CN108170273A - A kind of expert's remote guide system and implementation method based on hololens glasses - Google Patents
A kind of expert's remote guide system and implementation method based on hololens glasses Download PDFInfo
- Publication number
- CN108170273A CN108170273A CN201711467202.7A CN201711467202A CN108170273A CN 108170273 A CN108170273 A CN 108170273A CN 201711467202 A CN201711467202 A CN 201711467202A CN 108170273 A CN108170273 A CN 108170273A
- Authority
- CN
- China
- Prior art keywords
- hololens
- video
- intelligent glasses
- terminal device
- expert
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000011521 glass Substances 0.000 title claims abstract description 111
- 238000000034 method Methods 0.000 title claims abstract description 22
- 238000012423 maintenance Methods 0.000 claims abstract description 21
- 230000000007 visual effect Effects 0.000 claims abstract description 12
- 230000005540 biological transmission Effects 0.000 claims description 11
- 238000004891 communication Methods 0.000 claims description 9
- 238000002372 labelling Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 8
- 230000008054 signal transmission Effects 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000008439 repair process Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000033001 locomotion Effects 0.000 description 2
- 230000008846 dynamic interplay Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- -1 server Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000013024 troubleshooting Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a kind of expert's remote guide systems and implementation method based on hololens glasses, including hololens intelligent glasses, wireless router, server, terminal device, the audio and video of acquisition are forwarded to terminal device by hololens intelligent glasses by server, expert's input instruction content on the terminal device, guidance content under terminal device records, and guidance content is forwarded to hololens intelligent glasses by server, and shown in the visual field, instruct voice by what loudspeaker played out expert；Background terminal automatically generates maintenance record video file, and uploads onto the server.The present invention can accurately navigate to the information remotely marked on spatial position, make expert's remote guide more vivid, improve overhaul efficiency, improve maintenance accuracy；It can be interacted by modes such as voice, gestures with hololens glasses, liberate both hands；Maintenance record can preserve, convenient for tracking in the future.
Description
Technical field
The present invention relates to the technical fields of AR maintenances of equipment, and in particular to a kind of expert based on hololens glasses is long-range
Instruct system and implementation method.
Background technology
AR equipment is more and more applied at present, existing AR glasses are shown in three-dimensional overlay, image space positioning and
Perfect not enough in terms of operation and control, interactive mode is relatively simple in addition.A kind of realized using AR of Chinese invention patent is remotely referred to
Lead the method and apparatus (application publication number of scene investigation failure：CN107277451A), disclose its AR glasses, be installed in the AR
Camera, CPU module on glasses, wireless communication module, utilizing camera interface, video interface, remote terminal control system,
In, CPU module, wireless communication module, video interface, utilizing camera interface are integrated in a control box and are installed on AR glasses；
Module is connect CPU module with remote terminal control system wireless signal by radio communication；Camera by utilizing camera interface with
CPU module connects, and AR glasses are connect by video interface with CPU module.The invention can realize engineer on picture with skill
Art person carries out dynamic interaction, is only capable of realizing that video speech interaction and long-range mark, the information of mark can not be located in space
In, technician scene can not be allowed to check data, troubleshooting procedure can not record.
Invention content
Goal of the invention：It is of the existing technology in order to solve the problems, such as, it is provided for service personnel accurate efficient long-range real-time
Ability is instructed, the present invention provides a kind of expert's remote guide system and implementation method based on hololens glasses.
Technical solution：A kind of expert's remote guide implementation method based on hololens glasses, includes the following steps：
(1) field service personnel puts on hololens intelligent glasses, hololens intelligent glasses connection wireless router
WiFi；
(2) it is acquired using the camera on hololens intelligent glasses to currently overhauling scene, utilizes hololens
Microphone on intelligent glasses is acquired live sound；
(3) collected audio and video by encoder are encoded and is converted into audio/video flow, hololens intelligent glasses will
Audio/video flow is sent to server；
(4) after server receives audio/video flow, audio/video flow is sent on the terminal device of Remote；
(5) terminal device receives audio/video flow, and audio/video flow is handled, and playing audio-video；
(6) expert is labeled the position of live outdoor scene on video by terminal device, and and field service personnel
It carries out voice communication or sends video to field service personnel, position, figure and word that terminal device records are marked；Terminal
Position, figure, text information are converted into array by equipment, and voice and video information are converted into audio/video flow, then pass through network
Server is sent to, the position of mark, figure, word, voice and video information are forwarded to hololens intelligence by server again
Glasses；The entire instruction course of expert's mark is recorded a video by terminal device；
(7) after hololens intelligent glasses receive position, figure, word, voice and the video information of mark, by data into
Row conversion, and according to mark by graphic plotting to the corresponding position in space, and the word received, video are included
In the hololens intelligent glasses visual field, voice is played back by the loudspeaker of hololens intelligent glasses；
(8) after maintenance guidance, live video, the record of expert's instruction course are shielded and save as repair by rear PC machine automatically
Video file is recorded, and maintenance record video file is uploaded to server storage.
Preferably, the specific method that step (6), (7) show the figure that expert draws on hololens intelligent glasses
Including：It is existing all using the origin coordinates of hololens intelligent glasses as origin when hololens intelligent glasses and initial terminal device
When field service personnel wears hololens intelligent glasses, hololens intelligent glasses are periodically by the position of current eyeglasses and watcher
To terminal device is synchronized to, terminal device understands the position and direction of real-time update present viewing field, when expert is in terminal device screen
During upper graphing, the guiding software on terminal device records the coordinate of key point in figure, and periodically by crucial point coordinates
It is sent to long-range hololens intelligent glasses, after hololens intelligent glasses receive crucial point coordinates, the virtual screen before the visual field
According to crucial point coordinates graphing point on curtain, the figure that expert draws on the terminal device is formed.
Preferably, in the step (6), terminal device is PC machine, one or more, the expert in mobile phone, tablet computer
By mouse on computer display graphing or mobile phone, tablet computer touch screen on graphing.
A kind of expert's remote guide system based on hololens glasses, including hololens intelligent glasses, wireless routing
Device, server, terminal device, the hololens intelligent glasses, terminal device are by between wireless router and server
Carry out data transmission；
The hololens intelligent glasses include processor, memory, camera, headset, are stored in the memory
Computer program can realize following steps when described program is executed by processor：The sound that hololens intelligent glasses are acquired
Video data transmission is to server；Receive server send terminal device mark position, figure, word, voice and
Video；According to the position of mark by graphic plotting to the corresponding position in space, word, video are included in hololens intelligence
In the energy glasses visual field, voice is played out by the loudspeaker of hololens intelligent glasses；
The server includes processor, memory, is stored with computer program in the memory, described program is located
Reason device can realize following steps when performing：The audio, video data that hololens intelligent glasses transmit is received, and is forwarded to
Terminal device；Labeling position that receiving terminal apparatus transmits, figure, word, voice, video, and it is forwarded to hololens
Intelligent glasses；
The terminal device includes processor, memory, and computer program, described program quilt are stored in the memory
Processor can realize following steps when performing：The audio-video signal that server is sent is received, and is played on a display screen；
Labeling position, figure and the word of mouse or touch screen input are recorded, acquires video or voice, and by labeling position, figure, text
Word, voice and video signal transmission are to server.
Preferably, terminal device is one or more of PC machine, mobile phone, tablet computer.
Advantageous effect：Compare the prior art, and a kind of expert based on hololens glasses provided by the invention remotely refers to
Guiding systems and implementation method, have the following advantages：
(1) information remotely marked can be accurately navigated on spatial position, can skill be identified by voice command
Art realizes voice control, some specific gesture motions can be identified by three-dimensional object identification technology, so as to fulfill language
Sound, gesture transfer help study course, achieve the purpose that liberate both hands and can be by the modes such as voice, gesture and hololens
Mirror interacts, so as to liberate both hands；
(2) backstage expert can send and be shown in the information such as word, picture, video to hololens glasses, increase long-range
Interactive mode is instructed, makes expert's remote guide more vivid, improves overhaul efficiency, improves maintenance accuracy；
(3) maintenance record can preserve, convenient for tracking in the future；
(4) by organic integration such as hololens glasses, server, tablet computer, computers, the expert of complete set is formed
Remote guide system, convenient for being managed to service work；
(5) using Microsoft's hololens intelligent glasses, which has powerful 3-D view superposition plus space orientation energy
Markup information can be navigated to without changing position with walking about for operating personnel in space, but also can passed through by power
Gesture and voice are interacted with intelligent glasses, enhance interactivity, in addition, also adding word, picture, transmission of video function.
Description of the drawings
Fig. 1 is the structure chart of expert's remote guide system the present invention is based on hololens glasses；
Fig. 2 is the data flow diagram of expert's remote guide system the present invention is based on hololens glasses；
Fig. 3 is each module relation diagram of the present invention.
Specific embodiment
The invention will be further described in the following with reference to the drawings and specific embodiments.
As shown in Figure 1, a kind of expert's remote guide implementation method based on hololens glasses, includes the following steps：
(1) field service personnel puts on hololens intelligent glasses, hololens intelligent glasses connection wireless router
WiFi；
(2) it is acquired using the camera on hololens intelligent glasses to currently overhauling scene, utilizes hololens
Microphone on intelligent glasses is acquired live sound；
(3) video of acquisition is handled by CPU, is encoded with H264, and be converted into the audio/video flow of mp4 forms,
Audio/video flow is transferred to wireless router by hololens intelligent glasses by wifi module, and wireless router is again by data forwarding
To server；
(4) after server receives audio/video flow, audio/video flow is sent on the terminal device of Remote；
(5) terminal device receives audio/video flow, and audio/video flow is handled, and playing audio-video；
(6) expert is labeled the position of live outdoor scene on video by terminal device, and and field service personnel
It carries out voice communication or sends video to field service personnel, position, figure and word that terminal device records are marked；Terminal
Position, figure, text information are converted into array by equipment, after voice and video information to be converted into the audio/video flow of mp4 forms
Server is sent to by network again, the position of mark, figure, word, voice and video information are forwarded to by server again
Hololens intelligent glasses；The whole process of expert's mark is recorded a video by terminal device；
Its terminal device is PC machine, one or more in mobile phone, tablet computer, and expert is by mouse in Computer display
On screen graphing or mobile phone, tablet computer touch screen on graphing.
(7) after hololens intelligent glasses receive position, figure, word, voice and the video information of mark, by data into
Row conversion, and show tutorial message in holographic mirror on piece by graphic plotting to the corresponding position in space, and will receive
Word, video are shown in the hololens intelligent glasses visual field, and voice is played back by the loudspeaker of hololens intelligent glasses；
Wherein, the specific method that the figure that expert draws is shown on hololens intelligent glasses is included：hololens
All using the origin coordinates of hololens intelligent glasses as origin when intelligent glasses and initial terminal device, field service personnel is worn
During hololens intelligent glasses, the position of current eyeglasses and direction of observation are synchronized to terminal and set by the timing of hololens intelligent glasses
It is standby, the position and direction of terminal device meeting real-time update present viewing field, so as to fulfill hololens glasses and the seat of remote terminal
Mark system synchronizes, and when expert is in graphing on terminal device screen, the guiding software on terminal device, which is recorded in figure, to close
The coordinate of key point, and crucial point coordinates is sent to long-range hololens intelligent glasses by timing, hololens intelligent glasses receive
After crucial point coordinates, according to crucial point coordinates graphing point on the virtual screen before the visual field, expert is formed in terminal device
(virtual screen is equivalent to before the visual field is provided with a transparent screen to the figure of upper drafting, and the visual field of repair people is followed to walk
It is dynamic).
(8) after maintenance guidance, live video, the record of expert's instruction course are shielded and save as repair by rear PC machine automatically
Video file is recorded, and maintenance record video file is uploaded to server storage.
As shown in Fig. 2, the hardware platform of expert's remote guide system based on hololens glasses includes hololens
Mirror, wireless router, tablet computer, server, PC machine, hololens glasses are deployed in Overhaul site, and computer is deployed in specially
Family workplace, tablet computer can be carried by expert, and server disposition is in computer room.Expert's remote guide system is set each
It is standby to organically combine, form maintenance solution of the complete set based on AR.Terminal device in the present embodiment is tablet computer, PC
The other-ends such as machine or PC machine；The hololens intelligent glasses, terminal device pass through wireless router and service
Carry out data transmission between device；The data communication of each equipment room is received and dispatched using ICP/IP protocol by the socket interfaces of encapsulation
Data, for data with communication interface by optimization processing, occupied bandwidth is low, postpones low, zmodem.Hololens intelligent glasses collection
Into hardware devices such as processor, memory, camera, headsets, 10 operating systems of windows are carried, are equivalent to a wear
Formula computer as a holographic computing device, provides abundant application and development interface, supports a variety of windows exploitations works
Tool, the present invention can issue into windows, android, web etc. using unity3D applied software development system softwares, unity3D
The application software of multiple format, is greatly saved development cost.
The hololens intelligent glasses include processor, memory, camera, headset, are stored in the memory
Computer program can realize following steps when described program is executed by processor：The sound that hololens intelligent glasses are acquired
Video data transmission is to server；Receive server send terminal device mark position, figure, word, voice and
Video；According to the position of mark by graphic plotting to the corresponding position in space, word, video are included in hololens intelligence
In the energy glasses visual field, voice is played out by the loudspeaker of hololens intelligent glasses；
The server includes processor, memory, is stored with computer program in the memory, described program is located
Reason device can realize following steps when performing：The audio, video data that hololens intelligent glasses transmit is received, and is forwarded to
Terminal device；Labeling position that receiving terminal apparatus transmits, figure, word, voice, video, and it is forwarded to hololens
Intelligent glasses；
The terminal device includes processor, memory, and computer program, described program quilt are stored in the memory
Processor can realize following steps when performing：The audio-video signal that server is sent is received, and is played on a display screen；
Labeling position, figure and the word of mouse or touch screen input are recorded, acquires video or voice, and by labeling position, figure, text
Word, voice and video signal transmission are to server.
As shown in figure 3, system software mainly instructs client by hololens client softwares, back-stage management software, expert
Software composition is held, software is mainly instructed by Virtual Maintenance, and audio and video real-time Transmission is long-range to mark, word, picture, transmission of video,
Several module compositions such as back-stage management.Wherein, remote guide client software is disposed on hololens glasses, it is main to realize repair
Study course is instructed, audio and video real-time Transmission, and long-range mark display, word, picture, video reception are shown, the work(such as maintenance process video recording
Energy；Back-stage management software is disposed on server, mainly realizes the functions such as personal management, data forwarding, maintenance management statistics；Tablet
Expert is disposed on computer or computer and instructs client software, it is main to realize audio and video real-time Transmission, long-range to mark, word, figure
Piece, video are sent, the functions such as instruction course video recording.
Hololens intelligent glasses are applied to maintenance field by the present invention, by hololens glasses, tablet computer, service
Device, the system that Automated library system is complete set provide the maintenance solution based on AR of complete set.Expert can be long-range
Check the image on operating personnel's hololens glasses, moreover it is possible to drawing image and hololens glasses are transmitted in terminal, this
Outside can also be with operating personnel by voice communication, and the data such as word, picture, video can be sent and repair finger to operating personnel
It leads.Compared to traditional AR remote guide systems, hololens glasses show three by holographic process unit in holographic eyeglass
The figure of mark, is located on fixed position, operating personnel can also pass through by the holographic object of dimension by slam space orientation techniques
The modes such as gesture, voice and hololens intelligent glasses interact, and realize voice control by voice command identification technology, lead to
It crosses three-dimensional object identification technology and identifies some specific gesture motions, help study course is transferred so as to fulfill voice, gesture, solve
It puts both hands, improves working efficiency, in addition, expert can also send the information such as word, picture, video to hololens intelligent glasses,
And the video of entire maintenance process can be preserved, convenient for tracking in the future.The system can effectively promote the dimension of operating personnel
Ability is repaiied, enhances the working efficiency of maintenance personal, strengthens the tracking statistical power to maintenance process.
Claims (5)
1. a kind of expert's remote guide implementation method based on hololens glasses, which is characterized in that include the following steps：
(1) field service personnel puts on hololens intelligent glasses, hololens intelligent glasses connection wireless router WiFi；
(2) it is acquired using the camera on hololens intelligent glasses to currently overhauling scene, utilizes hololens intelligence
Microphone on glasses is acquired live sound；
(3) collected audio and video by encoder are encoded and is converted into audio/video flow, hololens intelligent glasses regard sound
Frequency stream is sent to server；
(4) after server receives audio/video flow, audio/video flow is sent on the terminal device of Remote；
(5) terminal device receives audio/video flow, and audio/video flow is handled, and playing audio-video；
(6) expert is labeled the position of live outdoor scene on video by terminal device, and is carried out with field service personnel
Voice communication sends video to field service personnel, position, figure and word that terminal device records are marked；Terminal device
Position, figure, text information are converted into array, voice and video information are converted into audio/video flow, then send by network
To server, the position of mark, figure, word, voice and video information are forwarded to hololens intelligent glasses by server again；
The entire instruction course of expert's mark is recorded a video by terminal device；
(7) after hololens intelligent glasses receive position, figure, word, voice and the video information of mark, data are turned
It changes, and according to mark by graphic plotting to the corresponding position in space, and the word received, video is included
In the hololens intelligent glasses visual field, voice is played back by the loudspeaker of hololens intelligent glasses；
(8) after maintenance guidance, live video, the record of expert's instruction course are shielded and save as maintenance record by rear PC machine automatically
Video file, and maintenance record video file is uploaded to server storage.
2. expert's remote guide implementation method according to claim 1 based on hololens glasses, which is characterized in that institute
It states in step (6), terminal device is PC machine, one or more in mobile phone, tablet computer, and expert is shown by mouse in computer
In display screen graphing or mobile phone, tablet computer touch screen on graphing.
3. expert's remote guide implementation method according to claim 1 based on hololens glasses, which is characterized in that step
Suddenly (6), (7) include the specific method that the figure that expert draws is shown on hololens intelligent glasses：Hololens intelligence
All using the origin coordinates of hololens intelligent glasses as origin when glasses and initial terminal device, field service personnel is worn
During hololens intelligent glasses, the position of current eyeglasses and direction of observation are synchronized to terminal and set by the timing of hololens intelligent glasses
It is standby, the position and direction of terminal device meeting real-time update present viewing field, when expert is in graphing on terminal device screen, eventually
Guiding software in end equipment records the coordinate of key point in figure, and crucial point coordinates is sent to remotely by timing
Hololens intelligent glasses, after hololens intelligent glasses receive crucial point coordinates, according to pass on the virtual screen before the visual field
Key point coordinates graphing point forms the figure that expert draws on the terminal device.
4. a kind of expert's remote guide system based on hololens glasses, which is characterized in that including hololens intelligent glasses,
Wireless router, server, terminal device, the hololens intelligent glasses, terminal device pass through wireless router and clothes
Carry out data transmission between business device；
The hololens intelligent glasses include processor, memory, camera, headset, and calculating is stored in the memory
Machine program can realize following steps when described program is executed by processor：The audio and video that hololens intelligent glasses are acquired
Data transmission is to server；Receive server send terminal device mark position, figure, word, voice and video；
According to the position of mark by graphic plotting to the corresponding position in space, word, video are included in hololens Brilliant Eyes
In the mirror visual field, voice is played out by the loudspeaker of hololens intelligent glasses；
The server includes processor, memory, is stored with computer program in the memory, described program is by processor
Following steps can be realized during execution：The audio, video data that hololens intelligent glasses transmit is received, and is forwarded to terminal
Equipment；Labeling position that receiving terminal apparatus transmits, figure, word, voice, video, and it is forwarded to hololens intelligence
Glasses；
The terminal device includes processor, memory, is stored with computer program in the memory, described program is handled
Device can realize following steps when performing：The audio-video signal that server is sent is received, and is played on a display screen；Record
The mouse or labeling position of touch screen input, figure and word, acquire video or voice, and by labeling position, figure, word,
Voice and video signal transmission are to server.
5. expert's remote guide system according to claim 4 based on hololens glasses, which is characterized in that terminal is set
Standby is one or more of PC machine, mobile phone, tablet computer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711467202.7A CN108170273A (en) | 2017-12-28 | 2017-12-28 | A kind of expert's remote guide system and implementation method based on hololens glasses |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711467202.7A CN108170273A (en) | 2017-12-28 | 2017-12-28 | A kind of expert's remote guide system and implementation method based on hololens glasses |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108170273A true CN108170273A (en) | 2018-06-15 |
Family
ID=62519666
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711467202.7A Pending CN108170273A (en) | 2017-12-28 | 2017-12-28 | A kind of expert's remote guide system and implementation method based on hololens glasses |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108170273A (en) |
Cited By (43)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108924224A (en) * | 2018-07-02 | 2018-11-30 | 国网山东省电力公司金乡县供电公司 | A kind of substation field maintenance and repair real-time communication system |
| CN108986556A (en) * | 2018-08-22 | 2018-12-11 | 高海龙 | A kind of aircraft remote technology clearance method, apparatus and smart machine |
| CN109187574A (en) * | 2018-08-16 | 2019-01-11 | 深圳市炬视科技有限公司 | A kind of tunnel defect detection and processing method based on holoscan |
| CN109302582A (en) * | 2018-09-19 | 2019-02-01 | 中国飞行试验研究院 | A kind of digitlization maintenance wearable device |
| CN109359202A (en) * | 2018-08-10 | 2019-02-19 | 昆仑智汇数据科技(北京)有限公司 | Electronic operation and maintenance work order automatic generation method and system based on audio frequency and video record |
| CN109452716A (en) * | 2018-12-26 | 2019-03-12 | 上海合时智能科技有限公司 | A kind of novel Anti-explosion helmet with MR video interactive function |
| CN109714575A (en) * | 2018-12-29 | 2019-05-03 | 广州德毅维才软件技术有限公司 | A kind of repair method based on internet remote command |
| CN109889767A (en) * | 2019-04-22 | 2019-06-14 | 台州智必安科技有限责任公司 | A kind of remote audio-video conference system and processing method based on multi-chain circuit transmission |
| CN110174423A (en) * | 2019-04-26 | 2019-08-27 | 云南电网有限责任公司电力科学研究院 | It is a kind of for X-ray detection it is long-range monitoring instruct system |
| CN110324560A (en) * | 2019-08-08 | 2019-10-11 | 北京佑仁天下网络科技有限公司 | A kind of long-distance video guide maintenance system |
| CN110458535A (en) * | 2019-08-20 | 2019-11-15 | 武汉邦拓信息科技有限公司 | A computer room operation and maintenance method based on AR glasses |
| CN110708384A (en) * | 2019-10-12 | 2020-01-17 | 西安维度视界科技有限公司 | Interaction method, system and storage medium of AR-based remote assistance system |
| CN110740285A (en) * | 2019-10-30 | 2020-01-31 | 中车青岛四方机车车辆股份有限公司 | A telematics method and device |
| CN110764615A (en) * | 2019-10-17 | 2020-02-07 | 辽宁中航信诺科技有限公司 | Checking and maintaining method of aircraft landing gear retraction system based on AR equipment |
| CN110956682A (en) * | 2019-11-26 | 2020-04-03 | 上海秒针网络科技有限公司 | Inspection result generation method and device |
| CN111049687A (en) * | 2019-12-23 | 2020-04-21 | 华自科技股份有限公司 | Equipment maintenance video operation guide file processing method and device and AR terminal |
| CN111260084A (en) * | 2020-01-09 | 2020-06-09 | 长安大学 | Remote system and method for collaborative assembly maintenance based on augmented reality |
| CN111464787A (en) * | 2020-04-09 | 2020-07-28 | 深圳市谦视智能科技有限责任公司 | Remote assistance method, terminal device and readable storage medium |
| CN112001709A (en) * | 2020-09-04 | 2020-11-27 | 贵州电网有限责任公司 | Intelligent assignment scheduling AR multi-person remote assistance method based on ant colony algorithm |
| CN112118413A (en) * | 2020-09-04 | 2020-12-22 | 瑞欧威尔(上海)智能科技有限公司 | Fire-fighting emergency remote command system based on head-mounted computer |
| CN112134836A (en) * | 2020-08-04 | 2020-12-25 | 广东希睿数字科技有限公司 | A system for remote guidance and operation of HMI equipment based on AR technology |
| CN112153267A (en) * | 2020-10-22 | 2020-12-29 | 国网江苏省电力有限公司镇江供电分公司 | Human eye visual angle limitation space operation remote monitoring system based on AR intelligent glasses |
| CN112515275A (en) * | 2020-11-09 | 2021-03-19 | 义乌市输变电工程有限公司 | Hardware interface device |
| CN112565658A (en) * | 2020-12-04 | 2021-03-26 | 杭州中车数字科技有限公司 | Equipment maintenance assisting method and system |
| CN112562091A (en) * | 2020-12-22 | 2021-03-26 | 国网上海市电力公司 | AR technology-based intelligent interaction method for electrical test |
| CN112613619A (en) * | 2020-11-30 | 2021-04-06 | 重庆电子工程职业学院 | Safety operation management system for gas area in workshop |
| CN112954280A (en) * | 2021-04-21 | 2021-06-11 | 国网瑞嘉(天津)智能机器人有限公司 | Intelligent wearable device-based manual live working system and method |
| CN112949376A (en) * | 2020-12-17 | 2021-06-11 | 宽衍(北京)科技发展有限公司 | Remote assistance system suitable for subway station |
| CN113112637A (en) * | 2021-03-30 | 2021-07-13 | 北京国电思达科技有限公司 | Handheld terminal and fan inspection online help seeking method and system |
| CN113393536A (en) * | 2021-07-03 | 2021-09-14 | 蒂姆维澳(上海)网络技术有限公司 | AR glasses-based remote operation and maintenance guidance control system and method |
| CN113411459A (en) * | 2021-06-10 | 2021-09-17 | 品令科技(北京)有限公司 | Remote voice interaction system and method controlled by initiator |
| WO2021208370A1 (en) * | 2020-04-13 | 2021-10-21 | 深圳市谦视智能科技有限责任公司 | Intelligent safety helmet apparatus |
| CN113542332A (en) * | 2020-04-22 | 2021-10-22 | 中移智行网络科技有限公司 | Customer service video interaction method and equipment based on positioning labels |
| CN113542714A (en) * | 2021-07-02 | 2021-10-22 | 恒大新能源汽车投资控股集团有限公司 | Remote interactive communication system and device |
| CN113556530A (en) * | 2021-07-22 | 2021-10-26 | 深圳市绿色智城科技有限公司 | Intelligent rail transit maintenance system and method based on wearable AR equipment |
| CN113596517A (en) * | 2021-07-13 | 2021-11-02 | 北京远舢智能科技有限公司 | Image freezing and labeling method and system based on mixed reality |
| CN113986011A (en) * | 2021-10-27 | 2022-01-28 | 北京乐驾科技有限公司 | Input method and device, storage medium, and electronic device for AR glasses |
| CN114191115A (en) * | 2021-12-22 | 2022-03-18 | 合肥德铭电子有限公司 | Intelligent endoscope system capable of marking surgical path planning and remote guidance |
| CN114401383A (en) * | 2021-12-22 | 2022-04-26 | 上海智能制造功能平台有限公司 | A remote expert guidance system and method |
| CN114863068A (en) * | 2022-04-22 | 2022-08-05 | 镇江电力设计院有限公司 | AR intelligent glasses for maintenance work and remote monitoring maintenance system |
| CN115633147A (en) * | 2022-10-12 | 2023-01-20 | 广东电网有限责任公司广州供电局 | A multi-person remote collaboration guidance system based on 5G multi-view |
| CN116320353A (en) * | 2023-02-13 | 2023-06-23 | 福建宁德核电有限公司 | Intelligent overhaul system based on natural language processing technology |
| WO2024250384A1 (en) * | 2023-06-09 | 2024-12-12 | 中国电子科技集团公司第三十八研究所 | Cross-terminal device data communication system based on augmented reality device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015060393A1 (en) * | 2013-10-25 | 2015-04-30 | 独立行政法人産業技術総合研究所 | Remote action guidance system and processing method therefor |
| CN105553978A (en) * | 2015-12-14 | 2016-05-04 | 西安科技大学 | Belt conveyor visualization auxiliary maintenance system and interaction process of streaming media |
| CN106340217A (en) * | 2016-10-31 | 2017-01-18 | 华中科技大学 | Augmented reality technology based manufacturing equipment intelligent system and its implementation method |
| CN106339094A (en) * | 2016-09-05 | 2017-01-18 | 山东万腾电子科技有限公司 | Interactive remote expert cooperation maintenance system and method based on augmented reality technology |
| CN107172390A (en) * | 2017-05-12 | 2017-09-15 | 广州市和佳电子科技有限公司 | It is a kind of based on intelligent glasses for terminal platform visualization system and implementation method |
| CN107277451A (en) * | 2017-07-14 | 2017-10-20 | 福建铁工机智能机器人有限公司 | A kind of utilization AR realizes the method and apparatus of remote guide scene investigation failure |
-
2017
- 2017-12-28 CN CN201711467202.7A patent/CN108170273A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015060393A1 (en) * | 2013-10-25 | 2015-04-30 | 独立行政法人産業技術総合研究所 | Remote action guidance system and processing method therefor |
| CN105553978A (en) * | 2015-12-14 | 2016-05-04 | 西安科技大学 | Belt conveyor visualization auxiliary maintenance system and interaction process of streaming media |
| CN106339094A (en) * | 2016-09-05 | 2017-01-18 | 山东万腾电子科技有限公司 | Interactive remote expert cooperation maintenance system and method based on augmented reality technology |
| CN106340217A (en) * | 2016-10-31 | 2017-01-18 | 华中科技大学 | Augmented reality technology based manufacturing equipment intelligent system and its implementation method |
| CN107172390A (en) * | 2017-05-12 | 2017-09-15 | 广州市和佳电子科技有限公司 | It is a kind of based on intelligent glasses for terminal platform visualization system and implementation method |
| CN107277451A (en) * | 2017-07-14 | 2017-10-20 | 福建铁工机智能机器人有限公司 | A kind of utilization AR realizes the method and apparatus of remote guide scene investigation failure |
Cited By (53)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108924224B (en) * | 2018-07-02 | 2020-11-13 | 国网山东省电力公司金乡县供电公司 | Real-time communication system for field maintenance and repair of transformer substation |
| CN108924224A (en) * | 2018-07-02 | 2018-11-30 | 国网山东省电力公司金乡县供电公司 | A kind of substation field maintenance and repair real-time communication system |
| CN109359202A (en) * | 2018-08-10 | 2019-02-19 | 昆仑智汇数据科技(北京)有限公司 | Electronic operation and maintenance work order automatic generation method and system based on audio frequency and video record |
| CN109187574A (en) * | 2018-08-16 | 2019-01-11 | 深圳市炬视科技有限公司 | A kind of tunnel defect detection and processing method based on holoscan |
| CN108986556A (en) * | 2018-08-22 | 2018-12-11 | 高海龙 | A kind of aircraft remote technology clearance method, apparatus and smart machine |
| CN109302582A (en) * | 2018-09-19 | 2019-02-01 | 中国飞行试验研究院 | A kind of digitlization maintenance wearable device |
| CN109452716A (en) * | 2018-12-26 | 2019-03-12 | 上海合时智能科技有限公司 | A kind of novel Anti-explosion helmet with MR video interactive function |
| CN109714575A (en) * | 2018-12-29 | 2019-05-03 | 广州德毅维才软件技术有限公司 | A kind of repair method based on internet remote command |
| CN109889767A (en) * | 2019-04-22 | 2019-06-14 | 台州智必安科技有限责任公司 | A kind of remote audio-video conference system and processing method based on multi-chain circuit transmission |
| CN110174423A (en) * | 2019-04-26 | 2019-08-27 | 云南电网有限责任公司电力科学研究院 | It is a kind of for X-ray detection it is long-range monitoring instruct system |
| CN110324560A (en) * | 2019-08-08 | 2019-10-11 | 北京佑仁天下网络科技有限公司 | A kind of long-distance video guide maintenance system |
| CN110458535A (en) * | 2019-08-20 | 2019-11-15 | 武汉邦拓信息科技有限公司 | A computer room operation and maintenance method based on AR glasses |
| CN110708384A (en) * | 2019-10-12 | 2020-01-17 | 西安维度视界科技有限公司 | Interaction method, system and storage medium of AR-based remote assistance system |
| CN110764615A (en) * | 2019-10-17 | 2020-02-07 | 辽宁中航信诺科技有限公司 | Checking and maintaining method of aircraft landing gear retraction system based on AR equipment |
| CN110764615B (en) * | 2019-10-17 | 2023-08-04 | 辽宁中航信诺科技有限公司 | Method for checking and maintaining aircraft landing gear retraction system based on AR equipment |
| CN110740285A (en) * | 2019-10-30 | 2020-01-31 | 中车青岛四方机车车辆股份有限公司 | A telematics method and device |
| CN110956682A (en) * | 2019-11-26 | 2020-04-03 | 上海秒针网络科技有限公司 | Inspection result generation method and device |
| CN110956682B (en) * | 2019-11-26 | 2024-04-12 | 上海明胜品智人工智能科技有限公司 | Inspection result generation method and device |
| CN111049687A (en) * | 2019-12-23 | 2020-04-21 | 华自科技股份有限公司 | Equipment maintenance video operation guide file processing method and device and AR terminal |
| CN111049687B (en) * | 2019-12-23 | 2023-03-24 | 华自科技股份有限公司 | Equipment maintenance video operation guide file processing method and device and AR terminal |
| CN111260084A (en) * | 2020-01-09 | 2020-06-09 | 长安大学 | Remote system and method for collaborative assembly maintenance based on augmented reality |
| CN111260084B (en) * | 2020-01-09 | 2024-03-15 | 长安大学 | Remote system and method based on augmented reality cooperative assembly maintenance |
| CN111464787A (en) * | 2020-04-09 | 2020-07-28 | 深圳市谦视智能科技有限责任公司 | Remote assistance method, terminal device and readable storage medium |
| WO2021208370A1 (en) * | 2020-04-13 | 2021-10-21 | 深圳市谦视智能科技有限责任公司 | Intelligent safety helmet apparatus |
| CN113542332B (en) * | 2020-04-22 | 2023-04-07 | 中移智行网络科技有限公司 | Customer service video interaction method and equipment based on positioning labels |
| CN113542332A (en) * | 2020-04-22 | 2021-10-22 | 中移智行网络科技有限公司 | Customer service video interaction method and equipment based on positioning labels |
| CN112134836A (en) * | 2020-08-04 | 2020-12-25 | 广东希睿数字科技有限公司 | A system for remote guidance and operation of HMI equipment based on AR technology |
| CN112001709A (en) * | 2020-09-04 | 2020-11-27 | 贵州电网有限责任公司 | Intelligent assignment scheduling AR multi-person remote assistance method based on ant colony algorithm |
| CN112118413A (en) * | 2020-09-04 | 2020-12-22 | 瑞欧威尔(上海)智能科技有限公司 | Fire-fighting emergency remote command system based on head-mounted computer |
| CN112153267A (en) * | 2020-10-22 | 2020-12-29 | 国网江苏省电力有限公司镇江供电分公司 | Human eye visual angle limitation space operation remote monitoring system based on AR intelligent glasses |
| CN112515275A (en) * | 2020-11-09 | 2021-03-19 | 义乌市输变电工程有限公司 | Hardware interface device |
| CN112613619B (en) * | 2020-11-30 | 2024-04-09 | 重庆电子工程职业学院 | Safety operation management system for gas area in workshop |
| CN112613619A (en) * | 2020-11-30 | 2021-04-06 | 重庆电子工程职业学院 | Safety operation management system for gas area in workshop |
| CN112565658A (en) * | 2020-12-04 | 2021-03-26 | 杭州中车数字科技有限公司 | Equipment maintenance assisting method and system |
| CN112949376A (en) * | 2020-12-17 | 2021-06-11 | 宽衍(北京)科技发展有限公司 | Remote assistance system suitable for subway station |
| CN112562091A (en) * | 2020-12-22 | 2021-03-26 | 国网上海市电力公司 | AR technology-based intelligent interaction method for electrical test |
| CN113112637A (en) * | 2021-03-30 | 2021-07-13 | 北京国电思达科技有限公司 | Handheld terminal and fan inspection online help seeking method and system |
| CN112954280A (en) * | 2021-04-21 | 2021-06-11 | 国网瑞嘉(天津)智能机器人有限公司 | Intelligent wearable device-based manual live working system and method |
| CN112954280B (en) * | 2021-04-21 | 2023-08-04 | 国网瑞嘉(天津)智能机器人有限公司 | Artificial live working system and method based on intelligent wearable equipment |
| CN113411459B (en) * | 2021-06-10 | 2022-11-11 | 品令科技(北京)有限公司 | Remote voice interaction system and method controlled by initiator |
| CN113411459A (en) * | 2021-06-10 | 2021-09-17 | 品令科技(北京)有限公司 | Remote voice interaction system and method controlled by initiator |
| CN113542714A (en) * | 2021-07-02 | 2021-10-22 | 恒大新能源汽车投资控股集团有限公司 | Remote interactive communication system and device |
| CN113393536A (en) * | 2021-07-03 | 2021-09-14 | 蒂姆维澳(上海)网络技术有限公司 | AR glasses-based remote operation and maintenance guidance control system and method |
| CN113393536B (en) * | 2021-07-03 | 2023-01-10 | 蒂姆维澳(上海)网络技术有限公司 | AR glasses-based remote operation and maintenance guidance control system and method |
| CN113596517A (en) * | 2021-07-13 | 2021-11-02 | 北京远舢智能科技有限公司 | Image freezing and labeling method and system based on mixed reality |
| CN113556530A (en) * | 2021-07-22 | 2021-10-26 | 深圳市绿色智城科技有限公司 | Intelligent rail transit maintenance system and method based on wearable AR equipment |
| CN113986011A (en) * | 2021-10-27 | 2022-01-28 | 北京乐驾科技有限公司 | Input method and device, storage medium, and electronic device for AR glasses |
| CN114401383A (en) * | 2021-12-22 | 2022-04-26 | 上海智能制造功能平台有限公司 | A remote expert guidance system and method |
| CN114191115A (en) * | 2021-12-22 | 2022-03-18 | 合肥德铭电子有限公司 | Intelligent endoscope system capable of marking surgical path planning and remote guidance |
| CN114863068A (en) * | 2022-04-22 | 2022-08-05 | 镇江电力设计院有限公司 | AR intelligent glasses for maintenance work and remote monitoring maintenance system |
| CN115633147A (en) * | 2022-10-12 | 2023-01-20 | 广东电网有限责任公司广州供电局 | A multi-person remote collaboration guidance system based on 5G multi-view |
| CN116320353A (en) * | 2023-02-13 | 2023-06-23 | 福建宁德核电有限公司 | Intelligent overhaul system based on natural language processing technology |
| WO2024250384A1 (en) * | 2023-06-09 | 2024-12-12 | 中国电子科技集团公司第三十八研究所 | Cross-terminal device data communication system based on augmented reality device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108170273A (en) | A kind of expert's remote guide system and implementation method based on hololens glasses | |
| CN103631221B (en) | A kind of distant operate services robot system | |
| US8903317B2 (en) | System and method for controlling an infrared camera using a mobile phone | |
| CN107547554A (en) | A kind of smart machine remote assisting system based on augmented reality | |
| CN201887888U (en) | Network video monitor system | |
| CN203012636U (en) | Man-machine interactive system based on laser projection positioning | |
| CN108156033A (en) | The wearable maintenance support of unmanned plane supports system | |
| CN108021046A (en) | A kind of robot for realizing human-computer interaction | |
| CN102184007B (en) | Interactive intelligent conference system based on pattern recognition and using method thereof | |
| CN107426508A (en) | A kind of method that long-range security inspection is realized using AR | |
| CN110740285A (en) | A telematics method and device | |
| CN107741785B (en) | Remote guidance method and system for protecting front end safety | |
| CN103957376A (en) | Infrared thermal-image probe controlling system and method based on mobile intelligent terminal | |
| CN207264613U (en) | A kind of equipment that remote guide scene investigation failure is realized using AR | |
| CN109167955A (en) | A kind of system and method for big smaller screen synchronization and Interaction Cooperation based on network communication | |
| CN116489149A (en) | Construction method of cloud-edge-device collaboration mixed reality collaboration environment for industrial applications | |
| CN203966055U (en) | Wireless interaction optical projection system | |
| CN208589071U (en) | A museum digital viewing system | |
| CN203276606U (en) | Video real object displaying system with network function | |
| CN202058115U (en) | Mouse controlling means based on mouse laser pen | |
| CN108076323A (en) | A kind of visual monitor method | |
| CN106899599A (en) | A kind of industrial environment outdoor scene enhanced exchange method | |
| CN117311506A (en) | Augmented reality interaction method and device and augmented reality equipment | |
| CN213276586U (en) | Visual echoing interaction system based on WIFI6 technology | |
| CN103177373A (en) | Interactive commercial experiencing method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180615 |
|
| RJ01 | Rejection of invention patent application after publication |