[go: up one dir, main page]

CN107578110A - A kind of repair message method for visualizing based on augmented reality - Google Patents

A kind of repair message method for visualizing based on augmented reality Download PDF

Info

Publication number
CN107578110A
CN107578110A CN201710851776.8A CN201710851776A CN107578110A CN 107578110 A CN107578110 A CN 107578110A CN 201710851776 A CN201710851776 A CN 201710851776A CN 107578110 A CN107578110 A CN 107578110A
Authority
CN
China
Prior art keywords
augmented reality
data
maintenance
smart machine
maintenance objects
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710851776.8A
Other languages
Chinese (zh)
Inventor
罗千科
王毅
史晓刚
徐培培
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaolong Technology Co Ltd
Original Assignee
Beijing Xiaolong Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaolong Technology Co Ltd filed Critical Beijing Xiaolong Technology Co Ltd
Priority to CN201710851776.8A priority Critical patent/CN107578110A/en
Publication of CN107578110A publication Critical patent/CN107578110A/en
Pending legal-status Critical Current

Links

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a kind of repair message method for visualizing based on augmented reality, including:Desktop end computing device, the related mantenance data of typing maintenance objects, and send and store to server device;Server device, related mantenance data is stored, receive the real scene data that augmented reality smart machine is sent, and the related mantenance data of corresponding maintenance objects is sent to augmented reality smart machine;Augmented reality smart machine, the real scene data of collection maintenance objects are worn for maintenance personal, and sent to server device;And receive the related mantenance data for the corresponding maintenance objects that server device is beamed back, and it is visual information that Projection Display is carried out in a manner of augmented reality to the related mantenance datas of the corresponding maintenance objects of reception, maintenance personal is interacted operation to the visual information.This method can more intuitively show the related mantenance data of maintenance objects to maintenance personal, and maintenance personal can be made intuitively to be instructed during the maintenance operation of complexity, lift maintenance efficiency.

Description

A kind of repair message method for visualizing based on augmented reality
Technical field
The present invention relates to maintenance field, more particularly to a kind of repair message method for visualizing based on augmented reality.
Background technology
In maintenance field, the maintenance maintenance of equipment, ensureing the stable operation of equipment has extremely important effect.Yet with Product form is complicated, and instrument and equipment is accurate.Cause maintenance personal can not remember each details of operation or each parts of understanding, no Lasting standard operation is can guarantee that, the experience of operating personnel, which lacks, causes the maintenance maintenance of equipment to become more and more difficult, maintenance effect Rate is not guaranteed.And conventional art is cumbersome for maintenance personal, this low problem of efficiency never has good solution party Case.
The content of the invention
Based on the problems of prior art, it is an object of the invention to provide a kind of repair message based on augmented reality Method for visualizing, can solve maintenance field maintenance personal because cumbersome, repair message directly perceived can not be obtained in operation The problem of maintenance efficiency is low caused by guidance.
The purpose of the present invention is achieved through the following technical solutions:
Embodiment of the present invention provides a kind of repair message method for visualizing based on augmented reality, using by augmented reality The repair message visualization system of smart machine, desktop end computing device and server device composition;Wherein, the augmented reality Smart machine is communicated to connect by network and the server device respectively with desktop end computing device, is comprised the following steps:
The desktop end computing device, repaired for the related mantenance data of typing maintenance objects, and by the correlation of typing Information sends and stored to the server device;
The server device, for storing the related mantenance data of maintenance objects, and receive the augmented reality intelligence Can the real scene data of maintenance objects that send of equipment, and according to the real scene data to the augmented reality smart machine Send the related mantenance data of corresponding maintenance objects;
The augmented reality smart machine, the real scene data of maintenance objects are gathered for maintenance personal's wearing, and The real scene data gathered are sent to the server device by network;And for receiving the server device The related mantenance data for the corresponding maintenance objects that the real scene data sent according to the augmented reality smart machine are beamed back, and it is right It is visual information that the related mantenance data of the corresponding maintenance objects of reception carries out Projection Display in a manner of augmented reality, makes dimension The personnel of repairing can interact operation to the visual information.
As seen from the above technical solution provided by the invention, the dimension provided in an embodiment of the present invention based on augmented reality Information visualization methods are repaiied, its advantage is:
The dimension formed by using the augmented reality smart machine, desktop end computing device and server device of communication connection Information Visualization System is repaiied, the related mantenance data from desktop end computing device to server device typing maintenance objects, and After the real scene data of augmented reality smart machine collection maintenance objects, server device, will according to the real scene data The related mantenance data of the maintenance objects of association is sent to augmented reality smart machine, existing to strengthen by augmented reality smart machine It is visual information that real mode, which carries out Projection Display, facilitates maintenance personal to interact operation to visual information, completely dimension Repair.This method can more intuitively show the related mantenance data of maintenance objects to maintenance personal, can make maintenance personal in the dimension of complexity Repair in operating process and intuitively instructed, lift maintenance efficiency.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, required use in being described below to embodiment Accompanying drawing be briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for this For the those of ordinary skill in field, on the premise of not paying creative work, other can also be obtained according to these accompanying drawings Accompanying drawing.
Fig. 1 is augmented reality smart machine and server device interactive stream in method for visualizing provided in an embodiment of the present invention Cheng Tu;
Fig. 2 is method for visualizing system for use in carrying schematic diagram provided in an embodiment of the present invention;
Fig. 3 is Desktop computing device and server device interaction flow in method for visualizing provided in an embodiment of the present invention Figure.
Embodiment
With reference to the particular content of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely retouched State, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.Based on the present invention Embodiment, the every other embodiment that those of ordinary skill in the art are obtained under the premise of creative work is not made, Belong to protection scope of the present invention.The content not being described in detail in the embodiment of the present invention belongs to professional and technical personnel in the field Known prior art.
As shown in Figures 1 to 3, the embodiment of the present invention provides a kind of repair message method for visualizing based on augmented reality, adopts With the repair message visualization system being made up of augmented reality smart machine, desktop end computing device and server device;Wherein, Augmented reality smart machine is communicated to connect by network and server device respectively with desktop end computing device, including following step Suddenly:
Desktop end computing device, for the related mantenance data of typing maintenance objects, and by the related repair message of typing Send and store to server device;
Server device, for storing the related mantenance data of maintenance objects, and receive augmented reality smart machine hair The real scene data for the maintenance objects sent, and send corresponding maintenance to augmented reality smart machine according to the real scene data The related mantenance data of object;
Augmented reality smart machine, the real scene data of maintenance objects are gathered for maintenance personal's wearing, and are passed through Network sends the real scene data gathered to server device;And showed for receiving server device according to the enhancing The related mantenance data for the corresponding maintenance objects that the real scene data that real smart machine is sent are beamed back, and the corresponding of reception is tieed up The related mantenance data for repairing object carries out Projection Display as visual information in a manner of augmented reality, enables maintenance personal to this Visual information interacts operation.
In the above method, the related mantenance data of the maintenance objects of desktop end computing device typing includes:Maintenance objects The image and information data that relevant information, the 3D models of maintenance objects, the AR effects of maintenance objects associate with maintenance objects.
In the above method, server device sends corresponding maintenance according to the real scene data to augmented reality smart machine The related mantenance data of object is:
Server device carries out data processing and analysis to the real scene data of reception, takes out and the real scene data The related mantenance data of the corresponding maintenance objects of association.
In the above method, augmented reality smart machine is existing to strengthen to the related mantenance data of the corresponding maintenance objects of reception It is that visual information is that real mode, which carries out Projection Display,:
After augmented reality smart machine receives the related mantenance data of corresponding maintenance objects, repaired according to the correlation received The relative position of data analysis virtual scene and real scene, and after the fusion for carrying out virtual scene of aliging, with augmented reality It is visual information that mode, which carries out Projection Display,.
The embodiment of the present invention is specifically described in further detail below.
As shown in Figure 1 to Figure 3, the present embodiment provides a kind of repair message method for visualizing based on augmented reality, the party The information visualization process of method is by augmented reality smart machine (the present embodiment is by taking AR intelligent glasses as an example), server device, table Face computing device (pc machines) is realized jointly.Wherein, augmented reality smart machine, as the gathering of 3D material object information, information in kind Visualization processing and information real Overlay displaying;Server device carries out the letter of augmented reality smart machine collection Cease 2D/3D image procossings (image recognition, image matching algorithm can be used to handle, or be handled using machine learning algorithm), big number According to processing and obtain image and data association information;Desktop computing device carries out the typing of related repair message, the record of 3D models Enter, the typing of AR effects, image associate with information data, the overall structure of this method system for use in carrying is as shown in Fig. 2.Maintenance personal In maintenance process, augmented reality smart machine is worn, is set by augmented reality smart machine and server device, Desktop Computing Standby multiterminal, which coordinate, realizes that repair message visualizes, and liberates both hands, is absorbed in maintenance, improves maintenance personal's operating efficiency.
The specific implementation flow of this method is as follows:
Real scene or image are gathered by augmented reality smart machine;, will by Wifi or mobile data network Gathered real scene or image, are transmitted to server device;Data processing and analysis will be carried out in server device in information, The information data associated with image is taken out, augmented reality smart machine is transmitted to by Wifi or mobile data network;Enhancing is existing After real smart machine receives data, the relative position of virtual scene and real scene is analyzed according to the data received, and it is right The neat fusion for carrying out virtual scene, Projection Display is carried out by augmented reality smart machine, carry out the interaction behaviour of visual information Make such as Fig. 1.Desktop computing device is mainly responsible for repair message, 3D models, the typing of AR effects and the pass of information and graphical information Connection, repair message and the incidence relation storage of typing are arrived by procotol by server device such as Fig. 3.
The method of the present invention, by augmented reality (AR) technology, by the operating procedure of maintenance and corresponding video, figure Text, 3D operation demonstrations are visualized, and superposition in real time is shown in reality.Make that maintenance personal is more directly perceived, is efficiently tieed up Repair operation.The augmented reality smart machine of wearing, can be visual simultaneously by repair message, can record the operation of maintenance personal Process and flow.Be easy to maintenance technique accumulation and maintenance problem it is traceable.The technology video of record can be used for training new Employee, reduce the personnel training cost accounting of enterprise.After repair message visualization, maintenance personal can specify maintenance flow, be absorbed in In maintenance work, maintenance efficiency is improved, reduces maintenance error rate.This method is from the appearance form of information and interactive mode etc. It is low to solve the problems, such as currently to repair field maintenance personal's efficiency.Make maintenance, the point of complex device by augmented reality AR Inspection becomes intuitive and convenient.Change the mode that original maintenance of equipment is safeguarded, raising efficiency, quality assurance.The present invention is based on service End, smart machine (augmented reality smart machine) multiterminal coordinate, and realize the visualization of repair message.
The foregoing is only a preferred embodiment of the present invention, but protection scope of the present invention be not limited thereto, Any one skilled in the art is in the technical scope of present disclosure, the change or replacement that can readily occur in, It should all be included within the scope of the present invention.Therefore, protection scope of the present invention should be with the protection model of claims Enclose and be defined.

Claims (6)

  1. A kind of 1. repair message method for visualizing based on augmented reality, it is characterised in that using by augmented reality smart machine, The repair message visualization system of desktop end computing device and server device composition;Wherein, the augmented reality smart machine Communicated to connect, comprised the following steps by network and the server device respectively with desktop end computing device:
    The desktop end computing device, for the related mantenance data of typing maintenance objects, and by the related repair message of typing Send and store to the server device;
    The server device, for storing the related mantenance data of maintenance objects, and receive the augmented reality and intelligently set The real scene data for the maintenance objects that preparation is sent, and sent according to the real scene data to the augmented reality smart machine The related mantenance data of corresponding maintenance objects;
    The augmented reality smart machine, the real scene data of maintenance objects are gathered for maintenance personal's wearing, and are passed through Network sends the real scene data gathered to the server device;And for receive the server device according to The related mantenance data for the corresponding maintenance objects that the real scene data that the augmented reality smart machine is sent are beamed back, and to receiving The related mantenance datas of corresponding maintenance objects Projection Display is carried out in a manner of augmented reality is visual information, make maintenance people Member can interact operation to the visual information.
  2. 2. a kind of repair message method for visualizing based on augmented reality according to claim 1, it is characterised in that described The related mantenance data of the maintenance objects of desktop end computing device typing includes:
    The image that the relevant information of maintenance objects, the 3D models of maintenance objects, the AR effects of maintenance objects associate with maintenance objects And information data.
  3. A kind of 3. repair message method for visualizing based on augmented reality according to claim 1 or 2, it is characterised in that The server device sends the correlation of corresponding maintenance objects according to the real scene data to the augmented reality smart machine Mantenance data is:
    The server device carries out data processing and analysis to the real scene data of reception, takes out and the real scene data The related mantenance data of the corresponding maintenance objects of association.
  4. A kind of 4. repair message method for visualizing based on augmented reality according to claim 1 or 2, it is characterised in that The augmented reality smart machine is thrown in a manner of augmented reality the related mantenance data of the corresponding maintenance objects of reception Shadow is shown as visual information:
    After the augmented reality smart machine receives the related mantenance data of corresponding maintenance objects, repaired according to the correlation received The relative position of data analysis virtual scene and real scene, and after the fusion for carrying out virtual scene of aliging, with augmented reality It is visual information that mode, which carries out Projection Display,.
  5. A kind of 5. repair message method for visualizing based on augmented reality according to claim 1 or 2, it is characterised in that The augmented reality smart machine uses:Any of AR intelligent glasses, AR intelligent helmets, smart mobile phone.
  6. A kind of 6. repair message method for visualizing based on augmented reality according to claim 1 or 2, it is characterised in that The AR intelligent glasses use binocular or monocular instrumnent.
CN201710851776.8A 2017-09-19 2017-09-19 A kind of repair message method for visualizing based on augmented reality Pending CN107578110A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710851776.8A CN107578110A (en) 2017-09-19 2017-09-19 A kind of repair message method for visualizing based on augmented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710851776.8A CN107578110A (en) 2017-09-19 2017-09-19 A kind of repair message method for visualizing based on augmented reality

Publications (1)

Publication Number Publication Date
CN107578110A true CN107578110A (en) 2018-01-12

Family

ID=61033950

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710851776.8A Pending CN107578110A (en) 2017-09-19 2017-09-19 A kind of repair message method for visualizing based on augmented reality

Country Status (1)

Country Link
CN (1) CN107578110A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109102087A (en) * 2018-08-02 2018-12-28 广东电网有限责任公司 Guidance method, device and server on equipment O&M line
CN109298991A (en) * 2018-11-23 2019-02-01 珠海格力电器股份有限公司 Equipment fault processing method and device and terminal
CN109407899A (en) * 2018-09-12 2019-03-01 北京星云城科技有限公司 A kind of desktop alternative projection system
CN110490339A (en) * 2019-08-23 2019-11-22 北京枭龙科技有限公司 A kind of auto repair auxiliary system and method based on augmented reality
CN111538414A (en) * 2020-04-28 2020-08-14 北京航空航天大学 Maintenance visual automatic judgment method and system
CN111612177A (en) * 2020-05-18 2020-09-01 上海齐网网络科技有限公司 Interactive semantic based augmented reality intelligent operation and maintenance system
CN114254693A (en) * 2021-11-11 2022-03-29 国网河北省电力有限公司电力科学研究院 Simulation maintenance method, device and terminal for substation equipment
CN115437507A (en) * 2022-11-07 2022-12-06 中科航迈数控软件(深圳)有限公司 AR (augmented reality) -glasses-based equipment maintenance guiding method and system and related equipment
CN116320353A (en) * 2023-02-13 2023-06-23 福建宁德核电有限公司 Intelligent overhaul system based on natural language processing technology

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104484523A (en) * 2014-12-12 2015-04-01 西安交通大学 Equipment and method for realizing augmented reality induced maintenance system
CN106340217A (en) * 2016-10-31 2017-01-18 华中科技大学 Augmented reality technology based manufacturing equipment intelligent system and its implementation method
CN106339094A (en) * 2016-09-05 2017-01-18 山东万腾电子科技有限公司 Interactive remote expert cooperation maintenance system and method based on augmented reality technology

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104484523A (en) * 2014-12-12 2015-04-01 西安交通大学 Equipment and method for realizing augmented reality induced maintenance system
CN106339094A (en) * 2016-09-05 2017-01-18 山东万腾电子科技有限公司 Interactive remote expert cooperation maintenance system and method based on augmented reality technology
CN106340217A (en) * 2016-10-31 2017-01-18 华中科技大学 Augmented reality technology based manufacturing equipment intelligent system and its implementation method

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109102087A (en) * 2018-08-02 2018-12-28 广东电网有限责任公司 Guidance method, device and server on equipment O&M line
CN109407899A (en) * 2018-09-12 2019-03-01 北京星云城科技有限公司 A kind of desktop alternative projection system
CN109298991A (en) * 2018-11-23 2019-02-01 珠海格力电器股份有限公司 Equipment fault processing method and device and terminal
CN110490339A (en) * 2019-08-23 2019-11-22 北京枭龙科技有限公司 A kind of auto repair auxiliary system and method based on augmented reality
CN111538414A (en) * 2020-04-28 2020-08-14 北京航空航天大学 Maintenance visual automatic judgment method and system
CN111612177A (en) * 2020-05-18 2020-09-01 上海齐网网络科技有限公司 Interactive semantic based augmented reality intelligent operation and maintenance system
CN111612177B (en) * 2020-05-18 2023-06-27 上海齐网网络科技有限公司 Augmented reality intelligent operation and maintenance system based on interaction semantics
CN114254693A (en) * 2021-11-11 2022-03-29 国网河北省电力有限公司电力科学研究院 Simulation maintenance method, device and terminal for substation equipment
CN115437507A (en) * 2022-11-07 2022-12-06 中科航迈数控软件(深圳)有限公司 AR (augmented reality) -glasses-based equipment maintenance guiding method and system and related equipment
CN115437507B (en) * 2022-11-07 2023-04-07 中科航迈数控软件(深圳)有限公司 AR (augmented reality) -glasses-based equipment maintenance guiding method and system and related equipment
CN116320353A (en) * 2023-02-13 2023-06-23 福建宁德核电有限公司 Intelligent overhaul system based on natural language processing technology

Similar Documents

Publication Publication Date Title
CN107578110A (en) A kind of repair message method for visualizing based on augmented reality
CN111526118B (en) Remote operation guiding system and method based on mixed reality
CN111260084B (en) Remote system and method based on augmented reality cooperative assembly maintenance
CN110266992A (en) A kind of long-distance video interactive system and method based on augmented reality
CN106339094B (en) Interactive remote expert cooperation examination and repair system and method based on augmented reality
CN111679740A (en) A method for remote intelligent diagnosis of power station equipment using augmented reality AR technology
CN104899825B (en) A kind of method and apparatus of pair of picture character moulding
Porcelli et al. Technical and organizational issues about the introduction of augmented reality in maintenance and technical assistance services
CN104469287A (en) Virtual agent system for remote VTM and implementation method of virtual agent system
CN108156033A (en) The wearable maintenance support of unmanned plane supports system
CN110213648A (en) One kind is the same as screen method, system, mobile terminal and computer readable storage medium
CN109669658A (en) A kind of display methods, device and display system
CN204810307U (en) Unmanned aerial vehicle wearing formula maintenance guarantee support system
CN210006245U (en) augmented reality multi-person collaborative simulation system for power equipment training
CN111311973A (en) Simulation examination system for distribution network uninterrupted operation
CN109857261A (en) A kind of multi-screen interactive VR teaching and training method, system, terminal and storage medium
CN104731338A (en) Closed type augmented and virtual reality system and method
CN113407035A (en) Communication facility maintenance operation system based on MR mixed reality technology
CN111710032B (en) Method, device, equipment and medium for constructing three-dimensional model of transformer substation
CN207123961U (en) Immersion multi-person synergy trainer for the three-dimensional arc curtain formula of Substation Training
CN210804322U (en) Virtual and real scene operation platform based on 5G and MR technology
CN107688898A (en) A kind of Electric Power Marketing System and method based on intelligent management platform
CN113965550B (en) Intelligent Interactive Remote Assisted Video System
CN110660287A (en) Simulation examination system for distribution network uninterrupted operation
CN104394199B (en) A kind of mobile terminal remote post-sale support method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180112

RJ01 Rejection of invention patent application after publication