CN112085232A - Operation inspection system and method based on augmented reality technology - Google Patents
Operation inspection system and method based on augmented reality technology Download PDFInfo
- Publication number
- CN112085232A CN112085232A CN202010961709.3A CN202010961709A CN112085232A CN 112085232 A CN112085232 A CN 112085232A CN 202010961709 A CN202010961709 A CN 202010961709A CN 112085232 A CN112085232 A CN 112085232A
- Authority
- CN
- China
- Prior art keywords
- equipment
- information
- intelligent glasses
- module
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 30
- 238000005516 engineering process Methods 0.000 title claims abstract description 28
- 238000000034 method Methods 0.000 title claims abstract description 26
- 238000007689 inspection Methods 0.000 title claims description 21
- 239000011521 glass Substances 0.000 claims abstract description 82
- 230000005540 biological transmission Effects 0.000 claims abstract description 14
- 238000012545 processing Methods 0.000 claims abstract description 9
- 238000007726 management method Methods 0.000 claims description 37
- 238000012423 maintenance Methods 0.000 claims description 21
- 238000004088 simulation Methods 0.000 claims description 12
- 230000003287 optical effect Effects 0.000 claims description 10
- 230000001681 protective effect Effects 0.000 claims description 9
- 210000001508 eye Anatomy 0.000 claims description 6
- 210000005252 bulbus oculi Anatomy 0.000 claims description 5
- 230000004886 head movement Effects 0.000 claims description 2
- 238000012550 audit Methods 0.000 claims 1
- 238000012544 monitoring process Methods 0.000 description 7
- 238000001514 detection method Methods 0.000 description 6
- 230000005855 radiation Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/20—Administration of product repair or maintenance
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01D—MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
- G01D21/00—Measuring or testing not otherwise provided for
- G01D21/02—Measuring two or more variables by means not covered by a single other subclass
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/06—Energy or water supply
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
- G08B21/0438—Sensor means for detecting
- G08B21/0453—Sensor means for detecting worn on the body to detect health condition by physiological monitoring, e.g. electrocardiogram, temperature, breathing
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Economics (AREA)
- Human Resources & Organizations (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Social Psychology (AREA)
- Psychiatry (AREA)
- General Business, Economics & Management (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Tourism & Hospitality (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physiology (AREA)
- Operations Research (AREA)
- Entrepreneurship & Innovation (AREA)
- Ophthalmology & Optometry (AREA)
- Biophysics (AREA)
- Cardiology (AREA)
- Heart & Thoracic Surgery (AREA)
- Physical Education & Sports Medicine (AREA)
- Quality & Reliability (AREA)
- Pulmonology (AREA)
- Gerontology & Geriatric Medicine (AREA)
- Emergency Management (AREA)
- Public Health (AREA)
- Water Supply & Treatment (AREA)
- Primary Health Care (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention belongs to the technical field of electric power safety, and particularly provides a fortune checking system and a method based on an augmented reality technology, wherein the fortune checking system comprises intelligent glasses equipment, a data acquisition device, a data transmission device, a server and a display; the intelligent glasses equipment is used for scanning field and equipment information, displaying the information on a front virtual screen by using image-text information and acquiring self action information of an operator; the data acquisition device is used for acquiring physical quantity information of the equipment and converting the physical quantity information into a digital signal; the data transmission device is a wireless route, and the intelligent glasses equipment communicates with the server through the wireless route; the server is used for analyzing and processing the information acquired by the intelligent glasses equipment and the data acquisition device and transmitting the analyzed and processed information to the display; the display is used for displaying the information analyzed and processed by the server. The user can liberate both hands of the user by wearing the intelligent glasses equipment to be linked with the management platform, information is shared with the management platform in real time, and the working efficiency is improved.
Description
Technical Field
The invention belongs to the technical field of electric power safety, and particularly relates to a shipping inspection system and method based on an augmented reality technology.
Background
In the power industry, the operation and inspection of power equipment usually needs to depend on operators to go to the site to check the equipment condition, judge whether a fault occurs and the equipment fault type according to own experience, and then carry out maintenance operation and record the fault condition and operation information. The manager can know the equipment condition through the recorded information, or can communicate with the operator in real time through the audio and video equipment to know the field condition or provide remote guidance.
In addition, a method for monitoring power equipment in real time and timely sending out an early warning alarm through a system also exists in the prior art, the method adopts an information acquisition device to acquire equipment operation information in real time and transmit the equipment operation information to a background management system, fault information is judged through comparison with a threshold value preset by an administrator, and a transportation and inspection person is timely notified to go to a site to process a fault, so that the safe operation of the power equipment is ensured.
In the existing operation and detection methods for the electric power equipment, the first method has the defects of large influence of human factors and low efficiency, and is inevitably influenced by human errors because the equipment faults are judged and the maintenance operation is carried out by basically depending on the experience of operators and instructors, so that on one hand, the operation and detection efficiency is low; on the other hand, the potential safety hazard caused by misoperation is large, and an operator directly contacts the equipment when the condition in the equipment is unknown, so that the condition that equipment such as high temperature and radiation damages the personal health of the operator exists.
Although part of the management system is provided with a mobile terminal platform for the operation staff to check the background information through the mobile terminal, the operation staff usually needs to wear safety equipment to operate the mobile terminal inconveniently during actual operation or needs to use both hands to perform operation, and cannot perform field operation and check background data simultaneously, on one hand, the operation staff is inconvenient to operate, and on the other hand, the potential safety hazard of operation errors caused by mistaken information recording of the operation staff exists.
Disclosure of Invention
The invention aims to solve the technical problem of providing a transportation and inspection system and a transportation and inspection method based on an augmented reality technology, which are convenient to use and suitable for popularization, and solve the problems of low transportation and inspection efficiency and high risk coefficient of the traditional equipment.
Therefore, the invention provides a shipping inspection system based on an augmented reality technology, which comprises intelligent glasses equipment, a data acquisition device, a data transmission device, a server and a display, wherein the intelligent glasses equipment is connected with the data acquisition device;
the intelligent glasses equipment is used for scanning field and equipment information, displaying the information on a front virtual screen by using image-text information and collecting the self action information of an operator;
the data acquisition device is used for acquiring physical quantity information of the equipment and converting the physical quantity information into a digital signal;
the data transmission device is a wireless router, and the intelligent glasses equipment communicates with the server through the wireless router;
the server is used for analyzing and processing the information acquired by the intelligent glasses equipment and the data acquisition device and transmitting the analyzed and processed information to the display;
the display is used for displaying the information analyzed and processed by the server.
Preferably, the smart glasses device includes an optical lens, a micro projector, a micro camera, a sensor, a microphone, and a speaker;
the optical lens is used for receiving the light-carrying information of the micro projector and forming a virtual screen in front of eyes of a user so as to display data, text information and image pictures;
the miniature projector and the optical lens are mainly used for displaying background data information and operation prompts, the miniature camera is used for collecting field pictures and scanning equipment two-dimensional codes, the sensor is used for capturing gestures, head movements and eyeball rotations of a user, the microphone is used for collecting field sound data, and the loudspeaker is used for playing sound.
Preferably, the optical lens includes a reflective lens and a convex lens, and the micro-projector projects light onto the reflective lens and then refracts the light to the eyes of the user through the convex lens, so as to form a large virtual screen in front of the eyes of the user to display data, text information and image pictures.
Preferably, the physical quantity information of the device includes a device type, a device name, a device number, a device picture, and a lifetime.
Preferably, the intelligent glasses device is internally provided with intelligent glasses device end software, and the functional modules of the intelligent glasses device end software comprise a user login module, a scanning identification module, an operation inquiry module, a remote assistance module and a safety prompt module.
Preferably, the user login module is used for logging in by scanning iris identification identity information of the user, automatically matching task information and operation authority, and completing login.
Preferably, the remote assistance module is used for transmitting the image-text information to a background in real time, and workers or experts in the background guide field personnel to operate on line.
Preferably, management platform software is arranged in the intelligent glasses device, and functional modules of the management platform software comprise a device information management module, a work order management module, a user management module, a remote assistance management module and an operation map module.
Preferably, the operation map module is configured to display an operation point list and a simulation map, where the operation point list displays each operation point, the corresponding device number, and device basic information in a hierarchical manner; the simulation map is used for marking each operation point and positioning the operation personnel in real time.
The invention also provides a method for operation inspection based on the augmented reality technology, which comprises the following steps:
s1, distributing the work order by the manager through the platform, and distributing the work order to the field operation personnel after the examination and approval is finished;
s2, the field worker wears the intelligent glasses device, login is completed through iris recognition user information, a work order to be processed is obtained, and information of a work point and the device is checked;
s3, an operator wears protective tools and a tool box to go to an operation point, the intelligent glasses equipment scans the two-dimensional code of the equipment, and the intelligent glasses equipment end projects and displays equipment fault information and operation steps;
s4, the operator carries out maintenance according to the operation instruction, if the situation which cannot be solved occurs, the operator contacts the management platform through the intelligent glasses equipment, and the manager judges which assistance is provided and whether to be connected with a remote expert or not according to the field situation;
s5, a manager or a specialist in a different place guides a worker to carry out maintenance operation, a guide picture is displayed on the virtual screen, and the intelligent glasses device automatically records the maintenance operation picture;
and S6, after the maintenance operation is completed, the operator fills in a work order through the intelligent glasses equipment, checks the next operation point, and leaves the operation site according to the guidance of the intelligent glasses equipment after all the operations are completed.
The invention has the beneficial effects that: the invention provides a fortune checking system and a method based on augmented reality technology, which comprises intelligent glasses equipment, a data acquisition device, a data transmission device, a server and a display, wherein the intelligent glasses equipment comprises a main body and a plurality of auxiliary bodies; the intelligent glasses equipment is used for scanning field and equipment information, displaying the information on a front virtual screen by using image-text information and acquiring self action information of an operator; the data acquisition device is used for acquiring physical quantity information of the equipment and converting the physical quantity information into a digital signal; the data transmission device is a wireless route, and the intelligent glasses equipment communicates with the server through the wireless route; the server is used for analyzing and processing the information acquired by the intelligent glasses equipment and the data acquisition device and transmitting the analyzed and processed information to the display; the display is used for displaying the information analyzed and processed by the server. The user is through wearing intelligent glasses equipment and management platform linkage, and under the circumstances that protective equipment such as protective clothing or be in the inconvenient mobile terminal of handling of special environment, can liberate user's both hands, real-time and management platform shared information. The operation risk is sensed in time, the operation personnel is prevented from being damaged by dangerous equipment such as high temperature and radiation in an unprotected state in the operation process, and the safety of the operation personnel can be effectively protected; and a remote expert and a platform manager can be accessed to perform guidance prompt and operation simulation demonstration on field operators, so that the field operators are helped to solve operation difficulties, and the field maintenance task is completed quickly and accurately.
The present invention will be described in further detail below with reference to the accompanying drawings.
Drawings
FIG. 1 is a general schematic diagram of the augmented reality based operation inspection system and method of the present invention;
FIG. 2 is a functional module diagram of the intelligent glasses device of the augmented reality technology-based operation inspection system and method of the present invention;
fig. 3 is a functional module schematic diagram of a management platform of the augmented reality technology-based operation inspection system and method of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the description of the present invention, it is to be understood that the terms "center", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of description and simplicity of description, and do not indicate or imply that the referenced devices or elements must have a particular orientation, be constructed and operated in a particular orientation, and thus, are not to be construed as limiting the present invention.
The terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature; in the description of the present invention, "a plurality" means two or more unless otherwise specified.
The embodiment of the invention provides a shipping inspection system based on an augmented reality technology, which comprises intelligent glasses equipment, a data acquisition device, a data transmission device, a server and a display, wherein the intelligent glasses equipment is shown in fig. 1 to 3;
the intelligent glasses equipment is used for scanning field and equipment information, displaying the information on a front virtual screen by using image-text information and collecting the self action information of an operator;
the data acquisition device is used for acquiring physical quantity information of the equipment and converting the physical quantity information into a digital signal;
the data transmission device is a wireless router, and the intelligent glasses equipment communicates with the server through the wireless router;
the server is used for analyzing and processing the information acquired by the intelligent glasses equipment and the data acquisition device and transmitting the analyzed and processed information to the display;
the display is used for displaying the information analyzed and processed by the server.
The invention provides a fortune checking system based on augmented reality technology, which comprises a hardware part and a software part, and FIG. 1 is a general structure diagram of the fortune checking system based on augmented reality technology.
(1) The hardware part comprises: the intelligent glasses comprise intelligent glasses equipment, a data acquisition device, a data transmission device, a server and a display.
The intelligent glasses equipment comprises optical lenses, a glasses frame, a miniature projector, a miniature camera, a sensor, a microphone and a loudspeaker. The optical lens integrates a reflecting lens and a convex lens, a micro projector firstly projects light onto the reflecting lens and then the light is refracted to the eyeball of a user through the convex lens, so that a large-scale virtual screen is formed in front of the eye of the user to display data, text information and image pictures.
The data acquisition device can be an equipment detection device, acquires physical quantity information of the equipment to be detected, converts an analog signal into a digital signal, and can also be an acquisition signal interface which is directly accessed to the digital signal transmitted by other equipment;
the data transmission device is a wireless router, and the intelligent glasses equipment is communicated with the server through WIFI (wireless fidelity) routing;
the server is used for processing the digital signals, storing and processing the field data acquired by the data acquisition device, analyzing according to a preset rule and transmitting the information after analysis and processing to the display;
the display is used for displaying the information analyzed and processed by the server.
(2) The software part comprises: the system comprises intelligent glasses equipment end software, management platform software, server software and software of each hardware equipment.
The functional module of intelligent glasses equipment end software includes: the system comprises a user login module, a scanning identification module, a job query module, a remote assistance module and a safety prompt module.
And after the user wears the intelligent glasses equipment, the glasses log in by scanning iris identification information of the user, and automatically match task information and operation authority to complete the login.
And the scanning identification module is used for automatically retrieving the basic information of the equipment through the two-dimensional code of the camera scanning equipment. And if the scanning equipment belongs to special equipment or radiation and other dangers exist, immediately prompting the dangers, marking danger information by adopting red fonts and playing prompting sound. The basic information includes: the equipment type, equipment name, equipment number, equipment picture, service life and the like can further display equipment data such as equipment drawings, technical manuals, maintenance records and the like according to user instructions.
And the operation query module is used for displaying an operation query interface including electronic work order query, operation task query and operation place query by the intelligent glasses equipment through a user instruction. After entering an electronic work order interface, displaying electronic work order information and electronic work order step prompts; entering an operation task query module, wherein a user can query a current task list to be operated and a completed task list and can check an operation point in a virtual map; the operation site query interface is a virtual map marked with all operation sites, and by selecting the operation sites, a user can check specific information of the operation sites, including operation environments (high temperature, high pressure, radiation and illumination conditions), the number of devices to be operated at the operation sites, route navigation and the like.
The remote assistance module is used for connecting the intelligent glasses equipment with management background personnel or remotely connecting with an expert through a user instruction, after the connection is successful, the expert can check the pictures shot by the field camera and guide the field personnel to operate through voice, and the pictures of the operation steps can be displayed through the system and synchronously displayed at the intelligent glasses equipment end to guide the field personnel to operate or indicate the position of a component to be displayed at the intelligent glasses equipment end.
A security prompt module, the module comprising the following scenarios: 1) when a user is about to enter a dangerous operation area, the intelligent glasses equipment simultaneously sends out a dangerous prompt signal and a dangerous prompt sound; 2) when the body of an operator is detected to be improper, a safety prompt is sent, the intelligent glasses equipment end captures the eyeball movement of the user through a sensor, when the user is detected to be tired or the body state is not good, the safety prompt is sent immediately, alarm information is sent to a background, and the user is guided to enter a safety region to rest or quit the maintenance operation; 3) when the current operation equipment is detected to be inconsistent with the equipment to be overhauled in the operation work order, the intelligent glasses equipment sends out a false detection prompt, and a user needs to confirm whether to continue to overhaul the equipment and report the equipment to the system.
The functional modules of the management platform software comprise: the system comprises an equipment information management module, a work order management module, a user management module, a remote assistance management module and an operation map module.
And the equipment information management module comprises an equipment list, an equipment information display interface and an equipment real-time monitoring interface. The equipment list displays various kinds of equipment according to levels, a certain equipment is clicked to enter the equipment information display interface, equipment information and equipment real-time monitoring information such as equipment types, equipment names, equipment numbers, equipment pictures, equipment three-dimensional models, service lives, equipment drawings, technical manuals and maintenance records are displayed, and equipment real-time monitoring data, historical monitoring data, monitoring data change trend graphs and the like are displayed on the equipment real-time monitoring interface. The manager can enlarge, reduce and rotate the three-dimensional model of the equipment and check the internal structure of the equipment in detail.
The work order management module comprises a work order creating module, a work order distributing module and a work order inquiring module. The construction site creating module is used for creating a new work order, a user inputs work order information, an examination and approval process is entered, the work order enters the work order distributing module after examination and approval are passed, the user can distribute the work order by himself or the system can automatically distribute the work order according to historical data and the positioning of current operating personnel. The work order query module comprises a work order list and a work order search bar, wherein the work order list displays all work orders according to types, a user can click the work orders to check detailed information including handlers, completion progress, maintenance information and the like, and the user can also input work order numbers or names of operators in the work order search bar to query.
And the user management module is used for adding/deleting users, managing user rights and user information. The administrator can add a system user and an intelligent device user, and the operation authority management of the system personnel, the authority management of the overhaul device of the transport inspection personnel, the operation area management of the transport inspection personnel and the like can be carried out.
The remote assistance module comprises a remote guidance module and a remote expert access module, wherein in the remote guidance module, managers can call knowledge base information on site and transmit the information to the intelligent glasses equipment for display, and can demonstrate operation steps through a three-dimensional model of the equipment or indicate the position of a component through a virtual component model. The manager can also share the scene picture and the demonstration interface to a plurality of experts in various places through the allopatric expert access module.
And the operation map module displays an operation point list and a simulation map on the interface. And the operation point list displays each operation point in a grading way, clicks the operation point, and displays the equipment number and the equipment basic information of the point. The simulation map is marked with operation points and operation personnel for real-time positioning, a manager can check the number of the operation points, the equipment of the operation points and the positions of the operation personnel in each area through the simulation map, the operation points and the operation personnel are combined for real-time positioning, an operation work order is distributed or specific personnel are assigned to execute an emergency task, when danger occurs in the site, danger information is marked in the simulation map in real time, the manager guides the site personnel to evacuate the dangerous area through the simulation map, and a safe evacuation route is displayed and guided in real time at the intelligent glasses equipment end.
The invention has the beneficial effects that: the invention provides a fortune checking system and a method based on augmented reality technology, which comprises intelligent glasses equipment, a data acquisition device, a data transmission device, a server and a display, wherein the intelligent glasses equipment comprises a main body and a plurality of auxiliary bodies; the intelligent glasses equipment is used for scanning field and equipment information, displaying the information on a front virtual screen by using image-text information and acquiring self action information of an operator; the data acquisition device is used for acquiring physical quantity information of the equipment and converting the physical quantity information into a digital signal; the data transmission device is a wireless route, and the intelligent glasses equipment communicates with the server through the wireless route; the server is used for analyzing and processing the information acquired by the intelligent glasses equipment and the data acquisition device and transmitting the analyzed and processed information to the display; the display is used for displaying the information analyzed and processed by the server. The user is through wearing intelligent glasses equipment and management platform linkage, and under the circumstances that protective equipment such as protective clothing or be in the inconvenient mobile terminal of handling of special environment, can liberate user's both hands, real-time and management platform shared information. The operation risk is sensed in time, the operation personnel is prevented from being damaged by dangerous equipment such as high temperature and radiation in an unprotected state in the operation process, and the safety of the operation personnel can be effectively protected; and a remote expert and a platform manager can be accessed to perform guidance prompt and operation simulation demonstration on field operators, so that the field operators are helped to solve operation difficulties, and the field maintenance task is completed quickly and accurately.
The embodiment of the invention also provides a method for operation and detection based on the augmented reality technology, which is applied to any one of the operation and detection systems based on the augmented reality technology and is not described herein again. The method comprises the following steps:
s1, distributing the work order by the manager through the platform, and distributing the work order to the field operation personnel after the examination and approval is finished;
s2, the field worker wears the intelligent glasses device, login is completed through iris recognition user information, a work order to be processed is obtained, and information of a work point and the device is checked;
s3, an operator wears protective tools and a tool box to go to an operation point, the intelligent glasses equipment scans the two-dimensional code of the equipment, and the intelligent glasses equipment end projects and displays equipment fault information and operation steps;
s4, the operator carries out maintenance according to the operation instruction, if the situation which cannot be solved occurs, the operator contacts the management platform through the intelligent glasses equipment, and the manager judges which assistance is provided and whether to be connected with a remote expert or not according to the field situation;
s5, a manager or a specialist in a different place guides a worker to carry out maintenance operation, a guide picture is displayed on the virtual screen, and the intelligent glasses device automatically records the maintenance operation picture;
and S6, after the maintenance operation is completed, the operator fills in a work order through the intelligent glasses equipment, checks the next operation point, and leaves the operation site according to the guidance of the intelligent glasses equipment after all the operations are completed.
The invention aims to provide a method and a system for operation and inspection based on an augmented reality technology, wherein a user wears intelligent glasses equipment to be linked with a management platform, and can liberate the hands of the user and share information with the management platform in real time under the condition that the user wears protective clothing such as protective clothing or is in a special environment and is inconvenient to operate a mobile terminal.
The invention aims to provide a method and a system for operation inspection based on an augmented reality technology, which can sense operation risks in time by scanning and checking equipment fault information and dangerous signals under the condition of not contacting equipment, prevent operation inspection personnel from being injured by contacting dangerous equipment such as high temperature, radiation and the like under an unprotected state in the operation process, and effectively protect the safety of the operation personnel.
The invention aims to provide a method and a system for operation and inspection based on an augmented reality technology, which can be accessed to a different-place expert and a platform manager to perform guidance prompt and operation simulation demonstration on field operators, help the field operators to solve operation difficulties and quickly and accurately complete field maintenance tasks.
The above examples are merely illustrative of the present invention and should not be construed as limiting the scope of the invention, which is intended to be covered by the claims and any design similar or equivalent to the scope of the invention.
Claims (10)
1. The utility model provides a fortune system of examining based on augmented reality technique which characterized in that: the intelligent glasses comprises intelligent glasses equipment, a data acquisition device, a data transmission device, a server and a display;
the intelligent glasses equipment is used for scanning field and equipment information, displaying the information on a front virtual screen by using image-text information and collecting the self action information of an operator;
the data acquisition device is used for acquiring physical quantity information of the equipment and converting the physical quantity information into a digital signal;
the data transmission device is a wireless router, and the intelligent glasses equipment communicates with the server through the wireless router;
the server is used for analyzing and processing the information acquired by the intelligent glasses equipment and the data acquisition device and transmitting the analyzed and processed information to the display;
the display is used for displaying the information analyzed and processed by the server.
2. The augmented reality technology-based exercise system of claim 1, wherein: the intelligent glasses equipment comprises an optical lens, a miniature projector, a miniature camera, a sensor, a microphone and a loudspeaker;
the optical lens is used for receiving the light-carrying information of the micro projector and forming a virtual screen in front of eyes of a user so as to display data, text information and image pictures;
the miniature projector and the optical lens are mainly used for displaying background data information and operation prompts, the miniature camera is used for collecting field pictures and scanning equipment two-dimensional codes, the sensor is used for capturing gestures, head movements and eyeball rotations of a user, the microphone is used for collecting field sound data, and the loudspeaker is used for playing sound.
3. The augmented reality technology-based exercise system of claim 2, wherein: the optical lens comprises a reflecting lens and a convex lens, the micro projector firstly projects light onto the reflecting lens and then refracts the light to the eyeball of a user through the convex lens, and therefore a large-scale virtual screen is formed in front of the eyes of the user to display data, text information and image pictures.
4. The augmented reality technology-based exercise system of claim 1, wherein: the physical quantity information of the equipment comprises equipment type, equipment name, equipment number, equipment picture and service life.
5. The augmented reality technology-based exercise system of claim 1, wherein: the intelligent glasses equipment is internally provided with intelligent glasses equipment end software, and a function module of the intelligent glasses equipment end software comprises a user login module, a scanning identification module, an operation inquiry module, a remote assistance module and a safety prompt module.
6. The augmented reality technology-based exercise system of claim 5, wherein: the user login module is used for logging in by scanning iris identification identity information of a user, automatically matching task information and operation authority and completing login.
7. The augmented reality technology-based exercise system of claim 5, wherein: the remote assistance module is used for transmitting the image-text information to the background in real time, and workers or experts in the background guide field personnel to operate on line.
8. The augmented reality technology-based audit system according to claim 1 or 5 wherein: the intelligent glasses equipment is internally provided with management platform software, and functional modules of the management platform software comprise an equipment information management module, a work order management module, a user management module, a remote assistance management module and an operation map module.
9. The augmented reality technology-based exercise system of claim 8, wherein: the operation map module is used for displaying an operation point list and a simulation map, and the operation point list displays each operation point, the corresponding equipment number and the equipment basic information in a grading manner; the simulation map is used for marking each operation point and positioning the operation personnel in real time.
10. A method for operation inspection based on augmented reality technology is characterized by comprising the following steps:
s1, distributing the work order by the manager through the platform, and distributing the work order to the field operation personnel after the examination and approval is finished;
s2, the field worker wears the intelligent glasses device, login is completed through iris recognition user information, a work order to be processed is obtained, and information of a work point and the device is checked;
s3, an operator wears protective tools and a tool box to go to an operation point, the intelligent glasses equipment scans the two-dimensional code of the equipment, and the intelligent glasses equipment end projects and displays equipment fault information and operation steps;
s4, the operator carries out maintenance according to the operation instruction, if the situation which cannot be solved occurs, the operator contacts the management platform through the intelligent glasses equipment, and the manager judges which assistance is provided and whether to be connected with a remote expert or not according to the field situation;
s5, a manager or a specialist in a different place guides a worker to carry out maintenance operation, a guide picture is displayed on the virtual screen, and the intelligent glasses device automatically records the maintenance operation picture;
and S6, after the maintenance operation is completed, the operator fills in a work order through the intelligent glasses equipment, checks the next operation point, and leaves the operation site according to the guidance of the intelligent glasses equipment after all the operations are completed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010961709.3A CN112085232A (en) | 2020-09-14 | 2020-09-14 | Operation inspection system and method based on augmented reality technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010961709.3A CN112085232A (en) | 2020-09-14 | 2020-09-14 | Operation inspection system and method based on augmented reality technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112085232A true CN112085232A (en) | 2020-12-15 |
Family
ID=73736982
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010961709.3A Pending CN112085232A (en) | 2020-09-14 | 2020-09-14 | Operation inspection system and method based on augmented reality technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112085232A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112488341A (en) * | 2020-12-22 | 2021-03-12 | 华能沁北发电有限责任公司 | Power plant safety management system and method |
| CN113010132A (en) * | 2021-03-24 | 2021-06-22 | 成都维泰油气能源技术有限公司 | Auxiliary system and method for intelligent well control |
| CN113989740A (en) * | 2021-10-29 | 2022-01-28 | 广西电网有限责任公司崇左供电局 | An alarm method for preventing misoperation in inspection operation |
| CN114063512A (en) * | 2021-11-15 | 2022-02-18 | 中国联合网络通信集团有限公司 | Maintenance business guidance and monitoring method, cloud platform, AR glasses and system |
| CN114118747A (en) * | 2021-11-15 | 2022-03-01 | 中煤科工集团南京设计研究院有限公司 | Coal mine equipment point inspection method based on intelligent glasses |
| CN115171447A (en) * | 2022-07-11 | 2022-10-11 | 广东电网有限责任公司东莞供电局 | Operation tutoring system based on augmented reality technology |
| CN115544284A (en) * | 2022-11-03 | 2022-12-30 | 江西省亿发姆科技发展有限公司 | Patrol method and device, intelligent glasses and flood prevention safety and cloud platform |
| CN116418859A (en) * | 2023-04-27 | 2023-07-11 | 中煤新集能源股份有限公司 | An AR-based intelligent transportation inspection system |
| CN116778119A (en) * | 2023-06-26 | 2023-09-19 | 中国信息通信研究院 | Man-machine cooperative assembly system based on augmented reality |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105955491A (en) * | 2016-06-30 | 2016-09-21 | 北京上古视觉科技有限公司 | VR (virtual reality) glasses with eye control and iris recognition functions |
| CN106780151A (en) * | 2017-01-04 | 2017-05-31 | 国网江苏省电力公司电力科学研究院 | Transformer station's Bidirectional intelligent cruising inspection system and method based on wearable augmented reality |
| CN109299908A (en) * | 2018-08-16 | 2019-02-01 | 深圳市炬视科技有限公司 | A kind of remote visualization assistance system |
| CN111553974A (en) * | 2020-04-21 | 2020-08-18 | 北京金恒博远科技股份有限公司 | Data visualization remote assistance method and system based on mixed reality |
-
2020
- 2020-09-14 CN CN202010961709.3A patent/CN112085232A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105955491A (en) * | 2016-06-30 | 2016-09-21 | 北京上古视觉科技有限公司 | VR (virtual reality) glasses with eye control and iris recognition functions |
| CN106780151A (en) * | 2017-01-04 | 2017-05-31 | 国网江苏省电力公司电力科学研究院 | Transformer station's Bidirectional intelligent cruising inspection system and method based on wearable augmented reality |
| CN109299908A (en) * | 2018-08-16 | 2019-02-01 | 深圳市炬视科技有限公司 | A kind of remote visualization assistance system |
| CN111553974A (en) * | 2020-04-21 | 2020-08-18 | 北京金恒博远科技股份有限公司 | Data visualization remote assistance method and system based on mixed reality |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112488341A (en) * | 2020-12-22 | 2021-03-12 | 华能沁北发电有限责任公司 | Power plant safety management system and method |
| CN113010132A (en) * | 2021-03-24 | 2021-06-22 | 成都维泰油气能源技术有限公司 | Auxiliary system and method for intelligent well control |
| US11756275B2 (en) | 2021-03-24 | 2023-09-12 | Vertechs Oil & Gas Technology Co., Ltd. | Auxiliary system and method for intelligent well control |
| CN113989740A (en) * | 2021-10-29 | 2022-01-28 | 广西电网有限责任公司崇左供电局 | An alarm method for preventing misoperation in inspection operation |
| CN114063512A (en) * | 2021-11-15 | 2022-02-18 | 中国联合网络通信集团有限公司 | Maintenance business guidance and monitoring method, cloud platform, AR glasses and system |
| CN114118747A (en) * | 2021-11-15 | 2022-03-01 | 中煤科工集团南京设计研究院有限公司 | Coal mine equipment point inspection method based on intelligent glasses |
| CN114063512B (en) * | 2021-11-15 | 2023-09-19 | 中国联合网络通信集团有限公司 | Maintenance business guidance and monitoring methods, cloud platforms, AR glasses and systems |
| CN115171447A (en) * | 2022-07-11 | 2022-10-11 | 广东电网有限责任公司东莞供电局 | Operation tutoring system based on augmented reality technology |
| CN115544284A (en) * | 2022-11-03 | 2022-12-30 | 江西省亿发姆科技发展有限公司 | Patrol method and device, intelligent glasses and flood prevention safety and cloud platform |
| CN116418859A (en) * | 2023-04-27 | 2023-07-11 | 中煤新集能源股份有限公司 | An AR-based intelligent transportation inspection system |
| CN116778119A (en) * | 2023-06-26 | 2023-09-19 | 中国信息通信研究院 | Man-machine cooperative assembly system based on augmented reality |
| CN116778119B (en) * | 2023-06-26 | 2024-03-12 | 中国信息通信研究院 | Man-machine cooperative assembly system based on augmented reality |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112085232A (en) | Operation inspection system and method based on augmented reality technology | |
| CN111722714B (en) | AR technology-based digital substation metering operation and detection auxiliary method | |
| CN110472858B (en) | A method for information management of construction project supervision | |
| CN113222184A (en) | Equipment inspection system and method based on augmented reality AR | |
| CN206672041U (en) | A kind of mining equipment intelligent patrol detection based on augmented reality and safeguard accessory system | |
| CN108764668A (en) | A kind of facilities management system and method based on BIM technology | |
| CN112034503A (en) | Radiation visualization system and method based on augmented reality technology | |
| CN113935645A (en) | High-risk operation management and control system and method based on identification analysis technology | |
| CN112565694A (en) | On-spot safety monitoring management system of building engineering | |
| CN111920129A (en) | An intelligent safety helmet system | |
| KR102585650B1 (en) | Nuclear power plant electrical facility management method and system | |
| CN108830967A (en) | A kind of visual Electric Power Patrol method and device | |
| JP7688867B2 (en) | Remote Support System | |
| CN115567690A (en) | Intelligent monitoring system capable of automatically identifying dangerous points of field operation | |
| CN213128247U (en) | Intelligent safety helmet system | |
| CN112015134B (en) | A storage cabinet personal safety protection safety system and its safety control method | |
| CN113556530A (en) | Intelligent rail transit maintenance system and method based on wearable AR equipment | |
| KR20200112418A (en) | System of establishing TBM computerization and safety and control method thereof | |
| CN209787471U (en) | Power plant operating personnel positioning system | |
| CN114187675B (en) | Fire-fighting inspection method and equipment, medium and product | |
| KR102360549B1 (en) | Smart safety management system for work site | |
| CN213457742U (en) | Welding operation monitoring system | |
| CN114444856A (en) | Auxiliary assembly system | |
| KR102573540B1 (en) | Smart Risk Assessment System | |
| JP3697816B2 (en) | Patrol inspection support system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201215 |