CN107872655A - A kind of method and system for determining hidden danger point - Google Patents
A kind of method and system for determining hidden danger point Download PDFInfo
- Publication number
- CN107872655A CN107872655A CN201711167635.0A CN201711167635A CN107872655A CN 107872655 A CN107872655 A CN 107872655A CN 201711167635 A CN201711167635 A CN 201711167635A CN 107872655 A CN107872655 A CN 107872655A
- Authority
- CN
- China
- Prior art keywords
- hidden danger
- danger point
- determined
- glasses
- audio signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 239000011521 glass Substances 0.000 claims abstract description 91
- 230000005236 sound signal Effects 0.000 claims abstract description 85
- 230000004044 response Effects 0.000 claims abstract description 19
- 230000009471 action Effects 0.000 claims abstract description 17
- 238000005516 engineering process Methods 0.000 claims description 17
- 230000003190 augmentative effect Effects 0.000 claims description 7
- 238000007689 inspection Methods 0.000 abstract description 42
- 230000002452 interceptive effect Effects 0.000 abstract description 5
- 230000005540 biological transmission Effects 0.000 description 25
- 230000006870 function Effects 0.000 description 4
- 238000012790 confirmation Methods 0.000 description 3
- 230000005611 electricity Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 238000012423 maintenance Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000009422 external insulation Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 210000000697 sensory organ Anatomy 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/3827—Portable transceivers
- H04B1/385—Transceivers carried on the body, e.g. in helmets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/3827—Portable transceivers
- H04B1/385—Transceivers carried on the body, e.g. in helmets
- H04B2001/3866—Transceivers carried on the body, e.g. in helmets carried on the head
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)
Abstract
The invention discloses a kind of method and system for determining hidden danger point, pass through AR glasses, in response to the trigger action of patrol officer, gather vision signal and the first audio signal, wherein, vision signal includes the real image of hidden danger point to be determined, and the first audio signal includes the patrol officer and the voice of the hidden danger point to be determined is described；AR glasses send the vision signal and first audio signal to server；Server plays vision signal and the first audio signal to technical specialist, so that technical specialist is determined to hidden danger point to be determined.Using the above method, patrol officer realizes the real-time, interactive with technical specialist by AR glasses, so that technical specialist is analyzed hidden danger point to be determined, differentiate hidden danger point to be determined, simplify inspection flow, inspection difficulty is reduced, improves the operating efficiency of patrol officer.
Description
Technical field
The present invention relates to AR technical fields, more particularly to a kind of method and system for determining hidden danger point.
Background technology
With the fast development of power system power supply network, the power transmission cable distribution in the supply network of underground is more and more closeer
Collection.In order to ensure power transmission cable safe operation, avoid power transmission cable failure from causing the accident, the administrative department of power transmission cable, can send
Send patrol officer and safety inspection periodically is carried out to the power transmission cable in cable duct well tunnel.
Patrol officer, it is necessary to check a variety of disparity items of power transmission cable, and finds power transmission cable during inspection
Present in hidden danger point.Patrol officer records the information of possible hidden danger point during inspection.After inspection terminates, it will be remembered
The Message Entry System of the possible hidden danger point of record, is determined by technical specialist to hidden danger point.The side of above-mentioned determination hidden danger point
Formula complex operation, efficiency are low.
The content of the invention
Present invention solves the technical problem that it is to provide a kind of method and system for determining hidden danger point, so as to pass through AR glasses
The real-time communication of patrol officer and technical specialist are realized, can determine whether the hidden danger point to be determined is hidden danger point, reduces inspection
Difficulty, simplify inspection flow, improve the operating efficiency of patrol officer.
Therefore, the technical scheme that the present invention solves technical problem is：
A kind of method for determining hidden danger point, this method include：
Augmented reality AR glasses gather vision signal and the first audio signal, institute in response to the trigger action of patrol officer
Stating vision signal includes the real image of hidden danger point to be determined, and first audio signal is treated including the patrol officer to described
Determine the voice description of hidden danger point；
AR glasses send the vision signal and first audio signal to server；
Server plays the vision signal and first audio signal to technical specialist, so as to the technical specialist couple
The hidden danger point to be determined is determined.
Optionally, this method also includes：
The feedback information of technical specialist described in collection of server, the feedback information are used to indicate the hidden danger point to be determined
Whether hidden danger point is defined as；
Server sends the feedback information to the AR glasses；
AR glasses play the feedback information to the patrol officer.
Optionally, the feedback information includes：
Second audio signal, second audio signal include voice of the technical specialist to the hidden danger point to be determined
Description.
Optionally, the feedback information includes：
Feedback image, the feedback image include image tagged of the technical specialist to the hidden danger point to be determined.
Optionally, this method also includes：
When the hidden danger point to be determined is determined to be hidden danger point, triggering of the AR glasses in response to the patrol officer
Operation, records the hidden danger point.
In addition, present invention also offers a kind of system for determining hidden danger point, the system includes：AR glasses, server；
AR glasses are connected with the server；
AR glasses, for the trigger action in response to patrol officer, vision signal and the first audio signal are gathered, wherein,
The vision signal includes the real image of hidden danger point to be determined, and first audio signal includes the patrol officer to described
The voice description of hidden danger point to be determined；And the vision signal and the first audio signal are sent to server；
Server, for playing the vision signal and first audio signal to technical specialist, so as to the technology
Expert is determined to the hidden danger point to be determined.
Optionally, the system also includes：
Server, is additionally operable to gather the feedback information of the technical specialist, and the feedback information is used to indicate described treat really
Determine whether hidden danger point is defined as hidden danger point；And the feedback information is sent to the AR glasses；
AR glasses, it is additionally operable to play the feedback information that will be received to the patrol officer.
Optionally, the feedback information includes：
Second audio signal, second audio signal include voice of the technical specialist to the hidden danger point to be determined
Description.
Optionally, the feedback information includes：
Feedback image, the feedback image include image tagged of the technical specialist to the hidden danger point to be determined.
Optionally, the system also includes：
The AR glasses, it is additionally operable to when the hidden danger point to be determined is determined to be hidden danger point, in response to the inspection people
The trigger action of member, records the hidden danger point.
According to the above-mentioned technical solution, the method have the advantages that：
Method and system provided by the invention, by augmented reality AR glasses, in response to the trigger action of patrol officer, adopt
Collect vision signal and the first audio signal, wherein, vision signal includes the real image of hidden danger point to be determined, the first audio signal
The voice of the hidden danger point to be determined is described including the patrol officer；AR glasses are by the vision signal and first audio
Signal is sent to server；Server plays vision signal and the first audio signal to technical specialist, so that technical specialist treats
Determine that hidden danger point is determined.Using the above method, patrol officer utilizes AR glasses, can link up tunnel with technical specialist in real time
The details of hidden danger point that may be present on inner cable, without patrol officer during inspection for possible hidden danger point
Record, without by the work of the Message Entry System recorded, realizing technical specialist and patrol officer after inspection terminates
Real-time, interactive, hidden danger point is determined, simplifies inspection flow, reduces inspection difficulty, improves the operating efficiency of patrol officer.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with
Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is a kind of flow chart of method for determining hidden danger point provided in an embodiment of the present invention；
Fig. 2 is the signaling process figure of another method for determining hidden danger point provided in an embodiment of the present invention；
Fig. 3 is a kind of structural representation of system for determining hidden danger point provided in an embodiment of the present invention.
Embodiment
In order to be given at the implementation of real-time confirmation hidden danger point during inspection, the embodiments of the invention provide it is a kind of really
Recognize the method and system of hidden danger point, for ease of understanding the technical scheme of description of the embodiment of the present invention, first the present invention is implemented below
The basic concepts that example is related to are introduced.
Augmented reality (Augmented Reality, AR) is a kind of by real world information and virtual world information " nothing
The integrated new technology of seam ", the target of the technology are that virtual world and real world are superimposed and carried out mutually on screen
It is dynamic.Specifically refer to, the entity information that script is hardly perceivable in real world certain time, spatial dimension, pass through computer
Etc. science and technology, be added to real world again after analog simulation, real environment and virtual object is added in real time
Same picture, the information that the generally mankind not directly perceive is perceived, so as to reach the sense organ of exceeding reality
Experience.
Virtual information can not only be added in real environment by AR technologies in real time, but also accomplish virtual information
Display consistent with true environment, AR technologies contain multimedia, three-dimensional modeling, real-time video show and control, multisensor
New technology and the new tool such as fusion, real-time tracking and registration, scene fusion.
AR can be divided into according to the difference of hardware carrier equipment：Helmet Mounted Display, computer, mobile device, glasses etc.,
The AR equipment of every kind of hardware carrier has its own exclusive interactive feature, and based on the application background of the present invention, patrol officer exists
Inspection in cable duct well tunnel, while liberating both hands, can real-time reception arrive tunnel cable attribute information, consideration AR equipment
Man-machine interaction flexibility and operability, AR glasses are selected as the AR equipment with functions such as data receiver, superposition, displays.
AR glasses, it is a kind of one kind " high-tech glasses " for exactly liking common spectacles, it is possible to achieve various functions.One
AR glasses can be regarded as a miniature mobile phone, the state for judging that user is currently in by tracking eyeball sight track, and
And corresponding function can be turned on or off；One AR glasses can also regard a computer as, can be directed to storage information
With reference to the actual environment of shooting, corresponding relation between the two is calculated, and be superimposed with inciting somebody to action the two " seamless ", etc..
Generally, AR glasses include display screen, video camera, position indicator etc., wherein, the current institute of camera acquisition user
The true environment video at place, position indicator position the position that user is presently in real time, and display screen shows true environment video and void
Intend the superposition of information, and realize the function of human-computer interaction.
In power transmission cable Gou Jing tunnels, patrol officer wears AR glasses and carries out inspection, and so special cruising inspection system is base
In Hololens+Unity3D development environment, wherein, Unity3D is integrated with abundant API in terms of Hololens interactions, and
And user interface is friendly, simple, great convenience is provided using realization to AR.
Introduction with reference to more than for some backgrounds and basic conception, the application scenarios of the present invention are simply retouched below
State.
As the power transmission cable distribution in the supply network of underground is more and more intensive, in order to avoid power transmission cable failure causes thing
Therefore patrol officer needs periodically to carry out safety inspection to the power transmission cable in cable duct well tunnel.Environment in cable duct well tunnel
Complexity, patrol officer, it is necessary to check a variety of disparity items of power transmission cable, and find in power transmission cable and deposited during inspection
Hidden danger point, record the information of possible hidden danger point.After inspection terminates, by the Data Enter of the possible hidden danger point recorded
System, hidden danger point is determined by technical specialist.The mode complex operation of above-mentioned determination hidden danger point, efficiency are low.
In order to reduce the workload of patrol officer, operating efficiency is improved, it is ensured that efficiently, accurately determined in inspection work
Hidden danger point, the invention provides a kind of method and system for determining hidden danger point, using AR technologies, realize that patrol officer is special with technology
Family's exchange in real time, so as to confirm the hidden danger point in tunnel cable.
The preferred embodiments of the present invention are illustrated with reference to Figure of description, it will be appreciated that described herein
Preferred embodiment is merely to illustrate and explain the present invention, and is not intended to limit the present invention.And in the case where not conflicting, this hair
The feature in embodiment and embodiment in bright can be mutually combined.
Fig. 1 is a kind of method flow diagram for determining hidden danger point provided in an embodiment of the present invention, as shown in figure 1, this method bag
Include：
Step 101, augmented reality AR glasses gather vision signal and the first audio in response to the trigger action of patrol officer
Signal, the vision signal include the real image of hidden danger point to be determined, and first audio signal includes the patrol officer
The voice of the hidden danger point to be determined is described.
Tunnel can be traffic tunnel (such as subway tunnel, railway tunnel, seabed tunnel as a kind of special architectural environment
Road etc.) or municipal tunnel (such as cable tunnel, outlet tunnel, heating tunnel), in embodiments of the present invention, with defeated
Illustrated exemplified by the Gou Jing tunnels of electrical cables.
In power transmission cable Gou Jing tunnels, there is many identical or different power transmission cable, in order to ensure transmission of electricity electricity
Cable can normal operation, patrol officer need periodically to tunnel inner cable carry out inspection, find the hidden danger point of cable, and record hidden
Suffer from the positional information of point.But cable tunnel environment is complicated, and tunnel inner cable type and quantity are various, patrol officer or maintenance personal
In inspection next time or maintenance work, it is necessary to before consulting patrol record hidden danger point data, so as in this task
Targetedly inspection or maintenance is carried out, therefore, the Accuracy and high efficiency that patrol officer records hidden danger point is very heavy in inspection
The requirement key element wanted.
Patrol officer carries out inspection by wearing AR glasses, why can improve the accuracy of patrol officer's work, drop
Low workload, it is the actual environment that can be around captured in real-time patrol officer because being integrated with video camera on AR glasses；In addition,
Display screen is also integrated with AR glasses, on the one hand, by virtual information and actual environment Overlapping display, gives staff more preferable work
Make environmental condition and visual experience, on the other hand, AR glasses provide real-time, interactive for patrol officer and technical specialist
Platform, patrol officer can learn hidden danger point that may be present on the cable on oneself periphery in real time by the display screen, and will retouch
The audio signal, the vision signal of displaying scene real scene etc. for stating hidden danger point details is transferred to technical specialist, allows technology
Expert immersively judges whether hidden danger point is correct, and then the hidden danger point for instructing following patrol officer couple to determine is marked
And display, realize more efficient inspection work.
In specific implementation, patrol officer wears AR glasses and entered in cable tunnel, can be with by the video camera of AR glasses
The actual environment in tunnel is watched in real time., it is necessary to which real-time on-site focuses on now for the staff of inspection cable hidden danger point
In real environment, hidden danger point that may be present on tunnel cable, because hidden danger point is the major source that tunnel cable breaks down.Patrol
Inspection personnel are in the hidden danger point having found that it is likely that, it is impossible to determine that the possible hidden danger point is genuine hidden danger point, then by the possibility
Hidden danger point as hidden danger point to be determined, it is necessary to patrol officer trigger " determining hidden danger point " operation, be specially：Show in AR glasses
In real scene image shown by display screen, the hidden danger point to be determined is clicked on, triggering AR glasses start holding for " determining hidden danger point "
Row operation.
AR glasses start to gather vision signal and the first audio signal in response to the trigger action of patrol officer, wherein, depending on
Frequency signal refers to the real scene video around the patrol officer of the video camera captured in real-time of AR glasses, and the video includes to be determined
The real image of hidden danger point；First audio signal is to be recorded by patrol officer when inspection scene finds and possible hidden danger point be present
, the content that the first audio signal carries includes patrol officer and the voice of current hidden danger point to be determined is described.
For example, patrol officer's first finds that cable external insulation skin at X occur in cable A 0-5m sections in current inspection
Breakage, then first click on AR glasses on " determining hidden danger point " button, AR glasses start gather vision signal, now, first need one
The camera site of side adjustment video camera, angle, the vision signal for ensureing collection as far as possible are clear and complete；While say：" electricity
It is doubtful hidden danger point that X points, which occurs, in cable A 0 to 5 meter of section, and external insulation skin is damaged, PLSCONFM ", when AR glasses are effective from can't detect
Start timing during voice signal, if continuous 10s does not have the input of efficient voice signal, judge that voice description is completed, i.e., first
Audio signal produces, and accordingly, stops the collection of vision signal.
By above-mentioned steps 101, when the hidden danger point of patrol officer's determination in need, can trigger " determining hidden danger point "
Operation, vision signal and the first audio signal are gathered using AR glasses, and the vision signal and first are utilized for subsequent technology expert
Audio signal confirms that data basis has been accomplished fluently in the sequence of operations of hidden danger point.In the AR glasses Jing Guo step 101 in response to inspection
The trigger action of personnel, after gathering vision signal and the first audio signal, perform following steps 102.
Step 102, AR glasses send above-mentioned vision signal and the first audio signal to server.
During specific implementation, the vision signal collected and the first audio signal are sent to server by AR glasses, transmission
Mode can be：Vision signal and the first audio signal are directly uploaded to server by AR glasses by internet；The side of transmission
Formula can also be：AR glasses pass the vision signal of patrol officer in tunnel and the first audio signal using short distances such as bluetooths
Defeated mode is sent to information gathering industrial computer, then by information gathering industrial computer by internet by the vision signal and the first audio
Signal is sent to server.
Specifically, above-mentioned vision signal and the first audio signal before transmitting, can be packed, then with number in advance
Overall transfer is carried out according to the form of bag；Vision signal and the first audio signal can also be transmitted respectively.Whether pack
It is unified to send, still transmit successively one by one, can be that transmission file be named, can with the job number of patrol officer,
Any one is named for telephone number, the feature of hidden danger to be determined point, the affiliated cable title of hidden danger to be determined point etc., can also
Directly be named with the time of file generated, be not construed as limiting herein, if can allow technical specialist and patrol officer that
This knows file content.
By above-mentioned steps, AR glasses send vision signal and the first audio signal to server, are subsequent server
The vision signal and the first audio signal are supplied to technical specialist, determine that hidden danger point is got ready for technical specialist.
Step 103, server plays the vision signal and first audio signal to technical specialist, so as to the skill
Art expert is determined to the hidden danger point to be determined.
Server is after the vision signal and the first audio signal of AR glasses transmission is received, on the display screen of server
Above-mentioned vision signal and the first audio signal are played, the video and audio playing software specifically used, can be on the server
The video/audio playout software that the video/audio playout software itself carried or user voluntarily install；Video/the sound
Frequency playout software can be two separate softwares, be respectively used to special video playback or audio plays, can also
It is a software, video and audio can be played simultaneously；Video and the form of audio can be arbitrary videos and audio file
Form.
Technical specialist watches the video image on hidden danger point to be determined in vision signal, makes it in a short time can be clear
The tunnel inner cable hidden danger point to be determined and its ambient conditions of surrounding are seen by Chu；According to patrol officer in the first audio signal
Voice description, further clear and definite actual conditions of the hidden danger point to be determined in a short time.Technical specialist believes with reference to video
Number, the first audio signal, and itself abundant expertise and sturdy technical foundation determine the hidden danger point to be determined
Concrete condition, confirm whether it is hidden danger point, and the prompting such as the concrete condition of the hidden danger point, points for attention.
The embodiments of the invention provide a kind of method for determining hidden danger point, by AR glasses, in response to touching for patrol officer
Hair operation, gathers vision signal and the first audio signal, wherein, vision signal includes the real image of hidden danger point to be determined, the
One audio signal includes the patrol officer and the voice of the hidden danger point to be determined is described；AR glasses are by the vision signal and institute
The first audio signal is stated to send to server；Server plays vision signal and the first audio signal to technical specialist, so as to skill
Art expert is determined to hidden danger point to be determined.Using the above method, patrol officer utilizes AR glasses, can be special with technology in real time
The details of hidden danger point that may be present on family's communication tunnel inner cable, without patrol officer during inspection for may
Hidden danger point record, without by the work of the Message Entry System recorded, realized after inspection terminates technical specialist with
The real-time, interactive of patrol officer, hidden danger point is determined, simplifies inspection flow, inspection difficulty is reduced, improves patrol officer's
Operating efficiency.
In the method for the determination hidden danger point that above example provides, technical specialist can be according to vision signal and the first audio
Signal carries out the confirmation of hidden danger point, and specific confirmation process has carried out specific description in the embodiment shown in Figure 2.
Fig. 2 is another method signaling process figure for determining hidden danger point provided in an embodiment of the present invention, as shown in Fig. 2 should
Method includes：
Step S201, augmented reality AR glasses gather vision signal and the first sound in response to the trigger action of patrol officer
Frequency signal, the vision signal include the real image of hidden danger point to be determined, and first audio signal includes the inspection people
Member describes to the voice of the hidden danger point to be determined.
Step S202, AR glasses send above-mentioned vision signal and the first audio signal to server.
Step S203, server plays the vision signal and first audio signal to technical specialist, so as to described
Technical specialist is determined to the hidden danger point to be determined.
Above-mentioned steps S201- steps S203 is consistent with the specific implementation of step 101- steps 103, specifically describe referring to
Step 101- steps 103, are repeated no more here.
Step S204, the feedback information of technical specialist described in collection of server, the feedback information are used to indicate described treat
Determine whether hidden danger point is defined as hidden danger point.
Technical specialist vision signal and the first audio signal that server plays, obtains, on this according in step 203
The result of determination of hidden danger point to be determined, the result of determination are used to indicate whether hidden danger point to be determined is defined as hidden danger point, this are sentenced
Determine result and be denoted as feedback information, the feedback information be by technical specialist draw, it is necessary to be input on server.
Specifically, the feedback information can include：Second audio signal, it is special that second audio signal includes the technology
Family describes to the voice of the hidden danger point to be determined.
Second audio signal be technical specialist record, for characterize hidden danger point to be determined whether be hidden danger point one section of language
Sound describes, and can be the audio signal directly inputted by the voice-input device of server end；Can also be by technical specialist
Handheld device collection a section audio signal, then by wireless transmission methods such as bluetooths, service is sent to from handheld device
On device, or server is sent to by wire transmission modes such as USB.The content of second audio signal, can be specifically simple
"Yes" or "No"；It can also be the judgement conclusion that the band comprising determination result and analysis expert analyze.
In addition, the feedback information can include：Feedback image, the feedback image are treated including the technical specialist to described
Determine the image tagged of hidden danger point.
When server receives vision signal and the first audio signal, technical specialist is except recording the second audio signal
Outside, can also be the position of hidden danger point by determination in video image by the specialty analysis to hidden danger point to be determined in vision signal
Put and be marked, the vision signal after the mark feeds back to AR glasses as feedback image.AR glasses show the feedback image
To patrol officer.Compared with only with the second audio signal, feedback image more can intuitively represent that technical specialist is to be determined to this
The analysis result of hidden danger point.
Need exist for illustrating, in practical application, the feedback information can only include above-mentioned second audio signal, also may be used
Only to include above-mentioned feedback image, it can also both include above-mentioned second audio signal or including above-mentioned feedback image, not enter here
Row is specific to be limited.
Step S205, server send the feedback information to AR glasses.
The feedback information got is sent to AR glasses by server, and the mode of transmission can be：Server passes through interconnection
Feedback information is transmitted directly to AR glasses by net, and the mode of transmission can also be：Server passes feedback information using internet
The defeated information gathering industrial computer near tunnel, then it is by the short-distance transmission mode such as bluetooth that this is anti-by information gathering industrial computer
Feedforward information is sent to AR glasses.
By above-mentioned steps, server sends feedback information to AR glasses, is that follow-up AR glasses will be anti-by AR technologies
Feedforward information is shown to patrol officer and provides precondition.
Step S206, AR glasses play the feedback information to the patrol officer.
Specific implementation when, AR glasses by itself integrate output equipment, to patrol officer play feedback information, if
Feedback information is the second audio signal, then AR glasses can be broadcast by the audio-frequence player device of itself, such as earphone to patrol officer
Second audio signal is put, the second audio signal can also be handled by the program in AR glasses, the second audio is believed
Number corresponding text information is resolved to, be illustrated on the display screen of AR glasses, read for patrol officer.
If feedback information is feedback image, AR glasses can directly display feedback image by the display screen of itself, supply
Patrol officer refers to；Or feedback image can also be handled by the program in AR glasses, will be corresponding in feedback image
The information such as the position of hidden danger point resolve to corresponding text information, be illustrated on the display screen of AR glasses, read for patrol officer
Read.
Certainly, if the feedback information includes the second audio signal and feedback image, it can be supplied to and patrolled using aforesaid way
Inspection personnel refer to, and repeat no more here.
Step S207, when hidden danger point to be determined is determined to be hidden danger point, AR glasses are grasped in response to the triggering of patrol officer
Make, record the hidden danger point.
When patrol officer receives the feedback information of AR glasses broadcasting, if the hidden danger point to be determined is defined as by skill expert
Hidden danger point, then need that the hidden danger point is marked.In specific implementation, patrol officer needs on a display screen, pair determination
Hidden danger point carries out the trigger action such as clicking on, and AR glasses record the hidden danger point in response to the trigger action.Need exist for explanation
It is that during above-mentioned inspection, hidden danger point is once labeled, then it represents that the hidden danger point is not only the hidden danger that patrol officer thinks
Point, or the hidden danger point determined by technical specialist, illustrate that the hidden danger point is effective.
The method provided using above-described embodiment, patrol officer utilize AR glasses, can link up tunnel with technical specialist in real time
The details of hidden danger point to be determined on road inner cable, receive feedback information of the technical specialist to hidden danger point to be determined, work as feedback
When information expression hidden danger point to be determined is true hidden danger point, the hidden danger point is marked patrol officer.It the method achieve skill
Art expert interacts with patrol officer's, the first audio signal and vision signal sent by technical specialist according to AR glasses, treats
Determine that hidden danger point is confirmed, the hidden danger point determined by patrol officer couple is marked, and simplifies inspection flow, reduces inspection
Difficulty, improve the operating efficiency of patrol officer.
The above is to a kind of introduction for the method for determining hidden danger point provided in an embodiment of the present invention, with above method embodiment
Corresponding, the embodiment of the present invention additionally provides a kind of system for determining hidden danger point.The embodiment of the present invention is entered below in conjunction with the accompanying drawings
Row description.
Fig. 3 is a kind of structural representation of system for determining hidden danger point provided in an embodiment of the present invention, as shown in figure 3, should
System includes：AR glasses 301, server 302；Server 302 is connected with AR glasses 301.
Wherein, AR glasses 301, for the trigger action in response to patrol officer, vision signal and the first audio letter are gathered
Number, wherein, the vision signal includes the real image of hidden danger point to be determined, and first audio signal includes the inspection people
Member describes to the voice of the hidden danger point to be determined；And the vision signal and the first audio signal are sent to server 302；
Server 302, for playing the vision signal and first audio signal to technical specialist, so as to the skill
Art expert is determined to the hidden danger point to be determined.
Alternatively, above-mentioned server 302, is additionally operable to gather the feedback information of the technical specialist, and the feedback information is used
Whether it is defined as hidden danger point in the instruction hidden danger point to be determined；And the feedback information is sent to the AR glasses 301；
AR glasses 301, it is additionally operable to play the feedback information that will be received to the patrol officer.
Specifically, above-mentioned feedback information includes：
Second audio signal, second audio signal include voice of the technical specialist to the hidden danger point to be determined
Description.
Specifically, above-mentioned feedback information includes：
Feedback image, the feedback image include image tagged of the technical specialist to the hidden danger point to be determined.
Alternatively, above-mentioned AR glasses 301, it is additionally operable to when the hidden danger point to be determined is determined to be hidden danger point, in response to
The trigger action of the patrol officer, record the hidden danger point.
The embodiment of the present invention is system embodiment corresponding to above method embodiment, and specific implementation refers to the above method
The description of embodiment, is repeated no more here.
Described above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art
For member, under the premise without departing from the principles of the invention, some improvements and modifications can also be made, these improvements and modifications also should
It is considered as protection scope of the present invention.
Claims (10)
- A kind of 1. method for determining hidden danger point, it is characterised in that methods described includes：Augmented reality AR glasses gather vision signal and the first audio signal in response to the trigger action of patrol officer, described to regard Frequency signal includes the real image of hidden danger point to be determined, and first audio signal includes the patrol officer to described to be determined The voice description of hidden danger point；The AR glasses send the vision signal and first audio signal to server；The server plays the vision signal and first audio signal to technical specialist, so as to the technical specialist couple The hidden danger point to be determined is determined.
- 2. according to the method for claim 1, it is characterised in that methods described also includes：The feedback information of technical specialist described in the collection of server, the feedback information are used to indicate the hidden danger point to be determined Whether hidden danger point is defined as；The server sends the feedback information to the AR glasses；The AR glasses play the feedback information to the patrol officer.
- 3. according to the method for claim 2, it is characterised in that the feedback information includes：Second audio signal, second audio signal are retouched including the technical specialist to the voice of the hidden danger point to be determined State.
- 4. according to the method for claim 2, it is characterised in that the feedback information includes：Feedback image, the feedback image include image tagged of the technical specialist to the hidden danger point to be determined.
- 5. according to the method described in claim 1-4 any one, it is characterised in that methods described also includes：When the hidden danger point to be determined is determined to be hidden danger point, the AR glasses are grasped in response to the triggering of the patrol officer Make, record the hidden danger point.
- 6. a kind of system for determining hidden danger point, it is characterised in that the system includes：AR glasses, server；The AR glasses are connected with the server；The AR glasses, for the trigger action in response to patrol officer, vision signal and the first audio signal are gathered, wherein, The vision signal includes the real image of hidden danger point to be determined, and first audio signal includes the patrol officer to described The voice description of hidden danger point to be determined；And the vision signal and the first audio signal are sent to server；The server, for playing the vision signal and first audio signal to technical specialist, so as to the technology Expert is determined to the hidden danger point to be determined.
- 7. system according to claim 6, it is characterised in that the system also includes：The server, is additionally operable to gather the feedback information of the technical specialist, and the feedback information is used to indicate described treat really Determine whether hidden danger point is defined as hidden danger point；And the feedback information is sent to the AR glasses；The AR glasses, it is additionally operable to play the feedback information that will be received to the patrol officer.
- 8. system according to claim 7, it is characterised in that the feedback information includes：Second audio signal, second audio signal are retouched including the technical specialist to the voice of the hidden danger point to be determined State.
- 9. system according to claim 7, it is characterised in that the feedback information includes：Feedback image, the feedback image include image tagged of the technical specialist to the hidden danger point to be determined.
- 10. according to the system described in claim 6-9 any one, it is characterised in that the system also includes：The AR glasses, it is additionally operable to when the hidden danger point to be determined is determined to be hidden danger point, in response to the patrol officer's Trigger action, record the hidden danger point.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711167635.0A CN107872655A (en) | 2017-11-21 | 2017-11-21 | A kind of method and system for determining hidden danger point |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711167635.0A CN107872655A (en) | 2017-11-21 | 2017-11-21 | A kind of method and system for determining hidden danger point |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107872655A true CN107872655A (en) | 2018-04-03 |
Family
ID=61754344
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711167635.0A Pending CN107872655A (en) | 2017-11-21 | 2017-11-21 | A kind of method and system for determining hidden danger point |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107872655A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108921259A (en) * | 2018-09-18 | 2018-11-30 | 西安艾润物联网技术服务有限责任公司 | Parking lot inspection device and system |
| CN109598731A (en) * | 2018-12-07 | 2019-04-09 | 北京中交睿达科技有限公司 | A kind of economical road visiting method |
| CN109741010A (en) * | 2018-12-14 | 2019-05-10 | 四川省交通运输厅交通勘察设计研究院 | A kind of road interactive mode field investigation system based on BIM and AR technology |
| CN110310451A (en) * | 2019-07-22 | 2019-10-08 | 软通智慧科技有限公司 | Fire hazard troubleshooting system and method based on wearable equipment |
| CN111031284A (en) * | 2019-12-12 | 2020-04-17 | 国网浙江余姚市供电有限公司 | Infrastructure construction site management and control method, system and terminal |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104506621A (en) * | 2014-12-24 | 2015-04-08 | 北京佳讯飞鸿电气股份有限公司 | Method for performing long-distance guidance by use of video annotation |
| CN105025259A (en) * | 2015-07-08 | 2015-11-04 | 国家电网公司 | A smart substation inspection video live broadcast system and method based on Google glasses |
| CN205750782U (en) * | 2016-04-27 | 2016-11-30 | 上海芝麻开花医疗科技有限公司 | Telemedicine System based on intelligent glasses |
| CN106339094A (en) * | 2016-09-05 | 2017-01-18 | 山东万腾电子科技有限公司 | Interactive remote expert cooperation maintenance system and method based on augmented reality technology |
| CN206460517U (en) * | 2017-02-23 | 2017-09-01 | 安徽感知土木科技有限公司 | A kind of bridge inspection based on VR and damage diagnostic system |
| CN107172390A (en) * | 2017-05-12 | 2017-09-15 | 广州市和佳电子科技有限公司 | It is a kind of based on intelligent glasses for terminal platform visualization system and implementation method |
| CN107277450A (en) * | 2017-07-14 | 2017-10-20 | 福建铁工机智能机器人有限公司 | A kind of utilization AR realizes the method and apparatus of the live disaster relief of remote command |
| WO2017182523A1 (en) * | 2016-04-20 | 2017-10-26 | Newbiquity Sagl | A method and a system for real-time remote support with use of computer vision and augmented reality |
-
2017
- 2017-11-21 CN CN201711167635.0A patent/CN107872655A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104506621A (en) * | 2014-12-24 | 2015-04-08 | 北京佳讯飞鸿电气股份有限公司 | Method for performing long-distance guidance by use of video annotation |
| CN105025259A (en) * | 2015-07-08 | 2015-11-04 | 国家电网公司 | A smart substation inspection video live broadcast system and method based on Google glasses |
| WO2017182523A1 (en) * | 2016-04-20 | 2017-10-26 | Newbiquity Sagl | A method and a system for real-time remote support with use of computer vision and augmented reality |
| CN205750782U (en) * | 2016-04-27 | 2016-11-30 | 上海芝麻开花医疗科技有限公司 | Telemedicine System based on intelligent glasses |
| CN106339094A (en) * | 2016-09-05 | 2017-01-18 | 山东万腾电子科技有限公司 | Interactive remote expert cooperation maintenance system and method based on augmented reality technology |
| CN206460517U (en) * | 2017-02-23 | 2017-09-01 | 安徽感知土木科技有限公司 | A kind of bridge inspection based on VR and damage diagnostic system |
| CN107172390A (en) * | 2017-05-12 | 2017-09-15 | 广州市和佳电子科技有限公司 | It is a kind of based on intelligent glasses for terminal platform visualization system and implementation method |
| CN107277450A (en) * | 2017-07-14 | 2017-10-20 | 福建铁工机智能机器人有限公司 | A kind of utilization AR realizes the method and apparatus of the live disaster relief of remote command |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108921259A (en) * | 2018-09-18 | 2018-11-30 | 西安艾润物联网技术服务有限责任公司 | Parking lot inspection device and system |
| CN109598731A (en) * | 2018-12-07 | 2019-04-09 | 北京中交睿达科技有限公司 | A kind of economical road visiting method |
| CN109741010A (en) * | 2018-12-14 | 2019-05-10 | 四川省交通运输厅交通勘察设计研究院 | A kind of road interactive mode field investigation system based on BIM and AR technology |
| CN110310451A (en) * | 2019-07-22 | 2019-10-08 | 软通智慧科技有限公司 | Fire hazard troubleshooting system and method based on wearable equipment |
| CN111031284A (en) * | 2019-12-12 | 2020-04-17 | 国网浙江余姚市供电有限公司 | Infrastructure construction site management and control method, system and terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107872655A (en) | A kind of method and system for determining hidden danger point | |
| CN107277451A (en) | A kind of utilization AR realizes the method and apparatus of remote guide scene investigation failure | |
| KR101147193B1 (en) | Monitoring system using smart phone | |
| CN107426508A (en) | A kind of method that long-range security inspection is realized using AR | |
| CN104767807A (en) | Information transmission method based on wearable devices and related devices | |
| CN105991962A (en) | Information display method, device and system | |
| CN109521935A (en) | It is a kind of to record screen, the reproducing method based on record screen, terminal | |
| CN108023298A (en) | A kind of tunnel cable attribute display method and system | |
| CN107241579A (en) | A kind of utilization AR realizes the method and apparatus of Telemedicine Consultation | |
| CN107197172A (en) | Net cast methods, devices and systems | |
| CN115022701B (en) | Video playing method, terminal, device, electronic equipment, medium and program product | |
| CN110536075A (en) | Video generation method and device | |
| CN201982135U (en) | Wireless multimedia command system in mine rescue | |
| CN114661026A (en) | Interactive vehicle remote diagnosis method and system based on augmented reality and storage medium thereof | |
| CN102061935B (en) | Wireless multimedia command system for mine rescue | |
| CN104410898A (en) | Intelligent home cloud box system and control method thereof | |
| CN107741785A (en) | A kind of remote guide method and system for protecting front end safety | |
| CN108195392A (en) | A kind of more people's layout of roads methods and terminal | |
| CN107277450A (en) | A kind of utilization AR realizes the method and apparatus of the live disaster relief of remote command | |
| AU2022394652A1 (en) | Video recommendation processing method and apparatus, and electronic device | |
| KR102481234B1 (en) | Video education system for disaster and safety accident response training based on virtual reality | |
| CN105854267A (en) | Data processing method and device and running machine | |
| CN109167872A (en) | A kind of application program open method and mobile terminal | |
| CN104657902A (en) | Integrated support intelligent terminal system for equipment and implementation method of intelligent terminal system | |
| CN103024505A (en) | Method, terminal and system for remotely controlling media playing on basis of application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180403 |