CN111931676A - Intelligent robot system with environment information visualization capability - Google Patents
Intelligent robot system with environment information visualization capability Download PDFInfo
- Publication number
- CN111931676A CN111931676A CN202010834137.2A CN202010834137A CN111931676A CN 111931676 A CN111931676 A CN 111931676A CN 202010834137 A CN202010834137 A CN 202010834137A CN 111931676 A CN111931676 A CN 111931676A
- Authority
- CN
- China
- Prior art keywords
- environment information
- information
- cloud service
- intelligent robot
- service module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/197—Matching; Classification
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides an intelligent robot system with environment information visualization capacity, which comprises an intelligent robot, wearing equipment with intelligent glasses, an environment information acquisition module and a cloud service module, wherein the wearing equipment is provided with an intelligent glasses; the environment information acquisition module gathers environment information acquired in real time and uploads the environment information to the cloud service module, wherein the environment information comprises environment parameters of equipment to be patrolled and examined, equipment operation and state parameters; the cloud service module is used for storing the enhanced information of each device needing to be patrolled and examined; the intelligent robot is arranged on the wearable device and used for accessing the cloud service module to acquire the enhancement information of the equipment to be patrolled and examined, acquiring the real space image of the equipment to be patrolled and examined, superimposing the enhancement information in the real space image, forming the augmented reality image and transmitting the augmented reality image to the intelligent glasses for displaying. The invention realizes the environmental information acquisition of equipment by utilizing a wireless sensor network, and designs the intelligent robot with the environmental information visualization capability based on the augmented reality technology.
Description
Technical Field
The invention relates to the technical field of data center equipment inspection, in particular to an intelligent robot system with environment information visualization capacity.
Background
In the related art, the augmented reality technology is a technology of taking a position and an angle of a computer camera in real time and adding a corresponding image, and the technology aims to sleeve a virtual world on a screen in a real world and interact with the virtual world. Through scientific technologies such as computers and the like, the virtual information is applied to the real world after simulation and then is superposed, and is perceived by human sense, so that the sense experience beyond reality is achieved. In recent years, wearable equipment which is developed rapidly, such as intelligent glasses, is combined with an augmented reality technology, and has the advantages of helping people understand and manipulate a physical environment, providing detailed guidance for complex industrial tasks, enhancing instant messaging and cooperation and the like, so that how to utilize the wearable augmented reality technology to provide visual help for equipment inspection personnel improves the efficiency of inspection work, promotes the development of paperless inspection, and has important significance.
Disclosure of Invention
In order to solve the problems, the invention provides an intelligent robot system with environment information visualization capability.
The purpose of the invention is realized by adopting the following technical scheme:
the intelligent robot system with the environment information visualization capability comprises an intelligent robot, wearable equipment with intelligent glasses, an environment information acquisition module and a cloud service module; the environment information acquisition module collects environment information acquired in real time and uploads the environment information to the cloud service module, wherein the environment information comprises environment parameters of equipment to be inspected, equipment operation and state parameters; the cloud service module is used for storing enhanced information of each device to be inspected, and the enhanced information comprises maintenance records, ledger information, historical inspection information and environmental information uploaded by the environmental information acquisition module; the intelligent robot is arranged on the wearable device and used for accessing the cloud service module to obtain the enhancement information of the device to be inspected, acquiring a real space image of the device to be inspected, superimposing the enhancement information on the real space image to form an augmented reality image and transmitting the augmented reality image to the intelligent glasses for display; the environment information acquisition module comprises sensor nodes, cluster heads and sink nodes, the sensor nodes are used for acquiring environment information of monitored positions, the cluster heads collect the environment information sent by the sensor nodes in the clusters, and the sink nodes send the environment information collected by the cluster heads to the cloud service module.
In an implementation manner, the cloud service module includes a storage unit, and the storage unit is used for storing the enhanced information of each device to be inspected.
Further, the cloud service module further comprises an interaction unit, and the interaction unit is used for carrying out data communication with a preset user terminal.
In an implementation manner, when the interaction unit performs data communication with the preset user terminal, the interaction unit verifies the identity identification information sent by the preset user terminal, calls corresponding data from the storage unit according to a query instruction of the preset user terminal after the verification is passed, and sends the data to the preset user terminal.
In an implementation manner, the identification information includes an iris image, and the verifying the identification information sent by the preset user terminal includes matching and recognizing the iris image with a stored standard iris image, and if the matching is successful, the verification is passed.
The invention has the beneficial effects that: utilize wireless sensor network to realize the environmental information collection of equipment to design the intelligent robot who has the visual ability of environmental information based on augmented reality technique, for the personnel of patrolling and examining of equipment provide convenient, audio-visual help, effectively improved security, real-time, the efficiency of the operation of patrolling and examining.
Drawings
The invention is further illustrated by means of the attached drawings, but the embodiments in the drawings do not constitute any limitation to the invention, and for a person skilled in the art, other drawings can be obtained on the basis of the following drawings without inventive effort.
FIG. 1 is a block diagram of structural connections of an intelligent robotic system with environmental information visualization capabilities in accordance with an exemplary embodiment of the present invention;
fig. 2 is a block diagram of structural connections of cloud service modules according to an exemplary embodiment of the present invention.
Reference numerals:
the intelligent glasses comprise an intelligent robot 1, intelligent glasses 2, a wearable device 3, an environmental information acquisition module 4, a cloud service module 5, a storage unit 10 and an interaction unit 20.
Detailed Description
The invention is further described with reference to the following examples.
Referring to fig. 1, the embodiment provides an intelligent robot system with an environment information visualization capability, which includes an intelligent robot 1, a wearable device 3 with intelligent glasses 2, an environment information acquisition module 4, and a cloud service module 5; the environment information acquisition module 4 gathers environment information acquired in real time and uploads the environment information to the cloud service module 5, wherein the environment information comprises environment parameters of equipment to be inspected, equipment operation and state parameters; the cloud service module 5 is used for storing enhanced information of each device to be inspected, and comprises environmental information, maintenance records, ledger information and historical inspection information which are uploaded by the environmental information acquisition module 4; the intelligent robot 1 is arranged on the wearable device 3 and used for accessing the cloud service module 5 to obtain the enhancement information of the device to be inspected, acquiring a real space image of the device to be inspected, superimposing the enhancement information on the real space image to form an augmented reality image and transmitting the augmented reality image to the intelligent glasses 2 for display; the environmental information collection module 4 comprises sensor nodes, cluster heads and sink nodes, the sensor nodes are used for collecting environmental information of monitored positions, the cluster heads collect the environmental information sent by the sensor nodes in the clusters, and the sink nodes send the environmental information collected by the cluster heads to the cloud service module 5.
In one embodiment, the intelligent robot 1 comprises an image acquisition module and an image enhancement processing module which are connected, wherein the image acquisition module is used for acquiring a real space image of equipment to be inspected, and the image enhancement processing module is used for superimposing enhancement information of the equipment to be inspected on the real space image to form an augmented reality image; the system further comprises a communication module for realizing information interaction with the cloud service module 5. The enhancement information acquired from the cloud service module 5 is superimposed to the image acquired by the intelligent robot 1 through the image enhancement processing module, so that personnel wearing the wearable device 3 can know the running condition of the equipment needing to be patrolled and examined more intuitively.
In one embodiment, the image capturing module is a dual-camera, and the wearable device 3 is provided with a control device for controlling the dual-camera to move and controlling the lenses of the dual-camera to zoom in or out.
In an implementation manner, as shown in fig. 2, the cloud service module 5 includes a storage unit 10, where the storage unit 10 is configured to store enhanced information of each device to be inspected, and further, the cloud service module 5 further includes an interaction unit 20, and the interaction unit 20 is configured to perform data communication with a preset user terminal.
In an implementation manner, when performing data communication with the preset user terminal, the interaction unit 20 verifies the identification information sent by the preset user terminal, retrieves corresponding data from the storage unit according to a query instruction of the preset user terminal after the verification is passed, and sends the data to the preset user terminal.
In an implementation manner, the identification information includes an iris image, and the verifying the identification information sent by the preset user terminal includes matching and recognizing the iris image with a stored standard iris image, and if the matching is successful, the verification is passed.
According to the embodiment of the invention, the environment information acquisition of the equipment is realized by utilizing the wireless sensor network, the intelligent robot with the environment information visualization capability is designed based on the augmented reality technology, the convenient and visual visualization help is provided for the inspection personnel of the equipment, and the safety, the real-time performance and the efficiency of the inspection operation are effectively improved.
In one implementation manner, a cluster head selects a mode of direct communication or indirect communication to communicate with a sink node according to a distance to the sink node, and the method includes: initially, when the distance from a cluster head to a sink node does not exceed a set distance threshold, selecting a direct communication mode to communicate with the sink node, and when the distance exceeds the set distance threshold, selecting an indirect communication mode to communicate with the sink node; every other preset period DeltaT0The sink node acquires energy data and position data of each cluster head in direct communication with the sink node through data interaction with each cluster head in direct communication with the sink node, and calculates a reference energy value U according to the energy data and the position datacAnd applying the reference energy value UcSending to each cluster head with which it is in direct communication:
in the formula, LTIndicating the set distance threshold value, i indicates the ith cluster head of which the distance to the sink node is not more than the distance threshold value, K is the number of the cluster heads of which the distance to the sink node is not more than the distance threshold value, UiIs the current remaining energy, U, of the ith cluster headmin1Minimum energy, U, required to collect data for a predetermined cluster headmin2L (i, sink) is the distance between a cluster head i and a sink node, and the sink represents the sink node;
if the current remaining energy of the cluster head in direct communication with the cluster head is not more than UcThe cluster head communicates with the sink node in an indirect communication mode.
And when the cluster head selects an indirect communication mode to communicate with the aggregation node, randomly selecting a next hop node in a neighbor cluster head which is closer to the aggregation node relative to the cluster head.
The embodiment proposes a mechanism related to whether a cluster head in direct communication with a sink node needs to switch a communication mode, wherein a reference energy value U is proposedcThe measurement indexes and the corresponding calculation formulas realize the switching of the cluster head between the direct communication mode and the indirect communication mode, and increase the flexibility of data communication; every other preset period DeltaT0The current residual energy of each cluster head is not more than the reference energy value UcThe communication mode is switched, so that the energy consumption caused by unnecessary communication mode switching is avoided. In this embodiment, the mechanism makes the cluster head energy higher than the reference energy value UcAnd the communication mode is switched in time in hours, so that the cluster heads are prevented from consuming energy quickly, the energy of all the cluster heads around the sink node is balanced, and the running stability of the environmental information acquisition module 4 is improved.
In one implementation, the maximum communication distance that can be achieved by the cluster head by adjusting the power is set to LmaxThe set distance threshold is as follows:
wherein L (j, sink) is the distance from the sink node not exceeding LmaxDistance of cluster head to sink node, MLmaxTo the distance from the sink node not exceeding LmaxThe number of cluster heads.
The distance threshold setting formula is given based on the maximum communication distance and the actual deployment position condition of the cluster heads, so that the cluster heads with proper quantity can directly communicate with the sink nodes in the initial state of the network, the distance threshold can be set according to the actual deployment position condition of the cluster heads, and the scientificity of distance threshold setting is improved.
It will be clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be performed by different functional modules according to needs, that is, the internal structure of the system is divided into different functional modules to perform all or part of the above described functions. For the specific working process of the system and the terminal described above, reference may be made to the corresponding process in the foregoing method embodiment, which is not described herein again.
From the above description of embodiments, it is clear for a person skilled in the art that the embodiments described herein can be implemented in hardware, software, firmware, middleware, code or any appropriate combination thereof. For a hardware implementation, a processor may be implemented in one or more of the following units: an application specific integrated circuit, a digital signal processor, a digital signal processing system, a programmable logic device, a field programmable gate array, a processor, a controller, a microcontroller, a microprocessor, other electronic units designed to perform the functions described herein, or a combination thereof. For a software implementation, some or all of the procedures of an embodiment may be performed by a computer program instructing associated hardware. In practice, the program may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a computer. The computer-readable medium can include, but is not limited to, random access memory, read only memory images, electrically erasable programmable read only memory or other optical disk storage, magnetic disk storage media or other magnetic storage systems, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.
Finally, it should be noted that the above embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the protection scope of the present invention, although the present invention is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions can be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.
Claims (5)
1. An intelligent robot system with environment information visualization capability is characterized by comprising an intelligent robot, wearing equipment with intelligent glasses, an environment information acquisition module and a cloud service module; the environment information acquisition module collects environment information acquired in real time and uploads the environment information to the cloud service module, wherein the environment information comprises environment parameters of equipment to be inspected, equipment operation and state parameters; the cloud service module is used for storing enhanced information of each device to be inspected, and the enhanced information comprises maintenance records, ledger information, historical inspection information and environmental information uploaded by the environmental information acquisition module; the intelligent robot is arranged on the wearable device and used for accessing the cloud service module to obtain the enhancement information of the device to be inspected, acquiring a real space image of the device to be inspected, superimposing the enhancement information on the real space image to form an augmented reality image and transmitting the augmented reality image to the intelligent glasses for display; the environment information acquisition module comprises sensor nodes, cluster heads and sink nodes, the sensor nodes are used for acquiring environment information of monitored positions, the cluster heads collect the environment information sent by the sensor nodes in the clusters, and the sink nodes send the environment information collected by the cluster heads to the cloud service module.
2. The intelligent robot system with the environment information visualization capability of claim 1, wherein the cloud service module comprises a storage unit, and the storage unit is used for storing the enhanced information of the equipment to be inspected.
3. The intelligent robot system with the environment information visualization capability of claim 2, wherein the cloud service module further comprises an interaction unit, and the interaction unit is used for data communication with a preset user terminal.
4. The intelligent robot system with the environment information visualization capability of claim 3, wherein the interaction unit verifies the identification information sent by the preset user terminal when performing data communication with the preset user terminal, retrieves corresponding data from the storage unit according to the query instruction of the preset user terminal after the verification is passed, and sends the data to the preset user terminal.
5. The intelligent robot system with environment information visualization capability of claim 4, wherein the identification information includes an iris image, and the verification of the identification information sent by the preset user terminal includes matching and recognizing the iris image with a stored standard iris image, and if the matching is successful, the verification is passed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010834137.2A CN111931676A (en) | 2020-08-18 | 2020-08-18 | Intelligent robot system with environment information visualization capability |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010834137.2A CN111931676A (en) | 2020-08-18 | 2020-08-18 | Intelligent robot system with environment information visualization capability |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111931676A true CN111931676A (en) | 2020-11-13 |
Family
ID=73305843
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010834137.2A Withdrawn CN111931676A (en) | 2020-08-18 | 2020-08-18 | Intelligent robot system with environment information visualization capability |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111931676A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114758426A (en) * | 2022-03-23 | 2022-07-15 | 国网浙江省电力有限公司嘉兴供电公司 | An electric power AR real scene digital inspection system and method |
-
2020
- 2020-08-18 CN CN202010834137.2A patent/CN111931676A/en not_active Withdrawn
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114758426A (en) * | 2022-03-23 | 2022-07-15 | 国网浙江省电力有限公司嘉兴供电公司 | An electric power AR real scene digital inspection system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4478510B2 (en) | Camera system, camera, and camera control method | |
| CN107341489B (en) | Image recognition system for machine room monitoring | |
| CN103841379B (en) | Intelligent identification visual monitoring system and method based on Internet of Things | |
| CN202840685U (en) | Monitor system integrated with infrared and visible light monitor components, and transformer station network | |
| CN112399072B (en) | VR live-action system for monitoring switch station data of power distribution room in real time | |
| CN113225212A (en) | Data center monitoring system, method and server | |
| CN106060452A (en) | Method and apparatus for controlling a surveillance system | |
| CN105260725A (en) | Iris recognition system | |
| CN112052785A (en) | Intelligent monitoring system of inspection robot | |
| CN108459711A (en) | Augmented reality management system for breeding, method and computer readable storage medium | |
| CN102340179B (en) | Network-based multi-station monitoring integrated matrix display control system | |
| WO2019225912A1 (en) | Method for controlling air conditioner by recognizing zone on basis of artificial intelligence, server, and air conditioner | |
| CN111931676A (en) | Intelligent robot system with environment information visualization capability | |
| US20110267471A1 (en) | Security monitoring system and method | |
| CN207589029U (en) | A kind of intelligent mobile full-view video image monitoring system | |
| US9882740B2 (en) | Wireless acquisition of digital video images | |
| CN105049786B (en) | Thermal infrared imager tests auxiliary system and method | |
| CN109121194B (en) | Method and apparatus for state transition of electronic device | |
| CN116582649A (en) | Monitoring and identifying system for unsafe behaviors of staff on construction site | |
| CN117061165A (en) | Safety protection system based on space-time data lake technology of monitoring and control system | |
| CN207027526U (en) | A kind of mobile security robot with video analysis function based on binocular vision | |
| JP6632632B2 (en) | Monitoring system | |
| CN116189249A (en) | Image recognition method and device of intelligent equipment, intelligent equipment and electronic equipment | |
| CN114979611A (en) | Binocular sensing system and method | |
| CN105338295A (en) | Law of evidence individual-soldier shoulder-carried mobile monitoring system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20201113 |
|
| WW01 | Invention patent application withdrawn after publication |