CN111885707A - AR (augmented reality) -device-based Internet of things device control method and system - Google Patents
AR (augmented reality) -device-based Internet of things device control method and system Download PDFInfo
- Publication number
- CN111885707A CN111885707A CN202010779392.1A CN202010779392A CN111885707A CN 111885707 A CN111885707 A CN 111885707A CN 202010779392 A CN202010779392 A CN 202010779392A CN 111885707 A CN111885707 A CN 111885707A
- Authority
- CN
- China
- Prior art keywords
- internet
- equipment
- things
- uwb
- things equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W64/00—Locating users or terminals or network equipment for network management purposes, e.g. mobility management
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/003—Navigation within 3D models or images
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y10/00—Economic sectors
- G16Y10/75—Information technology; Communication
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y40/00—IoT characterised by the purpose of the information processing
- G16Y40/30—Control
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y40/00—IoT characterised by the purpose of the information processing
- G16Y40/60—Positioning; Navigation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/023—Services making use of location information using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
Landscapes
- Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Remote Sensing (AREA)
- Theoretical Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Software Systems (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Computer Hardware Design (AREA)
- Economics (AREA)
- General Business, Economics & Management (AREA)
- Development Economics (AREA)
- Accounting & Taxation (AREA)
- Data Mining & Analysis (AREA)
- Business, Economics & Management (AREA)
- Computer Graphics (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses an AR (augmented reality) equipment-based control method of an Internet of things, which comprises the following steps that a dynamic UWB module in AR equipment and a static UWB module in the Internet of things equipment are communicated with each other; moving the AR equipment along a preset track in space, and calculating a distance parameter between the AR equipment and the equipment of the Internet of things through UWB signals transmitted in a UWB network when the AR equipment is moved; when the AR equipment is moved, an SLAM map is established through the AR equipment; generating coordinate information of the Internet of things equipment in the SLAM map through the distance parameters; and controlling the Internet of things equipment through the AR equipment based on the coordinate information. Through the combination of UWB and SLAM technologies, the coordinate information of the Internet of things equipment at each fixed position can be loaded in an SLAM map in the AR equipment, and therefore the quick browsing and control of the Internet of things equipment are achieved. The invention also provides a system which also has the beneficial effects.
Description
Technical Field
The invention relates to the technical field of Internet of things, in particular to an AR (augmented reality) equipment control method and an AR equipment control system.
Background
The ecology of interconnected smart devices is rapidly merging into people's daily life and work environments. It is anticipated that ubiquitous computing will greatly enhance the physical world around them. However, accessing and interacting with the internet of things (IoT) remains challenging due to the increased diversity and complexity of connected devices. Traditionally, the digital interface of interactive devices has been implemented with self-contained touch screen displays with limited adaptability. Today, however, contemporary internet of things devices allow users to remotely access full functionality by using a floating interface on a smartphone. However, in order to discover and access the device, the user needs to browse a specific web page or search for a corresponding application online, making the process somewhat cumbersome. Therefore, how to provide a control method capable of quickly browsing and controlling the internet of things equipment is a problem that needs to be solved by those skilled in the art.
Disclosure of Invention
The invention aims to provide an AR (augmented reality) -based Internet of things equipment control method, which can realize quick browsing and control of Internet of things equipment; another object of the present invention is to provide an AR device-based internet of things device control system, which can implement fast browsing and control of internet of things devices.
In order to solve the technical problem, the invention provides an AR device-based internet of things device control method, which includes:
establishing a UWB network by mutual communication between a dynamic UWB module in the AR equipment and a static UWB module in the Internet of things equipment; the Internet of things equipment is fixed in a preset space;
moving the AR equipment along a preset track in the preset space, and calculating a distance parameter between the AR equipment and the Internet of things equipment through a UWB signal transmitted in the UWB network when the AR equipment is moved;
when the AR equipment is moved in the preset space, establishing a SLAM map through the AR equipment;
generating coordinate information of the Internet of things equipment in the SLAM map through the distance parameter;
and controlling the Internet of things equipment through the AR equipment based on the coordinate information.
Optionally, establishing a UWB network by mutual communication between a dynamic UWB module in the AR device and a static UWB module in the internet of things device includes:
the dynamic UWB module in the AR equipment is communicated with the static UWB module in each Internet of things equipment, and a UWB network is established through the mutual communication of any two static UWB modules.
Optionally, the generating of the coordinate information of the internet of things device in the SLAM map through the distance parameter includes:
and calling an MDS positioning model, and generating coordinate information of the Internet of things equipment in the SLAM map through the distance parameter.
Optionally, the controlling, by the AR device, the internet of things device based on the coordinate information includes:
acquiring a scene image in the preset space through the AR equipment;
when the Internet of things equipment is not included in the scene image, generating an identifier pointing to the Internet of things equipment in the scene image based on the coordinate information.
Optionally, the controlling, by the AR device, the internet of things device based on the coordinate information includes:
when the scene image comprises the Internet of things equipment, loading a control interface of the Internet of things equipment in the scene image.
The invention also provides an AR equipment-based Internet of things equipment control system, which comprises the AR equipment and the Internet of things equipment;
a dynamic UWB module is arranged in the AR equipment, and a static UWB module is arranged in the Internet of things equipment; the dynamic UWB module and the static UWB module are communicated with each other to form a UWB network; the Internet of things equipment is fixed in a preset space;
the AR device is to:
moving along a preset track in the preset space, and calculating a distance parameter between the AR equipment and the Internet of things equipment through a UWB signal transmitted in the UWB network when the AR equipment is moved;
establishing a SLAM map when the AR equipment is moved in the preset space;
generating coordinate information of the Internet of things equipment in the SLAM map through the distance parameter;
and controlling the Internet of things equipment based on the coordinate information.
Optionally, the system comprises at least a plurality of internet of things devices, and any one of the internet of things devices is provided with the static UWB module; the dynamic UWB modules communicate with each of the static UWB modules, and any two of the static UWB modules communicate with each other to form the UWB network.
Optionally, the AR device is specifically configured to:
and calling an MDS positioning model, and generating coordinate information of the Internet of things equipment in the SLAM map through the distance parameter.
Optionally, the AR device is specifically configured to:
acquiring a scene image in the preset space;
when the Internet of things equipment is not included in the scene image, generating an identifier pointing to the Internet of things equipment in the scene image based on the coordinate information.
Optionally, the AR device is specifically configured to:
when the scene image comprises the Internet of things equipment, loading a control interface of the Internet of things equipment in the scene image.
The invention provides an AR equipment-based Internet of things equipment control method, which comprises the steps of establishing a UWB network through mutual communication between a dynamic UWB module in AR equipment and a static UWB module in the Internet of things equipment; the Internet of things equipment is fixed in a preset space; moving the AR equipment along a preset track in space, and calculating a distance parameter between the AR equipment and the equipment of the Internet of things through UWB signals transmitted in a UWB network when the AR equipment is moved; when the AR equipment is moved, an SLAM map is established through the AR equipment; generating coordinate information of the Internet of things equipment in the SLAM map through the distance parameters; and controlling the Internet of things equipment through the AR equipment based on the coordinate information.
Through the combination of the UWB (ultra wide band wireless communication) technology and the SLAM (instant positioning and map construction) technology, the coordinate information of the Internet of things equipment at each fixed position can be loaded in an SLAM map in the AR (augmented reality) equipment. The user can find and control the Internet of things equipment in time based on the coordinate information through the AR equipment, so that the Internet of things equipment can be browsed and controlled quickly.
The invention also provides an AR equipment-based Internet of things equipment control system, which has the beneficial effects and is not repeated herein.
Drawings
In order to more clearly illustrate the embodiments or technical solutions of the present invention, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
Fig. 1 is a flowchart of an AR device-based internet of things device control method according to an embodiment of the present invention;
fig. 2 is a flowchart of a specific method for controlling an internet of things device based on an AR device according to an embodiment of the present invention;
fig. 3 is a block diagram of a structure of an internet of things device control system based on an AR device according to an embodiment of the present invention.
Detailed Description
The core of the invention is to provide an Internet of things equipment control method based on AR equipment. In the prior art, in order to discover and access a device, a user needs to browse a specific webpage or search a corresponding application on line, so that the process is somewhat cumbersome.
The invention provides an AR equipment-based control method of an Internet of things device, which comprises the following steps that a dynamic UWB module in the AR equipment and a static UWB module in the Internet of things device are communicated with each other to establish a UWB network; the Internet of things equipment is fixed in a preset space; moving the AR equipment along a preset track in space, and calculating a distance parameter between the AR equipment and the equipment of the Internet of things through UWB signals transmitted in a UWB network when the AR equipment is moved; when the AR equipment is moved, an SLAM map is established through the AR equipment; generating coordinate information of the Internet of things equipment in the SLAM map through the distance parameters; and controlling the Internet of things equipment through the AR equipment based on the coordinate information.
Through the combination of UWB and SLAM technologies, the coordinate information of the Internet of things equipment at each fixed position can be loaded in the SLAM map in the AR equipment. The user can find and control the Internet of things equipment in time based on the coordinate information through the AR equipment, so that the Internet of things equipment can be browsed and controlled quickly.
In order that those skilled in the art will better understand the disclosure, the invention will be described in further detail with reference to the accompanying drawings and specific embodiments. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a flowchart of an internet of things device control method based on an AR device according to an embodiment of the present invention.
Referring to fig. 1, in the embodiment of the present invention, a method for controlling an internet of things device based on an AR device includes:
s101: a UWB network is established by mutual communication between a dynamic UWB module in the AR equipment and a static UWB module in the Internet of things equipment.
In the embodiment of the invention, the internet of things equipment is fixed in a preset space. UWB, an ultra-wideband wireless communication technology, is a carrier-free communication technology, and UWB does not use a carrier but uses a short energy pulse sequence, and spreads pulses into a frequency range by orthogonal frequency division modulation or direct sequencing. UWB is mainly characterized by high transmission rate, large spatial capacity, low cost, low power consumption, etc., and will certainly become a technical means to solve the contradiction between the demand for high-speed internet access and the increasingly crowded allocation of frequency resources. The ultra-wideband indoor positioning system comprises a UWB receiver, a UWB reference tag and an active UWB tag. In the positioning process, the UWB receiver receives the UWB signals transmitted by the tags, the signals containing effective information are obtained by filtering various noise interferences mixed in the transmission process of electromagnetic waves, and then the distance measurement positioning calculation analysis is carried out through the central processing unit.
In the embodiment of the present invention, the UWB module is a functional module for receiving and transmitting UWB signals. Specifically, the UWB module disposed in the internet of things device is a static UWB module, and the static UWB module generally needs to be provided with a UWB receiver and a UWB reference tag; the UWB module provided in the AR device is a dynamic UWB module, and the dynamic UWB module generally needs to be provided with a UWB receiver and an active UWB tag. In this step, the dynamic UWB module needs to communicate with the static UWB module, that is, to transmit UWB signals to each other to construct a UWB network, that is, a communication network constructed based on the UWB signals.
The type and function of the internet of things device are not specifically limited in the embodiments of the present invention, and are determined according to specific situations. The predetermined space is generally a room space in which the internet of things device is installed, and the AR device can move freely in the predetermined space. The type of the AR device is also not specifically limited in the embodiments of the present invention, as the case may be.
S102: the AR equipment moves along a preset track in a preset space, and when the AR equipment is moved, distance parameters between the AR equipment and the Internet of things equipment are calculated through UWB signals transmitted in a UWB network.
In this step, the AR device needs to be controlled to move in a preset space where the internet of things device is installed, and the distance between the AR device and the internet of things device can be changed when the AR device is moved, so that the distance parameter between the AR device and the internet of things device can be calculated through the UWB signal transmitted in the UWB network. In general, the distance parameter between the AR device and the internet of things device is calculated in real time through the UWB signal transmitted in the UWB network, so as to obtain a plurality of distance parameters according to the sequence of time points. For a specific process of calculating a distance parameter between two objects based on a UWB signal, reference may be made to the prior art, and details thereof are not repeated herein.
S103: and when the AR equipment is moved in the preset space, establishing the SLAM map through the AR equipment.
In this step, while the AR device is moved, a SLAM map may also be established by the AR device. SLAM (immediate positioning and mapping) technology is typically used for the positioning of robots in unknown environments. By utilizing SLAM technology, the unknown of the robot relative to the environment can be positioned through repeatedly observed terrain features in the motion process when the robot starts from an unknown place of the unknown environment. Colloquially, with SLAM technology, a robot can map an unfamiliar environment in real time and locate itself relative to the unfamiliar environment. Meanwhile, the SLAM technology is also one of the core technologies of the augmented reality technology. In this step, the AR device may further acquire the image of the preset space during the movement, and construct a SLAM map in the AR device according to the acquired image of the preset space based on a SLAM technique. It should be noted that, in the process of moving the AR device, it is required to ensure that the AR device can obtain the complete face of the whole preset space as much as possible.
S104: and generating coordinate information of the Internet of things equipment in the SLAM map through the distance parameters.
In this step, based on the distance parameter, coordinate information corresponding to the internet of things device may be generated in the SLAM map, and a position corresponding to the coordinate information in the SLAM map, that is, a position where the internet of things device is located. In general, in this step, the coordinate information needs to be loaded into the SLAM map, so that the user can directly obtain the coordinate information of the internet of things device through the AR device based on the SLAM map.
S105: and controlling the Internet of things equipment through the AR equipment based on the coordinate information.
In this step, the user may control the corresponding internet of things device based on the coordinate information through the AR device, thereby implementing control of the internet of things device.
The method for controlling the equipment of the Internet of things based on the AR equipment comprises the steps that a dynamic UWB module in the AR equipment is communicated with a static UWB module in the equipment of the Internet of things to establish a UWB network; the Internet of things equipment is fixed in a preset space; moving the AR equipment along a preset track in space, and calculating a distance parameter between the AR equipment and the equipment of the Internet of things through UWB signals transmitted in a UWB network when the AR equipment is moved; when the AR equipment is moved, an SLAM map is established through the AR equipment; generating coordinate information of the Internet of things equipment in the SLAM map through the distance parameters; and controlling the Internet of things equipment through the AR equipment based on the coordinate information.
Through the combination of UWB and SLAM technologies, the coordinate information of the Internet of things equipment at each fixed position can be loaded in the SLAM map in the AR equipment. The user can find and control the Internet of things equipment in time based on the coordinate information through the AR equipment, so that the Internet of things equipment can be browsed and controlled quickly.
Specific contents related to the method for controlling the internet of things device based on the AR device provided by the present invention will be described in detail in the following embodiments of the present invention.
Referring to fig. 2, fig. 2 is a flowchart of a specific method for controlling an internet of things device based on an AR device according to an embodiment of the present invention.
Referring to fig. 2, in the embodiment of the present invention, an AR device-based internet of things device control method includes:
s201: a dynamic UWB module in the AR equipment is communicated with a static UWB module in each Internet of things equipment, and any two static UWB modules are communicated with each other to establish a UWB network.
In the embodiment of the present invention, a plurality of internet of things devices are generally arranged in the preset space, and the types of different internet of things devices may be the same or different, which is not specifically limited in the embodiment of the present invention. In this step, not only the dynamic UWB module in the AR device and the static UWB module in each internet of things device communicate with each other, but also the static UWB modules in different internet of things devices communicate with each other to construct a UWB network together. After a plurality of pieces of internet-of-things equipment are added, the accuracy of the acquired distance parameters can be obviously improved, and therefore the accuracy of the coordinate information of the corresponding internet-of-things equipment in the SLAM map is improved.
S202: the AR equipment moves along a preset track in a preset space, and when the AR equipment is moved, distance parameters between the AR equipment and the Internet of things equipment are calculated through UWB signals transmitted in a UWB network.
S203: and when the AR equipment is moved in the preset space, establishing the SLAM map through the AR equipment.
S202 to S203 are substantially the same as S102 to S103 in the above embodiment of the invention, and for details, reference is made to the above embodiment of the invention, which is not repeated herein.
S204: and calling an MDS positioning model, and generating coordinate information of the Internet of things equipment in the SLAM map through the distance parameter.
The MDS positioning model is a calculation model established based on the MDS positioning technology, and MDS is multivariate analysis (Multidimensional scaling), which is a multivariate analysis technology. MDS location techniques, which are commonly used to solve the traditional location problem in wireless networks, derive location coordinates by minimizing the error between measured and estimated distances. The measured distance can be obtained by measuring through a UWB module, and the calculated position coordinates are positions of all the Internet of things devices mapped to the AR device SLAM map.
In the step, coordinate information mapped by the Internet of things equipment in the SLAM map is obtained through MDS positioning model calculation, and the precision and accuracy of the coordinate information can be greatly improved.
S205: and obtaining a scene image in a preset space through the AR equipment.
The scene image is an image in a preset space acquired by the AR device.
S206: and when the scene image does not comprise the Internet of things equipment, generating an identifier pointing to the Internet of things equipment in the scene image based on the coordinate information.
When the internet of things device generated with the coordinate information is not included in the scene image, in this step, the AR device may determine, based on the coordinate information and the SLAM map, which direction the internet of things device is specifically located with respect to the current scene image, and then display, in the current scene image, an identifier pointing to the internet of things device, such as an arrow, a path, and the like, according to the coordinate information and the SLAM map, so that the user may be directed to the internet of things device.
S207: and when the scene image comprises the Internet of things equipment, loading a control interface of the Internet of things equipment in the scene image.
In this step, when the scene image includes the internet of things device, the AR device may directly load the control interface of the object-carrying networking device in the scene image, so that the user directly controls the internet of things device.
According to the method for controlling the Internet of things equipment based on the AR equipment, provided by the embodiment of the invention, the coordinate information of the Internet of things equipment at each fixed position can be loaded in the SLAM map in the AR equipment through the combination of UWB and SLAM technologies. The user can find and control the Internet of things equipment in time based on the coordinate information through the AR equipment, so that the Internet of things equipment can be browsed and controlled quickly.
In the following, the internet of things device control system based on the AR device provided by the embodiment of the present invention is introduced, and the internet of things device control system described below and the internet of things device control method described above may be referred to in a corresponding manner.
Referring to fig. 3, fig. 3 is a block diagram of an internet of things device control system based on an AR device according to an embodiment of the present invention.
Referring to fig. 3, in the embodiment of the present invention, an AR device-based internet of things device control system includes an AR device 1 and an internet of things device 2; a dynamic UWB module 11 is arranged in the AR equipment 1, and a static UWB module 21 is arranged in the Internet of things equipment 2; the dynamic UWB module 11 and the static UWB module 21 communicate with each other to form a UWB network; the Internet of things equipment 2 is fixed in a preset space; the AR device 1 is configured to: moving along a preset track in the preset space, and calculating a distance parameter between the AR device 1 and the Internet of things device 2 through a UWB signal transmitted in the UWB network when the AR device 1 is moved; establishing a SLAM map when the AR equipment 1 is moved in the preset space; generating coordinate information of the Internet of things equipment 2 in the SLAM map according to the distance parameter; and controlling the Internet of things equipment 2 based on the coordinate information.
Preferably, in the embodiment of the present invention, the system may include at least a plurality of the internet of things devices 2, and any one of the internet of things devices 2 is provided with the static UWB module 21; the dynamic UWB module 11 communicates with each of the static UWB modules 21, and any two of the static UWB modules 21 communicate with each other to form the UWB network.
Preferably, in the embodiment of the present invention, the AR device 1 is specifically configured to: and calling an MDS positioning model, and generating coordinate information of the Internet of things equipment 2 in the SLAM map through the distance parameter.
Preferably, in the embodiment of the present invention, the AR device 1 is specifically configured to: acquiring a scene image in the preset space; when the internet of things device 2 is not included in the scene image, an identifier pointing to the internet of things device 2 is generated in the scene image based on the coordinate information.
Preferably, in the embodiment of the present invention, the AR device 1 is specifically configured to: when the internet of things device 2 is included in the scene image, a control interface of the internet of things device 2 is loaded in the scene image.
The internet of things device control system based on the AR device in this embodiment is used to implement the internet of things device control method based on the AR device, and therefore a specific implementation manner in the internet of things device control system may be found in the foregoing embodiment portions of the internet of things device control method, and therefore, the specific implementation manner thereof may refer to descriptions of corresponding embodiments of the respective portions, and details are not described herein again.
The embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same or similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The method for controlling the internet of things based on the AR equipment and the system for controlling the internet of things based on the AR equipment provided by the invention are described in detail above. The principles and embodiments of the present invention are explained herein using specific examples, which are presented only to assist in understanding the method and its core concepts. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present invention.
Claims (10)
1. An Internet of things equipment control method based on AR equipment is characterized by comprising the following steps:
establishing a UWB network by mutual communication between a dynamic UWB module in the AR equipment and a static UWB module in the Internet of things equipment; the Internet of things equipment is fixed in a preset space;
moving the AR equipment along a preset track in the preset space, and calculating a distance parameter between the AR equipment and the Internet of things equipment through a UWB signal transmitted in the UWB network when the AR equipment is moved;
when the AR equipment is moved in the preset space, establishing a SLAM map through the AR equipment;
generating coordinate information of the Internet of things equipment in the SLAM map through the distance parameter;
and controlling the Internet of things equipment through the AR equipment based on the coordinate information.
2. The method of claim 1, wherein establishing a UWB network by communicating with a dynamic UWB module in the AR device and a static UWB module in the internet of things device comprises:
the dynamic UWB module in the AR equipment is communicated with the static UWB module in each Internet of things equipment, and a UWB network is established through the mutual communication of any two static UWB modules.
3. The method of claim 2, wherein the generating coordinate information of the internet of things device in the SLAM map through the distance parameter comprises:
and calling an MDS positioning model, and generating coordinate information of the Internet of things equipment in the SLAM map through the distance parameter.
4. The method of any of claims 1 to 3, wherein the controlling, by the AR device, the Internet of things device based on the coordinate information comprises:
acquiring a scene image in the preset space through the AR equipment;
when the Internet of things equipment is not included in the scene image, generating an identifier pointing to the Internet of things equipment in the scene image based on the coordinate information.
5. The method of claim 4, wherein the controlling, by the AR device, the Internet of things device based on the coordinate information comprises:
when the scene image comprises the Internet of things equipment, loading a control interface of the Internet of things equipment in the scene image.
6. An Internet of things equipment control system based on AR equipment is characterized by comprising the AR equipment and the Internet of things equipment;
a dynamic UWB module is arranged in the AR equipment, and a static UWB module is arranged in the Internet of things equipment; the dynamic UWB module and the static UWB module are communicated with each other to form a UWB network; the Internet of things equipment is fixed in a preset space;
the AR device is to:
moving along a preset track in the preset space, and calculating a distance parameter between the AR equipment and the Internet of things equipment through a UWB signal transmitted in the UWB network when the AR equipment is moved;
establishing a SLAM map when the AR equipment is moved in the preset space;
generating coordinate information of the Internet of things equipment in the SLAM map through the distance parameter;
and controlling the Internet of things equipment based on the coordinate information.
7. The system of claim 6, comprising at least a plurality of the internet of things devices, any of the internet of things devices being provided with the static UWB module; the dynamic UWB modules communicate with each of the static UWB modules, and any two of the static UWB modules communicate with each other to form the UWB network.
8. The system of claim 7, wherein the AR device is specifically configured to:
and calling an MDS positioning model, and generating coordinate information of the Internet of things equipment in the SLAM map through the distance parameter.
9. The system according to any of claims 6 to 8, wherein the AR device is specifically configured to:
acquiring a scene image in the preset space;
when the Internet of things equipment is not included in the scene image, generating an identifier pointing to the Internet of things equipment in the scene image based on the coordinate information.
10. The system of claim 9, wherein the AR device is specifically configured to:
when the scene image comprises the Internet of things equipment, loading a control interface of the Internet of things equipment in the scene image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010779392.1A CN111885707A (en) | 2020-08-05 | 2020-08-05 | AR (augmented reality) -device-based Internet of things device control method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010779392.1A CN111885707A (en) | 2020-08-05 | 2020-08-05 | AR (augmented reality) -device-based Internet of things device control method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111885707A true CN111885707A (en) | 2020-11-03 |
Family
ID=73211288
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010779392.1A Pending CN111885707A (en) | 2020-08-05 | 2020-08-05 | AR (augmented reality) -device-based Internet of things device control method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111885707A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112785469A (en) * | 2021-02-03 | 2021-05-11 | 郑州轻工业大学 | Management system is equipped in wisdom campus education based on AR technique |
| CN114513771A (en) * | 2020-11-16 | 2022-05-17 | Oppo广东移动通信有限公司 | IoT (Internet of things) equipment control method, device, control system and terminal equipment |
| WO2023279887A1 (en) * | 2021-07-08 | 2023-01-12 | Oppo广东移动通信有限公司 | Device control method and apparatus, control system, device, and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108650245A (en) * | 2018-04-24 | 2018-10-12 | 上海奥孛睿斯科技有限公司 | Internet of things system based on augmented reality and operation method |
| CN108775901A (en) * | 2018-07-20 | 2018-11-09 | 山东大学 | A kind of real-time SLAM scenes map structuring system, navigation system and method |
| CN108965791A (en) * | 2018-04-04 | 2018-12-07 | 广州高新兴机器人有限公司 | One kind passing through robot AR camera and internet of things equipment exchange method and system |
| WO2019168886A1 (en) * | 2018-03-02 | 2019-09-06 | Purdue Research Foundation | System and method for spatially mapping smart objects within augmented reality scenes |
| CN110533719A (en) * | 2019-04-23 | 2019-12-03 | 以见科技(上海)有限公司 | Augmented reality localization method and device based on environmental visual Feature point recognition technology |
| CN110849367A (en) * | 2019-10-08 | 2020-02-28 | 杭州电子科技大学 | A method of indoor positioning and navigation based on visual SLAM fused with UWB |
| US20200092124A1 (en) * | 2019-07-23 | 2020-03-19 | Lg Electronics Inc. | METHOD FOR PROVIDING IoT DEVICE INFORMATION, APPARATUS AND INTELLIGENT COMPUTING DEVICE THEREOF |
-
2020
- 2020-08-05 CN CN202010779392.1A patent/CN111885707A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019168886A1 (en) * | 2018-03-02 | 2019-09-06 | Purdue Research Foundation | System and method for spatially mapping smart objects within augmented reality scenes |
| CN108965791A (en) * | 2018-04-04 | 2018-12-07 | 广州高新兴机器人有限公司 | One kind passing through robot AR camera and internet of things equipment exchange method and system |
| CN108650245A (en) * | 2018-04-24 | 2018-10-12 | 上海奥孛睿斯科技有限公司 | Internet of things system based on augmented reality and operation method |
| CN108775901A (en) * | 2018-07-20 | 2018-11-09 | 山东大学 | A kind of real-time SLAM scenes map structuring system, navigation system and method |
| CN110533719A (en) * | 2019-04-23 | 2019-12-03 | 以见科技(上海)有限公司 | Augmented reality localization method and device based on environmental visual Feature point recognition technology |
| US20200092124A1 (en) * | 2019-07-23 | 2020-03-19 | Lg Electronics Inc. | METHOD FOR PROVIDING IoT DEVICE INFORMATION, APPARATUS AND INTELLIGENT COMPUTING DEVICE THEREOF |
| CN110849367A (en) * | 2019-10-08 | 2020-02-28 | 杭州电子科技大学 | A method of indoor positioning and navigation based on visual SLAM fused with UWB |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114513771A (en) * | 2020-11-16 | 2022-05-17 | Oppo广东移动通信有限公司 | IoT (Internet of things) equipment control method, device, control system and terminal equipment |
| WO2022100314A1 (en) * | 2020-11-16 | 2022-05-19 | Oppo广东移动通信有限公司 | Iot device control method, apparatus, control system, and terminal device |
| CN112785469A (en) * | 2021-02-03 | 2021-05-11 | 郑州轻工业大学 | Management system is equipped in wisdom campus education based on AR technique |
| WO2023279887A1 (en) * | 2021-07-08 | 2023-01-12 | Oppo广东移动通信有限公司 | Device control method and apparatus, control system, device, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10506384B1 (en) | Determining a location of motion detected from wireless signals based on prior probability | |
| US8665840B2 (en) | User interface based on magnetic induction | |
| US12333452B2 (en) | Determining a location of motion detected from wireless signals | |
| KR101730269B1 (en) | Location estimation method for indoor device | |
| Chen et al. | Smartphone-based indoor positioning technologies | |
| US20030134647A1 (en) | Use of third party ultra-wideband devices to establish geo-positional data | |
| CN111885707A (en) | AR (augmented reality) -device-based Internet of things device control method and system | |
| EP2621240A2 (en) | Directional peer-to-peer networking | |
| CN105467358A (en) | Indoor positioning method and indoor positioning device | |
| Tian et al. | Application of a long short-term memory neural network algorithm fused with Kalman filter in UWB indoor positioning | |
| KR101680667B1 (en) | Mobile device and method for controlling the mobile device | |
| Díaz et al. | Ultrasonic indoor positioning for smart environments: A mobile application | |
| Goh et al. | IoT based indoor locating system (ILS) using bluetooth low energy (BLE) | |
| CN117479345B (en) | Point-to-point communication method based on UWB technology, electronic equipment and storage medium | |
| Rother et al. | Localization in 6g: A journey along existing wireless communication technologies | |
| Pau et al. | A practical approach based on Bluetooth Low Energy and Neural Networks for indoor localization and targeted devices’ identification by smartphones | |
| CN110839279A (en) | Intelligent terminal positioning method and device based on 5G signal | |
| Torres‐Zapata et al. | Implementation of a VLC‐based indoor localization system | |
| CN103442350B (en) | Based on mobile device across family's electrotransport delivery systems and method | |
| Ke et al. | Developing a beacon-based location system using bluetooth low energy location fingerprinting for smart home device management | |
| Li et al. | Research on indoor wireless localization system for radioactive sources based on ZigBee | |
| Zodi et al. | Enhanced centroid localization of wireless sensor nodes using linear and neighbor weighting mechanisms | |
| Lee et al. | Indoor positioning method using BITON and linear Kalman filter: S.-H. Lee, K.-S. Lim | |
| WO2025043562A1 (en) | Adjustment for sensing coverage area | |
| CN104869214B (en) | A kind of information processing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201103 |