CN105450953A - Display information insertion system for unmanned aerial vehicle and information insertion method thereof - Google Patents

Abstract

A display information insertion system for an unmanned aerial vehicle and an information insertion method thereof, the system includes a display device (1), an information processing device (2) and an unmanned aerial vehicle (3) that are wirelessly connected to each other, the display device ( 1) comprising a first wireless communication module (4) and a display screen (5), the unmanned aerial vehicle (3) comprising a second wireless communication module (6) and an information generating device (7) generating display information to be displayed, The information generating device (7) simultaneously transmits the display information to the display device (1) and the information processing device (2) via the second wireless communication module (6), and the information processing device (2) It includes a third wireless communication module (8), a processor (9) and a memory (10), the memory (10) stores classified insertion information, and the processor (9) screens the information associated with the display information Insert information and send to display device (1).

Description

Display information insertion system and information insertion method for unmanned aerial vehicle

technical field

The invention belongs to the field of unmanned aerial vehicles, and in particular relates to a display information insertion system of an unmanned aerial vehicle and an information insertion method thereof.

Background technique

With the popularity of multi-rotor UAVs, more and more people are beginning to understand and use UAVs. The current unmanned aerial vehicle is called the next-generation outlet because it, as a flying sensor, can collect information without being limited by time and space compared to other traditional methods.

The most direct way to collect this information is to use it in aerial photography. The unmanned aerial vehicle carries the shooting equipment, and then can perform flexible shooting from multiple angles in the air, and the results obtained by shooting can be sent back to the display device in real time or with a delay. , for users to view.

Using the application of aerial photography to illustrate, in fact, it is just to illustrate the information collection process of unmanned aerial vehicles. At the same time, the user also needs to identify the position and environmental information of the drone on the ground through the display device equipped on the ground station or the remote control station, and control it.

In other words, in the process of manipulating the UAV, there are actually new objects that attract the user's attention. Whether it is the above-mentioned aerial image or the flight control interface, the displayed content arouses the user's attention, and may even cause onlookers The attention of others such as readers, this attention will generate value.

Patent document CN204390044U discloses an optimized UAV flight recording device, including a remote control receiver, an autopilot and a ground station, characterized in that: the autopilot communicates with the remote control receiver and the ground station through a communication link; wherein the remote control receiver The machine includes a command transmitter, and the command transmitter of the remote control receiver is connected with the command receiver of the autopilot through a wireless network. This patent is to combine it with the dynamic data collected on the UAV, and then generate the normal and tangent directions at the track points through the dynamic three-dimensional coordinate information of the UAV flight. A reference direction is proposed, after the UAV signal is lost, it can be tracked with reference to the tangential direction, but this patent only provides a reference for flight control, and cannot provide relevant information insertion for all information on the display interface, providing users with more Auxiliary information, and the information provided by the patent occupies the communication of the flight control, which may easily cause the communication link to be blocked.

Patent document CN102967297A discloses a space movable visual sensor array system, which is composed of multiple visual sensor nodes, several first-level ground stations and a second-level ground station; three visual sensor nodes form a group, and a The communication between the first-level ground stations adopts wireless communication, and all the first-level ground stations and the second-level ground stations use wired Ethernet communication; wherein, the visual sensor node mainly includes a flight control module, a flight management module, a camera, a digital Transmission radio station, wireless network card and micro rotor UAV body; the flight control module, flight management module, camera, digital transmission radio station and wireless network card are all fixed on the micro rotor UAV body, flight control module, camera, Both the digital transmission radio station and the wireless network card are connected to the flight management module; the visual sensor node sends flight status information to the first-level ground station through the digital transmission station, and receives instructions from the first-level ground station; sends image data to the first-level ground station through the wireless network card A ground station; both the first-level ground station and the second-level ground station are computers. The image information obtained by the patent UAV is fused in real time, which improves the effect and efficiency of aerial photography. This patent only inserts information into the shooting information to improve the effect of aerial photography, but this patent cannot provide relevant information for all the information on the display interface. Information insertion provides users with more auxiliary information, and this patent has a complex structure and cannot flexibly update the inserted information associated with the displayed information.

Therefore, the inventors of the present application have noticed this new demand, and the new technical problem urgently needed to be solved in this field is how to analyze the characteristics of the displayed content in the situation where the unmanned aerial vehicle is used. According to the characteristics of the displayed content , Screen valuable information and display it to users or audiences to understand. In addition, the information needs to be updated in time and the structure is simple, which will not increase the burden on the flight control communication of the UAV.

The above information disclosed in this Background section is only for enhancement of understanding of the background of the invention and therefore it may contain information that does not form the prior art that is already known in this country to a person of ordinary skill in the art.

Contents of the invention

The purpose of the present invention is to be achieved through the following technical solutions.

According to the first aspect of the present invention, a display information insertion system for an unmanned aerial vehicle disclosed in the present invention includes a display device, an information processing device, and an unmanned aerial vehicle connected to each other via wireless, and the display device includes a first wireless communication module and a display screen, the UAV includes a second wireless communication module and an information generating device that generates display information to be displayed, and the information generating device simultaneously sends the display information to the A display device and an information processing device, the information processing device includes a third wireless communication module, a processor and a memory, the memory stores classified insertion information, the processor screens the insertion information associated with the display information and sent to the display device.

Preferably, the processor includes an identification unit that identifies categories and features of the displayed information, and a comparison unit that filters inserted information associated with the features under the same category.

Preferably, the information generating device is selected from the group consisting of a flight controller, a GIS module, an electronic compass, a GPS unit, an altimeter, a speed sensor, an accelerometer, an angle sensor and a temperature sensor on the unmanned aerial vehicle One or more components of .

Preferably, the inserted information includes at least UAV model information, electronic map, location data, navigation data, altitude data, acceleration data, temperature data and UAV control technology information.

Preferably, the information generating device is a photographing device provided on the UAV.

Preferably, the inserted information includes at least parameters of the shooting equipment and temperature, humidity and photosensitivity of the shooting location.

Preferably, the display information includes the first display information generated by the UAV itself and the second display information generated by the equipment installed on the UAV, and the processor screens the stored information from the memory. The insertion information associated with the first display information is sent to the display device in real time, and the processor screens the insertion information associated with the second display information from the memory and sends it to the display device in real time or with a delay.

Preferably, the first wireless communication module and/or the second wireless communication module and/or the third wireless communication module are selected from wireless local area network communication devices with different priorities, mobile communication network devices, stratosphere One or more of the group consisting of communication network equipment and satellite network communication equipment.

Preferably, the memory is Electronically Erasable Programmable Read Only Memory (EEPROM).

According to the second aspect of the present invention, an information insertion method using the display information insertion system for an unmanned aerial vehicle includes the following steps.

In the first step, the information generating device simultaneously transmits the display information to the display device and the information processing device via the second wireless communication module.

In a second step, the processor filters inserted information associated with the displayed information.

In a third step, the processor sends the insertion information to a display device.

The solution proposed by the present invention can be universally applied to large-scale delivery applications of ordinary users, without the need for users to manually input any other information, and the delivery task can be completed with one key, and the system can obtain the express delivery task information of the unmanned aerial vehicle according to the point-to-point communication request The starting point and destination, and automatically match the relevant information to both ends of the express delivery demand, without manual intervention, which improves the confidentiality and speed of delivery. Moreover, the structure is simple and the efficiency is high.

Description of drawings

Fig. 1 is a schematic structural diagram of a display information insertion system for an unmanned aerial vehicle according to an embodiment of the present invention.

Fig. 2 is a schematic coordinate diagram of an unmanned aerial vehicle display information insertion system according to another embodiment of the present invention.

Fig. 3 is a schematic diagram of the steps of the information insertion method of the display information insertion system of the unmanned aerial vehicle according to an embodiment of the present invention.

The present invention will be further explained below in conjunction with the accompanying drawings and embodiments.

detailed description

The following detailed description is merely exemplary in nature and not intended to limit application and uses. Furthermore, there is no intention to be bound by any expressed or implied theory presented in the preceding technical field, background, brief summary or the following detailed description. As used herein, the term "module" or "unit" refers to any hardware, software, firmware, electronic control components, processing logic, and/or processor devices alone or in any combination, including without limitation: application specific integrated circuits ASICs, Electronic circuits, processors executing one or more software or firmware programs shared, dedicated or grouped and memories, combinational logic circuits and/or other suitable components providing the described functionality. Furthermore, unless expressly stated to the contrary, the word "comprise" and its various variations should be understood as implying the inclusion of stated elements but not excluding any other elements.

The embodiment of the present invention describes a display information insertion system for an unmanned aerial vehicle. As shown in FIG. , an information processing device 2 and an unmanned aerial vehicle 3, the display device 1 includes a first wireless communication module 4 and a display screen 5, and the unmanned aerial vehicle 3 includes a second wireless communication module 6 and information for generating display information to be displayed generating device 7, the information generating device 7 simultaneously transmits the display information to the display device 1 and the information processing device 2 via the second wireless communication module 6, and the information processing device 2 includes a third wireless communication module 8. A processor 9 and a memory 10, the memory 10 stores the classified insertion information, the processor 9 screens the insertion information associated with the display information and sends it to the display device 1.

In this field, the UAV 3 may preferably be a multi-rotor UAV.

In one embodiment, the information generating device 7 is selected from a flight controller, a GIS module, an electronic compass, a GPS unit, an altimeter, a speed sensor, an accelerometer, an angle sensor and a temperature sensor installed on the unmanned aerial vehicle 3. One or more components in a group of sensors. The inserted information includes at least UAV model information, electronic map, location data, navigation data, altitude data, acceleration data, temperature data and UAV control technology information.

In one embodiment, the information generation device 7 includes a GIS module, which can generate the flight route of the UAV 3 on the electronic map according to preset conditions, and the GIS module includes a GIS information import and export unit , an information display unit and an information maintenance unit, wherein the GIS information import and export unit is used for the import and export of the information of the flight route of the unmanned aerial vehicle in the GIS map, and the formats of its import and export include but are not limited to text, XML, CSV, EXCEL, WORD, PDF and other formats; the information display unit is used to display the flight route information on the GIS map; the information maintenance unit is used to browse, edit and delete the flight route information on the GIS map. The GIS module displays flight route information, and provides operations such as planning, selection and frame selection of flight route information, and can be used to browse, edit and delete corresponding flight route information on the GIS map.

In another embodiment, the information generating device 7 is a photographing device provided on the UAV. The inserted information includes at least the parameters of the shooting equipment and the temperature, humidity and photosensitivity of the shooting location.

In one embodiment, the display information includes first display information generated by the UAV itself and second display information generated by equipment installed on the UAV, and the processor 9 obtains the information from the memory 10 to filter the insertion information associated with the first display information and send it to the display device 1 in real time, and the processor 9 filters the insertion information associated with the second display information from the memory 10 and real-time or Delay sent to display device 1.

In one embodiment, the first wireless communication module 4 and/or the second wireless communication module 6 and/or the third wireless communication module 8 are selected from wireless local area network communication devices, mobile One or more of the group consisting of communication network equipment, stratospheric communication network equipment and satellite network communication equipment.

In one embodiment, the mobile communication network equipment is mainly composed of 2G/3G/4G wireless communication chipsets, responsible for establishing wireless communication between the display device 1, the information processing device 2 and the UAV 3 through the mobile communication network. The wireless local area network communication device can be one of Bluetooth, ZigBee or Wi-Fi devices. The wireless local area device can establish short-distance communication through the 2.4GHz communication frequency. It is preferred to use this device to establish display devices in indoor or low-speed outdoor environments. The communication connection between the information processing device 2 and the unmanned aerial vehicle 3 . Stratospheric communication equipment generally uses helium-filled airships and balloons as the platform for placing forwarding stations. The height of the platform is 17km to 22km from the ground. When the unmanned aerial vehicle 4 is flying in a wide range of fields, stratospheric communication can be selected to establish display equipment 1. Information processing equipment 2 and the communication link between UAV 3. The satellite communication device uses the satellite communication channel to establish a communication connection between the display device 1, the information processing device 2 and the UAV 3. Generally, when there is no other wireless communication network available, the satellite communicator will be used as an emergency communication.

In one embodiment, the wireless transmission network is selected according to the wireless network cost or the wireless network access speed. This application designs the following priority scheme, Wi-Fi network: priority is 0; 4G wireless network: priority is 1; 3G wireless network: priority 2; stratospheric communication network: priority 3; satellite communication network: priority 4; priority 0-4, the priority of the selected wireless network is from high to low, that is, if there are multiple wireless signal, and the signal strength is valid, the wireless communication between the display device 1, the information processing device 2 and the UAV 3 will first select the Wi-Fi network as the wireless access network; when the Wi-Fi signal strength is invalid , the wireless communication will sub-optimally select the 4G network as the wireless access network; and so on.

Processor 9 may also include: CPU, RAM memory, operating system and application software. Responsible for multi-task scheduling, including wireless communication functions, memory reading and writing, sorting, sorting, screening and comparison, etc. The memory 10 can include a fast read-write SDD hard disk and a mobile read-write device that can be inserted into an SD card, and is mainly used to store classified insertion information such as unmanned aerial vehicle model information, electronic maps, position data, navigation data, height data, Acceleration data, temperature data, UAV control technical information, and more.

The present invention can store updatable third-party information in the memory, insert corresponding information into the display device through the information processing device, and realize valuable information matching. In one embodiment, the display information generated by the unmanned aerial vehicle 3 is mainly divided into two types: the first type is the display information of the display device caused by the flight control of the unmanned aerial vehicle 3. For the first display information, due to This information mainly involves data such as the flight status, flight parameters, and electronic map of the UAV 3, so the focus objects of the displayed information are generally the controller of the aircraft, and users who are interested in the process related to flight control. According to the displayed information, it can be analyzed that the concerned users of such displayed information will be more interested in the information of the drone itself, such as: the model of the drone, the knowledge of the drone, the product information of the drone, The peripheral products of drones, the laws and regulations of drones, the skills of controlling drones, the information exchange of drone users, etc.; Information, for the second display information, since the second display information mainly involves the content shot by using the unmanned aerial vehicle 3 as a carrier for some specific objects, the specific shot content may be data such as characters, scenery, and event scenes. , so the focus of the second display information is broader, it may be the controller of the aircraft, or it may be ordinary viewers who are interested in the shooting content. According to the second display information and the types of users it may be oriented to, it can be analyzed that the concerned users of the second display information will be more interested in the information related to the shooting content, for example: when the shooting content is a person, they will be more interested in the shooting content. Interested in information about knowledge and people; when the content of the shooting is scenery, you will be interested in the history and description of the scenery; information interested. The memory of the information processing device that realizes two-way communication with the unmanned aerial vehicle 3 through a wireless network has a large amount of sorted and sorted information. Appropriate information among a large amount of classified and sorted stored information is screened out and sent back to the display device corresponding to the unmanned aerial vehicle through the network.

In one embodiment, there is a display device 1 at the remote control end of the unmanned aerial vehicle 3, on which data related to the flight of the unmanned aerial vehicle 3 is displayed, such as including: electronic map, current position coordinate information of the aircraft, flight status of the aircraft Information, etc., the unmanned aerial vehicle will return the data reflecting the flight status of the unmanned aerial vehicle to the display device 1 of the remote control terminal in time through the GPS module, attitude sensor and other equipment on it, so that the remote control terminal can update the unmanned aerial vehicles displayed on it in time. The state of the aircraft. The above-mentioned flight status data of the UAV 3 is also sent to the information processing device 2, and the device 2 matches the corresponding information content to the remote control terminal of the UAV 3 according to the flight status data of the UAV 3. Typically, when the unmanned aerial vehicle 3 transmits its own device model and flight speed to the information content matching system, the information processing device 2 can, for example, match the best flight speed range information of the type of unmanned aerial vehicle according to its pre-stored data to the remote control terminal, thereby prompting the user to control the optimal flight speed control range of the unmanned aerial vehicle at an appropriate position on the remote control terminal; The information processing device 2 can send to the remote control terminal according to the number of active aircraft within a certain range near the coordinates stored in it, so as to remind the user on the remote control terminal how many other aircraft exist in the range, and the user should pay attention to avoid them.

In one embodiment, the content captured by the unmanned aerial vehicle 3 through an attached information generating device, such as a camera device, may be transmitted to a display device 1 near the user in real time or in a delayed manner through image transmission. During this process, the unmanned aerial vehicle 3 can simultaneously transmit the parameters of the shooting equipment used, the shooting location, and the remark information related to the shooting task to the third-party information processing device 2 through the network. The information processing device 2 matches the corresponding information content to the display device 1 near the user according to the information sent by the UAV, so as to complete the targeted information matching function. Typically, when the information processing device 2 receives information such as shooting device parameters, shooting locations, and shooting tasks transmitted by the unmanned aerial vehicle, it can sort out what kind of camera should be used under the current time and weather environment of the location based on the above content. Shooting equipment parameters are more conducive to better completion of shooting tasks. Even, for commercial purposes, the information processing device 2 may also timely push some advertisements related to the shooting device product itself, such as a certain lens, camera, shooting accessories, etc. that are more suitable for the current shooting task.

In short, through a third-party information processing device 2, it is possible to collect and summarize information from a higher level, and match the information required by the user to the user without integrating too many functions in the user control terminal, resulting in excessive burden.

Referring to the display information insertion system of an unmanned aerial vehicle according to another embodiment of the present invention shown in FIG. The device 1 includes a first wireless communication module 4 and a display screen 5, and the UAV 3 includes a second wireless communication module 6 and an information generating device 7 that generates display information to be displayed, and the information generating device 7 passes through the first The second wireless communication module 6 simultaneously sends the display information to the display device 1 and the information processing device 2, and the information processing device 2 includes a third wireless communication module 8, a processor 9 and a memory 10, and the memory 10 stores After classified insertion information, the processor 9 includes an identification unit 11 and a comparison unit 12, the identification unit 11 identifies the category and characteristics of the displayed information, and the comparison unit 12 filters the information related to the characteristics under the same category. The processor 9 screens the insertion information associated with the display information and sends it to the display device 1 .

In a particular embodiment, processor 9 may compile, organize or analyze data in memory to perform statistical analysis on the data. The processor 9 may include a general purpose processor, a digital signal processor, an application specific integrated circuit ASIC, a field programmable gate array FPGA, an analog circuit, a digital circuit, a combination thereof, or other known or later developed processors. The memory 10 may be a volatile memory or a non-volatile memory. The memory may include one or more read only memory ROM, random access memory RAM, flash memory, electronically erasable programmable read only memory EEPROM, or other types of memory.

In one embodiment, for example, if the displayed information is a flight altitude of 1000 meters, the identification unit 11 classifies it as the first displayed information and recognizes the feature "flight altitude", and the comparison unit 12 screens the flight altitude from the first display information category in the memory. Further, the comparison unit 12 includes a correlation degree algorithm component, which arranges the insertion information related to the display information "flying altitude 1000 meters" according to the degree of relevance from high to low, so as to filter the required ones associated with the display information. The insertion information of is sent to display device 1.

In one embodiment, the classified insertion information stored in the memory 10 can be updated, and further, can be updated online via a wireless connection. In one embodiment, the comparison unit may screen the inserted information associated with the feature over the Internet via a wireless connection.

The present invention can comprehensively store more valuable information through a third-party information processing device, and by analyzing the current needs of the user of the unmanned aerial vehicle, distribute the corresponding information to a display device near the user to realize valuable information match.

Referring to FIG. 3 , the information insertion method using the display information insertion system for an unmanned aerial vehicle according to an embodiment of the present invention includes the following steps.

In the first step S1, the information generating device 7 simultaneously sends the display information to the display device 1 and the information processing device 2 via the second wireless communication module 6;

In the second step S2, the processor 9 filters the insertion information associated with the display information;

In a third step S3, the processor 9 sends the insertion information to the display device 1 .

Although the embodiments of the present invention have been described above in conjunction with the accompanying drawings, the present invention is not limited to the above-mentioned specific embodiments and application fields, and the above-mentioned specific embodiments are only illustrative, instructive, and not restrictive . Under the enlightenment of this description and without departing from the protection scope of the claims of the present invention, those skilled in the art can also make many forms, which all belong to the protection of the present invention.

Claims (10)

1. A display information insertion system for an unmanned aerial vehicle, which includes a display device (1), an information processing device (2) and an unmanned aerial vehicle (3) that are wirelessly connected to each other, characterized in that: the display device ( 1) comprising a first wireless communication module (4) and a display screen (5), the unmanned aerial vehicle (3) comprising a second wireless communication module (6) and an information generating device (7) generating display information to be displayed, The information generating device (7) simultaneously transmits the display information to the display device (1) and the information processing device (2) via the second wireless communication module (6), and the information processing device (2) It includes a third wireless communication module (8), a processor (9) and a memory (10), the memory (10) stores classified insertion information, and the processor (9) screens the information associated with the display information Insert information and send to display device (1). 2. The display information insertion system of the unmanned aerial vehicle according to claim 1, characterized in that: the processor (9) includes a recognition unit (11) and a comparison unit (12), and the recognition unit (11) recognizes The category and feature of the displayed information, the comparison unit (12) filters the inserted information associated with the feature under the same category. 3. the display information insertion system of unmanned aerial vehicle according to claim 1, is characterized in that: described information generating device (7) is selected from the flight controller that is located on described unmanned aerial vehicle (3), GIS One or more from the group consisting of module, electronic compass, GPS unit, altimeter, speed sensor, accelerometer, angle sensor and temperature sensor. 4. The display information insertion system for unmanned aerial vehicle according to claim 3, characterized in that: said inserted information at least includes the type information of unmanned aerial vehicle, electronic map, position data, navigation data, altitude data, acceleration data, temperature Data and UAV control technical information. 5. The display information insertion system of the unmanned aerial vehicle according to claim 1, characterized in that: the information generating device (7) is a photographing device arranged on the unmanned aerial vehicle. 6 . The display information insertion system for unmanned aerial vehicles according to claim 5 , wherein the insertion information at least includes the parameters of the shooting equipment and the temperature, humidity and photosensitivity of the shooting location. 7 . 7. The display information insertion system of the unmanned aerial vehicle according to claim 1, wherein the display information includes the first display information generated by the unmanned aerial vehicle itself and the equipment installed on the unmanned aerial vehicle The generated second display information, the processor (9) screens the insertion information associated with the first display information from the memory (10) and sends it to the display device (1) in real time, the processor ( 9) Screening the insertion information associated with the second display information from the memory (10) and sending it to the display device (1) in real time or with a delay. 8. The display information insertion system of unmanned aerial vehicle according to claim 1, characterized in that: the first wireless communication module (4) and/or the second wireless communication module (6) and/or the The third wireless communication module (8) is composed of one or more selected from the group consisting of wireless local area network communication equipment, mobile communication network equipment, stratospheric communication network equipment and satellite network communication equipment with different priorities. 9. The display information insertion system of the unmanned aerial vehicle according to claim 1, characterized in that: the memory (10) is an electronically erasable programmable read-only memory (EEPROM). 10. An information insertion method utilizing the display information insertion system of the unmanned aerial vehicle according to any one of claims 1-9, comprising the following steps: In the first step (S1), the information generating device (7) simultaneously sends the display information to the display device (1) and the information processing device (2) via the second wireless communication module (6); In a second step (S2), the processor (9) filters inserted information associated with the displayed information; In a third step (S3), the processor (9) sends the insertion information to the display device (1).