[go: up one dir, main page]

CN212539194U - Device for collecting three-dimensional audio/video and motion gestures - Google Patents

Device for collecting three-dimensional audio/video and motion gestures Download PDF

Info

Publication number
CN212539194U
CN212539194U CN202021097272.5U CN202021097272U CN212539194U CN 212539194 U CN212539194 U CN 212539194U CN 202021097272 U CN202021097272 U CN 202021097272U CN 212539194 U CN212539194 U CN 212539194U
Authority
CN
China
Prior art keywords
controller
video
tof
data acquisition
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202021097272.5U
Other languages
Chinese (zh)
Inventor
戴永峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Eastern Communication Co Ltd
Original Assignee
Eastern Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eastern Communication Co Ltd filed Critical Eastern Communication Co Ltd
Priority to CN202021097272.5U priority Critical patent/CN212539194U/en
Application granted granted Critical
Publication of CN212539194U publication Critical patent/CN212539194U/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The utility model relates to an audio frequency and video collection system, concretely relates to gather device of three-dimensional audio frequency and video and motion gesture, which comprises a housin, the camera, sound collection station, the electron compass, 6 axis motion tracker, TOF data acquisition device, a controller, memory and power management unit, electron compass and 6 axis motion tracker collection system's motion gesture data, the camera, sound collection station and TOF data acquisition device are all installed on the casing, sound collection station and camera gather audio frequency and video data respectively, TOF data acquisition device gathers three-dimensional degree of depth image, the camera, sound collection station, TOF data acquisition device, the electron compass, 6 axis motion tracker and memory all link with the controller, power management unit is the power supply of other components. The utility model discloses a substantive effect is: the audio and video acquisition device is suitable for being carried on a mobile carrier to work, and the application range of the audio and video acquisition device is expanded.

Description

Device for collecting three-dimensional audio/video and motion gestures
Technical Field
The utility model relates to an audio frequency and video collection system, concretely relates to gather three-dimensional audio frequency and video and motion gesture's device.
Background
With the development of high-speed application of artificial intelligence technology, the face recognition technology surrounding human identity confirmation and the voice positioning recognition technology of confirmation personnel are applied more and more, various face recognition and voice recognition module devices are also appeared successively, for the application of the biological feature safety recognition based on the human body, on one hand, the intelligent handling requirements of some businesses can be met, on the other hand, the effect of effectively verifying the three-dimensional features and the real identity of a person entity cannot be achieved due to the fact that more products of the face recognition module are represented by a camera, the acquired image is planar image or video information, and the information does not contain three-dimensional data of the face, and is easy to be utilized and deceived by lawbreakers. Meanwhile, the face acquisition cameras do not have the capability of directionally acquiring voice, even if the voice acquired by the microphone is influenced by environmental noise reduction, the application requirements of scenes needing voice recognition and voice directional functions cannot be met, and a microphone voice acquisition array module has to be added, so that two physically independent different module devices are formed, the two modules are inconvenient to integrate and apply, and the application cost is increased.
Chinese patent CN108040199A, published 2018, 5, month and 15, an integrated audio/video acquisition device, comprising a camera, wherein the camera is provided with an audio acquisition module, an audio a/D conversion module, a video acquisition module, a video a/D conversion module, a data synthesis encryption module, a microprocessor, a wireless transmission module, a memory, a speaker, a display screen and a power circuit, the audio acquisition module acquires a sound signal and transmits the sound signal to the audio a/D conversion module, and the audio a/D conversion module converts the sound signal into a digital audio signal and transmits the digital audio signal to the data synthesis encryption module; the power supply circuit comprises a first inductor, a bridge rectifier, a first MOS (metal oxide semiconductor) tube, a second MOS tube, a third MOS tube, a first resistor, a first capacitor, a second capacitor, a first diode and a direct-current power supply. Although the technical scheme can simultaneously acquire audio and video signals, management personnel can conveniently know monitoring conditions at any time and any place, the function is single, and the device is not suitable for being carried on a mobile carrier to work.
Disclosure of Invention
The to-be-solved technical problem of the utility model is: the current audio and video acquisition device has single function. A device for acquiring three-dimensional audio and video and motion gestures is provided. The device can collect abundant field data, is suitable to be carried on a mobile carrier to work, and expands the application range of the audio and video acquisition device.
In order to solve the technical problem, the utility model discloses the technical scheme who takes does: a device for collecting three-dimensional audio and video and motion postures comprises a shell, a camera, a sound collector, an electronic compass, a 6-axis motion tracker, a TOF data collecting device, a controller, a memory and a power supply management unit, the electronic compass, the 6-axis motion tracker, the controller, the memory and the power supply management unit are all arranged in the shell, the electronic compass and the 6-axis motion tracker collect the motion attitude data of the device, the camera, the sound collector and the TOF data collection device are all arranged on the shell, the sound collector and the camera respectively collect audio and video data, the TOF data collecting device collects three-dimensional depth images, the camera, the sound collector, the TOF data collecting device, the electronic compass, the 6-axis motion tracker and the memory are all linked with the controller, and the power management unit supplies power to other elements. The TOF data acquisition device can acquire depth information, stores the depth information and audio and video information in a time axis in a correlated manner, can facilitate subsequent equipment to extract information, and measures X, Y, Z triaxial angular velocity and X, Y, Z triaxial acceleration of the device in a motion-removing state through a 6-axis motion tracker sensor. The azimuth and direction of the device are measured by an electronic compass sensor. Through the acquisition of the information, the whole device can simultaneously supplement the position, the direction, the moving state and the altitude information of the current acquisition device on the basis of acquiring the audio and video information, and improve the data enrichment, so that the device has richer functions and wider application range.
Preferably, the TOF data acquisition device comprises a TOF data acquisition controller, a TOF sensor, an infrared light emitting diode and a TOF equipment processor, wherein the infrared light emitting diode is embedded on the shell, the infrared light emitting diode emits infrared light forward, the TOF sensor receives reflected light of the infrared light emitted by the TOF sensor, the TOF sensor and the infrared light emitting diode are both connected with the TOF data acquisition controller, the TOF data acquisition controller is connected with the TOF equipment processor, and the TOF equipment processor is connected with the TOF equipment processor. By generating high frequency pulses to be applied to the IR-LED to generate invisible infrared light irradiation, the wavelength of the infrared light is about 850nm generally, if the emitted infrared light meets people and environmental objects in the irradiation direction, reflection can be formed, the TOF data acquisition controller can receive the information by using the TOF image receiving sensor, and then the actual distance length is calculated according to the time length of the transmitted and received infrared reflection information, so that a complete depth 3D image can be formed.
Preferably, the USB-HUB controller further comprises a USB interface and a USB-HUB, wherein the USB-HUB is installed in the shell, the USB interface is installed on the shell, the USB interface is connected with the USB-HUB, and the USB-HUB is linked with the controller. And the USB interface is converged with the USB-HUB, so that the communication interaction of USB data is realized.
Preferably, the air pressure meter is mounted outside the housing and detects the air pressure near the housing, and the air pressure meter is connected to the controller. The atmospheric pressure is measured by a barometer sensor, so that the altitude information is converted and calculated.
Preferably, the memory comprises an EEPROM and a high-speed memory, and the EEPROM and the high-speed memory are both connected with the controller.
Preferably, a plurality of infrared emission windows and indicator lamps are arranged on the outer side of the shell, the infrared light-emitting diodes are provided with a plurality of infrared light-emitting diodes, the infrared light-emitting diodes are respectively installed in the infrared emission windows, the emission directions of the infrared light-emitting diodes are different, and the indicator lamps are connected with the controller. The multiple infrared emission windows can improve the acquisition efficiency of the depth image.
Preferably, the sound collector comprises a plurality of digital microphones and a digital signal processor, the digital microphones are arranged on the shell side by side and located below the camera, sound collecting holes corresponding to the digital microphones are formed in the shell, the digital microphones are connected with the digital signal processor, and the digital signal processor is connected with the controller. The multiple microphones can support the digital directional acquisition technology in the prior art, and the functions of the device are enriched.
As preferred, sound collector still includes spring and elastic diaphragm, spring one end ground connection, the spring other end is connected with the controller, the sound collecting hole inboard of casing is equipped with solid fixed ring, the elastic diaphragm is one end confined tube-shape, the elastic diaphragm open end is connected with solid fixed ring, digital microphone installs at the elastic diaphragm blind end, the elastic diaphragm blind end is connected with spring one end, the spring other end and casing fixed connection. The elastic membrane can play the effect of concentrated sound, and the spring can change the degree of collection sound, through controller pin periodic output 0 or 1, adopts the mode change equivalent current through the spring of PMW, can change the tensile length of elastic membrane through the spring, changes the opening angle of collection sound.
The utility model discloses a substantive effect is: on the basis of obtaining audio and video information, motion removing posture information such as the position, the direction, the moving state, the altitude and the like of the current acquisition device can be obtained simultaneously, the device is suitable for being carried on a mobile carrier to work, the application range of the audio and video acquisition device is expanded, and the device has wide application prospects in intelligent equipment, artificial intelligent identification, automobile unmanned driving, human body interactive identification, robot intelligent walking and the like.
Drawings
FIG. 1 is a schematic diagram of a component connection according to an embodiment.
FIG. 2 is a schematic structural diagram of an embodiment.
Fig. 3 is a schematic diagram of a digital microphone according to an embodiment.
Wherein: 1. camera, 2, TOF data acquisition controller, 3, TOF sensor, 4, infrared emitting diode, 5, digital microphone, 6, digital signal processor, 7, high-speed memory, 8, barometer, 9, electronic compass, 10, 6 axis motion tracker, 11, TOF equipment treater, 12, USB interface, 13, USB-HUB, 14, EEPROM, 15, power management unit, 16, infrared emission window, 17, casing, 18, pilot lamp, 19, spring, 20, solid fixed ring, 21, elastic membrane.
Detailed Description
The following provides a more detailed description of the present invention, with reference to the accompanying drawings.
The first embodiment is as follows:
a device for collecting three-dimensional audio and video and motion gestures comprises a shell 17, a camera 1, a sound collector, an electronic compass 9, a 6-axis motion tracker 10, a TOF data collection device, a controller, a memory and a power management unit 15, wherein the electronic compass 9, the 6-axis motion tracker 10, the controller, the memory and the power management unit 15 are all installed in the shell 17, the electronic compass 9 and the 6-axis motion tracker 10 collect motion gesture data of the device, the camera 1, the sound collector and the TOF data collection device are all installed on the shell 17, the sound collector and the camera 1 respectively collect audio and video data, the TOF data collection device collects three-dimensional depth images, the camera 1, the sound collector, the TOF data collection device, the electronic compass 9, the 6-axis motion tracker 10 and the memory are all linked with the controller, the power management unit 15 supplies power to other components. The barometer 8 is attached to the outside of the housing 17, detects the air pressure near the housing 17, and the barometer 8 is connected to the controller. The memory comprises an EEPROM 14 and a high-speed memory 7, and the EEPROM 14 and the high-speed memory 7 are connected with the controller. The USB-HUB 13 is installed in the shell 17, the USB interface 12 is installed on the shell 17, the USB interface 12 is connected with the USB-HUB 13, and the USB-HUB 13 is linked with the controller. And the USB interface 12 is converged with the USB-HUB 13, so that the communication interaction of USB data is realized.
TOF is short for Time of flight, meaning Time of flight. The TOF data acquisition controller 2 is of the prior art, which generally consists of an analog preamplifier and an FPGA or an application-specific integrated processor. By generating high frequency pulses to be applied to the IR-LED to generate invisible infrared radiation having a wavelength of about 850nm, and reflecting the infrared radiation if it encounters a person or an environmental object in the direction of the radiation, the TOF data acquisition controller 2 can receive the information by using the TOF image receiving sensor, and calculate the actual distance length according to the duration of the transmitted and received infrared reflection information, thereby forming a complete depth 3D image. The X, Y, Z triaxial angular velocity and X, Y, Z triaxial acceleration, which are originally loaded in a motionless state, are measured by the 6-axis motion tracker 10 sensor. The orientation and direction of the device are measured by an electronic compass 9 sensor. Through the acquisition of the information, the whole device can simultaneously supplement the position, the direction, the moving state and the altitude information of the current acquisition device on the basis of acquiring the audio and video information, and improve the data enrichment, so that the device has richer functions and wider application range.
TOF data acquisition device includes TOF data acquisition controller 2, TOF sensor 3, infrared emitting diode 4 and TOF equipment treater 11, infrared emitting diode 4 inlays on casing 17, infrared emitting diode 4 forward emission infrared light, TOF sensor 3 receives the reverberation of the infrared light of TOF sensor 3 transmission, TOF sensor 3 and infrared emitting diode 4 all are connected with TOF data acquisition controller 2, TOF data acquisition controller 2 is connected with TOF equipment treater 11, TOF equipment treater 11 is connected with the controller. By generating high frequency pulses to be applied to the IR-LED to generate invisible infrared radiation having a wavelength of about 850nm, and reflecting the infrared radiation if it encounters a person or an environmental object in the direction of the radiation, the TOF data acquisition controller 2 can receive the information by using the TOF image receiving sensor, and calculate the actual distance length according to the duration of the transmitted and received infrared reflection information, thereby forming a complete depth 3D image.
As shown in fig. 2, a plurality of infrared emission windows 16 and indicator lamps 18 are arranged on the outer side of the shell 17, a plurality of infrared light emitting diodes 4 are arranged in the infrared emission windows 16, the plurality of infrared light emitting diodes 4 are arranged in different emission directions, and the indicator lamps 18 are connected with a controller. The multiple infrared emission windows 16 can improve the depth image acquisition efficiency. The sound collector comprises a plurality of digital microphones 5 and a digital signal processor 6, the digital microphones 5 are arranged on a shell 17 side by side and are positioned below the camera 1, sound collecting holes corresponding to the digital microphones 5 are formed in the shell 17, the digital microphones 5 are all connected with the digital signal processor 6, and the digital signal processor 6 is connected with the controller. The digital signal processor 6 is used, the DSP processor or the audio processor is used for collecting analog signals received by 4 microphones, the 4 microphones are arranged in a linear equidistant mode, and the digital microphone 5 is used for collecting sound signals, so that the problem that the analog microphone is easily interfered by internal signals, circuits or modules is solved, and meanwhile, a circuit meter is simplified, so that the analog microphone and the camera 1 module are directly integrated together for integrated design.
The beneficial effect of this embodiment is: on the basis of obtaining audio and video information, motion removing posture information such as the position, the direction, the moving state, the altitude and the like of the current acquisition device can be obtained simultaneously, the device is suitable for being carried on a mobile carrier to work, the application range of the audio and video acquisition device is expanded, and the device has wide application prospects in intelligent equipment, artificial intelligent identification, automobile unmanned driving, human body interactive identification, robot intelligent walking and the like.
As shown in fig. 3, in another embodiment of the present device, the sound collector further includes a spring 19 and an elastic membrane 21, one end of the spring 19 is grounded, the other end of the spring 19 is connected to the controller, a fixing ring 20 is disposed inside the sound collecting hole of the housing 17, the elastic membrane 21 is in a cylindrical shape with one closed end, the open end of the elastic membrane 21 is connected to the fixing ring 20, the digital microphone 5 is mounted at the closed end of the elastic membrane 21, the closed end of the elastic membrane 21 is connected to one end of the spring 19, and the other end of the spring 19 is fixedly connected to the housing 17. The elastic membrane 21 can play a role of sound concentration, the spring 19 can change the degree of sound collection, 0 or 1 can be periodically output through a controller pin, the equivalent current passing through the spring 19 is changed in a PMW mode, the stretched length of the elastic membrane 21 can be changed through the spring 19, and the opening angle of the sound collection is changed.
The above embodiment is only a preferred embodiment of the present invention, and is not intended to limit the present invention in any way, and other variations and modifications may be made without departing from the technical scope of the claims.

Claims (8)

1. A device for collecting three-dimensional audio and video and motion gestures, which is characterized in that,
including casing, camera, sound collection station, electron compass, 6 motion tracker, TOF data acquisition device, controller, memory and power management unit, electron compass, 6 motion tracker, controller, memory and power management unit are all installed in the casing, electron compass and 6 motion tracker acquisition device's motion attitude data, camera, sound collection station and TOF data acquisition device are all installed on the casing, sound collection station and camera gather audio and video data respectively, TOF data acquisition device gathers three-dimensional depth image, camera, sound collection station, TOF data acquisition device, electron compass, 6 motion tracker and memory all are connected with the controller, power management unit is other component power supplies.
2. The device for acquiring the three-dimensional audio and video and the motion gesture according to claim 1,
TOF data acquisition device includes TOF data acquisition controller, TOF sensor, infrared emitting diode and TOF equipment treater, infrared emitting diode inlays on the casing, infrared emitting diode is to emission infrared light in the place ahead, TOF sensor receives the reverberation of the infrared light of TOF sensor transmission, TOF sensor and infrared emitting diode all are connected with TOF data acquisition controller, TOF data acquisition controller is connected with TOF equipment treater, TOF equipment treater is connected with the controller.
3. The device for acquiring the three-dimensional audio and video and the motion gesture according to the claim 1 or 2,
the USB-HUB shell is characterized by further comprising a USB interface and a USB-HUB, wherein the USB-HUB is installed in the shell, the USB interface is installed on the shell and connected with the USB-HUB, and the USB-HUB is connected with the controller.
4. The device for acquiring the three-dimensional audio and video and the motion gesture according to the claim 1 or 2,
still include the barometer, the barometer is installed in the casing outside, detects the near atmospheric pressure of casing, the barometer is connected with the controller.
5. The device for acquiring the three-dimensional audio and video and the motion gesture according to the claim 1 or 2,
the memory comprises an EEPROM and a high-speed memory, and the EEPROM and the high-speed memory are connected with the controller.
6. The device for acquiring the three-dimensional audio and video and the motion gesture according to claim 2,
the casing outside is provided with a plurality of infrared emission window and pilot lamp, infrared emitting diode has a plurality ofly, and a plurality of infrared emitting diode install respectively in infrared emission window, and a plurality of infrared emitting diode transmitting direction are different, the pilot lamp is connected with the controller.
7. The device for acquiring the three-dimensional audio and video and the motion gesture according to the claim 1 or 2,
the sound collector comprises a plurality of digital microphones and a digital signal processor, the digital microphones are arranged on the shell side by side and located below the camera, sound collecting holes corresponding to the digital microphones are formed in the shell, the digital microphones are connected with the digital signal processor, and the digital signal processor is connected with the controller.
8. The device for acquiring the three-dimensional audio and video and the motion gesture according to claim 7,
the sound collector further comprises a spring and an elastic membrane, one end of the spring is grounded, the other end of the spring is connected with the controller, a fixing ring is arranged on the inner side of the sound collecting hole of the shell, the elastic membrane is in a tube shape with one end closed, the open end of the elastic membrane is connected with the fixing ring, the digital microphone is installed at the closed end of the elastic membrane, the closed end of the elastic membrane is connected with one end of the spring, and the other end of the spring is fixedly connected with the shell.
CN202021097272.5U 2020-06-15 2020-06-15 Device for collecting three-dimensional audio/video and motion gestures Active CN212539194U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202021097272.5U CN212539194U (en) 2020-06-15 2020-06-15 Device for collecting three-dimensional audio/video and motion gestures

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202021097272.5U CN212539194U (en) 2020-06-15 2020-06-15 Device for collecting three-dimensional audio/video and motion gestures

Publications (1)

Publication Number Publication Date
CN212539194U true CN212539194U (en) 2021-02-12

Family

ID=74548359

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202021097272.5U Active CN212539194U (en) 2020-06-15 2020-06-15 Device for collecting three-dimensional audio/video and motion gestures

Country Status (1)

Country Link
CN (1) CN212539194U (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111885333A (en) * 2020-06-15 2020-11-03 东方通信股份有限公司 Device and method for acquiring three-dimensional audio and video and motion gestures
CN113907475A (en) * 2021-10-09 2022-01-11 国网甘肃省电力公司电力科学研究院 Image acquisition device and method based on video semantics

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111885333A (en) * 2020-06-15 2020-11-03 东方通信股份有限公司 Device and method for acquiring three-dimensional audio and video and motion gestures
CN113907475A (en) * 2021-10-09 2022-01-11 国网甘肃省电力公司电力科学研究院 Image acquisition device and method based on video semantics

Similar Documents

Publication Publication Date Title
CN212539194U (en) Device for collecting three-dimensional audio/video and motion gestures
US20080223131A1 (en) System and Method for Motion Capture in Natural Environments
CN109324634B (en) Aircraft and positioning method, control method and optical flow module thereof
WO2018058937A1 (en) Head-mount blind guiding device
CN107102749A (en) A kind of three-dimensional pen type localization method based on ultrasonic wave and inertial sensor
CN208636719U (en) A kind of automatic following system based on ultrasonic distance measurement
CN102499638B (en) Living body detection system based on vision, hearing, smell and touch
CN108245387A (en) A kind of intelligent blind guiding system based on wearable device
US11858143B1 (en) System for identifying a user with an autonomous mobile device
CN108399813B (en) Robot-based learning tutoring method and system, robot and handwriting equipment
CN106853638A (en) A kind of human-body biological signal tele-control system and method based on augmented reality
CN202748745U (en) High-precision positioning electronic pen and electronic whiteboard system
US20220400325A1 (en) Neck-worn device
CN111885333A (en) Device and method for acquiring three-dimensional audio and video and motion gestures
US7474855B2 (en) Information support system
WO2019214165A1 (en) Intelligent flight follower for navigation for blind people
CN216817246U (en) Unmanned aerial vehicle tracking system
WO2013035161A1 (en) Sensor terminal
CN206043228U (en) A kind of bird-repellent robots and bird-repeller system
CN212287717U (en) Interactive robot based on facial expression analysis
CN206133039U (en) Earthquake rescue assistor
WO2015186218A1 (en) Wireless communication system
CN105333865B (en) Unmanned vehicle infrared location system
CN114847880A (en) Intelligent device and method for detecting sleep information
CN209448761U (en) Electronic equipment

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant