CN119472996A

CN119472996A - A gesture recognition device and gesture recognition method based on crystal display

Info

Publication number: CN119472996A
Application number: CN202411512014.1A
Authority: CN
Inventors: 杨邕
Original assignee: Shanghai Yinghuochong Digital Technology Co ltd
Current assignee: Shanghai Yinghuochong Digital Technology Co ltd
Priority date: 2024-10-28
Filing date: 2024-10-28
Publication date: 2025-02-18

Abstract

The present application relates to a gesture recognition device and a gesture recognition method based on a crystal display, and relates to the technical field of gesture recognition devices; it includes a display stand, a crystal display is arranged above the display stand, a through hole is arranged corresponding to the slot of the display stand, a light guide rod is arranged in the through hole, one end of the light guide rod is located below the display stand, and the other end of the light guide rod passes through the through hole and is located inside the crystal display; an LED fill light assembly is arranged at the center of the light guide rod, and an optical flow sensor is arranged at the end of the light guide rod away from the crystal display stand. The present application has the effect of improving the accuracy of gesture recognition based on the crystal display.

Description

Gesture recognition device and gesture recognition method based on crystal display piece

Technical Field

The application relates to the technical field of gesture recognition devices, in particular to a gesture recognition device and a gesture recognition method based on a crystal display piece.

Background

The gesture recognition technology based on various sensors is widely applied while the man-machine interaction technology is rapidly developed, and a more visual and convenient interaction mode is provided for users. Especially in exhibitions, shops and other display occasions, the crystal display piece is widely applied due to the attractive and elegant appearance and the characteristic of easily attracting the attention of audiences, and the interaction can be further enhanced by combining the gesture recognition technology with the crystal display piece, so that the user experience is improved.

In order to realize gesture recognition, the current common technical means mainly comprise capturing gesture changes of a user by using a sensor, processing the gesture changes by a specific algorithm, and finally realizing gesture recognition. Specifically, common gesture recognition devices on the market mainly adopt technologies such as cameras or infrared sensors to capture gesture changes, and further realize gesture recognition through corresponding image processing and mode recognition algorithms. In addition, some technical means are combined with special display pieces, and the gesture recognition is realized by capturing the change of the optical signal through the optical sensor. These methods typically rely on complex imaging devices and image processing techniques to achieve a somewhat stable interactive experience.

However, the above-mentioned conventional gesture recognition technology has a problem that the camera or the infrared sensor is easily disturbed in a complex light environment, resulting in a decrease in recognition accuracy, and it is difficult to stably capture dynamic changes of gestures in real time. In addition, the existing optical sensor is not specially designed for the crystal display piece, so that the light collection efficiency of the existing optical sensor in practical application is low, and the gesture recognition accuracy is affected.

Disclosure of Invention

In order to improve accuracy of gesture recognition based on a crystal display, the application provides a gesture recognition device and a gesture recognition method based on the crystal display.

On one hand, the gesture recognition device based on the crystal display piece provided by the application adopts the following technical scheme:

The gesture recognition device based on the crystal display piece comprises a display table, the crystal display piece is arranged above the display table, a through hole is formed in a slot corresponding to the display table, a light guide rod is arranged in the through hole, one end of the light guide rod is located below the display table, the other end of the light guide rod penetrates through the through hole and is located inside the crystal display piece, an LED light supplementing lamp assembly is arranged at the center of the light guide rod, and an optical flow sensor is arranged at one end, away from the crystal display table, of the light guide rod.

Through adopting above-mentioned technical scheme, at gesture recognition's in-process, the light that LED light filling lamp subassembly sent shines on quartzy display member through the leaded light stick, and when user's hand was slided in quartzy display member's top, the light signal that LED light subassembly sent out can be reflected by the hand and received by the light flow sensor to accomplish the discernment of gesture through the light flow sensor.

Preferably, a slot is arranged on one side of the crystal display piece, which is close to the display stand, and one end of the light guide rod, which is far away from the optical flow sensor, is in plug-in fit with the slot.

Through adopting above-mentioned technical scheme, through the grafting cooperation that the crystal display piece is close to and the light guide stick, make the light that LED light filling lamp subassembly sent can shine on the crystal display piece as far as possible through the light guide stick.

Preferably, the LED light supplementing lamp assembly comprises a mounting table and a plurality of LED lamps, wherein the mounting table is mounted on the light guide rod, a plurality of mounting grooves are formed in the periphery of the mounting table, the LED lamps are correspondingly mounted in the mounting grooves, and the heads of the LED lamps face the light guide rod.

Through adopting above-mentioned technical scheme, provide firm support and fixed platform for the LED lamp through setting up the mount table, ensure that the LED lamp can install on the light guide bar steadily, avoid droing or damaging because of vibrations or external force as far as possible.

Preferably, a light-gathering groove is formed in one end, close to the light guide rod, of the mounting groove, the groove wall of the light-gathering groove is inclined outwards, and the LED lamp head portion is located in the light-gathering groove.

By adopting the technical scheme, the light-gathering groove can ensure that the light of the LEDs and the like can be intensively irradiated on the light guide rod as much as possible, and the utilization rate of light is further improved.

Preferably, the axis of the light guide rod coincides with the axis of the crystal display piece, and the sensing end of the optical flow sensor is positioned on the axis of the light guide rod.

By adopting the technical scheme, the light emitted by the LED light supplementing lamp assembly can be more uniformly emitted on the crystal display piece.

On the other hand, the gesture recognition method based on the crystal display piece provided by the application adopts the following technical scheme:

The gesture recognition method based on the crystal display piece comprises an LED driving module, an RGB signal gray scale processing module, an optical flow signal processing module, a dynamic gray scale signal intersection module, an information processing module and an executing mechanism, and further comprises the following steps:

controlling the LED light supplementing lamp assembly to emit light, and outputting RGB driving signals to a control end of the LED light supplementing lamp assembly by the LED driving module;

The LED light supplementing lamp assembly emits light to carry out gray processing, the LED driving module can also generate corresponding LED light supplementing lamp control instructions according to RGB driving signals, the LED light supplementing lamp control instructions are input to the RGB signal gray processing module, the RGB gray processing module generates corresponding RGB signal gray data according to the received LED light supplementing lamp control instructions, and the generated RGB signal gray data is input to the dynamic gray signal intersection module;

When the hand of a user slides above the crystal showing piece, the light signals emitted by the LED light assembly can be reflected by the hand and received by the light flow sensor, and the light flow sensor outputs light flow signals to the light flow signal processing module;

Performing gray scale processing on information received by an optical flow sensor, wherein the optical flow signal gray scale processing module is used for receiving the optical flow signal, generating optical flow signal gray scale data, and inputting the generated optical flow signal gray scale data to the dynamic gray scale signal intersection module;

Recognizing a user gesture, wherein the dynamic gray signal intersection module receives the RGB signal gray data and combines the optical flow signal gray data to generate synthesized dynamic gray data; the signal processing module is used for processing the synthesized dynamic gray data to generate corresponding finger instructions and outputting the finger instructions to the executing mechanism.

Through adopting above-mentioned technical scheme, need not the user and wear any additional equipment or carry out complicated setting, only need simply make the gesture in quartzy display piece top can realize with the interdynamic of show content, promoted user's participation and experience impression, realized the accurate capture and the quick response to the gesture.

Preferably, the synthesized dynamic gray data is equal to the optical flow signal gray data minus the RGB signal gray data.

By adopting the technical scheme, the RGB signal gray scale data may contain some static or slowly changing ambient light information. By subtracting the information, interference caused by background light on gesture recognition can be reduced to a certain extent, and recognition accuracy is improved.

Preferably, the LED driving module is composed of a microprocessor and a driving circuit.

By adopting the technical scheme, the LED luminous lamp assembly is controlled.

Preferably, the LED driving signal can control the number of light emission and the light emission intensity of the LED light supplement lamp.

Through adopting above-mentioned technical scheme, can adjust the transmission pipeline of LED light filling lamp subassembly according to the ambient light and the application scene around.

In summary, the present application includes at least one of the following beneficial technical effects:

1. Through stable matching of the display stand and the crystal display piece and accurate installation of the light guide rod, effective transmission and uniform distribution of light are ensured, and stability of gesture recognition is improved;

2, the design of a plurality of LED lamps of the LED light supplementing lamp assembly and the optimization of the light gathering grooves enable light to be more concentrated and uniform in intensity, and the gesture recognition accuracy is remarkably improved;

3. The optical flow sensor captures gesture dynamic changes in real time, optical flow signal gray data can be produced through the optical flow signal processing module, and real-time response capability and anti-interference performance of gesture recognition can be effectively improved through subtracting RGB gray signal gray data.

Drawings

FIG. 1 is a schematic view showing the overall structure of embodiment 1 of the present application;

FIG. 2 is a schematic cross-sectional view of embodiment 1 of the present application;

FIG. 3 is a functional block diagram of embodiment 2 of the present application;

fig. 4 is a flow chart of the method of embodiment 2 of the present application.

Reference numeral 1, a display stand; 2, a crystal display piece, 21, a slot, 3, a light guide rod, 4, an LED light supplementing lamp component, 41, a mounting table, 411, a mounting groove, 412, a light gathering groove, 42, an LED lamp and 5, and an optical flow sensor.

Detailed Description

The application is described in further detail below with reference to fig. 1-4.

Example 1:

The embodiment 1 of the application discloses a gesture recognition device and a gesture recognition method based on a crystal display.

Referring to fig. 1 and 2, a gesture recognition device and a gesture recognition method based on a crystal display piece comprise a display table 1, wherein a crystal display piece 2 is arranged above the display table 1, and a hand of a user swings above the crystal display piece 2 to form a gesture. The crystal display piece 2 is provided with slot 21 near one side of show stand 1, and show stand 1 is provided with the through-hole corresponding to slot 21. The through hole is provided with the light guide rod 3, and the one end of light guide rod 3 is located the below of show stand 1, and the other end of light guide rod 3 passes the through hole and is connected to quartzy display piece 2. The center of the light guide rod 3 is also provided with an LED light supplementing lamp component 4, the lower part of the light guide rod 3 far away from the display stand 1 is also provided with an optical flow sensor 5 for receiving light, and the optical flow sensor 5 can capture dynamic changes of gestures in real time by calculating the movement speed of pixels or characteristic points in images, namely optical flow, so that the gesture can be identified.

The whole show stand 1 is rectangular plate-shaped, the whole crystal show piece 2 is cylindrical, and the axis of the crystal show piece 2 is perpendicular to the length direction surface of the show stand 1, so that light can be comprehensively collected by using the crystal show piece 2. The crystal display piece 2 is provided with cylindric slot 21 near one side of show stand 1, and light guide bar 3 wholly is the cylinder form, and light guide bar 3 can be made by transparent material such as transparent plastics or quartz material, and the axis coincidence of axis and the crystal display piece 2 of light guide bar 3, and the one end and the slot 21 grafting cooperation of light guide bar 3. The two ends of the light guide rod 3 are arc-shaped, namely, the two ends of the light guide rod 3 are convex mirrors. The radian of the convex mirrors at the two ends of the light guide rod 3 is related to the shape and the size of the crystal display piece, and it is required to ensure that the optical flow sensor 5 can capture correct gesture movement optical flow information.

The LED light supplementing lamp assembly 4 is positioned near the center of the light guide rod 3 and comprises a mounting table 41 and a plurality of LED lamps 42. The mounting table 41 is annular in shape as a whole, and the mounting table 41 is uniformly provided with a plurality of mounting slots 411 for mounting the LED lamps 42 along the circumferential direction thereof. Preferably, a condensing groove 412 is provided at one end of the mounting groove 411 near the light guide bar 3, and the head of the LED lamp 42 is located in the condensing groove 412, and the terminal of the LED lamp 42 is located at the outside of the mounting table 41, so that the wiring is facilitated. The groove walls of the light condensing groove 412 are inclined outward so that the light emitted from the LED lamp 42 can be irradiated on the light guide rod 3 as much as possible. In this embodiment, the LED lamps 42 and the mounting slots 411 are all provided with eight, the LED lamps 42 can adopt three-color (red, green and blue) LED lamp 42 beads, the number of LED lamps 42 of each color can be adjusted as required, and the luminous intensity of each LED lamp 42 can be adjusted as required.

The gesture recognition device based on the crystal display piece of the embodiment 1 of the application is implemented by ensuring the firmness and light transmittance of the whole device through the structural stability and material selection of the surface of the display table 1, ensuring the stable matching relationship between the light guide rod 3 and the crystal display piece 2 through the design of the slot 21 and the through hole, ensuring the uniform distribution and sufficient intensity of the light source by adopting a plurality of LED light supplementing lamps 42 uniformly distributed along the circumferential direction of the light guide rod 3 by adopting the LED light supplementing lamp component 4, and improving the recognition accuracy by adopting a high-precision sensor as the optical flow sensor 5. Together, these designs ensure the overall stability of the device and the accuracy of gesture recognition.

Example 2:

The embodiment 2 of the application discloses a gesture recognition method based on a crystal display.

Referring to fig. 3 and fig. 4, a gesture recognition method based on a crystal display is based on the gesture recognition device, and includes an LED driving module, an RGB signal gray processing module, a dynamic gray signal intersection module, an optical flow signal processing module, a signal processing module, and an executing mechanism. The control output end of the LED driving module is connected to the control end of the LED light supplementing lamp component in a signal mode, and the signal output end of the LED driving module is connected to the first signal output end of the dynamic gray signal intersection module through the RGB signal gray processing module in a signal mode. The signal output end of the optical flow sensor is connected to the second signal output end of the dynamic gray signal intersection module through an optical flow signal processing module, and the signal output end of the dynamic gray signal intersection module is transmitted to the executing mechanism through the signal processing module.

The method comprises the following steps:

S1, controlling the LED light supplementing lamp component to emit light. The control output end of the LED driving module is used for outputting RGB driving signals to the control end of the LED light supplementing lamp assembly, and the luminous quantity and luminous intensity of the LED light supplementing lamps can be controlled by controlling the RGB driving signals output by the LED module. Specifically, the LED driving module is composed of a microprocessor and a driving circuit, the microprocessor can realize complex control logic, and the driving circuit is responsible for converting control signals generated by the microprocessor into driving currents required by the LED light supplementing lamp assembly. And the LED driving module further comprises a filter circuit, so that the light-emitting stability of the LED light supplementing lamp can be improved, and the accuracy of the follow-up gesture recognition is improved.

Preferably, the display stand is further provided with an illumination sensor, and the output of the illumination sensor is in signal connection with the LED driving module. The illumination sensor is used for detecting the external illumination intensity, when the external illumination intensity is detected to be higher, the LED driving module is used for improving the luminous intensity of the LED light supplementing lamp so as to reduce the influence of external strong light on detection, and when the external illumination intensity is detected to be lower, the LED driving module is used for reducing the luminous intensity of the LED light supplementing lamp so as to achieve the effect of saving energy.

And S2, carrying out gray scale processing on the light emitted by the LED light supplementing lamp component. The LED driving module can also generate corresponding LED light supplementing lamp control instructions according to the RGB driving signals, the LED light supplementing lamp control instructions are input to the RGB signal gray scale processing module, the RGB gray scale processing module generates corresponding RGB signal gray scale data according to the received LED light supplementing lamp control instructions, and the generated RGB signal gray scale data is input to the dynamic gray scale signal intersection module. Specifically, the module can select ARM Cortex-A9 processor to process signals. The processor firstly converts the RGB driving signals into gray data, calculates the average gray value of each pixel point, generates the gray distribution of each pixel point, and finally generates RGB signal gray data. Through adjusting luminous intensity and colour of each LED light filling lamp, can provide different light environment for gesture recognition, reduce the influence of external light to recognition accuracy.

And S3, when the hand of the user slides above the crystal display piece, the light signals emitted by the LED light assembly can be reflected by the hand and received by the light flow sensor. After receiving the light signal, the optical flow sensor can output an optical flow signal to the optical flow signal processing module at the rear stage.

S4, gray processing is carried out on the information received by the optical flow sensor. The optical flow signal gray level processing module receives the optical flow signals, processes the optical flow signals to generate optical flow signal gray level data, and inputs the generated optical flow signal gray level data to the dynamic gray level signal intersection module. Specifically, the optical flow signal processing module can be selectively composed of a DSP chip and a peripheral circuit, wherein the DSP chip has multi-core processing capability and high-speed floating point operation capability. Peripheral circuits are responsible for signal input/output and power management.

Preferably, human body proximity sensors are arranged around the display stand, when a user detects that a human body approaches, gray processing is performed on information received by the light flow sensors, so that recognition of gestures of the user can be guaranteed to the greatest extent, and interference caused by other foreign matters scratching above the display stand is eliminated as much as possible. S5, recognizing a user gesture. The dynamic gray signal intersection module receives the RGB signal gray data in combination with the optical flow signal gray data to generate composite dynamic gray data, wherein the composite dynamic gray data is equal to the optical flow signal gray data minus the RGB signal gray data. By the mode, the gesture details can be reserved while the interference of external light rays is eliminated, and the recognition accuracy is improved.

Specifically, non-gesture signals (e.g., reflected signals of stationary objects such as desktops, backgrounds, etc.) may also be filtered. For example, by setting a specific gray threshold, light variation irrelevant to the gesture is eliminated, so that the gesture recognition accuracy is further improved. In addition, a fixed threshold or an adaptive threshold technology can be adopted to distinguish gesture signals from non-gesture signals, so that even under the interference of various light sources, the system can accurately identify the fine actions of the human hand.

The synthesized dynamic gray data generated by the dynamic gray signal intersection module is input to the signal processing module, and the signal processing module is used for processing the synthesized dynamic gray data to generate corresponding finger instructions and outputting the finger instructions to the executing mechanism.

S6, executing actions. The executing mechanism can execute corresponding actions according to the received gesture instructions.

The above embodiments are not intended to limit the scope of the application, so that the equivalent changes of the structure, shape and principle of the application are covered by the scope of the application.

Claims

1. A gesture recognition device based on a crystal display piece is characterized by comprising a display table (1), wherein a crystal display piece (2) is arranged above the display table (1), a through hole is formed in the display table (1) corresponding to a slot (21), a light guide rod (3) is arranged in the through hole, one end of the light guide rod (3) is located below the display table (1), the other end of the light guide rod (3) penetrates through the through hole and is located inside the crystal display piece (2), an LED light supplementing lamp assembly (4) is arranged at the center of the light guide rod (3), and an optical flow sensor (5) is arranged at one end, far away from the crystal display table (1), of the light guide rod (3).

2. The gesture recognition device based on the crystal display piece according to claim 1, wherein a slot (21) is formed in one side, close to the display table (1), of the crystal display piece (2), and one end, far away from the optical flow sensor (5), of the light guide rod (3) is in plug-in fit with the slot (21).

3. The gesture recognition device based on the crystal display of claim 1, wherein the LED light supplementing lamp assembly (4) comprises a mounting table (41) and a plurality of LED lamps (42), the mounting table (41) is mounted on the light guide rod (3), the mounting table (41) is provided with a plurality of mounting grooves (411) along the circumferential direction of the mounting table, the LED lamps (42) are correspondingly mounted in the mounting grooves (411), and the heads of the LED lamps (42) face the light guide rod (3).

4. The gesture recognition device based on the crystal display of claim 3, wherein a light-gathering groove (412) is formed in one end, close to the light guide rod (3), of the mounting groove (411), the groove wall of the light-gathering groove (412) is inclined outwards, and the head of the LED lamp (42) is located in the light-gathering groove (412).

5. The gesture recognition device based on the crystal display of claim 1, wherein the axis of the light guide rod (3) coincides with the axis of the crystal display (2), and the sensing end of the optical flow sensor (5) is positioned on the axis of the light guide rod (3).

6. The gesture recognition method based on the crystal display piece is based on the gesture recognition device according to any one of claims 1-5, and is characterized by comprising an LED driving module, an RGB signal gray scale processing module, an optical flow signal processing module, a dynamic gray scale signal intersection module, an information processing module and an executing mechanism, and further comprising the following steps:

7. The method of claim 6, wherein the composite dynamic gray scale data is equal to the optical flow signal gray scale data minus the RGB signal gray scale data.

8. The gesture recognition method based on the crystal display of claim 6, wherein the LED driving module comprises a microprocessor and a driving circuit, an illumination sensor is further arranged on the display stand, and the output end of the illumination sensor is in signal connection with the LED driving module.

9. The method for gesture recognition based on crystal display of claim 6, wherein the LED driving signals are capable of controlling the number of light emitting and the light emitting intensity of the LED light supplementing lamps.