CN106951109B - Method and device for acquiring hand gesture - Google Patents
Method and device for acquiring hand gesture Download PDFInfo
- Publication number
- CN106951109B CN106951109B CN201710211447.7A CN201710211447A CN106951109B CN 106951109 B CN106951109 B CN 106951109B CN 201710211447 A CN201710211447 A CN 201710211447A CN 106951109 B CN106951109 B CN 106951109B
- Authority
- CN
- China
- Prior art keywords
- finger
- gyroscope
- value
- wrist
- thumb
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method for acquiring hand gestures, which comprises the following steps: s1:fixed acquisition hand posture device, S2: setting parameters, S3: calculating a rate of change of the wrist pressure parameter, S4: calculating the opening degree of the middle finger, the ring finger and the little finger, S5: will K1、K2And K3The values of (1) are respectively transmitted to the information processing units. The invention relates to a device for collecting hand gestures, which further comprises: the first gyroscope arranged on the thumb, the second gyroscope arranged on the index finger, the wrist pressure sensor arranged on the wrist and the information processing unit, wherein the information processing unit is respectively connected with the first gyroscope, the second gyroscope and the wrist pressure sensor. The method for acquiring the hand gesture provided by the invention can accurately position the hand gesture, accords with the actual operating condition of a human body, can capture eight gestures and intermediate gestures, is sensitive and accurate in data acquisition, and cannot be interfered by environmental sound and light.
Description
Technical Field
The invention relates to the technical field of human-computer interaction, in particular to a method and a device for acquiring hand gestures.
Background
The traditional operation technology is usually realized based on a mouse and a keyboard, the input mode is limited, smooth middle state operation cannot be achieved, accurate operations such as drawing art, driving technology, cooking technology and the like are difficult to realize, some exploration for data acquisition of human hands exists in the technical field of man-machine interaction, but the main idea of the existing technical scheme is to add a sensing part for each finger, thereby realizing the gesture collection of the whole hand, causing the complex structure when the product is manufactured, and the prior art ignores the linkage action of the middle finger, the ring finger and the little finger of the human, the linkage of the three fingers causes that the gesture acquisition technology in the prior theory has very large error when being applied to practice and can not be used practically, therefore, a method for acquiring the hand gesture, which can quickly and effectively identify the hand gesture of an operator, has small error and strong universality, is urgently needed.
Disclosure of Invention
According to the problems in the prior art, the invention discloses a method and a device for acquiring hand gestures.
The technical scheme is as follows: a method of collecting hand gestures, comprising the steps of:
s1: the hand gesture collecting device comprises a first gyroscope, a second gyroscope and a wrist pressure sensor, wherein the first gyroscope is fixed on a thumb, the second gyroscope is fixed on an index finger, and the wrist pressure sensor is fixed on a wrist;
s2: setting parameters, and setting the opening degree of the first gyroscope to be K1，K1Is the opening and closing degree of the thumb, and the opening and closing degree of the second gyroscopeIs K2，K2The value of (A) is the opening degree of the index finger, and the pressure value of the wrist pressure sensor is P; all fingers are held tightly, and K at the moment is set1Is 0, K2Is 0 and P is P0(ii) a Keeping the thumb and the index finger to be held tightly, and opening the middle finger, the ring finger and the little finger, wherein the value P is P1(ii) a When all fingers are opened, K at this time is set1To 100%, K2Is 100%;
s3: calculating the change rate of the wrist pressure parameter, and setting the change rate of the wrist pressure parameter as Q, wherein the value of Q is calculated by adopting the following formula:
when the thumb and the index finger are held tightly, the middle finger, the ring finger and the little finger are opened, P is equal to P1I.e., Q ═ 1;
s4: calculating the opening degree of the middle finger, the ring finger and the little finger, setting the motion of the middle finger, the ring finger and the little finger as a combined posture, wherein the opening degree of the middle finger, the ring finger and the little finger is K3；
Opening and closing degree K of thumb1Opening and closing degree K of index finger2The influence on the pressure value P of the wrist pressure sensor satisfies the following formulas, respectively:
Q1＝0.1K1(2)
Q2＝0.18K2(3)
K3the value of (d) is calculated using the following formula:
in the formula K1The value of (A) is the opening and closing degree of the thumb, K2The value of (D) is the opening and closing degree of the index finger, K3The value of (1) is the joint gesture opening degree of the middle finger, the ring finger and the little finger.
Further, in the above technical solution, the method further includes step S5: will K1、K2And K3Are respectively transmitted to the information processing unitsWill K1、K2And K3The value of (d) is converted into a control signal.
Further, in the above technical solution, the information processing unit may change K1、K2And K3Is converted into a control signal composed of a plurality of attitude signals, wherein:
W＝(K1，K2，K3) (5)
wherein W is a single attitude signal, let W1＝(0，0，0)，W2＝(1，0，0)，W3＝(1，1，0)，W4＝(1，1，1)，W5＝(0，1，1)，W6＝(0，1，0)，W7＝(0，0，1)，W8When the user gets the gesture of (1, 0, 1), 8 hand gestures can be captured.
An apparatus for collecting hand gesture, the method for collecting hand gesture further comprises:
the first gyroscope arranged on the thumb, the second gyroscope arranged on the index finger, the wrist pressure sensor arranged on the wrist and the information processing unit, wherein the information processing unit is respectively connected with the first gyroscope, the second gyroscope and the wrist pressure sensor.
Compared with the prior art, the invention has the following beneficial effects:
(1) the method for acquiring the hand gesture can accurately position the hand gesture, has small error and strong universality, and accords with the actual operating condition of a human body;
(2) the method for acquiring the hand postures can capture eight postures and intermediate postures, and the acquired data is sensitive and accurate;
(3) the method for acquiring the hand gesture is based on the acquisition of mechanical characteristics, is not interfered by environmental sound and light, and has good stability.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It should be apparent that the drawings in the following description are only some of the embodiments described in the present application, and that other drawings can be obtained from these drawings by those skilled in the art without inventive effort;
fig. 1 is a flowchart of a method for acquiring hand gestures according to embodiment 1 of the present invention;
fig. 2 is a schematic diagram of hand gestures corresponding to the gesture signals in embodiment 2 of the present invention;
fig. 3 is a schematic structural diagram of a device for acquiring hand gestures according to embodiment 3 of the present invention.
In the figure: 1. the device comprises a first gyroscope, a second gyroscope, a wrist pressure sensor, a first gyroscope, a second gyroscope, a wrist pressure sensor, a second gyroscope, a.
Detailed Description
In order to make the technical solutions and advantages of the present invention clearer, the following describes the technical solutions in the embodiments of the present invention clearly and completely with reference to the drawings in the embodiments of the present invention.
Example 1
A method of collecting hand gestures, comprising the steps of:
s1: the hand gesture collecting device comprises a first gyroscope 1, a second gyroscope 2 and a wrist pressure sensor 3, wherein the first gyroscope 1 is fixed on a thumb, the second gyroscope 2 is fixed on an index finger, and the wrist pressure sensor 3 is fixed on a wrist;
s2: setting parameters, and setting the opening degree of the first gyroscope 1 to be K1，K1The value of (1) is the opening degree of the thumb, and the opening degree of the second gyroscope 2 is K2，K2The value of (3) is the opening degree of the index finger, and the pressure value of the wrist pressure sensor 3 is P; all fingers are held tightly, and K at the moment is set1Is 0, K2Is 0 and P is P0(ii) a Keeping the thumb and the index finger to be held tightly, and opening the middle finger, the ring finger and the little finger, wherein the value P is P1(ii) a When all fingers are opened, K at this time is set1To 100%, K2Is 100%;
s3: calculating the change rate of the wrist pressure parameter, and setting the change rate of the wrist pressure parameter as Q, wherein the value of Q is calculated by adopting the following formula:
when the thumb and the index finger are held tightly, the middle finger, the ring finger and the little finger are opened, P is equal to P1I.e., Q ═ 1;
s4: calculating the opening degree of the middle finger, the ring finger and the little finger, setting the motion of the middle finger, the ring finger and the little finger as a combined posture, wherein the opening degree of the middle finger, the ring finger and the little finger is K3；
Opening and closing degree K of thumb1Opening and closing degree K of index finger2The influence on the pressure value P of the wrist pressure sensor 3 satisfies the following formulas, respectively:
Q1＝0.1K1(2)
Q2＝0.18K2(3)
K3the value of (d) is calculated using the following formula:
in the formula K1The value of (A) is the opening and closing degree of the thumb, K2The value of (D) is the opening and closing degree of the index finger, K3The value of (1) is the joint gesture opening degree of the middle finger, the ring finger and the little finger.
The method for acquiring the hand gestures can capture various fixed gestures, intermediate gestures and motion gestures of the hand, and quickly and effectively identify the hand gestures of an operator.
Data collection data for validation equation 2 is shown in table 1:
TABLE 1 data acquisition data validation Table of equation 2
Data collection data for validation equation 3 is shown in table 2:
TABLE 2 data acquisition data validation Table of equation 3
Data collection data for validation equation 4 is shown in table 1:
TABLE 3 data acquisition data validation Table of equation 4
Example 2
The present embodiment is different from embodiment 1 in that it further includes step S5: will K1、K2And K3Respectively to the information processing unit 4, said information processing unit 4 transmitting K1、K2And K3The value of (d) is converted into a control signal.
Further, in the above technical solution, the information processing unit 4 sets K1、K2And K3Is converted into a control signal composed of a plurality of attitude signals, wherein:
W＝(K1，K2，K3) (5)
wherein W is a single attitude signal, let W1＝(0，0，0)，W2＝(1，0，0)，W3＝(1，1，0)，W4＝(1，1，1)，W5＝(0，1，1)，W6＝(0，1，0)，W7＝(0，0，1)，W8When the user gets the gesture of (1, 0, 1), 8 hand gestures can be captured.
W1Corresponding to the fist-holding posture W2Corresponding to the thumb and holding other fingersPosture of (W)3Corresponding to the position of the thumb and forefinger holding the other fingers simultaneously, W4Corresponding to the posture of opening all fingers, W5Corresponding to the gesture of holding the thumb while extending the other fingers, W6Corresponding to the posture of extending the index finger and holding other fingers, W7Corresponding to the position of holding the thumb and forefinger while opening the other fingers, W8Corresponding to the gesture of holding the index finger while opening the other fingers.
The method for acquiring the hand gestures can acquire the 8 hand gestures and acquire the middle gesture.
In addition, 8 hand gestures are captured by adopting the method for acquiring the hand gestures, corresponding to binary codes of three digits of 000 to 111, and control signals are output to a control terminal to carry out code input or gesture control.
Example 3
An apparatus for collecting hand gesture, the method for collecting hand gesture further comprises:
set up first gyroscope 1 on the thumb, set up second gyroscope 2 on the forefinger and set up in the wrist pressure sensor 3 of wrist, still include information processing unit 4, information processing unit 4 respectively with first gyroscope 1 second gyroscope 2 with wrist pressure sensor 3 is connected.
Preferably, the first gyroscope 1 is arranged on the first knuckle of the thumb, and the second gyroscope 2 is arranged on the first knuckle of the index finger.
Due to the adoption of the technical scheme, the method for acquiring the hand gesture provided by the invention can accurately position the hand gesture, has small error and strong universality, accords with the actual operation condition of a human body, can capture eight gestures and intermediate gestures, is sensitive and accurate in data acquisition, is based on the acquisition of mechanical characteristics, cannot be interfered by environmental sound and light, and has good stability.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.
Claims (4)
1. A method for collecting hand gestures is characterized by comprising the following steps:
s1: the hand gesture collecting device comprises a first gyroscope, a second gyroscope and a wrist pressure sensor, wherein the first gyroscope is fixed on a thumb, the second gyroscope is fixed on an index finger, and the wrist pressure sensor is fixed on a wrist;
s2: setting parameters, and setting the opening degree of the first gyroscope to be K1，K1The value of (a) is the opening degree of the thumb, and the opening degree of the second gyroscope is K2，K2The value of (A) is the opening degree of the index finger, and the pressure value of the wrist pressure sensor is P; all fingers are held tightly, and K at the moment is set1Is 0, K2Is 0 and P is P0(ii) a Keeping the thumb and the index finger to be held tightly, and opening the middle finger, the ring finger and the little finger, wherein the value P is P1(ii) a When all fingers are opened, K at this time is set1To 100%, K2Is 100%;
s3: calculating the change rate of the wrist pressure parameter, and setting the change rate of the wrist pressure parameter as Q, wherein the value of Q is calculated by adopting the following formula:
when the thumb and the index finger are held tightly, the middle finger, the ring finger and the little finger are opened, P is equal to P1I.e., Q ═ 1;
s4: calculating the opening degree of the middle finger, the ring finger and the little finger, setting the motion of the middle finger, the ring finger and the little finger as a combined posture, wherein the opening degree of the middle finger, the ring finger and the little finger is K3；
Opening and closing degree K of thumb1Opening and closing degree K of index finger2The influence on the pressure value P of the wrist pressure sensor satisfies the following formulas, respectively:
Q1＝0.1K1(2)
Q2＝0.18K2(3)
K3the value of (d) is calculated using the following formula:
in the formula K1The value of (A) is the opening and closing degree of the thumb, K2The value of (D) is the opening and closing degree of the index finger, K3The value of (1) is the joint gesture opening degree of the middle finger, the ring finger and the little finger.
2. The method of capturing hand gestures of claim 1, wherein: further comprising step S5: will K1、K2And K3Respectively to an information processing unit which transmits K1、K2And K3The value of (d) is converted into a control signal.
3. The method of capturing hand gestures of claim 2, wherein: the information processing unit sends K1、K2And K3Is converted into a control signal composed of a plurality of attitude signals, wherein:
W＝(K1，K2，K3) (5)
wherein W is a single attitude signal, let W1＝(0，0，0)，W2＝(1，0，0)，W3＝(1，1，0)，W4＝(1，1，1)，W5＝(0，1，1)，W6＝(0，1，0)，W7＝(0，0，1)，W8When the user gets the gesture of (1, 0, 1), 8 hand gestures can be captured.
4. The utility model provides a gather device of hand gesture which characterized in that: the method for acquiring hand gestures of claim 1, further comprising:
the first gyroscope arranged on the thumb, the second gyroscope arranged on the index finger, the wrist pressure sensor arranged on the wrist and the information processing unit, wherein the information processing unit is respectively connected with the first gyroscope, the second gyroscope and the wrist pressure sensor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710211447.7A CN106951109B (en) | 2017-03-31 | 2017-03-31 | Method and device for acquiring hand gesture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710211447.7A CN106951109B (en) | 2017-03-31 | 2017-03-31 | Method and device for acquiring hand gesture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106951109A CN106951109A (en) | 2017-07-14 |
| CN106951109B true CN106951109B (en) | 2020-02-14 |
Family
ID=59474605
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710211447.7A Active CN106951109B (en) | 2017-03-31 | 2017-03-31 | Method and device for acquiring hand gesture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106951109B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111984112A (en) * | 2020-04-08 | 2020-11-24 | 海尔（青岛）国际智慧教育网络有限公司 | Gesture recognition device and recognition method |
| CN113157087B (en) * | 2021-02-19 | 2024-12-10 | 浙江大学 | A dual-mode flexible sensing system for finger pressure and posture |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103263094A (en) * | 2013-05-28 | 2013-08-28 | 张瞳 | Intelligent induction glove system |
| WO2015131157A1 (en) * | 2014-02-28 | 2015-09-03 | Vikas Gupta | Gesture operated wrist mounted camera system |
| CN105022471A (en) * | 2014-04-23 | 2015-11-04 | 王建勤 | Device and method for gesture recognition based on pressure sensor array |
| CN105975075A (en) * | 2016-05-09 | 2016-09-28 | 深圳智华科技发展有限公司 | Operation system and method for replacing computer mouse by operating through gesture posture identification |
-
2017
- 2017-03-31 CN CN201710211447.7A patent/CN106951109B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103263094A (en) * | 2013-05-28 | 2013-08-28 | 张瞳 | Intelligent induction glove system |
| WO2015131157A1 (en) * | 2014-02-28 | 2015-09-03 | Vikas Gupta | Gesture operated wrist mounted camera system |
| CN105022471A (en) * | 2014-04-23 | 2015-11-04 | 王建勤 | Device and method for gesture recognition based on pressure sensor array |
| CN105975075A (en) * | 2016-05-09 | 2016-09-28 | 深圳智华科技发展有限公司 | Operation system and method for replacing computer mouse by operating through gesture posture identification |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106951109A (en) | 2017-07-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10817795B2 (en) | Handstate reconstruction based on multiple inputs | |
| US11000211B2 (en) | Adaptive system for deriving control signals from measurements of neuromuscular activity | |
| Chouhan et al. | Smart glove with gesture recognition ability for the hearing and speech impaired | |
| CN107589782B (en) | Method and apparatus for a gesture control interface of a wearable device | |
| EP2959394B1 (en) | Methods and devices that combine muscle activity sensor signals and inertial sensor signals for gesture-based control | |
| EP3951564A1 (en) | Methods and apparatus for simultaneous detection of discrete and continuous gestures | |
| CN109839827B (en) | Gesture recognition intelligent household control system based on full-space position information | |
| US20170147079A1 (en) | Human Body-Based Interaction Method and Interaction Apparatus | |
| Adnan et al. | Measurement of the flexible bending force of the index and middle fingers for virtual interaction | |
| CN103294226B (en) | A virtual input device and method | |
| WO2017036147A1 (en) | Bioelectricity-based control method, device and controller | |
| Chang et al. | A hierarchical hand motions recognition method based on IMU and sEMG sensors | |
| CN106951109B (en) | Method and device for acquiring hand gesture | |
| Ng et al. | Gesture based automating household appliances | |
| CN110362190B (en) | MYO-based text input system and method | |
| US20190302894A1 (en) | Method and system for electronic communication by persons with disabilities | |
| CN106125939A (en) | A kind of man-machine interaction method based on Intelligent glove | |
| CN204748634U (en) | Motion control system of robot | |
| CN107506041A (en) | A kind of wearable mouse control method based on motion sensor | |
| CN107203281A (en) | A kind of finger cot type input method and device | |
| Harling | Gesture input using neural networks | |
| Varalatchoumy et al. | Wheelchair and PC Volume Control Using Hand Gesture | |
| CN112068700B (en) | Text information input method, device and storage medium | |
| CN203299754U (en) | Virtual input device | |
| CN106843485A (en) | Virtual reality gesture control device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20211210 Address after: Room 636-1 and 636-2, 6 / F, Huizhi building, No. 28, ningshuang Road, Yuhuatai District, Nanjing, Jiangsu 210012 Patentee after: Nanjing weisaike Network Technology Co.,Ltd. Address before: 211100 Room 301, building 6, No. 18, Jialing Jiangdong Street, Jianye District, Nanjing City, Jiangsu Province Patentee before: Yin Chao |