CN104599554B - A sign language teaching system and method based on two-dimensional code recognition - Google Patents

Abstract

The invention discloses a two-dimensional code recognition-based sign language teaching system and method. The system comprises teaching gloves, a two-dimensional code scanner, a processor and a display device, wherein the front face, the back face and the side face of each fingerstall, palm part and arm part of each glove are provided with two-dimensional codes respectively for referring to the front face, the back face and the side face of each finger, palm and arm of a teacher; the two-dimensional code scanner is used for scanning on the front side or back side of a sign language gesture of the teacher and acquiring two-dimensional code information on the gloves; the processor is installed with sign language simulation software and is provided with a sign language code library and a character database; many simulating hands for making sign language gestures are stored in the sign language code library; character information matched with the meanings of various sign languages are stored in the character database; the display device is used for displaying the simulating hand and the character information corresponding to the sign language action of the teacher. The system and the method have the advantages of easiness in operation, high recognition speed and capability of helping learners to quickly understand the real meanings of the sign languages of the teacher to guarantee quicker learning and higher efficiency of the learner and guarantee the learning quality.

Description

A sign language teaching system and method based on two-dimensional code recognition

technical field

The invention relates to a sign language teaching system, in particular to a sign language teaching system and method based on two-dimensional code recognition.

Background technique

Sign language is an essential and effective means of communication in the life of the deaf-mute, and it is a special language used by the deaf-mute. Sign language is a very important part of human body language. It is a kind of human body language that contains the most information, and it is vivid, vivid, intuitive, and has a strong visual effect. However, because many sign languages often contain multiple meanings, deaf-mute people often experience difficulties in understanding and poor learning effect when learning sign language through sign language, or other non-deaf-mute people in the process of learning sign language The problem. In this regard, some sign language recognition products targeting this aspect have appeared in the existing technology, and there are mainly two types of relatively mature ones:

1. Based on camera technology, including: ordinary camera, infrared camera, etc. The purpose is to separate the hand shape from the background, get the shape of the hand, and then judge its meaning according to the shape of the hand. This technology has high requirements on camera resolution, computer configuration and light, etc., and the recognition speed is relatively slow.

2. Data gloves made of sensor technology, which are very complicated to operate and not suitable for ordinary classroom teaching.

Contents of the invention

The present invention provides a sign language teaching system and method based on two-dimensional code recognition, which overcomes the shortcomings described in the background technology.

The technical solution adopted by the present invention to solve its technical problems is: a sign language teaching system based on two-dimensional code recognition, including:

For teaching gloves, there are two-dimensional codes on the front, back, and sides of each fingertip, palm, and arm of the glove, which are used to refer to the front, back, and sides of each finger, palm, and arm of the teacher;

Two-dimensional code scanner, used to scan and obtain the two-dimensional code information on the glove on the front or back side of the teacher's sign language gesture;

The processor is equipped with sign language simulation software, which has a sign language coding library and a character database. The sign language coding library stores many simulated hands making sign language gestures, and the word database stores text information matching the meaning of various sign languages;

A display device for displaying simulated hands and text information corresponding to the teacher's sign language movements;

The two-dimensional code scanner transmits the obtained two-dimensional code information to the processor, and the processor decodes and recognizes the received two-dimensional code, and calls out the simulated hand and text information that match the teacher's sign language posture , displayed on the display device.

Further, the two-dimensional codes of various parts on the glove are coded by using simulated pictures of corresponding parts of the hand.

Further, the two-dimensional code scanner is worn on the chest of the teacher, or set on the chest cloth of a clothing that can be worn by the teacher.

Further, the two-dimensional codes on the front of the glove and the corresponding two-dimensional codes on the back adopt reverse coding; the two-dimensional codes on both sides of the arm part of the glove adopt reverse coding.

Further, the two-dimensional code scanner transmits the obtained two-dimensional code information to the processor through a data line or wireless communication.

Further, the display device is a projector screen.

A sign language teaching method based on two-dimensional code recognition, comprising the steps of:

(1) Sign language simulation software is pre-installed in the processor. The sign language simulation software has a sign language code base and a character database. The sign language code base stores many simulated hands making sign language gestures. text message; open the sign language simulation software;

(2) The teacher wears teaching gloves. There are two-dimensional codes on the front, back and side of each fingertip, palm and arm of the glove, which are used to refer to the front of each finger, palm and arm of the teacher. , the back and the side; the teacher performs sign language movements within the scanning range of the two-dimensional code scanner, and the two-dimensional code scanner transmits the scanned two-dimensional code on the glove to the processor;

(3) The processor decodes and recognizes the received two-dimensional code, and calls out the simulated hand and text information corresponding to the teacher's sign language posture, and displays them through the display device.

Further, in the step (2), the two-dimensional codes of the various parts on the glove are coded using the simulated pictures of the corresponding parts of the hand.

Further, in the step (2), the two-dimensional code scanner is worn on the chest of the teacher, or set on the chest cloth of a clothing that can be worn by the teacher.

Further, in the step (3), the text information is one or more groups, and if there are multiple groups, the teacher determines a group of text information that represents the correct meaning.

The present invention has the following beneficial effects:

In the present invention, a pair of gloves with a two-dimensional code is used to cooperate with a two-dimensional code scanner to collect the sign language posture of the teacher, and transmit it to a processor equipped with sign language simulation software for decoding and identification, and call out the sign language gesture corresponding to the teacher's sign language gesture. The matching simulated hands and text information are displayed on the display device. Not only is the operation simple and the recognition speed is fast, but it can also help learners quickly understand the true meaning of the teacher's sign language, making learners learn faster and more efficiently, and ensuring the quality of learning.

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments; however, a sign language teaching system and method based on two-dimensional code recognition of the present invention is not limited to the embodiments.

Description of drawings

Fig. 1 is the structural representation of glove of the present invention;

Fig. 2 is a schematic diagram of the installation position of the two-dimensional code scanner of the present invention.

detailed description

Embodiment, please refer to the accompanying drawings, a sign language teaching system based on two-dimensional code recognition of the present invention, including:

Teaching glove 1, the front, back and sides of each fingertip, palm and arm of the glove 1 are respectively provided with a two-dimensional code 2, which is used to refer to the front, back and front of each finger, palm and arm of the teacher. Side; Here, each two-dimensional code 2 can be set on the corresponding part of the glove 1 by printing, or can be set on the corresponding part of the glove 1 by pasting, for example, first print the corresponding two-dimensional code on multiple stickers. QR code, and then tear off each sticker and paste it on the corresponding part of the outer surface of the glove;

Two-dimensional code scanner 3, the two-dimensional code scanner 3 is spliced by multiple scanning heads, and is used to scan and obtain the two-dimensional code information on the glove 1 on the front side or the rear side of the teacher's sign language gesture;

Processor, the processor can be a computer mainframe, which is installed with sign language simulation software, the sign language simulation software has a sign language code library and a text database, the sign language code library stores a large number of simulated hands making sign language gestures, and the text database stores a large number of characters related to various written information that matches the meaning of a sign language;

The display device is used to display the simulated hand and text information corresponding to the teacher's sign language movements; specifically, the display device may be a projector screen.

The two-dimensional code scanner 3 transmits the obtained two-dimensional code 2 information to the processor through a data line or wireless communication (such as Bluetooth, wifi, etc.), and the processor decodes and recognizes the received two-dimensional code 2 , and call out the simulated hand and text information that match the sign language posture of the teacher, and display them through the display device.

As a preference, the two-dimensional codes of various parts on the glove 1 can be coded by using simulated pictures of corresponding parts of the hand. As shown in FIG. 2 , the two-dimensional code scanner 3 is arranged on the chest cloth of a garment 4 that can be worn by a teacher. Alternatively, the two-dimensional code scanner 3 can also be worn on the teacher's chest.

Since the hand shape of the teacher facing the students is opposite to that of the scanner when the teacher is in class, the two-dimensional codes 2 on the front of the glove 1 and the corresponding two-dimensional codes 2 on the back of the glove 1 adopt reverse coding; the glove 1 The two-dimensional code 2 on both sides of the arm part adopts reverse coding. That is, the two-dimensional codes 2 representing the front of the human hand are set on the corresponding positions on the back of the glove 1, the two-dimensional codes 2 representing the back of the human hand are respectively set on the corresponding positions on the front of the glove 1, and the two sides of the arm representing the human hand The two-dimensional code 2 is arranged on both sides of the arm part of the glove 1. For example, the two-dimensional code scanner 3 scans the palm of the hand, and the simulated hand displayed correspondingly is the back of the palm. Since the sides of the palm and each finger are relatively narrow, the corresponding two-dimensional code 2 may not be reverse-coded, and the front and back of the palm and each finger can be obtained by judging the front and back of the side of the arm.

A kind of sign language teaching method based on two-dimensional code recognition of the present invention comprises the following steps:

(1) pre-install the sign language simulation software in the processor, and open the sign language simulation software;

(2) The teacher wears the teaching glove 1, and puts on the clothes 4 with the two-dimensional code scanner 3 on his chest (or wears the two-dimensional code scanner 3 on his chest); Make a sign language action within the scanning range of the two-dimensional code scanner 3 and keep it for two or three seconds. The two-dimensional code scanner scans each two-dimensional code 2 on the glove 1 facing it, and the scanned two-dimensional code 2 transmitted to the processor;

(3) The processor decodes and recognizes the received two-dimensional code, and calls out the simulated hand and text information corresponding to the sign language gesture of the teacher, and displays them on the screen of the projector. At this time, if the text information displayed on the projector screen is multiple groups, indicating that the sign language gesture of the simulated hand has multiple meanings, the teacher orally determines or selects a group of text information that represents the correct meaning by clicking on the mouse;

(4) The teacher continues to make another sign language movement and repeats the above teaching process.

In the sign language teaching system and method based on two-dimensional code recognition of the present invention, each scanning head of the two-dimensional code scanner can be designed as a rotatable structure, so that when scanning, the scanning can be performed by rotating, so that the scanned The three image-finding graphics of the two-dimensional code are in the correct position, and the scanned two-dimensional code and the rotation angle of the scanning head (through which the orientation information of the teacher's palm, arm and each finger can be obtained) are transmitted to the processor. In addition, each scanning head of the two-dimensional code scanner can also be designed as a fixed type, and the process of rotating and obtaining the rotation angle can be completed by the processor, specifically: the processor decodes and recognizes the received two-dimensional code , according to the principle of two-dimensional code scanning, find the specific positions of the three image-finding graphics of the two-dimensional code image, and return their position coordinates, and then judge whether the image needs to be rotated according to the positions of the three image-finding graphics. Rotate the image so that the three image-finding graphics are in the correct position, and obtain the orientation (position) of the teacher's palm, arm and fingers by obtaining the angle value of the image rotation, and give priority to the palm and arm.

A sign language teaching system and method based on two-dimensional code recognition of the present invention can be used to teach the deaf-mute, and the teacher (or teacher) interacts with the deaf-mute through the language "sign language" that communicates with the deaf-mute. Deaf people learn all kinds of knowledge. Alternatively, the present invention can also be used to teach non-deaf-mute people to learn sign language. The teacher can sign a sign language action and cooperate with the simulated hand and text information displayed on the projector screen, so that sign language learners can not only learn sign language, but also Help learners remember the true meaning of sign language.

The above-mentioned embodiments are only used to further illustrate a sign language teaching system and method based on two-dimensional code recognition of the present invention, but the present invention is not limited to the embodiments, and any simple changes made to the above embodiments based on the technical essence of the present invention Modifications, equivalent changes and modifications all fall within the protection scope of the technical solution of the present invention.

Claims (10)

1. a kind of sign language teaching system based on Quick Response Code identification is it is characterised in that include:

Teaching glove, the front of each fingerstall of this glove, reverse side, side are respectively equipped with Quick Response Code, are used for referring to instructor The front of each finger, reverse side and side；The front of the palm part of glove, reverse side and side are respectively equipped with Quick Response Code, use In the front of the palm referring to instructor, reverse side and side；The front at arm position of glove, reverse side, side are respectively equipped with two Dimension code, for referring to front, reverse side and the side of the arm of instructor；

Dimensional code scanner, for the Quick Response Code letter on the front side of instructor's sign language attitude or rear side scanning and acquisition glove Breath；

Processor, is provided with sign language simulation software, and it has sign language code database and lteral data storehouse, and sign language code database is stored with perhaps Make the Simulated hand of sign language attitude, lteral data stock contains the Word message matching with the implication of various sign languages more；

Display device, for showing the Simulated hand corresponding with the sign language action of instructor and Word message；

The 2 D code information getting is transferred to processor by dimensional code scanner, and processor is translated to the Quick Response Code receiving Code and identification, and recall the Simulated hand matching with the sign language attitude of instructor and Word message, shown by display device Come.

2. the sign language teaching system based on Quick Response Code identification according to claim 1 it is characterised in that: on described glove The Quick Response Code at each position is encoded using the simulation drawing of the corresponding site of handss.

3. the sign language teaching system based on Quick Response Code identification according to claim 1 it is characterised in that: described Quick Response Code is swept Retouch the front that device is worn on instructor, or the front cloth being arranged at a medicated clothing that can dress for instructor.

4. the sign language teaching system based on Quick Response Code identification according to claim 3 it is characterised in that: described glove front Each Quick Response Code each Quick Response Code corresponding with its back side using reversion coding；The Quick Response Code of the arm segment both sides of described glove Using reversion coding.

5. the sign language teaching system based on Quick Response Code identification according to claim 1 it is characterised in that: described Quick Response Code is swept Retouch device and the 2 D code information getting is transferred to by described processor by data wire or communication.

6. the sign language teaching system based on Quick Response Code identification according to claim 1 it is characterised in that: described display device For projecting apparatus screen.

7. a kind of sign language teaching method based on Quick Response Code identification it is characterised in that: comprise the steps:

(1) sign language simulation software is installed within a processor in advance, this sign language simulation software has sign language code database and lteral data Storehouse, the sign language code database many that is stored with makes the Simulated hands of sign language attitude, and lteral data stock contains the implication with various sign languages The Word message matching；Open this sign language simulation software；

(2) instructor wears teaching glove, and the front of each fingerstall of this glove, reverse side, side are respectively equipped with Quick Response Code, uses In the front of each finger referring to instructor, reverse side and side；The front of the palm part of glove, reverse side and side set respectively There is Quick Response Code, for referring to front, reverse side and the side of the palm of instructor；The front at arm position of glove, reverse side, side It is respectively equipped with Quick Response Code, for referring to front, reverse side and the side of the arm of instructor；Instructor's sweeping in dimensional code scanner Carry out sign language action, the Quick Response Code on the glove scanning is transferred to processor by dimensional code scanner in the range of retouching；

(3) processor enters row decoding and identification to the Quick Response Code receiving, and recalls corresponding with the sign language attitude of instructor Simulated hand and Word message, are shown by display device.

8. the sign language teaching method based on Quick Response Code identification according to claim 7 it is characterised in that: described step (2) In, the Quick Response Code at each position on described glove is encoded using the simulation drawing of the corresponding site of handss.

9. Quick Response Code according to claim 7 identification sign language teaching method it is characterised in that: in described step (2), institute State the front that dimensional code scanner is worn on instructor, or the front cloth being arranged at a medicated clothing that can dress for instructor.

10. the sign language teaching method based on Quick Response Code identification according to claim 7 it is characterised in that: described step (3) In, described Word message is one or more groups of, if multigroup, is then determined one group of word letter representing correct implication by instructor Breath.