CN210606227U - Augmented reality wears exchange device and augmented reality wears exchange system - Google Patents
Augmented reality wears exchange device and augmented reality wears exchange system Download PDFInfo
- Publication number
- CN210606227U CN210606227U CN201920332672.0U CN201920332672U CN210606227U CN 210606227 U CN210606227 U CN 210606227U CN 201920332672 U CN201920332672 U CN 201920332672U CN 210606227 U CN210606227 U CN 210606227U
- Authority
- CN
- China
- Prior art keywords
- augmented reality
- communication
- database
- expression
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
An augmented reality head-mounted communication device comprising: the augmented reality glasses comprise an augmented reality glasses body and a communication component, wherein the augmented reality glasses body is used for acquiring expression input of a wearer or a communication party; and the communication component is used for converting the expression input into corresponding expression output. Compared with the prior art, the utility model discloses following beneficial effect has: the augmented reality head-mounted communication device and the communication system are provided, are applied to some special application scenes, can well solve the problem of communication obstruction, particularly enhance the communication convenience between common people and special people, and improve the cooperation efficiency in social work; and the equipment is light and convenient to wear and use.
Description
Technical Field
The utility model belongs to intelligence is equipped the field, concretely relates to alternating current device is worn to augmented reality, and this application still relates to an augmented reality wears alternating current system simultaneously.
Background
In daily life work, face-to-face communication between people is an indispensable scene, and for ordinary people, the face-to-face communication is realized through speech, so that the face-to-face communication is normal and convenient. However, for some special people, such as deaf people and people with impaired vision, face-to-face communication can become difficult.
If the deaf people and the deaf people both understand the sign language, the communication can be carried out through the sign language, but the communication can enter into obstacles between the deaf people and the common people or between the deaf people and the deaf people, if one of the deaf people and the deaf people does not understand the sign language. Further, communication between the deaf and the blind is more difficult, one party can present through sign language but the other party cannot see, one party can say but the other party cannot hear, which results in complete interruption of communication. In addition, the communication between different languages is troublesome, translation by means of a mobile phone is needed, and the time is long.
Nowadays, with the development of science and technology, augmented reality technology (augmented reality), gesture motion capture technology, eyeball motion capture technology, voice recognition technology, AI translation technology and the like are more and more mature, and some of the intelligent technologies are applied to real work and life, so that some problems are solved. In the present application, it is expected that some of the existing problems can be solved by applying these techniques to a real-time communication scene, especially to a communication scene between some feature persons.
SUMMERY OF THE UTILITY MODEL
To not enough among the above prior art, the utility model provides an alternating current system is worn to augmented reality head-mounted device and augmented reality has solved some obstacles in present special crowd's alternating current process through the assistance of technologies such as augmented reality technique, motion capture, speech recognition, character recognition, AI translation, makes information can effectively flow.
In order to solve the above technical problem, the present invention solves the above technical problems.
An augmented reality head-mounted communication device comprising: the augmented reality glasses comprise an augmented reality glasses body and a communication component, wherein the augmented reality glasses body is used for acquiring expression input of a wearer or a communication party; and the communication component is used for converting the expression input into corresponding expression output.
The wear-type communication device based on augmented reality technology in this application is applicable to the communication appurtenance under some special scenes. For example, when two people in different countries with different languages communicate, the augmented reality glasses body can acquire language information and express the language information after translation, so that the two parties communicate; for another example, when the deaf-mute communicates with the normal person, the augmented reality glasses body can obtain sign language information of the deaf-mute, and the sign language information is expressed by voice or characters after being translated; for another example, the augmented reality glasses main body can also acquire lip language information and translate the lip language information into voice or characters to be expressed.
Preferably, the augmented reality eyeglass body includes: one or more of voice input device (such as microphone), lip-type input device (such as camera), gesture input device (such as gesture camera), and text input device; the voice input device is used for acquiring voice information of the wearer or the communication party; the voice input device is used for acquiring voice information of the wearer or the communication party; the lip-shaped input device is used for acquiring lip language information of the wearer or the communication party; the gesture input device is used for acquiring sign language information of the wearer or the communication party; the character input device is used for acquiring character input information of the wearer or the communication party.
Preferably, the gesture input device includes: gesture perception camera and/or wisdom gloves. The gesture sensing camera can recognize corresponding sign language information by capturing the actions of hands of people; after the intelligent glove is worn on the hand of a person, the sign language action of the hand can be sensed, and corresponding sign language information is recognized.
Preferably, the character input device includes: one or more of a camera, a head aiming control component, an eye movement tracking control component and a control handle. In the structure, the camera is used for directly identifying character information, the head aiming control component and the eye movement tracking control component are used for performing character input operation through head movement and eyeball movement, and the control handle can select corresponding characters or information.
Preferably, the communication means includes: one or more of an outward display, an outward LED rolling display screen, a loudspeaker and a simulation manipulator; the outward display is positioned at the upper part of the augmented reality glasses main body, faces outwards, and is used for displaying communication information outwards, and the communication information can be information such as characters, letters, expressions, signs and the like; the outward LED rolling display screen is positioned at the upper part (close to the forehead of a wearer) of the augmented reality glasses main body, faces outwards, is used for displaying flowing communication information outwards, and is suitable for a billboard which is similar to character rolling when a large segment of character information needs to be output; the loudspeaker is positioned on the augmented reality glasses main body and used for playing voice, and if sign language information is 'translated', the sign language information is played through the voice; simulation manipulator is located on the augmented reality glasses main part, the orientation is external for outwards make the gesture, if show speech information through sign language.
Preferably, the augmented reality head-mounted communication device further comprises a communication chip; the communication chip is used for mutually transmitting information with network equipment, and the communication chip is used for uploading the acquired expression input information or downloading a corresponding output instruction.
Preferably, the device further comprises a memory for storing the communication database; and the communication database is used for identifying the expression meaning of the expression input and converting the expression meaning into a corresponding output instruction.
Preferably, the exchange database includes: one or more of voice databases of different countries/regions, lip language databases of different countries/regions, character databases of different countries/regions and hand language databases of different countries/regions can be adapted to various special communication scenes.
Preferably, the augmented reality head-mounted communication device further includes: CPU, GPU, MEM, HDD, I/O device, and communication chip. The CPU is equivalent to the brain of a computer and carries out overall planning and operation; the GPU is connected with each camera and is equivalent to the eyes of a computer, and the three-dimensional world is identified; MEM is a semiconductor device that assists the CPU in performing calculations; the HDD corresponds to a memory of a computer and is used as a storage function. The I/O device and the communication chip are used for wireless/wired communication.
An augmented reality head-mounted communication system comprising: the system comprises network equipment and an augmented reality head-mounted communication device; the augmented reality head-mounted communication device is used for transmitting the expression input of a wearer or a communication party to the network equipment; the network equipment is used for feeding back the corresponding output instruction after the expression input conversion to the augmented reality head-mounted communication device; the augmented reality head-mounted communication device is provided with a communication component, and the communication component is used for converting the corresponding output instruction into corresponding expression output. In the structure, information conversion among different communication means is placed in a cloud end/a server/a processing terminal, and the portability of the head-mounted equipment is ensured.
Preferably, the network device is configured to store a communication database, and the communication database includes: one or more of voice databases of different countries/regions, lip language databases of different countries/regions, character databases of different countries/regions and hand language databases of different countries/regions can be adapted to various special communication scenes.
Compared with the prior art, the utility model discloses following beneficial effect has: the augmented reality head-mounted communication device and the communication system are provided, are applied to some special application scenes, can well solve the problem of communication obstruction, particularly enhance the communication convenience between common people and special people, and improve the cooperation efficiency in social work; and the equipment is light and convenient to wear and use.
Drawings
Fig. 1 is a perspective view of the augmented reality head-mounted communication device of the present invention.
Fig. 2 is a side view of the augmented reality head-mounted communication device of the present invention.
Fig. 3 is a first schematic view of a scene in which an augmented reality headset is used for communication.
Fig. 4 is a schematic view of a scene two in which the augmented reality headset communication device is used for communication.
Fig. 5 is a third schematic view of a scene of communication using an augmented reality headset communication device.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
The embodiments described below by referring to the drawings are exemplary only for explaining the present invention and are not construed as limiting the present invention, in which the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout.
In the description of the present invention, it should be understood that the term: the center, vertically, transversely, length, width, thickness, upper and lower, preceding, back, left and right, vertical, level, top, end, inside and outside, clockwise, anticlockwise etc. indicate position or positional relationship for based on the position or positional relationship that the drawing shows, just for the convenience of description the utility model discloses and simplified description, consequently can not be understood as the restriction of the utility model. Furthermore, the terms: first, second, etc. are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features shown. In the description of the present invention, unless explicitly stated or limited otherwise, the terms: mounting, connecting, etc. should be understood broadly, and those skilled in the art will understand the specific meaning of the terms in this application as they pertain to the particular situation.
Referring to fig. 1 to 5, an augmented reality head-mounted communication device according to the present application includes: the augmented reality glasses comprise an augmented reality glasses body and a communication component, wherein the augmented reality glasses body is used for acquiring expression input of a wearer or a communication party; and the communication component is used for converting the expression input into corresponding expression output.
Specifically, as can be seen from fig. 1 and 2, the augmented reality glasses main body includes a glasses frame 1 and glasses lenses 2, and further includes: the glasses comprise one or more of a voice input device (such as a microphone 5), a lip-shaped input device (such as a camera 6), a gesture input device (such as a gesture camera 4) and a character input device, wherein the microphone 5 is arranged on the human face accessory through a connecting piece, the camera 6 is arranged at the upper central end of the spectacle lens 2 in a conventional installation mode, and the gesture camera 4 is arranged at the side part of the augmented reality glasses main body.
In the above structure, the lip-shaped input device is configured to acquire lip language information of the wearer or the communication party; the gesture input device is used for acquiring sign language information of the wearer or the communication party; the character input device is used for acquiring character input information of the wearer or the communication party, and the character input device can be a handwriting board, a keyboard, a virtual keyboard, an eyeball dynamic capture device and the like. In addition, the gesture input can also be intelligent gloves, and after the gloves are sleeved on the hands, corresponding sign language operation can be recognized along with the gesture change of the motion perception of the hands. The character input device includes: one or more of a camera, a head aiming control component, an eye movement tracking control component and a control handle.
In the present application, the communication part includes: one or more of an outward display, an outward LED rolling display screen 7, a loudspeaker and a simulation manipulator; the outward display 7 is located at the upper part of the augmented reality glasses main body, faces outward and is used for displaying communication information outward; the outward LED rolling display screen is positioned at the upper part (close to the forehead of the wearer) of the augmented reality glasses main body, faces outwards and is used for displaying flowing communication information outwards (the outward display and the outward LED rolling display screen can be a screen); the loudspeaker is positioned on the augmented reality glasses main body and used for playing voice; simulation manipulator is located on the augmented reality glasses main part, the orientation is external for outwards make the gesture, be applicable to no arm deaf personage and carry out sign language and communicate.
The augmented reality head-mounted communication device further comprises a memory, wherein the memory is used for storing a communication database; and the communication database is used for identifying the expression meaning of the expression input and converting the expression meaning into a corresponding output instruction. The exchange database includes: one or more of voice databases of different countries/regions, lip language databases of different countries/regions, character databases of different countries/regions, and hand language databases of different countries/regions. The augmented reality head-mounted communication device further comprises: CPU, GPU, MEM, HDD, I/O device, and communication chip. The CPU is equivalent to the brain of a computer and carries out overall planning and operation; the GPU is connected with each camera and is equivalent to the eyes of a computer, and the three-dimensional world is identified; MEM is a semiconductor device that assists the CPU in performing calculations; the HDD corresponds to a memory of a computer and is used as a storage function. The I/O device and the communication chip are used for wireless/wired communication.
Furthermore, the utility model discloses in still relate to an augmented reality wears alternating current system, include: the system comprises network equipment and an augmented reality head-mounted communication device; the augmented reality head-mounted communication device is used for transmitting the expression input of a wearer or a communication party to the network equipment; the network equipment is used for feeding back the corresponding output instruction after the expression input conversion to the augmented reality head-mounted communication device; the augmented reality head-mounted communication device is provided with a communication component, and the communication component is used for converting the corresponding output instruction into corresponding expression output. The network device is configured to store an exchange database, the exchange database including: one or more of voice databases of different countries/regions, lip language databases of different countries/regions, character databases of different countries/regions, and hand language databases of different countries/regions.
The present application will be described in detail with reference to specific examples.
Example one
Can refer to attached figure 1 and attached figure 2, when ordinary people and the deaf person communicate, the deaf person takes the augmented reality head to wear communication device, the deaf person makes sign language, the posture of sign language is recorded and is passed to processing center and carry out the analysis by gesture camera 4, processing center compares the sign language gesture of record with the hand language database of storage in equipment, analyze out the meaning of this sign language, and show this meaning on to display 7 with the form of characters, supply the other side to look over, microphone 5 collects the speech information of other side simultaneously, change this speech information into characters, show on augmented reality head wears communication device's lens 2 (augmented reality display device), supply the deaf person to look over, based on above process, can carry out the communication between ordinary people and the deaf person. Simultaneously, microphone 5 also can collect the sound information in the surrounding environment, changes this speech information into the characters, shows on augmented reality wears communicator's lens 2 (augmented reality display device), supplies deaf personnel to look over.
Example two
When a common person communicates with the blind person, the blind person wears the augmented reality head-wearing communication device, and the blind person speaks, can hear, speaks and can also hear. When a common person shows the text materials to the blind, the camera 6 shoots the text materials, converts the text materials into voice and plays the voice to the blind for listening through the earphone 3. In addition, when the blind person goes out alone and encounters a road sign, a store name and a notice, the camera 6 can shoot the text material, convert the text material into voice and play the voice to the blind person through the earphone 3.
EXAMPLE III
Can refer to fig. 3, when the blind person and deaf personnel communicate, both sides take augmented reality to wear AC device, the deaf people makes sign language, the posture of sign language is recorded and is passed to processing center by gesture camera 4 and carry out the analysis, processing center compares the sign language gesture of record with the sign language database of storage in equipment, analyze out the meaning of this sign language, and show this meaning on outward display 7 with the form of characters, this word material is shot to camera 6 on blind person's augmented reality wears AC device, convert it into pronunciation, play for the blind person through earphone 3 and listen.
Example four
Can refer to fig. 3, when the blind person and deaf personnel communicate, both sides were taken augmented reality and are worn exchange device, and the deaf person makes sign language, and the gesture of sign language is by gesture camera 4 record and reach processing center and carry out the analysis, and processing center compares the sign language gesture of record with the sign language database of storage in equipment, analyzes out the meaning of this sign language to directly play out (through playing loudspeaker outward) the form of this meaning pronunciation, supply the blind person to listen.
EXAMPLE five
Referring to fig. 3, when the blind person communicates with the blind person, the blind person wears the augmented reality head-mounted communication device, and the blind person speaks and can hear and communicate with each other. When the characters need to be displayed among each other, the camera 6 shoots the characters, converts the characters into voice and plays the voice to the blind person for listening through the earphone 3.
EXAMPLE six
When ordinary people and deaf people communicate, the deaf people takes the augmented reality to wear exchange device, and the deaf people makes sign language, and the gesture of sign language is recorded by gesture camera 4 and is passed to processing center and carry out the analysis, and processing center compares the sign language gesture of record with the sign language database of storage in equipment, analyzes out the meaning of this sign language to show this meaning with the form of characters on to display 7, supply the other side to look over. Simultaneously, the camera 6 shoots the lip gesture when the other party speaks, and the lip gesture is transmitted to the processing center for analysis, the processing center compares the recorded lip gesture with a lip language database stored in the equipment, the meaning of the lip language is analyzed, and the meaning is displayed on the spectacle lens 2 (augmented reality display device) of the augmented reality head-mounted communication device in a text form for the deaf person to check.
EXAMPLE seven
When two ordinary people with different languages communicate, the augmented reality head-mounted communication device is worn, the microphone 5 collects voice information of the other party, the voice information is converted into a familiar language after translation, the familiar language is played in the earphone 3, and real-time translation communication between the two parties can be achieved.
In the above embodiment, the mirror holder 1 of the augmented reality head-mounted communication device is provided with the battery module for supplying power, and is also provided with the processing center for processing information, and meanwhile, a certain number of buttons/touch keys can be set as required to realize operations such as volume adjustment and power on/off. The augmented reality head-mounted communication device is in communication connection with the outside through the Bluetooth, wifi, GSM, 4G, 5G and other prior art. In addition, in the above embodiments, the data content may be stored in a memory in the glasses body, or may be stored on a server, and the connection may be realized through a network. The angle a in fig. 3-5 is the capture range of the gesture camera 4, which is just the area where the human hands do the motion.
The augmented reality head-mounted communication device (and system) is a beneficial medium for communication whether the device is worn by normal people, deaf and disabled people or blind and disabled people, and is used for communication with normal people (language translation scheme), deaf and disabled people (sign language translation scheme), deaf and disabled people (lip reading translation scheme) or blind and disabled people (voice translation scheme). Although the embodiments are not described in the specification, the augmented reality head-mounted communication device (and system) can assist both parties in communication. Even if both sides wear the communication device, smooth communication between both sides is facilitated.
In the above, the utility model provides an augmented reality head-mounted communication device and communication system, which are applied to some special application scenes, can solve the problem of communication obstruction well, especially enhance the communication convenience between the ordinary people and the special people, and improve the cooperation efficiency in social work; and the equipment is light and convenient to wear and use.
The protection scope of the present invention includes but is not limited to the above embodiments, the protection scope of the present invention is subject to the claims, and any replacement, deformation, and improvement that can be easily conceived by those skilled in the art made by the present technology all fall into the protection scope of the present invention.
Claims (9)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201920332672.0U CN210606227U (en) | 2019-03-16 | 2019-03-16 | Augmented reality wears exchange device and augmented reality wears exchange system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201920332672.0U CN210606227U (en) | 2019-03-16 | 2019-03-16 | Augmented reality wears exchange device and augmented reality wears exchange system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN210606227U true CN210606227U (en) | 2020-05-22 |
Family
ID=70696349
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201920332672.0U Active CN210606227U (en) | 2019-03-16 | 2019-03-16 | Augmented reality wears exchange device and augmented reality wears exchange system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN210606227U (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024110791A1 (en) | 2022-11-22 | 2024-05-30 | Sangireddy Sisirnath | A method for enabling quality of learning, communication, and a cognitive support system for user interaction using a mixed reality device |
-
2019
- 2019-03-16 CN CN201920332672.0U patent/CN210606227U/en active Active
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024110791A1 (en) | 2022-11-22 | 2024-05-30 | Sangireddy Sisirnath | A method for enabling quality of learning, communication, and a cognitive support system for user interaction using a mixed reality device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN210166754U (en) | A virtual reality head-mounted communication device and a virtual reality head-mounted communication system | |
| US11030917B2 (en) | Wearable apparatus and method for monitoring posture | |
| CN101890719B (en) | Robot remote control device and robot system | |
| JP6361649B2 (en) | Information processing apparatus, notification state control method, and program | |
| CN104615243A (en) | Head-wearable type multi-channel interaction system and multi-channel interaction method | |
| CN109857262A (en) | A kind of intelligent AC device and intelligent AC apparatus system and communication method | |
| US10983591B1 (en) | Eye rank | |
| CN107533375A (en) | scene image analysis module | |
| CN103853071A (en) | Human-computer facial expression interaction system based on biological signal | |
| CN205620608U (en) | Head -mounted electronic equipment | |
| CN206178272U (en) | External multi -lingual smart machine of glasses | |
| JP7066115B2 (en) | Public speaking support device and program | |
| US20230325002A1 (en) | Techniques for neuromuscular-signal-based detection of in-air hand gestures for text production and modification, and systems, wearable devices, and methods for using these techniques | |
| CN210109744U (en) | Head-mounted alternating current device and head-mounted alternating current system | |
| CN105892627A (en) | Virtual augmented reality method and apparatus, and eyeglass or helmet using same | |
| CN106527678B (en) | A kind of social interactive device, system and the head-mounted display apparatus of mixed reality | |
| Chen et al. | Lisee: A headphone that provides all-day assistance for blind and low-vision users to reach surrounding objects | |
| CN107608513B (en) | Wearable device and data processing method | |
| CN210606227U (en) | Augmented reality wears exchange device and augmented reality wears exchange system | |
| Jafri et al. | Exploring the potential of eyewear-based wearable display devices for use by the visually impaired | |
| WO2022100358A1 (en) | Portable smart glasses based on multi-modal learning analysis | |
| CN215529127U (en) | Intelligent wearable device with visual impairment person auxiliary function | |
| US11823498B1 (en) | Systems and methods for hand pose estimation from video | |
| CN209514551U (en) | A kind of intelligent AC robot and AC system | |
| US20220311979A1 (en) | Wearable apparatus for projecting information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240722 Address after: No. 50 East Street, Zhongzhao Township, Neihuang County, Anyang City, Henan Province 455000 Patentee after: Anyang Yingrun Information Technology Service Center (sole proprietorship) Country or region after: China Address before: 201609 1st Floor, Yiwang Road, Yexie Town, Songjiang District, Shanghai Patentee before: SHANGHAI CUITAI INTELLIGENT TECHNOLOGY Co.,Ltd. Country or region before: China |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20241126 Address after: No. 361 East Street, Zhongzhao Township, Neihuang County, Anyang City, Henan Province 455000 Patentee after: Anyang Guangen Technology Service Co.,Ltd. Country or region after: China Address before: No. 50 East Street, Zhongzhao Township, Neihuang County, Anyang City, Henan Province 455000 Patentee before: Anyang Yingrun Information Technology Service Center (sole proprietorship) Country or region before: China |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20250620 Address after: 518000 Guangdong Province Shenzhen City Longhua District Heping Road Room 110, No. 410 China Patentee after: Pu Jingchao Country or region after: China Address before: No. 361 East Street, Zhongzhao Township, Neihuang County, Anyang City, Henan Province 455000 Patentee before: Anyang Guangen Technology Service Co.,Ltd. Country or region before: China |
|
| TR01 | Transfer of patent right |
Effective date of registration: 20250627 Address after: 518000 A2806, Block A, Longguang Jiuzuan Business Center, Tenglong Road, Daling Community, Minzhi Street, Longhua District, Shenzhen City, Guangdong Province Patentee after: Chuangmao Technology (Shenzhen) Group Co.,Ltd. Country or region after: China Address before: 518000 Guangdong Province Shenzhen City Longhua District Heping Road Room 110, No. 410 China Patentee before: Pu Jingchao Country or region before: China |