CN111526083B - Method, device, system and storage medium for instant messaging through head action - Google Patents
Method, device, system and storage medium for instant messaging through head action Download PDFInfo
- Publication number
- CN111526083B CN111526083B CN202010296819.2A CN202010296819A CN111526083B CN 111526083 B CN111526083 B CN 111526083B CN 202010296819 A CN202010296819 A CN 202010296819A CN 111526083 B CN111526083 B CN 111526083B
- Authority
- CN
- China
- Prior art keywords
- head
- user
- action
- recording
- instant messaging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
- H04L51/10—Multimedia information
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method, a device, a system and a storage medium for instant messaging through head actions. The method establishes a corresponding relation between a specific head action and a specific contact person, and after a user wears the head wearable device, the head action of the user can be identified through a sensor arranged in the head wearable device, so that the contact person corresponding to the head action is selected, voice is recorded, and an instant message generated by the voice is sent to the specific contact person through an instant messaging service, so that the action of separating from a hand is realized, and the function of selecting the contact person and carrying out instant messaging can be realized. Therefore, the user can free hands to carry out other work while carrying out instant messaging, the working efficiency is greatly improved, and the application scene of the instant messaging is further expanded.
Description
Technical Field
The invention relates to the field of wearable equipment, in particular to a method, a device, a system and a storage medium for instant messaging through head actions.
Background
Instant Message (IM) refers to a service capable of instantly transmitting and receiving messages through the internet or a mobile communication network. With the continuous progress and development of communication technology and internet technology, the application of instant messaging is becoming more and more extensive, and gradually develops into a comprehensive information platform integrating communication, information, entertainment, search, e-commerce, office collaboration, enterprise customer service and the like.
When instant messaging is performed, a communication object is selected first, and the communication object may be a certain contact or a certain group. Currently, most technical communication software and application programs select contacts by hand, for example, selecting contacts by operating a keyboard and a mouse with a hand point or by hand. With the increasing pace of work and life, the willingness of people to improve the work efficiency is stronger, and under certain scenes, people hope to free hands from doing other things when carrying out instant messaging. In addition, in some special scenes, for example, when a car is driven, safe driving can be affected if the car is frequently operated by hands, and potential safety hazards are caused.
Therefore, how to select the contact by the operation of disengaging the hand is a technical problem to be solved urgently.
Disclosure of Invention
In view of the above problems, embodiments of the present invention creatively provide a method, apparatus, system and storage medium for instant messaging through head movements.
According to a first aspect of the embodiments of the present invention, a method for instant messaging through head movements is applied to a head wearable device, and includes: identifying, by a sensor in a head-wearable device, a head action of a user; acquiring a user intention corresponding to the head action according to the head action; and executing corresponding operation according to the user intention, wherein if the user intention is the selected contact, acquiring a contact identifier corresponding to the head action, prompting the user to speak and start recording, if the user intention is that the speaking is finished at the current time, stopping recording, generating an instant message according to the recording content, and sending the contact identifier and the instant message.
According to an embodiment of the present invention, before the head action of the user is recognized by the sensor in the head wearable device, the method further includes: whether the wearable head device works normally is detected, if so, the next operation is continued, and if not, the user device is prompted to break down.
According to an embodiment of the present invention, before the head action of the user is recognized by the sensor in the head wearable device, the method further includes: acquiring data required by a sensor for recognizing head movements in a teaching mode; acquiring a contact person identifier; and establishing a corresponding relation between the head action and the contact person identification.
According to an embodiment of the present invention, acquiring data required by a sensor to recognize a head movement in a taught manner includes: displaying a demonstration action of the preset head action; recording relevant data of the sensor when the user performs the demonstration action; and establishing a corresponding relation between the preset head action and the related data.
According to an embodiment of the present invention, the preset head actions include raising the head, lowering the head, turning the head left, turning the head right, and looking front at the head.
According to an embodiment of the present invention, the acquiring data required by the sensor to recognize the head movement in a teaching manner further includes: prompting a user to make a custom head action; when a user performs a user-defined head action, recording related data of the sensor; and establishing a corresponding relation between the custom head action and the related data.
According to an embodiment of the present invention, before stopping recording, the method further includes: again a user prompt is given to indicate that the recording is finished and that an instant message is about to be sent.
According to an embodiment of the present invention, before generating the instant message according to the recorded content, the method further includes: and detecting whether the effective duration of the recording content is greater than a duration threshold, if so, continuing the next operation, and if not, ending the operation.
According to an embodiment of the present invention, the method further includes: and receiving a reply message returned by the contact.
According to an embodiment of the present invention, the method further includes: the instant message and the reply message are saved.
According to a second aspect of embodiments of the present invention, an apparatus for instant messaging through head movements, the apparatus comprising: the head action recognition module is used for recognizing the head action of the user through a sensor in the head wearable device; the user intention acquisition module is used for acquiring a user intention corresponding to the head action according to the head action; and the operation execution module is used for executing corresponding operation according to the intention of the user, wherein if the intention of the user is the selected contact, the contact identification corresponding to the head action is obtained, the user is prompted to speak and start recording, if the intention of the user is that the speaking is finished at the current time, the recording is stopped, the instant message is generated according to the recording content, and the contact identification and the instant message are sent.
According to an embodiment of the present invention, the apparatus further includes: and the equipment detection module is used for detecting whether the head wearable equipment works normally, if so, continuing the next operation, and if not, prompting the user equipment to break down.
According to an embodiment of the present invention, the apparatus further includes: the teaching module is used for acquiring data required by the sensor for recognizing the head action in a teaching mode; the contact person identification acquisition module is used for acquiring contact person identifications; and the contact person corresponding relation establishing module is used for establishing the corresponding relation between the head action and the contact person identification.
According to an embodiment of the present invention, the teaching module includes: a demonstration motion display unit for displaying demonstration motions of preset head motions; the data recording unit is used for recording relevant data of the sensor when a user performs demonstration action; and the head action corresponding relation establishing module is used for establishing the corresponding relation between the preset head action and the related data.
According to an embodiment of the present invention, the teaching module further includes: the user prompting unit is used for prompting a user to make a user-defined head action; the data recording unit is also used for recording related data of the sensor when a user performs a user-defined head action; the head action corresponding relation establishing unit is also used for establishing the corresponding relation between the user-defined head action and the related data.
According to an embodiment of the present invention, the operation executing module is further configured to give a user prompt again to indicate that the recording is finished and the instant message is about to be sent.
According to an embodiment of the present invention, the apparatus further includes a recording content detection module, configured to detect whether an effective duration of the recording content is greater than a duration threshold, if so, continue a next operation, and if not, end the operation.
According to an embodiment of the present invention, the apparatus further includes a receiving module, configured to receive a reply message returned by the contact.
According to an embodiment of the present invention, the apparatus further includes a message saving module, configured to save the instant message and the reply message.
According to a third aspect of embodiments of the present invention, there is provided a system for instant messaging through head movements, the system including: the head wearable device is used for executing the method for timely communication through head actions to select contacts and send instant messages; and the instant messaging service module is used for receiving the contact person identification and the instant message sent by the head wearable device and sending the instant message to the contact person.
According to an embodiment of the present invention, the system further includes an electronic device connected to the head wearable device, and a designated application program is installed on the electronic device, and the application program is configured to acquire data required by the sensor to recognize the head movement in a teaching manner.
According to a fourth aspect of embodiments of the present invention, there is provided a computer storage medium comprising a set of computer executable instructions which, when executed, perform any of the above methods for instant messaging through header actions.
The invention discloses a method, a device, a system and a storage medium for instant messaging through head actions. The method establishes a corresponding relation between a specific head action and a specific contact person, and after a user wears the head wearable device, the head action of the user can be identified through a sensor arranged in the head wearable device, so that the contact person corresponding to the head action is selected, voice is recorded, and an instant message generated by the voice is sent to the specific contact person through an instant messaging service, so that the action of separating from a hand is realized, and the function of selecting the contact person and carrying out instant messaging can be realized. Therefore, the user can free hands to carry out other work while carrying out instant messaging, the working efficiency is greatly improved, and the application scene of the instant messaging is further expanded.
It is to be understood that the teachings of the present invention need not achieve all of the above advantages, but rather that specific embodiments may achieve specific technical effects, and that other embodiments of the present invention may achieve other advantages not mentioned above.
Drawings
The above and other objects, features and advantages of exemplary embodiments of the present invention will become readily apparent from the following detailed description read in conjunction with the accompanying drawings. Several embodiments of the invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:
in the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.
FIG. 1 is a schematic view of an application scenario of the method of instant messaging through head movement according to the embodiment of the present invention;
FIG. 2 is a schematic flow chart illustrating an implementation of a method for instant messaging through head movement according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating preset header actions according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a device for instant messaging through head movement according to an embodiment of the present invention.
Detailed Description
In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means two or more unless specifically defined otherwise.
An application scenario of the method for instant messaging through head movement according to the embodiment of the present invention is described below with reference to fig. 1. In this scenario, the user 20 cannot use the electronic device 10 (e.g., a mobile phone) for instant messaging for various reasons, but the user 20 has completed the teaching process of the head movement through the application installed on the electronic device 10, and at this time, the user 20 wants to perform instant messaging through the head movement. First, the user 20 needs to wear the head-wearable device 30 on the head and turn on the head-wearable device 30. The head wearable device 30 mainly includes: a sensor 301, such as a gyroscope, a velocity sensor, and/or a gravity sensor, for sensing head movements of the user 20; a communication module 302, configured to establish a communication connection through bluetooth or a wireless network, and send and receive data; the main control module 303 is used for controlling the process, and summarizing, processing, converting and the like various data; the feedback module 304 is used for performing voice prompt for the user, receiving voice input of the user, feeding back an operation result and the like, such as an earphone. The head wearable device 30, when turned on, detects whether or not the respective components are connected and can function normally. When the detection is completed and all is normal, the head-wearable device 30 will give a prompt to the user through the feedback module 304, for example, "the device has completed starting, and each module is working normally, please send out an instruction. The user 20 can make various head movements for instant messaging. In a general scenario, the user 20 first performs a specific head action to designate a contact, where the head action is a specific predefined action to complete the teaching process, such as head left turn, head right turn, head front view, head up and head down, and the contact may be a certain person or a certain group. Assuming that the user 20 wants to make a tee call, the head motion corresponding to "zhang san" is "head left turn", so the user 20 makes a head left turn, at this time, the sensor 301 senses the motion of the user 20 and sends related data generated when the user makes the "head left turn" to the main control module 303, taking a gyroscope as an example, mainly including a self-rotation angular velocity, a precession angular velocity, and the like, and the main control module 303 recognizes the head motion made by the user at this time as "head left turn" according to the related data stored in the teaching process. Next, the main control module 303 searches a corresponding table of the head action and the contact person established in the teaching process, finds a contact person identifier "zhang san" corresponding to the head action "head turn left", and then sends a prompt voice to the user 20: "three contacts have been found, please begin speaking. And starting the recording function to start recording. The user 20 speaks the content to be transmitted and sends the voice to the main control module 303 through the feedback module 304. After the present speech, the user 20 returns the head to the front-looking head movement. At this time, the sensor 301 senses the motion and transmits the relevant data generated when the user 20 performs the motion of "head looking forward" to the main control module 303. The main control module 303 recognizes the head movement made by the user at this time as "head front view" from the relevant data stored in the teaching process. Then, the main control module 303 ends the recording, converts the recording content into an instant message, and then transmits the contact identifier "zhang san" and the instant message to the communication module 302. The communication module 302 sends the contact identification "zhang san" and the instant message to the instant communication service 40 through TCP/IP protocol data transmission. The instant messaging service 40 is deployed in the cloud and is mainly responsible for receiving and forwarding instant messages of users. The instant messaging service 40, upon receiving the contact identification "zhang" and the instant message, sends the instant message to "zhang". Thus, the user 20 completes an instant messaging through the head action instant messaging method according to the embodiment of the present invention.
In addition, after receiving the response of zhangsan, the electronic device 10 may further establish a connection with the feedback module 304 through a bluetooth data link, and send the response of zhangsan to the feedback module 304, so that zhangsan can receive the response message of zhangsan in time.
It should be noted that the above application scenario is only a certain application example of the embodiment of the present invention, and does not limit that the embodiment of the present invention can only be applied to the above scenario.
Fig. 2 shows a flow of implementing the method of instant messaging through head gestures according to the embodiment of the present invention. Referring to fig. 2, the method is applied to a head wearable device, including: an operation 210 of recognizing, by a sensor in a head-wearable device, a head motion of a user; operation 220, obtaining a user intention corresponding to the head action according to the head action; and operation 230, executing corresponding operation according to the user intention, wherein if the user intention is to select a contact, the contact identifier corresponding to the head action is obtained, the user is prompted to speak and start recording, if the user intention is that the speaking is finished at this time, the recording is stopped, an instant message is generated according to the recording content, and the contact identifier and the instant message are sent.
In operation 210, the sensor is typically built in the head wearable device, and mainly refers to a sensor that can sense the head motion of the user, such as a gyroscope, a speed sensor, and/or a gravity sensor. Taking a gyroscope as an example, the sensor is an angular motion detection device which uses a momentum moment sensitive shell of a high-speed revolving body relative to an inertia space around a plurality of axes orthogonal to a rotation axis, and can accurately determine the orientation of a moving object and transmit related data. The head wearable device herein refers to a smart wearable device wearable on the head, such as a smart helmet, a smart headband, a smart hat, and the like. The main control module is usually a part of the head wearable device, such as a microchip or a processor, and after receiving the related data sent by the sensor, the head action performed by the user can be recognized through analysis and comparison.
In operation 220, the user intent corresponding to the head action is predefined good, for example, head left turn represents finding contact three and initiating a conversation; the head front view represents that the speaking is finished and a message is sent. The correspondence between the head action and the user's intention is usually pre-established and stored in a local correspondence table for easy query at any time.
In operation 230, after the user's intention is recognized, the following operations may be performed according to the user's intention. Here, the identifier of the contact is also found through the pre-established correspondence between the head action and the contact, and the correspondence between the head action and the contact is also usually stored in a local correspondence table so as to be queried at any time. Prompting the user to speak is accomplished by communicating the prompt to the user through a feedback module of the head wearable device, such as a speaker or headset. The prompt may be in the form of a brief prompt or a semantic segment of speech. The recording function may be implemented by a feedback module of the head wearable device, such as a headset or a microphone, to collect voice input of the user and by a recording unit of the main control module. When the instant message is generated according to the recorded content, any form of instant message may be generated, for example, a voice message is directly generated through simple denoising, or the recorded content is converted into a text message through a voice conversion tool, and the like. After obtaining the contact identification and generating the instant message, the contact identification and the instant message may be sent to an instant messaging service. The instant messaging service can be an instant messaging service realized by the user, and an instant messaging service provided by a third party can also be used. And this instant messaging service is also an instant messaging service that initially establishes the contact and is used for instant messaging with the contact. The communication service stores contact identification and a communication channel required for sending instant messages to the contacts, and the instant messages can be sent to the communication devices of the contacts.
According to an embodiment of the present invention, before the head action of the user is recognized by the sensor in the head wearable device, the method further includes: whether the wearable head device works normally is detected, if so, the next operation is continued, and if not, the user device is prompted to break down.
Typically, this detection is performed when the head-wearable device is activated, and conventional detection means are used to ensure that the various components of the head-wearable device are functioning properly. If it is found that the device is not connected or fails the functional test, feedback to the user may be provided through a feedback module of the head wearable device, e.g., a speaker or a headset, to facilitate the user in checking and adjusting the device to enable the device to function properly.
According to an embodiment of the present invention, before the head action of the user is recognized by the sensor in the head wearable device, the method further includes: acquiring data required by a sensor for recognizing head movements in a teaching mode; acquiring a contact person identifier; and establishing a corresponding relation between the head action and the contact person identification.
Generally, when each person makes a specific head action, the action amplitude or force is different due to individual differences such as personal habits or head shapes, and in order to more accurately recognize the head action of the user, some data which can be used for assisting the internal sensor to recognize the head action of the user can be acquired in a teaching mode. The teaching process can also be used to establish the correspondence between contact identification and head movement. In order to establish the corresponding relationship between the contact person identifier and the head action, the contact person identifier needs to be acquired first. And the way of acquiring the contact identification may be: reading a contact list of a user, and designating a certain contact by the user; the name of the contact person can be input by the user for searching and confirmed by the user; or even be obtained in various ways, such as by user input followed by authentication. The corresponding relation between the head action and the contact person identification is specified by the user, and a corresponding table is formed and stored in the wearable device. The correspondence table may adopt any data structure capable of representing correspondence, for example, a two-bit array, a hash table, a database table, etc., and may even be a configuration information table in a configuration system. The implementer can select a proper data structure to store the corresponding relation between the contact person identification and the head action according to the practical situation and the convenience degree. The teaching process is usually completed through an application program installed on the electronic device, and the electronic device mainly refers to electronic devices such as a mobile phone and a tablet personal computer which are commonly used for performing instant messaging, so that on one hand, a contact identification can be conveniently acquired, and on the other hand, interaction with a user can be performed through a screen of the electronic device. However, the method of instant messaging through head movements in the embodiments of the present invention does not limit the teaching manner, and any implementation manner that can prompt the user to make a corresponding movement, obtain a contact person, and establish a correspondence between the head movements and the contact person is possible. For example, the user may be prompted by voice to make a particular action, obtain a contact list over a network connection, and so on.
According to an embodiment of the present invention, acquiring data required by a sensor to recognize a head movement in a taught manner includes: displaying a demonstration action of the preset head action; recording relevant data of the sensor when the user performs the demonstration action; and establishing a corresponding relation between the preset head action and the related data.
In this embodiment, the system is pre-configured with some head movements, and the exemplary movements may be displayed through an interface of the application while teaching. Here, the related data of the sensor is recorded mainly for extracting some characteristic features of the head motion of the user, so as to more accurately recognize the head motion. In order to record these characteristics of a specific head movement, a corresponding relationship between the head movement and the related data needs to be established, so that the specific head movement can be identified by comparing the related data or the characteristic values of the related data. The related data is generally some measurement data that can identify the motion, such as various speeds, gravity, and orientations, collected by the sensor, and the related data mainly refers to the rotational angular velocity, the precession angular velocity, and the like, taking a gyroscope as an example.
According to an embodiment of the present invention, the preset head actions include raising the head, lowering the head, turning the head left, turning the head right, and looking front at the head.
For a schematic view of head up, head down, head left turn, head right turn and head front view front, please refer to fig. 3. The figure may also show exemplary action presentations for teaching on the screen.
According to an embodiment of the present invention, the acquiring data required by the sensor to recognize the head movement in a teaching manner further includes: prompting a user to make a custom head action; when a user performs a user-defined head action, recording related data of the sensor; and establishing a corresponding relation between the custom head action and the related data.
In this embodiment, in addition to being able to associate particular contacts using preset header actions, the user is allowed to customize some header actions and associate particular contacts using these customized header actions. When the user-defined head action is carried out, the user can name the user-defined action, and the system can also automatically name the user-defined action according to a certain naming rule.
According to an embodiment of the present invention, before stopping recording, the method further includes: again a user prompt is given to indicate that the recording is finished and that an instant message is about to be sent.
It is not essential that a user prompt is given here, but if a prompt can be given, the user can be told that an instruction to end the speech has been recognized and that the recording is ready to be ended so that the user knows, and if the user has something to send, the user can wait for the next transmission to continue. And the user can confirm that the content just spoken by the user is recorded and is about to be sent through the prompt.
According to an embodiment of the present invention, before generating the instant message according to the recorded content, the method further includes: and detecting whether the effective duration of the recording content is greater than a duration threshold, if so, continuing the next operation, and if not, ending the operation.
In this embodiment, the recorded content is checked for duration, mainly to avoid sending error messages. Sometimes, the user may only swing the lower head carelessly, an instruction of a designated contact is triggered, and a message which is not to be sent is generated, at this time, if the user finds and ends the speaking in time, the message which is not to be sent does not exceed a preset time threshold, and an instant message generated due to careless operation can be avoided from being sent. The duration threshold is usually specified based on an empirical value, and in the embodiment of the present invention, 1 second is used as the duration threshold. However, the embodiment of the present invention does not limit the time threshold, and the implementer may adjust the time threshold according to the implementation effect.
According to an embodiment of the present invention, the method further includes: and receiving a reply message returned by the contact.
In this embodiment, the electronic device installed with the instant messaging application may send a message to a feedback module of the head wearable device, such as a headset or speaker, via bluetooth after receiving a reply from the contact.
According to an embodiment of the present invention, the method further includes: the instant message and the reply message are saved.
In this embodiment, if the head wearable device is provided with a sufficiently large memory space, the transmitted instant message and the reply message returned by the other party can also be saved for later review. Typically, the instant messaging service in the cloud also saves these communication records and can be viewed through an application on the electronic device.
According to a second aspect of the embodiments of the present invention, an apparatus for instant messaging through head movements, as shown in fig. 4, the apparatus 50 includes: a head motion recognition module 501, configured to recognize a head motion of a user through a sensor in a head wearable device; a user intention obtaining module 502, configured to obtain a user intention corresponding to the head action according to the head action; and an operation executing module 503, configured to execute a corresponding operation according to the user intention, where if the user intention is to select a contact, the contact identifier corresponding to the head action is obtained, the user is prompted to speak and start recording, if the user intention is that the speaking is finished at this time, recording is stopped, an instant message is generated according to the recording content, and the contact identifier and the instant message are sent.
According to an embodiment of the present invention, the apparatus 50 further includes: and the equipment detection module is used for detecting whether the head wearable equipment works normally, if so, continuing the next operation, and if not, prompting the user equipment to break down.
According to an embodiment of the present invention, the apparatus 50 further includes: the teaching module is used for acquiring data required by the sensor for recognizing the head action in a teaching mode; the contact person identification acquisition module is used for acquiring contact person identifications; and the contact person corresponding relation establishing module is used for establishing the corresponding relation between the head action and the contact person identification.
According to an embodiment of the present invention, the teaching module includes: a demonstration motion display unit for displaying demonstration motions of preset head motions; the data recording unit is used for recording relevant data of the sensor when a user performs demonstration action; and the head action corresponding relation establishing module is used for establishing the corresponding relation between the preset head action and the related data.
According to an embodiment of the present invention, the teaching module further includes: the user prompting unit is used for prompting a user to make a user-defined head action; the data recording unit is also used for recording related data of the sensor when a user performs a user-defined head action; the head action corresponding relation establishing unit is also used for establishing the corresponding relation between the user-defined head action and the related data.
According to an embodiment of the present invention, the operation performing module 503 is further configured to give a user prompt again to indicate that the recording is finished and an instant message is about to be sent.
According to an embodiment of the present invention, the apparatus 50 further includes a recording content detecting module, configured to detect whether an effective duration of the recording content is greater than a duration threshold, if so, continue a next operation, and if not, end the operation.
According to an embodiment of the present invention, the apparatus 50 further includes a receiving module, configured to receive a reply message returned by the contact.
According to an embodiment of the present invention, the apparatus 50 further includes a message saving module, configured to save the instant message and the reply message.
According to a third aspect of embodiments of the present invention, there is provided a system for instant messaging through head movements, the system including: the head wearable device is used for executing the method for the instant messaging through the head action to select the contact and send the instant message; and the instant messaging service module is used for receiving the contact person identification and the instant message sent by the head wearable device and sending the instant message to the contact person.
According to an embodiment of the present invention, the system further includes an electronic device connected to the head wearable device, and a designated application program is installed on the electronic device, and the application program is configured to acquire data required by the sensor to recognize the head movement in a teaching manner.
According to a fourth aspect of embodiments of the present invention, there is provided a computer storage medium comprising a set of computer executable instructions which, when executed, perform any of the above methods for instant messaging through header actions.
Here, it should be noted that: the above description of the embodiment of the apparatus for instant messaging by head action, the above description of the embodiment of the system for instant messaging by head action, and the above description of the embodiment of the computer storage medium are similar to the description of the foregoing method embodiments, and have similar beneficial effects to the foregoing method embodiments, and therefore, are not repeated herein. For the technical details that have not been disclosed yet for the description of the embodiment of the apparatus for instant messaging by head movement, the description of the embodiment of the system for instant messaging by head movement, and the description of the embodiment of the computer storage medium of the present invention, please refer to the description of the foregoing method embodiment of the present invention for understanding, and therefore, the details will not be repeated for the sake of brevity.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of a unit is only one logical function division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another device, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units; can be located in one place or distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: various media capable of storing program codes, such as a removable storage medium, a Read Only Memory (ROM), a magnetic disk, and an optical disk.
Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods of the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage medium, a ROM, a magnetic disk, an optical disk, or the like, which can store the program code.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (13)
1. A method for instant messaging through head actions, which is applied to a head wearable device, comprises the following steps:
acquiring data required by a sensor for recognizing head movements in a teaching mode;
acquiring a contact person identifier;
establishing a corresponding relation between the head action and the contact person identification;
identifying, by the sensor in the head-wearable device, a head action of a user;
acquiring a user intention corresponding to the head action according to the head action;
and executing corresponding operation according to the user intention, wherein if the user intention is a selected contact, the contact identification corresponding to the head action is obtained, the user is prompted to speak and start recording, if the user intention is that the speaking is finished at the current time, the recording is stopped, an instant message is generated according to the recording content, and the contact identification and the instant message are sent.
2. The method of claim 1, wherein prior to said identifying head movements of the user by the sensors in the head-wearable device, the method further comprises:
and detecting whether the head wearable equipment works normally, if so, continuing the next operation, and if not, prompting the user equipment to break down.
3. The method of claim 1, wherein said obtaining data required by said sensor to recognize head movements by means of said teaching comprises:
displaying a demonstration action of the preset head action;
recording data related to the sensor while the user is making the demonstration action;
and establishing a corresponding relation between the preset head action and the related data.
4. The method of claim 3, wherein the preset head actions include head up, head down, head left turn, head right turn, and head front.
5. The method of claim 3, wherein said obtaining data required for said sensor to recognize head movements by teaching further comprises:
prompting a user to make a custom head action;
recording relevant data of the sensor when the user makes the custom head action;
and establishing a corresponding relation between the user-defined head action and the related data.
6. The method of claim 1, wherein prior to said stopping recording, the method further comprises:
again a user prompt is given to indicate that the recording is finished and that an instant message is about to be sent.
7. The method of claim 1, wherein prior to the generating an instant message from canned content, the method further comprises:
and detecting whether the effective duration of the recording content is greater than a duration threshold, if so, continuing the next operation, and if not, ending the operation.
8. The method of claim 1, further comprising:
and receiving a reply message returned by the contact.
9. The method of claim 8, further comprising:
saving the instant message and the reply message.
10. An apparatus for instant messaging through head movements, the apparatus comprising:
the teaching module is used for acquiring data required by the sensor for identifying the head action in a teaching mode;
the contact person identification acquisition module is used for acquiring contact person identifications;
the contact person corresponding relation establishing module is used for establishing the corresponding relation between the head action and the contact person identification;
a head action recognition module for recognizing the head action of a user by a sensor in the head wearable device;
the user intention acquisition module is used for acquiring a user intention corresponding to the head action according to the head action; and the operation execution module is used for executing corresponding operation according to the user intention, wherein if the user intention is a selected contact, the contact identification corresponding to the head action is obtained, the user is prompted to speak and start recording, if the user intention is that the speaking is finished at the current time, the recording is stopped, an instant message is generated according to the recording content, and the contact identification and the instant message are sent.
11. A system for instant messaging through head gestures, the system comprising:
a head wearable device for performing the method of claim 1 to select a contact and send an instant message;
and the instant messaging service module is used for receiving the contact person identification and the instant message sent by the head wearable device and sending the instant message to the contact person.
12. The system of claim 11, further comprising:
and the electronic equipment is connected with the head wearable equipment, a specified application program is installed on the electronic equipment, and the application program is used for acquiring data required by the sensor for identifying the head action in a teaching mode.
13. A storage medium having stored thereon program instructions for performing, when executed, the method of instant messaging by header action according to any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010296819.2A CN111526083B (en) | 2020-04-15 | 2020-04-15 | Method, device, system and storage medium for instant messaging through head action |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010296819.2A CN111526083B (en) | 2020-04-15 | 2020-04-15 | Method, device, system and storage medium for instant messaging through head action |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111526083A CN111526083A (en) | 2020-08-11 |
| CN111526083B true CN111526083B (en) | 2022-04-15 |
Family
ID=71910715
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010296819.2A Active CN111526083B (en) | 2020-04-15 | 2020-04-15 | Method, device, system and storage medium for instant messaging through head action |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111526083B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115860598A (en) * | 2021-09-24 | 2023-03-28 | 上海擎感智能科技有限公司 | Distribution method, head-mounted device, electronic apparatus, and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102576530A (en) * | 2009-10-15 | 2012-07-11 | 索尼爱立信移动通讯有限公司 | Voice pattern tagged contacts |
| CN106363637A (en) * | 2016-10-12 | 2017-02-01 | 华南理工大学 | Fast teaching method and device for robot |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9047600B2 (en) * | 2011-07-18 | 2015-06-02 | Andrew H B Zhou | Mobile and wearable device payments via free cross-platform messaging service, free voice over internet protocol communication, free over-the-top content communication, and universal digital mobile and wearable device currency faces |
| CN102970403A (en) * | 2012-11-23 | 2013-03-13 | 上海量明科技发展有限公司 | Method for triggering instant messaging contactor object by terminal mobile, client and system |
| CN105515951A (en) * | 2015-12-14 | 2016-04-20 | 阿里巴巴集团控股有限公司 | Wearable device based instant messaging method and device |
| CN106357911A (en) * | 2016-09-27 | 2017-01-25 | 北京小米移动软件有限公司 | Communication event prompting method and device and specified graph setting method and device |
| CN106685459B (en) * | 2016-12-27 | 2019-07-30 | 广东小天才科技有限公司 | A wearable device operation control method and wearable device |
| WO2018195099A1 (en) * | 2017-04-19 | 2018-10-25 | Magic Leap, Inc. | Multimodal task execution and text editing for a wearable system |
| CN109862178A (en) * | 2019-01-17 | 2019-06-07 | 珠海市黑鲸软件有限公司 | A kind of wearable device and its voice control communication method |
| CN110071866B (en) * | 2019-04-29 | 2022-03-18 | 努比亚技术有限公司 | Instant messaging application control method, wearable device and storage medium |
-
2020
- 2020-04-15 CN CN202010296819.2A patent/CN111526083B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102576530A (en) * | 2009-10-15 | 2012-07-11 | 索尼爱立信移动通讯有限公司 | Voice pattern tagged contacts |
| CN106363637A (en) * | 2016-10-12 | 2017-02-01 | 华南理工大学 | Fast teaching method and device for robot |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111526083A (en) | 2020-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10720176B2 (en) | Multisensory speech detection | |
| US11074292B2 (en) | Voice tagging of video while recording | |
| US11004445B2 (en) | Information processing method, server, terminal, and information processing system | |
| JPWO2017130486A1 (en) | Information processing apparatus, information processing method, and program | |
| CN113678133A (en) | System and method for context-rich attentional memory networks with global and local encoding for dialogue break detection | |
| TWI502487B (en) | Methods for voice management, and related devices and computer program prodcuts | |
| KR20190087639A (en) | Message transmitting method, message processing method and terminal | |
| US20180294012A1 (en) | Information entry method and device | |
| CN106027801A (en) | Communication message processing method and device and mobile device | |
| CN107943724A (en) | Method and device for searching external device, terminal device and storage medium | |
| CN111526083B (en) | Method, device, system and storage medium for instant messaging through head action | |
| WO2016206642A1 (en) | Method and apparatus for generating control data of robot | |
| CN107819946B (en) | Method, device and mobile terminal for voice recognition | |
| CN108040003B (en) | A reminder method and device | |
| KR101289243B1 (en) | Video call service method, apparatus and system thereof | |
| US10635802B2 (en) | Method and apparatus for accessing Wi-Fi network | |
| CN108280189B (en) | A smart pen-based voice search method and system | |
| CN114758651A (en) | Voice signal processing method and device | |
| JP2013157758A (en) | Information transfer system, information transfer method, information transfer program, information transfer terminal, and program for information transfer terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |