CN108683790B - Voice processing method and related product - Google Patents

Abstract

The present application discloses a voice processing method and related products, which are applied to a wearable device. The wearable device is worn on a user's head. The method includes: collecting motion parameters of the user's head; When the preset conditions are met, a recording instruction is generated; in response to the recording instruction, a recording operation is performed. Using the embodiments of the present application, recording instructions can be generated according to the movement of the user's head, so as to realize the recording function, which improves the intelligence and convenience of the wearable device, and also improves the user experience.

Description

Speech processing method and related products

technical field

The present application relates to the field of electronic technology, and in particular, to a voice processing method and related products.

Background technique

With the maturity of wireless technology, there are more and more scenarios in which wireless headphones are connected to electronic devices such as mobile phones through wireless technology. People can listen to music, make calls and other functions through wireless earphones. However, the current wireless earphones are relatively simple, and thus, the user experience is degraded.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a voice processing method and related products, which can implement a recording function and improve the intelligence and convenience of a wearable device.

In a first aspect, an embodiment of the present application provides a wearable device, which is applied to a wearable device, where the wearable device is worn on the head of a user, the wearable device includes a storage and processing circuit, and is connected with the storage and processing circuit circuit-connected sensor and audio components, where,

the sensor for collecting the motion parameters of the user's head;

The storage and processing circuit is used to generate a recording instruction when the motion parameter meets a preset condition;

The audio component is configured to perform a recording operation in response to the recording instruction.

In a second aspect, an embodiment of the present application provides a voice processing method, which is applied to a wearable device, where the wearable device is worn on the head of a user, and the method includes:

collecting motion parameters of the user's head;

When the motion parameter satisfies the preset condition, generating a recording instruction;

In response to the recording instruction, a recording operation is performed.

In a third aspect, an embodiment of the present application provides a voice processing device, which is applied to a wearable device, where the wearable device is worn on the head of a user, and the voice processing device includes a collection unit, a generation unit, and an execution unit, wherein:

the collection unit, configured to collect motion parameters of the user's head;

The generating unit is configured to generate a recording instruction when the motion parameter satisfies a preset condition;

The execution unit is configured to perform a recording operation in response to the recording instruction.

In a fourth aspect, embodiments of the present application provide a wearable device, including a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory, and are configured by the above Executed by the processor, the above program includes instructions for executing steps in any method in the second aspect of the embodiments of the present application.

In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute the computer program as described in the first embodiment of the present application. Some or all of the steps described in either method of the second aspect.

In a sixth aspect, an embodiment of the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute as implemented in the present application. Examples include some or all of the steps described in any method of the second aspect. The computer program product may be a software installation package.

In the embodiment of the present application, the wearable device is worn on the user's head, collects the motion parameters of the user's head, generates a recording instruction when the motion parameters meet the preset conditions, responds to the recording instruction, and performs a recording operation, thereby, according to the user's head It can generate recording instructions, realize the recording function, improve the intelligence and convenience of the wearable device, and also improve the user experience.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1A is a schematic structural diagram of a wearable device disclosed in an embodiment of the present application;

FIG. 1B is a schematic diagram of a demonstration of a wireless headset disclosed in an embodiment of the present application;

1C is a schematic diagram of a network architecture of a voice processing disclosed in an embodiment of the present application;

1D is a schematic flowchart of a speech processing method disclosed in an embodiment of the present application;

2 is a schematic flowchart of another voice processing method disclosed in an embodiment of the present application;

3 is a schematic structural diagram of another wearable device disclosed in an embodiment of the present application;

4A is a schematic structural diagram of a voice processing apparatus disclosed in an embodiment of the present application;

FIG. 4B is a schematic structural diagram of another voice processing apparatus disclosed in an embodiment of the present application.

Detailed ways

In order to make those skilled in the art better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only The embodiments are part of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the scope of protection of the present application.

Each of them will be described in detail below.

The terms "first", "second", "third" and "fourth" in the description and claims of the present application and the drawings are used to distinguish different objects, rather than to describe a specific order . Furthermore, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optionally also includes For other steps or units inherent to these processes, methods, products or devices.

Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor a separate or alternative embodiment that is mutually exclusive of other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

Electronic devices may include various handheld devices, vehicle-mounted devices, wearable devices, computing devices, or other processing devices connected to wireless modems, as well as various forms of user equipment (UE), mobile stations (Mobile Station, MS), terminal device (terminaldevice) and so on. For convenience of description, the devices mentioned above are collectively referred to as electronic devices.

The wearable device may include at least one of the following: wireless earphones, brain wave collection devices, augmented reality (AR)/virtual reality (VR) devices, smart earrings/earrings, smart hearing aids, smart hair clips, smart glasses etc. Wireless headsets can communicate through the following technologies: wireless fidelity (Wi-Fi) technology, Bluetooth technology, visible light communication technology, invisible light communication technology (infrared communication technology, ultraviolet communication technology), and the like. For the convenience of description, the wearable device in the following embodiments is described by taking a wireless earphone as an example.

The wireless earphone may be a hanging earphone, an earplug type earphone, or a headphone, which is not limited in the embodiment of the present application.

The wireless earphone can be accommodated in the earphone box, and the earphone box can include: two receiving cavities (a first receiving cavity and a second receiving cavity), the size and shape of the two receiving cavities are designed to receive a pair of wireless earphones (the first wireless earphone). earphones and second wireless earphones); one or more earphone shell magnetic parts provided in the box, the above-mentioned one or more earphone case magnetic parts are used to magnetically attract and magnetically fix a pair of wireless earphones into two receiving cavities respectively . The earphone case may also include an earphone cover. The size and shape of the first receiving cavity is designed to receive the first wireless earphone, and the size and shape of the second receiving cavity is designed to receive the second wireless earphone. A wireless headset may include a headset housing, a rechargeable battery (eg, a lithium battery) disposed within the headset housing, a plurality of metal contacts for connecting the battery to a charging device, a speaker assembly including a driver unit and a directional sound port, Wherein, the driver unit includes a magnet, a voice coil and a diaphragm, the driver unit is used to emit sound from the directional sound port, and the above-mentioned plurality of metal contacts are arranged on the outer surface of the earphone shell. In a possible implementation manner, the wireless headset may further include a touch area, and the touch area may be located on the outer surface of the earphone shell. At least one touch sensor is provided in the touch area for detecting a touch operation, and the touch sensor may include a capacitance sensor. When the user touches the touch area, at least one capacitive sensor can detect the change of its own capacitance so as to recognize the touch operation.

In a possible implementation manner, the wireless headset may further include an acceleration sensor and a three-axis gyroscope, the acceleration sensor and the three-axis gyroscope may be arranged in the headset casing, and the acceleration sensor and the three-axis gyroscope are used to identify the holding of the wireless headset. Activate and remove.

In a possible implementation manner, the wireless earphone may further include at least one air pressure sensor, and the air pressure sensor may be arranged on the surface of the earphone shell, and is used to detect the air pressure in the ear after the wireless earphone is worn. The tightness of the wireless earphone can be detected by the air pressure sensor. When it is detected that the wireless earphone is loosely worn, the wireless earphone can send a prompt message to the electronic device connected to the wireless earphone to remind the user that the wireless earphone is at risk of falling.

Please refer to FIG. 1A . FIG. 1A is a schematic structural diagram of a wearable device disclosed in an embodiment of the present application. The wearable device 100 includes a storage and processing circuit 110 , a sensor 170 and an audio component connected to the storage and processing circuit 110 . 140. Optionally, for the specific form of the wearable device shown in FIG. 1A, refer to FIG. 1B, where the above-mentioned wearable device 100 is as follows:

Wearable device 100 may include control circuitry, which may include storage and processing circuitry 110 . The storage and processing circuit 110 may be memory, such as hard drive memory, non-volatile memory (such as flash memory or other electronically programmable read only memory used to form solid state drives, etc.), volatile memory (such as static or dynamic random access memory, etc.) memory, etc.), etc., which are not limited in the embodiments of the present application. Processing circuitry in storage and processing circuitry 110 may be used to control the operation of wearable device 100 . The processing circuit may be implemented based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management units, audio codec chips, application specific integrated circuits, display driver integrated circuits, and the like.

Storage and processing circuitry 110 may be used to run software in wearable device 100, such as internet browsing applications, voice over internet protocol (VOIP) phone calling applications, email applications, media playback applications, operating systems function, etc. These software can be used to perform some control operations, for example, camera-based image acquisition, ambient light measurement based on ambient light sensor, proximity sensor measurement based on proximity sensor, information based on status indicator implementation such as status indicators of light emitting diodes Display functions, touch sensor-based detection of touch events, functions associated with displaying information on multiple (eg, layered) displays, operations associated with performing wireless communication functions, operations associated with collecting and generating audio signals , control operations associated with collecting and processing button press event data, and other functions in the wearable device 100, etc., are not limited in this embodiment of the present application.

Wearable device 100 may also include input-output circuitry 150 . The input-output circuit 150 may be used to enable the wearable device 100 to input and output data, ie, allowing the wearable device 100 to receive data from an external device and also allow the wearable device 100 to output data from the wearable device 100 to an external device. The input-output circuit 150 may further include a sensor 170 . Sensors 170 may include ambient light sensors, light and capacitance-based proximity sensors, ultrasonic sensors, radar sensors, touch sensors (eg, light-based touch sensors and/or capacitive touch sensors, where the touch sensor may be a touch-sensitive display). part, can also be used independently as a touch sensor structure), acceleration sensor, and other sensors.

Input-output circuitry 150 may also include one or more displays, such as display 130 . The display 130 may include one or a combination of a liquid crystal display, an organic light emitting diode display, an electronic ink display, a plasma display, and displays using other display technologies. Display 130 may include an array of touch sensors (ie, display 130 may be a touch display). The touch sensor can be a capacitive touch sensor formed from an array of transparent touch sensor electrodes, such as indium tin oxide (ITO) electrodes, or can be a touch sensor formed using other touch technologies, such as sonic touch, pressure sensitive touch, resistive touch Touch, optical touch, etc., are not limited in the embodiments of the present application.

Audio component 140 may be used to provide audio input and output functionality for wearable device 100 . Audio components 140 in wearable device 100 may include speakers, microphones, buzzers, tone generators, and other components for generating and detecting sounds.

Communication circuitry 120 may be used to provide wearable device 100 with the ability to communicate with external devices. Communication circuitry 120 may include analog and digital input-output interface circuitry, and wireless communication circuitry based on radio frequency signals and/or optical signals. Wireless communication circuitry in communication circuitry 120 may include radio frequency transceiver circuitry, power amplifier circuitry, low noise amplifiers, switches, filters, and antennas. For example, the wireless communication circuitry in the communication circuitry 120 may include circuitry for supporting Near Field Communication (NFC) by transmitting and receiving near-field coupled electromagnetic signals. For example, the communication circuit 120 may include a near field communication antenna and a near field communication transceiver. Communication circuitry 120 may also include cellular telephone transceivers and antennas, wireless local area network transceiver circuits and antennas, and the like.

The wearable device 100 may further include a battery, power management circuits and other input-output units 160 . Input-output unit 160 may include buttons, joysticks, click wheels, scroll wheels, touch pads, keypads, keyboards, cameras, light emitting diodes and other status indicators, and the like.

The user may input commands through the input-output circuit 150 to control the operation of the wearable device 100 , and the output data of the input-output circuit 150 may be used to enable receiving status information and other outputs from the wearable device 100 .

Based on the wearable device described in Figure 1A above, it can be used to implement the following functions:

The sensor 170 is used to collect motion parameters of the user's head;

The storage and processing circuit 110 is configured to generate a recording instruction when the motion parameter meets a preset condition;

The audio component 140 is configured to perform a recording operation in response to the recording instruction.

In the embodiment of the present application, it is applied to a wearable device, the wearable device is worn on the user's head, collects motion parameters of the user's head, and when the motion parameters meet preset conditions, generates a recording instruction, responds to the recording instruction, and executes the recording Therefore, according to the user's head movement, a recording instruction is generated to realize the recording function, which improves the intelligence and convenience of the wearable device, and also improves the user experience.

In this embodiment of the present application, the sensor 170 may include at least one of the following: an acceleration sensor, a brain wave collection device, a proximity sensor, a light sensor, an ultrasonic sensor, a radar sensor, a pressure sensor, a temperature sensor, a displacement sensor, a nerve sensor, a muscle Sensors, etc., the audio component 140 may at least include a recording chip and a voice signal processing circuit.

In a possible example, the motion parameters include first motion parameters of the first head organ and second motion parameters of the second head organ;

In the aspect of generating the recording instruction, the storage and processing circuit 110 is specifically used for:

Determine the target recording range parameter corresponding to the first motion parameter according to the preset first mapping relationship between the motion parameter of the first head organ and the recording range parameter;

According to the preset second mapping relationship between the motion parameters of the second head organ and the recording object, determine the target recording object corresponding to the second motion parameter;

A recording instruction is generated according to the target recording range parameter and the target recording object.

In a possible example, the motion parameters include: target amplitude and target direction of facial muscle movement; the storage and processing circuit 110 is also specifically used for:

When the target amplitude is within a preset amplitude range and the target direction is within a preset direction range, it is determined that the motion parameter satisfies the preset condition.

In a possible example, in the aspect of performing the recording operation, the audio component 140 is specifically configured to:

When receiving an ambient sound signal, filtering the ambient sound signal to obtain a reference sound signal;

performing analog-to-digital conversion on the reference sound signal to obtain a target sound signal;

dividing the target sound signal into a plurality of sound signal segments according to time sequence;

respectively determining the energy value of each sound signal segment in the plurality of sound signal segments to obtain a plurality of energy values;

A target energy value greater than a preset energy threshold is selected from the plurality of energy values, and the sound signal segments corresponding to the target energy value are spliced in chronological order to obtain a final recording segment.

In a possible example, the wearable device is a wireless headset, the wireless headset includes a master headset and a slave headset, and the recording operation is implemented by the master headset and/or the slave headset.

Based on the wearable device described in FIG. 1A above, it can be used to execute the following voice processing methods, which are as follows:

the sensor 170 collects motion parameters of the user's head;

The storage and processing circuit 110 generates a recording instruction when the motion parameter satisfies a preset condition;

The audio component 140 performs a recording operation in response to the recording instruction.

In a possible example, please refer to FIG. 1C , which is a schematic diagram of a network architecture of a voice processing disclosed in an embodiment of the present application. In the network architecture of voice processing shown in FIG. 1C, electronic devices and wearable devices may be included, wherein the wearable devices may be connected through a wireless network (eg, Bluetooth, infrared, or wireless fidelity (Wi-Fi) or Visible light communication technology or invisible light communication technology) is communicatively connected with the electronic device. It should be noted that the number of wireless earphones may be one or two, which is not limited in this embodiment of the present application. In the voice processing network architecture shown in FIG. 1C , the wearable device and the electronic device can be successfully connected within a certain distance. Taking the wireless Bluetooth headset as an example, if the maximum power capacity of the wireless Bluetooth headset is 2.5mW, the wireless Bluetooth headset and the electronic device can only be successfully connected within a range of about 10 meters, and the distance between the wireless Bluetooth headset and the electronic device is greater than At 10 meters, the wireless Bluetooth headset is generally disconnected from the electronic device. The electronic device can communicate with the wearable device within a certain range, and the wearable device can be controlled by the electronic device to realize the recording function, or, after the wearable device is recorded, the recorded audio file can be transmitted to the electronic device.

Based on the wearable device described in FIG. 1A , or based on the network architecture of voice processing described in FIG. 1C , please refer to FIG. 1D , which is a schematic flowchart of a voice processing method disclosed in an embodiment of the present application. As shown in FIG. 1D, applied to a wearable device, the wearable device is worn on the user's head, and the voice processing method includes the following steps.

101. Collect motion parameters of the user's head.

Wherein, the movement parameters of the user's head may include at least one of the following: muscle movement parameters, nerve movement parameters, eye movement parameters, head movement parameters, breathing movement parameters, etc.,

Optionally, the muscle movement parameters may include facial expressions. Specifically, by collecting muscle movement parameters, the user's expression is analyzed through the muscle movement parameters. For another example, the muscle movement parameters may also include at least one of the following: muscle movement direction, muscle movement Location (eg, eye muscles, lip muscles, throat muscles, ear muscles, etc.), range of muscle movement, and the like.

Optionally, the neuromotor parameters may include at least one of the following: neuron type (for example, voice type, action type, etc.), neuron motor activity (for example, the user's brain waves can be collected and reflected by brain wave energy), Neuronal motor areas (eg, left-brain motor, right-brain motor, etc.).

Optionally, the eye movement parameter can be at least one of the following: a blink movement parameter (monocular movement parameter, binocular movement parameter), an eye movement parameter (single eye movement parameter, binocular movement parameter), and the blink movement parameter may specifically be: The number of blinks, the blinking amplitude (for example, closing and squinting, the blinking amplitude between the two is different), and the eye movement parameters can specifically be: eye movement left and right, eye up and down movement, eye wandering movement (for example, eyeball up and down Movement or eye movement back and forth, etc.), eye rolls, etc.

Optionally, the head motion parameters may include at least one of the following: up and down motion parameters (for example, nodding, bowing, looking up, squatting), left and right motion parameters (for example, head left, head right), head Rotation parameters (for example, head clockwise circle left, head clockwise circle right, head up clockwise circle, head down clockwise circle).

Optionally, the breathing motion parameter may include at least one of the following: the number of breaths, the frequency of breathing, the amplitude of breathing (for example, shallow breathing and deep breathing are different), and the like.

102. Generate a recording instruction when the motion parameter satisfies a preset condition.

The above preset conditions can be set by the system by default, or set by the user. For example, the motion parameter can be the number of nods. When the number of nods is greater than the preset number, a recording instruction is generated, and the preset number can be set by the user. Alternatively, the system defaults .

Optionally, the motion parameters include the first motion parameters of the first head organ and the second motion parameters of the second head organ; the above step 102, generating a recording instruction, may include the following steps:

21. Determine the target recording range parameter corresponding to the first motion parameter according to the preset first mapping relationship between the motion parameter of the first head organ and the recording range parameter;

22. Determine the target recording object corresponding to the second motion parameter according to the preset second mapping relationship between the motion parameter of the second head organ and the recording object;

23. Generate a recording instruction according to the target recording range parameter and the target recording object.

Wherein, the above-mentioned first head organ and second head organ may include, but are not limited to, at least one of the following: eyes, nose, mouth, oral cavity, respiratory tract, ears, cheeks and eyebrows, and the like. For example, the first head organ may be the left eye, and the second head organ may be the right eye. The above-mentioned recording range parameters may include: recording distance, recording direction, recording sound volume, recording sound frequency, recording duration, and the like. The recording object can be understood as the identity of the speaker (for example, in class, only the teacher's voice is recorded, in the meeting, only one person's voice is recorded), or, the number of speakers (for example, 5 people's voices), or, Type of speaker (eg, human, cat, dog, wind, etc.).

Optionally, the recording distance can be understood as recording only the sound within a certain distance range, for example, within a range of 5 meters. In the specific implementation, the wearable device can be a wireless headset, and the wireless headset can include a left Both the earphone and the right earphone can receive the ambient sound. For the same sound, the time received by the left earphone and the right earphone is different. Therefore, the distance between the student source and the wireless earphone can be identified by the time difference between the two. Furthermore, selective recording of sound is achieved. The recording direction can be understood as recording only the sound from a certain direction. The sound is a waveform, which propagates along a certain trajectory during the propagation process, so there is a propagation direction. The recording sound frequency can be understood as recording only the sound within a certain frequency range. The recording duration can be understood as how long the recording needs to be. For example, if it is 10 minutes, the recording can be stopped after 10 minutes of recording.

In specific implementation, the motion parameters include the first motion parameters of the first head organ and the second motion parameters of the second head organ, and the preset motion parameters and recording range parameters of the first head organ may be pre-stored in the electronic device and the preset second mapping relationship between the motion parameters of the second head organ and the recording object, and further, the preset motion parameters and recording range parameters of the first head organ can be Determine the target recording range parameter corresponding to the first motion parameter, according to the preset second mapping relationship between the motion parameter of the second head organ and the recording object, determine the corresponding second motion parameter. The target recording object generates recording instructions according to the target recording range parameters and the target recording object, so that personalized recording can be realized according to the target recording range parameters and the target recording object. processing to improve the user experience.

Optionally, the motion parameters include: target amplitude and target direction of facial muscle movement; between the above steps 101 and 102, the following steps may also be included:

When the target amplitude is within a preset amplitude range and the target direction is within a preset direction range, it is determined that the motion parameter satisfies the preset condition.

Wherein, the above-mentioned preset amplitude range can be set by the user or the system defaults, and the preset direction range can also be set by the user or the system defaults. For example, if the user pouts to the right, the corresponding amplitude and direction of the pout can be detected, and then it can be identified whether it meets the preset conditions. If the preset conditions are met, a recording instruction can be generated. Recording commands cannot be generated. In this way, recording instructions can be quickly generated through head movements to realize recording.

103. In response to the recording instruction, perform a recording operation.

Among them, the recording operation can be performed according to the instructions of the recording instruction in response to the recording instruction. In this way, the recording function is realized by using the head movement, which greatly improves the operational intelligence and convenience of the wearable device.

Optionally, the above step 103, performing the recording operation, may include the following steps:

31. When an ambient sound signal is received, filter the ambient sound signal to obtain a reference sound signal;

32. Perform analog-to-digital conversion on the reference sound signal to obtain a target sound signal;

33. Divide the target sound signal into a plurality of sound signal segments according to time sequence;

34. Determine the energy value of each sound signal segment in the plurality of sound signal segments, respectively, to obtain a plurality of energy values;

35. Select a target energy value greater than a preset energy threshold from the plurality of energy values, and splicing the sound signal segments corresponding to the target energy value in chronological order to obtain a final recording segment.

The ambient sound signal includes not only the sounds of different people, but also natural sounds, that is, sounds made by animals, such as wind, rain, and other sounds, and the filtering process may include at least one of the following: wavelet transform, Median filter, bilateral filter, band-pass filter, low-pass filter, high-pass filter, etc. The preset energy threshold can be set by the user, or the system defaults. Different sounds have different frequencies and waveforms. Therefore, after receiving the ambient sound signal, the ambient sound signal can be filtered to obtain the reference sound signal. In this way, the natural sound can be filtered out, and then the reference sound signal can be filtered. Perform analog-to-digital conversion to obtain the target sound signal, divide the target sound signal into a plurality of sound signal segments according to the time sequence, determine the energy value of each sound signal segment respectively, and obtain a plurality of energy values, which can be obtained from the plurality of energy values. Select the target energy value that is greater than the preset energy threshold, and the sound clips below the preset energy threshold can be understood as pauses (the speaker is not uttering sound all the time, but also pauses or thinks), and then, the target energy value corresponds to The sound signal segments are spliced in chronological order to obtain the final recording segment. In this way, the user's desired recording can be accurately obtained, which improves the user experience.

The voice processing method described in the embodiment of the present application is applied to a wearable device, the wearable device is worn on the user's head, collects motion parameters of the user's head, and generates a recording instruction when the motion parameters meet preset conditions, In response to the recording instruction, the recording operation is performed, thereby, according to the user's head movement, the recording instruction is generated, and the recording function is realized, which improves the intelligence and convenience of the wearable device, and also improves the user experience.

In a possible example, the wearable device is a wireless headset, the wireless headset includes a master headset and a slave headset, and the recording operation is implemented by the master headset and/or the slave headset. In this way, recording can be performed through the master earphone, or recording through the slave earphone, or recording through the master earphone and the slave earphone.

Consistent with the above, please refer to FIG. 2 , which is a schematic flowchart of a speech processing method disclosed in an embodiment of the present application. As shown in FIG. 2, applied to a wearable device, the wearable device is worn on the user's head, and the voice processing method includes the following steps.

201. A wearable device collects motion parameters of the user's head, where the wearable device includes a master headset and a slave headset.

202. The wearable device generates a recording instruction when the motion parameter meets a preset condition.

203. In response to the recording instruction, the wearable device controls the master headset and the slave headset to perform a recording operation.

The specific description of the above steps 201 to 203 may refer to the speech processing method described in the above-mentioned FIG. 1D , which will not be repeated here.

204. When the wearable device answers an incoming call, it controls the primary earphone to answer the incoming call, and the secondary earphone continues to perform a recording operation.

Among them, when an incoming call is received, the main earphone can be controlled to answer the incoming call, and the secondary earphone can continue to perform the recording operation. Of course, after hanging up the call, the main earphone and the secondary earphone can continue to perform the recording operation. In this way, the recording operation can be realized by the two earphones, or the recording operation can be realized from the earphones when an incoming call is made, which improves the intelligence and convenience of the wireless earphone recording.

In a possible example, the wearable device is a wireless headset, the wireless headset includes a master headset and a slave headset, and the recording operation is implemented by the master headset and/or the slave headset. In this way, recording can be performed through the master earphone, or recording through the slave earphone, or recording through the master earphone and the slave earphone.

The voice processing method described in the embodiments of the present application is applied to a wearable device. The wearable device includes a master earphone and a slave earphone. The wearable device is worn on the user's head and collects motion parameters of the user's head. When the preset conditions are met, generate a recording command, respond to the recording command, control the main earphone and the slave earphone to perform the recording operation, when answering a call, control the main earphone to answer the call, and continue to perform the recording operation from the earphone, thus, according to the user's head movement, Generate recording instructions and realize the recording function, which improves the intelligence and convenience of the wearable device, and also improves the user experience.

Please refer to FIG. 3. FIG. 3 is a schematic structural diagram of another wearable device disclosed in an embodiment of the present application. As shown in the figure, the wearable device includes a processor, a memory, a communication interface, and one or more programs, wherein, The one or more programs described above are stored in the memory described above and are configured to be executed by the processor described above, the programs comprising instructions for performing the following steps:

collecting motion parameters of the user's head;

When the motion parameter satisfies the preset condition, generating a recording instruction;

In response to the recording instruction, a recording operation is performed.

In the wearable device described in the embodiments of this application, the wearable device is worn on the user's head, collects motion parameters of the user's head, generates a recording instruction when the motion parameters meet the preset conditions, and executes the recording in response to the recording instruction. Therefore, according to the user's head movement, a recording instruction is generated to realize the recording function, which improves the intelligence and convenience of the wearable device, and also improves the user experience.

In a possible example, the motion parameters include a first motion parameter of a first head organ and a second motion parameter of a second head organ;

In terms of generating recording instructions, the above program includes instructions for performing the following steps:

Determine the target recording range parameter corresponding to the first motion parameter according to the preset first mapping relationship between the motion parameter of the first head organ and the recording range parameter;

According to the preset second mapping relationship between the motion parameters of the second head organ and the recording object, determine the target recording object corresponding to the second motion parameter;

A recording instruction is generated according to the target recording range parameter and the target recording object.

In a possible example, the motion parameters include: target amplitude and target direction of facial muscle movement; the above program also includes instructions for performing the following steps:

When the target amplitude is within a preset amplitude range and the target direction is within a preset direction range, it is determined that the motion parameter satisfies the preset condition.

In a possible example, in the aspect of performing the recording operation, the above program includes instructions for performing the following steps:

When receiving an ambient sound signal, filtering the ambient sound signal to obtain a reference sound signal;

performing analog-to-digital conversion on the reference sound signal to obtain a target sound signal;

dividing the target sound signal into a plurality of sound signal segments according to time sequence;

respectively determining the energy value of each sound signal segment in the plurality of sound signal segments to obtain a plurality of energy values;

A target energy value greater than a preset energy threshold is selected from the plurality of energy values, and the sound signal segments corresponding to the target energy value are spliced in chronological order to obtain a final recording segment.

In a possible example, the wearable device is a wireless headset, the wireless headset includes a master headset and a slave headset, and the recording operation is implemented by the master headset and/or the slave headset.

The foregoing mainly introduces the solutions of the embodiments of the present application from the perspective of the method-side execution process. It can be understood that, in order to realize the above-mentioned functions, the electronic device includes corresponding hardware structures and/or software modules for executing each function. Those skilled in the art should easily realize that the present application can be implemented in hardware or in the form of a combination of hardware and computer software, in combination with the units and algorithm steps of each example described in the embodiments provided herein. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

In this embodiment of the present application, the electronic device may be divided into functional units according to the foregoing method examples. For example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units. It should be noted that the division of units in the embodiments of the present application is illustrative, and is only a logical function division, and other division methods may be used in actual implementation.

Please refer to FIG. 4A. FIG. 4A is a schematic structural diagram of a voice processing apparatus disclosed in an embodiment of the present application, which is applied to a wearable device. The voice processing apparatus 400 includes a collection unit 401, a generation unit 402, and an execution unit 403, wherein:

The collection unit 401 is configured to collect motion parameters of the user's head;

The generating unit 402 is configured to generate a recording instruction when the motion parameter satisfies a preset condition;

The executing unit 403 is configured to perform a recording operation in response to the recording instruction.

In a possible example, the motion parameters include a first motion parameter of a first head organ and a second motion parameter of a second head organ;

For generating the recording instruction, the generating unit 402 is specifically used for:

According to the preset first mapping relationship between the motion parameter of the first head organ and the recording range parameter, the target recording range parameter corresponding to the first motion parameter is determined;

According to the preset second mapping relationship between the motion parameters of the second head organ and the recording object, determine the target recording object corresponding to the second motion parameter;

A recording instruction is generated according to the target recording range parameter and the target recording object.

In a possible example, the motion parameters include: target amplitude and target direction of facial muscle movement; FIG. 4B is another modified structure of the speech processing apparatus described in FIG. 4A , which is compared with FIG. 4A , may also include: a determining unit 404, specifically as follows:

The determining unit 404 is configured to determine that the motion parameter satisfies the preset condition when the target amplitude is within a preset amplitude range and the target direction is within a preset direction range.

In a possible example, in the aspect of executing the recording operation, the executing unit 403 is specifically configured to:

When receiving an ambient sound signal, filtering the ambient sound signal to obtain a reference sound signal;

performing analog-to-digital conversion on the reference sound signal to obtain a target sound signal;

dividing the target sound signal into a plurality of sound signal segments according to time sequence;

respectively determining the energy value of each sound signal segment in the plurality of sound signal segments to obtain a plurality of energy values;

A target energy value greater than a preset energy threshold is selected from the plurality of energy values, and the sound signal segments corresponding to the target energy value are spliced in chronological order to obtain a final recording segment.

In a possible example, the wearable device is a wireless headset, the wireless headset includes a master headset and a slave headset, and the recording operation is implemented by the master headset and/or the slave headset.

The voice processing device described in the embodiments of the present application is applied to a wearable device, the wearable device is worn on the user's head, collects motion parameters of the user's head, and generates a recording instruction when the motion parameters meet preset conditions, In response to the recording instruction, the recording operation is performed, thereby, according to the user's head movement, the recording instruction is generated, and the recording function is realized, which improves the intelligence and convenience of the wearable device, and also improves the user experience.

Embodiments of the present application further provide a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program causes the computer to execute part or all of the steps of any method described in the above method embodiments , the above computer includes electronic equipment.

Embodiments of the present application further provide a computer program product, where the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute any one of the method embodiments described above. some or all of the steps of the method. The computer program product may be a software installation package, and the computer includes an electronic device.

It should be noted that, for the sake of simple description, the foregoing method embodiments are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited by the described action sequence. Because in accordance with the present application, certain steps may be performed in other orders or concurrently. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the device embodiments described above are only illustrative. For example, the division of the above-mentioned units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated. to another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical or other forms.

The units described above as separate components may or may not be physically separated, and components shown as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

The above-mentioned integrated units, if implemented in the form of software functional units and sold or used as independent products, may be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence, or the part that contributes to the prior art, or all or part of the technical solution, and the computer software product is stored in a memory, Several instructions are included to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the above-mentioned methods in the various embodiments of the present application. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable memory, and the memory can include: a flash disk , Read-only memory (English: Read-Only Memory, referred to as: ROM), random access device (English: Random Access Memory, referred to as: RAM), magnetic disk or optical disk, etc.

The embodiments of the present application have been introduced in detail above, and the principles and implementations of the present application are described in this paper by using specific examples. The descriptions of the above embodiments are only used to help understand the methods and core ideas of the present application; at the same time, for Persons of ordinary skill in the art, based on the idea of the present application, may have changes in the specific implementation manner and application scope. In summary, the contents of this specification should not be construed as limitations on the present application.

Claims (11)

1. A wearable device, characterized in that, it is applied to a wearable device, the wearable device is worn on the head of a user, and the wearable device includes a storage and processing circuit, and a device connected to the storage and processing circuit. sensors and audio components, which, The sensor is used to collect motion parameters of the user's head, wherein the motion parameters include a first motion parameter of a first head organ and a second motion parameter of a second head organ; The storage and processing circuit is used to generate a recording instruction when the motion parameter meets a preset condition; the audio component, configured to perform a recording operation in response to the recording instruction; Wherein, in the aspect of generating the recording instruction, the storage and processing circuit is specifically used for: According to the preset first mapping relationship between the motion parameter of the first head organ and the recording range parameter, the target recording range parameter corresponding to the first motion parameter is determined, wherein the recording range parameter includes the recording distance, the recording direction, recording volume, recording frequency, recording duration; According to the preset second mapping relationship between the motion parameters of the second head organ and the recording object, determine the target recording object corresponding to the second motion parameter; A recording instruction is generated according to the target recording range parameter and the target recording object. 2. The wearable device according to claim 1, wherein the motion parameters include: target amplitude and target direction of facial muscle movement; the storage and processing circuit is also specifically used for: When the target amplitude is within a preset amplitude range and the target direction is within a preset direction range, it is determined that the motion parameter satisfies the preset condition. 3. The wearable device according to claim 1, wherein, in the aspect of performing the recording operation, the audio component is specifically used for: When receiving an ambient sound signal, filtering the ambient sound signal to obtain a reference sound signal; performing analog-to-digital conversion on the reference sound signal to obtain a target sound signal; dividing the target sound signal into a plurality of sound signal segments according to time sequence; respectively determining the energy value of each sound signal segment in the plurality of sound signal segments to obtain a plurality of energy values; A target energy value greater than a preset energy threshold is selected from the plurality of energy values, and the sound signal segments corresponding to the target energy value are spliced in chronological order to obtain a final recording segment. 4. The wearable device according to any one of claims 1-3, wherein the wearable device is a wireless earphone, the wireless earphone comprises a master earphone and a slave earphone, and the recording operation is performed by the master earphone. The headset and/or the slave headset is implemented. 5. A voice processing method, characterized in that, applied to a wearable device, the wearable device being worn on a user's head, the method comprising: collecting motion parameters of the user's head, wherein the motion parameters include a first motion parameter of a first head organ and a second motion parameter of a second head organ; When the motion parameter satisfies the preset condition, generating a recording instruction; In response to the recording instruction, perform a recording operation; Wherein, the generating a recording instruction includes: According to the preset first mapping relationship between the motion parameter of the first head organ and the recording range parameter, the target recording range parameter corresponding to the first motion parameter is determined, wherein the recording range parameter includes the recording distance, the recording direction, recording volume, recording frequency, recording duration; According to the preset second mapping relationship between the motion parameters of the second head organ and the recording object, determine the target recording object corresponding to the second motion parameter; A recording instruction is generated according to the target recording range parameter and the target recording object. 6. The method according to claim 5, wherein the motion parameters include: target amplitude and target direction of facial muscle movement; the method further comprises: When the target amplitude is within a preset amplitude range and the target direction is within a preset direction range, it is determined that the motion parameter satisfies the preset condition. 7. The method according to claim 5, wherein the performing a recording operation comprises: When receiving an ambient sound signal, filtering the ambient sound signal to obtain a reference sound signal; performing analog-to-digital conversion on the reference sound signal to obtain a target sound signal; dividing the target sound signal into a plurality of sound signal segments according to time sequence; respectively determining the energy value of each sound signal segment in the plurality of sound signal segments to obtain a plurality of energy values; A target energy value greater than a preset energy threshold is selected from the plurality of energy values, and the sound signal segments corresponding to the target energy value are spliced in chronological order to obtain a final recording segment. 8. The method according to any one of claims 5-7, wherein the wearable device is a wireless headset, the wireless headset comprises a master headset and a slave headset, and the recording operation is performed by the master headset and the slave headset. / or the implementation from the headset. 9. A voice processing device, characterized in that it is applied to a wearable device, wherein the wearable device is worn on the head of a user, and the voice processing device comprises a collection unit, a generation unit and an execution unit, wherein: the collection unit, configured to collect motion parameters of the user's head, wherein the motion parameters include a first motion parameter of a first head organ and a second motion parameter of a second head organ; The generating unit is configured to generate a recording instruction when the motion parameter satisfies a preset condition; The execution unit is configured to perform a recording operation in response to the recording instruction; Wherein, the generating unit is specifically used for: According to the preset first mapping relationship between the motion parameter of the first head organ and the recording range parameter, the target recording range parameter corresponding to the first motion parameter is determined, wherein the recording range parameter includes the recording distance, the recording direction, recording volume, recording frequency, recording duration; According to the preset second mapping relationship between the motion parameters of the second head organ and the recording object, determine the target recording object corresponding to the second motion parameter; A recording instruction is generated according to the target recording range parameter and the target recording object. 10. A wearable device, comprising a processor, a memory, a communication interface, and one or more programs, the one or more programs being stored in the memory and configured to be processed by the processor executable, the program comprising instructions for performing the steps in the method of any of claims 5-8. 11. A computer-readable storage medium, characterized by storing a computer program for electronic data exchange, wherein the computer program causes a computer to perform the method according to any one of claims 5-8.

Images