CN111880988B - Voiceprint wake-up log collection method and device - Google Patents

Abstract

The embodiment of the invention discloses a method and a device for collecting voiceprint wake-up logs, which relate to the technical field of log collection and solve the problem of lack of marks in the collected voiceprint wake-up logs in the prior art. The method includes: receiving a voiceprint wake-up input; performing voiceprint wake-up verification on the voiceprint wake-up input; if the voiceprint wake-up verification fails, acquiring a first reception result; the first reception result is within a first preset duration The wake-up input is received, or the wake-up input is not received within the first preset duration; if the voiceprint wake-up verification is passed, the second reception result is obtained; the second reception result is received within the second preset duration. control instructions, or no valid control instructions are received within a second preset time period; a voiceprint wake-up log is generated, and a mark of the voiceprint wake-up log is determined according to the first reception result or the second reception result. The embodiment of the present invention is used for the collection of voiceprint wake-up logs.

Description

A voiceprint wake-up log collection method and device

technical field

The embodiments of the present invention relate to the technical field of log collection, and in particular, to a method and device for collecting voiceprint wake-up logs.

Background technique

The voiceprint feature is one of the important biological characteristics of the human body and has strong individual specificity. It is often used in voiceprint recognition, voiceprint authentication and other fields as a feature of identity authentication. With the rapid development of voice processing technology, voiceprint wake-up technology has been widely used in terminal products that support the voice wake-up function. In the research and development process of voiceprint wake-up devices, in order to improve user experience, R&D engineers need a large number of voiceprint wake-up logs to analyze user false wake-up and normal wake-up data, so as to adjust the algorithm threshold or determine the algorithm model based on false wake-up and normal wake-up data direction of optimization.

At present, although voiceprint wake-up logs can be collected based on the uploaded work logs of voiceprint wake-up devices, the collected voiceprint wake-up logs lack marks and cannot be directly used for algorithm model optimization or algorithm threshold adjustment. Voiceprint wake-up logs are marked before they can be used to optimize the algorithm model or adjust the algorithm threshold. In the prior art, there are mainly two ways to mark the voiceprint wake-up log, one is to manually mark the voiceprint wake-up log, and the other is to mark the voiceprint wake-up log through a marking algorithm. Manually marking voiceprint wake-up logs requires a lot of manpower and is very inefficient, and cannot meet the needs of massive voiceprint wake-up log collection. Although marking the voiceprint wake-up log by the marking algorithm can improve the marking efficiency of the voiceprint wake-up log, due to the lack of user confirmation, the accuracy of marking the voiceprint wake-up log cannot be guaranteed.

Contents of the invention

Embodiments of the present invention provide a wake-up log collection method and device to solve the problem in the prior art that the collected voiceprint wake-up logs lack marks and cannot be directly used for algorithm model optimization or algorithm threshold adjustment.

In order to solve the above-mentioned technical problems, the embodiment of the present invention is implemented as follows:

In the first aspect, the embodiment of the present invention provides a voiceprint wake-up log collection method, including:

Receive voiceprint wake-up input;

Perform voiceprint wake-up verification on the voiceprint wake-up input;

In the case that the voiceprint wake-up verification fails, a first receiving result is obtained; the first receiving result is that a wake-up input is received within a first preset time length, or is not received within the first preset time length to wake-up input;

In the case that the voiceprint wake-up verification is passed, a second receiving result is obtained; the second receiving result is that a valid control instruction is received within a second preset time period, or is not received within the second preset time period To effective control instructions;

A voiceprint wakeup log is generated, and a mark of the voiceprint wakeup log is determined according to the first receiving result or the second receiving result.

In the second aspect, a voiceprint wake-up log collection device is provided, including:

The receiving unit is used to receive voiceprint wake-up input;

The verification unit is configured to perform voiceprint wake-up verification on the voiceprint wake-up input;

The first acquiring unit is configured to acquire a first receiving result when the voiceprint wake-up verification fails; the first receiving result is that a wake-up input is received within a first preset time period, or the first receiving result is A wake-up input is not received within a preset period of time;

The second acquiring unit is configured to acquire a second receiving result when the voiceprint wake-up verification is passed; the second receiving result is that a valid control instruction is received within a second preset time period, or within the second preset time period 2. No valid control command is received within the preset time period;

A generating unit, configured to generate a voiceprint wake-up log;

A marking unit, configured to determine a mark of the voiceprint wake-up log according to the first receiving result or the second receiving result.

In a third aspect, a terminal device is provided, including: a processor, a memory, and a computer program stored on the memory and operable on the processor, when the computer program is executed by the processor, the In one aspect, the steps of the voiceprint wake-up log collection method.

In a fourth aspect, a computer-readable storage medium is provided, including: a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the voiceprint wake-up log collection method as described in the first aspect is implemented A step of.

In the voiceprint wake-up log collection method provided by the embodiment of the present invention, after receiving the voiceprint wake-up input, the voiceprint wake-up verification is first performed on the voiceprint wake-up input, and if the voiceprint wake-up verification fails, the acquisition is A wake-up input is received within the first preset time period or the first reception result is that no wake-up input is received within the first preset time length. If the voiceprint wake-up verification is passed, it is obtained as A valid control command is received within a preset time period or a second reception result of not receiving a valid control command within the second preset time period, and finally a voiceprint wake-up log is generated, and according to the first reception result or the The second receiving result determines the mark of the voiceprint wake-up log. Since the embodiment of the present invention can obtain the first receiving result or the second receiving result according to the passing of the voiceprint wake-up verification, and determine the mark of the generated voiceprint wake-up log according to the first receiving result or the second receiving result, the implementation of the present invention For example, the voiceprint wake-up log can be automatically marked, so that the collected voiceprint wake-up log has an identification, and then the collected voiceprint wake-up log can be directly used for the optimization of the algorithm model or the adjustment of the algorithm threshold.

Description of drawings

FIG. 1 is a flow chart 1 of steps of a voiceprint wake-up log collection method provided by an embodiment of the present invention;

FIG. 2 is a schematic structural diagram of a terminal device supporting voiceprint wake-up provided by an embodiment of the present invention;

FIG. 3 is a flow chart 2 of the steps of the voiceprint wake-up log collection method provided by the embodiment of the present invention;

FIG. 4 is a flow chart three of steps of the voiceprint wake-up log collection method provided by the embodiment of the present invention;

Fig. 5 is a schematic structural diagram of a voiceprint wake-up log collection device provided by an embodiment of the present invention;

FIG. 6 is a second structural schematic diagram of a voiceprint wake-up log collection device provided by an embodiment of the present invention;

FIG. 7 is a schematic diagram of a hardware structure of a terminal device provided by an embodiment of the present invention.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

The terms "first" and "second" in the specification and claims of the present invention are used to distinguish different objects, rather than to describe a specific order of objects. For example, first device, second device, etc. are used to distinguish different devices, not to describe a specific order of devices.

It should be noted that, in the embodiments of the present invention, words such as "exemplary" or "for example" are used for example, illustration or illustration. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present invention shall not be construed as being more preferred or more advantageous than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete manner.

The terminal device in the embodiment of the present invention may be an intelligent peripheral device, a mobile terminal device, or a non-mobile terminal device. The mobile terminal device can be a terminal device, a tablet computer, a notebook computer, a handheld computer, a vehicle terminal device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA). ), etc.; the non-mobile terminal device may be a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which are not specifically limited in this embodiment of the present invention.

The voiceprint wake-up log collection method provided by the embodiment of the present invention can be implemented by a voiceprint wake-up log collection device as an execution subject, or by a terminal device as an execution subject.

It should be noted that the apparatus for collecting voiceprint wake-up logs in the embodiment of the present invention may be a terminal device, or may be a functional module or a functional entity built in the terminal device.

An embodiment of the present invention provides a voiceprint wake-up log collection method. As shown in FIG. 1, the voiceprint wake-up log collection method includes the following steps S101 to S105:

S101. Receive voiceprint wake-up input.

The voiceprint wake-up input in the embodiment of the present invention is a voice input, and the voice input may be a voice input input by a user of the terminal device to wake up the terminal device, or a voice input entered by mistake by a user of the terminal device, or Speech input by mistake for another user or object.

S102. Perform voiceprint wakeup verification on the voiceprint wakeup input.

Exemplarily, as shown in FIG. 2 , the terminal device may include: a primary verification module 21 , a secondary verification module 22 and a voiceprint verification module 23 . Among them, the first-level verification module 21 runs on a low-power digital processor (Digital SignalProcessor, DSP), and the second-level verification module 22 and voiceprint verification module 23 run on the central processing unit (Central Processing Unit, CPU) of the terminal device . In the standby state, the first-level verification module 21 is always in the activated state, monitors and receives voice information, and determines whether there is a voiceprint wake-up input in the received information. The secondary verification module 22 and the voiceprint verification module 23, only after the primary verification module 21 determines that there is a voiceprint wake-up input, will they start and further perform voiceprint wake-up verification on the voiceprint wake-up input, when the secondary verification module 22 determines The voiceprint wake-up input includes a wake-up word, and the voiceprint verification module 23 determines that the voiceprint of the voiceprint wake-up input matches the preset voiceprint, then it is determined that the voiceprint wake-up verification passes, and then wakes up the terminal device; and if the secondary verification module 22 determines The voiceprint wake-up input does not contain a wake-up word, or although the secondary verification module 22 determines that the voiceprint wake-up input contains a wake-up word, but the voiceprint verification module 23 determines that the voiceprint of the voiceprint wake-up input does not match the preset voiceprint, then it is determined that the voiceprint wake-up input does not match the preset voiceprint. If the wake-up verification fails, the terminal device will not be woken up.

In the above step S102, if the voiceprint wake-up verification fails, the following step S103 is performed; if the voiceprint wake-up verification passes, the following step S104 is performed.

S103. Acquire a first receiving result.

Wherein, the first receiving result is that the wake-up input is received within the first preset time period, or the wake-up input is not received within the first preset time period.

Specifically, when the voiceprint wake-up verification fails, a timer can be started immediately, and the duration of the timer can be set to the first preset duration. Before the timer timing ends, continuously monitor whether the wake-up input is received again; if the wake-up input is received again before the timer timing ends, the first result is determined to be that the wake-up input is received within the first preset duration. If the wake-up input is not received after the countdown of the timer expires, the first result of determination is that the wake-up input is not received within the first preset time period.

Exemplarily, the first preset duration may be 15 seconds.

It should be noted that the wake-up input received within the first preset time period may be a voiceprint wake-up input input again, or other wake-up input, for example: a wake-up input input by the user through a button on the terminal device, or A wakeup input entered by the user through a specific action.

S104. Acquire a second receiving result.

Wherein, the second receiving result is that a valid control command is received within a second preset time period, or no valid control command is received within a second preset time period.

Specifically, when the voiceprint wake-up verification is passed, a timer can be started immediately, and the duration of the timer can be set to the second preset duration. Before the timer ends, continuously monitor whether an effective control instruction is received; if an effective control instruction is received before the timer ends, the second result is determined to be that an effective control instruction has been received within the second preset duration, if in If the effective control instruction is not received after the timer expires, the second result is determined to be that no effective control instruction is received within the second preset time period.

Exemplarily, the second preset duration may be 5 seconds.

The valid control instructions in the embodiments of the present invention refer to control instructions that the terminal device can understand, including control instructions that the terminal device can understand but cannot execute. For example: the terminal device is a smart speaker, and the control command is "I want to watch TV", the smart speaker can understand the intention of the control command to turn on the TV, but there is no TV that the smart speaker can control. The control command cannot be executed, but it does not affect the validity of the control command.

S105. Generate a voiceprint wakeup log, and determine a mark of the voiceprint wakeup log according to the first receiving result or the second receiving result.

It should be noted that the voiceprint wake-up log collection method provided by the embodiment of the present invention can also configure whether the terminal device collects voiceprint wake-up logs based on user requirements. If the terminal device is configured to collect voiceprint wake-up logs, the above implementation In the voiceprint wake-up log collection method provided in the example, if the terminal device is configured not to collect voiceprint wake-up logs, the terminal device responds to the voiceprint wake-up input and executes control commands, but does not collect voiceprint wake-up logs.

In the voiceprint wake-up log collection method provided by the embodiment of the present invention, after the voiceprint wake-up input is received, the voiceprint wake-up verification is first performed on the voiceprint wake-up input, and if the voiceprint wake-up verification fails, it is obtained as the first Received the wake-up input within the preset time period or received the first reception result of not receiving the wake-up input within the first preset time period. The control instruction or the second reception result that no effective control instruction is received within the second preset time period, and finally generate a voiceprint wake-up log, and determine the mark of the voiceprint wake-up log according to the first reception result or the second reception result. Since the embodiment of the present invention can obtain the first receiving result or the second receiving result according to the passing of the voiceprint wake-up verification, and determine the mark of the generated voiceprint wake-up log according to the first receiving result or the second receiving result, the implementation of the present invention For example, the voiceprint wake-up log can be automatically marked, so that the collected voiceprint wake-up log has an identification, and then the collected voiceprint wake-up log can be directly used for the optimization of the algorithm model or the adjustment of the algorithm threshold.

The specific implementation and principle of the above step S105 (generating a voiceprint wakeup log, and determining the flag of the voiceprint wakeup log according to the first receiving result or the second receiving result) will be described in detail below. Referring to Fig. 3, generate a voiceprint wake-up log, and determine the mark of the voiceprint wake-up log according to the first receiving result or the second receiving result, including:

method one,

When the first receiving result is that the wake-up input is received within the first preset time period, the following step S301 is performed.

S301. Generate a voiceprint wake-up log, and determine the mark of the voiceprint wake-up log as the first mark.

Wherein, the first mark is used to mark the voiceprint wake-up log that wants to wake up the terminal device but fails to wake up the terminal device.

Generally speaking, when the user wants to wake up the terminal device, if the voiceprint wake-up input is input to the terminal device but fails to wake up the terminal device, the user is likely to use the same method or other methods to wake up the terminal device in a short time. The device wakes up. In the above embodiment, the terminal device first receives a voiceprint wake-up input that fails the voiceprint wake-up verification, and then receives another wake-up input within the first preset time period (very short time), so the first time it receives The received voiceprint wake-up input is likely to be the voiceprint wake-up input that the user wants to wake up the terminal device but fails the voiceprint wake-up verification, so it is determined that the mark of the voiceprint wake-up log is the first mark.

Based on the voiceprint wake-up log marked as the first mark, the algorithm model can be optimized or the algorithm threshold can be adjusted, so that the voiceprint wake-up input is easier to pass the voiceprint wake-up verification.

Method two,

When the first receiving result is that no wake-up input is received within the first preset time period, the following step S302 is performed.

S302. Generate a voiceprint wake-up log, and determine a flag of the voiceprint wake-up log as a second flag.

Wherein, the second mark is used to mark false wake-up voiceprint wake-up logs that fail the voiceprint wake-up verification.

Similarly, when the user wants to wake up the terminal device, if the voiceprint wake-up input is input to the terminal device but fails to wake up the terminal device, the user is likely to use the same method or other methods to wake up the terminal device in a short time. wake. In the above embodiment, the terminal device received a voiceprint wake-up input that failed the voiceprint wake-up verification, and the terminal device was successfully woken up, but the user did not continue to wake up the terminal device, so the received voiceprint wake-up input is likely to be The sound that does not contain the wake-up word from the user to which the terminal device belongs, or the sound that is mistakenly made by other users or objects is determined as the voiceprint wake-up input, so the mark of the voiceprint wake-up log is determined as the second mark.

Based on the voiceprint wake-up log marked as the second mark, the algorithm model can be optimized or the algorithm threshold can be adjusted, so as to make the recognition of the voiceprint wake-up input more stringent, avoid frequently starting the verification of the wake-up word and voiceprint, and thus save the terminal The power consumption of the device.

Method three,

When the second receiving result is that a valid control instruction is received within the second preset time period, the following step S303 is performed.

S303. Generate a voiceprint wakeup log, and determine that the flag of the voiceprint wakeup log is a third flag.

Wherein, the third mark is used to mark the voiceprint wake-up log of the terminal device being woken up normally.

Generally, when the user successfully wakes up the terminal device, the user will immediately input a control command to the terminal device. If the terminal device is successfully woken up but does not receive the control command input by the user within a period of time, the terminal device is likely to was awakened by mistake. In the above embodiment, the voiceprint wakeup input passes the voiceprint wakeup verification, the terminal device is successfully woken up, and a valid control command is received within the second preset time period, so the flag of the voiceprint wakeup log is determined to be the third flag.

Method 4.

When the second receiving result is that no valid control instruction is received within the second preset time period, the following step S304 is performed.

S304. Generate a voiceprint wakeup log, and determine that the flag of the voiceprint wakeup log is a fourth flag.

Wherein, the fourth mark is used to mark the wake-up log of the false wake-up voiceprint that has passed the voiceprint wake-up verification.

Similarly, when the user successfully wakes up the terminal device, the user will immediately input a control command to the terminal device. If the terminal device is successfully woken up but does not receive the control command input by the user within a period of time, the terminal device is likely to be activated. awakened by mistake. In the above embodiment, the voiceprint wake-up input has passed the voiceprint wake-up verification, and the terminal device is successfully woken up, but no valid control command is received within the second preset time period, so the flag of the voiceprint wake-up log is determined to be the fourth flag .

Based on the voiceprint wake-up log marked as the fourth mark, the algorithm model can be optimized or the algorithm threshold can be adjusted, so as to make the voiceprint wake-up verification more stringent, avoid frequent wake-up of the terminal device, and thus save the power consumption of the terminal device and improve the user experience. .

As an optional implementation manner of the embodiment of the present invention, on the basis of the foregoing embodiments, the voiceprint wake-up log collection method provided by the embodiment of the present invention further includes: uploading the collected voiceprint wake-up logs. Referring to Figure 4, the method flow for uploading the collected voiceprint wake-up log includes:

S401. Determine whether the current network state is a preset network state.

Optionally, the preset network status may be at least one of access to WIFI, access to a mobile network, and network signal quality reaching a threshold network signal quality.

In the above step S401, if it is determined that the current network state is the default network state, then perform the following step S402; if it is determined that the current network state is not the default network state, then perform the following step S403 and subsequent steps.

S402. Upload all locally stored voiceprint wake-up logs and marks of the voiceprint wake-up logs, and delete the uploaded voiceprint wake-up logs and marks of the voiceprint wake-up logs.

S403. Determine whether the number of voiceprint wake-up logs stored locally is greater than a preset threshold.

In the above step S403, if the number of locally stored voiceprint wake-up logs is greater than the preset threshold, the following step S404 is performed, and if the number of locally stored voiceprint wake-up logs is less than or equal to the preset threshold, it can be determined that the voiceprint wake-up The storage of the log does not take up too much storage space, and there is no need to process the voiceprint wake-up log.

S404. Delete the voiceprint wakeup log with the earliest time stamp among the locally stored voiceprint wakeup logs.

When the number of voiceprint wake-up logs stored locally is greater than the preset threshold, delete the voiceprint wake-up log with the earliest time stamp in the locally stored voiceprint wake-up logs, which can avoid excessive storage of voiceprint wake-up logs, thereby avoiding The collection of voiceprint wake-up logs affects the performance of terminal devices.

Based on the same inventive concept, as an implementation of the above method, an embodiment of the present invention also provides a voiceprint wakeup log collection device that implements the voiceprint wakeup log collection method provided by the above method embodiment. This embodiment is the same as the aforementioned method embodiment Correspondingly, for ease of reading, this embodiment does not repeat the details of the foregoing method embodiments one by one, but it should be clear that the voiceprint wake-up log collection device in this embodiment can correspondingly implement all the content in the foregoing method embodiments .

FIG. 5 is a schematic structural diagram of a voiceprint wake-up log collection device provided in an embodiment of the present invention. Referring to FIG. 5 , the voiceprint wake-up log collection device 500 provided in an embodiment of the present invention includes:

A receiving unit 51, configured to receive voiceprint wake-up input;

The verification unit 52 performs voiceprint wake-up verification on the voiceprint wake-up input;

The first acquiring unit 53 is configured to acquire the first receiving result when the voiceprint wake-up verification fails; the first receiving result is that the wake-up input is received within the first preset time length, or within the first preset time length Wake-up input not received;

The second acquiring unit 54 is configured to acquire a second receiving result when the voiceprint wake-up verification is passed; the second receiving result is that a valid control instruction is received within the second preset time period, or within the second preset time period No effective control command has been received;

A generating unit 55, configured to generate a voiceprint wake-up log;

The marking unit 56 is configured to determine the marking of the voiceprint wake-up log according to the first receiving result or the second receiving result.

As an optional implementation of the embodiment of the present invention, the marking unit 56 is specifically configured to determine that the voiceprint wake-up log is marked as the first when the first receiving result is that the wake-up input is received within the first preset time period a mark;

Wherein, the first mark is used to mark the voiceprint wake-up log that wants to wake up the terminal device but fails to wake up the terminal device.

As an optional implementation of the embodiment of the present invention, the marking unit 56 is specifically configured to determine that the voiceprint wake-up log is marked as second mark;

Wherein, the second mark is used to mark false wake-up voiceprint wake-up logs that fail the voiceprint wake-up verification.

As an optional implementation of the embodiment of the present invention, the marking unit 56 is specifically configured to determine that the marking of the voiceprint wake-up log is third mark;

Wherein, the third mark is used to mark the voiceprint wake-up log of the terminal device being woken up normally.

As an optional implementation of the embodiment of the present invention, the marking unit 56 is specifically configured to determine the marking of the voiceprint wake-up log when the second receiving result is that no valid control instruction is received within the second preset time period for the fourth mark;

Wherein, the fourth mark is used to mark the wake-up log of the false wake-up voiceprint that has passed the voiceprint wake-up verification.

As an optional implementation of the embodiment of the present invention, referring to FIG. 6 , the voiceprint wake-up log collection device 500 further includes:

The processing unit 57 is configured to determine whether the current network state is a preset network state after generating the voiceprint wake-up log and determining the mark of the voiceprint wake-up log according to the first receiving result or the second receiving result;

The sending unit 58 is configured to upload all the voiceprint wake-up logs and the marks of the voiceprint wake-up logs stored locally when the current network state is determined to be the preset network state;

The deletion unit 59 is configured to delete the uploaded voiceprint wake-up log and the mark of the voiceprint wake-up log.

As an optional implementation of the embodiment of the present invention, the processing unit 57 is further configured to determine whether the number of locally stored voiceprint wake-up logs is greater than a preset threshold when it is determined that the current network state is not the preset network state ;

The deletion unit 59 is further configured to delete the voiceprint wakeup log with the earliest time stamp among the locally stored voiceprint wakeup logs when the number of locally stored voiceprint wakeup logs is greater than a preset threshold.

The voiceprint wake-up log collection device provided by the embodiment of the present invention, after receiving the voiceprint wake-up input through the receiving unit, first performs voiceprint wake-up verification on the voiceprint wake-up input through the verification unit, and if the voiceprint wake-up verification fails , the first receiving result is acquired by the first acquisition unit as the wake-up input is received within the first preset time period or the wake-up input is not received within the first preset time length, and when the voiceprint wake-up verification passes, through The second acquisition unit acquires the second receiving result of receiving an effective control instruction within the second preset time length or not receiving an effective control instruction within the second preset time length, and finally the generation unit generates a voiceprint wake-up log, and the marking unit Determine the mark of the voiceprint wake-up log according to the first receiving result or the second receiving result. Since the embodiment of the present invention can obtain the first receiving result or the second receiving result according to the passing of the voiceprint wake-up verification, and determine the mark of the generated voiceprint wake-up log according to the first receiving result or the second receiving result, the implementation of the present invention For example, the voiceprint wake-up log can be automatically marked, so that the collected voiceprint wake-up log has an identification, and then the collected voiceprint wake-up log can be directly used for the optimization of the algorithm model or the adjustment of the algorithm threshold.

7 is a schematic diagram of a hardware structure of a terminal device implementing various embodiments of the present invention. As shown in FIG. , a display unit 740 , a sensor 750 , an audio circuit 760 , a wireless fidelity (wireless fidelity, WiFi) module 770 , a processor 780 , and a power supply 790 and other components. Wherein, the radio frequency circuit 710 includes a receiver 710 and a transmitter 712 . Those skilled in the art can understand that the structure of the terminal device shown in FIG. 7 does not constitute a limitation on the terminal device, and may include more or less components than those shown in the figure, or combine some components, or arrange different components.

The RF circuit 710 can be used for sending and receiving information or receiving and sending signals during a call. In particular, after receiving the downlink information of the base station, it is processed by the processor 780; in addition, the designed uplink data is sent to the base station. Generally, the RF circuit 710 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (low noise amplifier, LNA), a duplexer, and the like. In addition, RF circuitry 710 may also communicate with networks and other devices via wireless communications. The above wireless communication can use any communication standard or protocol, including but not limited to global system of mobile communication (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access) , CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), long term evolution (long term evolution, LTE), email, short message service (short messaging service, SMS), etc.

The memory 720 may be used to store software programs and modules, and the processor 780 executes various functional applications and data processing of the terminal device by running the software programs and modules stored in the memory 720 . The memory 720 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); Data created by the use of terminal equipment (such as audio data, phonebook, etc.), etc. In addition, the memory 720 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

The input unit 730 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the terminal device. Specifically, the input unit 730 may include a touch panel 731 and other input devices 732 . The touch panel 731, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 731 or near the touch panel 731). operation), and drive the corresponding connection device according to the preset program. Optionally, the touch panel 731 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the to the processor 780, and can receive and execute commands sent by the processor 780. In addition, the touch panel 731 can be realized by various methods such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 731 , the input unit 730 may also include other input devices 732 . Specifically, other input devices 732 may include but not limited to one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), trackball, mouse, joystick, and the like.

The display unit 740 may be used to display information input by or provided to the user and various menus of the terminal device. The display unit 740 may include a display panel 741. Optionally, the display panel 741 may be configured in the form of a liquid crystal display (liquid crystal display, LCD) or an organic light-emitting diode (organic light-Emitting diode, OLED). Further, the touch panel 731 can cover the display panel 741, and when the touch panel 731 detects a touch operation on or near it, it sends it to the processor 780 to determine the touch event, and then the processor 780 according to the touch event A corresponding visual output is provided on the display panel 741 . Although in FIG. 7, the touch panel 731 and the display panel 741 are used as two independent components to realize the input and input functions of the terminal device, in some embodiments, the touch panel 731 and the display panel 741 can be integrated And realize the input and output functions of the terminal equipment.

The terminal device may also include at least one sensor 750, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 741 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 741 and the display panel 741 when the terminal device moves to the ear. / or backlighting. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used for applications that recognize the posture of terminal equipment (such as horizontal and vertical screen switching, Related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc.; as for the gyroscope, barometer, hygrometer, thermometer, infrared sensor and other sensors that can be configured on the terminal device, here No longer. In this embodiment of the present invention, the terminal device may include an acceleration sensor, a depth sensor, or a distance sensor.

The audio circuit 760, the speaker 761, and the microphone 762 can provide an audio interface between the user and the terminal device. The audio circuit 760 can transmit the electrical signal converted from the received audio data to the speaker 761, and the speaker 761 converts it into an audio signal for output; After being received, it is converted into audio data, and then the audio data is processed by the output processor 780, and then sent to another terminal device through the RF circuit 710, or the audio data is output to the memory 720 for further processing.

WiFi is a short-distance wireless transmission technology. The terminal device can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 770, which provides users with wireless broadband Internet access. Although FIG. 7 shows a WiFi module 770, it can be understood that it is not an essential component of the terminal device, and can be completely omitted as required without changing the essence of the invention.

The processor 780 is the control center of the terminal equipment. It uses various interfaces and lines to connect various parts of the entire terminal equipment. By running or executing software programs and/or modules stored in the memory 720, and calling data stored in the memory 720 , execute various functions of the terminal equipment and process data, so as to monitor the terminal equipment as a whole. Optionally, the processor 780 may include one or more processing units; preferably, the processor 780 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc. , the modem processor mainly handles wireless communications. It can be understood that the foregoing modem processor may not be integrated into the processor 780 .

The terminal device also includes a power supply 790 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 780 through the power management system, so that functions such as management of charging, discharging, and power consumption management can be realized through the power management system. Although not shown, the terminal device may also include a camera, a Bluetooth module, etc., which will not be repeated here.

In the embodiment of the present invention, the above-mentioned microphone 762 is specifically used to receive the voiceprint wake-up input; the processor 780 is used to perform voiceprint wake-up verification on the voiceprint wake-up input; the microphone 762 is also used to determine that the voiceprint wake-up verification has failed In the case of the voiceprint wake-up, the first receiving result is obtained, and in the case where the processor 780 determines that the voiceprint wake-up verification is passed, the second receiving result is obtained; the processor 780 is also used to generate a voiceprint wake-up log and to 2. The receiving result determines the mark of the voiceprint wake-up log;

Wherein, the first receiving result is that the wake-up input is received within the first preset time length, or the wake-up input is not received within the first preset time length; the second receiving result is that a valid control instruction is received within the second preset time length , or no valid control instruction is received within the second preset time period.

As an optional implementation manner of the embodiment of the present invention, the processor 780 is specifically configured to determine that the voiceprint wakeup log is marked as the first when the first receiving result is that the wakeup input is received within the first preset time period a mark;

Wherein, the first mark is used to mark the voiceprint wake-up log that wants to wake up the terminal device but fails to wake up the terminal device.

As an optional implementation manner of the embodiment of the present invention, the processor 780 is specifically configured to determine that the voiceprint wake-up log is marked as second mark;

Wherein, the second mark is used to mark false wake-up voiceprint wake-up logs that fail the voiceprint wake-up verification.

As an optional implementation manner of the embodiment of the present invention, the processor 780 is specifically configured to determine that the flag of the voiceprint wake-up log is third mark;

Wherein, the third mark is used to mark the voiceprint wake-up log of the terminal device being woken up normally.

As an optional implementation of the embodiment of the present invention, the processor 780 is specifically configured to determine the mark of the voiceprint wake-up log when the second receiving result is that no valid control instruction is received within the second preset time period for the fourth mark;

Wherein, the fourth mark is used to mark the wake-up log of the false wake-up voiceprint that has passed the voiceprint wake-up verification.

As an optional implementation of the embodiment of the present invention, the radio frequency circuit 710 is specifically configured to determine the current network wake-up log after generating the voiceprint wake-up log and determining the mark of the voiceprint wake-up log according to the first receiving result or the second receiving result. Whether the state is the default network state, and if the current network state is determined to be the default network state, upload all voiceprint wake-up logs and marks of voiceprint wake-up logs stored locally;

The memory 720 is specifically used to delete the uploaded voiceprint wake-up log and the mark of the voiceprint wake-up log.

As an optional implementation of the embodiment of the present invention, the processor 780 and the radio frequency circuit 77 are also used to determine whether the number of voiceprint wake-up logs stored locally is greater than preset threshold;

The memory 720 is further configured to delete the voiceprint wakeup log with the earliest time stamp among the locally stored voiceprint wakeup logs when the number of locally stored voiceprint wakeup logs is greater than a preset threshold.

An embodiment of the present invention also provides a terminal device. The terminal device may include: a processor, a memory, and a computer program stored in the memory and operable on the processor. When the computer program is executed by the processor, the above method can be implemented. The voiceprint wake-up log collection method provided in the example can achieve the same technical effect. To avoid repetition, it will not be repeated here.

An embodiment of the present invention provides a computer-readable storage medium, which is characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the voiceprint wake-up log collection method provided by the above method embodiment is implemented.

The first device, the second device, and the storage medium provided in the embodiment of the present invention can achieve the same technical effect as the voiceprint wake-up log collection method provided in the above method embodiment. In order to avoid repetition, the technical effect will not be repeated here. .

Wherein, the computer-readable storage medium may be a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on such an understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products are stored in a storage medium (such as ROM/RAM, disk, CD) contains several instructions to make a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods of various embodiments of the present invention.

Embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementations, and the above-mentioned specific implementations are only illustrative, rather than restrictive, and those of ordinary skill in the art will Under the enlightenment of the present invention, without departing from the gist of the present invention and the protection scope of the claims, many forms can also be made, all of which belong to the protection of the present invention.

Claims (9)

1. A voiceprint awakening log collection method, characterized in that, comprising: Receive voiceprint wake-up input; Perform voiceprint wake-up verification on the voiceprint wake-up input; In the case that the voiceprint wake-up verification fails, a first receiving result is obtained; the first receiving result is that a wake-up input is received within a first preset time length, or is not received within the first preset time length to wake-up input; In the case that the voiceprint wake-up verification is passed, a second receiving result is obtained; the second receiving result is that a valid control instruction is received within a second preset time period, or is not received within the second preset time period To effective control instructions; generating a voiceprint wake-up log, and determining a mark of the voiceprint wake-up log according to the first receiving result or the second receiving result; The generating the voiceprint wake-up log, and determining the mark of the voiceprint wake-up log according to the first receiving result or the second receiving result includes: When the first receiving result is that no wake-up input is received within the first preset time period, a voiceprint wake-up log is generated, and the mark of the voiceprint wake-up log is determined to be a second mark, and the second mark It is used to mark false wake-up voiceprint wake-up logs that fail the voiceprint wake-up verification. 2. The method according to claim 1, wherein the generating a voiceprint wake-up log, and determining the mark of the voiceprint wake-up log according to the first receiving result or the second receiving result comprises: In the case where the first receiving result is that a wake-up input is received within a first preset duration, a voiceprint wake-up log is generated, and the mark of the voiceprint wake-up log is determined to be the first mark; Wherein, the first mark is used to mark a voiceprint wake-up log that wants to wake up the terminal device but fails to wake up the terminal device. 3. The method according to claim 1, wherein the generating a voiceprint wake-up log, and determining the mark of the voiceprint wake-up log according to the first receiving result or the second receiving result comprises: When the second receiving result is that a valid control instruction is received within a second preset time period, a voiceprint wake-up log is generated, and the mark of the voiceprint wake-up log is determined to be a third mark; Wherein, the third mark is used to mark the voiceprint wake-up log of the terminal device being woken up normally. 4. The method according to claim 1, wherein the generating a voiceprint wake-up log, and determining the mark of the voiceprint wake-up log according to the first receiving result or the second receiving result comprises: When the second receiving result is that no effective control instruction is received within the second preset time period, a voiceprint wake-up log is generated, and the mark of the voiceprint wake-up log is determined to be a fourth mark; Wherein, the fourth mark is used to mark the wake-up log of the false wake-up voiceprint that has passed the voiceprint wake-up verification. 5. The method according to any one of claims 1-4, characterized in that, after generating the voiceprint wake-up log, and determining the voiceprint wake-up log according to the first receiving result or the second receiving result After marking, the method also includes: Determine whether the current network state is a preset network state; If yes, upload all voiceprint wake-up logs and marks of voiceprint wake-up logs stored locally, and delete the uploaded voiceprint wake-up logs and marks of voiceprint wake-up logs. 6. The method according to claim 5, further comprising: If it is determined that the current network state is not the preset network state, it is judged whether the number of locally stored voiceprint wake-up logs is greater than a preset threshold; If the number of voiceprint wake-up logs stored locally is greater than the preset threshold, delete the voiceprint wake-up log with the earliest timestamp among the locally stored voiceprint wake-up logs. 7. A voiceprint wake-up log collection device, characterized in that it comprises: The receiving unit is used to receive voiceprint wake-up input; A verification unit, configured to perform voiceprint wake-up verification on the voiceprint wake-up input; The first acquiring unit is configured to acquire a first receiving result when the voiceprint wake-up verification fails; the first receiving result is that a wake-up input is received within a first preset time period, or the first receiving result is A wake-up input is not received within a preset period of time; The second acquiring unit is configured to acquire a second receiving result when the voiceprint wake-up verification is passed; the second receiving result is that a valid control instruction is received within a second preset time period, or within the second preset time period 2. No valid control command is received within the preset time period; A generating unit, configured to generate a voiceprint wake-up log; a marking unit, configured to determine the marking of the voiceprint wake-up log according to the first receiving result or the second receiving result; The marking unit is specifically configured to determine that the voiceprint wake-up log is marked as a second mark when the first receiving result is that no wake-up input is received within a first preset time period, and the second The mark is used to mark the voiceprint wake-up log that failed the voiceprint wake-up verification by false wakeup. 8. A terminal device, characterized in that it comprises: a processor, a memory, and a computer program stored on the memory and operable on the processor, when the computer program is executed by the processor, the following The steps of the voiceprint wake-up log collection method described in any one of claims 1 to 6. 9. A computer-readable storage medium, comprising: a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program according to any one of claims 1 to 6 is implemented. The steps of the voiceprint wake-up log collection method.

Images