CN110009206B - A timing voice scoring method, device, equipment and storage medium - Google Patents

Abstract

The invention discloses a timing voice scoring method, a timing voice scoring device, timing voice scoring equipment and a storage medium. The method comprises the steps that when a client detects interrupt process information, an interrupt time stamp and the residual time are obtained, trigger time before process interrupt is obtained according to the interrupt time stamp and the residual time, and the client pushes a local notification and recognizes scoring after timing to the trigger time. And after the evaluation is finished, the scoring information and the timing information are stored. The accuracy of timing is ensured, so that the reference of scoring is improved. Meanwhile, the invention reminds the user through popup window information and voice prompt when the process is interrupted, ensures normal scoring and improves user experience.

Description

A timing voice scoring method, device, equipment and storage medium

technical field

The invention relates to the field of data processing, in particular to a timing voice scoring method, device, equipment and storage medium.

Background technique

At present, in the test process of the car simulation driving platform, testers are usually required to score the degree of motion sickness during the test drive to provide reference for later equipment adjustments. The traditional method mainly relies on the tester to report the degree of motion sickness after the test drive. In the case of a long test drive, the reference value of the score is not high, so it is necessary to score regularly during the test. Existing solutions usually use smart devices for timing, and obtain ratings through voice at regular intervals. Although this method achieves timing scoring, timing will occur when there is an unexpected exit during the scoring process or the client is interrupted by other unexpected circumstances. The process is interrupted, resulting in inaccurate timing and affecting the reference value of scoring.

Contents of the invention

In order to overcome the deficiencies of the prior art, the object of the present invention is to provide a timing voice scoring method, device, equipment and storage medium, which can enable the client in the smart device to keep the timing process stable during the scoring process in practical applications, Improve the reference value of scoring.

The technical solution adopted by the present invention to solve its problem is: first aspect, the present invention provides a kind of timing voice scoring method, comprises the following steps:

The client obtains the timing interval and starts the timer, and if the client detects process interruption information, obtains the interruption timestamp and the remaining duration;

The client obtains the trigger time according to the interrupt timestamp and the remaining duration, creates local notification information and keeps the timer counting;

The client clocks to the trigger time, pushes the local notification information and recognizes the score value from the voice input to complete the score.

Further, the timing of the timer specifically includes the following steps:

The timer acquires the refresh rate of the screen;

If the timer detects that the screen is refreshed, the timer adds 1 to the count value of the counter;

If the count value of the counter is the same as the value of the refresh frequency, the timer executes timing for 1 second, and clears the count value.

Further, the local notification information includes pop-up window information and/or voice prompts.

Further, the client pushing the voice prompt further includes: the client acquiring the current operation type of the user equipment, if the current operation type is a system operation, the voice prompt pushed by the client is a prompt tone, otherwise the voice prompt is Pre-synthesized vocal cues.

Further, the step of identifying the scoring value from the voice input and completing the scoring includes: the client monitors the voice input, and if the client successfully acquires the voice information, recognizes the scoring value from the voice information, otherwise keeps monitoring.

In a second aspect, the present invention provides a timing speech scoring device, comprising the following devices:

The process interruption detection unit is used for the client to obtain the timing interval and start the timer, and if the client detects the process interruption information, obtain the interruption time stamp and the remaining duration;

Keeping the timing unit, used for the client to obtain the trigger time according to the interrupt timestamp and the remaining duration, create local notification information and keep the timer timing;

The scoring unit is used for the client to count to the trigger time, push the local notification information and recognize the scoring value from the voice input to complete the scoring.

Further, the following devices are also included:

A refresh rate acquisition unit, used for the timer to acquire the refresh rate of the screen;

A timer counting unit, configured to add 1 to the count value of the counter if the timer detects that the screen is refreshed;

A timer timing execution unit, configured to execute the timer for 1 second and clear the count value if the count value of the counter is the same as the value of the refresh frequency;

The voice prompt unit is used for the client to obtain the current operation type of the user equipment. If the current operation type is a system operation, the voice prompt pushed by the client is a prompt, otherwise the voice prompt is a pre-synthesized human voice prompt;

The voice information acquisition unit is used for the client to monitor the voice input, if the client successfully acquires the voice information, recognize the scoring value from the voice information, otherwise keep monitoring.

In a third aspect, the present invention provides a timing speech scoring device, including at least one control processor and a memory for communicating with at least one control processor; the memory stores instructions that can be executed by at least one control processor, and the instructions Executed by at least one control processor to enable the at least one control processor to perform the timed voice scoring method as described above.

In a fourth aspect, the present invention provides a computer-readable storage medium. The computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to make a computer execute the timing speech scoring method as described above.

In a fifth aspect, the present invention also provides a computer program product, the computer program product includes a computer program stored on a computer-readable storage medium, the computer program includes program instructions, and when the program instructions are executed by a computer , making the computer execute the timing voice scoring method as described above.

One or more technical solutions provided in the embodiments of the present invention have at least the following beneficial effects: the present invention adopts a timing voice scoring method, device, equipment and storage medium. When the client detects the interruption process information, it obtains the interruption time stamp and the remaining duration, and obtains the trigger time before the interruption of the process according to the interruption time stamp and the remaining duration. Compared with the technical solution in the prior art that can only restart the timing after the process is interrupted, the present invention can obtain the trigger time according to the timestamp and the remaining duration, ensuring the accuracy of timing, thereby improving the referentiality of scoring.

Description of drawings

The present invention will be further described below in conjunction with accompanying drawing and example.

Fig. 1 is the flow chart of a kind of timing speech scoring method that the first embodiment of the present invention provides;

Fig. 2 is a flow chart of timer counting in a kind of timing voice scoring method provided by the first embodiment of the present invention;

Fig. 3 is a complete step diagram of a timing voice scoring method provided in the first embodiment of the present invention;

Fig. 4 is a device schematic diagram of a timing speech scoring device provided by the second embodiment of the present invention;

Fig. 5 is a schematic structural diagram of a timing speech scoring device provided by the third embodiment of the present invention.

Detailed ways

At present, in the test process of the car simulation driving platform, testers are usually required to score the degree of motion sickness during the test drive to provide reference for later equipment adjustments. The traditional method mainly relies on the tester to report the degree of motion sickness after the test drive. In the case of a long test drive, the reference value of the score is not high, so it is necessary to score regularly during the test. Existing solutions usually use smart devices for timing, and obtain ratings through voice at regular intervals. Although this method achieves timing scoring, timing will occur when there is an unexpected exit during the scoring process or the client is interrupted by other unexpected circumstances. The process is interrupted, resulting in inaccurate timing and affecting the reference value of scoring.

Based on this, the present invention adopts a timing voice scoring method, device, equipment and storage medium. When the client detects the interruption process information, it obtains the interruption time stamp and the remaining duration, and obtains the trigger time before the interruption of the process according to the interruption time stamp and the remaining duration. Compared with the technical solution in the prior art that can only restart the timing after the process is interrupted, the present invention can obtain the trigger time according to the timestamp and the remaining duration, ensuring the accuracy of timing, thereby improving the referentiality of scoring.

In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

It should be noted that, if there is no conflict, various features in the embodiments of the present invention may be combined with each other, and all of them are within the protection scope of the present invention. In addition, although the functional modules are divided in the schematic diagram of the device, and the logical order is shown in the flowchart, in some cases, the division of modules in the device or the sequence shown in the flowchart can be performed in different ways. or the steps described.

With reference to Fig. 1, the first embodiment of the present invention provides a kind of timing speech scoring method, comprises the following steps:

Step S100, the client obtains the timing interval and starts the timer, and if the client detects process interruption information, obtains the interruption timestamp and remaining duration;

Step S200, the client obtains the trigger time according to the interrupt timestamp and the remaining duration, creates local notification information and keeps a timer;

Step S300, the client counts to the trigger time, pushes the local notification information and recognizes the score value from the voice input to complete the score.

Wherein, in this embodiment, step S100-step S300 is a step of scoring by a single time. If multiple timed scoring is involved, it is enough to execute step S100-step S300 in a loop until the cycle is completed. No more details will be given in this embodiment.

Wherein, in this embodiment, the timing interval can be a preset fixed value, or it can be manually input before timing each time. In this embodiment, it is preferable to manually input each time before timing, so that different time intervals can be set. , to meet the ratings of different needs.

Preferably, when inputting the timing interval in this embodiment, it also includes inputting the scoring times in the client. For example, if the input timing interval is 2 minutes and the scoring times is 10, then the client will obtain voice scoring every 2 minutes. Preferably, it also includes inputting a score value in the client, so as to judge whether the score recognized from the voice is within a normal range. For example, the score ranges from 1 to 5 points, and the score obtained from speech recognition is 6 points. Marking and recording abnormal scores in the client will help improve the accuracy of client scoring.

Wherein, in this embodiment, the process interruption information can be generated when the client exits, or it can be generated when the client transfers from the foreground to the background, for example, the APP running in the smart device of the client returns to the client desktop during operation , or receive a call during operation, etc.

Wherein, in this embodiment, the trigger time is the specific time of timing in the client, for example, the current timing is 5 seconds, the process interruption information is received, the interrupt timestamp is obtained as 00:00:05, and the timing interval is 15 seconds, then The remaining time is 10 seconds. At this time, the trigger time is set to 00:00:15, and the timing continues. When the timing time of the client reaches 00:00:15, it is considered that the trigger time has been reached, that is, the trigger time = interrupt timestamp + (timing interval - elapsed timed length).

Among them, in this embodiment, the local notification information can be generated when the process interruption information is received, and can also be generated when the timing is completed. In this embodiment, it is preferably generated when the process interruption information is received, so that when the timing is completed, push.

Preferably, in this embodiment, after completing all the timing and scoring operations, the client saves the acquired scoring and time information in the form of a binary data stream, and the saved file name is the time stamp when the scoring operation ends, It is beneficial to ensure the uniqueness of the obtained operation information, thereby ensuring the integrity of the data.

Referring to Fig. 2, further, in another embodiment of the present invention, the timing of the timer specifically includes the following steps:

Step S210, the timer obtains the refresh rate of the screen;

Step S220, if the timer detects that the screen is refreshed, the timer adds 1 to the count value of the counter;

Step S230, if the count value of the counter is the same as the value of the refresh frequency, the timer executes timing for 1 second, and clears the count value.

Wherein, in this embodiment, timing can be performed by any type of timer, such as NSTimer class and CADisplayLink class, as long as it can realize timing. In this embodiment, the CADisplayLink class is preferably used. After the CADisplayLink class is registered in the runloop in a specific mode, whenever the screen display content is refreshed, the runloop will send a specified selector message to the target specified by the CADisplayLink, and the selector corresponding to the CADisplayLink class will be It will be called once, that is, the timer will add 1 to the count value of the counter. Since the timing method of screen refresh is more accurate, it can effectively avoid the delay caused by too many running processes in the user device.

Furthermore, in another embodiment of the present invention, the local notification information includes pop-up window information and/or voice prompts.

Among them, the local notification information can be reminded in any form. In this embodiment, pop-up information and/or voice prompts are preferred. The reminders can be given at the same time, or one of them can be selected, as long as the reminder effect can be achieved.

Preferably, the content of the pop-up window information in this embodiment is the same as that of the voice prompt, including the operation to be performed and the next operation, as well as current timing information, such as inputting voice scores through text and voice prompts.

Among them, in this embodiment, the voice prompt is preferably synthesized by using AVSpeechSynthesizer, which saves the operation of manually recording the prompt voice and makes the use of the client more convenient.

Preferably, in this embodiment, if the process of the client is resumed after being interrupted, the local notification information is deleted to avoid unnecessary reminders when the client is running normally.

Further, in another embodiment of the present invention, the push of the voice prompt by the client further includes: the client obtains the current operation type of the user equipment, and if the current operation type is a system operation, the voice prompt pushed by the client The prompt is a prompt, otherwise the voice prompt is a pre-synthesized human voice prompt.

Wherein, in this embodiment, the priority of the system operation in the smart device is usually the highest, such as making a phone call. At this time, the human voice notification pushed by the client will greatly affect the user experience, so the reminder can be realized by replacing it with the notification sound.

Furthermore, in another embodiment of the present invention, the step of identifying the scoring value from the voice input and completing the scoring includes: the client monitors the voice input, and if the client successfully acquires voice information, recognizes the value from the voice information. Get the score value, otherwise keep monitoring.

Wherein, in this embodiment, the time for listening to the voice input can be set, for example, 5 seconds is set to wait for the voice input, and the monitoring can also be kept. In this embodiment, it is preferable to keep listening. Since the application scenario of this embodiment is a simulated test drive of a car, the test driver will not forget to score, so by keeping listening, it is possible to avoid missing the test driver's voice score.

Preferably, in this embodiment, the speech input is recognized by the SpeechKit framework, and the corresponding scoring is matched by a regular pattern, so that the scoring operation can be completed more accurately.

With reference to Fig. 3, in addition, another embodiment of the present invention also provides a kind of timing speech scoring method, comprises the following steps:

Step S3100, the client acquires the input timing interval and scoring times;

Step S3200, the client starts the timer, and if process interruption information is detected, execute step S3310, otherwise execute step S3410;

Step S3310, obtain the interrupt time stamp and remaining duration, calculate the trigger time and keep timing;

Step S3320, creating pop-up information and voice prompts;

Step S3410, obtaining the refresh rate of the screen obtained by the timer;

Step S3420, if the timer detects that the screen is refreshed, the timer adds 1 to the count value of the counter, if the count value of the timer reaches the refresh frequency value, execute step S3430, otherwise execute step S3410;

Step S3430, the timer executes timing for 1 second, if the timing reaches the trigger time, execute step S3510, otherwise execute step S3420;

Step S3510, the client performs voice input prompts. If there is process interruption information in the client, the voice input prompts are pop-up window information and voice prompts, otherwise, only voice prompts are performed;

Step S3520, if the client monitors the voice input, the client recognizes and scores the voice, otherwise keep monitoring;

Step S3600, if the client completes all scoring, the client saves the obtained scoring and time information in the form of a binary data stream, and uses the time stamp when the scoring operation is completed as the saved file name, otherwise, execute step S3200.

Among them, in this embodiment, when the client detects the interruption process information, it obtains the interruption timestamp and the remaining duration, and obtains the trigger time before the interruption of the process according to the interruption timestamp and the remaining duration, which avoids the interruption of the client from affecting the timing; by obtaining The number of screen refreshes is timed, which improves the accuracy of timing; the client pushes a local notification and recognizes the score after timing to the trigger time; after repeated execution until all scores are completed, the client saves the score and time information, and saves the file The file name is the time stamp when scoring is completed, which ensures the uniqueness and accuracy of the file name.

Referring to FIG. 4 , the second embodiment of the present invention also provides a timing voice scoring device, in which the timing voice scoring device 4000 includes but not limited to: a process interruption detection unit 4100 , a keeping timing unit 4200 , and a scoring unit 4300 .

Wherein, the process interruption detection unit 4100 is used for the client to obtain the timing interval and start the timer, and if the client detects the process interruption information, obtain the interruption time stamp and the remaining duration;

The keeping timing unit 4200 is used for the client to acquire the trigger time according to the interrupt timestamp and the remaining duration, create local notification information and keep the timer timing;

The scoring unit 4300 is used for the client to count to the trigger time, push the local notification information and recognize the scoring value from the voice input to complete the scoring.

Furthermore, in another embodiment of the present invention, it also includes but not limited to: a refresh frequency acquisition unit 4210 , a timer counting unit 4220 , a timer timing execution unit 4230 , a voice prompt unit 4310 and a voice information acquisition unit 4320 .

Wherein, the refresh frequency acquiring unit 4210 is used for the timer to acquire the refresh frequency of the screen;

The timer counting unit 4220 is configured to add 1 to the count value of the counter if the timer detects that the screen is refreshed;

The timer timing execution unit 4230 is configured to execute the timer for 1 second if the count value of the counter is the same as the value of the refresh frequency, and clear the count value;

The voice prompt unit 4310 is used for the client to obtain the current operation type of the user equipment. If the current operation type is a system operation, the voice prompt pushed by the client is a prompt, otherwise the voice prompt is a pre-synthesized human voice prompt;

The voice information acquisition unit 4320 is used for the client to monitor the voice input, if the client successfully acquires the voice information, identify the score value from the voice information, otherwise keep monitoring.

It should be noted that, since the timing speech scoring device in this embodiment is based on the same inventive concept as the above-mentioned timing speech scoring method, the corresponding content in the method embodiment is also applicable to this device embodiment, and will not be detailed here. stated.

Referring to FIG. 5 , the third embodiment of the present invention also provides a timing voice scoring device. The timing voice scoring device 5000 can be any type of intelligent terminal, such as a mobile phone, a tablet computer, a personal computer, and the like.

Specifically, the timing speech scoring device 5000 includes: one or more control processors 5001 and memory 5002, one control processor 5001 is taken as an example in FIG. 5 .

The control processor 5001 and the memory 5002 may be connected through a bus or in other ways. In FIG. 5 , connection through a bus is taken as an example.

The memory 5002, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs, non-transitory computer-executable programs and modules, such as program instructions/programs corresponding to the timing voice scoring device in the embodiment of the present invention modules, for example, the process interruption detection unit 4100 and the hold timing unit 4200 shown in FIG. 4 . The control processor 5001 runs the non-transitory software programs, instructions and modules stored in the memory 5002 to execute various functional applications and data processing of the timing voice scoring device 4000, that is, to realize the timing voice scoring method of the above method embodiment.

The memory 5002 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and at least one application program required by a function; the data storage area may store data created according to the use of the timing voice scoring device 4000, and the like. In addition, the memory 5002 may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some implementations, the storage 5002 may optionally include storages that are remotely located relative to the control processor 5001, and these remote storages may be connected to the timing voice scoring device 5000 through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The one or more modules are stored in the memory 5002, and when executed by the one or more control processors 5001, perform the timing voice scoring method in the above method embodiment, for example, perform the above-described Figure 1 The method steps S100 to S300 in FIG. 2 , the method steps S210 to S220 in FIG. 2 , and the method steps S3100 to S3600 in FIG. 3 realize the functions of the devices 4100-4300 in FIG. 4 .

An embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more control processors, for example, by the Executed by one control processor 5001, the one or more control processors 5001 may execute the timing voice scoring method in the above method embodiment, for example, execute the method steps S100 to S300 in FIG. 1 described above, and in FIG. 2 The method steps S210 to S220 in FIG. 3 and the method steps S3100 to S3600 in FIG. 3 realize the functions of the devices 4100-4300 in FIG. 4 .

The device embodiments described above are only illustrative, and the devices described as separate components may or may not be physically separated, that is, they may be located in one place, or may be distributed to multiple network devices. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

Through the above description of the implementation manners, those skilled in the art can clearly understand that each implementation manner can be implemented by means of software plus a general hardware platform. Those skilled in the art can understand that all or part of the process in the method of the above-mentioned embodiments can be completed by instructing related hardware through a computer program, and the program can be stored in a computer-readable storage medium. , it may include the flow of the embodiment of the above method. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory (ReadOnly Memory, ROM) or a random access memory (Random Access Memory, RAM), etc.

The above is a specific description of the preferred implementation of the present invention, but the present invention is not limited to the above-mentioned implementation, and those skilled in the art can also make various equivalent deformations or replacements without violating the spirit of the present invention. Equivalent modifications or replacements are all within the scope defined by the claims of the present application.

Claims (7)

1. A method of timed speech scoring comprising the steps of:

the method comprises the steps that a client obtains a timing interval and starts a timer, and if the client detects process interrupt information, an interrupt time stamp and the residual duration are obtained;

the client acquires trigger time according to the interrupt time stamp and the residual time length, creates local notification information and keeps the timer to count;

the client counts to the triggering time, pushes the local notification information and recognizes the grading value from the voice input to finish grading;

wherein, the timer timing specifically includes the following steps:

the timer acquires the refreshing frequency of the screen;

if the timer detects screen refreshing, the timer adds 1 to the count value of the counter; if the count value of the counter is the same as the value of the refresh frequency, the timer performs timing for 1 second, and clears the count value;

the identifying a scoring numerical completion score from the speech input comprises: and the client monitors voice input, if the client successfully acquires voice information, the scoring numerical value is identified from the voice information, and otherwise, monitoring is kept.

2. A timed speech scoring method according to claim 1, characterized in that: the local notification information comprises popup information and/or voice prompts.

3. The method of claim 2, wherein the client pushing the voice prompt further comprises: the client acquires the current operation type of the user equipment, if the current operation type is system operation, the voice prompt pushed by the client is prompt sound, otherwise, the voice prompt is a pre-synthesized voice prompt.

4. A timed speech scoring apparatus comprising:

the process interruption detection unit is used for the client to acquire a timing interval and start a timer, and if the client detects the process interruption information, the client acquires an interruption time stamp and the residual duration;

the maintenance timing unit is used for acquiring the trigger time by the client according to the interrupt time stamp and the residual time length, creating local notification information and maintaining the timing of a timer;

the scoring unit is used for the client to time to trigger time, pushing the local notification information and identifying scoring numerical values from voice input to finish scoring;

the refresh frequency acquisition unit is used for acquiring the refresh frequency of the screen by the timer;

a timer counting unit, configured to increment a count value of a counter by 1 if the timer detects a screen refresh;

the timer timing execution unit is used for executing timing for 1 second and resetting the count value if the count value of the counter is the same as the value of the refresh frequency;

and the voice information acquisition unit is used for monitoring voice input by the client, identifying a grading value from the voice information if the voice information is successfully acquired by the client, and keeping monitoring if the grading value is not the grading value.

5. The timed speech scoring apparatus according to claim 4, further comprising:

the voice prompt unit is used for the client to acquire the current operation type of the user equipment, if the current operation type is system operation, the voice prompt pushed by the client is prompt voice, otherwise, the voice prompt is pre-synthesized voice prompt.

6. A timed speech scoring apparatus, characterized by: comprising at least one control processor and a memory for communication connection with the at least one control processor; the memory stores instructions executable by the at least one control processor to enable the at least one control processor to perform a timed speech scoring method according to any one of claims 1-3.

7. A computer-readable storage medium, characterized by: the computer readable storage medium stores computer executable instructions for causing a computer to perform a timed speech scoring method according to any one of claims 1-3.

Images