CN112201230A - Voice response method, device, equipment and storage medium - Google Patents
Voice response method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN112201230A CN112201230A CN201910609650.9A CN201910609650A CN112201230A CN 112201230 A CN112201230 A CN 112201230A CN 201910609650 A CN201910609650 A CN 201910609650A CN 112201230 A CN112201230 A CN 112201230A
- Authority
- CN
- China
- Prior art keywords
- response
- voice
- application
- responded
- wearable device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000004044 response Effects 0.000 title claims abstract description 401
- 238000000034 method Methods 0.000 title claims abstract description 106
- 230000009471 action Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 abstract description 42
- 230000003993 interaction Effects 0.000 description 14
- 238000004891 communication Methods 0.000 description 10
- 238000012545 processing Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 6
- 230000006872 improvement Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 230000001960 triggered effect Effects 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 150000001875 compounds Chemical class 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000005316 response function Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
技术领域technical field
本公开涉及语音交互领域,尤其涉及一种语音响应方法、装置、设备以及计算机可读存储介质。The present disclosure relates to the field of voice interaction, and in particular, to a voice response method, apparatus, device, and computer-readable storage medium.
背景技术Background technique
随着技术的发展和生活的进步,人们越来越倾向于使用各种智能穿戴设备来提高自身的生活质量。现有的智能穿戴设备支持语音交互的功能,通过语音交互方式,可以实现信息查询功能、智能家居控制功能或者其他的个性化操作。在相关的语音交互场景中,用户通常可以在任意场景下对智能穿戴设备进行语音输入,以期待该智能穿戴设备的响应结果;然而,现有智能穿戴设备的语音响应方案具有一定局限,响应准确率不高,有时用户输入的语音信号无法让智能穿戴设备明确用户的具体意图,从而无法给出用户想要的响应结果。With the development of technology and the progress of life, people are more and more inclined to use various smart wearable devices to improve their quality of life. The existing smart wearable device supports the function of voice interaction, and through the voice interaction method, an information query function, a smart home control function, or other personalized operations can be implemented. In related voice interaction scenarios, users can usually input voice to the smart wearable device in any scenario to expect the response result of the smart wearable device; however, the existing voice response solutions for smart wearable devices have certain limitations, and the response is accurate The rate is not high, and sometimes the voice signal input by the user cannot make the smart wearable device clear the user's specific intention, so it cannot give the user's desired response result.
发明内容SUMMARY OF THE INVENTION
为克服相关技术中存在的问题,本公开提供了一种语音响应方法、装置、设备及计算机可读存储介质。To overcome the problems in the related art, the present disclosure provides a voice response method, apparatus, device, and computer-readable storage medium.
根据本公开实施例的第一方面,提供一种语音响应方法,包括:According to a first aspect of the embodiments of the present disclosure, a voice response method is provided, including:
基于采集的语音信号,获取识别所述语音信号得到的语音信息;Obtaining voice information obtained by recognizing the voice signal based on the collected voice signal;
获取与所述语音信息相应的一条或多条响应参数;所述响应参数包括待响应的应用和/或待响应的应用页面、以及对应的响应指令;Obtain one or more response parameters corresponding to the voice information; the response parameters include the application to be responded and/or the application page to be responded, and the corresponding response instruction;
若当前运行的应用为所述待响应的应用和/或当前显示的应用页面为所述待响应的应用页面,执行所述响应指令。If the currently running application is the application to be responded to and/or the currently displayed application page is the application page to be responded to, the response instruction is executed.
可选地,所述响应参数还包括响应触发方式;Optionally, the response parameter further includes a response trigger mode;
所述执行所述响应指令,包括:The executing the response instruction includes:
基于所述响应触发方式触发所述当前运行的应用执行所述响应指令。Trigger the currently running application to execute the response instruction based on the response triggering manner.
可选地,所述语音响应方法应用于智能穿戴设备;Optionally, the voice response method is applied to a smart wearable device;
所述基于采集的语音信号,获取识别所述语音信号得到的语音信息,包括:The voice information obtained by recognizing the voice signal based on the collected voice signal, including:
将采集的所述语音信号发送给云端;所述语音信号用于触发所述云端识别所述语音信号得到语音信息,并基于所述语音信息匹配预置的意图关键词,以获取与所述意图关键词对应的一条或多条响应参数并返回给所述智能穿戴设备;所述意图关键词表示所述语音信息可能执行的操作;Send the collected voice signal to the cloud; the voice signal is used to trigger the cloud to recognize the voice signal to obtain voice information, and match preset intent keywords based on the voice information to obtain the intent One or more response parameters corresponding to the keywords are returned to the smart wearable device; the intent keywords indicate possible operations performed by the voice information;
所述获取与所述语音信息相应的一条或多条响应参数,包括:The acquiring one or more response parameters corresponding to the voice information includes:
接收所述云端发送的与所述意图关键词对应的一条或多条响应参数。One or more response parameters corresponding to the intent keyword sent by the cloud are received.
可选地,所述语音响应方法应用于智能穿戴设备;Optionally, the voice response method is applied to a smart wearable device;
所述基于采集的语音信号,获取识别所述语音信号得到的语音信息,包括:The voice information obtained by recognizing the voice signal based on the collected voice signal, including:
将采集的语音信号发送给云端,以从云端获取识别所述语音信号得到的语音信息;sending the collected voice signal to the cloud, so as to obtain the voice information obtained by recognizing the voice signal from the cloud;
所述获取与所述语音信息相应的一条或多条响应参数,若当前运行的应用为所述待响应的应用、和/或当前显示的应用页面为所述待响应的应用页面,执行所述响应指令,包括:The acquiring one or more response parameters corresponding to the voice information, if the currently running application is the application to be responded, and/or the currently displayed application page is the application page to be responded, execute the Response commands, including:
获取当前运行的应用和/或当前显示的应用页面对应的响应参数;所述响应参数还包括一条或多条预置文本信息;Acquire response parameters corresponding to the currently running application and/or the currently displayed application page; the response parameters also include one or more pieces of preset text information;
匹配所述文本信息与所述语音信息,若所述语音信息匹配所述预置文本信息,执行所述预置文本信息对应的响应指令。The text information and the voice information are matched, and if the voice information matches the preset text information, a response instruction corresponding to the preset text information is executed.
可选地,所述语音响应方法应用于云端;Optionally, the voice response method is applied to the cloud;
所述基于采集的语音信号,获取识别所述语音信号得到的语音信息,包括:The voice information obtained by recognizing the voice signal based on the collected voice signal, including:
接收智能穿戴设备发送的语音信号,识别所述语音信号得到的语音信息;Receive the voice signal sent by the smart wearable device, and recognize the voice information obtained from the voice signal;
所述获取与所述语音信息相应的一条或多条响应参数,包括:The acquiring one or more response parameters corresponding to the voice information includes:
基于所述语音信息匹配预置的意图关键词,以获取与所述意图关键词对应的一条或多条响应参数;所述意图关键词表示所述语音信息可能执行的操作;Match preset intent keywords based on the voice information to obtain one or more response parameters corresponding to the intent keywords; the intent keywords represent possible operations performed by the voice information;
所述若当前运行的应用为所述待响应的应用、和/或当前显示的应用页面为所述待响应的应用页面,执行所述响应指令,包括:If the currently running application is the application to be responded, and/or the currently displayed application page is the application page to be responded, executing the response instruction includes:
接收所述智能穿戴设备发送的当前运行的应用和/或当前显示的应用页面;receiving the currently running application and/or the currently displayed application page sent by the smart wearable device;
若所述当前运行的应用为所述待响应的应用和/或所述当前显示的应用页面为所述待响应的应用页面,将所述响应指令发送给所述智能穿戴设备,以使所述智能穿戴设备执行所述响应指令。If the currently running application is the application to be responded and/or the currently displayed application page is the application page to be responded, send the response instruction to the smart wearable device, so that the The smart wearable device executes the response instruction.
可选地,所述语音响应方法应用于移动终端;所述移动终端与智能穿戴设备关联;Optionally, the voice response method is applied to a mobile terminal; the mobile terminal is associated with a smart wearable device;
所述基于采集的语音信号,获取识别所述语音信号得到的语音信息,包括:The voice information obtained by recognizing the voice signal based on the collected voice signal, including:
接收云端发送的语音信息;所述语音信息为关联的智能穿戴设备将采集的语音信号发送给云端之后,由所述云端识别所述语音信号得到的;Receive the voice information sent by the cloud; the voice information is obtained by the cloud recognizing the voice signal after the associated smart wearable device sends the collected voice signal to the cloud;
所述获取与所述语音信息相应的一条或多条响应参数,包括:The acquiring one or more response parameters corresponding to the voice information includes:
接收所述云端发送的与所述语音信息相应的一条或多条响应参数;所述响应参数为所述云端基于所述语音信息匹配预置的意图关键词,获取与所述意图关键词对应的一条或多条响应参数并返回的;Receive one or more response parameters corresponding to the voice information sent by the cloud; the response parameters are that the cloud matches preset intent keywords based on the voice information, and obtains the intent keywords corresponding to the intent keywords. One or more response parameters and returned;
所述若当前运行的应用为所述待响应的应用、和/或当前显示的应用页面为所述待响应的应用页面,执行所述响应指令包括:If the currently running application is the application to be responded, and/or the currently displayed application page is the application page to be responded, executing the response instruction includes:
接收所述智能穿戴设备发送的当前运行的应用和/或当前显示的应用页面;receiving the currently running application and/or the currently displayed application page sent by the smart wearable device;
若当前运行的应用为所述待响应的应用、和/或当前显示的应用页面为所述待响应的应用页面,将所述响应指令发送给所述智能穿戴设备,以使所述智能穿戴设备执行所述响应指令。If the currently running application is the application to be responded, and/or the currently displayed application page is the application page to be responded, send the response instruction to the smart wearable device, so that the smart wearable device Execute the response instruction.
可选地,所述智能穿戴设备包括声音采集单元;Optionally, the smart wearable device includes a sound collection unit;
所述语音信号为所述智能穿戴设备响应于用户的唤醒操作,启动所述声音采集单元采集得到的。The voice signal is collected by the smart wearable device starting the sound collecting unit in response to the user's wake-up operation.
可选地,所述智能穿戴设备还包括惯性传感器;Optionally, the smart wearable device further includes an inertial sensor;
所述唤醒操作包括指定控件的触发操作或者基于所述惯性传感器采集的数据确定的用户的指定动作。The wake-up operation includes a trigger operation of a designated control or a designated action of a user determined based on data collected by the inertial sensor.
根据本公开实施例的第二方面,提供一种语音响应装置,包括:According to a second aspect of the embodiments of the present disclosure, there is provided a voice response apparatus, including:
语音信息获取模块,被配置为基于采集的语音信号,获取识别所述语音信号得到的语音信息;a voice information acquisition module, configured to acquire voice information obtained by recognizing the voice signal based on the collected voice signal;
响应参数获取模块,被配置为获取与所述语音信息相应的响应参数;所述响应参数包括待响应的应用和/或待响应的应用页面、以及对应的响应指令;a response parameter obtaining module, configured to obtain a response parameter corresponding to the voice information; the response parameter includes an application to be responded and/or an application page to be responded, and a corresponding response instruction;
响应指令执行模块,被配置为若当前运行的应用为所述待响应的应用、和/或当前显示的应用页面为所述待响应的应用页面,执行所述响应指令。The response instruction execution module is configured to execute the response instruction if the currently running application is the application to be responded, and/or the currently displayed application page is the application page to be responded.
可选地,所述响应参数还包括响应触发方式;Optionally, the response parameter further includes a response trigger mode;
所述响应指令执行模块被配置为:The response instruction execution module is configured to:
若当前运行的应用为所述待响应的应用、和/或当前显示的应用页面为所述待响应的应用页面,基于所述响应触发方式触发所述当前运行的应用执行所述响应指令。If the currently running application is the application to be responded, and/or the currently displayed application page is the application page to be responded, trigger the currently running application to execute the response instruction based on the response triggering method.
可选地,所述语音响应方法应用于智能穿戴设备;Optionally, the voice response method is applied to a smart wearable device;
所述语音信息获取模块被配置为:The voice information acquisition module is configured as:
将采集的所述语音信号发送给云端;所述语音信号用于触发所述云端识别所述语音信号得到语音信息,并基于所述语音信息匹配预置的意图关键词,以获取与所述意图关键词对应的一条或多条响应参数并返回给所述智能穿戴设备;所述意图关键词表示所述语音信息的可能执行的操作;Send the collected voice signal to the cloud; the voice signal is used to trigger the cloud to recognize the voice signal to obtain voice information, and match preset intent keywords based on the voice information to obtain the intent One or more response parameters corresponding to the keywords are returned to the smart wearable device; the intent keywords represent possible operations of the voice information;
所述响应参数获取模块被配置为:The response parameter acquisition module is configured as:
接收所述云端发送的与所述意图关键词对应的一条或多条响应参数。One or more response parameters corresponding to the intent keyword sent by the cloud are received.
可选地,所述语音响应方法应用于智能穿戴设备;Optionally, the voice response method is applied to a smart wearable device;
所述语音信息获取模块,被配置为:The voice information acquisition module is configured as:
将采集的语音信号发送给云端,以从云端获取识别所述语音信号得到的语音信息;sending the collected voice signal to the cloud, so as to obtain the voice information obtained by recognizing the voice signal from the cloud;
所述响应参数获取模块以及所述响应指令执行模块,被配置为:The response parameter acquisition module and the response instruction execution module are configured as:
获取当前运行的应用和/或当前显示的应用页面对应的响应参数;所述响应参数还包括一条或多条预置文本信息;Acquire response parameters corresponding to the currently running application and/or the currently displayed application page; the response parameters also include one or more pieces of preset text information;
匹配所述文本信息与所述语音信息,若所述语音信息匹配所述预置文本信息,执行所述预置文本信息对应的响应指令。The text information and the voice information are matched, and if the voice information matches the preset text information, a response instruction corresponding to the preset text information is executed.
可选地,所述语音响应方法应用于云端;Optionally, the voice response method is applied to the cloud;
所述语音信息获取模块被配置为:The voice information acquisition module is configured as:
接收智能穿戴设备发送的语音信号,识别所述语音信号得到的语音信息;Receive the voice signal sent by the smart wearable device, and recognize the voice information obtained from the voice signal;
所述响应参数获取模块包括:The response parameter acquisition module includes:
基于所述语音信息匹配预置的意图关键词,以获取与所述意图关键词对应的一条或多条响应参数;所述意图关键词表示所述语音信息的可能执行的操作;Match preset intent keywords based on the voice information to obtain one or more response parameters corresponding to the intent keywords; the intent keywords represent possible operations of the voice information;
所述响应指令执行模块被配置为:The response instruction execution module is configured to:
应用和/或应用页面接收子模块,被配置为接收所述智能穿戴设备发送的当前运行的应用和/或当前显示的应用页面;an application and/or application page receiving submodule, configured to receive the currently running application and/or the currently displayed application page sent by the smart wearable device;
响应指令发送子模块,被配置为若所述当前运行的应用为所述待响应的应用、和/或所述当前显示的应用页面为所述待响应的应用页面,将所述响应指令发送给所述智能穿戴设备,以使所述智能穿戴设备执行所述响应指令。A response instruction sending submodule is configured to send the response instruction to if the currently running application is the application to be responded and/or the currently displayed application page is the application page to be responded the smart wearable device, so that the smart wearable device executes the response instruction.
可选地,所述语音响应方法应用于移动终端;所述移动终端与智能穿戴设备关联;Optionally, the voice response method is applied to a mobile terminal; the mobile terminal is associated with a smart wearable device;
所述语音信息获取模块被配置为:The voice information acquisition module is configured as:
接收云端发送的语音信息;所述语音信息为关联的智能穿戴设备将采集的语音信号发送给云端之后,由所述云端识别所述语音信号得到的;Receive the voice information sent by the cloud; the voice information is obtained by the cloud recognizing the voice signal after the associated smart wearable device sends the collected voice signal to the cloud;
所述响应参数获取模块被配置为:The response parameter acquisition module is configured as:
接收所述云端发送的与所述语音信息相应的一条或多条响应参数;所述响应参数为所述云端基于所述语音信息匹配预置的意图关键词,获取与所述意图关键词对应的一条或多条响应参数并返回的;Receive one or more response parameters corresponding to the voice information sent by the cloud; the response parameters are that the cloud matches preset intent keywords based on the voice information, and obtains the intent keywords corresponding to the intent keywords. One or more response parameters and returned;
所述响应指令执行模块被配置为:The response instruction execution module is configured to:
应用和/或应用页面接收子模块,被配置为接收所述智能穿戴设备发送的当前运行的应用和/或当前显示的应用页面;an application and/or application page receiving submodule, configured to receive the currently running application and/or the currently displayed application page sent by the smart wearable device;
响应指令发送子模块,被配置为若当前运行的应用为所述待响应的应用、和/或当前显示的应用页面为所述待响应的应用页面,将所述响应指令发送给所述智能穿戴设备,以使所述智能穿戴设备执行所述响应指令。A response instruction sending submodule, configured to send the response instruction to the smart wearable if the currently running application is the application to be responded and/or the currently displayed application page is the application page to be responded device, so that the smart wearable device executes the response instruction.
可选地,所述智能穿戴设备包括声音采集单元;Optionally, the smart wearable device includes a sound collection unit;
所述语音信号为所述智能穿戴设备响应于用户的唤醒操作,启动所述声音采集单元采集得到的。The voice signal is collected by the smart wearable device starting the sound collecting unit in response to the user's wake-up operation.
可选地,所述智能穿戴设备包括惯性传感器;Optionally, the smart wearable device includes an inertial sensor;
所述唤醒操作包括指定控件的触发操作或者基于所述惯性传感器采集的数据确定的用户的指定动作。The wake-up operation includes a trigger operation of a designated control or a designated action of a user determined based on data collected by the inertial sensor.
根据本公开实施例的第三方面,提供一种电子设备,包括:According to a third aspect of the embodiments of the present disclosure, there is provided an electronic device, comprising:
处理器;processor;
用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
其中,in,
所述处理器被配置为执行如上所述方法中的操作。The processor is configured to perform the operations in the method as described above.
根据本公开实施例的第四方面,提供一种计算机可读存储介质,其上存储有计算机程序,当由一个或多个处理器执行时,使得处理器执行如上所述方法中的操作。According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having a computer program stored thereon, which when executed by one or more processors, causes the processors to perform the operations in the method as described above.
本公开的实施例提供的技术方案可以包括以下有益效果:The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:
本公开中,在采集到用户的语音信号之后,首先获取识别所述语音信号的语音信息,再获取与所述语音信息相应的响应参数,所述响应参数包括待响应的应用和/或待响应的应用页面、以及对应的响应指令,从而如果检测到当前运行的应用为所述待响应的应用、和/或当前显示的应用页面为所述待响应的应用页面,执行所述响应指令,本公开实施例能够根据应用确定用户语音的意图,并基于用户的语音执行应用的响应指令,给出用户想要的响应结果,实现通过语音来控制应用的具体功能,提高用户的使用体验。In the present disclosure, after the user's voice signal is collected, the voice information identifying the voice signal is obtained first, and then the response parameter corresponding to the voice information is obtained, and the response parameter includes the application to be responded and/or the to-be-responded application The application page and the corresponding response instruction, so if it is detected that the currently running application is the application to be responded, and/or the currently displayed application page is the application page to be responded, execute the response instruction, this The disclosed embodiments can determine the intent of the user's voice according to the application, execute the application's response instruction based on the user's voice, give the user's desired response result, realize the specific function of the application controlled by the voice, and improve the user's use experience.
本公开中,所述语音响应方法可以应用于智能穿戴设备中,所述智能穿戴设备将采集的所述语音信号发送给云端,以从云端获取响应参数,通过所述响应参数,所述智能穿戴设备可以根据应用来明确用户的语音意图,并根据用户的语音意图执行应用内的可响应指令,实现通过语音来控制应用的具体功能,提高用户的使用体验;同时,由于只需将相关的响应参数存储在云端,云端将匹配的响应参数发送给所述智能穿戴设备即可,无需对云端进行任何改进,因此可以适用于各种厂商的云端,具备良好的兼容性。In the present disclosure, the voice response method can be applied to a smart wearable device, and the smart wearable device sends the collected voice signal to the cloud to obtain response parameters from the cloud, and through the response parameters, the smart wearable The device can clarify the user's voice intention according to the application, and execute the responsive commands in the application according to the user's voice intention, so as to control the specific functions of the application through voice and improve the user's experience; The parameters are stored in the cloud, and the cloud only needs to send the matching response parameters to the smart wearable device without any improvement to the cloud, so it can be applied to the cloud of various manufacturers and has good compatibility.
本公开中,所述智能穿戴设备包括声音采集单元以及惯性传感器,能够响应于用户的唤醒操作,启动所述语音采集单元以采集语音信号,所述唤醒操作包括指定控件的触发操作或者基于所述惯性传感器采集的数据确定的用户的指定动作,实现在用户需要时才启动语音采集单元,从而节省所述智能穿戴设备的电量,避免维持语音采集单元的持续运行导致所述智能穿戴设备的续航时长大幅度缩小。In the present disclosure, the smart wearable device includes a sound acquisition unit and an inertial sensor, and can activate the voice acquisition unit to collect voice signals in response to a user's wake-up operation, where the wake-up operation includes a trigger operation of a specified control or an operation based on the The user's designated action determined by the data collected by the inertial sensor realizes that the voice acquisition unit is activated only when the user needs it, thereby saving the power of the smart wearable device and avoiding the continuous operation of the voice acquisition unit. drastically reduced.
本公开中,所述语音响应方法可以应用于智能穿戴设备中,所述智能穿戴设备将采集的所述语音信号发送给云端,以从云端获取识别所述语音信号得到的语音信息,所述智能穿戴设备将识别得到的语音信息与当前运行的应用和/或当前显示的应用页面对应的预置文本信息进行匹配,如果匹配,表明命中用户的语音意图,则所述智能穿戴设备执行所述预置文本信息对应的响应指令,以实现通过语音控制应用的具体功能,提高用户的使用体验。In the present disclosure, the voice response method can be applied to a smart wearable device, and the smart wearable device sends the collected voice signal to the cloud to obtain voice information obtained by recognizing the voice signal from the cloud. The wearable device matches the recognized voice information with the preset text information corresponding to the currently running application and/or the currently displayed application page. Set the response command corresponding to the text information to realize the specific function of the application through voice control and improve the user experience.
本公开中,所述语音响应方法可以应用于云端中,所述云端接收并识别智能穿戴设备发送的语音信号以得到语音信息,然后基于所述语音信息匹配预置的意图关键词,以获取所述意图关键词对应的响应参数,并在接收到所述智能穿戴设备发送的当前显示的应用和/或应用页面之后,检测所述当前运行的应用是否匹配待响应的应用、和/或所述当前显示的应用页面是否匹配待响应的应用页面,若匹配,表明命中用户的语音意图,则所述云端将对应的响应指令发送给所述智能穿戴设备,以使所述智能穿戴设备执行所述待响应位置对应的响应指令,通过对云端进行改进,使得云端可以基于应用明确用户的语音意图,实现通过语音控制应用的具体功能,提高用户的使用体验。In the present disclosure, the voice response method can be applied to the cloud, and the cloud receives and recognizes the voice signal sent by the smart wearable device to obtain voice information, and then matches preset intent keywords based on the voice information to obtain the voice information. describe the response parameters corresponding to the intent keywords, and after receiving the currently displayed application and/or application page sent by the smart wearable device, detect whether the currently running application matches the application to be responded to, and/or the Whether the currently displayed application page matches the application page to be responded to, if it matches, it indicates that the user's voice intention is hit, and the cloud sends the corresponding response instruction to the smart wearable device, so that the smart wearable device executes the By improving the cloud for the response command corresponding to the position to be responded to, the cloud can clarify the user's voice intention based on the application, realize the specific functions of the application through voice control, and improve the user experience.
本公开中,所述语音响应方法可以应用于与智能穿戴设备关联的移动终端中,所述移动终端接收云端返回的语音信息以及与语音消息相应的一条或多条响应参数,然后接收所述智能穿戴设备发送的当前运行的应用和/或当前显示的应用页面之后,检测所述当前运行的应用是否匹配待响应的应用、和/或所述当前显示的应用页面是否匹配待响应的应用页面,若匹配,表明命中用户的语音意图,则所述移动终端将对应的响应指令发送给所述智能穿戴设备,以使所述智能穿戴设备执行所述响应指令,通过对移动终端进行改进,使得移动终端可以根据应用明确用户的语音意图,实现通过语音控制应用的具体功能,提高用户的使用体验。In the present disclosure, the voice response method can be applied to a mobile terminal associated with a smart wearable device. The mobile terminal receives the voice information returned by the cloud and one or more response parameters corresponding to the voice message, and then receives the smart After the currently running application and/or the currently displayed application page sent by the wearable device, it is detected whether the currently running application matches the application to be responded to, and/or whether the currently displayed application page matches the application page to be responded to, If it matches, indicating that the user's voice intention is hit, the mobile terminal sends the corresponding response command to the smart wearable device, so that the smart wearable device executes the response command. The terminal can clarify the user's voice intention according to the application, realize specific functions of the application through voice control, and improve the user's use experience.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本公开。It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.
附图说明Description of drawings
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开的原理。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure.
图1是本公开根据一示例性实施例示出的一种语音响应方法的流程图。FIG. 1 is a flowchart of a voice response method according to an exemplary embodiment of the present disclosure.
图2是本公开根据一示例性实施例示出的第二种语音响应方法的流程图。FIG. 2 is a flowchart of a second voice response method according to an exemplary embodiment of the present disclosure.
图3是本公开根据一示例性实施例示出的第三种语音响应方法的流程图。FIG. 3 is a flowchart of a third voice response method according to an exemplary embodiment of the present disclosure.
图4是本公开根据一示例性实施例示出的第四种语音响应方法的流程图。FIG. 4 is a flowchart of a fourth voice response method according to an exemplary embodiment of the present disclosure.
图5是本公开根据一示例性实施例示出的一种语音响应装置的结构框图。FIG. 5 is a structural block diagram of a voice response apparatus according to an exemplary embodiment of the present disclosure.
图6是本公开根据一示例性实施例示出的一种电子设备的架构图。FIG. 6 is an architectural diagram of an electronic device according to an exemplary embodiment of the present disclosure.
具体实施方式Detailed ways
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, the same numerals in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure, as recited in the appended claims.
在本公开使用的术语是仅仅出于描述特定实施例的目的,而非旨在限制本公开。在本公开和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义。还应当理解,本文中使用的术语“和/或”是指并包含一个或多个相关联的列出项目的任何或所有可能组合。The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to limit the present disclosure. As used in this disclosure and the appended claims, the singular forms "a," "the," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.
应当理解,尽管在本公开可能采用术语第一、第二、第三等来描述各种信息,但这些信息不应限于这些术语。这些术语仅用来将同一类型的信息彼此区分开。例如,在不脱离本公开范围的情况下,第一信息也可以被称为第二信息,类似地,第二信息也可以被称为第一信息。取决于语境,如在此所使用的词语“如果”可以被解释成为“在……时”或“当……时”或“响应于确定”。It should be understood that although the terms first, second, third, etc. may be used in this disclosure to describe various pieces of information, such information should not be limited by these terms. These terms are only used to distinguish the same type of information from each other. For example, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information, without departing from the scope of the present disclosure. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determining."
相关技术中的智能穿戴设备或移动终端支持语音交互的功能,通过语音交互方式,可以实现信息查询功能、智能家居控制功能或者其他的个性化操作。在相关的语音交互场景中,用户通常可以在任意场景下对智能穿戴设备或移动终端进行语音输入,以期待该智能穿戴设备或该移动终端的响应结果,由于智能穿戴设备与移动终端实现语音交互方式相同,以下以智能穿戴设备为例进行说明,相关技术中的实现手段是:所述智能穿戴设备采集用户的语音信号,然后将采集的语音信号发送给云端,云端对所述语音信号进行识别以获取语音识别结果(即语音信息),然后基于所述语音识别结果确定用户的意图,从而确定相应的功能,从而执行相应的功能并返回响应结果给所述智能穿戴设备,比如用户在智能穿戴设备处输入“今天天气怎么样”的语音信号,所述云端识别该语音信号明确用户想知道天气情况,并执行查询天气的功能,从而返回天气结果给所述智能穿戴设备,但是,有时用户输入的语音信号无法让智能穿戴设备明确用户的具体意图,比如用户在智能穿戴设备处输入“保存”的语音信号,所述智能穿戴设备或者所述云端无法从该语音信息中明确用户的具体意图,从而无法给出用户想要的响应结果,用户体验不佳。The smart wearable device or mobile terminal in the related art supports the function of voice interaction, and through the voice interaction, an information query function, a smart home control function, or other personalized operations can be implemented. In related voice interaction scenarios, the user can usually input voice to the smart wearable device or mobile terminal in any scenario to expect the response result of the smart wearable device or the mobile terminal. Since the smart wearable device and the mobile terminal realize voice interaction The method is the same. The following takes the smart wearable device as an example to illustrate. The implementation method in the related art is: the smart wearable device collects the user's voice signal, and then sends the collected voice signal to the cloud, and the cloud recognizes the voice signal. to obtain the voice recognition result (that is, voice information), and then determine the user's intention based on the voice recognition result, so as to determine the corresponding function, so as to execute the corresponding function and return the response result to the smart wearable device. Input the voice signal of "how is the weather today" at the device, the cloud recognizes the voice signal to make it clear that the user wants to know the weather, and executes the function of querying the weather, thereby returning the weather result to the smart wearable device. However, sometimes the user inputs The voice signal of the smart wearable device cannot make the smart wearable device clarify the user's specific intention. For example, when the user inputs a "saved" voice signal at the smart wearable device, the smart wearable device or the cloud cannot clarify the user's specific intention from the voice information. As a result, the response result desired by the user cannot be given, and the user experience is poor.
因此,为了解决相关技术中的问题,本公开实施例提供了一种语音响应方法;所述语音响应方法能够根据当前运行的应用明确用户输入的语音信号的意图,从而获取用户想要的响应结果,也实现了通过语音控制应用中的具体功能。Therefore, in order to solve the problems in the related art, an embodiment of the present disclosure provides a voice response method; the voice response method can clarify the intention of the voice signal input by the user according to the currently running application, so as to obtain the response result desired by the user , which also implements specific functions in the application through voice control.
请参阅图1,图1是本公开根据一示例性实施例示出的一种语音响应方法的流程图,所述语音响应方法可以由智能穿戴设备或者移动终端来执行,以下以所述语音响应方法由智能穿戴设备执行为例进行说明:所述智能穿戴设备可以是手环、手表、手带、指环、臂带或者脚环等设备,所述方法包括:Please refer to FIG. 1. FIG. 1 is a flowchart of a voice response method according to an exemplary embodiment of the present disclosure. The voice response method can be executed by a smart wearable device or a mobile terminal. The voice response method is hereinafter referred to as the The smart wearable device is used as an example to illustrate: the smart wearable device may be a wristband, a watch, a wristband, a finger ring, an armband, or a foot ring. The method includes:
在步骤S101中,基于采集的语音信号,获取识别所述语音信号得到的语音信息。In step S101, based on the collected voice signal, voice information obtained by recognizing the voice signal is acquired.
在步骤S102中,获取与所述语音信息相应的一条或多条响应参数;所述响应参数包括待响应的应用和/或待响应的应用页面、以及对应的响应指令。In step S102, one or more response parameters corresponding to the voice information are acquired; the response parameters include an application to be responded to and/or an application page to be responded to, and a corresponding response instruction.
在步骤S103中,若当前运行的应用为所述待响应的应用和/或当前显示的应用页面为所述待响应的应用页面,执行所述响应指令。In step S103, if the currently running application is the application to be responded to and/or the currently displayed application page is the application page to be responded to, the response instruction is executed.
需要说明的是,所述智能穿戴设备包括声音采集单元,所述声音采集单元用于采集用户的语音信号,所述声音采集单元可以是麦克风、拾音器等设备。It should be noted that the smart wearable device includes a sound collection unit, and the sound collection unit is used to collect a user's voice signal, and the sound collection unit may be a device such as a microphone and a pickup.
在一种可能的实现方式中,所述智能穿戴设备可以在检测到用户的唤醒操作时,响应于用户的唤醒操作,启动所述语音采集单元以采集语音信号,作为例子,所述唤醒操作可以是指定控件(可以是虚拟控件也可以是实体按键)被触发的操作,或者在包括有惯性传感器(加速度传感器或者陀螺仪等)的智能穿戴设备中,可以通过检测所述惯性传感器的数据确定用户的指定动作,比如当所述智能穿戴设备为手表或者手环时,所述指定动作可以是抬腕动作,然后所述智能穿戴设备基于检测到的抬腕动作启动所述语音采集单元,智能判断的过程解放用户的双手,提高用户的使用体验;同时,本公开实施例在用户需要时才启动语音采集单元,从而节省所述智能穿戴设备的电量,避免维持语音采集单元的持续运行导致所述智能穿戴设备的续航时长大幅度缩小。In a possible implementation manner, the smart wearable device may, when detecting the wake-up operation of the user, start the voice acquisition unit to collect the voice signal in response to the wake-up operation of the user. As an example, the wake-up operation may be It is an operation triggered by a specified control (which can be a virtual control or a physical button), or in a smart wearable device including an inertial sensor (acceleration sensor or gyroscope, etc.), the user can be determined by detecting the data of the inertial sensor. For example, when the smart wearable device is a watch or a wristband, the specified action can be a wrist-raising action, and then the smart wearable device starts the voice acquisition unit based on the detected wrist-raising action, and intelligently judges The process of freeing the hands of the user and improving the user's use experience; at the same time, the embodiment of the present disclosure only starts the voice collection unit when the user needs it, thereby saving the power of the smart wearable device and avoiding the continuous operation of the voice collection unit. The battery life of smart wearable devices has been greatly reduced.
需要说明的是,本申请对于所述声音采集单元的启动时机不做任何限制,所述智能穿戴设备可以在打开任何应用的情况下,响应于用户的唤醒操作启动所述声音采集单元;并且,所述声音采集单元的启动与当前打开的应用为相互独立的两个功能。It should be noted that this application does not limit the start-up timing of the sound collection unit, and the smart wearable device can start the sound collection unit in response to the user's wake-up operation when any application is opened; and, The startup of the sound collection unit and the currently opened application are two independent functions.
在一实施例中,预先在云端配置意图关键词以及意图关键词对应的一条或多条响应参数,所述意图关键词表示所述语音消息语音信息可能执行的操作,比如接收到“我要回复短信”、“发短信”、“发送短信”等语音信号,其对应的意图关键词可以是“短信回复”,表示用户要进行短信回复的操作;另外,所述响应参数可以包括以下内容:In one embodiment, intent keywords and one or more response parameters corresponding to the intent keywords are pre-configured in the cloud, where the intent keywords indicate possible operations performed by the voice message voice information, such as receiving "I want to reply. For voice signals such as "SMS", "Send SMS", "Send SMS", the corresponding intent keyword may be "SMS reply", indicating that the user wants to perform the operation of replying to the SMS; in addition, the response parameters may include the following content:
在第一种可能的实现方式中,所述响应参数可以包括待响应的应用、响应触发方式以及对应的响应指令;所述响应触发方式表示执行所述响应指令的触发操作;在一个例子中,所述响应触发方式包括控件(虚拟按键或者实体控件)以及触发该控件的操作;比如意图关键词为“短信回复”,对应的响应参数包括短信应用、“回复”控件、触发该控件的操作以及回复指令;再如意图关键词为“保存”,可能对应多条响应参数,比如其中一条响应参数可以包括运动应用、“保存”控件、触发该控件的操作以及保存运动数据的保存指令,另一条响应参数可以包括电话应用、“保存”控件、触发该控件的操作以及保存电话号码的保存指令。In a first possible implementation manner, the response parameter may include an application to be responded to, a response trigger mode, and a corresponding response instruction; the response trigger mode represents a trigger operation for executing the response instruction; in one example, The response triggering method includes a control (virtual button or a physical control) and an operation that triggers the control; for example, the intent keyword is "SMS reply", and the corresponding response parameters include the SMS application, the "reply" control, the operation that triggers the control, and Reply command; if the intent keyword is "save", it may correspond to multiple response parameters. For example, one of the response parameters may include the sports application, the "save" control, the operation that triggers the control, and the save command to save the sports data, and the other The response parameters may include the phone application, a "save" control, the action that triggered the control, and a save instruction to save the phone number.
在第二种可能的实现方式中,所述响应参数可以包括待响应的应用页面、响应触发方式以及对应的响应指令;其中,所述应用页面表示应用向用户展示的应用的UI界面,比如短信回复页面。In a second possible implementation manner, the response parameters may include an application page to be responded to, a response triggering method, and a corresponding response instruction; wherein, the application page represents the UI interface of the application displayed by the application to the user, such as a short message Reply page.
在第三种可能的实现方式中,所述响应参数可以包括待响应的应用、待响应的应用页面、响应触发方式以及对应的响应指令;以意图关键词为“语音回复”为例,以下是两条响应参数的形式的示例性说明:In a third possible implementation manner, the response parameters may include the application to be responded to, the application page to be responded to, the response triggering method, and the corresponding response instruction; taking the intent keyword as "voice reply" as an example, the following are An example description of the form of the two response parameters:
{"packageName":"com.huami.wear.notification",{"packageName":"com.huami.wear.notification",
"appAction":"com.huami.wear.notification.ACTION_MESSAGE","appAction":"com.huami.wear.notification.ACTION_MESSAGE",
"action":"voice_reply"}"action":"voice_reply"}
或者or
{"packageName":"com.huami.wear.message",{"packageName":"com.huami.wear.message",
"appAction":"com.huami.wear.message.ACTION_DETAILS","appAction":"com.huami.wear.message.ACTION_DETAILS",
"action":"voice_reply"}"action":"voice_reply"}
其中,所述packageName表示待响应的应用,所述appAction表示待响应的应用页面,所述action表示响应触发方式以及对应的响应指令,即如何触发响应指令去执行。The packageName represents the application to be responded to, the appAction represents the application page to be responded to, and the action represents the response triggering method and the corresponding response instruction, that is, how to trigger the response instruction to execute.
可以看出,本公开实施例中无需对云端进行任何改进,只需将已经配置好的意图关键词以及意图关键词对应的响应参数的相关数据存到云端。It can be seen that, in the embodiment of the present disclosure, there is no need to make any improvements to the cloud, and it is only necessary to store the preconfigured intent keywords and relevant data of the response parameters corresponding to the intent keywords to the cloud.
在本公开实施例中,所述智能穿戴设备在基于所述语音采集单元采集到语音信号之后,将采集的所述语音信号发送给云端,所述云端在接收到所述语音信号之后,对所述语音信号进行语音识别以得到语音信息,然后将所述语音信息与预置的意图关键词进行匹配,从而获取与所述意图关键词对应的一条或多条响应参数并返回给所述智能穿戴设备,所述智能穿戴设备接收所述云端发送的与所述意图关键词对应的一条或多条响应参数。In the embodiment of the present disclosure, after collecting the voice signal based on the voice collecting unit, the smart wearable device sends the collected voice signal to the cloud, and after receiving the voice signal, the cloud sends the voice signal to the cloud. perform voice recognition on the voice signal to obtain voice information, and then match the voice information with preset intent keywords to obtain one or more response parameters corresponding to the intent keywords and return them to the smart wearable The smart wearable device receives one or more response parameters corresponding to the intent keyword and sent by the cloud.
在所述智能穿戴设备接收所述响应参数之后,为了与所述响应参数所包括的内容相对应,所述智能穿戴设备可以被配置为获取当前运行的应用以及当前显示的应用页面、或者获取两者其中之一,在第一种可能的方式中,若所述智能穿戴设备获取当前运行的应用以及当前显示的应用页面,则检测所述当前运行的应用与所述待响应的应用是否匹配,以及检测所述当前显示的应用页面与所述待响应的应用页面是否匹配;在第二种可能的方式中,若所述智能穿戴设备只获取当前运行的应用,则检测所述当前运行的应用与所述待响应的应用是否匹配;在第三种可能的实现方式中,若所述智能穿戴设备只获取当前显示的应用页面,则检测所述当前显示的应用页面与所述待响应的应用页面是否匹配;在以上三种情况中,若匹配,则所述智能穿戴设备基于所述响应触发方式触发所述当前显示的应用执行所述响应指令,否则,不响应所述语音信息。After the smart wearable device receives the response parameter, in order to correspond to the content included in the response parameter, the smart wearable device may be configured to acquire the currently running application and the currently displayed application page, or acquire both One of them, in a first possible manner, if the smart wearable device acquires the currently running application and the currently displayed application page, it detects whether the currently running application matches the application to be responded to, and detecting whether the currently displayed application page matches the application page to be responded; in a second possible way, if the smart wearable device only obtains the currently running application, then the currently running application is detected Whether it matches the application to be responded to; in a third possible implementation manner, if the smart wearable device only obtains the currently displayed application page, it detects the currently displayed application page and the application to be responded to Whether the page matches; in the above three cases, if it matches, the smart wearable device triggers the currently displayed application to execute the response instruction based on the response triggering method, otherwise, it does not respond to the voice information.
可以看出,对于云端而言,只需响应于智能穿戴设备的语音信号并返回相应的参数即可,其无需知道语音信号的具体执行含义,而是由智能穿戴设备来执行所述语音信号的具体含义,即是说,云端只需基于既定的流程执行即可,无需对云端做任何流程上的改动,从而使得本公开实施例的语音响应方法可以接入任何厂商的语音识别云端,具有良好的兼容性,而且,只需在智能穿戴设备上进行改进即可实现本公开实施例的语音响应方法,对于只能借用其他厂商的语音识别云端的智能穿戴设备也同样适用,具有广泛的适用性;进一步地,本公开实施例将相关的参数(意图关键词及对应的响应参数)配置在云端,当需要对相关的参数进行更新时,只需在云端上进行修改或替换,则接入云端的所有智能穿戴设备均可按照更新后的规则进行语音响应,操作简单高效,避免将相关的参数配置在智能穿戴设备上由于部分用户未更新固件、系统等而难以按照更新后的规则进行语音响应问题。It can be seen that for the cloud, it only needs to respond to the voice signal of the smart wearable device and return the corresponding parameters, it does not need to know the specific execution meaning of the voice signal, but the smart wearable device executes the voice signal. The specific meaning is that the cloud only needs to execute based on the established process, without any process changes to the cloud, so that the voice response method of the embodiment of the present disclosure can be connected to the voice recognition cloud of any manufacturer, and has good performance. Moreover, the voice response method of the embodiment of the present disclosure can be implemented only by making improvements on the smart wearable device, and it is also applicable to smart wearable devices that can only borrow the voice recognition cloud of other manufacturers, and has wide applicability ; Further, in the embodiment of the present disclosure, the relevant parameters (intent keywords and corresponding response parameters) are configured in the cloud, and when the relevant parameters need to be updated, it is only necessary to modify or replace them on the cloud, and then access the cloud All smart wearable devices can respond by voice according to the updated rules, the operation is simple and efficient, and it is difficult to configure the relevant parameters on smart wearable devices because some users have not updated the firmware, system, etc., and it is difficult to respond by voice according to the updated rules. question.
在一实现方式中,以所述响应参数包括待响应的应用、待响应的应用页面、响应触发方式以及对应的响应指令,且所述响应触发方式包括控件以及模拟用户触发该控件的操作为例进行说明:所述智能穿戴设备上包括一语音助手的应用程序,所述语音助手将所述声音采集单元采集的语音信号发送给云端,以从所述云端接收所述语音信号对应的语音信息以及相应的一条或多条响应参数,所述响应参数包括待响应的应用、待响应的应用页面、响应触发方式以及所述响应触发方式触发的响应指令,所述响应触发方式表示执行所述响应指令的触发操作,,则所述语音助手在检测到所述当前运行的应用为所述待响应的应用以及当前显示的应用页面为所述待响应的应用页面之后,模拟用户的操作触发所述控件,以使当前运行的应用执行所述响应指令。In one implementation, take the response parameter including the application to be responded, the application page to be responded, the response trigger mode and the corresponding response instruction, and the response trigger mode includes the control and the operation of simulating the user to trigger the control as an example. Description: The smart wearable device includes an application program of a voice assistant, and the voice assistant sends the voice signal collected by the voice acquisition unit to the cloud, so as to receive the voice information corresponding to the voice signal from the cloud and Corresponding one or more response parameters, the response parameters include the application to be responded, the application page to be responded, the response trigger mode and the response command triggered by the response trigger mode, and the response trigger mode means executing the response command triggering operation, the voice assistant simulates the user's operation to trigger the control after detecting that the currently running application is the application to be responded to and the currently displayed application page is the application page to be responded to , so that the currently running application executes the response instruction.
作为例子,假设待响应的应用为音乐播放应用,当前显示的应用页面为某首歌曲的播放页面,该播放页面中在三个不同的位置设置有三个功能控件:“上一首”功能控件,暂停功能控件以及“下一首”功能控件;相关技术中若用户想要触发其中的任一功能控件,用户需要在该功能控件上进行点击。而利用本说明书实施例的方案,当用户说出“暂停”,本实施例方案在识别出用户期望应用执行暂停功能后,可以模拟用户的操作触发暂停功能控件,则音乐播放应用通过该暂停功能控件检测到该控件被触发,因此会执行暂停功能,从而实现了语音控制。As an example, suppose that the application to be responded is a music playback application, the currently displayed application page is the playback page of a certain song, and the playback page is provided with three function controls in three different positions: the "previous song" function control, The pause function control and the "next track" function control; in the related art, if the user wants to trigger any of the function controls, the user needs to click on the function control. However, using the solution of the embodiment of this specification, when the user says "pause", the solution of this embodiment can simulate the user's operation to trigger the pause function control after recognizing that the user expects the application to execute the pause function, and the music playback application can pass the pause function. The control detects that the control is triggered, so it executes the pause function, enabling voice control.
在一种可能的实现方式中,为了进一步提高用户的使用体验,减少用户的操作步骤,所述响应参数中的响应指令可以被配置为复合型响应指令,所述复合型响应指令表示执行接下来的操作所需要响应的多条指令,作为例子,比如所述智能穿戴设备当前显示的应用为运动应用,当接收到用户“我要跑步”的语音信号时,由于进行跑步模式功能的前提是执行打开跑步模式以及打开定位的功能,则为了减少用户还需打开定位应用并打开定位功能的繁琐操作,可以预先设置所述响应参数包括运动应用、运动应用的页面、开启跑步模式的触发方式以及对应的打开跑步模式并打开定位功能的指令,或者所述响应参数包括运动应用、运动应用的页面两者之一以及其他参数,从而优化用户的使用体验。In a possible implementation manner, in order to further improve the user's use experience and reduce the user's operation steps, the response instruction in the response parameter may be configured as a compound response instruction, and the compound response instruction indicates that executing the next Multiple instructions that need to be responded to for the operation of the smart wearable device. For example, for example, the application currently displayed by the smart wearable device is a sports application. When the user's voice signal "I want to run" is received, the premise of the running mode function is to execute If the running mode and the positioning function are turned on, in order to reduce the tedious operation of opening the positioning application and turning on the positioning function, the response parameters can be preset to include the sports application, the page of the sports application, the triggering method for enabling the running mode, and the corresponding The instruction to turn on the running mode and turn on the positioning function, or the response parameter includes one of the sports application, the page of the sports application, and other parameters, so as to optimize the user experience.
需要说明的是,所述智能穿戴设备除了能够基于上述语音响应方法响应特定应用内的语音信号,以执行所述特定应用内的应用响应指令之外,也支持相关技术中通用的语音响应方法,响应于用户输入的语音信号以执行通用响应指令,比如在所述智能穿戴设备的应用显示界面上,采集到用户“我想听歌”的语音信号,所述智能穿戴设备可以基于所述语音信号执行打开音乐应用这个通用响应指令。It should be noted that the smart wearable device can not only respond to the voice signal in a specific application based on the above-mentioned voice response method to execute the application response command in the specific application, but also support the general voice response method in the related art, In response to the voice signal input by the user to execute a general response command, for example, on the application display interface of the smart wearable device, the voice signal of the user "I want to listen to a song" is collected, and the smart wearable device can be based on the voice signal. Execute the general response command to open the music app.
可以看出,本公开实施例能够根据应用确定用户语音的意图,并基于用户的语音执行应用的响应指令,给出用户想要的响应结果,对于智能穿戴设备这些显示屏有限的设备,比起触摸交互带来的不友好体验,通过语音交互来控制应用的具体功能更为便利,解放用户双手,显著提高用户的使用体验;并且,由于本公开实施例可以在任何应用打开的情况下启动所述声音采集单元,且声音采集单元与所述应用相互独立,即是说声音采集单元的启动不依赖于应用本身是否具备语音采集以及语音控制的相关功能,应用本身无需配置语音采集以及语音控制的相关功能,应用本身无需做任何有关语音控制的改进,也可以实现通过语音控制该应用的具体功能,从而避免开发人员改进应用带来的繁琐操作,同时使用该应用的用户也无需从应用商店更新应用以使应用具备语音采集功能,从而提高用户的使用体验。It can be seen that the embodiment of the present disclosure can determine the intention of the user's voice according to the application, and execute the response command of the application based on the user's voice, and give the response result that the user wants. The unfriendly experience brought by touch interaction makes it more convenient to control the specific functions of the application through voice interaction, frees the user's hands, and significantly improves the user's use experience; and, because the embodiment of the present disclosure can start all applications when any application is opened. The sound acquisition unit is described above, and the sound acquisition unit is independent of the application, that is to say, the startup of the sound acquisition unit does not depend on whether the application itself has the relevant functions of voice acquisition and voice control, and the application itself does not need to configure voice acquisition and voice control. For related functions, the application itself does not need to do any improvement on voice control, and the specific functions of the application can also be controlled by voice, so as to avoid the cumbersome operations brought by developers to improve the application, and users who use the application do not need to update from the application store. The application enables the application to have the function of voice capture, thereby improving the user experience.
请参阅图2,图2是本公开根据一示例性实施例示出的第二种语音响应方法的流程图,所述语音响应方法可以由智能穿戴设备来执行,所述方法包括:Please refer to FIG. 2. FIG. 2 is a flowchart of a second voice response method shown in the present disclosure according to an exemplary embodiment. The voice response method can be executed by a smart wearable device, and the method includes:
在步骤S201中,将采集的语音信号发送给云端,以从云端获取识别所述语音信号得到的语音信息。In step S201, the collected voice signal is sent to the cloud, so as to obtain voice information obtained by recognizing the voice signal from the cloud.
在步骤S202中,获取当前运行的应用和/或当前显示的应用页面对应的响应参数,所述响应参数包括一条或多条预置文本信息以及对应的响应指令。In step S202, response parameters corresponding to the currently running application and/or the currently displayed application page are acquired, where the response parameters include one or more pieces of preset text information and corresponding response instructions.
在步骤S203中,匹配所述文本信息与所述语音信息,若所述语音信息匹配所述预置文本信息,执行所述预置文本信息对应的响应指令。In step S203, the text information and the voice information are matched, and if the voice information matches the preset text information, a response instruction corresponding to the preset text information is executed.
在一实施例中,预先在所述智能穿戴设备上配置与应用和应用页面、或者与两者其中之一对应的文本信息,比如配置短信应用和短信回复页面对应“我要回复”、“短信回复”或者“发短信”等文本信息;所述智能穿戴设备包括声音采集单元,所述声音采集单元用于采集用户的语音信号,所述声音采集单元可以是麦克风、拾音器等设备。In one embodiment, the smart wearable device is preconfigured with text information corresponding to the application and the application page, or one of the two, for example, configuring the SMS application and the SMS reply page to correspond to "I want to reply", "SMS "Reply" or "Send a text message" and other text information; the smart wearable device includes a sound collection unit, the sound collection unit is used to collect the user's voice signal, and the sound collection unit can be a device such as a microphone and a pickup.
在本公开实施例中,所述智能穿戴设备通过所述声音采集单元采集语音信号,并将所述语音信号发送给云端,云端接收并识别所述语音信号得到语音信息,然后将识别的语音信息返回给所述智能穿戴设备,同时为了与预先配置的信息相对应,所述智能穿戴设备获取当前运行的应用和当前显示的应用页面、或者两者其中之一对应的响应参数,所述响应参数包括一条或多条预置文本信息以及对应的响应指令,然后将当前运行的应用和应用页面、或者两者其中之一对应的预置文本信息与所述语音信息进行匹配,若所述语音信息匹配所述预置文本信息,表明命中用户的语音意图,则执行所述预置文本信息对应的响应指令,否则,不响应所述语音信号;本公开实施例实现通过语音控制应用的具体功能,解放用户双手,提高用户的使用体验。In the embodiment of the present disclosure, the smart wearable device collects a voice signal through the sound acquisition unit, and sends the voice signal to the cloud, and the cloud receives and recognizes the voice signal to obtain voice information, and then uses the recognized voice information to Return to the smart wearable device, and in order to correspond to the pre-configured information, the smart wearable device obtains the response parameters corresponding to the currently running application and the currently displayed application page, or one of the two, the response parameter Include one or more preset text information and corresponding response instructions, and then match the currently running application and application page, or the preset text information corresponding to one of the two with the voice information, if the voice information If it matches the preset text information, indicating that the user's voice intention is hit, execute the response command corresponding to the preset text information, otherwise, do not respond to the voice signal; the embodiment of the present disclosure realizes the specific function of controlling the application by voice, Free the user's hands and improve the user's experience.
请参阅图3,图3是本公开根据一示例性实施例示出的第三种语音响应方法的流程图,所述语音响应方法可以由云端来执行,所述云端可以是具备语音识别功能的云服务器,所述方法包括:Please refer to FIG. 3. FIG. 3 is a flowchart of a third voice response method according to an exemplary embodiment of the present disclosure. The voice response method may be executed by a cloud, and the cloud may be a cloud with a voice recognition function. server, the method includes:
在步骤S301中,接收智能穿戴设备发送的语音信号,识别所述语音信号得到的语音信息。In step S301, a voice signal sent by the smart wearable device is received, and voice information obtained by recognizing the voice signal is obtained.
在步骤S302中,基于所述语音信息匹配预置的意图关键词,以获取与所述意图关键词对应的一条或多条响应参数;所述意图关键词表示所述语音信息可能执行的操作;所述响应参数包括待响应的应用和/或待响应的应用页面以及、对应的响应指令。In step S302, matching preset intent keywords based on the voice information to obtain one or more response parameters corresponding to the intent keywords; the intent keywords represent possible operations performed by the voice information; The response parameters include the application to be responded to and/or the application page to be responded to and corresponding response instructions.
在步骤S303中,接收所述智能穿戴设备发送的当前运行的应用和/或当前显示的应用页面,若所述当前运行的应用为所述待响应的应用、和/或所述当前显示的应用页面为所述待响应的应用页面,将所述响应指令发送给所述智能穿戴设备,以使所述智能穿戴设备执行所述响应指令。In step S303, receive the currently running application and/or the currently displayed application page sent by the smart wearable device, if the currently running application is the application to be responded to and/or the currently displayed application The page is the application page to be responded, and the response instruction is sent to the smart wearable device, so that the smart wearable device executes the response instruction.
在一实施例中,预先在云端配置意图关键词以及意图关键词对应的一条或多条响应参数,所述意图关键词表示所述语音消息语音信息可能执行的操作;另外,所述响应参数可以包括以下内容:在第一种可能的实现方式中,所述响应参数可以包括待响应的应用、响应触发方式以及对应的响应指令;在第二种可能的实现方式中,所述响应参数可以包括待响应的应用页面、响应触发方式以及对应的响应指令;在第三种可能的实现方式中,所述响应参数可以包括待响应的应用、待响应的应用页面、响应触发方式以及对应的响应指令。In an embodiment, intent keywords and one or more response parameters corresponding to the intent keywords are pre-configured in the cloud, and the intent keywords indicate possible operations performed by the voice message voice information; in addition, the response parameters may be: It includes the following content: in a first possible implementation manner, the response parameter may include an application to be responded, a response triggering manner, and a corresponding response instruction; in a second possible implementation manner, the response parameter may include The application page to be responded to, the response triggering method, and the corresponding response instruction; in a third possible implementation manner, the response parameters may include the application to be responded to, the application page to be responded to, the response triggering method, and the corresponding response instruction .
在本公开实施例中,在所述云端接收到所述智能穿戴设备发送的语音信号,并且,若所述响应参数包括待响应的应用和待响应的应用页面,所述智能穿戴设备被配置为发送当前运行的应用和当前显示应用页面;若所述响应参数包括待响应的应用,所述智能穿戴设备被配置为发送当前运行的应用;若所述响应参数包括待响应的应用页面,所述智能穿戴设备被配置为发送当前显示应用页面;所述云端识别所述语音信号得到语音信息,并将所述语音信息与预置的意图关键词进行匹配,获取与所述意图关键词对应的一条或多条响应参数,若所述响应参数包括待响应的应用和待响应的应用页面,所述云端检测所述当前运行的应用是否为所述待响应的应用,以及检测所述当前显示的应用页面是否为所述待响应的应用页面;若所述响应参数包括待响应的应用,所述云端检测所述当前运行的应用是否为所述待响应的应用;若所述响应参数包括待响应的应用页面,所述云端检测所述当前显示的应用页面是否为所述待响应的应用页面;在以上三种情况中,若是,则所述云端将所述响应触发方式以及对应的响应指令发送给所述智能穿戴设备,使得所述智能穿戴设备基于所述响应触发方式触发所述当前运行的应用执行所述响应指令,否则,不响应所述语音信息。In the embodiment of the present disclosure, the voice signal sent by the smart wearable device is received in the cloud, and if the response parameter includes an application to be responded to and an application page to be responded to, the smart wearable device is configured to Send the currently running application and the currently displayed application page; if the response parameter includes the application to be responded, the smart wearable device is configured to send the currently running application; if the response parameter includes the application page to be responded, the The smart wearable device is configured to send the currently displayed application page; the cloud recognizes the voice signal to obtain voice information, matches the voice information with a preset intent keyword, and obtains an item corresponding to the intent keyword or multiple response parameters, if the response parameters include the application to be responded to and the application page to be responded to, the cloud detects whether the currently running application is the application to be responded to, and detects the currently displayed application Whether the page is the application page to be responded; if the response parameter includes the application to be responded, the cloud detects whether the currently running application is the application to be responded; if the response parameter includes the application to be responded Application page, the cloud detects whether the currently displayed application page is the application page to be responded; in the above three cases, if so, the cloud sends the response triggering method and the corresponding response instruction to The smart wearable device enables the smart wearable device to trigger the currently running application to execute the response instruction based on the response triggering method, otherwise, does not respond to the voice information.
可以理解的是,上述实施例仅作为示例性的,当前运行的应用、当前显示的应用页面中一种或多种可以与语音信号同时发送,也可以不同时发送,本申请对此并不做限定。本公开实施例通过对云端进行改进,利用云端强大的计算资源实现基于语音控制应用的具体功能,实现在智能穿戴设备上通过语音交互的方法替代触摸交互的方法,提高用户的使用体验;进一步地,本公开实施例将相关的参数(意图关键词及对应的响应参数)配置在云端,当需要对相关的参数进行更新或者对语音响应功能进行改进时,只需在云端上进行修改或替换,则接入云端的所有智能穿戴设备均可按照更新后的规则进行语音响应,操作简单高效,避免将相关的参数配置在智能穿戴设备上由于部分用户未更新固件、系统等难以按照更新后的规则进行语音响应问题。It can be understood that the above embodiments are only exemplary, and one or more of the currently running application and the currently displayed application page may be sent at the same time as the voice signal, or may not be sent at the same time, and this application does not do this. limited. The embodiments of the present disclosure improve the cloud, utilize the powerful computing resources of the cloud to implement specific functions based on voice control applications, and replace the touch interaction method on the smart wearable device with the voice interaction method, thereby improving the user experience; further , in this embodiment of the present disclosure, the relevant parameters (intent keywords and corresponding response parameters) are configured in the cloud, and when the relevant parameters need to be updated or the voice response function needs to be improved, it is only necessary to modify or replace them on the cloud. Then all smart wearable devices connected to the cloud can respond by voice according to the updated rules, the operation is simple and efficient, and it is difficult to configure relevant parameters on smart wearable devices because some users have not updated the firmware, system, etc. according to the updated rules. Make a voice response question.
请参阅图4,图4是本公开根据一示例性实施例示出的第四种语音响应方法的流程图,所述语音响应方法可以由与智能穿戴设备关联的移动终端来执行,所述移动终端可以是手机、个人平板或者电脑等,所述方法包括:Please refer to FIG. 4. FIG. 4 is a flowchart of a fourth voice response method according to an exemplary embodiment of the present disclosure. The voice response method may be executed by a mobile terminal associated with a smart wearable device. The mobile terminal It can be a mobile phone, a personal tablet or a computer, etc. The method includes:
在步骤S401中,接收云端发送的语音信息;所述语音信息为关联的智能穿戴设备将采集的语音信号发送给云端之后,由所述云端识别所述语音信号得到的。In step S401, the voice information sent by the cloud is received; the voice information is obtained by the cloud recognizing the voice signal after the associated smart wearable device sends the collected voice signal to the cloud.
在步骤S402中,接收所述云端发送的与所述语音信息相应的一条或多条响应参数;所述响应参数为所述云端基于所述语音信息匹配预置的意图关键词,获取与所述意图关键词对应的一条或多条响应参数并返回的;所述响应参数包括待响应的应用和/或待响应的应用页面、以及对应的响应指令。In step S402, one or more response parameters corresponding to the voice information sent by the cloud are received; the response parameters are the intent keywords that are preset by the cloud based on matching the voice information, and the response parameters are obtained and matched with the voice information. One or more response parameters corresponding to the intent keyword are returned; the response parameters include the application to be responded to and/or the application page to be responded to, and the corresponding response instruction.
在步骤S403中,接收所述智能穿戴设备发送的当前运行的应用和/或当前显示的应用页面,若当前运行的应用为所述待响应的应用、和/或当前显示的应用页面为所述待响应的应用页面,将所述响应指令发送给所述智能穿戴设备,以使所述智能穿戴设备执行所述响应指令。In step S403, receiving the currently running application and/or the currently displayed application page sent by the smart wearable device, if the currently running application is the application to be responded to and/or the currently displayed application page is the The application page to be responded, sends the response instruction to the smart wearable device, so that the smart wearable device executes the response instruction.
在一实施例中,预先在云端配置意图关键词以及意图关键词对应的一条或多条响应参数,所述意图关键词表示所述语音消息语音信息可能执行的操作;另外,所述响应参数可以包括以下内容:在第一种可能的实现方式中,所述响应参数可以包括待响应的应用、响应触发方式以及对应的响应指令;在第二种可能的实现方式中,所述响应参数可以包括待响应的应用页面、响应触发方式以及对应的响应指令;在第三种可能的实现方式中,所述响应参数可以包括待响应的应用、待响应的应用页面、响应触发方式以及对应的响应指令。In an embodiment, intent keywords and one or more response parameters corresponding to the intent keywords are pre-configured in the cloud, and the intent keywords indicate possible operations performed by the voice message voice information; in addition, the response parameters may be: It includes the following content: in a first possible implementation manner, the response parameter may include an application to be responded, a response triggering manner, and a corresponding response instruction; in a second possible implementation manner, the response parameter may include The application page to be responded to, the response triggering method, and the corresponding response instruction; in a third possible implementation manner, the response parameters may include the application to be responded to, the application page to be responded to, the response triggering method, and the corresponding response instruction .
在本公开实施例中,所述移动终端可以通过蓝牙连接所述智能穿戴设备,以接收所述智能穿戴设备发送的语音信号,所述智能穿戴设备同时也将所述语音信号发送给云端,以使云端接收并识别所述语音信号得到语音信息,所述移动终端可以基于所述语音信号向所述云端发起语音回调指令,以接收所述云端发送的所述语音信号对应的语音信息,同时所述云端基于识别出的语音信息匹配预置的意图关键词,获取与所述意图关键词对应的一条或多条响应参数并返回给所述移动终端。In this embodiment of the present disclosure, the mobile terminal may be connected to the smart wearable device through Bluetooth to receive a voice signal sent by the smart wearable device, and the smart wearable device also sends the voice signal to the cloud to Make the cloud receive and recognize the voice signal to obtain voice information, and the mobile terminal can initiate a voice callback instruction to the cloud based on the voice signal, so as to receive the voice information corresponding to the voice signal sent by the cloud, and at the same time The cloud matches preset intent keywords based on the recognized voice information, acquires one or more response parameters corresponding to the intent keywords, and returns them to the mobile terminal.
与所述响应参数相对应,所述移动终端也接收所述智能穿戴设备发送的当前运行的应用和当前显示的应用页面、或者两者其中之一的相关信息,若从云端接收的所述响应参数包括待响应的应用和待响应的应用页面,所述移动终端检测所述当前运行的应用是否为所述待响应的应用,以及检测所述当前显示的应用页面是否为所述待响应的应用页面;若所述响应参数包括待响应的应用,所述移动终端检测所述当前运行的应用是否为所述待响应的应用;若所述响应参数包括待响应的应用页面,所述移动终端检测所述当前显示的应用页面是否为所述待响应的应用页面;在以上三种情况中,若是,则所述移动终端将所述响应触发方式以及对应的响应指令发送给所述智能穿戴设备,使得所述智能穿戴设备基于所述响应触发方式触发所述当前运行的应用执行所述响应指令,否则,不响应所述语音信息。Corresponding to the response parameter, the mobile terminal also receives the information about the currently running application and the currently displayed application page, or one of the two sent by the smart wearable device, if the response received from the cloud The parameters include the application to be responded to and the application page to be responded to, and the mobile terminal detects whether the currently running application is the application to be responded to, and detects whether the currently displayed application page is the application to be responded to page; if the response parameter includes the application to be responded, the mobile terminal detects whether the currently running application is the application to be responded; if the response parameter includes the application page to be responded, the mobile terminal detects Whether the currently displayed application page is the application page to be responded; in the above three cases, if so, the mobile terminal sends the response triggering method and the corresponding response instruction to the smart wearable device, The smart wearable device is caused to trigger the currently running application to execute the response instruction based on the response triggering method, otherwise, it does not respond to the voice information.
可以理解的是,上述实施例仅作为示例性的,当前运行的应用、当前显示的应用页面中一种或多种可以与语音信号同时发送,也可以不同时发送,本申请对此并不做限定。It can be understood that the above embodiments are only exemplary, and one or more of the currently running application and the currently displayed application page may be sent at the same time as the voice signal, or may not be sent at the same time, and this application does not do this. limited.
本公开实施例通过对移动终端进行改进,使得移动终端可以根据应用明确用户的语音意图,实现通过语音控制应用的具体功能,提高用户的使用体验;进一步地,本公开实施例将相关的参数(意图关键词及对应的响应参数)配置在云端,当需要对相关的参数进行更新时,只需在云端上进行修改或替换,则接入云端的所有移动终端均可按照更新后的规则进行语音响应,操作简单高效,避免将相关的参数配置在智能穿戴设备、移动终端上由于部分用户未更新固件、系统、应用软件等难以按照更新后的规则进行语音响应问题。The embodiment of the present disclosure improves the mobile terminal, so that the mobile terminal can clarify the user's voice intention according to the application, realize the specific function of the application through the voice control, and improve the user's use experience; further, the embodiment of the present disclosure uses the relevant parameters ( Intent keywords and corresponding response parameters) are configured in the cloud, when the relevant parameters need to be updated, only need to be modified or replaced on the cloud, then all mobile terminals connected to the cloud can speak according to the updated rules. Responding, the operation is simple and efficient, and it avoids the problem of configuring the relevant parameters on smart wearable devices and mobile terminals because some users have not updated the firmware, system, application software, etc.
在另一种实施例中,也可以在移动终端上配置意图关键词以及意图关键词对应的一条或多条响应参数,比如所述响应参数包括待响应的应用、待响应的应用页面、响应触发方式以及对应的响应指令,所述移动终端基于采集的语音信号,从云端获取识别所述语音信号得到的语音信息,所述移动终端根据所述语音信息匹配预置的意图关键词,获取与意图关键词对应的一条或多条响应参数,并且所述移动终端接收所述智能穿戴设备发送的当前运行的应用和当前显示的应用页面的相关信息,若检测到所述当前运行的应用为所述待响应的应用,以及检测所述当前显示的应用页面为所述待响应的应用页面,将所述响应触发方式以及对应的响应指令发送给所述智能穿戴设备,使得所述智能穿戴设备基于所述响应触发方式触发所述当前运行的应用执行所述响应指令,否则,不响应所述语音信息。In another embodiment, intent keywords and one or more response parameters corresponding to the intent keywords may also be configured on the mobile terminal. For example, the response parameters include the application to be responded, the application page to be responded, and the response trigger. The mobile terminal obtains the voice information obtained by recognizing the voice signal from the cloud based on the collected voice signal, and the mobile terminal matches the preset intent keyword according to the voice information, and obtains the corresponding intent keyword. One or more response parameters corresponding to the keyword, and the mobile terminal receives the information about the currently running application and the currently displayed application page sent by the smart wearable device, if it is detected that the currently running application is the The application to be responded, and the currently displayed application page is detected as the application page to be responded, and the response triggering method and the corresponding response instruction are sent to the smart wearable device, so that the smart wearable device is based on the application page. The response triggering manner triggers the currently running application to execute the response instruction; otherwise, the voice information is not responded to.
如图5所示,图5是本公开根据一示例性实施例示出的一种语音响应装置的框图,包括:As shown in FIG. 5, FIG. 5 is a block diagram of a voice response apparatus according to an exemplary embodiment of the present disclosure, including:
语音信息获取模块501,被配置为基于采集的语音信号,获取识别所述语音信号得到的语音信息。The voice
响应参数获取模块502,被配置为获取与所述语音信息相应的响应参数;所述响应参数包括待响应的应用和/或待响应的应用页面、以及对应的响应指令。The response
响应指令执行模块503,被配置为若当前运行的应用为所述待响应的应用、和/或当前显示的应用页面为所述待响应的应用页面,执行所述响应指令。The response
可选地,所述响应参数还包括响应触发方式。Optionally, the response parameter further includes a response triggering method.
所述响应指令执行模块503被配置为:The response
若当前运行的应用为所述待响应的应用、和/或当前显示的应用页面为所述待响应的应用页面,基于所述响应触发方式触发所述当前运行的应用执行所述响应指令。If the currently running application is the application to be responded, and/or the currently displayed application page is the application page to be responded, trigger the currently running application to execute the response instruction based on the response triggering method.
可选地,所述语音响应方法应用于智能穿戴设备。Optionally, the voice response method is applied to a smart wearable device.
所述语音信息获取模块501被配置为:The voice
将采集的所述语音信号发送给云端;所述语音信号用于触发所述云端识别所述语音信号得到语音信息,并基于所述语音信息匹配预置的意图关键词,以获取与所述意图关键词对应的一条或多条响应参数并返回给所述智能穿戴设备;所述意图关键词表示所述语音信息可能执行的操作。Send the collected voice signal to the cloud; the voice signal is used to trigger the cloud to recognize the voice signal to obtain voice information, and match preset intent keywords based on the voice information to obtain the intent One or more response parameters corresponding to the keywords are returned to the smart wearable device; the intent keywords indicate possible operations performed by the voice information.
所述响应参数获取模块502被配置为:The response
接收所述云端发送的与所述意图关键词对应的一条或多条响应参数。One or more response parameters corresponding to the intent keyword sent by the cloud are received.
可选地,所述语音响应方法应用于智能穿戴设备。Optionally, the voice response method is applied to a smart wearable device.
所述语音信息获取模块501,被配置为:The voice
将采集的语音信号发送给云端,以从云端获取识别所述语音信号得到的语音信息。The collected voice signal is sent to the cloud, so as to obtain voice information obtained by recognizing the voice signal from the cloud.
所述响应参数获取模块502以及所述响应指令执行模块503,被配置为:The response
获取当前运行的应用和/或当前显示的应用页面对应的响应参数;所述响应参数还包括一条或多条预置文本信息;匹配所述文本信息与所述语音信息,若所述语音信息匹配所述预置文本信息,执行所述预置文本信息对应的响应指令。Obtain the response parameters corresponding to the currently running application and/or the currently displayed application page; the response parameters also include one or more pieces of preset text information; match the text information and the voice information, if the voice information matches For the preset text information, a response instruction corresponding to the preset text information is executed.
可选地,所述语音响应方法应用于云端。Optionally, the voice response method is applied in the cloud.
所述语音信息获取模块501被配置为:The voice
接收智能穿戴设备发送的语音信号,识别所述语音信号得到的语音信息。Receive the voice signal sent by the smart wearable device, and recognize the voice information obtained from the voice signal.
所述响应参数获取模块502被配置为:The response
基于所述语音信息匹配预置的意图关键词,以获取与所述意图关键词对应的一条或多条响应参数;所述意图关键词表示所述语音信息的可能执行的操作。Match a preset intent keyword based on the voice information to obtain one or more response parameters corresponding to the intent keyword; the intent keyword represents a possible operation of the voice information.
所述响应指令执行模块503被配置为:The response
应用和/或应用页面接收子模块,被配置为接收所述智能穿戴设备发送的当前运行的应用和/或当前显示的应用页面。The application and/or application page receiving sub-module is configured to receive the currently running application and/or the currently displayed application page sent by the smart wearable device.
响应指令发送子模块,被配置为若所述当前运行的应用为所述待响应的应用、和/或所述当前显示的应用页面为所述待响应的应用页面,将所述响应指令发送给所述智能穿戴设备,以使所述智能穿戴设备执行所述响应指令。A response instruction sending submodule is configured to send the response instruction to if the currently running application is the application to be responded and/or the currently displayed application page is the application page to be responded the smart wearable device, so that the smart wearable device executes the response instruction.
可选地,所述语音响应方法应用于移动终端;所述移动终端与智能穿戴设备关联。Optionally, the voice response method is applied to a mobile terminal; the mobile terminal is associated with a smart wearable device.
所述语音信息获取模块501被配置为:The voice
接收云端发送的语音信息;所述语音信息为关联的智能穿戴设备将采集的语音信号发送给云端之后,由所述云端识别所述语音信号得到的。Receive the voice information sent by the cloud; the voice information is obtained by the cloud recognizing the voice signal after the associated smart wearable device sends the collected voice signal to the cloud.
所述响应参数获取模块502被配置为:The response
接收所述云端发送的与所述语音信息相应的一条或多条响应参数;所述响应参数为所述云端基于所述语音信息匹配预置的意图关键词,获取与所述意图关键词对应的一条或多条响应参数并返回的。Receive one or more response parameters corresponding to the voice information sent by the cloud; the response parameters are that the cloud matches preset intent keywords based on the voice information, and obtains the intent keywords corresponding to the intent keywords. One or more response parameters and returned.
所述响应指令执行模块503被配置为:The response
应用和/或应用页面接收子模块,被配置为接收所述智能穿戴设备发送的当前运行的应用和/或当前显示的应用页面。The application and/or application page receiving sub-module is configured to receive the currently running application and/or the currently displayed application page sent by the smart wearable device.
响应指令发送子模块,被配置为若当前运行的应用为所述待响应的应用、和/或当前显示的应用页面为所述待响应的应用页面,将所述响应指令发送给所述智能穿戴设备,以使所述智能穿戴设备执行所述响应指令。A response instruction sending submodule, configured to send the response instruction to the smart wearable if the currently running application is the application to be responded and/or the currently displayed application page is the application page to be responded device, so that the smart wearable device executes the response instruction.
可选地,所述智能穿戴设备包括声音采集单元。Optionally, the smart wearable device includes a sound collection unit.
所述语音信号为所述智能穿戴设备响应于用户的唤醒操作,启动所述声音采集单元采集得到的。The voice signal is collected by the smart wearable device starting the sound collecting unit in response to the user's wake-up operation.
可选地,所述智能穿戴设备包括惯性传感器。Optionally, the smart wearable device includes an inertial sensor.
所述唤醒操作包括指定控件的触发操作或者基于所述惯性传感器采集的数据确定的用户的指定动作。上述显示装置中各个模块的功能和作用的实现过程具体详见上述显示方法中对应步骤的实现过程,在此不再赘述。The wake-up operation includes a trigger operation of a designated control or a designated action of a user determined based on data collected by the inertial sensor. For details of the implementation process of the functions and functions of each module in the above-mentioned display device, please refer to the implementation process of the corresponding steps in the above-mentioned display method, which will not be repeated here.
对于装置实施例而言,由于其基本对应于方法实施例,所以相关之处参见方法实施例的部分说明即可。以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的模块可以是或者也可以不是物理上分开的,作为模块显示的部件可以是或者也可以不是物理模块,即可以位于一个地方,或者也可以分布到多个网络模块上。可以根据实际的需要选择其中的部分或者全部模块来实现本公开方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。As for the apparatus embodiments, since they basically correspond to the method embodiments, reference may be made to the partial descriptions of the method embodiments for related parts. The device embodiments described above are only illustrative, wherein the modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in One place, or it can be distributed over multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of the present disclosure. Those of ordinary skill in the art can understand and implement it without creative effort.
相应的,本公开还提供一种电子设备,包括:Correspondingly, the present disclosure also provides an electronic device, comprising:
处理器;processor;
用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
其中,in,
所述处理器被配置为执行如上所述语音响应方法中的操作。The processor is configured to perform the operations in the voice response method as described above.
其中,所述电子设备可以是智能穿戴设备、云服务器或者移动终端。Wherein, the electronic device may be a smart wearable device, a cloud server or a mobile terminal.
图6是根据一示例性实施例示出的一种语音响应装置应用的电子设备的结构示意图。FIG. 6 is a schematic structural diagram of an electronic device to which a voice response apparatus is applied, according to an exemplary embodiment.
如图6所示,根据一示例性实施例示出的一种电子设备600,该电子设备600可以是智能穿戴设备、云服务器或者移动终端。As shown in FIG. 6 , according to an
参照图6,电子设备600可以包括以下一个或多个组件:处理组件601,存储器602,电源组件603,多媒体组件604,音频组件605,输入/输出(I/O)的接口606,传感器组件607,以及通信组件608。6, an
处理组件601通常控制电子设备600的整体操作,诸如与显示,电话呼叫,数据通信,相机操作和记录操作相关联的操作。处理组件601可以包括一个或多个处理器609来执行指令,以完成上述的方法的全部或部分步骤。此外,处理组件601可以包括一个或多个模块,便于处理组件601和其它组件之间的交互。例如,处理组件601可以包括多媒体模块,以方便多媒体组件604和处理组件601之间的交互。The
存储器602被配置为存储各种类型的数据以支持在电子设备600的操作。这些数据的示例包括用于在电子设备600上操作的任何应用程序或方法的指令,联系人数据,电话簿数据,消息,图片,视频等。存储器602可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。
电源组件603为电子设备600的各种组件提供电力。电源组件603可以包括电源管理系统,一个或多个电源,及其它与为电子设备600生成、管理和分配电力相关联的组件。
多媒体组件604包括在所述电子设备600和用户之间的提供一个输出接口的屏幕。在一些实施例中,屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板,屏幕可以被实现为触摸屏,以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界,而且还检测与所述触摸或滑动操作相关的持续时间和压力。在一些实施例中,多媒体组件604包括一个前置摄像头和/或后置摄像头。当电子设备600处于操作模式,如拍摄模式或视频模式时,前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。
音频组件605被配置为输出和/或输入音频信号。例如,音频组件605包括一个麦克风(MIC),当电子设备600处于操作模式,如呼叫模式、记录模式和语音识别模式时,麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器602或经由通信组件608发送。在一些实施例中,音频组件605还包括一个扬声器,用于输出音频信号。
I/O接口602为处理组件601和外围接口模块之间提供接口,上述外围接口模块可以是键盘,点击轮,按钮等。这些按钮可包括但不限于:主页按钮、音量按钮、启动按钮和锁定按钮。The I/
传感器组件607包括一个或多个传感器,用于为电子设备600提供各个方面的状态评估。例如,传感器组件607可以检测到电子设备600的打开/关闭状态,组件的相对定位,例如所述组件为电子设备600的显示器和小键盘,传感器组件607还可以检测电子设备600或电子设备600一个组件的位置改变,用户与电子设备600接触的存在或不存在,电子设备600方位或加速/减速和电子设备600的温度变化。传感器组件607可以包括接近传感器,被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件607还可以包括光传感器,如CMOS或CCD图像传感器,用于在成像应用中使用。在一些实施例中,该传感器组件607还可以包括加速度传感器,陀螺仪传感器,磁传感器,压力传感器、心率信号传感器、心电图传感器、指纹传感器或温度传感器。
通信组件608被配置为便于电子设备600和其它设备之间有线或无线方式的通信。电子设备600可以接入基于通信标准的无线网络,如WiFi,2G或3G,或它们的组合。在一个示例性实施例中,通信组件608经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中,所述通信组件608还包括近场通信(NFC)模块,以促进短程通信。例如,在NFC模块可基于射频识别(RFID)技术,红外数据协会(IrDA)技术,超宽带(UWB)技术,蓝牙(BT)技术和其它技术来实现。
在示例性实施例中,电子设备600可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其它电子元件实现,用于执行上述方法。In an exemplary embodiment,
在示例性实施例中,还提供了一种包括指令的非临时性计算机可读存储介质,例如包括指令的存储器602,上述指令可由电子设备600的处理器609执行以完成上述方法。例如,所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。In an exemplary embodiment, there is also provided a non-transitory computer-readable storage medium including instructions, such as a
其中,当所述存储介质中的指令由所述处理器609执行时,使得电子设备600能够执行前述语音响应方法。Wherein, when the instructions in the storage medium are executed by the
一种计算机可读存储介质,其上存储有计算机程序,当由一个或多个处理器执行时,使得处理器执行上述语音响应方法。A computer-readable storage medium having stored thereon a computer program that, when executed by one or more processors, causes the processors to perform the above-described voice response method.
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本公开的其它实施方案。本公开旨在涵盖本公开的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本公开的真正范围和精神由下面的权利要求指出。Other embodiments of the present disclosure will readily suggest themselves to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common general knowledge or techniques in the technical field not disclosed by this disclosure . The specification and examples are to be regarded as exemplary only, with the true scope and spirit of the disclosure being indicated by the following claims.
应当理解的是,本公开并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求来限制。It is to be understood that the present disclosure is not limited to the precise structures described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
以上所述仅为本公开的较佳实施例而已,并不用以限制本公开,凡在本公开的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本公开保护的范围之内。The above descriptions are only preferred embodiments of the present disclosure, and are not intended to limit the present disclosure. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present disclosure shall be included in the present disclosure. within the scope of protection.
Claims (18)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910609650.9A CN112201230A (en) | 2019-07-08 | 2019-07-08 | Voice response method, device, equipment and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910609650.9A CN112201230A (en) | 2019-07-08 | 2019-07-08 | Voice response method, device, equipment and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN112201230A true CN112201230A (en) | 2021-01-08 |
Family
ID=74004589
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910609650.9A Pending CN112201230A (en) | 2019-07-08 | 2019-07-08 | Voice response method, device, equipment and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112201230A (en) |
Citations (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104219388A (en) * | 2014-08-28 | 2014-12-17 | 小米科技有限责任公司 | Voice control method and device |
CN106373570A (en) * | 2016-09-12 | 2017-02-01 | 深圳市金立通信设备有限公司 | Voice control method and terminal |
CN106526619A (en) * | 2016-10-26 | 2017-03-22 | 广东小天才科技有限公司 | method and device for automatically starting GPS positioning function |
CN107112014A (en) * | 2014-12-19 | 2017-08-29 | 亚马逊技术股份有限公司 | Application foci in voice-based system |
CN107608652A (en) * | 2017-08-28 | 2018-01-19 | 三星电子(中国)研发中心 | A kind of method and apparatus of Voice command graphical interfaces |
CN108108142A (en) * | 2017-12-14 | 2018-06-01 | 广东欧珀移动通信有限公司 | Voice information processing method and device, terminal equipment and storage medium |
EP3346400A1 (en) * | 2017-01-09 | 2018-07-11 | Apple Inc. | Application integration with a digital assistant |
CN108305626A (en) * | 2018-01-31 | 2018-07-20 | 百度在线网络技术(北京)有限公司 | The sound control method and device of application program |
CN108364646A (en) * | 2018-02-08 | 2018-08-03 | 上海智臻智能网络科技股份有限公司 | Embedded speech operating method, device and system |
CN108519871A (en) * | 2018-03-30 | 2018-09-11 | 广东欧珀移动通信有限公司 | Audio signal processing method and related products |
CN108683937A (en) * | 2018-03-09 | 2018-10-19 | 百度在线网络技术(北京)有限公司 | Interactive voice feedback method, system and the computer-readable medium of smart television |
CN108700429A (en) * | 2017-01-22 | 2018-10-23 | 华为技术有限公司 | The method and electronic equipment of motion recording |
CN108761496A (en) * | 2018-05-23 | 2018-11-06 | 四川斐讯信息技术有限公司 | A kind of method and device automatically turning on GPS |
CN109389974A (en) * | 2017-08-09 | 2019-02-26 | 阿里巴巴集团控股有限公司 | A kind of method and device of voice operating |
-
2019
- 2019-07-08 CN CN201910609650.9A patent/CN112201230A/en active Pending
Patent Citations (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104219388A (en) * | 2014-08-28 | 2014-12-17 | 小米科技有限责任公司 | Voice control method and device |
CN107112014A (en) * | 2014-12-19 | 2017-08-29 | 亚马逊技术股份有限公司 | Application foci in voice-based system |
CN106373570A (en) * | 2016-09-12 | 2017-02-01 | 深圳市金立通信设备有限公司 | Voice control method and terminal |
CN106526619A (en) * | 2016-10-26 | 2017-03-22 | 广东小天才科技有限公司 | method and device for automatically starting GPS positioning function |
EP3346400A1 (en) * | 2017-01-09 | 2018-07-11 | Apple Inc. | Application integration with a digital assistant |
CN108700429A (en) * | 2017-01-22 | 2018-10-23 | 华为技术有限公司 | The method and electronic equipment of motion recording |
CN109389974A (en) * | 2017-08-09 | 2019-02-26 | 阿里巴巴集团控股有限公司 | A kind of method and device of voice operating |
CN107608652A (en) * | 2017-08-28 | 2018-01-19 | 三星电子(中国)研发中心 | A kind of method and apparatus of Voice command graphical interfaces |
CN108108142A (en) * | 2017-12-14 | 2018-06-01 | 广东欧珀移动通信有限公司 | Voice information processing method and device, terminal equipment and storage medium |
CN108305626A (en) * | 2018-01-31 | 2018-07-20 | 百度在线网络技术(北京)有限公司 | The sound control method and device of application program |
CN108364646A (en) * | 2018-02-08 | 2018-08-03 | 上海智臻智能网络科技股份有限公司 | Embedded speech operating method, device and system |
CN108683937A (en) * | 2018-03-09 | 2018-10-19 | 百度在线网络技术(北京)有限公司 | Interactive voice feedback method, system and the computer-readable medium of smart television |
CN108519871A (en) * | 2018-03-30 | 2018-09-11 | 广东欧珀移动通信有限公司 | Audio signal processing method and related products |
CN108761496A (en) * | 2018-05-23 | 2018-11-06 | 四川斐讯信息技术有限公司 | A kind of method and device automatically turning on GPS |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
RU2766255C1 (en) | Voice control method and electronic device | |
EP3136793B1 (en) | Method and apparatus for awakening electronic device | |
JP6072362B2 (en) | Application program processing method, apparatus, program, and storage medium | |
EP3249524A1 (en) | Method and device for upgrading a zigbee device | |
CN105159672B (en) | Remote Assistance Methods and Clients | |
CN110610699B (en) | Voice signal processing method, device, terminal, server and storage medium | |
US20170150290A1 (en) | Method and device for information push | |
WO2017028425A1 (en) | Energy-saving mode activation method and device | |
WO2015154360A1 (en) | Method and device for controlling smart terminal | |
CN107666536B (en) | Method and device for searching terminal | |
RU2663709C2 (en) | Method and device for data processing | |
CN110619873A (en) | Audio processing method, device and storage medium | |
KR20170038178A (en) | Method, apparatus, and mobile terminal for identificating fingerprint | |
KR20150122574A (en) | Method and device for executing user instructions | |
CN105549960B (en) | Control the method and device of camera | |
CN108735218A (en) | voice awakening method, device, terminal and storage medium | |
CN109922098A (en) | A kind of content share method, device and the device for content share | |
CN108108213A (en) | Instruction set performs method and device | |
CN105159434A (en) | Time display method, device and terminal | |
CN114663901A (en) | Image processing method, image recognition device, electronic apparatus, and medium | |
CN112489650A (en) | Wake-up control method and device, storage medium and terminal | |
JP2018503149A (en) | Information input method, apparatus, program, and recording medium | |
WO2017080204A1 (en) | Fault feedback method and apparatus and mobile device | |
CN114051157B (en) | Input method and device | |
US11308197B2 (en) | Intelligent device recognition using prompt frequency information |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210108 |