CN110060686B - Voice interaction method and apparatus, terminal device, and computer-readable storage medium - Google Patents
Voice interaction method and apparatus, terminal device, and computer-readable storage medium Download PDFInfo
- Publication number
- CN110060686B CN110060686B CN201910300604.0A CN201910300604A CN110060686B CN 110060686 B CN110060686 B CN 110060686B CN 201910300604 A CN201910300604 A CN 201910300604A CN 110060686 B CN110060686 B CN 110060686B
- Authority
- CN
- China
- Prior art keywords
- question
- information
- type
- voice
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 162
- 230000003993 interaction Effects 0.000 title claims abstract description 64
- 238000004590 computer program Methods 0.000 claims description 20
- 230000006870 function Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000005034 decoration Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 241000238558 Eucarida Species 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000008570 general process Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/332—Query formulation
- G06F16/3329—Natural language query formulation
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification techniques
- G10L17/22—Interactive procedures; Man-machine interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Computational Linguistics (AREA)
- Multimedia (AREA)
- Mathematical Physics (AREA)
- Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Artificial Intelligence (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Telephonic Communication Services (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a voice interaction method and device, terminal equipment and a computer readable storage medium, which relate to the field of voice interaction, and the voice interaction method comprises the following steps: receiving question type voice information input by a user; performing voice recognition on the question type voice information, and converting the question type voice information into corresponding text information; and matching the text information in a preset question type question method database to obtain question type question method information corresponding to the text information. The invention can effectively solve the problem that users face difficult problems but do not know how to ask the question when doing homework, and directly read the question type title, thereby obtaining effective question type question method information feedback and ensuring that the human-computer interaction becomes smoother.
Description
Technical Field
The present invention relates to the field of voice interaction, and in particular, to a voice interaction method and apparatus, a terminal device, and a computer-readable storage medium.
Background
With the development of science and technology, the voice technology of the terminal device is gradually becoming mainstream. At present, when a user interacts with a terminal device by using voice, the general process is as follows: the user opens an interface to a speech system, for example: siri, the user asks by a conventional method of inquiry, such as "call XXX", "alarm at X", etc.
The existing voice question method mode is only suitable for general scenes and cannot be suitable for learning type voice question and answer products. In the learning process, different subjects have different question types, and when a student wants to ask a question, the general description mode cannot accurately describe the question that the student wants to ask, so that the condition that the student asks the homework question through a voice system is limited.
Disclosure of Invention
The invention aims to provide a voice interaction method and device, terminal equipment and a computer readable storage medium, which can provide relevant question type question method information for users to refer to when the users do not know how to ask the task, help the users to accurately describe the questions asked by the users and improve the use experience of the users.
The technical scheme provided by the invention is as follows:
a voice interaction method, comprising the steps of: receiving question type voice information input by a user; performing voice recognition on the question type voice information, and converting the question type voice information into corresponding text information; and matching the text information in a preset question type question method database to obtain question type question method information corresponding to the text information.
In the technical scheme, a user can query question type question method information corresponding to a question type by reading out the question type of a question to be queried, so that the user can accurately query by using a related question method, the description is more accurate when the user queries the question by voice, and the terminal equipment can also give more accurate feedback.
Further, the matching of the text information in a preset question type question method database to obtain question type question method information corresponding to the text information comprises: and matching the text information in a preset question type question method database, and taking the question type question method information with the highest matching degree as the question type question method information corresponding to the text information when the question type question method information completely consistent with the text information is not matched.
In the technical scheme, the description with the highest matching degree is the closest to the character information and most probably the question type question and question information wanted by the user, and good use experience is provided for the user in many ways.
Further, the voice recognition of the question type voice information and the conversion into corresponding text information further comprise: performing voice recognition and semantic analysis on the question type voice, and converting the question type voice into corresponding text information, wherein the text information comprises: subject information and topic information; the step of matching the text information in a preset question type question method database to obtain the question type question method information corresponding to the text information comprises the following steps: and matching the question type information in a list corresponding to the subject information in a preset question type question method database to obtain the question type question method information corresponding to the character information.
In the above technical solution, the question type voice information may include subject information to improve the speed and accuracy when matching question type question mark information.
Further, still include: when detecting that a user encounters a question which cannot be done, sending prompt information, wherein the prompt information is used for prompting the user to read the question type of the question; the receiving of the question type voice information input by the user specifically comprises: and receiving the question type voice information input by the user according to the prompt information.
In the technical scheme, the prompt information is sent at a proper time, so that when the user does not know how to describe the question, the user can timely give related question type question information and accurately describe the question that the user wants to ask, thereby obtaining accurate feedback subsequently and improving the use experience of the user.
Further, still include: when receiving voice question information of a user, considering that the user is detected to encounter a question which cannot be done; or, when the time that the user stays in the same theme is shot to exceed the preset time, the user is considered to be detected to encounter the theme which cannot be done.
In the technical scheme, the prompt information is triggered to be sent in various modes, so that the man-machine interaction is more intelligent.
The invention also provides a voice interaction device, comprising: the receiving module is used for receiving the question type voice information input by the user; the recognition module is used for carrying out voice recognition on the question type voice information and converting the question type voice information into corresponding character information; and the matching module is used for matching the text information in a preset question type question method database to obtain question type question method information corresponding to the text information.
Further, the recognition module is configured to perform speech recognition on the question type speech information, and the converting into corresponding text information includes: the recognition module carries out voice recognition and semantic analysis on the question type voice and converts the question type voice into corresponding text information, wherein the text information comprises: subject information and topic information; the matching module is used for matching the text information in a preset question type question method database, and the obtaining of the question type question method information corresponding to the text information comprises the following steps: and the matching module is used for matching the question type information in a list corresponding to the subject information in a preset question type question method database to obtain the question type question method information corresponding to the character information.
Further, still include: the prompting module is used for sending out prompting information when detecting that the user encounters a question which cannot be made, wherein the prompting information is used for prompting the user to read out the question type of the question; the receiving module is used for receiving the question type voice information input by the user, and specifically comprises the following steps: and the receiving module is used for receiving the question type voice information input by the user according to the prompt information.
The invention also provides a terminal device, which comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein when the processor runs the computer program, the steps of any one of the voice interaction methods are realized.
The present invention further provides a computer-readable storage medium, which stores a computer program, wherein the computer program is executed by a processor to implement the steps of any of the above-mentioned voice interaction methods.
Compared with the prior art, the voice interaction method and device, the terminal equipment and the computer readable storage medium have the advantages that:
the invention can effectively solve the problem that users face difficult problems but do not know how to ask the question when doing homework, and directly read the question type title, thereby obtaining effective question type question method information feedback and ensuring that the human-computer interaction becomes smoother.
Drawings
The above features, technical features, advantages and implementation manners of a voice interaction method and apparatus, a terminal device, and a computer-readable storage medium will be further described in the following detailed description of preferred embodiments in a clearly understandable manner with reference to the accompanying drawings.
FIG. 1 is a flow chart of one embodiment of a voice interaction method of the present invention;
FIG. 2 is a schematic diagram of a topic of the present invention;
FIG. 3 is a diagram of a question-type question-method information display according to the present invention;
FIG. 4 is a flow chart of another embodiment of a voice interaction method of the present invention;
FIG. 5 is a schematic structural diagram of an embodiment of a terminal device of the present invention;
FIG. 6 is a flow chart of yet another embodiment of a voice interaction method of the present invention;
FIG. 7 is a flow chart of yet another embodiment of a voice interaction method of the present invention;
FIG. 8 is a schematic structural diagram of an embodiment of a voice interaction apparatus;
FIG. 9 is a schematic structural diagram of another embodiment of the voice interaction apparatus of the present invention;
the reference numbers illustrate:
8. the voice interaction device comprises a voice interaction device, 81, a receiving module, 82, a recognition module, 83, a matching module, 84, a prompting module, 85, a shooting module, 86, a display module, 5, terminal equipment, 51, a memory, 52, a computer program and 53 a processor.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. However, it will be apparent to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
For the sake of simplicity, the drawings only schematically show the parts relevant to the present invention, and they do not represent the actual structure as a product. In addition, in order to make the drawings concise and understandable, components having the same structure or function in some of the drawings are only schematically illustrated or only labeled. In this document, "one" means not only "only one" but also a case of "more than one".
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
In particular implementations, the terminal devices described in embodiments of the present application include, but are not limited to, other portable devices such as mobile phones, laptop computers, or tablet computers having touch sensitive surfaces (e.g., touch screen displays and/or touch pads). It should also be understood that in some embodiments the terminal device is not a portable communication device, but is a desktop computer having a touch-sensitive surface (e.g., a touch screen display and/or touchpad).
In the discussion that follows, a terminal device that includes a display and a touch-sensitive surface is described. However, it should be understood that the terminal device may include one or more other physical user interface devices such as a physical keyboard, mouse, and/or joystick.
The terminal device supports various applications, such as one or more of the following: a drawing application, a presentation application, a network creation application, a word processing application, a disc burning application, a spreadsheet application, a gaming application, a telephone application, a video conferencing application, an email application, an instant messaging application, an exercise support application, a photo management application, a digital camera application, a digital video camera application, a Web browsing application, a digital music player application, and/or a digital video player application.
Various applications that may be executed on the terminal device may use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the terminal can be adjusted and/or changed between applications and/or within respective applications. In this way, a common physical architecture (e.g., touch-sensitive surface) of the terminal can support various applications with user interfaces that are intuitive and transparent to the user.
In addition, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not intended to indicate or imply relative importance.
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following description will be made with reference to the accompanying drawings. It is obvious that the drawings in the following description are only some examples of the invention, and that for a person skilled in the art, other drawings and embodiments can be derived from them without inventive effort.
Fig. 1 shows a flowchart of an implementation of a voice interaction method according to the present invention, where the voice interaction method can be applied to a terminal device (for example, a tablet computer, a family education machine, etc., in this embodiment, for convenience of understanding, the family education machine is used as a subject for explanation, but those skilled in the art will understand that the voice interaction method can also be applied to other terminal devices as long as corresponding functions can be implemented), and the voice interaction method includes the following steps:
s101, receiving the question type voice information input by the user.
Specifically, the topic voice information refers to the topic type of the topic read by the user. For example, in fig. 2, if the user wants to ask the question "b-ani n", but does not know how to describe the question, he can read out the question type corresponding to the question, i.e., "see pinyin and write word" as the question type voice information input by the user, so as to inquire the corresponding question type question method information.
S102, performing voice recognition on the question type voice information, and converting the question type voice information into corresponding character information.
Specifically, the step is a general step in the voice interaction process, namely, the question type voice information is converted into character information through voice recognition for use in subsequent matching.
S103, matching the text information in a preset question type question method database to obtain question type question method information corresponding to the text information.
Specifically, the preset question type question database may be in a list form (of course, other forms are also possible as long as matching can be achieved), and includes a plurality of question types and corresponding questions, as shown in table one below.
Watch 1
| Question type | Method of inquiry |
| Read the spelling and write the words | xxxxxx |
| The sentences are linked together in a pattern so as to make the sentence expression accurate | yyyyyy |
| Complement ancient poems completely | aaaaaaa |
| Problems of single choice | bbbbbb |
Supposing that the table I is a preset question type question method database, the character information converted according to the question type voice information of the user is 'seeing pinyin and writing words', and the corresponding question type question method information matched is 'xxxxxx'.
Preferably, the voice interaction method further comprises the steps of: and displaying question type question and question information.
The question type question method information has various display modes:
first, text display, which displays question-type question-method information on the display screen of the home education machine, is shown in fig. 3.
Second, voice presentation, i.e., a form of voice broadcast, speaks a specific example for the user to refer to.
Thirdly, combining characters and voice to display question type question and answer information. For example: when question type question information (i.e., question type question guide) is found, the question type question information is displayed on the display screen of the home education machine, and the user can ask the question by using voice description for example when you meet the question type: xxxxxx ", which is equivalent to describing an example with speech, further helps the user understand how to ask about the question he wants.
Of course, other display manners are also possible as long as the user can understand the question type question information, and the display manner is not limited herein.
In this embodiment, the user can query question type question method information corresponding to the question type by reading out the question type of the question to be asked, so that the user can accurately inquire by using the related question method, the description is more accurate, and the terminal device can also give more accurate feedback.
In addition, in the embodiment, because the question type voice information belongs to some specific question types, only voice recognition is needed to be performed and the question type voice information is converted into character information, semantic analysis is not involved, the recognition difficulty is simplified, and meanwhile, the high matching degree of question type question method information can be ensured.
In another embodiment of the present invention, improved on fig. 1, as shown in fig. 4, a voice interaction method includes:
s401, when detecting that the user meets the question which cannot be done, sending out prompt information, wherein the prompt information is used for prompting the user to read the question type of the question.
Specifically, only when a certain condition is met (for example, when it is detected that the user encounters a question that the user cannot do), the family education machine sends out prompt information to prompt the user to read a question type to inquire question type question method information.
Optionally, when receiving the voice question information of the user, considering that the user is detected to encounter a question which cannot be done; or, when the time that the user stays in the same theme is shot to exceed the preset time, the user is considered to be detected to encounter the theme which cannot be done.
Specifically, the voice question information refers to information on how to describe the question asked by the user.
Sometimes, when the user encounters a question that is not asked but is not known to be asked, a voice command can be directly sent out, for example: "i want to describe how to do it" to inquire about how to do it, through operations such as speech recognition and semantic analysis, the family education machine understands that the speech question information of the user is received, and then thinks that the user meets the question that can not be done, can send out the prompt information to prompt the user to read out the question type.
If the family education machine supports video shooting, the family education machine can also judge whether the user encounters a question which cannot be done by monitoring the writing operation condition of the user.
For example: when the shooting time that the user stays in the same theme exceeds the preset time, the fact that the user meets the theme which cannot be done is considered to be detected.
The questions are difficult to do sometimes, the user may spend a relatively long time thinking to do so sometimes, and the user may be able to freely tangle without limit to do so and cannot ask questions sometimes, so the setting of the preset time can enable the family education machine to send out prompt information at a reasonable time, if the user wants to ask questions, the user can read out question types, namely inputting question type voice information, and if the user does not want to ask questions, the user can ignore the question types and continue research by himself.
The length of the preset time can be set by the user according to different conditions, so that personalized matching is realized, for example: the home tutor machine preset time of the user a is set to 10 minutes, and the home tutor machine preset time of the user B is set to 15 minutes, and the like.
S402, receiving the question type voice information input by the user according to the prompt message.
S403, performing voice recognition on the question type voice information, and converting the question type voice information into corresponding character information.
S404, matching the text information in a preset question type question method database to obtain question type question method information corresponding to the text information.
Optionally, question-type question information is presented.
In the embodiment, the family education machine can send out prompt information at a proper time, so that the user can timely give out relevant question type question method information when the user does not know how to describe the question, and the user can accurately describe the question asked by the user, thereby obtaining accurate feedback subsequently and improving the use experience of the user.
Fig. 6 shows a flowchart of an implementation of another voice interaction method according to the present invention, where the voice interaction method can be applied to a terminal device (for example, a tablet computer, a family education machine, etc., and in this embodiment, for convenience of understanding, the family education machine is used as a subject for explanation, but those skilled in the art will understand that the voice interaction method can also be applied to other terminal devices as long as the corresponding functions can be implemented), and the voice interaction method includes the following steps:
s601, receiving question type voice information input by a user;
s602, performing voice recognition on the question type voice information, and converting the question type voice information into corresponding character information;
matching the text information in a preset question type question method database to obtain question type question method information corresponding to the text information, wherein the question type question method information comprises the following specific steps: s603, matching the text information in a preset question type question method database, and when the question type question method information completely consistent with the text information is not matched, taking the question type question method information with the highest matching degree as the question type question method information corresponding to the text information.
Specifically, different test papers and exercise books may be named differently according to the language habits of the subjects. For example: reading pinyin and writing Chinese characters, the name can be also selected as: read the pinyin and write words.
When the preset question type question method database is established, different calling methods of the same question type can be collected, and subsequent accurate matching is facilitated.
However, there is always a case that there is no way to match the question information with the highest matching degree to the completely consistent question information, and the question information with the highest matching degree can be used as the question information corresponding to the text information and displayed to the user, so that the user can judge the question information by himself.
Optionally, the S602 performs speech recognition on the question-type speech information, and the converting into corresponding text information further includes: and performing voice recognition and semantic analysis on the question type voice information, and converting the question type voice information into corresponding character information.
Specifically, after voice recognition is performed, key information is extracted through semantic analysis to form character information.
For example: the question type voice information of the user is 'a first part, namely, reading pinyin and writing words', the voice is recognized as 'the first part, namely, reading pinyin and writing words', the converted text information (namely, key information) is 'reading pinyin and writing words' through semantic analysis, the 'the first part' which is the content irrelevant to the question type is filtered, and the accuracy of subsequent matching is improved.
Optionally, the voice interaction method of this embodiment further includes: when detecting that the user encounters a question which cannot be done, sending out prompt information, wherein the prompt information is a question type for prompting the user to read the question; the receiving of the question-type voice information input by the user specifically includes: and receiving the question type voice information input by the user according to the prompt information.
Preferably, when receiving the voice question information of the user, considering that the user is detected to encounter a question which cannot be done; or, when the time that the user stays in the same theme is shot to exceed the preset time, the user is considered to be detected to encounter the theme which cannot be done.
In this embodiment, when the question type question information completely consistent with the text information is not matched, the question type question information with the highest matching degree is output for the user to refer to, and the description with the highest matching degree is the question type question information closest to the text information and most likely to be the question type question information desired by the user, so that good use experience is provided for the user in many ways.
Fig. 7 shows a flowchart of another implementation of the voice interaction method according to the present invention, where the voice interaction method can be applied to a terminal device (for example, a tablet computer, a family education machine, etc., in this embodiment, for convenience of understanding, the family education machine is used as a subject for explanation, but those skilled in the art will understand that the voice interaction method can also be applied to other terminal devices as long as the corresponding functions can be implemented), and the voice interaction method includes the following steps:
when detecting that the user encounters a question which cannot be done, sending out prompt information which is used for prompting the user to read out the subject and the question type of the question; the receiving of the question-type voice information input by the user specifically includes: and receiving the question type voice information input by the user according to the prompt information (the step is an optional step).
S701, receiving question type voice information input by a user;
performing voice recognition on the question type voice information, and converting the question type voice information into corresponding text information further comprises: s702 carries out voice recognition and semantic analysis on the question type voice, and converts the question type voice into corresponding text information, wherein the text information comprises: subject information and topic information.
Specifically, the question types of different disciplines are the same at some times, but the question methods of the disciplines are different based on the particularity of the different disciplines, so that question type voice information input by a user comprises question type information and subject information at some times, and the accuracy of information matching of the follow-up question type question methods is improved.
After the user inputs the question type voice information, the information corresponding to the subject and the question type is accurately extracted through voice recognition and semantic analysis.
For example: the question type voice information of the user is 'single item selection questions of mathematics', the subject information in the character information is mathematics and the question type information is single item selection questions after voice recognition and semantic analysis.
Matching the text information in a preset question type question method database to obtain question type question method information corresponding to the text information, wherein the question type question method information comprises the following steps: s703, matching the question type information in a list corresponding to the subject information of the preset question type question method database to obtain the question type question method information corresponding to the character information.
Specifically, in the preset question type question method database, the question types corresponding to different disciplines can be associated, and during subsequent matching, the range is directly reduced and the matching speed and precision can be improved according to the discipline information in the text information.
For example: the preset question type question database has a plurality of lists, including: the method comprises the steps of obtaining a list of mathematic related question type question method information, a list of historical related question type question method information, a list of Chinese related question type question method information and the like, and when matching is conducted, directly positioning the relevant list according to subject information to conduct matching.
Optionally, the question type information is matched in a list corresponding to subject information in a preset question type question database, and when the question type question information completely consistent with the question type information is not matched, the question type question information with the highest matching degree is used as the question type question information corresponding to the character information.
Optionally, the method further comprises: and displaying question type question and question information.
In the embodiment, the problem that a user faces a difficult problem and does not know how to perform opening inquiry when doing homework can be effectively solved, the question type title is directly read, effective question type inquiry information feedback can be obtained, and human-computer interaction becomes smoother; and subject information can be contained in the question type voice information to improve the speed and the precision when the question type question method information is matched.
It should be understood that, in the above embodiments, the size of the sequence number of each step does not mean the execution sequence, and the execution sequence of each step should be determined by functions and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
Fig. 8 is a schematic diagram of the voice interaction apparatus 8 provided in the present application, and for convenience of explanation, only the parts related to the embodiments of the present application are shown.
The voice interaction device can be a software unit, a hardware unit or a combination unit of software and hardware which are built in the terminal equipment, and can also be integrated into the terminal equipment as an independent pendant.
The voice interaction device comprises:
the receiving module 81 is configured to receive the topic voice information input by the user.
Specifically, the topic voice information refers to the topic type of the topic read by the user. For example, in fig. 2, if the user wants to ask the question "b-ani n", but does not know how to describe the question, he can read out the question type corresponding to the question, i.e., "see pinyin and write word" as the question type voice information input by the user, so as to inquire the corresponding question type question method information.
And the recognition module 82 is used for performing voice recognition on the question type voice information and converting the question type voice information into corresponding character information.
And the matching module 83 is configured to match the text information in a preset question type question method database to obtain question type question method information corresponding to the text information.
Specifically, the preset question type database may be in a list form (of course, other forms are also possible as long as matching can be achieved), and includes a plurality of question types and corresponding questions, as shown in the first table.
Supposing that the table I is a preset question type question method database, the character information converted according to the question type voice information of the user is 'seeing pinyin and writing words', and the corresponding question type question method information matched is 'xxxxxx'.
Preferably, the voice interaction apparatus further comprises: and the display module is used for displaying question type question method information.
The question type question method information has various display modes:
first, text display, which displays question-type question-method information on the display screen of the home education machine, is shown in fig. 3.
Second, voice presentation, i.e., a form of voice broadcast, speaks a specific example for the user to refer to.
Thirdly, combining characters and voice to display question type question and answer information. For example: when question type question information (i.e., question type question guide) is found, the question type question information is displayed on the display screen of the home education machine, and the user can ask the question by using voice description for example when you meet the question type: xxxxxx ", which is equivalent to describing an example with speech, further helps the user understand how to ask about the question he wants.
Of course, other display manners are also possible as long as the user can understand the question type question information, and the display manner is not limited herein.
In this embodiment, the user can query question type question method information corresponding to the question type by reading out the question type of the question to be asked, so that the user can accurately inquire by using the related question method, the description is more accurate, and the terminal device can also give more accurate feedback.
In addition, in the embodiment, because the question type voice information belongs to some specific question types, only voice recognition is needed to be performed and the question type voice information is converted into character information, semantic analysis is not involved, the recognition difficulty is simplified, and meanwhile, the high matching degree of question type question method information can be ensured.
In another embodiment of the apparatus of the present invention, which is an improvement of the above-mentioned embodiment of the apparatus, as shown in fig. 9, a voice interaction apparatus includes:
and the prompt module 84 is configured to send prompt information when detecting that the user encounters a question that is not to be done, where the prompt information is a question type for prompting the user to read the question.
Specifically, only when a certain condition is met (for example, when it is detected that the user encounters a question that the user cannot do), the family education machine sends out prompt information to prompt the user to read a question type to inquire question type question method information.
Optionally, the receiving module 81 is configured to receive the voice question information of the user, and when the voice question information of the user is received, it is determined that the user is detected to encounter a question that the user cannot do; or, the voice interaction device further comprises: and the shooting module 85 is used for shooting a user to do a question, and when the time that the user stays in the same question exceeds the preset time, the user is determined to be detected to encounter a question which cannot be done.
Specifically, the voice question information refers to information on how to describe the question asked by the user.
Sometimes, when the user encounters a question that is not asked but is not known to be asked, a voice command can be directly sent out, for example: "i want to describe how to do it" to inquire about how to do it, through operations such as speech recognition and semantic analysis, the family education machine understands that the speech question information of the user is received, and then thinks that the user meets the question that can not be done, can send out the prompt information to prompt the user to read out the question type.
If the family education machine supports video shooting, the family education machine can also judge whether the user encounters a question which cannot be done by monitoring the writing operation condition of the user.
The questions are difficult to do sometimes, the user may spend a relatively long time thinking to do so sometimes, and the user may be able to freely tangle without limit to do so and cannot ask questions sometimes, so the setting of the preset time can enable the family education machine to send out prompt information at a reasonable time, if the user wants to ask questions, the user can read out question types, namely inputting question type voice information, and if the user does not want to ask questions, the user can ignore the question types and continue research by himself.
The length of the preset time can be set by the user according to different conditions, so that personalized matching is realized, for example: the home tutor machine preset time of the user a is set to 10 minutes, and the home tutor machine preset time of the user B is set to 15 minutes, and the like.
The receiving module 81 is used for receiving the question type voice information input by the user according to the prompt information;
the recognition module 82 is used for carrying out voice recognition on the question type voice information and converting the question type voice information into corresponding character information;
and the matching module 83 is configured to match the text information in a preset question type question method database to obtain question type question method information corresponding to the text information.
Optionally, the display module 86 is configured to display question type question and question information.
In the embodiment, the family education machine can send out prompt information at a proper time, so that the user can timely give out relevant question type question method information when the user does not know how to describe the question, and the user can accurately describe the question asked by the user, thereby obtaining accurate feedback subsequently and improving the use experience of the user.
In still another embodiment of the voice interaction apparatus of the present invention, the apparatus comprises:
a receiving module 81, configured to receive question-type voice information input by a user;
the recognition module 82 is used for carrying out voice recognition on the question type voice information and converting the question type voice information into corresponding character information;
the matching module 83 is configured to match the text information in a preset question type question method database, and obtain question type question method information corresponding to the text information includes: and the matching module 83 is used for matching the text information in the preset question type question method database, and when the question type question method information completely consistent with the text information is not matched, the question type question method information with the highest matching degree is used as the question type question method information corresponding to the text information.
Specifically, different test papers and exercise books may be named differently according to the language habits of the subjects. For example: reading pinyin and writing Chinese characters, the name can be also selected as: read the pinyin and write words.
When the preset question type question method database is established, different calling methods of the same question type can be collected, and subsequent accurate matching is facilitated.
However, there is always a case that there is no way to match the question information with the highest matching degree to the completely consistent question information, and the question information with the highest matching degree can be used as the question information corresponding to the text information and displayed to the user, so that the user can judge the question information by himself.
Optionally, the recognition module 82 is configured to perform speech recognition on the question-type speech information, and the converting into corresponding text information further includes: the recognition module 82 performs voice recognition and semantic analysis on the question type voice information, and converts the question type voice information into corresponding character information.
Specifically, after voice recognition is performed, key information is extracted through semantic analysis to form character information.
For example: the question type voice information of the user is 'a first part, namely, reading pinyin and writing words', the voice is recognized as 'the first part, namely, reading pinyin and writing words', the converted text information (namely, key information) is 'reading pinyin and writing words' through semantic analysis, the 'the first part' which is the content irrelevant to the question type is filtered, and the accuracy of subsequent matching is improved.
Optionally, the voice interaction apparatus of this embodiment further includes: and the prompt module 84 is configured to send prompt information when detecting that the user encounters a question that is not to be done, where the prompt information is a question type for prompting the user to read the question.
Optionally, the receiving module 81 is configured to receive the voice question information of the user, and when the voice question information of the user is received, it is determined that the user is detected to encounter a question that the user cannot do; or, the voice interaction device further comprises: and the shooting module 85 is used for shooting a user to do a question, and when the time that the user stays in the same question exceeds the preset time, the user is determined to be detected to encounter a question which cannot be done.
In this embodiment, when the question type question information completely consistent with the text information is not matched, the question type question information with the highest matching degree is output for the user to refer to, and the description with the highest matching degree is the question type question information closest to the text information and most likely to be the question type question information desired by the user, so that good use experience is provided for the user in many ways.
In still another embodiment of the voice interaction apparatus of the present invention, the apparatus comprises:
a receiving module 81, configured to receive question-type voice information input by a user;
the recognition module 82 is configured to perform speech recognition on the question-type speech information, and the converting into corresponding text information further includes: the recognition module 82 performs speech recognition and semantic analysis on the question type speech, and converts the question type speech into corresponding text information, wherein the text information includes: subject information and topic information.
Specifically, the question types of different disciplines are the same at some times, but the question methods of the disciplines are different based on the particularity of the different disciplines, so that question type voice information input by a user comprises question type information and subject information at some times, and the accuracy of information matching of the follow-up question type question methods is improved.
After the user inputs the question type voice information, the information corresponding to the subject and the question type is accurately extracted through voice recognition and semantic analysis.
For example: the question type voice information of the user is 'single item selection questions of mathematics', the subject information in the character information is mathematics and the question type information is single item selection questions after voice recognition and semantic analysis.
The matching module 83 matches the text information in the preset question-type question-method database, and obtaining question-type question-method information corresponding to the text information includes: the matching module 83 matches the question type information in the list corresponding to the subject information in the preset question type question method database to obtain the question type question method information corresponding to the text information.
Specifically, in the preset question type question method database, the question types corresponding to different disciplines can be associated, and during subsequent matching, the range is directly reduced and the matching speed and precision can be improved according to the discipline information in the text information.
Optionally, the matching module 83 matches the question type information in the list corresponding to the subject information in the preset question type question method database, and when the question type question information completely consistent with the question type information is not matched, takes the question type question method information with the highest matching degree as the question type question method information corresponding to the text information.
Optionally, the display module 86 is configured to display question type question and question information.
In the embodiment, the problem that a user faces a difficult problem and does not know how to perform opening inquiry when doing homework can be effectively solved, the question type title is directly read, effective question type inquiry information feedback can be obtained, and human-computer interaction becomes smoother; and subject information can be contained in the question type voice information to improve the speed and the precision when the question type question method information is matched.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of program modules is illustrated, and in practical applications, the above-described distribution of functions may be performed by different program modules, that is, the internal structure of the apparatus may be divided into different program units or modules to perform all or part of the above-described functions. Each program module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one processing unit, and the integrated unit may be implemented in a form of hardware, or may be implemented in a form of software program unit. In addition, the specific names of the program modules are only used for distinguishing the program modules from one another, and are not used for limiting the protection scope of the application.
Fig. 5 is a schematic structural diagram of the terminal device 5 provided in one embodiment of the present invention. As shown in fig. 5, the terminal device 5 of the present embodiment includes: a processor 53, a memory 51 and a computer program 52 stored in said memory 51 and executable on said processor 53, such as: and (5) voice interaction program. The processor 53 implements the steps in the above-mentioned voice interaction method embodiments when executing the computer program 52, or the processor 53 implements the functions of the modules in the above-mentioned voice interaction apparatus embodiments when executing the computer program 52.
The terminal device 5 may be a desktop computer, a notebook, a palm computer, a tablet computer, a mobile phone, or the like. The terminal device 5 may include, but is not limited to, a processor 53 and a memory 51. Those skilled in the art will appreciate that fig. 5 is merely an example of a terminal device and does not constitute a limitation of terminal device 5, and may include more or fewer components than shown, or some components in combination, or different components, such as: the terminal device may also include input output devices, display devices, network access devices, buses, and the like.
The Processor 53 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 51 may be an internal storage unit of the terminal device 5, such as: hard disk or memory of the terminal device. The memory may also be an external storage device of the terminal device, such as: the terminal equipment is provided with a plug-in hard disk, an intelligent memory Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) and the like. Further, the memory 51 may also include both an internal storage unit and an external storage device of the terminal device 5. The memory 51 is used for storing the computer program 52 and other programs and data required by the terminal device 5. The memory may also be used to temporarily store data that has been output or is to be output.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or recited in detail in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by sending instructions to relevant hardware through a computer program, where the computer program may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises: computer program code which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable storage medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the content of the computer-readable storage medium can be increased or decreased according to the requirements of the legislation and patent practice in the jurisdiction, for example: in certain jurisdictions, in accordance with legislation and patent practice, the computer-readable medium does not include electrical carrier signals and telecommunications signals.
It should be noted that the above embodiments can be freely combined as necessary. The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (8)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910300604.0A CN110060686B (en) | 2019-04-15 | 2019-04-15 | Voice interaction method and apparatus, terminal device, and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910300604.0A CN110060686B (en) | 2019-04-15 | 2019-04-15 | Voice interaction method and apparatus, terminal device, and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110060686A CN110060686A (en) | 2019-07-26 |
| CN110060686B true CN110060686B (en) | 2021-06-22 |
Family
ID=67319042
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910300604.0A Active CN110060686B (en) | 2019-04-15 | 2019-04-15 | Voice interaction method and apparatus, terminal device, and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110060686B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111324206B (en) * | 2020-02-28 | 2023-07-18 | 重庆百事得大牛机器人有限公司 | System and method for identifying confirmation information based on gesture interaction |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104050256A (en) * | 2014-06-13 | 2014-09-17 | 西安蒜泥电子科技有限责任公司 | Initiative study-based questioning and answering method and questioning and answering system adopting initiative study-based questioning and answering method |
| CN108509439A (en) * | 2017-02-24 | 2018-09-07 | 上海莘越软件科技有限公司 | A kind of Algebra Teaching system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140272894A1 (en) * | 2013-03-13 | 2014-09-18 | Edulock, Inc. | System and method for multi-layered education based locking of electronic computing devices |
-
2019
- 2019-04-15 CN CN201910300604.0A patent/CN110060686B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104050256A (en) * | 2014-06-13 | 2014-09-17 | 西安蒜泥电子科技有限责任公司 | Initiative study-based questioning and answering method and questioning and answering system adopting initiative study-based questioning and answering method |
| CN108509439A (en) * | 2017-02-24 | 2018-09-07 | 上海莘越软件科技有限公司 | A kind of Algebra Teaching system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110060686A (en) | 2019-07-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6718828B2 (en) | Information input method and device | |
| CN110797019B (en) | Multi-command single speech input method | |
| US9734193B2 (en) | Determining domain salience ranking from ambiguous words in natural speech | |
| US9633653B1 (en) | Context-based utterance recognition | |
| US8886521B2 (en) | System and method of dictation for a speech recognition command system | |
| DE202017004558U1 (en) | Smart automated assistant | |
| JP6413256B2 (en) | CONFERENCE SUPPORT DEVICE, CONFERENCE SUPPORT DEVICE CONTROL METHOD, AND PROGRAM | |
| CN108717853B (en) | Man-machine voice interaction method, device and storage medium | |
| EP3115907A1 (en) | Common data repository for improving transactional efficiencies of user interactions with a computing device | |
| CN106710327A (en) | English-based point reading book system | |
| WO2023051021A1 (en) | Human-machine conversation method and apparatus, device, and storage medium | |
| US11189283B2 (en) | Freeform conversation writing assistant | |
| US20230289514A1 (en) | Speech recognition text processing method and apparatus, device, storage medium, and program product | |
| CN118734793A (en) | Method, device, electronic device and storage medium for generating presentation | |
| CN106886582A (en) | Method and system for embedding learning assistant in terminal equipment | |
| CN110060686B (en) | Voice interaction method and apparatus, terminal device, and computer-readable storage medium | |
| KR101151865B1 (en) | Portable communication device for auditory disabled | |
| Faiz et al. | Virtual voice assistant for smart devices | |
| CN117829137A (en) | Chinese language prime topic generation method, device, electronic equipment and storage medium | |
| Fume et al. | Implementation of automatic captioning system to enhance the accessibility of meetings | |
| CN109948155B (en) | Multi-intention selection method and device and terminal equipment | |
| CN111506739A (en) | Corpus processing method and apparatus, storage medium, and electronic apparatus | |
| CN111913563A (en) | A human-computer interaction method and device based on semi-supervised learning | |
| TWI599897B (en) | Methodologies, systems, computer programs, and human readable help by asking questions Get record media | |
| CN112082103A (en) | Intelligent learning desk lamp and method for adjusting operation thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |