Disclosure of Invention
The embodiment of the application discloses a starting control method of an application program and family education equipment, the visual style of a main interface of the application program can be flexibly adjusted according to the instant emotion of a user, interestingness is improved, and interest of the user (such as primary and secondary school students) in using the application program of the family education equipment is favorably improved.
A first aspect of an embodiment of the present application discloses a method for controlling starting of an application program, where the method includes:
the family education equipment monitors voice signals sent by the outside;
the family education equipment detects whether the voice signal contains a keyword for starting a certain application program of the family education equipment;
if the voice signal contains a keyword for starting a certain application program of the family education equipment, the family education equipment identifies the user gender of the external user starting the voice signal according to the voice signal;
the family education equipment acquires the instant emotion of the outside user;
the family education device determines a target visual style for improving the instant emotion from a plurality of visual styles pre-configured by the application program;
the family education equipment starts the application program, loads a main interface of the application program according to the target visual style, and outputs a virtual animal matched with the gender of the user on the main interface of the application program;
and the family education equipment controls the virtual animal to broadcast prompt information according to the tone used for improving the instant emotion, wherein the prompt information is used for prompting that the application program is started.
As an optional implementation manner, in the first aspect of this embodiment of the present application, the identifying, by the family education device, the user gender of the external user who has sent out the speech signal according to the speech signal includes:
the family education equipment extracts the sound characteristics of the voice signals according to the voice signals;
and the family education equipment identifies the user gender of the external user starting the voice signal according to the voice characteristics of the voice signal.
As an optional implementation manner, in the first aspect of this embodiment of the present application, the acquiring, by the family education device, the instant emotion of the external user includes:
the family education equipment identifies the instant emotion of the external user according to the tone of the voice signal;
or, the family education device obtains the instant emotion of the external user, including:
the family education equipment detects whether a wearable device is wirelessly connected at present;
if the wearable equipment is wirelessly connected with the family education equipment currently, the family education equipment acquires the sound characteristics of a wearer of the wearable equipment;
the family education device verifying whether the sound features of the wearer of the wearable device match the sound features of the voice signal;
if the current heart rate data of the wearer of the wearable device and the current blood pressure data of the wearer are matched, the family education device informs the wearable device to obtain the current heart rate data of the wearer of the wearable device and the current blood pressure data of the wearer, and the wearable device determines the instant emotion of the wearer according to the current heart rate data of the wearer and the current blood pressure data of the wearer;
the family education device receives the identification of the instant emotion of the wearer sent by the wearable device so as to obtain the instant emotion of the outside user.
As an optional implementation manner, in the first aspect of this embodiment of the present application, the application is a topic search application, and the method further includes:
the family education equipment monitors the search question voice sent by an external user;
the family education equipment acquires a question searching result corresponding to the question searching voice;
the family education equipment outputs a question searching result corresponding to the question searching voice to a main interface of the application program for displaying;
and the family education equipment controls the virtual animal to broadcast response voice corresponding to the search question voice sent by the external user according to the tone used for improving the instant emotion.
As an optional implementation manner, in the first aspect of this embodiment of the present application, the method further includes:
the family education equipment inquires whether student personal attribute information corresponding to the sound features of the voice signals is stored or not; the student personal attribute information at least comprises student identity information and a target curriculum schedule corresponding to the students, and the target curriculum schedule at least comprises a plurality of different learning subjects learned by the students and teacher terminal identifications corresponding to the learning subjects;
if the personal attribute information of the students corresponding to the voice features of the voice signals is stored, the family education equipment queries a target learning subject corresponding to the search result from the target curriculum schedule according to the search result; inquiring a target teacher terminal identification corresponding to the target learning subject from the target curriculum schedule;
the family education equipment converts the search question voice into search question words and reports the student identity information, the search question words and the target teacher terminal identification to a cloud platform, so that the cloud platform sends the student identity information and the search question words to a teacher terminal to which the target teacher terminal identification belongs according to the target teacher terminal identification.
The second aspect of the embodiments of this application discloses a family education equipment, includes:
the monitoring unit is used for monitoring voice signals sent by the outside;
the detection unit is used for detecting whether the voice signal contains a keyword for starting a certain application program of the family education equipment;
the recognition unit is used for recognizing the user gender of the external user who starts the voice signal according to the voice signal when the detection result of the detection unit is positive;
the first acquisition unit is used for acquiring the instant emotion of the external user;
a determining unit, configured to determine a target visual style for improving the instant emotion from a plurality of visual styles preconfigured by the application;
the first control unit is used for starting the application program, loading a main interface of the application program according to the target visual style, and outputting a virtual animal matched with the gender of the user on the main interface of the application program;
and the second control unit is used for controlling the virtual animal to broadcast prompt information according to the tone used for improving the instant emotion, wherein the prompt information is used for prompting that the application program is started.
As an optional implementation manner, in the second aspect of the embodiment of the present application, the identification unit is specifically configured to, when the detection result of the detection unit is yes, extract a sound feature of the speech signal according to the speech signal; and identifying the user gender of the external user starting the voice signal according to the voice characteristics of the voice signal.
As an optional implementation manner, in a second aspect of the embodiment of the present application, the first obtaining unit is specifically configured to recognize an instant emotion of the external user according to a tone of the voice signal;
alternatively, the first acquiring unit includes:
the detection subunit is used for detecting whether the family education equipment is wirelessly connected with wearable equipment currently;
the acquisition subunit is used for acquiring the sound characteristics of the wearer of the wearable device when the detection subunit detects that the family education device is wirelessly connected with the wearable device currently;
a verification subunit for verifying whether the sound features of the wearer of the wearable device match the sound features of the speech signal;
the interaction subunit is used for informing the wearable device to acquire the current heart rate data of the wearer of the wearable device and the current blood pressure data of the wearer when the verification result of the verification subunit is matched, and determining the instant emotion of the wearer by the wearable device according to the current heart rate data of the wearer and the current blood pressure data of the wearer;
the interaction subunit is further configured to receive the identifier of the instant emotion of the wearer sent by the wearable device, so as to obtain the instant emotion of the external user.
As an optional implementation manner, in the second aspect of this embodiment of the present application, the application is a topic search application:
the monitoring unit is also used for monitoring the question searching voice sent by the external user;
the family education device further includes a second acquisition unit, wherein:
the second obtaining unit is used for obtaining a question searching result corresponding to the question searching voice;
the first control unit is further configured to output a question searching result corresponding to the question searching voice to a main interface of the application program for display;
and the second control unit is also used for controlling the virtual animal to broadcast response voice corresponding to the search question voice sent by the external user according to the tone used for improving the instant emotion.
As an optional implementation manner, in the second aspect of this embodiment of the present application, the family education device further includes:
the query unit is used for querying whether student personal attribute information corresponding to the sound features of the voice signals is stored or not; the student personal attribute information at least comprises student identity information and a target curriculum schedule corresponding to the students, and the target curriculum schedule at least comprises a plurality of different learning subjects learned by the students and teacher terminal identifications corresponding to the learning subjects; and if the personal attribute information of the students corresponding to the voice characteristics of the voice signals is stored, inquiring a target learning subject corresponding to the search result from the target curriculum schedule by taking the search result as a basis; inquiring a target teacher terminal identification corresponding to the target learning subject from the target curriculum schedule;
and the conversion unit is used for converting the search question voice into search question words and reporting the student identity information, the search question words and the target teacher terminal identification to a cloud platform, so that the cloud platform sends the student identity information and the search question words to a teacher terminal to which the target teacher terminal identification belongs according to the target teacher terminal identification.
The third aspect of the embodiments of the present application discloses a family education device, including:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program code stored in the memory to execute the start control method of the application program disclosed in the first aspect of the embodiment of the present application.
A fourth aspect of the embodiments of the present application discloses a computer-readable storage medium, which stores a computer program, where the computer program causes a computer to execute the method for controlling the start of an application program disclosed in the first aspect of the embodiments of the present application.
Compared with the prior art, the embodiment of the application has the following beneficial effects:
by implementing the embodiment of the application, the home education equipment can flexibly adjust the visual style of the main interface of the application program started by the user according to the instant emotion of the user, so that the interestingness can be improved, and the interest of the user (such as primary and secondary school students) in using the application program of the home education equipment can be promoted. In addition, the visual style of the main interface of the adjusted application program is a target visual style for improving the instant emotion of the user, so that the experience of the user using the application program of the family education device can be improved.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It is to be noted that the terms "comprises" and "comprising" and any variations thereof in the examples and figures of the present application are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
The embodiment of the application discloses a starting control method of an application program and family education equipment, the visual style of a main interface of the application program can be flexibly adjusted according to the instant emotion of a user, interestingness is improved, and interest of the user (such as primary and secondary school students) in using the application program of the family education equipment is favorably improved. The following are detailed below.
Example one
Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a method for controlling starting of an application according to an embodiment of the present application. As shown in fig. 1, the start control method of the application program may include the steps of:
101. the family education equipment listens to the voice signal sent by the outside.
In this application embodiment, family education equipment can start the pronunciation interception function of family education equipment after the start to family education equipment can be through the real-time voice signal that the interception external world sent of the pronunciation interception function of the family education equipment that has started.
Optionally, in this embodiment of the application, after the home teaching device is turned on, it may be detected whether a first trajectory for starting the voice interception function, which is input by an external user on a display screen of the home teaching device, is received, and if the first trajectory is received, the voice interception function of the home teaching device is started, so that power consumption of the home teaching device may be reduced; correspondingly, after the family education equipment is started, whether a second track which is input by an external user on a display screen of the family education equipment and used for closing the voice interception function is received or not can be detected, wherein the second track is different from the first track; if the audio signal is received, the voice interception function of the family education device can be closed, so that the power consumption of the family education device can be reduced.
102. The family education equipment detects whether the voice signal contains a keyword for starting a certain application program of the family education equipment; if the voice signal contains a keyword for starting an application program of the family education device, executing step 103-step 107; if the voice signal does not contain the keyword for starting a certain application program of the family education equipment, the process is ended.
For example, the family education device may detect whether the voice signal contains a keyword "small cloth" for starting a search question application of the family education device, and if so, execute steps 103 to 107; if not, the process is ended.
103. And the family education equipment identifies the user gender of the external user sending the voice signal according to the voice signal.
In the embodiment of the application, the family education equipment can extract the sound characteristics of the voice signal according to the voice signal; and the family education equipment can identify the user gender of the external user who sends the voice signal according to the voice characteristics of the voice signal.
For example, the family education device can extract a tone (belonging to a sound feature) of the voice signal according to the voice signal, and the family education device can recognize the user gender of the external user who utters the voice signal according to the tone of the voice signal. The male vocal cords are longer, wider and thicker, so that the frequency is low during vibration, and the emitted tone is low; the vocal cords of women are shorter, thinner and narrower, so that the frequency is high during vibration, and the emitted tones are high; therefore, if the tone of the voice signal is low, the family education device can determine that the gender of the external user of the voice signal is male; if the tone of the voice signal is high, the family education device may determine that the gender of the external user of the voice signal is female.
104. And the family education equipment acquires the instant emotion of the external user.
As an optional implementation manner, in the embodiment of the present application, the family education device may recognize an instant emotion of an external user according to a tone of the voice signal; the external users' immediate emotions may include a low emotion and a high emotion, among others. For example, when the intonation of the voice signal is a high-hole intonation, the family education device can recognize that the instant emotion of the external user is a high-rise emotion; when the intonation of the voice signal is a deep intonation, the family education device can recognize that the instant emotion of the external user is a low emotion.
As another optional implementation manner, in this application example, the acquiring, by the family education device, the instant emotion of the external user includes:
the family education equipment detects whether a wearable device is wirelessly connected at present;
if the wearable equipment is wirelessly connected with the family education equipment currently, the family education equipment acquires the sound characteristics of a wearer of the wearable equipment;
and the family education device verifying whether the sound features of the wearer of the wearable device match the sound features of the voice signal;
if the current heart rate data of the wearable device and the current blood pressure data of the wearer are matched, the family education device can inform the wearable device to acquire the current heart rate data of the wearer of the wearable device and the current blood pressure data of the wearer, and the wearable device determines the instant emotion of the wearer according to the current heart rate data of the wearer and the current blood pressure data of the wearer; when the current heart rate data exceeds a specified heart rate threshold value and the current blood pressure data exceeds a specified blood pressure threshold value, the wearable device identifies that the instant emotion type of the wearer is a high emotion; or when the current heart rate data does not exceed a specified heart rate threshold and the current blood pressure data does not exceed a specified blood pressure threshold, identifying the type of the immediate emotion of the wearer as a low emotion;
and the family education device receives the identification of the instant emotion of the wearer sent by the wearable device to obtain the instant emotion of the external user.
Wherein, implement above-mentioned embodiment, can be because the accurate instant emotion of discerning external user of the wearable equipment that external user wore and inform family education equipment to make family education equipment can obtain accurate external user's instant emotion.
105. The family education device determines a target visual style for improving the instant emotion from among a plurality of visual styles pre-configured by the application.
Wherein the visual style may be a combination of color and pattern. For example, when the instant emotion is a low-falling emotion, the color of the target visual style may be red (in color psychology, red represents vitality, health, enthusiasm, joy, celebration, and the like), and the pattern of the target visual style may be a festive pattern; for another example, when the immediate mood is a high mood, the color of the target visual style can be brown or brown (in psychology, brown or brown stands for calm, and peace), and the pattern of the target visual style can be provided with a pattern of cool and quiet cues.
106. The family education equipment starts the application program, loads the main interface of the application program according to the target visual style, and outputs the virtual animal matched with the gender of the user on the main interface of the application program.
For example, the virtual animal matching the gender of the user may be a virtual animal that is generally preferred by the user to whom the gender of the user belongs. For example, when the gender of the user is male, the virtual animal matched with the gender of the user can be a virtual dog, a virtual tortoise, and the like; when the gender of the user is female or male, the virtual animal matched with the gender of the user can be a virtual cat, a virtual bird and the like.
It should be noted that the virtual animal matching the gender of the user may also be any virtual animal in a set of virtual animals configured for the gender of the user in advance by the family education device, and the embodiment of the present application is not limited thereto.
107. And the family education equipment controls the virtual animal to broadcast prompt information according to the tone used for improving the instant emotion, and the prompt information is used for prompting that the application program is started.
In the embodiment of the application, for example, when the instant emotion is a low-falling emotion, the virtual animal may broadcast the prompt message according to a happy tone for improving the low-falling emotion; for another example, when the immediate emotion is a rising emotion, the virtual animal may broadcast the alert information in the tone and expression for improving the rising emotion.
In the method described in fig. 1, the home education device can flexibly adjust the visual style of the main interface of the application program started by the user according to the instant emotion of the user, so that the interestingness can be improved, and the interest of the user (such as primary and secondary school students) in using the application program of the home education device can be promoted. In addition, the visual style of the main interface of the adjusted application program is a target visual style for improving the instant emotion of the user, so that the experience of the user using the application program of the family education device can be improved.
Example two
Referring to fig. 2, fig. 2 is a schematic flowchart illustrating another method for controlling starting of an application according to an embodiment of the present disclosure. As shown in fig. 2, the start control method of the application program may include the steps of:
201. the family education equipment listens to the voice signal sent by the outside.
202. Detecting whether the voice signal contains a keyword for starting a search question application program of the family education equipment or not by the family education equipment; if the voice signal contains the keyword for starting the question searching application program of the family education device, executing step 203-step 212; if the voice signal does not contain the keyword for starting the question searching application program of the family education equipment, the process is ended.
203. And the family education equipment identifies the user gender of the external user sending the voice signal according to the voice signal.
204. The family education equipment detects whether wireless connection is currently provided with the wearable equipment, if yes, the sound characteristics of a wearer of the wearable equipment are obtained, whether the sound characteristics of the wearer of the wearable equipment are matched with the sound characteristics of the voice signals is verified, if yes, the wearable equipment is informed to obtain the current heart rate data of the wearer of the wearable equipment and the current blood pressure data of the wearer, and the wearable equipment determines the instant emotion of the wearer according to the current heart rate data of the wearer and the current blood pressure data of the wearer.
205. The family education device receives the identification of the instant emotion of the wearer sent by the wearable device to obtain the instant emotion of the outside user.
206. The family education device determines a target visual style for improving the instant emotion from among a plurality of visual styles pre-configured by the application.
207. The family education equipment starts the application program, loads the main interface of the application program according to the target visual style, and outputs the virtual animal matched with the gender of the user on the main interface of the application program.
For example, the virtual animal matching the gender of the user may be a virtual animal that is generally preferred by the user to whom the gender of the user belongs. For example, when the gender of the user is male, the virtual animal matched with the gender of the user can be a virtual dog, a virtual tortoise, and the like; when the gender of the user is female or male, the virtual animal matched with the gender of the user can be a virtual cat, a virtual bird and the like.
It should be noted that the virtual animal matching the gender of the user may also be any virtual animal in a set of virtual animals configured for the gender of the user in advance by the family education device, and the embodiment of the present application is not limited thereto.
208 the family education device controls the virtual animal to broadcast prompt information according to the tone used for improving the instant emotion, wherein the prompt information is used for prompting that the application program is started.
In the embodiment of the application, for example, when the instant emotion is a low-falling emotion, the virtual animal may broadcast the prompt message according to a happy tone for improving the low-falling emotion; for another example, when the immediate emotion is a rising emotion, the virtual animal may broadcast the alert information in the tone and expression for improving the rising emotion.
209. The family education equipment monitors the question searching voice sent by the external user and obtains a question searching result corresponding to the question searching voice.
210. And the family education equipment outputs the question searching result corresponding to the question searching voice to a main interface of the application program for displaying.
211. And the family education equipment controls the virtual animal to broadcast response voice corresponding to the search question voice sent by the external user according to the tone for improving the instant emotion.
In this embodiment of the application, the response voice may be an output voice obtained by performing text/voice conversion on a search question result corresponding to a search question voice sent by the external user, for example, when the search question voice sent by the external user is "what a radical wearing characters is", the search question result corresponding to the search question voice sent by the external user may be "the radical wearing characters is: correspondingly, the response voice can be a search question result 'the radical with characters worn on the head' corresponding to the search question voice sent by the external user: and tenthly, performing text/voice conversion to obtain output voice. For another example, when the search question speech uttered by the external user is "recommend good sentences describing spring and i want to write composition", the search question result corresponding to the search question speech uttered by the external user may be "thin rain such as silk, spring rain such as oil", and accordingly, the response speech may be output speech obtained by performing text/speech conversion on the search question result "thin rain such as silk, spring rain such as oil" corresponding to the search question speech uttered by the external user.
In this embodiment of the application, the response voice may be a learning encouragement voice of a search result (e.g., a knowledge point video) corresponding to the search voice uttered by the external user, for example, when the search voice uttered by the external user is "i want to watch videos about rational numbers", the search result corresponding to the search voice uttered by the external user may be videos about rational numbers, and accordingly, the response voice may be a learning encouragement voice of videos about rational numbers corresponding to the search voice uttered by the external user, for example, the learning encouragement voice may be "to assist a celebrity in finding videos about rational numbers, and make a learning effort".
212. The family education equipment inquires whether student personal attribute information corresponding to the sound features of the voice signals is stored or not; the student personal attribute information at least comprises student identity information and a target curriculum schedule corresponding to the student, and the target curriculum schedule at least comprises a plurality of different learning subjects learned by the student and teacher terminal identifications corresponding to each learning subject; if the personal attribute information of the student corresponding to the sound feature of the voice signal is stored, go to step 213; if the personal attribute information of the student corresponding to the sound feature of the voice signal is not stored, the flow is ended.
The teacher terminal identification can be a mobile phone number of the teacher terminal or account information of a teaching application installed on the teacher terminal.
213. The family education equipment queries a target learning subject corresponding to the search question result from a target curriculum schedule according to the search question result; and inquiring the target teacher terminal identification corresponding to the target learning subject from the target curriculum schedule.
214. The home education equipment converts the search question voice into search question words, and reports the student identity information, the search question words and the target teacher terminal identification to the cloud platform, so that the cloud platform sends the student identity information and the search question words to the teacher terminal to which the target teacher terminal identification belongs according to the target teacher terminal identification.
In the embodiment of the present application, the above steps 212 to 214 are implemented to enable the teacher to find the problems encountered by some students in the subject (e.g., language) taught by the teacher according to the collected search words sent by some students in the subject (e.g., language) taught by the teacher, so that the teacher can specifically explain the problems encountered by the students to the students, thereby facilitating to improve the learning efficiency of the students.
As an optional implementation manner, in this application embodiment, after receiving the student identity information and the search question words sent by the cloud platform, the teacher terminal to which the target teacher terminal identifier belongs may prompt the teacher to award the student to which the student identity information belongs for encouraging the student to learn a virtual gift (such as a virtual small red flower), and the teacher terminal to which the target teacher terminal identifier belongs may send the virtual gift to the cloud platform, so that the cloud platform may send the virtual gift to the home education device, thereby realizing that the teacher encourages the student to learn, and being beneficial to promoting learning interest and power of the student.
As an optional implementation manner, in this application embodiment, the cloud platform may detect whether the total number of the virtual gifts pushed to the family education device exceeds a specified number, and if the total number of the virtual gifts pushed to the family education device exceeds the specified number, the cloud platform may determine a user function (for example, an animation function performed by watching a virtual animal) in the search result application program that has not been activated corresponding to the total number of the virtual gifts pushed to the family education device, and activate the user authority for the family education device, so that the available user functions of the search result application program may be enriched, and the learning interest and power of the student may be improved.
As an optional implementation manner, in this embodiment of the application, the personal attribute information of the student may further include a monitor terminal identifier corresponding to the student. Accordingly, the method depicted in fig. 2 may further include:
family education equipment is with student identity information, search for the subject characters and this guardian terminal identification and report to the cloud platform, so that the cloud platform is according to this guardian terminal identification, with student identity information, search for the subject characters and send the guardian terminal that this guardian terminal identification belongs to, make the guardian can be according to the search for the subject characters that the student of its guardianship who collects sent on the study, discover the problem that this student met on the study, so that the guardian can the pertinence further explain the problem that this student met to the student of its guardianship, thereby be favorable to promoting this student's learning efficiency.
As an alternative embodiment, in the method described in fig. 2, the family education device may further perform the following operations:
the family education equipment informs the wearable equipment to start a recording microphone of the wearable equipment to monitor the environmental sound source, the wearable equipment can verify whether the monitored environmental sound source is matched with a crying sound source of the child in the database, if so, the wearable equipment plays target music, and the target music is used for attracting and transferring the attention of the student and relieving the emotion of the student when the student encounters difficulty in learning.
Because the environment sound source monitored by the recording microphone contains background noise, the wearable equipment can firstly carry out pre-discrete sampling and quantification on the environment sound source containing the background noise to obtain a data frame, construct a wavelet neural network based on a Morlet wavelet function for the data frame, construct a particle swarm fitness function for parameters of the wavelet neural network, obtain the optimal parameters of the wavelet neural network through a particle swarm algorithm, input the data frame into the wavelet neural network for filtering, thereby removing the noise and extracting to obtain a voice signal; further, the wearable device can check whether the voiceprint features of the extracted voice signals are matched with the voiceprint features of the crying sound sources of the children in the database, if the voiceprint features of the extracted voice signals are matched with the voiceprint features of the crying sound sources of the children in the database, the wearable device plays target music, the target music is used for attracting and transferring the attention of the students, and the emotion of the students when the students encounter difficulty in learning is relieved. By implementing the embodiment, the adaptability to the noise characteristics of different environment sound sources can be improved.
Wherein, wearable equipment check-up whether the voiceprint characteristic of the speech signal who extracts matches with the voiceprint characteristic of the child's source of crying in the database includes:
the wearable device carries out preprocessing on the extracted voice signals, wherein the preprocessing comprises pre-emphasis, framing and windowing processing;
the wearable device extracts voiceprint features MFCC, LPCC, Δ MFCC, Δ LPCC, energy, first order difference of energy, and GFCC from the preprocessed voice signal to jointly form a first multi-dimensional feature vector, wherein: MFCC is a Mel frequency cepstrum coefficient, LPCC is a linear prediction cepstrum coefficient, Δ MFCC is a first order difference of MFCC, Δ LPCC is a first order difference of LPCC, and GFCC is a Gamma tone filter cepstrum coefficient;
and the wearable equipment judges whether the first multi-dimensional feature vector is completely matched with a second multi-dimensional vector corresponding to the voiceprint features of the crying sound source of the child in the database, and if so, the extracted voiceprint features of the voice signal are accurately verified to be matched with the voiceprint features of the crying sound source of the child in the database.
In the embodiment of the application, the target music can be music preset by the wearable device and used for attracting the attention of the student and relieving the emotion of the student when the student encounters difficulty in learning; or, the wearable device may also be music that is acquired from the cloud and used for attracting and transferring the attention of the student, and relieving the emotion generated when the student encounters difficulty in learning, which is not limited in the embodiment of the present application.
In the method described in fig. 2, the home education device can flexibly adjust the visual style of the main interface of the application program started by the user according to the instant emotion of the user, so that the interestingness can be improved, and the interest of the user (such as primary and secondary school students) in using the application program of the home education device can be promoted. In addition, the visual style of the main interface of the adjusted application program is a target visual style for improving the instant emotion of the user, so that the experience of the user using the application program of the family education device can be improved.
In addition, in the method described in fig. 2, the family education device may load a virtual animal matching the user gender of the external user on the main interface of the application program, so that the virtual animal may broadcast a response voice corresponding to the search voice uttered by the external user according to the intonation for improving the instant emotion of the external user, thereby being beneficial to arousing the interest of the primary and secondary school students in searching for the questions.
In addition, in the method described in fig. 2, the teacher may find the problems that some students have encountered in the subject (e.g., language) taught by the teacher according to the collected search words that some students have issued in the subject (e.g., language) taught by the teacher, so that the teacher may specifically explain the problems that the students have encountered to the students, thereby facilitating to improve the learning efficiency of the students.
In addition, in the method described in fig. 2, the emotion of the student when difficulty is encountered in learning can be relieved.
EXAMPLE III
Referring to fig. 3, fig. 3 is a schematic structural diagram of a family education device disclosed in an embodiment of the present application. As shown in fig. 3, the family education device may include:
the monitoring unit 301 is configured to monitor a voice signal sent by the outside;
a detecting unit 302, configured to detect whether the voice signal contains a keyword for starting an application of a family education device;
a recognition unit 303, configured to recognize, according to the voice signal, a user gender of an external user who has sent the voice signal when a detection result of the detection unit 302 is yes;
a first obtaining unit 304, configured to obtain an instant emotion of an external user;
a determining unit 305, configured to determine a target visual style for improving the instant emotion from a plurality of visual styles pre-configured by the application;
the first control unit 306 is configured to start the application program, load a main interface of the application program according to a target visual style, and output a virtual animal matched with the gender of the user on the main interface of the application program;
and a second control unit 307, configured to control the virtual animal to broadcast a prompt message according to the intonation for improving the instant emotion, where the prompt message is used to prompt that the application has been started.
In this application embodiment, family education equipment can start the voice interception function of family education equipment after the start to interception unit 301 can intercept the speech signal that the external world sent through the voice interception function real-time interception of the family education equipment that has started.
Optionally, in this embodiment of the application, after the home teaching device is turned on, it may be detected whether a first trajectory for starting the voice interception function, which is input by an external user on a display screen of the home teaching device, is received, and if the first trajectory is received, the voice interception function of the home teaching device is started, so that power consumption of the home teaching device may be reduced; correspondingly, after the family education equipment is started, whether the second track which is input by an external user on the display screen of the family education equipment and used for closing the voice interception function can be detected, and if the second track is received, the voice interception function of the family education equipment can be closed, so that the power consumption of the family education equipment can be reduced.
In this embodiment, the recognition unit 303 is specifically configured to, when the detection unit 302 detects that the voice signal includes a wake-up word for waking up a voice search application of the family education device, extract a sound feature of the voice signal according to the voice signal; and identifying the user gender of the external user sending the voice signal according to the voice characteristics of the voice signal. For example, the recognition unit 303 may extract a tone (belonging to a sound feature) of the voice signal according to the voice signal, and the recognition unit 303 may recognize the user gender of the external user who utters the voice signal according to the tone of the voice signal.
As an optional implementation manner, in this embodiment of the application, the first obtaining unit 304 may recognize an instant emotion of an external user according to a tone of the voice signal; the instant emotion types of the external users can include low emotions and high emotions. For example, when the intonation of the voice signal is a high pitch, the first obtaining unit 304 may recognize that the instant emotion of the external user is a high emotion; when the intonation of the voice signal is a deep intonation, the first obtaining unit 304 may recognize the immediate emotion of the external user as a low emotion.
As another alternative implementation, as shown in fig. 3, the first obtaining unit 304 may include:
a detecting subunit 3041, configured to detect whether a wearable device is currently wirelessly connected to the home education device;
an obtaining subunit 3042, configured to obtain a sound feature of a wearer of the wearable device when the detecting subunit 3041 detects that the wearable device is wirelessly connected to the home education device currently;
a verification subunit 3043 configured to verify whether the sound characteristics of the wearer of the wearable device match the sound characteristics of the voice signal;
an interaction subunit 3044, configured to notify the wearable device to obtain current heart rate data of a wearer of the wearable device and current blood pressure data of the wearer when the verification result of the verification subunit 3043 is a match, and determine an instant emotion type of the wearer by the wearable device according to the current heart rate data of the wearer and the current blood pressure data of the wearer; when the current heart rate data exceeds a specified heart rate threshold value and the current blood pressure data exceeds a specified blood pressure threshold value, the wearable device identifies the instant emotion of the wearer as a high emotion; or, when the current heart rate data does not exceed the specified heart rate threshold and the current blood pressure data does not exceed the specified blood pressure threshold, identifying the immediate emotion of the wearer as a low emotion;
and the interaction subunit 3044 is further configured to receive the identification of the wearer's instant emotion sent by the wearable device to obtain the external user's instant emotion.
Wherein, implement above-mentioned embodiment, can be because the accurate instant emotion of discerning external user of the wearable equipment that external user wore and inform family education equipment to make family education equipment can obtain accurate external user's instant emotion type.
Therefore, the home education device described in fig. 3 can flexibly adjust the visual style of the main interface of the application program started by the user according to the instant emotion of the user, so that the interestingness can be improved, and the interest of the user (such as primary and secondary school students) in using the application program of the home education device can be promoted. In addition, the visual style of the main interface of the adjusted application program is a target visual style for improving the instant emotion of the user, so that the experience of the user using the application program of the family education device can be improved.
Example four
Referring to fig. 4, fig. 4 is a schematic structural diagram of another family education device disclosed in the embodiment of the present application. Wherein, the family education device shown in fig. 4 is optimized by the family education device shown in fig. 3. In the family education device shown in fig. 4, the application is a question searching application, and the family education device shown in fig. 4 includes a second obtaining unit 308, a query unit 309 and a conversion unit 310, in addition to all the components of the family education device shown in fig. 3, wherein:
the monitoring unit 301 is further configured to monitor a question searching voice sent by an external user;
a second obtaining unit 308, configured to obtain a question searching result corresponding to the question searching voice;
the first control unit 306 is further configured to output a question searching result corresponding to the question searching voice to a main interface of the application program for display;
the second control unit 307 is further configured to control the virtual animal to broadcast a response voice corresponding to the search voice sent by the external user according to the intonation used for improving the instant emotion.
The query unit 309 is configured to query whether student personal attribute information corresponding to the sound feature of the voice signal is stored; the student personal attribute information at least comprises student identity information and a target curriculum schedule corresponding to the student, and the target curriculum schedule at least comprises a plurality of different learning subjects learned by the student and teacher terminal identifications corresponding to the learning subjects; and if the personal attribute information of the student corresponding to the voice feature of the voice signal is stored, inquiring a target learning subject corresponding to the search result from the target curriculum schedule by taking the search result as a basis; inquiring a target teacher terminal identification corresponding to the target learning subject from the target curriculum schedule;
the conversion unit 310 is configured to convert the search question voice into search question words, and report the student identity information, the search question words, and the target teacher terminal identifier to the cloud platform, so that the cloud platform sends the student identity information and the search question words to the teacher terminal to which the target teacher terminal identifier belongs according to the target teacher terminal identifier, and the teacher can find problems that the students encounter in subjects (such as languages) taught by the teacher according to the collected search question words that are sent by some students in the subjects (such as languages) taught by the teacher, so that the teacher can specifically explain the problems that the students encounter to the students, and thus the learning efficiency of the students is improved.
As an optional implementation manner, in this embodiment of the application, the personal attribute information of the student may further include a monitor terminal identifier corresponding to the student. Correspondingly, the conversion unit 310 can also report the student identity information, the search question words and the guardian terminal identification to the cloud platform, so that the cloud platform sends the student identity information and the search question words to the guardian terminal to which the guardian terminal identification belongs according to the guardian terminal identification, so that the guardian can discover the problems encountered by the student in the study according to the collected search question words sent by the guardian in the study of the student in the guardian, so that the guardian can pertinently further explain the problems encountered by the student to the guardian, and the learning efficiency of the student is favorably improved.
As an optional implementation manner, in this embodiment of the application, the second control unit 307 may further perform the following operations:
the second control unit 307 informs the wearable device to start the recording microphone of the wearable device to monitor the environmental sound source, and the wearable device may check whether the monitored environmental sound source matches with the crying sound source of the child in the database, and if so, the wearable device plays the target music, and the target music is used for attracting the attention of the student, and relieving the emotion of the student when the student encounters difficulty in learning.
Because the environment sound source monitored by the recording microphone contains background noise, the wearable equipment can firstly carry out pre-discrete sampling and quantification on the environment sound source containing the background noise to obtain a data frame, construct a wavelet neural network based on a Morlet wavelet function for the data frame, construct a particle swarm fitness function for parameters of the wavelet neural network, obtain the optimal parameters of the wavelet neural network through a particle swarm algorithm, input the data frame into the wavelet neural network for filtering, thereby removing the noise and extracting to obtain a voice signal; further, the wearable device can check whether the voiceprint features of the extracted voice signals are matched with the voiceprint features of the crying sound sources of the children in the database, if the voiceprint features of the extracted voice signals are matched with the voiceprint features of the crying sound sources of the children in the database, the wearable device plays target music, the target music is used for attracting and transferring the attention of the students, and the emotion of the students when the students encounter difficulty in learning is relieved. By implementing the embodiment, the adaptability to the noise characteristics of different environment sound sources can be improved.
Wherein, wearable equipment check-up whether the voiceprint characteristic of the speech signal who extracts matches with the voiceprint characteristic of the child's source of crying in the database includes:
the wearable device carries out preprocessing on the extracted voice signals, wherein the preprocessing comprises pre-emphasis, framing and windowing processing;
the wearable device extracts voiceprint features MFCC, LPCC, Δ MFCC, Δ LPCC, energy, first order difference of energy, and GFCC from the preprocessed voice signal to jointly form a first multi-dimensional feature vector, wherein: MFCC is a Mel frequency cepstrum coefficient, LPCC is a linear prediction cepstrum coefficient, Δ MFCC is a first order difference of MFCC, Δ LPCC is a first order difference of LPCC, and GFCC is a Gamma tone filter cepstrum coefficient;
and the wearable equipment judges whether the first multi-dimensional feature vector is completely matched with a second multi-dimensional vector corresponding to the voiceprint features of the crying sound source of the child in the database, and if so, the extracted voiceprint features of the voice signal are accurately verified to be matched with the voiceprint features of the crying sound source of the child in the database.
In the embodiment of the application, the target music can be music preset by the wearable device and used for attracting the attention of the student and relieving the emotion of the student when the student encounters difficulty in learning; or, the wearable device may also be music that is acquired from the cloud and used for attracting and transferring the attention of the student, and relieving the emotion generated when the student encounters difficulty in learning, which is not limited in the embodiment of the present application.
In the family education device described in fig. 4, the visual style of the main interface of the application program started by the user can be flexibly adjusted according to the instant emotion of the user, so that the interestingness can be improved, and the interest of the user (such as primary and secondary school students) in using the application program of the family education device can be promoted. In addition, the visual style of the main interface of the adjusted application program is a target visual style for improving the instant emotion of the user, so that the experience of the user using the application program of the family education device can be improved.
In addition, in the family education device described in fig. 4, the family education device may load a virtual animal matching the user gender of the external user on the main interface of the application program, so that the virtual animal may broadcast a response voice corresponding to the search voice issued by the external user according to the intonation for improving the instant emotion of the external user, thereby being beneficial to arousing the interest of the primary and secondary school students in searching for the questions.
In addition, in the home teaching apparatus described in fig. 4, the teacher can find the problems that some students have encountered in the subject (e.g., language) taught by the teacher according to the collected search words that some students have issued in the subject (e.g., language) taught by the teacher, so that the teacher can specifically explain the problems that the students have encountered to the students, thereby being beneficial to improving the learning efficiency of the students.
In addition, in the family education device described in fig. 4, the emotion of the student when difficulty is encountered in learning can be relieved.
EXAMPLE five
Referring to fig. 5, fig. 5 is a schematic structural diagram of another family education device disclosed in the embodiment of the present application. As shown in fig. 5, the family education device may include:
a memory 501 in which executable program code is stored;
a processor 502 coupled to a memory 501;
wherein, the processor 502 calls the executable program code stored in the memory 501 to execute the method described in fig. 1 or fig. 2.
An embodiment of the present application discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute the method described in fig. 1 or fig. 2.
It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by hardware instructions of a program, and the program may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CD-ROM), or other Memory, such as a magnetic disk, or a combination thereof, A tape memory, or any other medium readable by a computer that can be used to carry or store data.
The start control method of the application program and the family education device disclosed in the embodiment of the application are introduced in detail, a specific example is applied in the description to explain the principle and the implementation of the application, and the description of the embodiment is only used for helping to understand the method and the core idea of the application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.