CN111402925A - Voice adjusting method and device, electronic equipment, vehicle-mounted system and readable medium - Google Patents

Abstract

Embodiments of the present disclosure disclose a voice adjustment method and apparatus. A specific embodiment of the present disclosure includes: acquiring environmental information of a vehicle; acquiring status information of at least one person on the vehicle; determining a voice adjustment strategy based on the environmental information and the state information; and according to the voice adjustment strategy, Adjust the parameters of the voice to be played on the vehicle. This embodiment uses internal and external vehicle conditions and road conditions to determine the urgency of the situation, and then combines the emotional state of the driver/passenger to determine whether it is necessary to appease the occupants in the vehicle, and performs tone change and speed change processing on the voice. Under the condition of ensuring the integrity of the same voice image, the voice is given correct emotional feedback, which brings safer driving voice interaction. It can be applied to assisted driving and unmanned driving scenarios.

Description

Method, apparatus, electronic device, in-vehicle system and readable medium for voice adjustment

technical field

Embodiments of the present disclosure relate to the field of computer technology, and in particular, to a method and apparatus for adjusting speech.

Background technique

With the rapid development of computer technology and artificial intelligence, in-vehicle navigation and assisted driving are more and more widely used in the field of car driving. Early vehicle voice systems generally use a single mechanical voice prompt, that is, a fixed voice (speaking speed, pitch, intonation) is used, which may lead to poor prompting effect and users do not like it. For example, in a general survey, some users prefer a sweet and gentle female voice (slow speed, high pitch, and intonation change), while some users prefer the voice broadcast of a specific star. In order to meet the individual needs of users, speech synthesis technology can be used to simulate the speech of a specific person (first collect a limited amount of speech, use artificial intelligence technology to perform speech synthesis processing, and obtain the target language with the specific person's voice timbre).

Research has found that for warning reminders during driving, it is necessary to be more confident that urgent intonation (speaking fast, low intonation, and intonation is flat) to allow users to respond more quickly. The following solutions can be envisaged:

(1) Different functions call different voice packets. For example, when the function of waking up the voice dialogue system is performed, the voice packet 1 is called, and when the function of broadcasting navigation information is performed, the voice packet 2 is called. However, in this solution, different functions do not fully represent the urgency of the scene, and the voice packets are quite different in timbre, and the voice image experience is fragmented.

(2) Real people record specific corpus, some car voice systems will record more corpus, trying to have natural changes in the pitch and speed of speech in different scenarios. However, in this scheme, various situations need to be considered when recording corpus, and the workload of corpus recording is large.

It should be noted that the methods described in this section are not necessarily methods that have been previously conceived or adopted. Unless otherwise indicated, it should not be assumed that any of the approaches described in this section qualify as prior art merely by virtue of their inclusion in this section. Similarly, unless otherwise indicated, the issues raised in this section should not be considered to be recognized in any prior art.

SUMMARY OF THE INVENTION

Embodiments of the present disclosure propose a voice adjustment method and apparatus.

According to a first aspect of the present disclosure, an embodiment of the present disclosure provides a voice adjustment method, the method includes: acquiring environmental information of a vehicle; acquiring status information of at least one person on the vehicle; based on the environmental information and According to the state information, a voice adjustment strategy is determined; according to the voice adjustment strategy, the parameters of the voice to be played on the vehicle are adjusted.

In some embodiments, the environmental information includes at least one of in-vehicle environmental information and out-of-vehicle environmental information, and wherein the out-of-vehicle environmental information includes road condition information and/or advanced driver assistance system ADAS information.

In some embodiments, the parameter includes at least one of pitch, speech rate, and intonation.

In some embodiments, the determining the voice adjustment strategy based on the environment information and the state information includes: judging, according to the environment information, the urgency of the prompting event corresponding to the voice to be played, and judging according to the state information the emotional state of at least one person on board the vehicle.

In some embodiments, when the environmental information includes in-vehicle environmental information, the in-vehicle environmental information is acquired by collecting vehicle component state information.

In some embodiments, when the environmental information includes road condition information, the road condition information is acquired in one of the following ways: obtaining real-time high-precision road condition information through the cloud; or sensing the vicinity of the vehicle through a sensor camera and/or radar Happening.

In some embodiments, the at least one person on the vehicle includes a driver of the vehicle, and wherein the state information is obtained in at least one of the following ways: collecting the facial expression of the at least one person on the vehicle through a camera; The language of at least one person on the vehicle is collected through a voice receiver; the driving action of the driver is collected through a driving action collector; or the driving duration of the driver is collected through a clock recorder.

In some embodiments, the method further includes: pre-establishing a speech adjustment strategy model, the speech adjustment strategy model including the corresponding relationship between the urgency, the emotional state and the speech adjustment strategy, the speech adjustment strategy including frequency, speed and a combination of intonation model curves.

In some embodiments, the intonation model curves include a serious intonation model curve with a warning effect, a calm intonation model curve with a soothing effect, and a lively intonation model curve with an uplifting effect.

In some embodiments, the adjusting the parameters of the speech to be played on the vehicle according to the speech adjustment strategy includes: according to the combination of the frequency, speed and intonation model curve included in the determined speech adjustment strategy, The frequency and speech rate of the to-be-played speech are adjusted accordingly, and the corresponding intonation model is adjusted for the to-be-played speech.

According to a second aspect of the present disclosure, an embodiment of the present disclosure provides a voice adjustment device, comprising: a first acquisition unit configured to acquire environmental information of a vehicle; a second acquisition unit configured to acquire information on the vehicle Status information of at least one person; a determining unit configured to determine a voice adjustment strategy based on the environment information and the status information; an adjustment unit configured to adjust the voice to be played on the vehicle according to the voice adjustment strategy parameter.

In some embodiments, the environmental information includes at least one of in-vehicle environmental information and out-of-vehicle environmental information, and wherein the out-of-vehicle environmental information includes road condition information and/or ADAS information.

In some embodiments, the parameter includes at least one of pitch, speech rate, and intonation.

In some embodiments, the determining unit is configured to determine the urgency of the prompting event corresponding to the prompting voice according to the environmental information, and to judge the emotional state of at least one person on the vehicle according to the state information.

In some embodiments, when the environmental information includes in-vehicle environmental information, the first acquisition unit is configured to acquire the in-vehicle environmental information by collecting vehicle component state information; and wherein, in the environment When the information includes road condition information, the first acquiring unit is configured to acquire the road condition information in at least one of the following ways: acquiring real-time high-precision road condition information through the cloud; or sensing the vicinity of the vehicle through a sensing camera and/or radar Happening.

In some embodiments, when the at least one person on the vehicle includes the driver of the vehicle, the second obtaining unit is configured to obtain the state information in at least one of the following ways: collecting the information by a camera collect the facial expression of at least one person on the vehicle; collect the language of at least one person on the vehicle through a voice receiver; collect the driving action of the driver through a driving action collector; or collect the driver's current time through a clock recorder duration of driving.

In some embodiments, the determining unit is further configured to determine a speech adjustment strategy according to a pre-established speech adjustment strategy model, where the speech adjustment strategy model includes the corresponding relationship between the urgency, the emotional state and the speech adjustment strategy, so The described speech modulation strategies include a combination of frequency, velocity, and intonation model curves.

According to a third aspect of the present disclosure, an embodiment of the present disclosure provides an electronic device, the electronic device includes: one or more processors; a storage device on which one or more programs are stored; A plurality of programs are executed by the one or more processors such that the one or more processors implement the method as described in any one of the implementations of the first aspect.

According to a fourth aspect of the present disclosure, an embodiment of the present disclosure provides an in-vehicle system including the electronic device as described in the third aspect.

According to a fifth aspect of the present disclosure, an embodiment of the present disclosure provides a computer-readable medium on which a computer program is stored, wherein the program, when executed by a processor, implements the implementation described in any of the first aspect method.

The voice adjustment method and device provided by the embodiments of the present disclosure use internal and external vehicle conditions and road conditions to determine the urgency of the situation, and then combine the emotional state of the driver/passenger to determine whether it is necessary to appease the occupants in the vehicle, and perform pitch shifting and shifting processing on the voice. Under the condition of ensuring the integrity of the same voice image, the voice is given correct emotional feedback, which brings safer driving voice interaction. The present disclosure can be applied to assisted driving and unmanned driving scenarios.

Description of drawings

Other features, objects and advantages of the present disclosure will become more apparent upon reading the detailed description of non-limiting embodiments taken with reference to the following drawings.

FIG. 1 is a flowchart of one embodiment of a speech adjustment method according to the present disclosure.

FIG. 2 is a schematic structural diagram of an embodiment of a speech adjustment apparatus according to the present disclosure.

3 is a schematic structural diagram of an electronic device suitable for implementing embodiments of the present disclosure.

Implementation

The present disclosure will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the related invention, but not to limit the invention. In addition, it should be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.

It should be noted that the embodiments of the present disclosure and the features of the embodiments may be combined with each other under the condition of no conflict. The present disclosure will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

FIG. 1 shows a flowchart of a process 100 of one embodiment of a speech adjustment method according to the present disclosure. The voice adjustment method includes the following steps:

In step 101, environmental information of the vehicle is acquired.

In this step, the executive body of the voice adjustment method may acquire the environmental information through a wired connection or a wireless connection. In some embodiments, the environmental information may include in-vehicle environmental information or out-of-vehicle environmental information. The in-vehicle environment information may include, for example, vehicle condition information, and the vehicle condition information may include various data related to vehicle operating conditions, such as data related to various components of the vehicle itself, such as tire pressure, water temperature, fuel quantity, electricity, vehicle speed, and the like. As an example, the corresponding component status data can be acquired through collection of tire pressure sensor, temperature sensor, fuel quantity sensor, level sensor, vehicle speed sensor, etc. respectively. The outside environment information may include road condition information or ADAS information of an advanced driving assistance system. The road condition information may be, for example, a traffic jam condition. As an example, real-time high-precision road condition information can be obtained from the cloud. This information can be used in subsequent steps to determine if there is a traffic emergency (bad weather, road collapse, ambulance giving way, etc.), or routing problems (wrong way, speeding, etc.). ADAS information may include conditions around the vehicle, such as the vehicle's distance from surrounding obstacles. As an example, the situation around the vehicle can be sensed through sensing cameras, radar, etc. For example, the distance between the vehicle and surrounding obstacles can be obtained through ultrasonic radar. In some embodiments, the present disclosure is applied to a smart cockpit system, and sensors such as a sensor camera and a radar configured in the smart cockpit can determine whether there is an approaching accident (collision with other cars, collision with others, collision with objects, etc.) or driving problems (running a red light, pressing the line, lane departure), so as to warn the user or make a manual takeover request. Although the specific content and acquisition method of the environmental information have been described above, this is only an example, and the present disclosure is not limited thereto. Those skilled in the art should be able to understand that the content and acquisition method of the information can be expanded according to specific requirements.

In step 102, the status information of at least one person on the vehicle is acquired.

In this step, the executive body of the voice adjustment method may acquire the state information through a wired connection or a wireless connection. For example, the status information of people on the vehicle, such as the driver of the current vehicle or the passengers in the vehicle, is obtained. One or more persons in the vehicle can be considered as users of the voice conditioning function. For simplicity, "user" is used below to refer to persons on board the vehicle, including the driver and passengers in the vehicle. It should be understood that the at least one person on the vehicle may include at least the driver of the vehicle.

In some embodiments, the user's state information may be various effective information that is helpful for analyzing the user's emotional state. With the help of this information, it is better to more effectively analyze whether the user is in a specific emotional state, such as panic. , an emotional state of fatigue or sadness (depression). As an example, the user's emotional state may be analyzed by the user's facial expressions, the language spoken by the user, the user's driving action, the duration of the current drive, and the like. As an example, the user's facial expressions can be collected through a camera, the language spoken by the user can be collected through a voice receiver, the driver's driving movements can be collected through a driving action collector, and the driver's driving duration can be collected through a clock recorder. In some embodiments, a camera, a voice receiver, a driving action collector, etc. may be equipped in the intelligent cockpit system to which the present disclosure is applied. Although the specific content and acquisition method of the user state information have been described above, this is only an example, and the present disclosure is not limited thereto. Those skilled in the art should be able to understand that the content and acquisition method of the information can be expanded according to specific requirements.

Although step 101 is described above, and step 102 is described later, this is not intended to limit the sequence of the two steps, which may be performed simultaneously, or may be performed first as described later. Those skilled in the art should understand that the present disclosure is not limited to this. .

In step 103, a speech adjustment strategy is determined based on the environment information and the state information.

In this step, the information obtained in the previous steps is to be analyzed. The urgency of the situation is analyzed according to the environmental information, and the emotional state of the user is analyzed according to the user state information. Powerful analysis functions can be supported with the help of a background server.

In some embodiments, the urgency is pre-divided into multiple levels. The number of pre-divided levels is based on demand. As an example, it can be simply divided into urgent and not urgent. However, this is only an example, and the present disclosure is not limited thereto.

In some embodiments, the level of urgency corresponding to a specific situation is pre-set. For example, when the oil amount is lower than the first threshold or the second threshold, the user needs to be prompted to refuel, and when the fuel amount is lower than the first threshold, which is larger, the emergency degree of the prompt event can be set to a lower level, and when the fuel amount is lower than the second threshold, which is smaller The urgency of the reminder event can be set to a higher level. For another example, when a vehicle component fails, a fault prompt needs to be given, and a failure of an important component will lead to a traffic accident, and the emergency level of the prompt event can be set to a higher level. For another example, the urgency of the prompting event that the vehicle speed is high and a safe driving distance is not maintained with the preceding vehicle needs to be set to a high level. For another example, the emergency level of the road condition reminder event in the congestion situation may be set to a low level. In some embodiments, a database is established in advance, various prompt events are classified and corresponding urgency levels are set. As an example, when analyzing the urgency according to the vehicle environment information, the urgency of the current situation, that is, the urgency of the prompting event corresponding to the to-be-played voice, may be determined by searching a pre-established database based on the obtained vehicle environment information.

In this step, the user's emotional state is analyzed. The user's emotional state can be analyzed according to the collected facial expressions, language, driving actions, and driving duration of the user, and only one of them can be judged. Judging based on multiple pieces of information, or even combining with other pieces of information, for example, it can be comprehensively judged that the user is currently in a state of anxiety based on the user's current facial expression, the specific language spoken, and even combined with road condition information that represents congestion. In some embodiments, when analyzing the user's emotional state, on the basis of the collected facial expressions, language, driving actions and/or driving duration of the user, comprehensive analysis may also be performed with the help of a user feature database, so as to improve In order to effectively and accurately determine the user's emotional state. Whether the user is in a state of panic, fatigue, normal, happy, sad, etc. can be determined based on the user state information obtained in the previous steps and according to a predetermined mode. In some embodiments, the information processing judgment may be processed in the cockpit intelligent system, or may be assisted in processing by the cloud system.

In this step, a speech adjustment strategy is determined according to the degree of urgency and emotional state, and the speech adjustment strategy includes a combination of frequency adjustment, speed adjustment and intonation model curve. The frequency adjustment corresponds to the pitch of the speech, the speed adjustment corresponds to the speech rate of the speech, and the intonation model curve corresponds to the intonation of the speech. Intonation is a combination of pitch and rhythm, such as happy intonation, the tone at the end of a sentence is up, angry tone, the end of a sentence is down. A sentence usually has 2 pitch peaks and 3 low points. Therefore, using different intonation model curves to adjust the speech can show different intonation. As examples, the intonation model curves may include a serious intonation model curve with a warning effect, a peaceful intonation model curve with a soothing effect, a lively intonation model curve with an uplifting effect, and the like.

In some embodiments, a speech adjustment strategy model is pre-established, and the model may be linear, non-linear or hierarchical. As an example, the speech regulation strategy model includes a speech regulation strategy table, and the speech regulation strategy table includes the corresponding relationship between urgency, emotional state, and speech regulation strategy. Table 1 below is an example of a speech adjustment strategy table. As an example, the degree of urgency includes urgent and not urgent, and the emotional state includes normal, panic, fatigue, . . . and the like. For example, when the situation is not urgent but the user is in a state of panic, it is necessary to use low-pitched, slow-speed and a moderate intonation model curve to process the speech. For another example, when the situation is urgent but the user is in a state of fatigue, it is necessary to use a high-pitched, fast and serious intonation model curve. Process the voice.

Table 1

emergency level emotional state speech regulation strategy urgent normal low, fast, serious tone urgent fatigue high-pitched, fast, serious tone urgent panic Bass, slow, smooth intonation not urgent normal no treatment not urgent fatigue high-pitched, fast, serious tone not urgent panic Bass, slow, smooth intonation ... ... ...

In some embodiments, speech adjustment strategies with appropriate prompting effects may also be adopted according to more emotional states (eg, anxiety, sadness, happiness, etc.). More intonation model curves can be developed, such as soothing intonation with a soothing effect, etc. The above is just an example, and the present disclosure is not limited thereto.

In step 104, the parameters of the voice to be played on the vehicle are adjusted according to the voice adjustment strategy.

In this step, one or more parameters of the speech to be played, such as speech, intonation and speech rate, are adjusted according to the determined speech adjustment strategy. In some embodiments, according to the combination of frequency, speed and intonation model curve included in the determined speech adjustment strategy, the frequency and speech speed of the to-be-played speech are adjusted and corresponding intonation model processing is performed.

In some embodiments, the to-be-played voice may be a to-be-played voice corresponding to a prompt event called from a pre-made voice package. For example, when the amount of oil is lower than a certain threshold, a prompt event to remind the user to refuel is generated. Based on the prompt event, the voice data with matching content is called from the prefabricated voice package as the voice to be played. In other embodiments, the voice to be played may also be voice data obtained from a background server according to user preferences. In some embodiments, the to-be-played voice may also be a predetermined voice in an existing playing program, which may not be related to the real-time acquired environmental information or user status. The content and obtaining method of the voice to be played above are only examples, and the present disclosure is not limited thereto.

When the voice processed by the determined voice adjustment strategy is played, it sounds like it is given correct emotional feedback, which can achieve a better prompt effect.

Referring further to FIG. 2 , as an implementation of the method shown in FIG. 1 , the present disclosure provides an embodiment of a speech adjustment apparatus, which corresponds to the embodiment of the method shown in FIG. 1 , and the apparatus can be specifically applied to in various electronic devices.

As shown in FIG. 2 , the voice adjustment apparatus 200 provided in this embodiment includes a first acquisition unit 201 configured to acquire environmental information of a vehicle; a second acquisition unit 202 configured to acquire the status of at least one person on the vehicle The determining unit 203 is configured to determine a voice adjustment strategy based on the environment information and the state information; the adjustment unit 204 is configured to adjust parameters of the voice to be played on the vehicle according to the voice adjustment strategy.

In this embodiment, in the voice adjustment apparatus 200: the specific processing of the first acquisition unit 201, the second acquisition unit 202, the determination unit 203, and the adjustment unit 204 and the technical effects brought about by the first acquisition unit 201, the second acquisition unit 202, and the technical effects brought by them may refer to the corresponding embodiment in FIG. 1 respectively. The related descriptions of step 101, step 102, step 103 and step 104 in the above will not be repeated here.

In some optional implementations of this embodiment, the environment information includes at least one of in-vehicle environment information and outside-vehicle environment information, and wherein the outside-vehicle environment information includes road condition information and/or ADAS information .

In some optional implementations of this embodiment, the parameter includes at least one of pitch, speech rate, and intonation.

In some optional implementations of this embodiment, the determining unit 203 may be configured to determine, according to the environmental information, the degree of urgency of the prompting event corresponding to the prompting voice, and to determine the level of urgency of the prompting event corresponding to the prompting voice according to the state information The emotional state of at least one person.

In some optional implementations of this embodiment, in the case that the environment information includes in-vehicle environment information, the first acquiring unit 201 may be configured to acquire the in-vehicle environment by collecting vehicle component state information and wherein, when the environmental information includes road condition information, the first obtaining unit 201 may be configured to obtain the road condition information in at least one of the following manners: obtaining real-time high-precision road condition information through the cloud; or Sensing the vicinity of the vehicle through sensing cameras and/or radar.

In some optional implementation manners of this embodiment, the at least one person on the vehicle includes a driver of the vehicle, and wherein the second acquiring unit 202 may be configured to acquire the information in at least one of the following manners The above state information: collect the facial expression of at least one person on the vehicle through the camera; collect the language of at least one person on the vehicle through the voice receiver; collect the driving action of the driver through the driving action collector; or use the clock The duration of the current driving of the driver is recorded and collected.

In some optional implementations of this embodiment, the determining unit 203 may be further configured to determine a speech adjustment strategy according to a pre-established speech adjustment strategy model, where the speech adjustment strategy model includes the urgency, emotional state And the corresponding relationship of the speech adjustment strategy, the speech adjustment strategy includes the combination of frequency, speed and intonation model curve. The adjusting unit 204 may be configured to adjust the frequency and the speed of the voice to be played according to the combination of the frequency, speed and intonation model curve included in the determined voice adjustment strategy, and adjust the voice to be played accordingly. According to the voice to be played, adjust the intonation model accordingly.

In some optional implementations of this embodiment, the intonation model curve may include a serious intonation model curve with a warning effect, a peaceful intonation model curve with a soothing effect, and a lively intonation model curve with an uplifting effect.

The voice adjustment method and device provided by the embodiments of the present disclosure can process the voice to be played based on the in-vehicle situation, judge the urgency of the situation by using the internal and external vehicle conditions and road conditions, and then determine whether it is necessary to appease the passengers in the vehicle in combination with the emotional state of the driver/passenger in the vehicle. The voice is transposed and processed with variable speed. Under the condition of ensuring the integrity of the same voice image, the voice is given correct emotional feedback, which brings safer driving voice interaction. It can be applied to assisted driving and unmanned driving scenarios.

Referring next to FIG. 3 , a schematic structural diagram of an electronic device 300 suitable for implementing embodiments of the present disclosure is shown. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as in-vehicle terminals (eg, in-vehicle navigation terminals), mobile phones, notebook computers, PADs (tablet computers), and the like. The electronic device shown in FIG. 3 is only an example, and should not impose any limitation on the function and scope of use of the embodiments of the present disclosure.

As shown in FIG. 3, an electronic device 300 may include a processing device (eg, a central processing unit, a graphics processor, etc.) 301 that may be loaded into random access according to a program stored in a read only memory (ROM) 302 or from a storage device 308 Various appropriate actions and processes are executed by the programs in the memory (RAM) 303 . In the RAM 303, various programs and data necessary for the operation of the electronic device 300 are also stored. The processing device 301 , the ROM 302 , and the RAM 303 are connected to each other through a bus 304 . An input/output (I/O) interface 305 is also connected to bus 304 .

Typically, the following devices may be connected to the I/O interface 305: input devices 306 including, for example, a touch screen, touchpad, camera, accelerometer, gyroscope, etc.; including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, etc. The output device 307 ; a storage device 308 including, for example, a flash memory (Flash Card); and a communication device 309 . Communication means 309 may allow electronic device 300 to communicate wirelessly or by wire with other devices to exchange data. While FIG. 3 shows electronic device 300 having various means, it should be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided. Each block shown in FIG. 3 can represent one device, and can also represent multiple devices as needed.

In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network via the communication device 309 , or from the storage device 308 , or from the ROM 302 . When the computer program is executed by the processing apparatus 301, the above-described functions defined in the methods of the embodiments of the present disclosure are executed.

It should be noted that the computer-readable medium described in the embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples of computer readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), fiber optics, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. In embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. Rather, in embodiments of the present disclosure, a computer-readable signal medium may include a data signal in baseband or propagated as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device . The program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: electric wire, optical cable, RF (Radio Frequency, radio frequency), etc., or any suitable combination of the above.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or may exist alone without being assembled into the electronic device. The above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device: acquires the environmental information of the vehicle; acquires the status information of at least one person on the vehicle; Based on the environment information and the state information, a voice adjustment strategy is determined; according to the voice adjustment strategy, parameters of the voice to be played on the vehicle are adjusted.

The above-mentioned voice adjustment device can be a part of an in-vehicle system or an assisted driving system, for example, a part of an advanced assisted driving system ADAS, and can be realized as a function of the system.

Computer program code for carrying out operations of embodiments of the present disclosure may be written in one or more programming languages, including object-oriented programming languages such as Java, Smalltalk, C++, or a combination thereof , but also conventional procedural programming languages - such as "C" or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider to via Internet connection).

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more logical functions for implementing the specified functions executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in dedicated hardware-based systems that perform the specified functions or operations , or can be implemented in a combination of dedicated hardware and computer instructions.

The units involved in the embodiments of the present disclosure may be implemented in software or hardware. The described unit may also be provided in the processor, for example, it may be described as: a processor including a first obtaining unit, a second obtaining unit, a determining unit, and an adjusting unit. Wherein, the names of these units do not constitute a limitation on the unit itself in some cases, for example, the first acquisition unit may also be described as a "unit for acquiring environmental information of a vehicle".

The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solution formed by the specific combination of the above-mentioned technical features, and should also cover, without departing from the above-mentioned inventive concept, the above-mentioned Other technical solutions formed by any combination of technical features or their equivalent features. For example, a technical solution is formed by replacing the above-mentioned features with the technical features disclosed in the embodiments of the present disclosure (but not limited to) with similar functions.

Claims (20)

1. A method of speech conditioning, the method comprising:

acquiring environmental information of a vehicle;

acquiring state information of at least one person on the vehicle;

determining a voice adjustment strategy based on the environmental information and the state information;

and adjusting parameters of the voice to be played on the vehicle according to the voice adjusting strategy.

2. The voice adjustment method according to claim 1, wherein the environmental information includes at least one of in-vehicle environmental information and out-vehicle environmental information, and wherein the out-vehicle environmental information includes road condition information and/or Advanced Driver Assistance System (ADAS) information.

3. The speech adjustment method according to claim 1 or 2, wherein the parameter comprises at least one of pitch, pace and intonation.

4. The speech adjustment method according to claim 1 or 2, wherein the determining a speech adjustment policy based on the context information and the status information comprises:

and judging the emergency degree of a prompt event corresponding to the voice to be played according to the environment information, and judging the emotional state of at least one person on the vehicle according to the state information.

5. The voice adjustment method according to claim 2, wherein the in-vehicle environment information is acquired by collecting vehicle component state information in a case where the environment information includes in-vehicle environment information.

6. The voice adjusting method according to claim 2, wherein, when the environment information includes traffic information, the traffic information is obtained by one of the following methods:

acquiring real-time high-precision road condition information through a cloud; or

And sensing the situation near the vehicle through a sensing camera and/or a radar.

7. The voice adjustment method of claim 1, wherein the at least one person on the vehicle comprises a driver of the vehicle, and wherein the status information is obtained in at least one of:

collecting facial expressions of at least one person on the vehicle through a camera;

collecting, by a voice receiver, a language of at least one person on the vehicle;

collecting the driving action of the driver through a driving action collector; or

And recording and acquiring the duration of the current driving of the driver through a clock.

8. The speech adjustment method of claim 4, wherein the method further comprises: and pre-establishing a voice regulation strategy model, wherein the voice regulation strategy model comprises the corresponding relation of the emergency degree, the emotional state and the voice regulation strategy, and the voice regulation strategy comprises the combination of frequency, speed and a tone model curve.

9. The speech adaptation method of claim 8, wherein the intonation model curves include a serious intonation model curve with warning effect, a peace intonation model curve with soothing effect, and an active intonation model curve with excitement effect.

10. The voice adjustment method according to claim 8 or 9, wherein the adjusting the parameter of the voice to be played on the vehicle according to the voice adjustment strategy comprises:

and correspondingly adjusting the frequency and the speech speed of the voice to be played and correspondingly adjusting the tone model of the voice to be played according to the combination of the frequency, the speed and the tone model curve included in the determined voice adjusting strategy.

11. A voice adjustment apparatus comprising:

a first acquisition unit configured to acquire environmental information of a vehicle;

a second acquisition unit configured to acquire status information of at least one person on the vehicle;

a determining unit configured to determine a voice adjustment policy based on the environment information and the state information;

and the adjusting unit is configured to adjust the parameters of the voice to be played on the vehicle according to the voice adjusting strategy.

12. The voice adjustment device of claim 11, wherein the environmental information includes at least one of in-vehicle environmental information and out-vehicle environmental information, and wherein the out-of-vehicle environmental information includes road condition information and/or ADAS information.

13. The speech adaptation device according to claim 11 or 12, wherein the parameter comprises at least one of pitch, pace and intonation.

14. The speech adjustment device of claim 11 or 12, wherein the determination unit is configured to:

and judging the emergency degree of a prompt event corresponding to the prompt voice according to the environment information, and judging the emotional state of at least one person on the vehicle according to the state information.

15. The voice adjustment device according to claim 12, wherein, in a case where the environmental information includes in-vehicle environmental information, the first acquisition unit is configured to acquire the in-vehicle environmental information by collecting vehicle component state information; and wherein, in case the environment information includes traffic information, the first obtaining unit is configured to obtain the traffic information at least in one of:

acquiring real-time high-precision road condition information through a cloud; or

And sensing the situation near the vehicle through a sensing camera and/or a radar.

16. The voice adjustment apparatus according to claim 11, wherein the at least one person on the vehicle comprises a driver of the vehicle, and wherein the second acquisition unit is configured to acquire the status information at least in one of:

collecting facial expressions of at least one person on the vehicle through a camera;

collecting, by a voice receiver, a language of at least one person on the vehicle;

collecting the driving action of the driver through a driving action collector; or

And recording and acquiring the duration of the current driving of the driver through a clock.

17. The speech adaptation device according to claim 14, wherein the determining unit is configured to determine a speech adaptation strategy according to a pre-established speech adaptation strategy model comprising correspondence of the urgency level, emotional state and speech adaptation strategy, the speech adaptation strategy comprising a combination of frequency, speed and pitch model curves.

18. An electronic device, comprising:

one or more processors;

a storage device having one or more programs stored thereon;

when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-10.

19. An in-vehicle system comprising the electronic device of claim 18.

20. A computer-readable medium, on which a computer program is stored, which program, when being executed by a processor, carries out the method according to any one of claims 1-10.

Images