[go: up one dir, main page]

CN119012095B - An audio optimization system and method for in-car screen projection - Google Patents

An audio optimization system and method for in-car screen projection Download PDF

Info

Publication number
CN119012095B
CN119012095B CN202411465004.7A CN202411465004A CN119012095B CN 119012095 B CN119012095 B CN 119012095B CN 202411465004 A CN202411465004 A CN 202411465004A CN 119012095 B CN119012095 B CN 119012095B
Authority
CN
China
Prior art keywords
car
audio
speaker
vehicle
mobile device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202411465004.7A
Other languages
Chinese (zh)
Other versions
CN119012095A (en
Inventor
冯南阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Rivotek Technology Jiangsu Co Ltd
Original Assignee
Rivotek Technology Jiangsu Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Rivotek Technology Jiangsu Co Ltd filed Critical Rivotek Technology Jiangsu Co Ltd
Priority to CN202411465004.7A priority Critical patent/CN119012095B/en
Publication of CN119012095A publication Critical patent/CN119012095A/en
Application granted granted Critical
Publication of CN119012095B publication Critical patent/CN119012095B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R9/00—Transducers of moving-coil, moving-strip, or moving-wire type
    • H04R9/06—Loudspeakers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R9/00—Transducers of moving-coil, moving-strip, or moving-wire type
    • H04R9/02—Details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2400/00—Loudspeakers
    • H04R2400/11—Aspects regarding the frame of loudspeaker transducers

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

本发明公开了一种用于车内投屏的音频优化系统及方法，涉及音频处理和车载投屏技术领域，包括投屏模块、接口判断模块、功能触发模块、策略执行模块及用户交互模块；通过投屏模块将移动设备与车载显示屏连接，并将音频信号传输至车载扬声器；接口判断模块检测车内扬声器数量及噪声水平，判断是否触发音场补偿，并通过麦克风接口获取音频信息，分析车机扬声器与移动设备扬声器之间的音质相似度；功能触发模块在扬声器数量不足或音质相似度较低时，自动调用移动设备扬声器补偿音场；自适应滤波器和策略匹配引擎，实时调整移动设备与车机扬声器的发声频率和音质。本发明改善了现有车内音质同步性及音效覆盖问题，增强了车内音频的清晰度和稳定性。

The present invention discloses an audio optimization system and method for in-car screen projection, which relates to the technical field of audio processing and in-car screen projection, including a screen projection module, an interface judgment module, a function trigger module, a strategy execution module and a user interaction module; the mobile device is connected to the in-car display screen through the screen projection module, and the audio signal is transmitted to the in-car speaker; the interface judgment module detects the number of speakers in the car and the noise level, determines whether to trigger the sound field compensation, and obtains audio information through the microphone interface, and analyzes the sound quality similarity between the car speaker and the mobile device speaker; the function trigger module automatically calls the mobile device speaker to compensate the sound field when the number of speakers is insufficient or the sound quality similarity is low; the adaptive filter and the strategy matching engine adjust the sound frequency and sound quality of the mobile device and the car speaker in real time. The present invention improves the existing in-car sound quality synchronization and sound effect coverage problems, and enhances the clarity and stability of the in-car audio.

Description

Audio optimization system and method for in-vehicle screen projection
Technical Field
The invention relates to the technical field of audio processing and vehicle-mounted screen projection, in particular to an audio optimization system and method for in-vehicle screen projection.
Background
The existing screen-throwing technology supports that pictures of mobile equipment (such as a mobile phone) are displayed in large-screen equipment such as a vehicle-mounted display screen through screen-throwing protocols such as AirPlay, DLNA, miracast. Users typically transmit audio or video content to speakers in the vehicle for playback via a projection or internet protocol. For example, the mobile phone searches for information of the screen-throwing device in the local area network through a Wi-Fi channel connected to the same local area network, and sends the video address to the vehicle-mounted display screen. And after the display screen receives the video address, starting to play the video content. However, when audio is transmitted to a speaker in a vehicle, a significant problem of sound quality loss generally occurs, and especially in the case of wireless connection, the audio compression results in poor sound quality, and the sound quality effect of direct playing by the local device cannot be achieved. In addition, when the number of speakers in the vehicle is small, the sound field coverage is insufficient, and the audio experience of the user is poor. However, the following drawbacks exist in the prior art:
audio compression loss-audio transmission compression due to wireless connection, the sound quality of the car set speaker is far inferior to the local play of the mobile device.
The number of speakers is limited by the inability to provide an immersive hearing experience when the number of speakers in the vehicle is insufficient.
Sound quality difference, namely, sound emitted by a speaker of the mobile equipment and sound emitted by a speaker of the car machine have the difference in sound quality, and the problem that the difference cannot be effectively solved in the prior art, so that the synchronization and fusion of the audios are difficult.
These problems seriously affect the user's quality experience when using the screen-projecting function in the vehicle, and particularly in the case of a small number of speakers in the vehicle or a poor noise environment, it is difficult to obtain satisfactory sound effects.
Disclosure of Invention
Aiming at the problems of audio compression loss, speaker number limitation, tone quality difference and the like, the invention provides an audio optimization system and method for in-vehicle screen projection. Particularly, the invention introduces the self-adaptive filter and the strategy matching engine, which are used for adjusting the sound production frequency and the sound quality of the mobile equipment and the vehicle loudspeaker in real time, so that the sound quality of the mobile equipment and the sound quality of the vehicle loudspeaker are fused.
In order to achieve the above object, the present invention is realized by the following technical scheme:
The method comprises the steps of adopting a screen projection module, transmitting video content of the mobile device to a vehicle-mounted display screen through AirPlay, DLNA, miracast and other protocols, outputting audio signals through vehicle speakers, detecting the number of the speakers in the vehicle and the noise level through an interface judging module, judging whether to trigger a sound field compensation function, and executing a tuning strategy when the tone quality similarity value reaches a set threshold value.
The self-adaptive filter adjusts sounding frequency of the mobile equipment loudspeaker according to the detected frequency difference value of the mobile equipment loudspeaker and the vehicle-mounted loudspeaker in real time, and ensures synchronism of audio output. And the calculation of the frequency difference value analyzes the difference of different frequency bands through an improved wavelet transformation algorithm, and the dynamic correction is realized by combining an adaptive filter.
And generating a personalized tuning strategy according to the noise level and the number of loudspeakers in the vehicle through a strategy matching engine deployed in the cloud, and issuing the personalized tuning strategy to a vehicle-mounted system and mobile equipment. The user can also manually adjust the sound field compensation mode, the tone quality optimization progress and the personalized audio parameter configuration through the interactive interface.
Threshold number of speakers the system defaults to 4 and when the number of speakers in the vehicle is less than or equal to the threshold, the system automatically triggers the sound field compensation function.
And the tone quality similarity threshold value is set as 0.85 by the system, and when the tone quality similarity between the mobile equipment and the vehicle speaker is lower than the threshold value, the tuning strategy is triggered.
The maximum allowable value of the frequency difference is set to be 200Hz, and when the frequency difference value of the mobile device and the vehicle speaker is detected to exceed the threshold value, the adaptive filter corrects.
An audio optimization system for in-vehicle projection, the system comprising:
the screen throwing module is used for establishing connection between the mobile equipment and the vehicle-mounted display screen through a screen throwing protocol or an interconnection protocol;
the interface judging module is used for detecting the number information of the loudspeakers in the vehicle through the loudspeaker interface of the vehicle and judging whether a sound field compensation function is required to be triggered or not, acquiring the audio information in the vehicle through the microphone interface of the vehicle during the sound field compensation, generating a tone quality similarity value between the mobile equipment loudspeaker and the vehicle loudspeaker and judging whether a tuning strategy is required to be executed or not;
the function triggering module is used for automatically triggering a sound field compensation function when the number of the loudspeakers in the vehicle is smaller than or equal to the threshold value of the number of the loudspeakers, calling the mobile equipment loudspeakers and the vehicle loudspeaker to carry out co-frequency collaborative sounding, and triggering a tuning strategy when the tone quality similarity value is lower than the threshold value of the tone quality similarity;
The strategy execution module is used for generating a tuning strategy according to a preset matching logic, and issuing a command to the mobile equipment end and the vehicle end for adjusting the EQ modes;
And the user interaction module is used for manually selecting a triggering mode of the sound field compensation function, checking the execution progress of the tuning strategy or setting the personalized tuning strategy by a user, and controlling the volume and sound effect modes of the mobile equipment loudspeaker and the car machine loudspeaker.
Preferably, the screen projection module includes:
The video transmission unit is used for transmitting the video content of the mobile equipment to the vehicle-mounted display screen through wireless or wired connection;
and the audio transmission unit is used for transmitting the audio signals in the mobile equipment to the vehicle-mounted loudspeaker.
Preferably, the interface judging module includes:
the audio monitoring unit is used for acquiring an audio signal in the vehicle in real time through a microphone interface of the vehicle, continuously analyzing a sound frequency spectrum in the vehicle, extracting frequency characteristics of environmental noise and judging the noise level in the vehicle;
the voice quality similarity calculation unit is used for calculating a voice quality similarity value between a mobile device loudspeaker and a car machine loudspeaker, and the calculation process is as follows:
step one, inputting audio signal by An audio signal representative of a speaker of the mobile device,Audio signals representing vehicle speakers using short-time Fourier transform STFTAndConverted into frequency domain representations, respectively denoted asAndWherein f represents frequency and t represents time;
Step two, representing from the frequency domain AndRespectively extracting audio signalsAndIs characterized by the fact that, the obtained feature vectors are respectively recorded asAndRepresenting audio feature vectors of the mobile device and the car machine respectively;
step three, adding frequency weight And (3) carrying out weighting treatment, wherein a preliminary tone quality similarity calculation formula is as follows:
Wherein, Representing preliminary tone quality similarity; a characteristic value at frequency f of an audio signal representative of a speaker of the mobile device; A characteristic value of an audio signal representing a speaker of the vehicle at a frequency f;
step four, automatically adjusting the frequency weight according to the user preference or environment through a dynamic adjustment mechanism The dynamic weight adjustment formula is:
wherein α represents a rate parameter controlling weight adjustment; A reference value representing a frequency for dynamically adjusting the weight according to a user preference or an audio environment;
Combining the primary tone quality similarity with subjective tone quality evaluation, balancing by a weight parameter beta, and calculating a perceived tone quality score as a final tone quality similarity value, wherein a calculation formula is as follows:
Wherein, beta represents a weight coefficient; Representing subjective tone quality assessment scores;
step six, scoring according to the final perceived tone quality Judging whether tuning strategy is needed to be executed, if so, sensing tone quality scoreAnd if the tone quality similarity value is lower than the set tone quality similarity value threshold, executing a tuning strategy, otherwise, not executing.
Preferably, the mobile device speaker and the car machine speaker perform co-frequency collaborative sounding, and the implementation process includes:
step 1, audio signal to speaker of mobile device Audio signal of vehicle loudspeakerWindowing is respectively carried out to correspondingly form windowing signalsAndUsing window functionsThe frequency resolution is improved, and the expression is:
Wherein t represents time;
Wavelet transformation is applied to the windowed signal to obtain wavelet coefficients on each frequency band AndThe expression is:
Wherein, Representing windowed signalsOn the scale ofAnd wavelet transform coefficients at position b; Representing windowed signals On the scale ofAnd wavelet transform coefficients at position b; Is a mother wavelet function; B is a time translation parameter, and controls the time resolution;
Analyzing the frequency spectrum difference of the mobile equipment loudspeaker and the vehicle-mounted loudspeaker signals on different scales and time translation to generate a preliminary frequency difference value ;
Step 2, utilizing the adaptive filter to carry out frequency difference valuePerforming optimization adjustment to calculate error signal of filterThe formula is:
Wherein, Is an error signal representing an ideal output signalAnd the actual output signal of the filterDifferences between;
The update formula of the filter coefficients is:
Wherein: the mu is the learning rate, and the step length is controlled and adjusted; is a delay term of the input signal; k denotes the updated filter coefficients;
Step 3, judging sounding synchronization between the mobile equipment speaker and the vehicle-mounted speaker when the optimized frequency difference value is lower than a preset frequency difference threshold value, and if the optimized frequency difference value is greater than the preset frequency difference threshold value, issuing an adjustment instruction through a control system to adjust the synchronous sounding frequency of the mobile equipment speaker and the vehicle-mounted speaker again;
And 4, continuously monitoring the frequency difference between the loudspeaker of the mobile device and the loudspeaker of the car machine in the synchronous sounding process.
Preferably, the slightly executing module includes:
the strategy matching engine is deployed on the cloud server and is used for receiving data from the interface judging module and generating tuning strategies according to preset matching logic;
the instruction execution unit is used for receiving the tuning instruction from the strategy matching engine, converting the tuning instruction into control signals and respectively sending the control signals to the mobile equipment loudspeaker and the car machine loudspeaker.
Preferably, the policy matching engine includes:
The sound quality comparison unit is used for acquiring in-vehicle audio information through the vehicle microphone interface, comparing the audio frequency band of sound production of the vehicle speaker with the audio frequency band of sound production of the mobile device speaker, and generating a frequency band difference value;
And the EQ mode adjusting unit is used for generating a tuning strategy when the frequency band difference value is larger than the frequency band difference threshold value, adjusting EQ modes of the mobile terminal and the vehicle terminal, and adjusting the frequency band to be in the range of 500Hz to 2 KHz.
Preferably, the system further comprises a unified verification module, wherein the unified verification module is used for continuously monitoring the tone quality change through the in-vehicle microphone interface after the adjustment of the EQ mode is completed, if the tone quality similarity value is still lower than the tone quality similarity threshold value, the unified verification module feeds back the tone quality similarity value to the server, the server issues an adjustment instruction again, and the tuning strategy is repeated until the tone quality similarity reaches a preset standard.
Preferably, the user interaction module includes:
the sound field compensation control module is used for manually selecting whether to start the collaborative sounding function of the mobile device loudspeaker and the car machine loudspeaker;
and the tone quality optimization progress display module is used for displaying the execution progress and the result of the tuning strategy in real time.
An audio optimization method for an in-vehicle projection audio optimization system, the method comprising:
The mobile equipment is connected with the vehicle-mounted display screen through a screen throwing protocol or an interconnection protocol, and audio signals of the mobile equipment are transmitted to a vehicle speaker;
detecting the number information of the loudspeakers in the vehicle through a vehicle-mounted loudspeaker interface, judging whether the number of the loudspeakers in the vehicle is smaller than or equal to a loudspeaker number threshold value, if yes, triggering a sound field compensation function, and if not, triggering;
acquiring audio signals of a mobile device loudspeaker and a vehicle speaker in real time, calculating a frequency difference value, correcting the frequency difference by using a self-adaptive filter, and when the corrected frequency difference value is smaller than a preset frequency difference threshold value, enabling the vehicle speaker and the mobile device loudspeaker to reach the same-frequency sounding standard;
in the sound field compensation process, acquiring in-car audio information through a microphone interface of a car machine, calculating a tone quality similarity value of a mobile equipment loudspeaker and a car machine loudspeaker, and triggering a tuning strategy when the tone quality similarity value is lower than a tone quality similarity threshold value;
A strategy matching engine is deployed on a cloud server, in-vehicle audio information is obtained through a vehicle-to-vehicle microphone interface, and an audio frequency band of sound production of a vehicle-to-vehicle speaker is compared with an audio frequency band of sound production of a mobile device speaker to generate a frequency band difference value;
After the EQ mode is adjusted, continuously monitoring the tone quality similarity value through the in-vehicle microphone interface, and if the tone quality similarity value is still lower than the tone quality similarity threshold value, feeding back to the cloud server, and repeating the tuning strategy until the tone quality similarity reaches a preset standard.
Preferably, the method further comprises an audio optimization step based on a user preset configuration, the step comprising:
the user inputs personalized audio parameter configuration through a user interaction interface, wherein the configuration comprises volume adjustment, EQ frequency band adjustment and audio delay control;
the vehicle-mounted system adjusts the audio output of the mobile equipment loudspeaker and the vehicle-mounted loudspeaker in real time according to the personalized configuration input by the user;
when the noise change in the environment in the vehicle exceeds a preset noise threshold, the system automatically adjusts the volume or the audio frequency band.
Compared with the prior art, the method has the beneficial effects that the self-adaptive filter and the frequency difference calculation unit are introduced, so that the audio signals of the vehicle speaker and the mobile device speaker can be obtained in real time, the audio frequency difference between the two is analyzed, the sounding frequency is dynamically adjusted, and the synchronous sounding of the speaker reaches the standard, thereby improving the problem of the dyssynchrony of the tone quality between the mobile device speaker and the vehicle speaker, and remarkably improving the synchronism and the overall listening feeling of the audio in the vehicle. When the system detects that the number of the loudspeakers in the vehicle is insufficient, the sound field compensation function is automatically triggered, the mobile equipment loudspeakers and the vehicle machine loudspeakers are called to cooperatively perform the same-frequency sounding, the coverage range of the sound effect in the vehicle is enhanced, the problem of insufficient sound field coverage caused by the small number of the loudspeakers in the vehicle is solved, and the hearing experience of a user is improved. The system monitors the noise in the vehicle in real time through the microphone interface of the vehicle and automatically adjusts the volume and EQ mode of the mobile equipment and the speaker of the vehicle according to the noise level change, so that the passengers can always obtain clear and stable audio output in different noise environments, and the problem of poor tone quality performance in the complex noise environment in the prior art is solved. The user can also manually select the triggering mode of the sound field compensation function through the interactive interface, and set personalized audio parameters such as volume, EQ frequency band and the like so as to meet personalized requirements. Through the strategy matching engine deployed by the cloud, the system can generate and issue tuning strategies according to the noise level and the number of speakers in the vehicle, so that the automatic fusion of the sound quality of the speakers of the mobile equipment and the speakers of the vehicle is realized, and the sound quality performance is further improved. The system combines the real-time audio signal analysis technology and the intelligent tuning function of the strategy matching engine, automatically optimizes the tone quality output, improves the definition of tone quality, the balance of sound effect and the stability of sound field, and adapts to various driving scenes.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art. Wherein:
FIG. 1 is a schematic diagram of a system modular structure of the present invention, FIG. 2 is a schematic diagram of a workflow of an adaptive filter of the present invention, and FIG. 3 is a schematic diagram of a sound field compensation function of the present invention;
fig. 4 is a schematic flow chart of the EQ mode adjustment according to the present invention, and fig. 5 is a schematic flow chart of the method according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention more clear, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. It will be apparent that the described embodiments are some, but not all, embodiments of the invention. All other embodiments, which are obtained by a person skilled in the art based on the described embodiments of the invention, fall within the scope of protection of the invention.
Example 1
As shown in fig. 1, an embodiment of the present invention provides an audio optimization system for in-vehicle projection, including:
the screen projection module is used for establishing connection between the mobile equipment and the vehicle-mounted display screen through a screen projection protocol or an interconnection protocol (such as AirPlay, DLNA, miracast and the like);
The mobile equipment is connected with the vehicle-mounted display screen through an AirPlay protocol, a DLNA protocol or a Miracast protocol, video content is transmitted to the vehicle-mounted display screen through wireless, and audio signals are output through a vehicle speaker. When the audio signal is transmitted, the system transmits and synchronizes the audio signal in the mobile device and the audio signal of the car audio loudspeaker in real time through the audio transmission unit.
Specifically, the screen projection module comprises:
The video transmission unit is used for transmitting the video content of the mobile equipment to the vehicle-mounted display screen through wireless or wired connection;
and the audio transmission unit is used for transmitting the audio signals in the mobile equipment to the vehicle-mounted loudspeaker.
Further, as shown in fig. 2 and 3, the method is used for detecting the number information of the speakers in the vehicle through the speaker interface of the vehicle to judge whether the sound field compensation function is required to be triggered, acquiring the audio information in the vehicle through the microphone interface of the vehicle during the sound field compensation, generating a tone quality similarity value between the speaker of the mobile device and the speaker of the vehicle, and judging whether the tuning strategy is required to be executed;
The system detects the number of loudspeakers and the noise level in the vehicle in real time through the vehicle microphone interface. And generating a noise frequency characteristic value through analysis of the noise frequency spectrum, and comparing the noise frequency characteristic value with a preset noise threshold value. When the noise level exceeds a threshold and the number of speakers in the vehicle is less than the speaker number threshold, the system activates a sound field compensation function.
Specifically, the interface judging module includes:
the audio monitoring unit is used for acquiring an audio signal in the vehicle in real time through a microphone interface of the vehicle, continuously analyzing a sound frequency spectrum in the vehicle, extracting frequency characteristics of environmental noise and judging the noise level in the vehicle;
the voice quality similarity calculation unit is used for calculating a voice quality similarity value between a mobile device loudspeaker and a car machine loudspeaker, and the calculation process is as follows:
step one, inputting audio signal by An audio signal representative of a speaker of the mobile device,Audio signals representing vehicle speakers using short-time Fourier transform STFTAndConverted into frequency domain representations, respectively denoted asAndWherein f represents frequency and t represents time;
Step two, representing from the frequency domain AndRespectively extracting audio signalsAndIs characterized by the fact that, the obtained feature vectors are respectively recorded asAndRepresenting audio feature vectors of the mobile device and the car machine respectively;
step three, adding frequency weight And (3) carrying out weighting treatment, wherein a preliminary tone quality similarity calculation formula is as follows:
Wherein, Representing preliminary tone quality similarity; a characteristic value at frequency f of an audio signal representative of a speaker of the mobile device; A characteristic value of an audio signal representing a speaker of the vehicle at a frequency f;
step four, automatically adjusting the frequency weight according to the user preference or environment through a dynamic adjustment mechanism The dynamic weight adjustment formula is:
wherein α represents a rate parameter controlling weight adjustment; A reference value representing a frequency for dynamically adjusting the weight according to a user preference or an audio environment;
Combining the primary tone quality similarity with subjective tone quality evaluation, balancing by a weight parameter beta, and calculating a perceived tone quality score as a final tone quality similarity value, wherein a calculation formula is as follows:
Wherein, beta represents a weight coefficient; Representing subjective tone quality assessment scores;
step six, scoring according to the final perceived tone quality Judging whether tuning strategy is needed to be executed, if so, sensing tone quality scoreAnd if the tone quality similarity value is lower than the set tone quality similarity value threshold, executing a tuning strategy, otherwise, not executing.
In a vehicle voice recognition system, an interface judgment module plays a crucial role. The module realizes detection and processing of sound signals in the vehicle by acquiring two key interfaces of the vehicle machine end, namely a loudspeaker interface and a microphone interface. Specifically, the interface judging module firstly obtains the number information of the speakers in the vehicle through the speaker interface. When the number of the speakers in the vehicle is detected to be less than or equal to 6, the module can trigger a sound field compensation function so as to improve the audio effect in the vehicle.
Meanwhile, the interface judging module also acquires sound quality information in the vehicle through the microphone interface. In order to evaluate the similarity between the sounds of the mobile phone side and the vehicle side, the module introduces a concept of a similarity value and initializes it to 1. During the sound field compensation, the module continuously monitors the change of the similarity value. When the similarity value is larger than 0.5, the module defaults that the similarity between the sound production of the mobile phone end and the sound production of the vehicle end is high, so that additional optimization operation is not needed. However, when the similarity value is less than or equal to 0.5, the module may determine that there is a large difference between the sounds of the mobile phone end and the car phone end, so as to trigger a tuning strategy to further optimize the audio in the car.
In addition, the interface judging module also acquires an audio signal in the vehicle in real time through a microphone interface of the vehicle and judges the noise level in the vehicle. The unit can continuously analyze the sound frequency spectrum in the car, extract the frequency characteristic of environmental noise, and the audio adjusting unit is responsible for triggering the volume adjusting function to match the volumes of the mobile equipment loudspeaker and the car machine loudspeaker, so that passengers can still clearly hear audio output in a high-noise environment.
Further, the function triggering module is used for automatically triggering a sound field compensation function when the number of the loudspeakers in the vehicle is smaller than or equal to the threshold value of the number of the loudspeakers, calling the mobile equipment loudspeakers to perform co-frequency collaborative sounding with the vehicle speakers, and triggering a tuning strategy when the tone quality similarity value is lower than the threshold value of the tone quality similarity;
Specifically, the mobile device speaker and the car machine speaker carry out co-frequency collaborative sounding, and the implementation process comprises the following steps:
step 1, audio signal to speaker of mobile device Audio signal of vehicle loudspeakerWindowing is respectively carried out to correspondingly form windowing signalsAndUsing window functionsThe frequency resolution is improved, and the expression is:
Wherein t represents time;
Wavelet transformation is applied to the windowed signal to obtain wavelet coefficients on each frequency band AndThe expression is:
Wherein, Representing windowed signalsOn the scale ofAnd wavelet transform coefficients at position b; Representing windowed signals On the scale ofAnd wavelet transform coefficients at position b; Is a mother wavelet function; B is a time translation parameter, and controls the time resolution;
Analyzing the frequency spectrum difference of the mobile equipment loudspeaker and the vehicle-mounted loudspeaker signals on different scales and time translation to generate a preliminary frequency difference value ;
Step 2, utilizing the adaptive filter to carry out frequency difference valuePerforming optimization adjustment to calculate error signal of filterThe formula is:
Wherein, Is an error signal representing an ideal output signalAnd the actual output signal of the filterDifferences between;
The update formula of the filter coefficients is:
Wherein: the mu is the learning rate, and the step length is controlled and adjusted; is a delay term of the input signal; k denotes the updated filter coefficients;
Step 3, judging sounding synchronization between the mobile equipment speaker and the vehicle-mounted speaker when the optimized frequency difference value is lower than a preset frequency difference threshold value, and if the optimized frequency difference value is greater than the preset frequency difference threshold value, issuing an adjustment instruction through a control system to adjust the synchronous sounding frequency of the mobile equipment speaker and the vehicle-mounted speaker again;
And 4, continuously monitoring the frequency difference between the loudspeaker of the mobile device and the loudspeaker of the car machine in the synchronous sounding process.
Further, the strategy execution module is used for generating a tuning strategy according to a preset matching logic, and issuing a command to the mobile equipment end and the vehicle end for adjusting the EQ mode;
When the tone quality similarity value is detected to be lower than 0.85, the strategy matching engine generates a personalized tuning strategy on the cloud server, and the command is sent to the mobile equipment and the car machine system. The system adjusts the EQ mode of the speaker according to the generated tuning strategy, with the audio output range set between 500Hz and 2 KHz. The user can check the tuning progress through the interactive interface and manually adjust the tone quality parameters.
Specifically, as shown in fig. 4, the policy enforcement module includes:
the policy enforcement module includes:
the strategy matching engine is deployed on the cloud server and is used for receiving data from the interface judging module and generating tuning strategies according to preset matching logic;
the instruction execution unit is used for receiving the tuning instruction from the strategy matching engine, converting the tuning instruction into control signals and respectively sending the control signals to the mobile equipment loudspeaker and the car machine loudspeaker.
Specifically, the policy matching engine includes:
The sound quality comparison unit is used for acquiring in-vehicle audio information through the vehicle microphone interface, comparing the audio frequency band of sound production of the vehicle speaker with the audio frequency band of sound production of the mobile device speaker, and generating a frequency band difference value;
And the EQ mode adjusting unit is used for generating a tuning strategy when the frequency band difference value is larger than the frequency band difference threshold value, adjusting EQ modes of the mobile terminal and the vehicle terminal, and adjusting the frequency band to be in the range of 500Hz to 2 KHz.
The system further comprises a unified verification module, wherein the unified verification module is used for continuously monitoring tone quality change through the in-vehicle microphone interface after the EQ mode is adjusted, if the tone quality similarity value is still lower than a tone quality similarity threshold value, the unified verification module feeds back the tone quality similarity value to the server, the server issues an adjustment instruction again, and the tuning strategy is repeated until the tone quality similarity reaches a preset standard.
Further, the user interaction module includes:
the sound field compensation control module is used for manually selecting whether to start the collaborative sounding function of the mobile device loudspeaker and the car machine loudspeaker;
and the tone quality optimization progress display module is used for displaying the execution progress and the result of the tuning strategy in real time.
Example 2
As shown in fig. 5, an embodiment of the present invention provides an audio optimization method for an audio optimization system for in-vehicle projection, including:
Step S1, establishing connection between mobile equipment and a vehicle-mounted display screen through a screen throwing protocol or an interconnection protocol, and transmitting audio signals of the mobile equipment to a vehicle speaker;
S2, detecting the number information of the loudspeakers in the vehicle through a vehicle-mounted loudspeaker interface, judging whether the number of the loudspeakers in the vehicle is smaller than or equal to a loudspeaker number threshold value, if yes, triggering a sound field compensation function, otherwise, not triggering;
S3, audio signals of a mobile device loudspeaker and a vehicle-mounted loudspeaker are obtained in real time, a frequency difference value is calculated, a self-adaptive filter is utilized to correct the frequency difference, and when the corrected frequency difference value is smaller than a preset frequency difference threshold value, the vehicle-mounted loudspeaker and the mobile device loudspeaker reach the same-frequency sounding standard;
S4, acquiring in-car audio information through a microphone interface of the car machine in the sound field compensation process, calculating a tone quality similarity value of a mobile equipment loudspeaker and the car machine loudspeaker, and triggering a tuning strategy when the tone quality similarity value is lower than a tone quality similarity threshold value;
Step 5, a strategy matching engine is deployed on a cloud server, in-vehicle audio information is obtained through a vehicle microphone interface, an audio frequency band of sound production of a vehicle speaker is compared with an audio frequency band of sound production of a mobile device speaker to generate a frequency band difference value, when the frequency band difference value is larger than a frequency band difference threshold value, tuning strategies are generated, instructions are respectively sent to the mobile device and the vehicle, adjustment of EQ modes of a mobile terminal and a vehicle terminal is carried out, and audio output is optimized;
And S6, continuously monitoring the tone quality similarity value through the in-vehicle microphone interface after the EQ mode is adjusted, and if the tone quality similarity value is still lower than the tone quality similarity threshold value, feeding back to the cloud server, and repeating the tuning strategy until the tone quality similarity reaches a preset standard.
Further comprising an audio optimization step based on a user preset configuration, the step comprising:
the user inputs personalized audio parameter configuration through a user interaction interface, wherein the configuration comprises volume adjustment, EQ frequency band adjustment and audio delay control;
the vehicle-mounted system adjusts the audio output of the mobile equipment loudspeaker and the vehicle-mounted loudspeaker in real time according to the personalized configuration input by the user;
when the noise change in the environment in the vehicle exceeds a preset noise threshold, the system automatically adjusts the volume or the audio frequency band.
Example 3
The embodiment introduces audio optimization use scenes after in-vehicle screen projection or interconnection, and the audio optimization use scenes are mainly divided into the following two types:
and (3) an automatic audio tuning scene, namely after screen projection or interconnection is carried out in the automobile, for example, a user plays music or watches a film, the system recognizes the current audio effect through a loudspeaker in the automobile, and audio tuning is automatically executed according to the requirement.
The specific operation steps are as follows:
the user connects the mobile phone with the vehicle-mounted display screen through a screen-throwing protocol, and the system starts to play the audio content on the mobile device.
The system monitors the audio output in the vehicle in real time through the vehicle microphone interface and evaluates the sound quality effect of the current speaker in the vehicle.
If the audio output effect is detected to be insufficient, the system triggers a tone quality optimization function and automatically adjusts the collaborative sounding frequency of the vehicle speaker and the mobile phone speaker so as to achieve a better tone quality effect.
And the sound field compensation scene is that when the number of the loudspeakers in the vehicle is insufficient, the system supplements the sound field through the loudspeakers of the mobile phone so as to improve the overall sound effect experience.
The specific operation steps are as follows:
After the user throws the screen or interconnects, because the speaker quantity is less in the car, lead to the sound field coverage not enough.
After the system detects that the number of the speakers in the vehicle is lower than a preset threshold, the mobile phone speakers are automatically called to serve as volume compensators, and the speakers of the vehicle are cooperated to produce sound, so that the sound effect in the vehicle is enhanced.
The audio output is adjusted through the cloud server, so that the tone quality between the mobile phone loudspeaker and the car phone loudspeaker is fused, and the user is ensured to obtain more immersed audio experience in the car.
Example 4
In this embodiment, the system controls the EQ modes of the mobile device and the vehicle-mounted device through the server, and performs frequency band comparison and adjustment on the audio sent by the mobile device and the vehicle-mounted device, so as to ensure that the similarity of sound quality meets the preset standard.
The method comprises the following specific steps:
And the system automatically triggers the loudspeaker of the mobile equipment to cooperate with the loudspeaker of the car machine to output the audio when the loudspeaker in the car environment is insufficient or the sound field is not completely covered.
Audio signals sent by a vehicle speaker and a mobile device speaker are collected through a microphone interface in the vehicle, and the signals are transmitted to a server for processing through different delays.
The frequency band setting and analyzing server divides the received audio signal into two main frequency bands, which are named frequency band m and frequency band n respectively.
Frequency band m and frequency band n represent the dominant frequency ranges of the audio signals of the car speaker and the mobile device speaker, respectively.
And in the frequency band comparison process, the server side can place the two frequency bands in the same comparison area, and the system can analyze the tone quality difference of the two frequency bands in real time.
When the system detects that the difference value of the two frequency bands reaches 0.5 or more, the system automatically triggers the EQ mode adjustment strategy. The specific adjustment step comprises the step of adjusting weights of different frequencies in two frequency bands, so that sound production of the two frequency bands in the same audio frequency range is ensured to have similar tone quality characteristics.
EQ mode adjustment:
the system adjusts the EQ modes of the mobile equipment loudspeaker and the car machine loudspeaker according to the optimizing strategy of the service end, and adjusts the main range of the audio frequency band to be between 500Hz and 2 KHz.
The adjusted EQ mode ensures that the tone quality difference of two frequency bands is reduced, and similar or identical sound effects are finally achieved, so that the sound heard by the user has no obvious cracking sense between the interior of the vehicle and the sound production of the loudspeaker of the mobile equipment.
Feedback mechanism:
After the EQ mode adjustment is completed, the system continuously monitors the similarity of the audio signals through a microphone interface of the vehicle. If the similarity is still lower than the preset tone quality similarity threshold, the system triggers the audio tuning process again until the two meet the requirement of tone quality similarity.
In summary, the invention provides an audio optimization system and method for in-vehicle screen projection, which can effectively detect the number of speakers and the level of environmental noise in a vehicle and trigger sound field compensation and audio optimization strategies according to the similarity of sound quality through the cooperative work of a screen projection module, an interface judgment module, a function triggering module and a strategy execution module. Particularly, the invention introduces the self-adaptive filter and the cloud policy matching engine, thereby realizing the frequency difference correction and the real-time EQ mode adjustment between the vehicle speaker and the mobile device speaker and ensuring the stability and the synchronism of the tone quality in a complex environment. In addition, the user can customize the audio parameters through the interactive interface, so that the personalized audio experience is further improved. The invention solves the problems of poor tone quality synchronization, insufficient sound effect coverage, noise interference and the like in the prior art, is suitable for various vehicle-mounted audio systems, and effectively improves the overall quality and user experience of audio playing in a vehicle.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction.
Any process or method description in a flowchart or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process. And the scope of the preferred embodiments of the present application includes additional implementations in which functions may be performed in a substantially simultaneous manner or in an opposite order from that shown or discussed, including in accordance with the functions that are involved.
The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that various changes and substitutions are possible within the scope of the present application. Therefore, the protection scope of the application is subject to the protection scope of the claims.

Claims (9)

1.一种用于车内投屏的音频优化系统，其特征在于，所述系统包括：1. An audio optimization system for in-car screen projection, characterized in that the system comprises: 投屏模块，用于通过投屏协议或互联协议将移动设备与车载显示屏建立连接；A screen projection module is used to establish a connection between a mobile device and a vehicle-mounted display screen through a screen projection protocol or an interconnection protocol; 接口判断模块，用于通过车机扬声器接口检测车内扬声器的数量信息，判断是否需要触发音场补偿功能；并在音场补偿期间，通过车机的麦克风接口获取车内音频信息，生成移动设备扬声器与车机扬声器之间的音质相似度值，判断是否需要执行调音策略；The interface judgment module is used to detect the number of speakers in the car through the car speaker interface to determine whether the sound field compensation function needs to be triggered; and during the sound field compensation, the audio information in the car is obtained through the microphone interface of the car, and the sound quality similarity value between the mobile device speaker and the car speaker is generated to determine whether the tuning strategy needs to be executed; 所述接口判断模块包括：The interface judgment module includes: 音频监测单元，用于通过车机的麦克风接口实时获取车内的音频信号，持续对车内的声音频谱进行分析，提取环境噪声的频率特征，判断车内环境噪声水平；The audio monitoring unit is used to obtain the audio signal in the car in real time through the microphone interface of the car computer, continuously analyze the sound spectrum in the car, extract the frequency characteristics of the ambient noise, and determine the ambient noise level in the car; 音质相似度计算单元，用于计算移动设备扬声器与车机扬声器之间的音质相似度值，计算过程如下：The sound quality similarity calculation unit is used to calculate the sound quality similarity value between the mobile device speaker and the vehicle head unit speaker. The calculation process is as follows: 步骤一：输入音频信号，用Xm(t)代表移动设备扬声器的音频信号，Xc(t)代表车机扬声器的音频信号；使用短时傅里叶变换STFT将Xm(t)和Xc(t)转换为频域表示，分别记作Fm(f,t)和Fc(f,t)，其中f代表频率，t代表时间；Step 1: Input audio signal, with Xm (t) representing the audio signal of the mobile device speaker and Xc (t) representing the audio signal of the car speaker; use short-time Fourier transform (STFT) to convert Xm (t) and Xc (t) into frequency domain representation, denoted as Fm (f,t) and Fc (f,t), respectively, where f represents frequency and t represents time; 步骤二：从频域表示Fm(f,t)和Fc(f,t)中分别提取音频信号Xm(t)和Xc(t)的频谱特征，得到特征向量，分别记作hm(f)和hc(f)，分别代表移动设备和车机的音频特征向量；Step 2: Extract the spectral features of the audio signals X m (t) and X c (t) from the frequency domain representations F m (f, t) and F c (f, t) respectively to obtain feature vectors, which are denoted as h m (f) and h c (f), representing the audio feature vectors of the mobile device and the vehicle head unit, respectively; 步骤三：加入频率权重w(f)进行加权处理，初步音质相似度计算公式为：Step 3: Add frequency weight w(f) for weighted processing. The preliminary sound quality similarity calculation formula is: 其中，Similarityimproved代表初步音质相似度；hm(f)代表移动设备扬声器的音频信号在频率f上的特征值；hc(f)代表车机扬声器的音频信号在频率f上的特征值；Wherein, Similarity improved represents the preliminary sound quality similarity; h m (f) represents the characteristic value of the audio signal of the mobile device speaker at the frequency f; h c (f) represents the characteristic value of the audio signal of the car speaker at the frequency f; 步骤四：根据用户偏好或环境自动调整频率权重w(f)，动态权重调整公式为：Step 4: Automatically adjust the frequency weight w(f) according to user preference or environment. The dynamic weight adjustment formula is: 其中，α代表控制权重调整的速率参数；f0代表频率的参考值，用于根据用户偏好或音频环境动态调整权重；Where α represents the rate parameter that controls the weight adjustment; f0 represents the reference value of the frequency, which is used to dynamically adjust the weight according to user preference or audio environment; 步骤五：将初步音质相似度和主观音质评价结合，通过权重参数β来平衡，计算感知音质得分作为最终的音质相似度值，计算公式为：Step 5: Combine the preliminary sound quality similarity and the subjective sound quality evaluation, balance them through the weight parameter β, and calculate the perceived sound quality score as the final sound quality similarity value. The calculation formula is: Perceptual Score＝β*Similarityimproved+(1-β)*Subjective QualityPerceptual Score＝β*Similarity improved +(1-β)*Subjective Quality 其中，β代表权重系数；Subjective Quality代表主观音质评估得分；Among them, β represents the weight coefficient; Subjective Quality represents the subjective sound quality evaluation score; 步骤六：根据最终的感知音质得分Perceptual Score，判断是否需要执行调音策略，若感知音质得分Perceptual Score低于设定的音质相似度值阈值，则需要执行调音策略，否则不执行；Step 6: According to the final perceived sound quality score Perceptual Score, determine whether to execute the tuning strategy. If the perceived sound quality score Perceptual Score is lower than the set sound quality similarity value threshold, the tuning strategy needs to be executed, otherwise it is not executed; 功能触发模块，用于车内扬声器数量小于或等于扬声器数量阈值时自动触发音场补偿功能，调用移动设备扬声器与车机扬声器进行同频协同发声，并在所述音质相似度值低于音质相似度阈值时触发调音策略；A function trigger module, used to automatically trigger the sound field compensation function when the number of speakers in the car is less than or equal to the speaker number threshold, call the mobile device speaker and the car machine speaker to perform co-frequency coordinated sound, and trigger the tuning strategy when the sound quality similarity value is lower than the sound quality similarity threshold; 策略执行模块，用于根据预设的匹配逻辑生成调音策略，并下发指令给移动设备端与车机端两端进行EQ模式的调整；The strategy execution module is used to generate a tuning strategy according to the preset matching logic, and send instructions to the mobile device and the vehicle computer to adjust the EQ mode; 用户交互模块，用于用户手动选择音场补偿功能的触发模式、查看调音策略执行进度或设置个性化的调音策略，并控制移动设备扬声器和车机扬声器的音量及音效模式。The user interaction module is used for the user to manually select the trigger mode of the sound field compensation function, view the execution progress of the tuning strategy or set a personalized tuning strategy, and control the volume and sound effect mode of the mobile device speakers and the car speakers. 2.根据权利要求1所述的用于车内投屏的音频优化系统，其特征在于，所述投屏模块包括：2. The audio optimization system for in-car screen projection according to claim 1, characterized in that the screen projection module comprises: 视频传输单元，用于将移动设备的视频内容通过无线或有线连接传输至车载显示屏；A video transmission unit, used to transmit the video content of the mobile device to the vehicle display screen via wireless or wired connection; 音频传输单元，用于将移动设备中的音频信号传输至车载扬声器。The audio transmission unit is used to transmit the audio signal from the mobile device to the vehicle speakers. 3.根据权利要求1所述的用于车内投屏的音频优化系统，其特征在于，所述移动设备扬声器与车机扬声器进行同频协同发声，实现过程包括：3. The audio optimization system for in-car screen projection according to claim 1 is characterized in that the mobile device speaker and the car machine speaker perform the same frequency coordinated sound, and the implementation process includes: 步骤1：对移动设备扬声器的音频信号Xm(t)和车机扬声器的音频信号Xc(t)分别进行加窗处理，对应形成加窗信号x1(t)和x2(t)，利用窗函数w(t)提高频率分辨率，表达式为：Step 1: Perform windowing on the audio signal Xm (t) of the mobile device speaker and the audio signal Xc (t) of the vehicle head unit speaker to form windowed signals x1 (t) and x2 (t) respectively. Use the window function w(t) to improve the frequency resolution. The expression is: x1(t)＝Xm(t)*w(t)，x2(t)＝Xc(t)*w(t)x 1 (t) = X m (t) * w (t), x 2 (t) = X c (t) * w (t) 其中，t代表时间；Where t represents time; 对加窗信号应用小波变换，得到各个频段上的小波系数Wx1(a,b)和Wx2(a,b)，表达式为：Apply wavelet transform to the windowed signal to obtain the wavelet coefficients Wx 1 (a, b) and Wx 2 (a, b) in each frequency band, expressed as: 其中，Wx1(a,b)表示加窗信号x1(t)在尺度a和位置b上的小波变换系数；Wx2(a,b)表示加窗信号x2(t)在尺度a和位置b上的小波变换系数；ψ是母小波函数；a是尺度参数，控制信号在频域的分辨率；b是时间平移参数，控制时间分辨率；Wherein, Wx 1 (a, b) represents the wavelet transform coefficient of the windowed signal x 1 (t) at scale a and position b; Wx 2 (a, b) represents the wavelet transform coefficient of the windowed signal x 2 (t) at scale a and position b; ψ is the mother wavelet function; a is the scale parameter, which controls the resolution of the signal in the frequency domain; b is the time shift parameter, which controls the time resolution; 分析移动设备扬声器与车机扬声器信号在不同尺度和时间平移上的频谱差异，生成初步的频率差异值Δf1；步骤2：利用自适应滤波器对频率差异值Δf1进行优化调整，计算滤波器的误差信号e(n)，公式为：Analyze the spectrum differences between the mobile device speaker and the vehicle speaker signals at different scales and time shifts to generate a preliminary frequency difference value Δf 1 ; Step 2: Use an adaptive filter to optimize and adjust the frequency difference value Δf 1 and calculate the filter error signal e(n), the formula is: e(n)＝d(n)-y(n)e(n)＝d(n)-y(n) 其中，e(n)为误差信号，表示理想输出信号d(n)与滤波器实际输出信号y(n)之间的差异；Where e(n) is the error signal, which represents the difference between the ideal output signal d(n) and the actual output signal y(n) of the filter; 滤波器系数的更新公式为：The update formula of the filter coefficient is: hn+1(k)＝hn(k)+μ*e(n)*x(n-k)h n+1 (k)＝h n (k)+μ*e(n)*x(nk) 其中：hn(k)表示滤波器在第n次迭代时的系数；μ为学习率，控制调整步长；x(n-k)是输入信号的延迟项；k表示更新滤波器系数；Where: h n (k) represents the coefficient of the filter at the nth iteration; μ is the learning rate, which controls the adjustment step size; x(nk) is the delay term of the input signal; k represents the updated filter coefficient; 步骤3：当优化后的频率差异值低于预设的频率差异阈值时，判定移动设备扬声器与车机扬声器之间的发声同步；若优化后的频率差异值大于预设的频率差异阈值，则通过控制系统下发调整指令，再次调整移动设备扬声器与车机扬声器的同步发声频率；Step 3: When the optimized frequency difference value is lower than the preset frequency difference threshold, the sound synchronization between the mobile device speaker and the vehicle headphone speaker is determined; if the optimized frequency difference value is greater than the preset frequency difference threshold, an adjustment instruction is issued through the control system to adjust the synchronous sound frequency between the mobile device speaker and the vehicle headphone speaker again; 步骤4：在同步发声过程中，持续监测移动设备扬声器与车机扬声器的频率差异。Step 4: During the synchronous sounding process, continuously monitor the frequency difference between the mobile device speaker and the vehicle headphone speaker. 4.根据权利要求1所述的用于车内投屏的音频优化系统，其特征在于，所述策略执行模块包括：4. The audio optimization system for in-car screen projection according to claim 1, characterized in that the strategy execution module comprises: 策略匹配引擎，所述策略匹配引擎部署在云端服务器上，用于接收来自接口判断模块的数据，并根据预设的匹配逻辑生成调音策略；A strategy matching engine, which is deployed on a cloud server and is used to receive data from the interface judgment module and generate a tuning strategy according to a preset matching logic; 指令执行单元，用于接收来自策略匹配引擎的调优指令，并将其转化为控制信号，分别发送给移动设备扬声器和车机扬声器。The instruction execution unit is used to receive the tuning instructions from the strategy matching engine and convert them into control signals, which are sent to the mobile device speaker and the vehicle headphone speaker respectively. 5.根据权利要求4所述的用于车内投屏的音频优化系统，其特征在于，所述策略匹配引擎包括：5. The audio optimization system for in-car screen projection according to claim 4, characterized in that the strategy matching engine comprises: 音质比对单元，用于通过车机麦克风接口获取车内音频信息，将车机扬声器发声的音频频段与移动设备扬声器发声的音频频段进行比对，生成频段差异值；The sound quality comparison unit is used to obtain the in-vehicle audio information through the vehicle microphone interface, compare the audio frequency band of the vehicle speaker with the audio frequency band of the mobile device speaker, and generate a frequency band difference value; EQ模式调整单元，用于当频段差异值大于频段差异阈值时，生成调音策略，调节移动端和车机端的EQ模式，将频段调整到500Hz至2KHz范围内。The EQ mode adjustment unit is used to generate a tuning strategy when the frequency band difference value is greater than the frequency band difference threshold, adjust the EQ mode of the mobile terminal and the vehicle terminal, and adjust the frequency band to the range of 500Hz to 2KHz. 6.根据权利要求1所述的用于车内投屏的音频优化系统，其特征在于，所述系统还包括统一验证模块，用于在EQ模式调整完成后，通过车内麦克风接口持续监测音质变化，若音质相似度值仍然低于音质相似度阈值，统一验证模块将反馈给服务端，服务端再次下发调整指令，重复调音策略，直至音质相似度达到预设标准。6. According to claim 1, the audio optimization system for in-car screen projection is characterized in that the system also includes a unified verification module, which is used to continuously monitor the sound quality changes through the in-car microphone interface after the EQ mode adjustment is completed. If the sound quality similarity value is still lower than the sound quality similarity threshold, the unified verification module will feedback to the server, and the server will issue an adjustment instruction again and repeat the tuning strategy until the sound quality similarity reaches the preset standard. 7.根据权利要求1所述的用于车内投屏的音频优化系统，其特征在于，所述用户交互模块包括：7. The audio optimization system for in-car screen projection according to claim 1, characterized in that the user interaction module comprises: 音场补偿控制模块，用于用户手动选择是否启用移动设备扬声器与车机扬声器的协同发声功能；The sound field compensation control module is used for the user to manually select whether to enable the coordinated sound function of the mobile device speaker and the vehicle headphone speaker; 音质优化进度显示模块，用于实时显示调音策略的执行进度和结果。The sound quality optimization progress display module is used to display the execution progress and results of the tuning strategy in real time. 8.基于权利要求1-7任一项所述的一种用于车内投屏的音频优化系统的音频优化方法，其特征在于，所述方法包括：8. An audio optimization method for an audio optimization system for in-car screen projection based on any one of claims 1 to 7, characterized in that the method comprises: 通过投屏协议或互联协议将移动设备与车载显示屏建立连接，将移动设备的音频信号传输至车机扬声器；通过车机扬声器接口检测车内扬声器的数量信息，判断车内扬声器的数量是否小于或等于扬声器数量阈值，若是，则触发音场补偿功能，否则不触发；Establish a connection between the mobile device and the vehicle display screen through the screen projection protocol or the interconnection protocol, and transmit the audio signal of the mobile device to the vehicle speaker; detect the number of speakers in the vehicle through the vehicle speaker interface, and determine whether the number of speakers in the vehicle is less than or equal to the speaker number threshold. If so, the sound field compensation function is triggered, otherwise it is not triggered; 实时获取移动设备扬声器与车机扬声器的音频信号，计算频率差异值，利用自适应滤波器对频率差异进行校正，当校正后的频率差异值小于预设的频率差异阈值时，车机扬声器和移动设备扬声器达到同频发声标准；The audio signals of the mobile device speaker and the vehicle head speaker are obtained in real time, the frequency difference value is calculated, and the frequency difference is corrected by using an adaptive filter. When the corrected frequency difference value is less than a preset frequency difference threshold, the vehicle head speaker and the mobile device speaker reach the same frequency sounding standard; 在音场补偿过程中，通过车机的麦克风接口获取车内音频信息，计算移动设备扬声器与车机扬声器的音质相似度值，当音质相似度值低于音质相似度阈值时，触发调音策略；During the sound field compensation process, the in-car audio information is obtained through the microphone interface of the car computer, and the sound quality similarity value between the mobile device speaker and the car computer speaker is calculated. When the sound quality similarity value is lower than the sound quality similarity threshold, the tuning strategy is triggered; 在云端服务器上部署策略匹配引擎，通过车机麦克风接口获取车内音频信息，将车机扬声器发声的音频频段与移动设备扬声器发声的音频频段进行比对，生成频段差异值；当频段差异值大于频段差异阈值时，生成调音策略，并向移动设备和车机分别发送指令，进行移动端和车机端EQ模式的调整，优化音频输出；EQ模式调整完成后，通过车内麦克风接口持续监测音质相似度值，若音质相似度值仍然低于音质相似度阈值，则反馈给云端服务器，重复调音策略，直至音质相似度达到预设标准。A strategy matching engine is deployed on the cloud server, and the in-car audio information is obtained through the in-car microphone interface. The audio frequency band emitted by the in-car speaker is compared with the audio frequency band emitted by the mobile device speaker to generate a frequency band difference value. When the frequency band difference value is greater than the frequency band difference threshold, a tuning strategy is generated, and instructions are sent to the mobile device and the in-car respectively to adjust the EQ mode of the mobile and in-car terminals to optimize the audio output. After the EQ mode adjustment is completed, the sound quality similarity value is continuously monitored through the in-car microphone interface. If the sound quality similarity value is still lower than the sound quality similarity threshold, it is fed back to the cloud server and the tuning strategy is repeated until the sound quality similarity reaches the preset standard. 9.根据权利要求8所述的用于车内投屏的音频优化系统的音频优化方法，其特征在于，所述方法进一步包括基于用户预设配置的音频优化步骤，所述步骤包括：9. The audio optimization method for the audio optimization system for in-car screen projection according to claim 8, characterized in that the method further comprises an audio optimization step based on a user preset configuration, the step comprising: 用户通过用户交互界面输入个性化的音频参数配置，所述配置包括音量调节、EQ频段调整及音频延迟控制；The user inputs personalized audio parameter configuration through the user interaction interface, wherein the configuration includes volume adjustment, EQ frequency band adjustment and audio delay control; 车机系统根据用户输入的个性化配置，对移动设备扬声器与车机扬声器的音频输出进行实时调整；The car system adjusts the audio output of the mobile device speakers and the car speakers in real time according to the personalized configuration input by the user; 当车内环境噪声变化超过预设的噪声阈值时，系统自动调整音量或音频频段。When the ambient noise in the car changes beyond the preset noise threshold, the system automatically adjusts the volume or audio frequency band.
CN202411465004.7A 2024-10-21 2024-10-21 An audio optimization system and method for in-car screen projection Active CN119012095B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202411465004.7A CN119012095B (en) 2024-10-21 2024-10-21 An audio optimization system and method for in-car screen projection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202411465004.7A CN119012095B (en) 2024-10-21 2024-10-21 An audio optimization system and method for in-car screen projection

Publications (2)

Publication Number Publication Date
CN119012095A CN119012095A (en) 2024-11-22
CN119012095B true CN119012095B (en) 2025-01-21

Family

ID=93469365

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202411465004.7A Active CN119012095B (en) 2024-10-21 2024-10-21 An audio optimization system and method for in-car screen projection

Country Status (1)

Country Link
CN (1) CN119012095B (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117651238A (en) * 2024-01-30 2024-03-05 科大讯飞(苏州)科技有限公司 Audio playing method, audio compensation coefficient determining method and automobile

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6889189B2 (en) * 2003-09-26 2005-05-03 Matsushita Electric Industrial Co., Ltd. Speech recognizer performance in car and home applications utilizing novel multiple microphone configurations
US9509820B2 (en) * 2014-12-03 2016-11-29 Harman International Industries, Incorporated Methods and systems for controlling in-vehicle speakers

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117651238A (en) * 2024-01-30 2024-03-05 科大讯飞(苏州)科技有限公司 Audio playing method, audio compensation coefficient determining method and automobile

Also Published As

Publication number Publication date
CN119012095A (en) 2024-11-22

Similar Documents

Publication Publication Date Title
US8634547B2 (en) Echo canceller operative in response to fluctuation on echo path
KR101970370B1 (en) Processing audio signals
US20090034750A1 (en) System and method to evaluate an audio configuration
EP3350804B1 (en) Collaborative audio processing
WO2017101067A1 (en) Ambient sound processing method and device
GB2495472B (en) Processing audio signals
US20200329330A1 (en) Improvements in sound reproduction
CN106303836A (en) Method and device for adjusting stereo playing
US11653156B2 (en) Source separation in hearing devices and related methods
US11205440B2 (en) Sound playback system and output sound adjusting method thereof
TW202038859A (en) Methods, devices and system for a compensated hearing test
WO2023040820A1 (en) Audio playing method and apparatus, and computer-readable storage medium and electronic device
WO2018193826A1 (en) Information processing device, information processing method, speech output device, and speech output method
JP2019184809A (en) Voice recognition device and voice recognition method
WO2020017518A1 (en) Audio signal processing device
US10602276B1 (en) Intelligent personal assistant
CN119012095B (en) An audio optimization system and method for in-car screen projection
KR20230113853A (en) Psychoacoustic reinforcement based on audio source directivity
US11386911B1 (en) Dereverberation and noise reduction
GB2490092A (en) Reducing howling by applying a noise attenuation factor to a frequency which has above average gain
US12223974B2 (en) Method, hearing system, and computer program for improving a listening experience of a user wearing a hearing device
CN116015993B (en) Audio signal processing method and terminal
JP2021164109A (en) Sound field correction method, sound field correction program and sound field correction system
US20240029755A1 (en) Intelligent speech or dialogue enhancement
CN113031904A (en) Control method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant