CN112669859B - Communication mode control method and device - Google Patents

Abstract

The embodiment of the application discloses a communication mode control method and device, wherein the method comprises the following steps: the user equipment creates a fast track thread when detecting a low-delay communication request for the wireless earphone; reducing an audio data buffer area through the fast track thread, and canceling the operations of resampling the target audio data and/or processing the sound effect of the target audio data; when detecting that the audio coder/decoder selected by the local terminal is a first coder/decoder with non-low delay, switching the first coder/decoder into a second coder/decoder with low delay; and sending a low-delay mode switching notification to the wireless earphone, wherein the low-delay mode switching notification is used for notifying the wireless earphone to switch the working mode of the wireless earphone into a low-delay mode. The method and the device are beneficial to reducing the audio delay of the user equipment end and the earphone end and improving the user experience.

Description

A communication mode control method and device

Technical field

The present application relates to the field of communication technology, and in particular to a communication mode control method and device.

Background technique

Currently, the use of wireless earphones is becoming more and more common. People use wireless earphones on various occasions to get rid of the constraints of wired earphones and freely enjoy music, entertainment and communication.

In the field of gaming and e-sports and when watching live broadcasts and other videos, the audio delay between the wireless headset and the user device is a shortcoming. The delay refers to the total time it takes for the audio stream on the user device to be played by the speaker on the wireless headset. When the delay is too large, the user device screen and the sound heard by the user will be inconsistent, which will affect the user's gaming experience and video viewing experience.

Contents of the invention

Embodiments of the present application provide a communication mode control method and device, in order to reduce the audio delay between the user equipment side and the headset side and improve the user experience.

In a first aspect, embodiments of the present application provide a communication mode control method, applied to user equipment, which is communicatively connected to a wireless headset; the method includes:

Upon detecting a low-latency communication request for the wireless headset, create a fast audio track thread;

Reduce the size of the audio data cache area through the fast track thread, and cancel the operations of resampling the target audio data and/or processing the sound effects of the target audio data;

When it is detected that the audio codec selected by the local end is a non-low-latency first codec, switch the first codec to a low-latency second codec;

A low-latency mode switching notification is sent to the wireless headset, where the low-latency mode switching notification is used to notify the wireless headset to switch the working mode of the wireless headset to the low-latency mode.

In a second aspect, embodiments of the present application provide a communication mode control method, which is applied to a wireless headset. The wireless headset is communicatively connected to a user equipment. The method includes:

Receive a low-latency mode switching notification sent by the user equipment. The low-latency mode switching notification is sent by the user equipment after performing the following operations: when detecting a low-latency communication request for the wireless headset, create a fast Audio track thread; and reducing the audio data buffer area through the fast audio track thread, and canceling the operations of resampling the target audio data and/or processing the sound effects of the target audio data; and when detecting When the audio codec selected by the local end is a non-low-latency first codec, switch the first codec to a low-latency second codec;

Switch the local end's working mode to low-latency working mode.

In a third aspect, embodiments of the present application provide a communication mode control device, which is applied to user equipment, and the user equipment is communicatively connected to a wireless headset; the device includes a processing unit and a communication unit, wherein,

The processing unit is configured to create a fast audio track thread when a low-latency communication request for the wireless headset is detected; reduce the audio data buffer area through the fast audio track thread, and cancel the target audio data Perform the operations of resampling and/or processing the sound effects of the target audio data; when it is detected that the audio codec selected by the local end is a non-low-latency first codec, the first codec is The decoder is switched to a low-latency second codec; and a low-latency mode switching notification is sent to the wireless headset. The low-latency mode switching notification is used to notify the wireless headset to switch the working mode of the wireless headset to low. Delay mode.

In the fourth aspect, embodiments of the present application provide a communication mode control device, which is applied to a wireless headset, and the wireless headset is communicatively connected with user equipment; the device includes a processing unit and a communication unit, wherein,

The processing unit is configured to receive a low-latency mode switching notification sent by the user equipment. The low-latency mode switching notification is sent by the user equipment after performing the following operations: detecting a low-latency mode switching notification for the wireless headset. When delaying the communication request, create a fast audio track thread; and reduce the audio data buffer area through the fast audio track thread, and cancel resampling the target audio data and/or processing the sound effects of the target audio data The operation; and when it is detected that the audio codec selected by the local end is a non-low-latency first codec, switch the first codec to a low-latency second codec; Switch the local end's working mode to low-latency working mode.

In a fifth aspect, an embodiment of the present application provides a user device, comprising a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps of any method in the first aspect of the embodiment of the present application.

In a sixth aspect, embodiments of the present application provide a wireless headset, including a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and are configured to perform the processing The program is executed by a computer, and the above program includes instructions for executing steps in any method of the second aspect of the embodiment of the present application.

In the seventh aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the above-mentioned computer-readable storage medium stores a computer program for electronic data exchange, wherein the above-mentioned computer program enables a computer to execute part or all of the steps described in any method of the first aspect or the second aspect of the embodiment of the present application.

In the eighth aspect, embodiments of the present application provide a computer program product, wherein the above-mentioned computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the above-mentioned computer program is operable to cause the computer to execute the implementation of the present application. Examples include some or all of the steps described in any method of the first aspect. The computer program product may be a software installation package.

In the embodiment of the present application, when the user equipment detects a low-latency communication request for the wireless headset, it creates a fast audio track thread; uses the fast audio track thread to reduce the audio data buffer area and cancels the processing of the target audio data. The operation of resampling and/or processing the sound effects of the target audio data; when detecting that the audio codec selected by the local end is a non-low-latency first codec, decoding the first codec The coder is switched to a low-latency second codec; and a low-latency mode switching notification is sent to the wireless headset. The low-latency mode switching notification is used to notify the wireless headset to switch the working mode of the wireless headset to low-latency. Mode, it can be seen that while the user equipment itself reduces the delay, it sends a low-latency mode switching notification to the wireless headset side. The user equipment side and the mobile phone side are jointly optimized to reduce the audio delay between the user equipment side and the headset side and improve the user experience.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only for the purpose of the present application. For some embodiments, for those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting creative efforts.

Figure 1 is an architectural diagram of a communication mode control system in which a communication mode control device is provided in an embodiment of the present application;

Figure 2 is a schematic flowchart of a communication mode control method provided by an embodiment of the present application;

Figure 3 is a schematic flow chart of another communication mode control method provided by an embodiment of the present application;

Figure 4 is a schematic flowchart of yet another communication mode control method provided by an embodiment of the present application;

Figure 5 is a schematic structural diagram of a user equipment provided by an embodiment of the present application;

Figure 6 is a schematic structural diagram of a wireless earphone provided by an embodiment of the present application;

Figure 7 is a functional unit block diagram of a communication mode control device provided by an embodiment of the present application;

Figure 8 is a functional unit block diagram of another communication mode control device provided by an embodiment of the present application.

Detailed ways

In order to enable those in the technical field to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only These are part of the embodiments of this application, but not all of them. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this application.

The terms "first", "second", etc. in the description and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than describing a specific sequence. Furthermore, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes Other steps or units inherent to such processes, methods, products or devices.

Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

The user equipment involved in the embodiments of this application may be an electronic device with communication capabilities. The user equipment may include various handheld devices with wireless communication functions, vehicle-mounted devices, wearable devices, computing devices, or other devices connected to wireless modems. Processing equipment, as well as various forms of user equipment (User Equipment, UE), mobile station (Mobile Station, MS), terminal equipment (terminal device), etc.

The wireless earphones mentioned in the embodiments of this application have the middle earphone wire replaced by radio waves. They are connected from the audio outlet of the audio playback device to the transmitter. The transmitter then sends the radio waves to the receiver's earphones. The receiver is equivalent to a radio. Wireless headsets can be divided into infrared wireless headsets, meter wave wireless headsets (FM frequency modulation headsets) and decimeter wave wireless headsets (Bluetooth headsets).

Currently, in scenarios such as gaming, watching live broadcasts, and videos, when the audio delay between the wireless headset and the user device is too large, the picture on the user device and the sound heard by the user will be inconsistent, seriously affecting the user. experience.

To address the above problems, embodiments of the present application provide a communication mode control method and device. The embodiments of the present application are introduced in detail below with reference to the accompanying drawings.

As shown in FIG. 1 , the communication mode control system 100 described in the present application includes: a user device 101 and a wireless headset 102 , and the user device 101 and the wireless headset 102 can establish a communication connection.

Please refer to FIG. 2, which is a flow chart of a communication mode control method provided in an embodiment of the present application, which is applied to a user device, and the user device is communicatively connected with a wireless headset; as shown in the figure, the communication mode control method includes the following operations:

S201: When the user equipment detects a low-latency communication request for the wireless headset, create a fast audio track thread.

The user device can be a mobile phone, and can be identified by identifying whether the application on the mobile phone calls the audio processing interface OpenSL ES, or whether the AUDIO_OUTPUT_FLAG_FAST (audio stream needs to be quickly output to the audio device) flag is set when creating the audio track thread audioTrack. To determine whether there is a low-latency requirement, or you can also use the mobile application whitelist to detect whether there is a low-latency requirement.

In order to better achieve low latency, applications with low latency requirements first obtain the sampling rate of the user device before creating the audio track thread audioTrack, and then provide corresponding audio data based on the obtained sampling rate.

S202: The user equipment uses the fast track thread to reduce the size of the audio data buffer area, and cancels the operations of resampling the target audio data and/or processing the sound effects of the target audio data.

Among them, the user device can be a mobile phone. Taking a mobile phone as an example, when the mobile phone detects that there is a demand for low-latency applications, it can create a fast audio track thread through the audio module of the mobile phone. The fast audio track thread reduces the audio data buffer, cancels resampling of the target audio data, and cancels processing of the sound effects of the target audio data, thereby reducing the processing time of the audio stream on the mobile phone side, thereby reducing the delay.

S203: When the user equipment detects that the audio codec selected by the local terminal is a non-low-latency first codec, the user equipment switches the first codec to a low-latency second codec.

For example, taking a mobile phone as an example, when the audio module of the mobile phone recognizes a low-latency requirement, it can submit the request to the Bluetooth module of the mobile phone. If the previously selected audio codec is not a low-latency audio codec codec, The mobile phone Bluetooth module switches the previous audio codec codec to an audio codec codec with lower latency.

S204: The user equipment sends a low-latency mode switching notification to the wireless headset. The low-latency mode switching notification is used to notify the wireless headset to switch the working mode of the wireless headset to the low-latency mode.

The wireless headset in the embodiment of the present application may be a Bluetooth headset, and may be connected to the user equipment through Bluetooth technology. Bluetooth is a wireless technology standard that enables short-range data exchange between fixed devices, mobile devices and building personal area networks.

For example, take a mobile phone and a Bluetooth headset as an example. The mobile phone and the Bluetooth headset establish a communication connection through their respective Bluetooth modules. The mobile phone Bluetooth module then sends a low-latency mode switching notification to the Bluetooth headset, notifying the Bluetooth headset to enter the low-latency mode. , the Bluetooth headset can be notified to enter low-latency mode through the reconfiguration command reconfig, or other customized commands.

In the embodiment of the present application, when the user equipment detects a low-latency communication request for the wireless headset, it creates a fast audio track thread; uses the fast audio track thread to reduce the audio data buffer area and cancels the processing of the target audio data. The operation of resampling and/or processing the sound effects of the target audio data; when detecting that the audio codec selected by the local end is a non-low-latency first codec, decoding the first codec The coder is switched to a low-latency second codec; and a low-latency mode switching notification is sent to the wireless headset. The low-latency mode switching notification is used to notify the wireless headset to switch the working mode of the wireless headset to low-latency. Mode, it can be seen that while the user equipment itself reduces the delay, it sends a low-latency mode switching notification to the wireless headset side. The user equipment side and the mobile phone side are jointly optimized to reduce the audio delay between the user equipment side and the headset side and improve the user experience.

In a possible example, the detection of a low-latency communication request for the wireless headset includes: detecting that the local application calls the audio processing interface OpenSL ES; or detecting that the local application creates the audio track thread audioTrack. Set a preset flag bit, which is used to identify that the audio stream needs to be output to the audio device quickly; or, detect it through a mobile phone application whitelist.

For example, take a mobile phone as an example. When detecting that an application installed on the mobile phone calls the audio processing interface OpenSL ES, or detecting that an application in the mobile phone creates the audio track thread audioTrack, it sets AUDIO_OUTPUT_FLAG_FAST (audio stream needs to be output to the audio device quickly) flag, or when an application in the mobile application whitelist is detected, it is determined that the mobile phone has a low-latency communication request for wireless headphones and a fast audio track thread is created.

In order to better achieve low latency, an application with low latency requirements first obtains the sampling rate of the user device before creating the audio track thread audioTrack, and then provides corresponding audio data according to the obtained sampling rate.

It can be seen that in this example, the user device identifies the low-latency demand scenario, so that when the low-latency demand scenario is recognized, it switches to the low-latency mode to reduce the audio delay between the user device and the wireless headset. Detect whether the application calls OpenSL ES or whether there is a preset flag used to identify the audio stream that needs to be quickly output to the audio device when creating the audioTrack, or through the mobile application whitelist to make it easier to identify the user device. End-user applications and wireless headsets have low latency requirements for audio data.

In a possible example, sending the low-latency mode switching notification to the wireless headset includes: sending the low-latency mode switching notification through a reconfiguration instruction.

For example, the user device can be a mobile phone, and the wireless headset can be a Bluetooth headset. The mobile phone and the Bluetooth headset establish a communication connection through their respective Bluetooth modules. The mobile phone Bluetooth module can send a reconfiguration command to the Bluetooth headset. This command is used to Notify the Bluetooth headset to enter the low-latency mode, so that the Bluetooth headset can enter the low-latency mode after receiving the reconfiguration command sent by the mobile phone.

It can be seen that in this example, the low-latency mode switching notification is sent to the wireless headset through the reconfiguration instruction.

In one possible example, after detecting a low-latency communication request for the wireless headset, the method further includes: when detecting that the audio data buffer area is reduced in size, adjusting the size of the Bluetooth transmission packet to a preset size according to the size of the audio data buffer area.

For example, after detecting a low-latency communication request for a wireless headset, the user equipment detects whether the audio data buffer area has been reduced. If it detects that the audio data buffer area has been reduced, it will cache the audio data based on the reduced audio data buffer area. According to the size of the area, the user equipment can correspondingly reduce the size of the Bluetooth data transmission packet and use small packet data transmission to increase the anti-interference capability of Bluetooth.

It can be seen that in this example, because reducing the buffer area will affect the anti-interference ability and distance pulling ability, when entering the low-latency mode, the user can improve the Bluetooth anti-interference ability by adjusting the size of the Bluetooth transmission packet, thereby improving Bluetooth data transmission. stability.

In a possible example, the method further includes: determining the interference intensity of the scene in which the local terminal is located; adjusting the compression rate of audio encoding to a preset compression rate according to the interference intensity, so that the transmission code rate of Bluetooth is reduced to Default bit rate.

For example, the wireless headset can be a Bluetooth headset, and the user device can be a mobile phone. The two communicate through their respective Bluetooth modules. The user device first determines the interference intensity of the scene where the local terminal is located, and then adjusts the compression of the audio encoding according to the different interference intensity. The compression rate corresponding to the rate. For example, when the user equipment is in a strong interference environment, the corresponding coding compression rate is higher than the corresponding coding compression rate when the user equipment is in a weak interference environment. By increasing the coding compression rate, the Bluetooth transmission The code rate is reduced.

It can be seen that in this example, the compression rate of audio encoding is adjusted according to the different interference intensity of the scene where the user equipment is located, so as to reduce the code rate of Bluetooth transmission and improve the stability of Bluetooth transmission.

Please refer to FIG. 3, which is a flow chart of another communication mode control method provided in an embodiment of the present application, which is applied to a wireless headset, and the wireless headset is in communication connection with a user device; as shown in the figure, the communication mode control method includes the following operations:

S301. The wireless headset receives the low-latency mode switching notification sent by the user device.

Wherein, the low-latency mode switching notification is sent by the user equipment after performing the following operations: when detecting a low-latency communication request for the wireless headset, creating a fast audio track thread; and through the fast audio track The thread reduces the audio data buffer area and cancels the operations of resampling the target audio data and/or processing the sound effects of the target audio data; and detecting that the audio codec selected by the local end is non- When using a first codec with low delay, switch the first codec to a second codec with low delay.

S302, the wireless headset switches the working mode of the local end to the low-latency working mode.

The wireless headset in the embodiment of the present application may be a Bluetooth headset, which can be connected to the user device via Bluetooth technology. Bluetooth is a wireless technology standard that can realize short-range data exchange between fixed devices, mobile devices and building personal area networks.

In this embodiment of the present application, the wireless headset receives a low-latency mode switching notification sent by the user equipment; wherein the low-latency mode switching notification is sent by the user equipment after performing the following operations: upon detecting the When a low-latency communication request is made, a fast audio track thread is created; and the audio data cache area is reduced through the fast audio track thread, and the resampling of the target audio data and/or the sound effects of the target audio data are cancelled. Processing operations; and when it is detected that the audio codec selected by the local end is a non-low-latency first codec, switching the first codec to a low-latency second codec ;Switch the working mode of the local terminal to the low-latency working mode. It can be seen that the wireless headset receives the low-latency mode switching notification from the user device and switches the working mode of the local terminal to the low-latency working mode. The user device side and the mobile phone side are jointly optimized to reduce user Audio delay on the device side and headset side improves user experience.

In a possible example, the method further includes: reducing the audio data buffer area of the headset so that the buffer time is less than a first preset threshold; adjusting the size of the target audio data decoded once to a preset size to reduce the direct memory access (DMA) switching time.

Among them, after the wireless headset receives a notification from the user device to enter the low-latency mode, the headset adjusts its own audio data cache area to reduce the cache time. The first preset threshold here can be 100 milliseconds, that is, the cache time is in the range of tens of milliseconds; the headset will also adjust the data size of the audio data decoded at one time to reduce the direct memory access DMA switching time, thereby reducing the delay on the headset.

It can be seen that in this example, by reducing the audio data buffer area sum of the headphone side and adjusting the size of the target audio data decoded once, the delay of the headphone side can be reduced.

In a possible example, the method further includes: detecting the size of the cache data of the target audio data; and fine-tuning the headphone playback speed according to the size of the cache data of the target audio data.

For example, the headphone end can detect the size of the cached data of the target audio data in the audio buffer area of the headset end, and fine-tune the headset playback speed according to the size of the cached data. For example, when the size of the cached data is small, the headset playback speed can be appropriately lowered, and the cached data is larger. When the volume is high, you can increase the headphone playback speed appropriately.

It can be seen that in this example, the headphone playback speed is finely adjusted according to the size of the cache data of the target audio data, so that the headphone playback speed adapts to the size of the cache data, which is beneficial to maintaining the balance of the cache.

In a possible example, the method further includes: counting the stability of the local Bluetooth receiving the target audio data; and dynamically adjusting the audio of the headset according to the stability of the local Bluetooth receiving the target audio data. Data cache area.

The wireless headset may be a Bluetooth headset, and may be connected to the user equipment through Bluetooth technology.

For example, taking a Bluetooth headset as an example, the Bluetooth headset can count the stability of the local Bluetooth receiving the target audio data, and then dynamically adjust the audio data buffer size of the Bluetooth headset based on this statistical stability. For example, stable When the performance is weak, appropriately increase the size of the audio data buffer to improve stability in interference environments.

It can be seen that in this example, by dynamically adjusting the audio data buffer area of the headset according to the statistical stability of the local Bluetooth receiving the target audio data, the stability in the interference environment is improved.

Please refer to Figure 4, which is a flow chart of another communication mode control method provided in an embodiment of the present application. As shown in the figure, the communication mode control method includes the following steps:

S401: When the user equipment detects a low-latency communication request for the wireless headset, create a fast audio track thread.

The user device can be a mobile phone, and can be identified by identifying whether the application on the mobile phone calls the audio processing interface OpenSL ES, or whether the AUDIO_OUTPUT_FLAG_FAST (audio stream needs to be quickly output to the audio device) flag is set when creating the audio track thread audioTrack. To determine whether there is a low-latency requirement, or you can also use the mobile application whitelist to detect whether there is a low-latency requirement.

In order to better achieve low latency, applications with low latency requirements first obtain the sampling rate of the user device before creating the audio track thread audioTrack, and then provide corresponding audio data based on the obtained sampling rate.

S402: The user equipment uses the fast track thread to reduce the size of the audio data buffer area, and cancels the operations of resampling the target audio data and/or processing the sound effects of the target audio data.

The fast track thread reduces the audio data buffer, cancels resampling of the target audio data, cancels processing of the sound effects of the target audio data, and reduces the processing time of the audio stream on the mobile phone, thereby reducing the delay.

S403: When the user equipment detects that the audio codec selected by the local terminal is a non-low-latency first codec, the user equipment switches the first codec to a low-latency second codec.

For example, taking a mobile phone as an example, when the audio module of the mobile phone recognizes a low-latency requirement, it can submit the request to the Bluetooth module of the mobile phone. If the previously selected audio codec is not a low-latency audio codec codec, the mobile phone The Bluetooth module switches the previous audio codec codec to an audio codec codec with lower latency.

S404: The user equipment sends a low-latency mode switching notification to the wireless headset.

Wherein, the low-latency mode switching notification is used to notify the wireless headset to switch the working mode of the wireless headset to the low-latency mode.

S405: The wireless headset receives the low-latency mode switching notification sent by the user device.

The wireless headset in the embodiment of the present application may be a Bluetooth headset, and may be connected to the user equipment through Bluetooth technology.

S406, the wireless headset switches the working mode of the local end to the low-latency working mode.

In the embodiment of the present application, when the user equipment detects a low-latency communication request for the wireless headset, it creates a fast audio track thread; uses the fast audio track thread to reduce the audio data buffer area and cancels the processing of the target audio data. The operation of resampling and/or processing the sound effects of the target audio data; when detecting that the audio codec selected by the local end is a non-low-latency first codec, decoding the first codec The codec is switched to a low-latency second codec; the user equipment sends a low-latency mode switching notification to the wireless headset; the wireless headset receives the low-latency mode switching notification sent by the user equipment; the wireless headset switches the working mode of the local end to low Delayed working mode. It can be seen that when the user equipment detects a low-latency requirement, it reduces the delay itself and sends a low-latency mode switching notification to the wireless headset. When the wireless headset receives the notification, it enters the low-latency mode to reduce the delay on the headset. , through the joint optimization of the user equipment side and the headset side, the total time for the sound to be played from the user equipment to the wireless headset is reduced, thereby improving the problem that the user feels that the picture and sound are out of sync, and using wireless in scenarios such as gaming, watching live broadcasts, and videos. Get a better experience with headphones.

Consistent with the above embodiment shown in Figure 2, please refer to Figure 5. Figure 5 is a schematic structural diagram of a user equipment provided by an embodiment of the present application. As shown in the figure, the user equipment 500 includes an application processor 510, a memory 520, a communication interface 530, and one or more programs 521, wherein the one or more programs 521 are stored in the above-mentioned memory 520 and are The configuration is executed by the above-mentioned application processor 510, and the one or more programs 521 include instructions for executing any step in the above-mentioned method embodiments.

In one possible example, the one or more programs 521 include instructions for performing the following steps: when a low-latency communication request for the wireless headset is detected, create a fast audio track thread; The track thread reduces the audio data buffer area and cancels the operations of resampling the target audio data and/or processing the sound effects of the target audio data; when it is detected that the audio codec selected by the local end is non- When using a low-latency first codec, switch the first codec to a low-latency second codec; send a low-latency mode switching notification to the wireless headset, and the low-latency mode switch The notification is used to notify the wireless headset to switch the working mode of the wireless headset to the low-latency mode.

In one possible example, in terms of detecting a low-latency communication request for the wireless headset, the instructions in the program 521 are specifically used to perform the following operations: detecting that an application on the local side calls the audio processing interface OpenSL ES; or detecting that an application on the local side creates an audio track thread audioTrack and sets a preset flag bit, wherein the preset flag bit is used to indicate that the audio stream needs to be output to the audio device quickly; or detecting by means of a mobile phone application whitelist.

In one possible example, in terms of sending a low-latency mode switching notification to the wireless headset, the instructions in the program 521 are specifically used to perform the following operations: sending the low-latency mode switching notification via a reconfiguration instruction reconfig.

In a possible example, after the low-latency communication request for the wireless headset is detected, the program 521 further includes instructions for performing the following operations: after detecting that the audio data buffer is adjusted , according to the size of the audio data buffer area, adjust the size of the Bluetooth transmission packet to a preset size.

In a possible example, the program 521 also includes instructions for performing the following operations: determining the interference intensity of the scene where the local terminal is located; adjusting the compression rate of the audio encoding to a preset compression rate according to the interference intensity, so that The transmission bit rate of Bluetooth is reduced to the preset bit rate.

Consistent with the embodiment shown in FIG. 3 above, please refer to FIG. 6 , which is a schematic structural diagram of a wireless earphone provided by an embodiment of the present application. As shown in the figure, the wireless headset 600 includes an application processor 610, a memory 620, a communication interface 630, and one or more programs 621, wherein the one or more programs 621 are stored in the memory 620 and are The configuration is executed by the above-mentioned application processor 610, and the one or more programs 621 include instructions for executing any step in the above-mentioned method embodiments.

In a possible example, the one or more programs 621 include instructions for performing the following steps: receiving a low-latency mode switching notification sent by the user equipment, where the low-latency mode switching notification is when the user equipment Sent after performing the following operations: creating a fast audio track thread when a low-latency communication request for the wireless headset is detected; and reducing the audio data cache area through the fast audio track thread and canceling the target audio The operation of resampling the data and/or processing the sound effects of the target audio data; and when it is detected that the audio codec selected by the local end is a non-low-latency first codec, the third codec is The first codec is switched to a low-latency second codec; the working mode of the local end is switched to a low-latency working mode.

In a possible example, the program 621 also includes instructions for performing the following operations: reducing the audio data cache area of the headset so that the cache time is less than the first preset threshold; adjusting the target audio data once decoded The size is a preset size to reduce direct memory access DMA switching time.

In a possible example, the program 621 further includes instructions for performing the following operations: detecting the size of the cache data of the target audio data; and fine-tuning the headphone playback speed according to the size of the cache data of the target audio data.

In a possible example, the program 621 also includes instructions for performing the following operations: counting the stability of the local Bluetooth receiving the target audio data; and according to the stability of the local Bluetooth receiving the target audio data. , dynamically adjust the audio data buffer area of the headset.

The above mainly introduces the solution of the embodiment of the present application from the perspective of the execution process on the method side. It can be understood that in order to implement the above functions, the user equipment includes corresponding hardware structures and/or software modules for performing each function. Persons skilled in the art should easily realize that, with the units and algorithm steps of each example described in conjunction with the embodiments provided herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving the hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered beyond the scope of this application.

Embodiments of the present application can divide the user equipment into functional units according to the above method examples. For example, each functional unit can be divided corresponding to each function, or two or more functions can be integrated into one processing unit. The above integrated units can be implemented in the form of hardware or software functional units. It should be noted that the division of units in the embodiment of the present application is schematic and is only a logical function division. In actual implementation, there may be other division methods.

Please refer to FIG. 7 , which is a functional unit block diagram of a communication mode control device 700 involved in the embodiment of the present application. The communication mode control device 700 is applied to user equipment, and the user equipment is communicatively connected to a wireless headset; the communication mode control device 700 includes a processing unit 701 and a communication unit 702, wherein the processing unit 701 is used to perform the above method. Any step in the embodiment, and when performing data transmission such as sending, the communication unit 702 can be selectively called to complete the corresponding operation. Detailed explanation below.

The processing unit 701 is configured to create a fast audio track thread when a low-latency communication request for the wireless headset is detected; reduce the audio data buffer area through the fast audio track thread, and cancel the processing of the target audio The operation of resampling the data and/or processing the sound effects of the target audio data; when it is detected that the audio codec selected by the local end is a non-low-latency first codec, the first codec is The codec is switched to a low-latency second codec; and a low-latency mode switching notification is sent to the wireless headset. The low-latency mode switching notification is used to notify the wireless headset to switch the working mode of the wireless headset. Low latency mode.

In a possible example, in terms of detecting a low-latency communication request for the wireless headset, the processing unit 701 is specifically configured to: detect that the local application calls the audio processing interface OpenSL ES; or, detect that the local application calls the audio processing interface OpenSL ES; or, detect that the local application calls the audio processing interface OpenSL ES; The end-end application creates the audio track thread audioTrack and sets a preset flag bit, which is used to identify that the audio stream needs to be quickly output to the audio device; or, it can be detected through the mobile phone application whitelist.

In a possible example, in terms of sending the low-latency mode switching notification to the wireless headset, the processing unit 701 is specifically configured to: send the low-latency mode switching notification through a reconfiguration instruction reconfig.

In a possible example, after detecting the low-latency communication request for the wireless headset, the processing unit 701 is further configured to: when detecting that the audio data buffer is adjusted, adjust the audio data according to the audio data. The size of the buffer area, adjust the size of the Bluetooth transmission packet to the default size.

In a possible example, the processing unit 701 is further configured to: determine the interference intensity of the scene where the local terminal is located; adjust the compression rate of the audio encoding to a preset compression rate according to the interference intensity, so that the Bluetooth transmission code The code rate is reduced to the preset code rate.

The communication mode control apparatus 700 may also include a storage unit 703 for storing program codes and data of user equipment. The processing unit 701 may be a processor, the communication unit 702 may be a touch display screen or a transceiver, and the storage unit 703 may be a memory.

Please refer to FIG. 8 , which is a functional unit block diagram of another communication mode control device 800 involved in the embodiment of the present application. The communication mode control device 800 is applied to wireless headsets, and the wireless headsets are communicatively connected with user equipment; the communication mode control device 800 includes a processing unit 801 and a communication unit 802, wherein the processing unit 801 is used to perform the following: In any step in the above method embodiment, when performing data transmission such as sending, the communication unit 802 can be optionally called to complete the corresponding operation. Detailed explanation below.

The processing unit 801 is configured to receive a low-latency mode switching notification sent by the user equipment. The low-latency mode switching notification is sent by the user equipment after performing the following operations: upon detecting the When a low-latency communication request is made, a fast audio track thread is created; and the audio data cache area is reduced through the fast audio track thread, and the resampling of the target audio data and/or the sound effects of the target audio data are cancelled. Processing operations; and when it is detected that the audio codec selected by the local end is a non-low-latency first codec, switching the first codec to a low-latency second codec ;Switch the local working mode to low-latency working mode.

In a possible example, the processing unit 801 is further configured to: reduce the audio data cache area of the headset so that the cache time is less than a first preset threshold; adjust the size of the target audio data decoded once to the preset threshold. Set size to reduce direct memory access DMA switching time.

In a possible example, the processing unit 801 is further configured to: detect the size of the cache data of the target audio data; and fine-tune the headphone playback speed according to the size of the cache data of the target audio data.

In a possible example, the processing unit 801 is further configured to: make statistics on the stability of the local Bluetooth receiving the target audio data; and dynamically adjust the target audio data according to the stability of the local Bluetooth receiving the target audio data. Describes the audio data buffer area of the headset.

It can be understood that since the method embodiment and the device embodiment are different presentation forms of the same technical concept, the content of the method embodiment part in this application should be simultaneously adapted to the device embodiment part, and will not be described again here.

An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute part or all of the steps of any method recorded in the above method embodiments, and the above computer includes a user device or a wireless headset.

The embodiment of the present application also provides a computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, the computer program is operable to cause a computer to execute some or all of the steps of any method described in the method embodiment. The computer program product may be a software installation package, and the computer includes a user device.

It should be noted that for the sake of simple description, the foregoing method embodiments are expressed as a series of action combinations. However, those skilled in the art should know that the present application is not limited by the described action sequence. Because in accordance with this application, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily necessary for this application.

In the above embodiments, each embodiment is described with its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the above units is only a logical function division. In actual implementation, there may be other divisions. For example, multiple units or components may be combined or integrated. to another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical or other forms.

The units described above as separate components may or may not be physically separated. The components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application is essentially or contributes to the existing technology, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory, It includes several instructions to cause a computer device (which can be a personal computer, a server or a network device, etc.) to execute all or part of the steps of the above methods in various embodiments of the present application. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program. The program can be stored in a computer-readable memory. The memory can include: a flash disk. , read-only memory (English: Read-Only Memory, abbreviation: ROM), random access device (English: Random Access Memory, abbreviation: RAM), magnetic disk or optical disk, etc.

The embodiments of the present application have been introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and the core idea of the present application; at the same time, for Those of ordinary skill in the art will have changes in the specific implementation and application scope based on the ideas of the present application. In summary, the content of this description should not be understood as a limitation of the present application.

Claims (14)

1. A communication mode control method, characterized in that it is applied to user equipment, and the user equipment is communicatively connected to a wireless headset; the method includes: Upon detecting a low-latency communication request for the wireless headset, create a fast audio track thread; Reduce the size of the audio data cache area through the fast track thread, and cancel the operations of resampling the target audio data and/or processing the sound effects of the target audio data; When it is detected that the audio codec selected by the local end is a non-low-latency first codec, switch the first codec to a low-latency second codec; A low-latency mode switching notification is sent to the wireless headset, where the low-latency mode switching notification is used to notify the wireless headset to switch the working mode of the wireless headset to the low-latency mode. 2. The method of claim 1, wherein the detection of a low-latency communication request for the wireless headset includes: It is detected that the local application calls the audio processing interface OpenSL ES; or, It is detected that the local application creates the audio track thread audioTrack and sets the preset mark bit, which is used to identify that the audio stream needs to be quickly output to the audio device; or, Detection is done through mobile application whitelist. 3. The method according to claim 1 or 2, characterized in that sending a low-latency mode switching notification to the wireless headset includes: The low-latency mode switching notification is sent through a reconfiguration instruction reconfig. 4. The method according to claim 1 or 2, characterized in that after detecting the low-latency communication request for the wireless headset, the method further comprises: When it is detected that the audio data buffer area is adjusted to a smaller size, the size of the Bluetooth transmission packet is adjusted to a preset size according to the size of the audio data buffer area. 5. The method according to claim 4, characterized in that, the method further comprises: Determine the interference intensity of the scene where the local terminal is located; The compression rate of the audio encoding is adjusted to a preset compression rate according to the interference intensity, so that the transmission code rate of Bluetooth is reduced to the preset code rate. 6. A communication mode control method, characterized in that it is applied to wireless earphones, and the wireless earphones are communicatively connected to user equipment; the method includes: Receive a low-latency mode switching notification sent by the user equipment. The low-latency mode switching notification is sent by the user equipment after performing the following operations: when detecting a low-latency communication request for the wireless headset, create a fast Audio track thread; and reducing the audio data buffer area through the fast audio track thread, and canceling the operation of resampling the target audio data and/or processing the sound effects of the target audio data; and when detecting that the local end When the selected audio codec is a non-low-latency first codec, switch the first codec to a low-latency second codec; Switch the local end's working mode to low-latency working mode. 7. The method according to claim 6, characterized in that the method further comprises: Reduce the audio data cache area of the headset so that the cache time is less than the first preset threshold; Adjust the size of the target audio data decoded once to the preset size to reduce the direct memory access DMA switching time. 8. The method according to claim 7, characterized in that the method further comprises: Detect the size of cache data of the target audio data; Fine-tune the headphone playback speed according to the size of the cache data of the target audio data. 9. The method according to claim 8, characterized in that the method further comprises: Statistics on the stability of the local Bluetooth receiving the target audio data; According to the stability of the local Bluetooth receiving the target audio data, the audio data buffer area of the headset is dynamically adjusted. 10. A communication mode control device, characterized in that it is applied to user equipment, and the user equipment is communicatively connected to a wireless headset; the device includes a processing unit and a communication unit, wherein, The processing unit is used to create a fast audio track thread when a low-latency communication request for the wireless headset is detected; reduce the audio data buffer area through the fast audio track thread, and cancel the operation of resampling the target audio data and/or processing the sound effects of the target audio data; when it is detected that the audio codec selected by this end is a non-low-latency first codec, switch the first codec to a low-latency second codec; send a low-latency mode switching notification to the wireless headset, and the low-latency mode switching notification is used to notify the wireless headset to switch the working mode of the wireless headset to the low-latency mode. 11. A communication mode control device, characterized in that it is applied to wireless earphones, and the wireless earphones are communicatively connected with user equipment; the device includes a processing unit and a communication unit, wherein, The processing unit is used to receive a low-latency mode switching notification sent by the user equipment, and the low-latency mode switching notification is sent by the user equipment after performing the following operations: when a low-latency communication request for the wireless headset is detected, a fast audio track thread is created; and the audio data buffer area is reduced through the fast audio track thread, and the operation of resampling the target audio data and/or processing the sound effects of the target audio data is canceled; and when it is detected that the audio codec selected by this end is a non-low-latency first codec, the first codec is switched to a low-latency second codec; and the working mode of this end is switched to a low-latency working mode. 12. A user equipment with communication mode control, characterized in that it includes a processor, a memory, a communication interface, and one or more programs, the one or more programs are stored in the memory and configured Executed by the processor, the program includes instructions for performing steps in the method of any one of claims 1-5. 13. A wireless headset, characterized by comprising a processor, a memory, a communication interface, and one or more programs, the one or more programs being stored in the memory and configured by the processor Execution, the program includes instructions for executing the steps of the method according to any one of claims 6-9. 14. A computer-readable storage medium, characterized by storing a computer program for electronic data exchange, wherein the computer program causes the computer to perform the method according to any one of claims 1-5 or 6-9 .