CN117715163B - Audio play control method, electronic device and readable storage medium - Google Patents

Abstract

The present application discloses a control method for audio playback, an electronic device, and a readable storage medium, and belongs to the field of terminal technology. The method includes: in response to an audio playback operation, when the electronic device is in a non-silent playback mode, transmitting the audio data of the target audio to the audio power amplifier of the electronic device through an audio playback application to play the target audio, and the audio power amplifier is in an on state before receiving the audio playback operation; when the electronic device switches from a non-silent playback mode to a silent playback mode, turning off the audio power amplifier and stopping transmitting the audio data of the target audio to the audio power amplifier; simulating the operation of transmitting the audio data of the target audio to the audio power amplifier, so that the playback speed of the target audio does not change during the playback of the target audio. The present application can turn off the audio power amplifier during the process of playing the target audio, thereby reducing the power consumption of the electronic device.

Description

Audio playback control method, electronic device and readable storage medium

Technical Field

The present application relates to the field of terminal technology, and in particular to a method for controlling audio playback, an electronic device, and a readable storage medium.

Background Art

With the development of terminal technology, users have more and more ways to entertain themselves through electronic devices. For example, users can entertain themselves by playing videos, audios, etc.

However, when playing audio or video, the electronic device generates power consumption, which increases the overall power consumption of the electronic device, thereby affecting the battery life of the electronic device. Therefore, in order to reduce the power consumption generated during the audio playback process, a method for controlling audio playback is urgently needed.

Summary of the invention

The present application provides a method for controlling audio playback, an electronic device, and a readable storage medium, which can be used to reduce the power consumption generated during audio playback. The technical solution is as follows:

In a first aspect, a method for controlling audio playback is provided, which is applied to an electronic device, and the method includes:

In response to an audio playback operation, when the electronic device is in a non-silent playback mode, transmitting audio data of a target audio to an audio power amplifier of the electronic device through an audio playback application to play the target audio, the audio power amplifier being in an on state before receiving the audio playback operation;

When the electronic device is switched from the non-silent playback mode to the silent playback mode, turning off the audio power amplifier and stopping transmitting the audio data of the target audio to the audio power amplifier;

The operation of transmitting the audio data of the target audio to the audio power amplifier is simulated so that the playing speed of the target audio does not change during the playing of the target audio.

In this way, when the electronic device is playing the target audio, if the electronic device is switched to the silent playback mode, the audio power amplifier can be turned off. When the audio power amplifier is in the off state, the audio power amplifier does not generate power consumption, thereby reducing the power consumption of the electronic device and improving the battery life of the electronic device. In addition, since the operation of transmitting audio data to the audio power amplifier can be simulated when the audio power amplifier is turned off, the target audio playback speed is avoided from changing, ensuring the normal playback of the target audio.

As an example of the present application, when the electronic device is switched from the non-silent playback mode to the silent playback mode, after turning off the audio power amplifier and stopping transmitting the audio data of the target audio to the audio power amplifier, it also includes:

When the electronic device switches from the silent play mode to the non-silent play mode, the audio power amplifier is turned on, and the transmission of the audio data of the target audio to the audio power amplifier is resumed.

In this way, when the electronic device is in a non-silent playback mode, the target audio can be played normally by turning on the audio power amplifier, thereby avoiding the occurrence of target audio playback errors.

As an example of the present application, when the electronic device is switched from the non-silent playback mode to the silent playback mode, before turning off the audio power amplifier and stopping transmitting the audio data of the target audio to the audio power amplifier, it also includes:

Acquire volume information of the target audio, where the volume information is used to indicate the current volume of the target audio;

When the volume information indicates that the current volume of the target audio is zero, determining a duration during which the volume is zero;

When the duration is greater than or equal to the duration threshold, it is determined that the electronic device is switched from the non-silent play mode to the silent play mode.

In this way, by detecting the duration of the volume being zero, frequent switching of the audio power amplifier can be avoided, thereby reducing damage to the audio power amplifier.

As an example of the present application, the electronic device includes a scene recognition module and a mute control module;

When the electronic device is switched from the non-silent play mode to the silent play mode, turning off the audio power amplifier and stopping transmitting the audio data of the target audio to the audio power amplifier comprises:

When the electronic device switches from the non-silent playback mode to the silent playback mode, the scene recognition module sends a silent control instruction to the silent control module;

In response to the mute control instruction, the mute control module sends a shutdown instruction to the audio power amplifier and discards the audio data transmitted from the audio playback application;

In response to the shut-down instruction, the audio power amplifier switches from the on state to the off state.

In this way, by sending a shutdown command to the audio power amplifier, the audio power amplifier is switched from an on state to an off state, thereby reducing the power consumption generated by the audio power amplifier, thereby reducing the power consumption of the electronic device and ensuring the battery life of the electronic device.

As an example of the present application, when the electronic device is switched from the non-silent playback mode to the silent playback mode, turning off the audio power amplifier and stopping transmitting the audio data of the target audio to the audio power amplifier include:

When the electronic device switches from the non-silent playback mode to the silent playback mode, if the target application identifier of the audio playback application exists in the preset whitelist, the audio power amplifier is turned off and the transmission of the target audio data to the audio power amplifier is stopped.

In this way, by setting a preset white list, the control of the audio power amplifier is made more targeted, thereby improving the accuracy of the mute control of the audio power amplifier.

As an example of the present application, the electronic device includes a scene recognition module and a whitelist control module;

When the electronic device is switched from the non-silent playback mode to the silent playback mode, if the target application identifier of the audio playback application program exists in the preset whitelist, before turning off the audio power amplifier and stopping transmitting audio data to the audio power amplifier, the method further includes:

The whitelist control module obtains the target application identifier;

When the target application identifier exists in the preset whitelist, the whitelist control module sends a match pass message to the scene recognition module, and the match pass message is used to indicate that the audio power amplifier is allowed to be turned off when the electronic device switches from the non-silent playback mode to the silent playback mode.

In this way, by identifying whether the target application identifier is in the preset whitelist, it can be quickly determined whether the audio power amplifier can be turned off when the electronic device is in the silent playback mode, thereby improving the efficiency of controlling the audio power amplifier.

As an example of the present application, the electronic device includes a mute control module;

The operation of simulating transmitting the audio data of the target audio to the audio power amplifier includes:

During the audio data transmission process, the mute control module starts a delay operation each time it receives a frame of audio data transmitted by the audio playback thread, and discards a frame of audio data currently received, wherein the audio playback application transmits the audio data of the target audio to the mute control module through the audio playback thread;

When the delay duration reaches the transmission duration, the mute control module sends feedback information to the audio playback thread. The transmission duration is the duration for the audio data of the target audio to be transmitted from the mute control module to the audio power amplifier. The feedback information is used to instruct the audio playback thread to continue transmitting the next frame of audio data.

In this way, by sending feedback information, the audio playback thread can accurately transmit the audio data and avoid abnormal progress bar of the target audio.

As an example of the present application, the mute control module includes an audio switch module and an audio simulation module;

During the audio data transmission process, the mute control module starts a delay operation each time it receives a frame of audio data transmitted by the audio playback thread, and discards a currently received frame of audio data, including:

During the audio data transmission process, the audio switch module sends a simulation message to the audio simulation module each time it receives a frame of audio data transmitted by the audio playback thread, and discards a currently received frame of audio data;

The audio simulation module starts to perform a delay operation when receiving the simulation message;

When the delay duration reaches the transmission duration, the mute control module sends feedback information to the audio playback thread, including:

When the delay duration reaches the transmission duration, the audio simulation module sends the feedback information to the audio playback thread.

In this way, the delay operation is performed through the audio simulation module, and feedback information is sent when the delay time reaches the transmission time, thereby ensuring the playback speed of the target audio and avoiding accelerated playback of the target audio.

In a second aspect, an electronic device is provided, wherein the structure of the electronic device includes a processor and a memory, wherein the memory is used to store a program that supports the electronic device to execute the audio playback control method provided in the first aspect, and to store data involved in implementing the audio playback control method described in the first aspect. The processor is configured to execute the program stored in the memory. The electronic device may also include a communication bus, wherein the communication bus is used to establish a connection between the processor and the memory.

In a third aspect, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is executed on a computer, the computer executes the audio playback control method described in the first aspect.

In a fourth aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the audio playback control method described in the first aspect.

The technical effects obtained by the above-mentioned second, third, fourth and fifth aspects are similar to the technical effects obtained by the corresponding technical means in the above-mentioned first aspect, and will not be repeated here.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of an application scenario provided by an embodiment of the present application;

FIG2 is a schematic diagram of an audio data transmission process provided by an embodiment of the present application;

FIG3 is a block diagram of a software system of an electronic device provided in an embodiment of the present application;

FIG4 is a flow chart of a method for controlling audio playback provided in an embodiment of the present application;

FIG5 is a schematic diagram of a scene recognition process provided by an embodiment of the present application;

FIG6 is a flow chart of another method for controlling audio playback provided in an embodiment of the present application;

FIG7 is a schematic diagram of a flow chart of a loop thread provided in an embodiment of the present application;

FIG8 is a schematic diagram of a mute control process provided in an embodiment of the present application;

FIG. 9 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

DETAILED DESCRIPTION

In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

It should be understood that the "multiple" mentioned in this application refers to two or more. In the description of this application, unless otherwise specified, "/" means or, for example, A/B can mean A or B; "and/or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and/or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in order to facilitate the clear description of the technical solution of this application, the words "first" and "second" are used to distinguish between the same or similar items with basically the same functions and effects. Those skilled in the art can understand that the words "first" and "second" do not limit the quantity and execution order, and the words "first" and "second" do not limit them to be different.

References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

In an application scenario, a user may play audio or video while using an electronic device such as a mobile phone or tablet computer. During the process of playing audio or video, the audio or video may be played in a silent mode for some reasons. For example, referring to (a) or (b) in FIG. 1, after a user opens an application that can play videos, such as a video application, if the video is set to be automatically previewed, the video can be automatically played in a silent mode when it is located at a specified position of the video display interface. For example, in (a) in FIG. 1, the video named "Surpassing Self" is located at the top of the video display interface and is played in a silent mode; in (b) in FIG. 1, the video uploaded by user c is displayed in the middle of the screen and is played in a silent mode. When the video is played in a silent mode, the video screen is in a normal playing state and the audio in the video is in a silent state, that is, the user can see that the video is in a playing state but cannot hear the audio in the video. In this case, the audio data of the audio in the video will still be transmitted normally, that is, the audio data can be transmitted from the video application to the audio power amplifier, and the audio power amplifier transmits the processed audio data to the speaker of the electronic device for playback, so that the audio power amplifier will still generate power consumption, which increases the power consumption of the electronic device, which is not conducive to the battery life of the electronic device. For example, referring to Figure 2, in response to the playback operation of the target video, the video application can transmit the audio data to the audio power amplifier in the hardware layer through the framework layer, the HAL layer and the kernel layer. The audio power amplifier can process the received audio data and transmit the processed audio data to the speaker, so that the speaker plays the target audio silently. Since the audio power amplifier is always in a working state, the audio power amplifier will still generate power consumption, which increases the power consumption of the electronic device, which is not conducive to the battery life of the electronic device.

In order to reduce the power consumption of an electronic device during silent audio playback, an embodiment of the present application provides a method for controlling audio playback, in which, during the process of transmitting audio data to an audio power amplifier through an audio playback application, if the electronic device switches from a non-silent playback mode to a silent playback mode, the audio power amplifier can be turned off and the transmission of audio data to the audio power amplifier can be stopped. At the same time, in order to prevent the playback speed of the target audio from changing during the playback of the target audio, the operation of transmitting audio data to the audio power amplifier can also be simulated. Since during the process of the electronic device playing the target audio, if the electronic device switches to a silent playback mode, the audio power amplifier can be turned off, and when the audio power amplifier is in the off state, the audio power amplifier does not generate power consumption, thereby reducing the power consumption of the electronic device and improving the battery life of the electronic device.

Next, the software system of the electronic device 100 will be described.

The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software system of the electronic device 100.

FIG3 is a block diagram of a software system of an electronic device 100 provided in an embodiment of the present application. Referring to FIG3 , the layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the framework layer (also referred to as the local framework layer or native layer), the Android runtime (Android runtime) and the system layer, and the kernel layer.

The application layer may include a series of application packages. As shown in FIG3 , the application package may include applications such as gallery, music, video, shopping, etc.

As an example, the framework layer may also include a scene recognition module, a whitelist control module, and an audio playback thread; the whitelist control module is used to identify whether the application identifier of the application currently transmitting audio data is in a preset whitelist. The audio playback thread is used to transmit the audio data of the currently playing audio. The scene recognition module is used to identify the scene of the currently playing audio. For example, the scene recognition module can identify whether it is currently in silent playback mode, whether the application identifier of the application currently playing audio is in the whitelist, whether the audio is played through the speaker of the electronic device 100, etc., and send a mute control instruction to the HAL layer when it is identified that it is currently in silent playback mode, and/or the application identifier of the application currently playing audio is in the whitelist, and/or the audio is played through the speaker.

As an example, the whitelist control module includes an application identification acquisition module, a whitelist matching module and an information transmission module. The application identification acquisition module is used to identify the application identification of the application currently transmitting audio data, and send the identified application identification to the whitelist matching module, and the application identification acquisition module is also used to send the whitelist matching result to the information transmission module when receiving the whitelist matching result returned by the whitelist matching module; the whitelist matching module is used to store a preset whitelist, and identify whether the application identification of the application sent by the application identification acquisition module is in the whitelist, and after obtaining the whitelist matching result, return the whitelist matching result to the application identification acquisition module; the information transmission module is used to forward the whitelist matching result to the scene recognition module.

In some embodiments, the HAL layer includes a mute control module and an audio writing module, wherein the audio writing module is used to receive audio data written by the audio playback thread and pass the audio data to the mute control module. The mute control module is used to send a shutdown instruction to the audio power amplifier of the hardware layer and discard the audio data transmitted by the audio writing module when receiving the mute control instruction.

As an example of the present application, the mute control module may include a mute switch module and an audio simulation module. The mute switch module is used to send a shutdown instruction to the audio power amplifier of the hardware layer, discard the audio data transmitted by the audio write module, and send an analog message to the audio simulation module. The audio simulation module is used to perform a delay operation, and when the delay time reaches the time it takes for the audio data to be transmitted from the mute control module to the audio power amplifier, feedback information is sent to the audio playback thread.

Exemplarily, referring to FIG3 , the mute switch module may further include an audio switch module and an audio control module. The audio control module is used to send a shutdown instruction to the audio power amplifier of the hardware layer, send an analog message to the audio simulation module, and send a stop transmission instruction to the audio switch module when receiving a mute control instruction. The audio switch module is used to discard the audio data transmitted by the audio write module when receiving a stop transmission instruction.

The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

The hardware layer may include a digital signal processing chip (Digital Singal Processor, DSP), an audio power amplifier, a speaker, etc. Among them, the audio power amplifier may enter a closed state from an open state when receiving a close instruction.

In order to clearly understand the embodiments of the present application, the transmission path of audio data when the audio power amplifier is in different states is described below.

In some embodiments, when the audio power amplifier is in the on state, the application currently playing audio can transmit audio data to the audio playback thread, the audio playback thread transmits the received audio data to the audio write module, the audio write module transmits the audio data to the audio switch module in the mute control module, the audio switch module transmits the audio data to the DSP through the kernel layer, the DSP transmits the audio data to the audio power amplifier, and after the audio power amplifier processes the audio data, it transmits the processed audio data to the speaker for playback.

In some embodiments, when the audio power amplifier is in the off state, the application currently playing audio transmits the audio data to the audio playback thread, the audio playback thread transmits the received audio data to the audio write module, the audio write module transmits the audio data to the audio switch module in the mute control module, and the audio switch module discards the received audio data.

It should be noted that in FIG. 3 , the transmission line of the audio data is represented by a solid arrow, and the transmission line of the control signal is represented by a dotted arrow.

Next, the control method of audio playback provided by the embodiment of the present application is introduced. Here, an electronic device plays the target audio silently through an audio application as an example. Please refer to Figure 4, which is a flow chart of a control method of audio playback according to an exemplary embodiment. The method can be executed by the above-mentioned electronic device, and the electronic device can be implemented by the interaction of multiple modules shown in Figure 3. The method may include some or all of the following contents:

Step 401: The audio application receives an audio playing operation.

When using an electronic device, a user may play the target audio through a music application or a video application. In this case, the user can trigger the audio playback operation. Alternatively, some video applications provide a function of previewing videos in silence, that is, when the target video is at a specified position on the display screen on a video browsing page, it can be automatically previewed and played in silence. In this case, the audio playback operation can also be triggered. For example, the scene can be shown in FIG. 1. When the audio playback operation is triggered, the audio application can receive the audio playback operation.

It should be noted that in the embodiment of the present application, the audio application is an application that can play audio, such as a video application, a music application, a shopping application, a short video application, etc. The embodiment of the present application does not impose any specific restrictions on this.

As an example, the audio power amplifier is turned on before the audio application receives an audio playback operation.

Step 402: In response to the audio playback operation, the audio application transmits audio data to the audio playback thread.

Step 403: The audio playback thread transmits audio data to the audio writing module.

Step 404: The audio writing module transmits the audio data to the mute switch module.

Step 405: During the audio data transmission process, the application identification acquisition module acquires the application identification of the audio application program currently transmitting the audio data.

A whitelist may be provided in the electronic device. In this case, when the audio application responds to the audio playing operation, the application identification acquisition module may acquire the application identification of the audio application currently transmitting the audio data.

In the case that there are currently multiple audio applications transmitting audio data, the application identification acquisition module may acquire the application identification of each audio application in the multiple audio applications.

Step 406: The application identifier acquisition module sends the acquired application identifier to the whitelist matching module.

As can be seen from the above, the whitelist matching module stores a preset whitelist, and the application identifiers stored in the preset whitelist are application identifiers of applications that can allow the audio power amplifier to be turned off during the use of the corresponding application. Therefore, the application identifier acquisition module can send each acquired application identifier to the whitelist matching module.

It should be noted that the preset whitelist can be preset during the development of the electronic device, or it can be actively set by the user during the use of the electronic device. In other words, the preset whitelist is preset during the development of the electronic device, and the preset whitelist allows the user to edit it during use, for example, allowing the user to add application identifiers to the preset whitelist, delete application identifiers, etc.

Step 407: The whitelist matching module identifies whether the received application identifier is in a preset whitelist.

As an example, when the whitelist matching module receives the application identifier sent by the application identifier acquisition module, it can traverse the preset whitelist. When the received application identifier exists in the preset whitelist, it determines that the received application identifier matches the preset whitelist; when the received application identifier does not exist in the preset whitelist, it determines that the received application identifier does not match the preset whitelist.

From the above, it can be seen that there may be multiple audio applications currently playing audio data. In this case, the whitelist matching module may receive multiple application identifiers. When each of the multiple application identifiers exists in the preset whitelist, it can be determined that the received multiple application identifiers match the preset whitelist; when at least one application identifier among the multiple application identifiers is not in the preset whitelist, it is determined that the multiple application identifiers do not match the preset whitelist.

Step 408: When the received application identifier is in the preset whitelist, the whitelist matching module sends a matching message to the application identifier acquisition module.

In a possible case, when there is an application identifier that is not in the preset whitelist among the received application identifiers, the whitelist matching module sends a non-matching message to the application identifier obtaining module.

Step 409: The application identification acquisition module sends a matching message to the information transmission module.

In one possible case, the application identification acquisition module may receive a mismatch message, in which case the application identification acquisition module may send the mismatch message to the information delivery module, or may not send any message to the information delivery module. In the embodiment of the present application, sending a mismatch message to the information delivery module is used as an example for explanation.

In another possible case, when the whitelist matching module obtains the whitelist matching result, it can directly send the whitelist matching result to the information transmission module, and the whitelist matching result includes that the received application identifiers have application identifiers that are not in the preset whitelist, or the received application identifiers are in the preset whitelist. Exemplarily, when the received application identifier is in the preset whitelist, the whitelist matching module sends a matching message to the information transmission module; when the received application identifiers have application identifiers that are not in the preset whitelist, the whitelist matching module sends a non-matching message to the information transmission module.

Step 410: The information transfer module sends a matching message to the scene recognition module.

In one possible case, the information transmission module may also receive a non-matching message. In this case, the information transmission module may send the non-matching message to the scene recognition module.

Step 411: During the audio data transmission process, the scene recognition module identifies whether the current mode is silent playback.

It should be noted that the embodiment of the present application does not specifically limit the order of executing step 403, step 405, and step 411. That is, in the process of executing step 403, the operations of step 405 and step 411 can be executed simultaneously, or, in the process of executing step 403, the operation of step 405 is executed first, and then the operation of step 411 is executed, or, in the process of executing step 403, the operation of step 411 is executed first, and then the operation of step 403 is executed. The embodiment of the present application does not specifically limit this.

In some embodiments, the scene recognition module can obtain volume information of the currently played audio from the framework layer, and the volume information is used to indicate the volume of the currently played audio. If the volume information obtained indicates that the volume of the currently played audio is zero, it can be determined that the current silent playback mode is in progress. If the volume information obtained indicates that the volume of the currently played audio is not zero, it can be determined that the current non-silent playback mode is in progress.

Since the audio may be played through multiple audio applications at present, the audio data of multiple audios may be transmitted in the audio playback thread. In this case, the scene recognition module can determine that it is currently in silent playback mode when it recognizes that the volume of multiple audios is zero. The scene recognition module can determine that it is currently in non-silent playback mode when it recognizes that the volume information of one of the audios indicates that the volume of the audio is not zero. Exemplarily, in the case where the electronic device plays the first audio through a music application, if the user opens a video application, the electronic device may perform a silent preview of the first video while displaying the video browsing interface of the video application. In this case, the scene recognition module recognizes that the volume information of the second audio in the first video indicates that the volume of the second audio is zero, and recognizes that the volume information of the first audio indicates that the volume of the first audio is not zero. Therefore, the scene recognition module can determine that it is currently in non-silent playback mode.

In some embodiments, when the scene recognition module recognizes that the volume information indicates that the volume of the currently playing audio is zero, it can also determine the duration of the volume being zero; when the duration is greater than or equal to a duration threshold, it is determined that the current playback mode is silent; when the duration is less than the duration threshold, it is determined that the current playback mode is non-silent.

It should be noted that the duration threshold can be pre-set according to needs, for example, the duration threshold can be 10 seconds, 20 seconds, 30 seconds, etc.

In some embodiments, a time threshold (Threshold) can be set in the scene recognition module. During the audio data transmission process, if it is detected that the volume of the currently played audio is zero, it can be detected whether the time threshold is less than or equal to 0. If the time threshold is greater than 0, 1 is subtracted from the current time threshold, and the volume of the currently played audio is continuously detected to be zero. Until it is detected that the time threshold is less than or equal to 0, it is determined that the duration of the volume being zero is greater than or equal to the duration threshold. The initial size of the time threshold is the same as the duration threshold, that is, the size of the time threshold initialized is the size of the duration threshold.

In some embodiments, the scene recognition module can not only obtain volume information, but also obtain other audio playback information, for example, it can also obtain the audio playback mode (i.e., whether the audio is played by headphones or speakers, etc.) and audio data type, etc.

As an example, the audio playback information is carried in the currently transmitted audio data, so the scene recognition module can obtain the audio playback information from the framework layer. Exemplarily, if the scene recognition module obtains "SPEAKER==ture" from the framework layer, it can be determined that the audio is currently being played through the speaker, and if it obtains "CVOL==0", it can be determined that the volume of the currently played audio is zero.

Since electronic devices also transmit audio data during the communication process, the scene recognition module can also detect whether the currently transmitted audio data is not the audio data transmitted during the communication process, that is, identify the audio data type. For example, when the scene recognition module obtains "MODE!=IN_CALL", "MODE!=COMMUNICATION" and "STREAM==MUSIC" from the framework layer, it can be determined that the currently transmitted audio data is not the audio data in the audio communication process.

In some embodiments, the scene recognition module may perform the following step 412 when it is recognized that the audio is currently in silent playback mode, or it may perform the following step 412 when it is recognized that the audio is currently in silent playback mode and is currently played by a speaker, and the audio data is not audio data transmitted during audio communication. Otherwise, this operation ends. Exemplarily, when the scene recognition module recognizes that the audio is currently in silent playback mode, if the audio is currently played through the speaker of the electronic device, the scene recognition module may perform the following step 412. If the audio is currently played through headphones, the scene recognition module may not perform any processing.

Step 412: When the scene recognition module recognizes that the current mode is silent playback, if a matching message is received, the scene recognition module sends a silent control instruction to the silent switch module.

As an example, the scene recognition module may send a mute control instruction to the mute switch module through a parameter setting function, where the parameter setting function may be a setparameter function. The mute control instruction may carry a mute state flag, for example, the mute state flag may be flag==1.

In one possible case, when the scene recognition module recognizes that the current mode is mute playback, if a mismatch message is received, the scene recognition module does not perform any processing when the audio power amplifier is in the on state, that is, does not send a mute control instruction to the mute switch module. When the audio power amplifier is in the off state, the scene recognition module can perform the following step 417.

In some embodiments, there may not be a preset whitelist in the electronic device. In the absence of a preset whitelist, the scene recognition module may send a mute control instruction to the mute switch module when recognizing that the current mode is mute playback.

Step 413: upon receiving the mute control instruction, the mute switch module sends a close instruction to the audio power amplifier, sends an analog message to the audio analog module, and stops sending audio data to the audio power amplifier.

Since the audio data is transmitted normally during the process of the scene recognition module identifying whether the current mode is silent playback, and the silent control instruction carries a silent status flag, when the silent switch module receives the silent control instruction, if it obtains the silent status flag from the silent control instruction, it can send a shutdown command to the audio power amplifier, send an analog message to the audio simulation module, and stop sending audio data to the audio power amplifier.

Exemplarily, the mute switch module may call a HAL layer interface, such as calling a Standby() interface to turn off the audio power amplifier.

In some embodiments, the mute switch module may stop sending audio data to the audio power amplifier by discarding currently received audio data, or by other means.

In some embodiments, the mute switch module may include an audio switch module and an audio control module. The audio control module may receive a mute control instruction. When receiving the mute control instruction, the audio control module may send a shutdown instruction to the audio power amplifier, send an analog message to the audio analog module, and send a stop transmission message to the audio switch module. When receiving the stop transmission message, the audio switch module sets a first stop flag and stops sending audio data to the audio power amplifier. The first stop flag is used to instruct the audio switch module to stop sending audio data to the audio power amplifier when receiving audio data.

Step 414: The audio power amplifier switches from the on state to the off state in response to the off instruction.

Step 415: The audio simulation module starts to perform a delay operation when receiving the simulation message.

As an example, when the audio simulation module receives a simulated message, it can determine the transmission duration through a simulation function and perform a delay operation through a delay function. The simulation function can be MockWriteDelay(), and the delay function can be Usleep(SleepTimeUs). The embodiments of the present application do not impose any specific restrictions on this.

In some embodiments, the audio simulation module may start a delay operation when receiving a simulation message, or may perform a delay operation in other situations. Exemplarily, when the mute switch module receives a mute control instruction, it may send a shutdown instruction to the audio power amplifier, and send audio data and a second stop mark to the audio simulation module, the second stop mark being used to instruct the audio simulation module to perform a delay operation and stop sending audio data to the audio power amplifier. When the audio simulation module receives the audio data and the second stop mark, it performs a delay operation and stops sending audio data to the audio power amplifier.

As can be seen from the above, the mute switch module can include an audio switch module and an audio control module. When the audio simulation module is instructed to perform a delay operation through the second stop mark, the audio control module can send a shutdown command to the audio power amplifier and send a stop transmission message to the audio switch module when the mute control instruction is received. When the audio switch module receives the stop transmission message, it sends audio data and the second stop mark to the audio simulation module; when the audio simulation module receives the audio data and the second stop mark, it performs a delay operation and stops sending audio data to the audio power amplifier.

Step 416: When the delay duration reaches the transmission duration, the audio simulation module sends feedback information to the audio playback thread.

It should be noted that the transmission duration is the duration for the audio data of the target audio to be transmitted from the mute control module to the audio power amplifier, and the feedback information is used to instruct the audio playback thread to continue transmitting the next frame of audio data.

Since it takes a certain amount of time for the audio data to be transmitted from the audio switch module to the audio power amplifier, and after the audio data is transmitted to the bottom layer (such as the hardware layer), the bottom layer module can send feedback information to the audio playback thread to instruct the audio playback thread to continue transmitting the audio data. If the mute switch module stops transmitting the audio data to the bottom layer, the mute switch module will directly send feedback information to the audio playback thread. The audio playback thread can continue to transmit the audio data when receiving the feedback information. In this way, the audio playback thread transmits the audio data almost uninterruptedly, and soon all the audio data of the currently played audio will be transmitted. After the audio power amplifier is restored later, the audio data cannot be played, or the progress of the audio playback will be accelerated. If the audio is the audio in the video, then because the video frame will follow the timing of the audio frame, when the progress of the audio playback is accelerated, the video frame playback speed will be accelerated, resulting in frame loss during the video playback process. Therefore, when the audio power amplifier is turned off, the audio simulation module needs to simulate the operation of transmitting the audio data of the target audio to the audio power amplifier. That is, the audio simulation module can start the delay operation when receiving the simulation message, and send feedback information to the audio playback thread when the delay time reaches the transmission time.

Step 417: When the scene recognition module recognizes that the silent playback mode is switched to the non-silent playback mode, the scene recognition module sends a mute release instruction to the mute switch module.

Since the user may turn on the volume of the electronic device when the electronic device is in the silent playback mode, in this case, the electronic device will switch from the silent playback module to the non-silent playback module. When the electronic device is in the non-silent playback mode, the audio power amplifier is required to process the audio data. Therefore, when the scene recognition module recognizes that the silent playback mode is switched to the non-silent playback mode, it can send a mute release instruction to the mute switch module. The mute release instruction can carry a non-silent state flag, for example, the non-silent state flag carried can be flag==0.

In order to facilitate the understanding of the scene recognition process, the embodiment of the present application provides a scene recognition process diagram. For example, see Figure 5. Step B1: During the audio data transmission process, the scene recognition module detects whether the currently transmitted audio data is audio data that meets the mute control condition. If not, the operation of the following step B8 is performed. If so, the operation of the following step B2 is performed. Step B2: The whitelist control module detects whether the application identifier of the application currently transmitting the audio data is located in the preset whitelist. If so, the operation of the following step B3 is performed. If not, the operation of the following step B8 is performed. Step B3: The scene recognition module determines whether the time threshold is less than or equal to zero. If so, the following step B4 is performed. If not, the operation of the following step B5 is performed. Step B4: The scene recognition module determines whether the audio power amplifier is currently in the off state. If so, the current scene recognition is terminated. If not, the operation of the following step B6 is performed. Step B5: Subtract 1 from the time threshold and return to the operation of step B1. Step B6: The scene recognition module sends a mute control instruction to the mute switch module, wherein the mute control instruction can be expressed in the form of a parameter of the function setparameter, and the parameter can be client_zero_volume=true. Step B7: The scene recognition module initializes the size of the time threshold to the duration threshold. Step B8: The scene recognition module determines whether the audio power amplifier is currently in the off state. If not, the scene recognition is terminated. If so, the operation of the following step B9 is performed. Step B9: The scene recognition module sends a mute release instruction to the mute switch control module, wherein the mute release instruction can also be expressed in the form of a parameter of the function setparameter, and the parameter can be client_zero_volume=false.

It should be noted that the mute control conditions include that the audio data is played by a speaker, the volume of the audio data is zero, and the audio data is not audio data transmitted during the communication process.

Step 418: When receiving the mute release instruction, the mute switch module sends a start instruction to the audio power amplifier, sends a cancel simulation message to the audio simulation module, and transmits the received audio data to the audio power amplifier.

As an example, the mute switch module may transmit the audio data to the DSP through the kernel layer, and the DSP may transmit the received audio data to the audio power amplifier.

Since there is no need to simulate the audio data transmission process when the audio data is transmitted normally, the mute switch module can send a simulation cancellation message to the audio simulation module when receiving the mute release instruction.

Step 419: The audio simulation module stops the simulation of audio data transmission.

Step 420: The audio power amplifier processes the received audio data and sends the processed audio data to the speaker so that the speaker plays the audio.

In the embodiment of the present application, since the audio power amplifier can be turned off when the electronic device is switched to the silent playback mode during the process of playing the target audio, the audio power amplifier will not generate power consumption when the audio power amplifier is in the off state, thereby reducing the power consumption of the electronic device and improving the battery life of the electronic device. In addition, since the operation of transmitting audio data to the audio power amplifier can be simulated when the audio power amplifier is turned off, the target audio playback speed is avoided from changing, and the target audio is ensured to be played normally.

Next, another method for controlling audio playback provided by an embodiment of the present application is introduced. Please refer to Figure 6, which is a flow chart of a method for controlling audio playback according to an exemplary embodiment. As an example but not a limitation, Figure 6 takes the method applied to an electronic device as an example for explanation, and the method may include some or all of the following contents:

Step 601: In response to an audio playback operation, when the electronic device is in a non-silent playback mode, audio data of a target audio is transmitted to an audio power amplifier of the electronic device through an audio playback application to play the target audio.

It should be noted that the audio power amplifier is in an on state before receiving the audio playback operation.

Since users may need to play audio when using electronic devices, in this case, the user can trigger an audio playback operation in an audio playback application, the electronic device can receive the audio playback operation, and transmit audio data in response to the audio playback operation, and since the electronic device is in a non-silent state, i.e., a non-silent playback mode, the audio data can be transmitted from the audio playback application to the audio power amplifier.

As an example, the situation that the electronic device is in a non-silent playing mode refers to a situation that the volume of any one of at least one audio currently played by the electronic device is not zero.

In some embodiments, there is a threadloop in the framework layer of the electronic device, and the process of the threadloop will be executed regardless of the playback mode of the electronic device.

Exemplarily, referring to FIG. 7 , the process of the loop thread includes: step A: detecting whether there is audio data transmission, that is, detecting whether an audio playback operation is received; if not, continuing to detect; if present, the operation of step B can be performed; step B: identifying the current playback mode of the electronic device, and controlling the switch of the audio power amplifier according to the playback mode; step C: mixing the currently played audio data through the audio playback thread (i.e., threadloop_mix); step D: writing the audio data after mixing (i.e., threadloop_write), and returning to the operation of step A, wherein the writing data process refers to writing the audio data to the HAL layer. In addition, the process of the threadloop may also include other steps, and the embodiments of the present application will not be given examples one by one.

Exemplarily, the specific operations of the electronic device in executing step B may refer to the operations of step B1 to step B9 in FIG. 5 , or refer to the operations of step 602 to step 605 described below, which will not be described one by one in the embodiments of the present application.

Step 602: Obtain volume information of the target audio.

It should be noted that the volume information is used to indicate the current volume of the target audio.

Since the electronic device may perform some operations during the process of playing the target audio, causing the volume of the target audio to become zero, in order to timely confirm the playing mode of the electronic device, the electronic device may obtain the volume information of the target audio during the process of transmitting audio data.

Exemplarily, the operation of the electronic device obtaining the volume information of the target audio may refer to the operation of step 411 above, which will not be described in detail in the embodiment of the present application.

As an example, the audio data includes not only volume information but also other audio playback information, such as the playback mode of the current audio data, whether the current audio data is the audio data transmitted during the communication process, etc. Therefore, the electronic device can not only obtain the volume information in the frame frame, but also obtain other audio playback information.

Step 603: When the volume information indicates that the current volume of the target audio is zero, determine the duration of the zero volume.

In order to avoid damage to the audio power amplifier due to frequent switching of the audio power amplifier, when the volume information indicates that the current volume of the target audio is zero, the electronic device can also determine the duration of the zero volume.

As an example, when the volume information indicates that the current volume of the target audio is zero, the electronic device may also directly determine that the electronic device is switched from a non-silent playback mode to a silent playback mode.

Step 604: when the duration is greater than or equal to the duration threshold, determine that the electronic device is switched from the non-silent play mode to the silent play mode.

As an example of the present application, the electronic device can detect whether the duration of the audio volume being zero is greater than or equal to the duration threshold by setting a time threshold. Exemplarily, this operation can refer to the operation of step 411 above, and the embodiments of the present application will not be described in detail.

It is worth noting that by detecting the duration of the volume being zero, frequent switching of the audio power amplifier can be avoided, thereby reducing damage to the audio power amplifier.

Step 605: When the electronic device switches from the non-silent play mode to the silent play mode, the audio power amplifier is turned off, and the transmission of the audio data of the target audio to the audio power amplifier is stopped.

Since the electronic device is in silent playback mode, the user cannot hear the played audio, and the electronic device does not need to process the received audio data through the audio power amplifier. Therefore, in order to reduce the power consumption of the electronic device, the electronic device can turn off the audio power amplifier. Since the audio power amplifier cannot receive audio data when the audio power amplifier is turned off, the electronic device can stop transmitting the audio data of the target audio to the audio power amplifier.

From the above, it can be seen that the electronic device includes a scene recognition module and a mute control module; thus, when the electronic device switches from a non-silent playback mode to a silent playback mode, the electronic device turns off the audio power amplifier and stops transmitting the audio data of the target audio to the audio power amplifier. The operations include: the scene recognition module sends a mute control instruction to the mute control module; in response to the mute control instruction, the mute control module sends a shutdown instruction to the audio power amplifier and discards the audio data transmitted from the audio playback application; in response to the shutdown instruction, the audio power amplifier switches from an on state to an off state.

It should be noted that since the audio playback application can transmit audio data to the audio playback thread, the audio playback thread can transmit the audio data to the audio writing module, and the audio writing module can transmit the audio data to the mute control module, and when the mute control module sends a shutdown command to the audio power amplifier, it means that the audio power amplifier will be in a shutdown state subsequently and the audio power amplifier will no longer receive audio data. Therefore, there is no need for the mute control module to continue transmitting audio data, and the mute control module can discard the audio data transmitted by the audio playback application.

It is worth noting that by sending a shutdown command to the audio power amplifier, the audio power amplifier is switched from an on state to an off state, thereby reducing the power consumption generated by the audio power amplifier, thereby reducing the power consumption of the electronic device and ensuring the battery life of the electronic device.

In some embodiments, the mute control module may include a mute switch module and an audio simulation module. In response to the mute control instruction, the mute switch module may send a shutdown instruction to the audio power amplifier, discard the audio data transmitted from the audio playback application, and send a simulation message to the audio simulation module. The simulation message is used to instruct the audio simulation module to simulate the operation of transmitting the target audio data to the audio power amplifier. The simulation operation can refer to the operation of step 606 described below.

In some embodiments, a preset whitelist may also be stored in the electronic device. In this way, when the electronic device switches from a non-silent playback mode to a silent playback mode, the electronic device can detect whether there is a target application identifier of the audio playback application in the preset whitelist. If there is a target application identifier of the audio playback application in the preset whitelist, the audio power amplifier is turned off and the transmission of audio data of the target audio to the audio power amplifier is stopped.

It should be noted that the preset whitelist is a pre-set whitelist, and the preset whitelist can be edited by the user.

It is worth noting that by setting a preset whitelist, the control of the audio power amplifier is made more targeted, thereby improving the accuracy of the mute control of the audio power amplifier.

From the above, it can be seen that the electronic device includes a scene recognition module and a whitelist control module; in this way, the whitelist control module can obtain the target application identifier; when the target application identifier exists in the preset whitelist, the whitelist control module sends a match pass message to the scene recognition module, and the match pass message is used to indicate that the audio power amplifier is allowed to be turned off when the electronic device switches from a non-silent playback mode to a silent playback mode.

As can be seen from Figure 3 above, the whitelist control module includes an application identification acquisition module, a whitelist matching module and an information transmission module. In this way, the application identification acquisition module can identify the target application identification and send the identified target application identification to the whitelist matching module; the whitelist matching module can identify whether the target application identification is in the preset whitelist, and if the target application identification is in the preset whitelist, send a match passed message to the application identification acquisition module, and if the target application identification is not in the preset whitelist, send a match failed message to the application identification acquisition module. When the application identification acquisition module receives a match passed message or a match failed message, it can forward the received message to the information transmission module; the information transmission module can send the received message to the scene recognition module.

It is worth noting that by identifying whether the target application identifier is in the preset whitelist, it can be quickly determined whether the audio power amplifier can be turned off when the electronic device is in silent playback mode, thereby improving the efficiency of controlling the audio power amplifier.

Step 606: Simulate the operation of transmitting the audio data of the target audio to the audio power amplifier, so that the playback speed of the target audio does not change during the playback of the target audio.

Since the audio data needs to return feedback information to the audio playback thread during the transmission process, the feedback information can ensure that the playback timing of the target audio is normal, that is, the playback speed of the target audio does not change during the playback, or the target audio will not actively play at double the speed. Therefore, in order to ensure the normal playback timing of the target audio, the electronic device can also simulate the operation of transmitting the audio data of the target audio to the audio power amplifier when the audio power amplifier is turned off.

From the above, it can be seen that the electronic device includes a mute control module, so that the operation of simulating the transmission of audio data of the target audio to the audio power amplifier includes: during the audio data transmission process, the mute control module starts a delay operation every time it receives a frame of audio data transmitted by the audio playback thread, and discards the currently received frame of audio data, wherein the audio playback application transmits the audio data of the target audio to the mute control module through the audio playback thread; when the delay duration reaches the transmission duration, the mute control module sends feedback information to the audio playback thread, and the transmission duration is the duration for the audio data of the target audio to be transmitted from the mute control module to the audio power amplifier, and the feedback information is used to instruct the audio playback thread to continue transmitting the next frame of audio data.

During the audio data transmission process, the audio data will be transmitted to the mute control module normally, but the mute control module will no longer transmit the audio data to the audio power amplifier. Therefore, in order to avoid transmitting the audio data too quickly and thus speeding up the playback speed of the target audio, the mute control module can perform a delay operation and send feedback information to the audio playback thread when the delay time reaches the transmission time.

It is worth noting that by sending feedback information, the audio playback thread can accurately transmit audio data and avoid abnormal progress bar of the target audio.

In some embodiments, the mute control module may include a mute switch module and an audio simulation module; thus, during the audio data transmission process, the mute switch module may send an analog message to the audio simulation module and discard the currently received frame of audio data each time it receives a frame of audio data transmitted by the audio playback thread; the audio simulation module starts a delay operation when it receives the analog message; when the delay duration reaches the transmission duration, the audio simulation module sends feedback information to the audio playback thread.

As an example, when the audio simulation module receives a simulation message, it can calculate the delay duration, then perform a delay operation, and send feedback information to the audio playback thread when the delay duration reaches the transmission duration.

It should be noted that the audio simulation module calculates the delay duration very quickly, so the duration of the calculation process can be ignored.

In some embodiments, the audio simulation module can obtain the number of bytes of a frame of audio data, the number of transmission channels of the audio data and the sampling rate, etc. Based on the number of bytes of a frame of audio data, the number of transmission channels of the audio data and the sampling rate, etc., the number of bytes transmitted per second can be determined, and then the number of bytes of a frame of audio data can be added to the number of bytes transmitted per second to obtain the transmission duration.

It is worth noting that the delay operation is performed through the audio simulation module, and feedback information is sent when the delay time reaches the transmission time, thereby ensuring the playback speed of the target audio and avoiding accelerated playback of the target audio.

In some embodiments, during the process of playing the target audio, when the electronic device switches from the silent playback mode to the non-silent playback mode, the electronic device can turn on the audio power amplifier and resume transmitting audio data of the target audio to the audio power amplifier.

It is worth noting that when the electronic device is in a non-silent playback mode, the target audio can be played normally by turning on the audio power amplifier, thereby avoiding the occurrence of target audio playback errors.

In some embodiments, during the process of playing the target audio, if new audio is added for playback and the electronic device is in silent playback mode, but the application identifier of the application of the added audio is not in the preset whitelist, the electronic device can turn on the audio power amplifier.

As an example, when the scene recognition module detects that the volume level in the audio data is not zero, it can determine that the electronic device has switched from the silent playback mode to the non-silent playback mode. In this case, the scene recognition module can send a mute release instruction to the mute control module; the mute control module responds to the mute release instruction by sending a start instruction to the audio power amplifier, cancels the simulation operation of transmitting audio data to the audio playback amplifier, and resumes transmitting the target audio data to the audio power amplifier.

In order to facilitate understanding of the audio transmission process in the present application, an embodiment of the present application provides a schematic diagram of a mute control process, see Figure 8, step F: when the electronic device detects that the audio data is written to the HAL layer, it detects whether the mute switch module receives the mute control instruction. If so, it executes the operation of the following step G, if not, it executes the operation of the following step J. Step G: When it is detected that the mute switch module receives the mute control instruction, the electronic device sends a shutdown instruction to the audio power amplifier through the mute switch module, and sends an analog message to the audio simulation module through the mute switch module. Step H: When the electronic device receives the analog message through the audio simulation module, it calculates the transmission duration. Step I: The electronic device performs a delay operation through the audio simulation module, and sends feedback information to the audio playback thread when the delay duration reaches the transmission duration. Step J: The electronic device transmits audio data to the audio power amplifier through the mute switch module.

In the embodiment of the present application, since the audio power amplifier can be turned off when the electronic device is switched to the silent playback mode during the process of playing the target audio, the audio power amplifier will not generate power consumption when the audio power amplifier is in the off state, thereby reducing the power consumption of the electronic device and improving the battery life of the electronic device. In addition, since the operation of transmitting audio data to the audio power amplifier can be simulated when the audio power amplifier is turned off, the target audio playback speed is avoided from changing, and the target audio is ensured to be played normally.

Next, the electronic device involved in the embodiment of the present application is described.

The method provided in the embodiment of the present application can be executed by an electronic device, and the electronic device supports an audio playback function. As an example and not a limitation, the electronic device can be, but is not limited to, a tablet computer, a desktop, a laptop, a handheld computer, a notebook computer, a netbook, an augmented reality (AR)\virtual reality (VR) device, a mobile phone, etc., and the embodiment of the present application does not limit this.

9 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Referring to FIG9 , the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna S1, an antenna S2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and/or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces, such as an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (SIM) interface, and/or a universal serial bus (USB) interface, etc.

The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple groups of I2S interfaces. The processor 110 can be coupled to the audio module 170 via the I2S interface to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.

The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls through a Bluetooth headset.

The UART interface is a universal serial data bus for asynchronous communication. The UART interface can be a bidirectional communication bus. The UART interface can convert the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example: the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.

It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device 100 through the power management module 141.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193 and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

The wireless communication function of the electronic device 100 can be implemented through the antenna S1, the antenna S2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is an integer greater than 1.

The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in various coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created by the electronic device 100 during use (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

The electronic device 100 can implement audio functions, such as music playback, recording, etc., through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D and the application processor.

The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than a pressure threshold acts on a short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the pressure threshold acts on a short message application icon, an instruction to create a new short message is executed.

The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor 180K can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (such as: coaxial cable, optical fiber, data subscriber line (Digital Subscriber Line, DSL)) or wireless (such as: infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access, or a data storage device such as a server or data center that includes one or more available media integrations. The available medium may be a magnetic medium (such as a floppy disk, a hard disk, a magnetic tape), an optical medium (such as a digital versatile disc (DVD)), or a semiconductor medium (such as a solid state disk (SSD)).

The above are optional embodiments provided for the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the technical scope disclosed in the present application shall be included in the protection scope of the present application.

Claims (9)

1. A control method for audio playing, which is applied to an electronic device, the method comprising:

in response to an audio playing operation, transmitting audio data of target audio to an audio power amplifier of the electronic device through an audio playing application program under the condition that the electronic device is in a non-mute playing mode so as to play the target audio, wherein the audio power amplifier is in an on state before receiving the audio playing operation;

Under the condition that the electronic equipment is switched from the non-mute play mode to the mute play mode, the audio power amplifier is turned off, and the transmission of the audio data of the target audio to the audio power amplifier is stopped;

In the audio data transmission process, each time a mute control module in the electronic equipment receives a frame of audio data transmitted by an audio playing thread, starting delay operation, and discarding the currently received frame of audio data, wherein the audio playing application program transmits the audio data of the target audio to the mute control module through the audio playing thread;

And under the condition that the time delay time length reaches the transmission time length, the mute control module sends feedback information to the audio playing thread, wherein the transmission time length is the time length of the audio data of the target audio transmitted from the mute control module to the audio power amplifier, and the feedback information is used for indicating the audio playing thread to continuously transmit the audio data of the next frame, so that the playing speed of the target audio is not changed during the playing of the target audio.

2. The method of claim 1, wherein after turning off the audio power amplifier and stopping transmitting the audio data of the target audio to the audio power amplifier in the case where the electronic device is switched from the non-mute play mode to the mute play mode, further comprising:

And under the condition that the electronic equipment is switched from the mute play mode to the non-mute play mode, starting the audio power amplifier, and recovering the audio data of the target audio transmitted to the audio power amplifier.

3. The method of claim 1, wherein the turning off the audio power amplifier and stopping the transmission of the audio data of the target audio to the audio power amplifier before the electronic device switches from the non-silent play mode to the silent play mode, further comprises:

Acquiring volume information of the target audio, wherein the volume information is used for indicating the current volume of the target audio;

Determining the duration time of zero volume when the volume information indicates that the current volume of the target audio is zero;

And under the condition that the duration time is greater than or equal to a time threshold, determining that the electronic equipment is switched from the non-mute play mode to the mute play mode.

4. The method of any of claims 1-3, wherein the electronic device includes a scene recognition module and a mute control module therein;

And when the electronic device is switched from the non-mute play mode to the mute play mode, turning off the audio power amplifier and stopping transmitting the audio data of the target audio to the audio power amplifier, including:

under the condition that the electronic equipment is switched from the non-mute play mode to the mute play mode, the scene recognition module sends a mute control instruction to the mute control module;

responding to the mute control instruction, the mute control module sends a closing instruction to the audio power amplifier and discards audio data transmitted from the audio playing application program;

in response to the off command, the audio power amplifier switches from the on state to an off state.

5. The method of any of claims 1-3, wherein the turning off the audio power amplifier and ceasing to transmit audio data of the target audio to the audio power amplifier if the electronic device switches from the non-silent play mode to a silent play mode comprises:

And under the condition that the electronic equipment is switched from the non-mute play mode to the mute play mode, if a target application identifier of the audio play application program exists in a preset white list, closing the audio power amplifier, and stopping transmitting audio data of the target audio to the audio power amplifier.

6. The method of claim 5, wherein the electronic device includes a scene recognition module and a whitelist control module therein;

And if the target application identifier of the audio playing application program exists in the preset white list under the condition that the electronic equipment is switched from the non-mute playing mode to the mute playing mode, closing the audio power amplifier, and before stopping transmitting the audio data to the audio power amplifier, further comprising:

the white list control module acquires the target application identifier;

And under the condition that the target application identifier exists in the preset white list, the white list control module sends a matching passing message to the scene recognition module, wherein the matching passing message is used for indicating that the audio power amplifier is allowed to be turned off under the condition that the electronic equipment is switched from the non-mute play mode to the mute play mode.

7. The method of claim 1, wherein the mute control module comprises a mute switch module and an audio simulation module;

In the audio data transmission process, each time the silence control module receives a frame of audio data transmitted by the audio playing thread, delay operation is started, and the currently received frame of audio data is discarded, including:

in the audio data transmission process, each time the mute switch module receives one frame of audio data transmitted by the audio playing thread, an analog message is sent to the audio analog module, and the currently received one frame of audio data is discarded;

The audio simulation module starts to perform delay operation under the condition that the simulation message is received;

And under the condition that the delay time length reaches the transmission time length, the mute control module sends feedback information to the audio playing thread, and the method comprises the following steps:

and under the condition that the time delay time length reaches the transmission time length, the audio simulation module sends the feedback information to the audio playing thread.

8. An electronic device, wherein the electronic device comprises a processor and a memory in its structure;

The memory is configured to store a program for supporting the electronic device to perform the method according to any one of claims 1-7.

9. A computer readable storage medium having instructions stored therein which, when run on a computer, cause the computer to perform the method of any of claims 1-7.