CN107249080A - A kind of method, device and mobile terminal for adjusting audio - Google Patents

Abstract

The embodiments of the present invention belong to the technical field of communication, and provide a method, a device and a mobile terminal for adjusting sound effects. The method includes: extracting the corresponding target music feature from the audio signal of the target music file; searching for music genre information matching the target music feature; when playing the target music file, loading the sound effect corresponding to the music genre information configuration information. The embodiment of the present invention solves the problem that the corresponding sound effect configuration information cannot be loaded when the music file is played due to the lack of music genre information of the music file; the embodiment of the present invention improves the recognition rate of the music genre information, and can automatically The music genre information of the music file loads the corresponding sound effect configuration information, which improves the user's operating experience and music experience.

Description

Method, device and mobile terminal for adjusting sound effect

technical field

The present invention relates to the field of communication technology, in particular to a method, device and mobile terminal for adjusting sound effects.

Background technique

With the popularity of electronic devices, people are more and more inclined to use electronic devices to play music. In order to improve the user's sense of hearing, various sound effect configuration information is often built into the playback device to adapt to different music genre information. When the user plays music files of different genres, it is necessary to frequently change the sound effect configuration information of the playback device to adapt to the currently played music file, so as to achieve a better playback effect.

At present, most playback devices select the corresponding sound effect configuration information by reading the music genre information in the attribute information in the music file. For example, if the music genre information of the music file to be played is rock music, then load the sound effect configuration information corresponding to rock music to play.

However, in practical applications, the music genre information of many music files is missing, resulting in the problem that the corresponding sound effect configuration information cannot be loaded when the above music files are played.

Contents of the invention

An embodiment of the present invention provides a method for adjusting sound effects, so as to solve the problem that the corresponding sound effect configuration information cannot be loaded when playing the above-mentioned music files due to lack of music genre information of the music files.

In order to solve the above-mentioned technical problems, the present invention is achieved in this way: a method for adjusting sound effects, comprising:

extracting the corresponding target music feature from the audio signal of the target music file;

Searching for music genre information matching the target music feature;

When the target music file is played, the sound effect configuration information corresponding to the music genre information is loaded.

The embodiment of the present invention also provides a device for adjusting sound effects, including:

Music feature extraction module, for extracting corresponding target music feature from the audio signal of target music file;

A music genre information search module, configured to search for music genre information matching the target music features;

The sound effect configuration loading module is configured to load the sound effect configuration information corresponding to the music genre information when playing the target music file.

Another embodiment of the present invention provides a mobile terminal, including a processor, a memory, and a sound effect adjustment program stored in the memory and operable in the processor, and the sound effect adjustment program is processed by the processor Implementing the steps of the method for adjusting sound effects according to any one of the preceding claims when the device is executed.

Yet another embodiment of the present invention provides a computer-readable storage medium, on which a program for adjusting sound effects is stored, and when the program for adjusting sound effects is executed by a processor, any one of the above claims can be achieved. Steps in the method of adjusting the sound effect described in the item.

In the embodiment of the present invention, at first by extracting the target music feature from the audio signal of the target music file, then find out the music genre information of the target music file according to the above-mentioned target music feature, thereby when the target music file is played, load and target music The sound effect configuration information of the music genre information corresponding to the file, so it solves the problem that the corresponding sound effect configuration information cannot be loaded when the above music file is played due to the lack of music genre information of the music file; the embodiment of the present invention improves the music genre information. The recognition rate can automatically load the corresponding sound effect configuration information according to the music genre information of different music files, which improves the user's operating experience and music experience.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments of the present invention. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention , for those skilled in the art, other drawings can also be obtained according to these drawings without paying creative labor.

Fig. 1 shows a flow chart of steps of a method for adjusting sound effects according to Embodiment 1 of the method of the present invention;

Fig. 2 shows a flow chart of steps of a method for adjusting sound effects according to Embodiment 2 of the method of the present invention;

Fig. 3 shows a structural block diagram of a device for adjusting sound effects according to Embodiment 3 of the device of the present invention;

Fig. 4 shows a structural block diagram of another device for adjusting sound effects according to Embodiment 3 of the device of the present invention;

FIG. 5 shows a structural block diagram of a mobile terminal according to Embodiment 4 of the device of the present invention;

FIG. 6 shows a schematic structural diagram of a mobile terminal according to Embodiment 5 of the apparatus of the present invention.

detailed description

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

The technical solutions of the embodiments of the present invention can be applied to various music players, such as mobile terminals, desktop computers, MP3 players and other electronic devices with the function of playing music files, and can also be applied to web page music players, client Software that can play music files stored in the form of digital signals, such as end music players.

【Method Embodiment 1】

Referring to Figure 1, the embodiment of the present invention provides a method for adjusting sound effects, which may specifically include steps 101-103:

Step 101: Extract corresponding target music features from the audio signal of the target music file.

In an embodiment of the present invention, the corresponding target music feature is extracted from the audio signal of the above-mentioned target music file; the above-mentioned target music file can be a music file to be played; the above-mentioned audio signal can be a complete audio signal of the above-mentioned target music file; It may also be a certain audio signal or multiple audio signals in the above-mentioned target music file.

The above-mentioned target music features can be the time-domain features, frequency-domain features, time-frequency features, etc. Value features, fundamental wave features, harmonic features, etc.

It can be understood that the above-mentioned amplitude feature corresponds to the loudness feature of the target music file; the above-mentioned fundamental wave feature corresponds to the tone feature of the above-mentioned target music file; the above-mentioned harmonic feature corresponds to the timbre feature of the target music file.

For example, the extracted above-mentioned target music features can be expressed on the mathematical model as:

[X ₁ , X ₂ , X ₃ ,..., X _n ], this set represents the set of the above-mentioned target music features, where X represents the target music features, which can be in the form of scalar, vector, or The form of the matrix can also be other forms; the subscripts 1, 2, 3, ..., n indicate the type of the target music feature, for example, 1 indicates the short-term energy, 2 indicates the short-term average amplitude, etc.

Step 102: Search for music genre information matching the above-mentioned target music characteristics.

In the embodiment of the present invention, the music genre information matching the above-mentioned target music characteristics is searched; the above-mentioned music genre information may include country music, rock music, classical music, etc.; the preset music genre information and preset Assuming a correspondence relationship of music features, the above correspondence relationship may be in the form of a table, in the form of a database, or in other forms.

As shown in Table 1, in an optional manner of the embodiment of the present invention, by looking up the comparison table between the preset music genre information and the preset music features, the information corresponding to the preset music features matching the above-mentioned target music features can be obtained. Music genre information.

Table 1

Music Genre Information preset music features A [A ₁ , A ₂ , A ₃ ,..., A _n ] B [B ₁ , B ₂ , B ₃ ,..., B _n ] C [C ₁ , C ₂ , C ₃ ,..., C _n ]

Step 103: When the above target music file is played, the sound effect configuration information corresponding to the above music genre information is loaded.

It can be understood that, as shown in Table 2, the above-mentioned sound effect configuration information may be found in the corresponding sound effect configuration information of the above-mentioned music genre information from the corresponding relationship between the music genre information and the sound effect configuration information carried by the music player, or The corresponding relationship between the preset music genre information and the sound effect configuration information is searched locally or through the network.

Table 2

music genre Audio configuration information A a B b C c

The sound effect configuration information is loaded into the audio data stream of the above-mentioned target music file, and then processed by the analog circuit, and the finally played sound is the sound of the target music file loaded with the sound effect configuration information. The sound effects can further enhance the realism, atmosphere and other characteristics of the target music file, and can include environmental sound effects, action sound effects, atmosphere sound effects, and the like.

The sound effect configuration information may include equalizer configuration information, sound stereo surround effect configuration information, etc.; the equalizer configuration information may be to perform signal gain or signal weakening on the audio signal of the target music file according to the different signal frequencies, for example, the audio signal According to the frequency, it is divided into 50Hz file, 200Hz file, 1KHz file, 3KHz file, 14KHz file, each file has 10 levels of adjustment: -15dB (decibel, decibel), -12dB, -9dB, -6dB, -3dB, 0dB, +3dB, +6dB, +9dB, +12dB, +15dB; for example, the sound configuration information is +6dB for the 50Hz file, which may be +6dB for the signal gain in the 20Hz-60Hz frequency range, which can enhance the powerful feeling of the target music file , giving a very loud feeling, such as thunder and so on. The embodiment of the present invention is not limited to the above exemplary sound effect configuration information.

In the embodiment of the present invention, at first by extracting the target music feature from the audio signal of the target music file, then find out the music genre information of the target music file according to the above-mentioned target music feature, thereby when the target music file is played, load and target music The sound effect configuration information of the music genre information corresponding to the file, so it solves the problem that the corresponding sound effect configuration information cannot be loaded when the above music file is played due to the lack of music genre information of the music file; the embodiment of the present invention improves the music genre information. The recognition rate can automatically load the corresponding sound effect configuration information according to the music genre information of different music files, which improves the user's operating experience and music experience.

[Method Embodiment 2]

Referring to Figure 2, the embodiment of the present invention provides a method for adjusting sound effects, which may specifically include steps 201-206:

Step 201: Obtain the decoded audio signal of the target music file.

In an optional manner of the embodiment of the present invention, the audio signal of the target music file of the set time length after being decoded by the codec processor can be obtained, for example, the decoded PCM (pulse audio signal) of the above-mentioned target music file for 10 seconds can be obtained. Code modulation, Pulse Code Modulation) audio signal.

If the above-mentioned target music file needs to be downloaded for online play, the audio signal of the above-mentioned target music file can be obtained by decoding the buffered data downloaded before playing, and then the corresponding target music features can be extracted.

Step 202: extracting the time-domain features and/or frequency-domain features of the above-mentioned audio signal as the above-mentioned target music features.

In an implementation manner of an embodiment of the present invention, the above-mentioned audio signal is subjected to time-domain and/or frequency-domain data processing, and the time-domain feature and/or frequency-domain feature of the above-mentioned audio signal is extracted as the above-mentioned target music feature; The above-mentioned audio signal is subjected to frame division and windowing processing to perform time-domain data processing, and the above-mentioned audio signal may be subjected to FFT (Fast Fourier Transformation, Fast Fourier Transformation) transformation to perform frequency-domain data processing.

Optionally, the step 202 of extracting the time-domain features and/or frequency-domain features of the above-mentioned audio signal as the above-mentioned target music features may include:

Perform pre-emphasis processing and normalization processing on the above audio signal;

dividing the audio signal into multiple audio frames according to a preset time period;

Extracting time-domain features and/or frequency-domain features corresponding to the above-mentioned multiple audio frames as the above-mentioned target music features.

The foregoing pre-emphasis processing is a signal processing method for enhancing high-frequency components of an audio signal. Because in the actual process, the power spectrum of the audio signal decreases with the increase of the frequency, and most of its energy is concentrated in the low frequency range, which causes the signal-to-noise ratio of the high-frequency end of the audio signal to be reduced to an unacceptable level. Pre-emphasis increases the high-frequency resolution of an audio signal. Specifically, pre-emphasis processing can be realized through a high-pass digital filter. The above-mentioned normalization processing is a common information processing method for simplifying calculations, and transforms a dimensional processing object into a dimensionless processing object, so that the processing results can have wider applicability.

The audio signal is a signal that changes with time. It can be considered that the audio signal is approximately unchanged in a short period of time (generally 10-30ms), that is, the audio signal has short-term stability; the audio signal can be processed in frames, according to The audio signal is divided into multiple audio frames (also referred to as analysis frames) for processing in the preset time period, and the corresponding music features may be called short-term music features.

The framing processing of audio signals is generally realized by weighting a movable finite length window, that is, windowing and framing processing, to solve the problem that the naturalness and continuity of audio signals are destroyed by framing processing of audio signals. , leading to the problem of spectrum leakage. Generally, the number of audio frames per second can be 33 to 100 frames, depending on the actual situation. Although the method of continuous segmentation can be used for framing processing, the method of overlapping segmentation is generally used to make a smooth transition between audio frames and maintain their continuity. The overlapping part of the previous frame and the next frame is called frame shift, and the ratio of frame shift to frame length is generally 0 to 0.5; where the frame length is the number of sampling points or sampling time of an audio frame. For example, for a PCM audio signal with a sampling rate of 50kHz for 6 seconds, take 30ms as the frame length and 15ms as the frame shift, then divide the above audio signal into 401 audio frames, and the number of sampling points of each audio frame, that is, the sample The number is 1500. In a specific implementation, a window function commonly used in speech signal processing such as a rectangular window, a Hanning window, and a triangular window may be selected for windowing and frame division processing. For example, the window function of the Hanning window is as follows:

for each audio frame A new audio frame X _m (n) is obtained after windowing with the window function W(n):

Wherein X _m (n) is the nth sampling value of the m audio frame, i.e. the amplitude; N is the frame length, i.e. the number of sampling points in an audio frame; n represents the nth sampling points in the audio frame , n=1,2,3...N.

Exemplarily, the above-mentioned time-domain features may include short-term energy, and the above-mentioned short-time energy r _low is defined as the ratio of audio frames lower than the average energy in a text window; Na is the number of audio frames in a text window, and N is The number of samples in an audio frame.

Among them, x _rms is the short-term average energy, and x(n) is the sampling value of the nth sample point.

For example, for the above-mentioned 6-second PCM audio signal with a sampling rate of 50kHz, take 30ms as the frame length and 15ms as the frame shift; you can take the above-mentioned 6-second audio signal as a text window, then Na is 401, and N is 1500.

Exemplarily, the above-mentioned time-domain features may include a short-term zero-crossing rate zero-cross, which is defined as the number of times an audio signal passes through a zero-crossing rate in time, which has been widely used in speech retrieval and speech recognition, and is also used to distinguish music genres important descriptors.

Among them, N is the number of samples in an audio frame, x(n) is the sampling value of the nth sample point, sign(t) is 1 when t>0, and is 0 when t<0.

Optionally, the above-mentioned time-domain features include: any one or any combination of amplitude, short-term energy, short-time average amplitude, and short-time zero-crossing rate; the above-mentioned frequency-domain features include: frequency spectrum, fundamental wave, harmonic, inverted Any one or any combination of spectrum, formant, and resonance frequency.

Exemplarily, the above-mentioned amplitude includes feature values such as the maximum amplitude, the minimum amplitude, and the average amplitude of the above-mentioned audio signal, which may be a feature vector composed of the average amplitude of each audio frame, and may also be in other forms; it can be understood that , other above-mentioned time-domain features and frequency-domain features also refer to the description of the above-mentioned amplitude. In a word, the present invention is not limited thereto.

Step 203: Determine the preset music feature corresponding to the target music feature by calculating the similarity coefficient between the target music feature and each preset music feature in the preset music database.

In the embodiment of the present invention, the preset music feature corresponding to the target music feature is determined by calculating the similarity coefficient between the target music feature and each preset music feature in the preset music database. The foregoing music database may be located in a local storage, or in a network, such as the cloud; in short, this embodiment of the present invention does not limit it.

Exemplarily, referring to the preset music database shown in Table 3, the above-mentioned target music features [X ₁ , X ₂ , X ₃ , ..., X _n ] and preset music features [A ₁ , A ₂ , A ₃ , ... , A _n ], by calculating the similarity coefficient as Σ _A ={δ ₁ (X ₁ -A ₁ ) ² +δ ₂ (X ₂ -A ₂ ) ² +δ ₃ (X ₃ -A ₃ ) ² +…+δ _n (X _n -A _n ) ² }, where δ _i is the weight of the element of the preset music feature of type i. By comparing the similarity coefficients Σ _A , Σ _B , Σ _C ... Σ _N corresponding to each preset music feature, the preset music feature with the smallest similarity coefficient is the preset music feature corresponding to the above-mentioned target music feature.

Music Genre Information Audio configuration information preset music features A a [A ₁ , A ₂ , A ₃ ,..., A _n ] B b [B ₁ , B ₂ , B ₃ ,..., B _n ] C c [C ₁ , C ₂ , C ₃ ,..., C _n ] … … …

If it is calculated that there are multiple similarity coefficients of the same size, or the difference is within the preset threshold, the elements in the preset music feature can be compared one by one with the elements of the above-mentioned target music feature through a preset priority order. For example: if Σ _A ＝Σ _B , then take the order of subscript numerical values in the set of the above-mentioned preset music features and the set of the above-mentioned target music features as the priority order, that is, first compare |X ₁ -A ₁ | with |X ₁ - B ₁ |; if |X ₁ -A ₁ |<|X ₁ -B ₁ |, then the preset music features [A ₁ , A ₂ , A ₃ ,..., A _n ] are the presets corresponding to the above target music features music features; if |X ₁ -A ₁ |=|X ₁ -B ₁ |, then compare |X ₂ -A ₂ | and |X ₂ -B ₂ |, repeating this, you can get the unique and above-mentioned target music features Corresponding preset music features.

Step 204: Obtain music genre information corresponding to the preset music feature according to the correspondence between the preset music feature and the music genre information in the preset music database.

In an optional manner of the embodiment of the present invention, referring to the preset music database shown in Table 3, according to the corresponding relationship between preset music features and music genre information in the above preset music database, the information related to the above preset music features is obtained. Corresponding music genre information. For example, the music genre information corresponding to the preset music feature [A ₁ , A ₂ , A ₃ , . . . , A _n ] corresponding to the target music feature is A.

Step 205: Obtain the sound effect configuration information corresponding to the music genre information according to the correspondence between the music genre information and the sound effect configuration information in the preset music database.

In an optional manner of the embodiment of the present invention, referring to the preset music database shown in Table 3, according to the corresponding relationship between the music genre information and the sound effect configuration information in the preset music database, the information corresponding to the above music genre information is obtained. Audio configuration information. For example, the sound effect configuration information corresponding to the music genre information A is a.

It can be understood that, in the embodiment of the present invention, the music genre information of the target music file is searched through the preset music database in the preset music database and the corresponding relationship between the music genre information, and the sound effect configuration information corresponding to the target music file is further searched. The classification of music genres and corresponding sound effect configurations can be uniformly managed and updated through the preset music database, which improves the applicability of the method for adjusting sound effects.

Step 206: When the above target music file is played, the sound effect configuration information corresponding to the above music genre information is loaded.

In the embodiment of the present invention, when playing the above-mentioned target music file, the sound effect configuration information corresponding to the above-mentioned music genre information is loaded to the digital signal processor; Audio configuration information into the audio data stream of the above target music file.

In the embodiment of the present invention, at first by extracting the target music feature from the audio signal of the target music file, then find out the music genre information of the target music file according to the above-mentioned target music feature, thereby when the target music file is played, load and target music The sound effect configuration information of the music genre information corresponding to the file, so it solves the problem that the corresponding sound effect configuration information cannot be loaded when the above music file is played due to the lack of music genre information of the music file; on the one hand, the embodiment of the present invention improves the music performance. The recognition rate of the genre information can automatically load the corresponding sound effect configuration information according to the music genre information of different music files, which improves the user's operating experience and music experience; Genre classification and corresponding sound effect configurations are managed and updated in a unified manner, which improves the applicability of the method of adjusting sound effects.

It should be noted that, for the method embodiment, for the sake of simple description, it is expressed as a series of action combinations, but those skilled in the art should know that the embodiment of the present invention is not limited by the described action sequence, because According to the embodiment of the present invention, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[Device Embodiment 3]

Referring to Figure 3, an embodiment of the present invention provides a device for adjusting sound effects, which may specifically include:

Music feature extraction module 301, for extracting corresponding target music feature from the audio signal of target music file;

A music genre information search module 302, configured to search for music genre information matching the above-mentioned target music features;

The sound effect configuration loading module 303 is configured to load the sound effect configuration information corresponding to the above music genre information when the above target music file is played.

Optionally, as shown in FIG. 4, on the basis of the above-mentioned FIG. 3, the above-mentioned music genre information search module 302 may include:

The preset music feature determining unit 3021 is used to determine the preset music feature corresponding to the above-mentioned target music feature by calculating the similarity coefficient between the above-mentioned target music feature and each preset music feature in the preset music database;

The music genre information acquiring unit 3022 is configured to acquire music genre information corresponding to the aforementioned preset music features according to the correspondence between preset music features and music genre information in the aforementioned preset music database.

Optionally, the above-mentioned music genre information search module 302 may also include:

The sound effect configuration information obtaining unit 3023 is configured to obtain the sound effect configuration information corresponding to the music genre information according to the correspondence between the music genre information and the sound effect configuration information in the preset music database.

Optionally, the above-mentioned music feature extraction module 301 may include:

An audio signal acquisition unit 3011, configured to acquire the decoded audio signal of the target music file;

The music feature extraction unit 3012 is configured to extract the time domain feature and/or frequency domain feature of the above audio signal as the above target music feature.

Optionally, the above-mentioned music feature extraction unit 3012 may include:

The preprocessing subunit is used to perform pre-emphasis processing and normalization processing on the above audio signal, and divide it into multiple audio frames according to the preset time period;

A framing subunit, configured to divide the audio signal into multiple audio frames according to a preset time period;

The music feature extraction subunit is configured to extract time-domain features and/or frequency-domain features corresponding to the above-mentioned multiple audio frames as the above-mentioned target music features.

Optionally, the above-mentioned time-domain features may include: any one or any combination of amplitude, short-term energy, short-time average amplitude, and short-time zero-crossing rate; the above-mentioned frequency-domain features include: spectrum, fundamental wave, harmonic, Any one or any combination of cepstrum, formant, and resonance frequency.

In the embodiment of the present invention, at first by extracting the target music feature from the audio signal of the target music file, then find out the music genre information of the target music file according to the above-mentioned target music feature, thereby when the target music file is played, load and target music The sound effect configuration information of the music genre information corresponding to the file, so it solves the problem that the corresponding sound effect configuration information cannot be loaded when the above music file is played due to the lack of music genre information of the music file; on the one hand, the embodiment of the present invention improves the music performance. The recognition rate of the genre information can automatically load the corresponding sound effect configuration information according to the music genre information of different music files, which improves the user's operating experience and music experience; Genre classification and corresponding sound effect configurations are managed and updated in a unified manner, which improves the applicability of the method of adjusting sound effects.

[Device Embodiment 4]

FIG. 5 is a block diagram of a mobile terminal according to another embodiment of the present invention. The mobile terminal 500 shown in FIG. 5 includes: at least one processor 501 , a memory 502 , at least one network interface 504 , and other user interfaces 503 . Various components in the mobile terminal 500 are coupled together through the bus system 505 . It can be understood that the bus system 505 is used to realize connection and communication between these components. In addition to the data bus, the bus system 505 also includes a power bus, a control bus and a status signal bus. However, for clarity of illustration, the various buses are labeled as bus system 505 in FIG. 5 .

Wherein, the user interface 503 may include a display, a keyboard, or a pointing device (for example, a mouse, a trackball (trackball), a touch panel, or a touch screen, and the like.

The memory 502 in the embodiment of the present invention stores a program for adjusting sound effects, and when the program for adjusting sound effects is executed by a processor, the steps of the method for adjusting sound effects as described in any one of the preceding claims are implemented.

It can be understood that the memory 502 in the embodiment of the present invention may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memories. Wherein, the non-volatile memory may be a read-only memory (Read-Only Memory, ROM), a programmable read-only memory (Programmable ROM, PROM), an erasable programmable read-only memory (Erasable PROM, EPROM), an electronically programmable Erase Programmable Read-Only Memory (Electrically EPROM, EEPROM) or Flash. The volatile memory can be Random Access Memory (RAM), which acts as an external cache. By way of illustration and not limitation, many forms of RAM are available such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double DataRate SDRAM, DDRSDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous connection dynamic random access memory (Synch link DRAM, SLDRAM) And Direct Memory Bus Random Access Memory (Direct Ram bus RAM, DRRAM). The memory 502 of the systems and methods described in embodiments of the present invention is intended to include, but is not limited to, these and any other suitable types of memory.

In some implementations, the memory 502 stores the following elements, executable modules or data structures, or their subsets, or their extended sets: an operating system 5021 and an application program 5022 .

Among them, the operating system 5021 includes various system programs, such as framework layer, core library layer, driver layer, etc., for realizing various basic services and processing tasks based on hardware. The application program 5022 includes various application programs, such as a media player (Media Player), a browser (Browser), etc., and is used to implement various application services. The program for realizing the method of the embodiment of the present invention may be included in the application program 5022.

In the embodiment of the present invention, by calling the program or instruction stored in the memory 502, specifically, the program or instruction stored in the application program 5022, the processor 501 is used to extract the corresponding target music from the audio signal of the target music file. Features; searching for music genre information matching the above-mentioned target music features; when playing the above-mentioned target music file, loading sound effect configuration information corresponding to the above-mentioned music genre information.

The methods disclosed in the foregoing embodiments of the present invention may be applied to the processor 501, or implemented by the processor 501. The processor 501 may be an integrated circuit chip and has signal processing capability. In the implementation process, each step of the above method may be completed by an integrated logic circuit of hardware in the processor 501 or instructions in the form of software. The above-mentioned processor 501 may be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), an off-the-shelf programmable gate array (Field Programmable Gate Array, FPGA) or other available Program logic devices, discrete gate or transistor logic devices, discrete hardware components. Various methods, steps and logic block diagrams disclosed in the embodiments of the present invention may be implemented or executed. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, and the like. The steps of the methods disclosed in the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, register. The storage medium is located in the memory 502, and the processor 501 reads the information in the memory 502, and completes the steps of the above method in combination with its hardware.

It can be understood that the embodiments described in the embodiments of the present invention may be implemented by hardware, software, firmware, middleware, microcode or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application specific integrated circuits (Application Specific Integrated Circuits, ASIC), digital signal processor (Digital Signal Processing, DSP), digital signal processing device (DSP Device, DSPD), programmable logic Equipment (Programmable Logic Device, PLD), Field-Programmable Gate Array (Field-Programmable GateArray, FPGA), general-purpose processor, controller, microcontroller, microprocessor, other electronic units for performing the above-mentioned functions of this application or in its combination.

For software implementation, the above-mentioned technologies in the embodiments of the present invention may be implemented through modules (such as procedures, functions, etc.) that execute the above-mentioned functions in the embodiments of the present invention. Software codes can be stored in memory and executed by a processor. Memory can be implemented within the processor or external to the processor.

Optionally, the processor 501 is further configured to: determine the preset music feature corresponding to the above-mentioned target music feature by calculating the similarity coefficient between the above-mentioned target music feature and each preset music feature in the preset music database; Preset the corresponding relationship between music features and music genre information in the database, and acquire the music genre information corresponding to the preset music features.

Further, the processor 501 is further configured to: acquire the sound effect configuration information corresponding to the music genre information according to the correspondence between the music genre information and the sound effect configuration information in the preset music database.

Optionally, the processor 501 is further configured to: acquire the decoded audio signal of the target music file; and extract the time-domain feature and/or frequency-domain feature of the audio signal as the target music feature.

Further, the processor 501 is also configured to: perform pre-emphasis processing and normalization processing on the above audio signal; divide the above audio signal into multiple audio frames according to a preset time period; extract time frames corresponding to the above multiple audio frames. Domain features and/or frequency domain features are used as the above-mentioned target music features.

The mobile terminal 500 can implement various processes implemented by the mobile terminal in the foregoing embodiments, and to avoid repetition, details are not repeated here.

In the embodiment of the present invention, at first by extracting the target music feature from the audio signal of the target music file, then find out the music genre information of the target music file according to the above-mentioned target music feature, thereby when the target music file is played, load and target music The sound effect configuration information of the music genre information corresponding to the file, so it solves the problem that the corresponding sound effect configuration information cannot be loaded when the above music file is played due to the lack of music genre information of the music file; on the one hand, the embodiment of the present invention improves the music performance. The recognition rate of the genre information can automatically load the corresponding sound effect configuration information according to the music genre information of different music files, which improves the user's operating experience and music experience; Genre classification and corresponding sound effect configurations are managed and updated in a unified manner, which improves the applicability of the method of adjusting sound effects.

【Device Embodiment 5】

Fig. 6 is a schematic structural diagram of a mobile terminal according to another embodiment of the present invention. Specifically, the mobile terminal 600 in FIG. 6 may be a mobile phone, a tablet computer, a personal digital assistant (Personal Digital Assistant, PDA), or a vehicle-mounted computer.

The mobile terminal 600 in FIG.

The memory 620 in the embodiment of the present invention stores a program for adjusting sound effects, and when the program for adjusting sound effects is executed by a processor, the steps of the method for adjusting sound effects as described in any one of the preceding claims are implemented.

Wherein, the input unit 630 can be used to receive number or character information input by the user, and generate signal input related to the user setting and function control of the mobile terminal 600 . Specifically, in the embodiment of the present invention, the input unit 630 may include a touch panel 631 . The touch panel 631, also referred to as a touch screen, can collect user's touch operations on or near it (such as the user's operation on the touch panel 631 using any suitable object or accessory such as a finger, a stylus), and The specified program drives the corresponding connected device. Optionally, the touch panel 631 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the to the processor 660, and can receive and execute commands sent by the processor 660. In addition, the touch panel 631 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 631, the input unit 630 may also include other input devices 632, which may include but not limited to physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, etc. one or more of.

Wherein, the display unit 640 can be used to display information input by the user or information provided to the user and various menu interfaces of the mobile terminal 600 . The display unit 640 may include a display panel 641, and optionally, the display panel 641 may be configured in the form of an LCD or an organic light-emitting diode (Organic Light-Emitting Diode, OLED).

It should be noted that the touch panel 631 can cover the display panel 641 to form a touch display screen. When the touch display screen detects a touch operation on or near it, it is sent to the processor 660 to determine the type of the touch event, and then the processor 660 provides corresponding visual output on the touch display screen according to the type of the touch event.

The touch display screen includes an application program interface display area and a common control display area. The arrangement of the display area of the application program interface and the display area of the commonly used controls is not limited, and may be an arrangement in which the two display areas can be distinguished, such as vertical arrangement, left-right arrangement, and the like. The application program interface display area can be used to display the interface of the application program. Each interface may include at least one application program icon and/or interface elements such as widget desktop controls. The application program interface display area can also be an empty interface without any content. The commonly used control display area is used to display controls with a high usage rate, for example, application icons such as setting buttons, interface numbers, scroll bars, and phonebook icons.

Wherein the processor 660 is the control center of the mobile terminal 600, utilizes various interfaces and lines to connect the various parts of the whole mobile phone, by running or executing the software programs and/or modules stored in the first memory 621, and calling the software programs and/or modules stored in the second memory 621. The data in the memory 622 executes various functions of the mobile terminal 600 and processes data, so as to monitor the mobile terminal 600 as a whole. Optionally, the processor 660 may include one or more processing units.

In the embodiment of the present invention, by calling the software programs and/or modules stored in the first memory 621 and/or the data in the second memory 622, the processor 660 is used to extract the corresponding The target music feature; find the music genre information matching the above target music feature; when playing the above target music file, load the sound effect configuration information corresponding to the above music genre information.

Optionally, the processor 660 is also configured to: determine the preset music feature corresponding to the above-mentioned target music feature by calculating the similarity coefficient between the above-mentioned target music feature and each preset music feature in the preset music database; Preset the corresponding relationship between music features and music genre information in the database, and acquire the music genre information corresponding to the preset music features.

Further, the processor 660 is further configured to: acquire the sound effect configuration information corresponding to the music genre information according to the correspondence between the music genre information and the sound effect configuration information in the preset music database.

Optionally, the processor 660 is further configured to: acquire the decoded audio signal of the target music file; and extract the time-domain feature and/or frequency-domain feature of the audio signal as the target music feature.

Further, the processor 660 is also configured to: perform pre-emphasis processing and normalization processing on the above-mentioned audio signal; divide the above-mentioned audio signal into multiple audio frames according to a preset time period; extract time frames corresponding to the above-mentioned multiple audio frames; Domain features and/or frequency domain features are used as the above-mentioned target music features.

Visible, in the embodiment of the present invention, at first by extracting target music feature from the audio signal of target music file, then find the music genre information of target music file according to above-mentioned target music feature, thereby when target music file is played, load and The sound effect configuration information of the music genre information corresponding to the target music file, so it solves the problem that the corresponding sound effect configuration information cannot be loaded when the above music file is played due to the lack of music genre information of the music file; on the one hand, the embodiments of the present invention improve The recognition rate of the music genre information is improved, and the corresponding sound effect configuration information can be automatically loaded according to the music genre information of different music files, which improves the user's operating experience and music experience; on the other hand, the embodiment of the present invention can Unified management and updating of music genre classification and corresponding sound effect configuration improves the applicability of the method of adjusting sound effect.

Those of ordinary skill in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed in the embodiments of the present invention can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the embodiments provided in this application, it should be understood that the disclosed devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the above units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or can be Integrate into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.

If the above functions are realized in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the above-mentioned methods in various embodiments of the present invention. The aforementioned storage medium includes: various media capable of storing program codes such as U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk.

The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone familiar with the technical field can easily think of changes or replacements within the technical scope disclosed in the present invention. covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (12)

1. a kind of method for adjusting audio, it is characterised in that including：

Corresponding target musical features are extracted from the audio signal of target music file；

Search the musical genre information with the target music characteristic matching；

When playing the target music file, audio configuration information corresponding with the musical genre information is loaded.

2. according to the method described in claim 1, it is characterised in that the lookup and the music of the target music characteristic matching The step of genre information, including：

By calculating the target musical features and the similarity factor of each preset musical feature in preset musical database, it is determined that with The corresponding preset musical feature of the target musical features；

According to the corresponding relation of preset musical feature in the preset musical database and musical genre information, obtain with it is described pre- If the corresponding musical genre information of musical features.

3. method according to claim 2, it is characterised in that the lookup and the music of the target music characteristic matching The step of genre information, in addition to：

According to music genre information in the preset musical database and the corresponding relation of audio configuration information, obtain and the sound The corresponding audio configuration information of happy genre information.

4. according to the method described in claim 1, it is characterised in that the extraction pair from the audio signal of target music file The step of target musical features answered, including：

Audio signal after acquisition target music file is decoded；

The temporal signatures and/or frequency domain character of the audio signal are extracted as the target musical features.

5. method according to claim 4, it is characterised in that the temporal signatures of the extraction audio signal and/or The step of frequency domain character is as the target musical features include：

Preemphasis processing and normalized are carried out to the audio signal；

The audio signal is divided into by multiple audio frames according to preset time period；

Extract corresponding with the multiple audio frame temporal signatures and/or frequency domain character and be used as the target musical features.

6. a kind of device for adjusting audio, it is characterised in that including：

Music features extraction module, for extracting corresponding target musical features from the audio signal of target music file；

Musical genre information searching module, for searching the musical genre information with the target music characteristic matching；

Audio configures load-on module, for when playing the target music file, loading corresponding with the musical genre information Audio configuration information.

7. device according to claim 6, it is characterised in that the musical genre information searching module includes：

Preset musical characteristics determining unit, for being preset by calculating the target musical features with each in preset musical database The similarity factor of musical features, it is determined that preset musical feature corresponding with the target musical features；

Musical genre information acquisition unit, for being believed according to preset musical feature in the preset musical database and musical genre The corresponding relation of breath, obtains musical genre information corresponding with the preset musical feature.

8. device according to claim 7, it is characterised in that the musical genre information searching module, in addition to：

Audio configuration information acquiring unit, for matching somebody with somebody confidence according to music genre information in the preset musical database and audio The corresponding relation of breath, obtains audio configuration information corresponding with the musical genre information.

9. device according to claim 6, it is characterised in that the music features extraction module includes：

Audio signal acquiring unit, for obtain target music file it is decoded after audio signal；

Music features extraction unit, for extracting the temporal signatures and/or frequency domain character of the audio signal as the target Musical features.

10. device according to claim 9, it is characterised in that the music features extraction unit includes：

Subelement is pre-processed, for carrying out preemphasis processing and normalized to the audio signal, and according to preset time Section is divided into multiple audio frames；

Framing subelement, for the audio signal to be divided into multiple audio frames according to preset time period；

Music features extraction subelement, makees for extracting corresponding with the multiple audio frame temporal signatures and/or frequency domain character For the target musical features.

11. a kind of mobile terminal, it is characterised in that including processor, memory and be stored in the memory and can be in institute The program of the adjustment audio run in processor is stated, the program of the adjustment audio is realized such as right during the computing device It is required that any one of 1 to 5 adjustment audio method the step of.

12. a kind of computer-readable recording medium, it is characterised in that be stored with adjustment sound on the computer-readable recording medium The program of effect, realizes the adjustment as any one of claim 1 to 5 when the program of the adjustment audio is executed by processor The step of method of audio.