CN112825488B - Audio data transmission method and device and terminal - Google Patents
Audio data transmission method and device and terminal Download PDFInfo
- Publication number
- CN112825488B CN112825488B CN201911148361.XA CN201911148361A CN112825488B CN 112825488 B CN112825488 B CN 112825488B CN 201911148361 A CN201911148361 A CN 201911148361A CN 112825488 B CN112825488 B CN 112825488B
- Authority
- CN
- China
- Prior art keywords
- audio data
- signal processor
- encoded
- memory
- coded
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/3827—Portable transceivers
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/16—Vocoder architecture
- G10L19/18—Vocoders using multiple modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/40—Circuits
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention provides an audio data transmission method, an audio data transmission device and a terminal, wherein the method comprises the following steps: the audio acquisition module acquires audio data to be coded and sends the audio data to be coded to the first signal processor; the first signal processor saves the audio data to be coded to a first memory; the first application processor acquires the audio data to be coded from the first memory, codes the audio data to be coded and sends the coded audio data to the first signal processor; and the first signal processor receives the coded audio data and sends the coded audio data to a target terminal through a first modem, so that the coding and transmission of the audio data are realized.
Description
Technical Field
The embodiment of the invention relates to the technical field of communication, in particular to an audio data transmission method, an audio data transmission device and a terminal.
Background
When voice talkback is carried out, the talkback sending terminal needs to acquire voice data input by a user, encode the voice data and transmit the encoded voice data to the talkback receiving terminal, so that the talkback receiving terminal can decode the encoded voice data and play the decoded voice data, and coding, decoding and transmission of the voice data are realized.
In the prior art, since a vocoder is generally integrated on a Digital Signal Processing (DSP), when encoding and transmitting voice data, the Digital Signal processor on an intercom transmitting terminal is generally used for encoding, and then the Digital Signal processor transmits the encoded voice data to a related transmitting device, such as a Modem (Modem), so that the related transmitting device transmits the encoded voice data to an intercom receiving terminal to realize voice data transmission.
However, the inventors found that at least the following problems exist in the prior art: when the coding environment of the vocoder is not compatible with the coding environment of the dsp, the vocoder cannot be integrated into the dsp, and only the vocoder can be integrated into an Application Processor (AP), and the dsp cannot encode the voice data, so that the voice data cannot be transmitted according to the existing transmission method.
Disclosure of Invention
The embodiment of the invention provides an audio data transmission method, an audio data transmission device and a terminal, and aims to provide a new audio data transmission mode to realize transmission of audio data.
In a first aspect, an embodiment of the present invention provides an audio data transmission method, which is applied to an audio data transmission apparatus, where the transmission apparatus includes an audio acquisition module, a first signal processor, a first application processor, and a first modem;
the method comprises the following steps:
the audio acquisition module acquires audio data to be coded and sends the audio data to be coded to the first signal processor;
the first signal processor saves the audio data to be coded to a first memory;
the first application processor acquires the audio data to be coded from the first memory, codes the audio data to be coded and sends the coded audio data to the first signal processor;
and the first signal processor receives the coded audio data and sends the coded audio data to a target terminal through a first modem.
In one possible design, after the first signal processor saves the audio data to be encoded to the first memory, the method further includes:
the first signal processor sending a first notification message to the first application processor;
accordingly, the first application processor retrieves the audio data to be encoded from the first memory, including:
upon receiving the first notification message, the first application processor retrieves the audio data to be encoded from the first memory.
In one possible design, after the retrieving the audio data to be encoded from the first memory, the method further includes:
the first application processor returns first response information to the first signal processor.
In one possible design, after the receiving the encoded audio data, further comprising:
and adding a time stamp to the encoded audio data, and saving the encoded audio data added with the time stamp to a second memory.
In one possible design, the sending the encoded audio data to the target terminal through the first modem includes:
and acquiring the encoded audio data from the second memory according to the sequence of the time stamps in the second memory, and transmitting the audio data to the target terminal through the first modem.
In one possible design, the transmission device further includes an audio playing module, a second signal processor, a second application processor, and a second modem;
the method further comprises the following steps:
the second modem acquires the encoded audio data and sends the encoded audio data to a second signal processor;
the second signal processor sending the encoded audio data to the second application processor;
the second application processor decodes the encoded audio data to obtain decoded audio data, and stores the decoded audio data to a third memory;
and the second signal processor acquires the decoded audio data from the third memory and plays the decoded audio data through the audio playing module.
In one possible design, after the saving the decoded audio data to the third memory, the method further includes:
the second application processor sending a second notification message to the second signal processor;
accordingly, the second signal processor retrieves the decoded audio data from the third memory, including:
upon receiving the second notification message, the second signal processor retrieves the decoded audio data from the third memory.
In a second aspect, an embodiment of the present invention provides an audio data transmission apparatus, including an audio acquisition module, a first signal processor, a first application processor, and a first modem;
the audio acquisition module is used for acquiring audio data to be encoded and sending the audio data to be encoded to the first signal processor;
the first signal processor is used for saving the audio data to be coded to a first memory;
the first application processor is configured to acquire the audio data to be encoded from the first memory, encode the audio data to be encoded, and send the encoded audio data to the first signal processor;
the first signal processor is further configured to receive the encoded audio data and send the encoded audio data to a target terminal through a first modem.
In one possible design, the audio data transmission apparatus further includes an audio playing module, a second signal processor, a second application processor, and a second modem;
the second modem is used for acquiring the encoded audio data and sending the encoded audio data to the second signal processor;
the second signal processor is configured to send the encoded audio data to the second application processor;
the second application processor is configured to decode the encoded audio data to obtain decoded audio data, and store the decoded audio data in a third memory;
the second signal processor is further configured to obtain the decoded audio data from the third memory, and play the decoded audio data through the audio playing module.
In a third aspect, an embodiment of the present invention provides a terminal, where the terminal includes the audio data transmission apparatus according to the second aspect.
In the audio data transmission method, device and terminal provided by the embodiment of the invention, after the first signal processor in the audio data transmission device receives the audio data to be coded, the audio data to be coded is stored in a first memory, a first application processor can directly acquire the audio data to be coded from the first memory to realize the acquisition of the audio data to be coded by a first application process, the first application processor codes the audio data to be coded and sends the coded audio data to a first signal processor, so that the first signal processor can send the encoded audio data to the target terminal, realize the encoding and transmission of the audio data, thereby solving the problem that when the vocoder is integrated in the application processor, namely, when the application processor carries out coding, the transmission can not be carried out according to the existing transmission mode.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic diagram of a conventional audio data transmission scenario provided by an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an audio data transmission apparatus according to an embodiment of the present invention;
fig. 3 is a first flowchart of an audio data transmission method according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an audio data transmission apparatus according to an embodiment of the present invention;
fig. 5 is a flowchart of a second audio data transmission method according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein. Moreover, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Fig. 1 is a schematic diagram of a conventional audio data transmission scenario provided by an embodiment of the present invention, as shown in fig. 1, in the prior art, an intercom transmitting terminal includes a microphone, a first digital signal processor and a first modem, and an intercom receiving terminal includes a second modem, a second digital signal processor and a player. When voice talkback is carried out, a microphone in the talkback sending terminal acquires audio data input by a user and sends the audio data to the first digital signal processor, and the first digital signal processor is integrated with a vocoder, so that the first digital signal processor can directly encode the audio data and send the encoded audio data to the first modem, and the first modem sends the encoded audio data to the talkback receiving terminal through a network, thereby realizing the encoding and transmission of the audio data.
And the second modem in the talkback receiving end sends the encoded audio data to the second digital signal processor after receiving the encoded audio data sent by the talkback sending terminal, and the second digital signal processor can directly decode the encoded audio data and play the decoded language data through the player to realize the decoding and transmission of the audio data because a vocoder is integrated on the second digital signal processor.
When the coding environment of the vocoder is not compatible with the coding environment of the digital signal processor or the coding environment of the vocoder is incompatible with the coding environment of the digital signal processor, the vocoder cannot be integrated into the digital signal processor, and only the vocoder can be integrated into the application processor, that is, the vocoders are not integrated into the first digital signal processor and the second digital signal processor, the first digital signal processor cannot encode the audio data to be encoded, the second digital signal processor cannot decode the audio data, and only the application processor on the terminal can be used for encoding and decoding, so that the encoding, decoding and transmission cannot be performed according to the existing audio data transmission mode, the application processor needs to be used for encoding and decoding and transmission, and therefore, a new transmission mode of voice data is urgently needed to solve the problem that when the vocoder is not integrated into the digital signal processor, the audio data cannot be coded and decoded and transmitted.
The application provides an audio data transmission method, an audio data transmission device and a terminal, aiming at the problems existing in the prior art in the transmission of audio data, so as to provide a new audio data transmission mode and realize the transmission of the audio data, thereby solving the problem that the audio data transmission cannot be carried out when a vocoder is not integrated on a digital signal processor.
The technical solution of the present invention will be described in detail below with specific examples. These several specific embodiments may be combined with each other below, and details of the same or similar concepts or processes may not be repeated in some embodiments.
Fig. 2 is a schematic structural diagram of an audio data transmission apparatus according to an embodiment of the present invention, and as shown in fig. 2, the transmission apparatus includes an audio acquisition module 201, a first signal processor 202, a first application processor 203, and a first modem 204.
The audio acquiring module 201 is configured to acquire audio data to be encoded, and send the audio data to be encoded to the first signal processor 202.
A first signal processor 202 for saving the audio data to a first memory 205.
The first application processor 203 is configured to obtain audio data from the first memory 205, encode the audio data to be encoded, and send the encoded audio data to the first signal processor 202.
The first signal processor 202 is further configured to receive the encoded audio data and send the encoded audio data to the audio data transmission device through the first modem 204.
In this embodiment, the audio acquiring module sends the acquired audio data to be encoded to the first signal processor, so that the first signal processor stores the audio data in the first memory. And the first application processor acquires the audio data to be coded from the first memory to realize the acquisition of the audio data to be coded.
The first application processor encodes the audio data after acquiring the audio data to be encoded to obtain encoded audio data, and the first application processor can directly send the encoded audio data to the first signal processor because the encoded audio data is small in size. The first signal processor transmits the received encoded audio data to the target terminal through the first modem.
The target terminal is a terminal that needs to receive the encoded audio data, for example, an intercom receiving terminal in voice intercom.
The first memory may be a memory of the terminal where the audio data transmission device is located, a memory on the audio data transmission device, or a memory on another external terminal, and the location of the first memory is not limited herein. The first storage may be a memory, a shared memory, etc.
The audio data may be PCM (Pulse Code Modulation) audio data.
When the first signal processor sends the received encoded audio data to the target terminal through the first modem, the first signal processor may send the encoded audio data to the first modem first, and then the first modem sends the encoded audio data to the target terminal through the network.
The audio acquisition module may be a microphone, or may be a device integrated with a microphone or other audio acquisition units, such as a CODEC.
Wherein the first signal processor is a digital signal processor.
In this embodiment, because the audio data to be encoded is large, after the first signal processor acquires the audio data to be encoded, the audio data to be encoded is first stored in the first memory, and the first application processor may take out the audio data to be encoded from the first memory, so that a vocoder on the first application processor may encode the audio data, thereby implementing transmission and encoding of the data to be encoded.
In this embodiment, the audio data transmission device is used to acquire the audio data to be encoded, encode it, and transmit it, which means that the transmission device is used as an intercom sending terminal.
As can be seen from the above description, after receiving audio data to be encoded, the first signal processor stores the audio data to be encoded in the first memory, and the first application processor may directly acquire the audio data to be encoded from the first memory to implement the first application process, and encode the audio data to be encoded and send the encoded audio data to the first signal processor, so that the first signal processor may send the encoded audio data to a target terminal to implement encoding and transmission of the audio data.
Fig. 3 is a flowchart of an audio data transmission method according to an embodiment of the present invention, which can be applied to the audio data transmission apparatus in the embodiment of fig. 2. As shown in fig. 3, the method of this embodiment may include:
s301, the audio acquisition module acquires audio data to be coded and sends the audio data to be coded to the first signal processor.
In this embodiment, the audio acquiring module acquires audio data to be encoded, for example, voice data input by a user, and sends the acquired audio data to be encoded to the first signal processor.
When the audio data to be encoded is sent to the first signal processor, the audio data to be encoded may be sent to the first signal processor according to a first-in first-out rule, that is, the audio data to be encoded that is obtained first is sent to the first signal processor.
S302, the first signal processor stores the audio data to be coded to a first memory.
In this embodiment, the first signal processor saves the received audio data to be encoded to the first memory so that the first application processor can retrieve the audio data to be encoded from the first memory.
Optionally, after the first signal processor saves the audio data to be encoded to the first memory, the method further includes:
the first signal processor sends a first notification message to the first application processor.
In this embodiment, after the first signal processor stores the audio data to be encoded in the first memory, the first signal processor may send a first notification message to the first application processor to notify the first application processor that the audio data to be encoded has been stored in the first memory, so that the first application processor may acquire the data to be encoded from the first memory in time, thereby implementing synchronous acquisition of data, and avoiding a situation where the audio data to be encoded is covered due to untimely extraction of the audio data to be encoded from the first memory.
S303, the first application processor acquires the audio data to be coded from the first memory, codes the audio data to be coded, and sends the coded audio data to the first signal processor.
In this embodiment, the first application processor acquires audio data to be encoded from the first memory, encodes the audio data, and sends the encoded audio data to the first signal processor.
When the first signal processor is received to transmit the first notification message in order to avoid the content in the first memory from being overwritten, that is, when the first notification message is received, the first application processor acquires the audio data to be encoded from the first memory.
Optionally, after the audio data to be encoded is fetched from the first memory, the first application processor returns the first response information to the first signal processor.
In this embodiment, the first signal processor continues to store the audio data to be encoded in the first memory after receiving the first response message, so as to prevent the audio data in the first memory from being overwritten.
In this embodiment, after the first signal processor stores the audio data to be encoded in the first memory, the first signal processor sends a first notification message to the first application processor, so that the first application processor can timely retrieve the audio data to be encoded from the first memory, and when the first application processor retrieves the audio data to be encoded, the first signal processor returns a first response message to the first signal processor to notify that the first signal processor has retrieved the audio data to be encoded, and the first signal processor continues to store new audio data in the first memory, so that synchronous storage and retrieval of data are achieved through an inter-core message mechanism, and content in the first memory is prevented from being overwritten.
S304, the first signal processor receives the coded audio data and sends the coded audio data to the target terminal through the first modem.
In this embodiment, since the encoded audio data is small, the first application processor may directly transmit the encoded audio data to the first signal processor. The first signal processor sends the received encoded audio data to the target terminal through the first modem, that is, the encoded audio data is sent to the target terminal, so that the target terminal can decode and play the encoded voice data, and therefore a listener in a voice call can know the words spoken by a speaker.
After receiving the encoded audio data, the first signal processor may not immediately send the audio data to the first modem, so to avoid timing problems, after receiving the encoded audio data, the first signal processor may timestamp the audio data, and then send the audio data to the first modem in the order of the timestamps, which is specifically performed by: and adding a time stamp to the encoded audio data, and saving the time-stamped encoded audio data to the second memory. And according to the sequence of the time stamps in the second memory, acquiring the encoded audio data from the second memory and transmitting the audio data to the target terminal through the first modem.
In this embodiment, the first signal processor may timestamp the audio data according to the time of receiving the audio data after receiving the encoded audio data, i.e. the timestamp represents the time of receiving the audio data. The time stamps in the second memory are sorted in order from early to late, that is, the time stamps with earlier receiving time are ranked higher, and then the encoded audio data are obtained from the second memory in the order of the time stamps in the second memory and transmitted to the target terminal through the first modem, that is, the audio data with the earliest time stamp are obtained from the second memory and transmitted, so that the audio data to be encoded, which is received earliest in time sequence, is transmitted to the target terminal.
The second memory may be a memory of the terminal where the audio data transmission device is located, a memory on the audio data transmission device, or a memory on another external terminal, where the location of the first memory is not limited. The second memory may be a memory buffer that is developed ahead of time for the first signal processor.
As can be seen from the above description, after receiving audio data to be encoded, the first signal processor stores the audio data to be encoded in the first memory, and the first application processor can directly acquire the audio data to be encoded from the first memory, so as to achieve acquisition of the audio data to be encoded by the first application processor, and encode the audio data to be encoded and send the encoded audio data to the first signal processor, so that the first signal processor can send the encoded audio data to a target terminal, thereby constructing a novel transmission mode, so that the audio data transmission device can encode the audio data to be encoded and transmit the encoded audio data to the target terminal, i.e., achieving encoding and transmission of the audio data.
Fig. 4 is a schematic structural diagram of an audio data transmission apparatus according to an embodiment of the present invention, and as shown in fig. 4, the transmission apparatus further includes an audio playing module 401, a second signal processor 402, a second application processor 403, and a second modem 404.
A second modem 404 for acquiring the encoded audio data and sending the encoded audio data to the second signal processor 402.
A second signal processor 402 for sending the encoded audio data to a second application processor 403.
The second application processor 403 is configured to decode the encoded audio data to obtain decoded audio data, and store the decoded audio data in the third memory 405.
The second signal processor 402 is further configured to obtain the decoded audio data from the third memory 405, and play the decoded audio data through the audio playing module 401.
In this embodiment, after acquiring the encoded audio data, the second modem sends the encoded audio data to the second signal processor, and because the size of the encoded audio data is small, the encoded audio data can be directly sent to the second application processor, and the second application processor decodes the encoded audio data, and because the size of the decoded audio data is large, the decoded audio data cannot be directly transmitted to the second signal processor, and needs to be stored in the third memory, and the second signal processor acquires the decoded audio data from the third memory, thereby implementing transmission of the decoded audio data.
And the second signal processor plays the decoded audio data through the audio playing module after acquiring the decoded audio data. When the encoded audio data received by the audio data transmission device is sent by other talkback sending terminals, the terminal where the audio data transmission device is located is taken as a talkback receiving terminal. After the decoded audio data are played through the audio playing module, a user corresponding to the terminal where the audio data transmission device is located can know the user using the talkback sending terminal, namely the speaking person speaks, and voice communication is achieved.
The third memory may be a memory of the terminal where the audio data transmission device is located, a memory on the audio data transmission device, or a memory on another external terminal, where the location of the third memory is not limited. The third storage may be a memory, a shared memory, etc.
The audio playing module may be a player, or may be a device integrated with the player or other audio playing units, for example, a CODEC.
The second application processor may be the first application processor, or may not be the first application processor, and here, it is no longer limited, and when the second application processor is the first application processor, it means that the first application processor can perform both encoding and decoding.
The second signal processor may be the first signal processor, or may not be the first signal processor, and herein, no limitation is made.
The second modem may be the first modem, or may not be the first modem, and herein, the limitation is not repeated.
The third memory may be the first memory, or may not be the first memory, and herein, the limitation is not repeated.
Alternatively, the audio data transmission apparatus may be integrated on the terminal, that is, the terminal includes the audio data transmission apparatus described in the above embodiments.
The terminal can be a talkback sending terminal in voice talkback, and can also be a talkback receiving terminal.
As can be seen from the above description, after receiving the encoded audio data, the second signal processor needs to send the encoded audio data to the second application processor, so that the second application processor decodes the encoded audio data, and since the decoded audio data is large, the second application processor needs to first store the audio data in the third memory, so that the second signal processor obtains the decoded audio data from the third memory to implement decoding of the audio data, and the second signal processor obtains the decoded audio data and plays the decoded audio data through the audio playing module, thereby implementing transmission of the audio data and playing of the speech.
Fig. 5 is a flowchart of an audio data receiving method according to an embodiment of the present invention, which can be applied to the audio data transmission apparatus in the embodiment of fig. 4. As shown in fig. 5, the method of this embodiment may include:
s501, the second modem acquires the coded audio data and sends the coded audio data to the second signal processor.
In this embodiment, the second modem obtains encoded audio data, and when the encoded audio data is sent by the talkback sending terminal, it indicates that the terminal where the audio transmission device is located becomes a talkback receiving terminal, and the audio data transmission device decodes the decoded audio data and plays the decoded audio data, so that a user corresponding to the talkback receiving terminal can obtain a word spoken by a speaker, that is, a word spoken by a user corresponding to the talkback receiving terminal.
And after the second modem acquires the coded audio data, the second modem sends the acquired coded audio data to the second signal processor.
Wherein the second modem may obtain the encoded audio data over a network when obtaining the encoded audio data.
And S502, the second signal processor sends the coded audio data to the second application processor.
In this embodiment, since the encoded audio data is small, the encoded audio data can be directly transmitted to the second application processor, that is, the second signal processor can directly send the encoded audio data to the second application processor without using an associated memory.
S503, the second application processor decodes the encoded audio data to obtain decoded audio data, and stores the decoded audio data in a third memory.
In this embodiment, the second application processor decodes the encoded audio data to obtain decoded audio data, and since the decoded audio data is large, the audio data cannot be directly transmitted to the second signal processor, and needs to be transmitted by using the third memory, that is, the decoded audio data is stored in the third memory, so that the second signal processor can obtain the decoded audio data from the third memory.
Optionally, after the storing the decoded audio data in the third memory, the method further includes:
the second application processor sends a second notification message to the second signal processor.
In this embodiment, after the second application processor stores the decoded audio data in the third memory, the second application processor may further send a second notification message to the second signal processor to notify the second signal processor that the second signal processor has stored the decoded audio data in the third memory, so that the second signal processor may timely fetch the decoded audio data from the third memory, thereby implementing synchronous data acquisition and avoiding the occurrence of a situation where the decoded audio data is covered due to the decoded audio data not being timely fetched from the third memory.
S504, the second signal processor obtains the decoded audio data from the third memory, and plays the decoded audio data through the audio playing module.
In this embodiment, after the second signal processor obtains the decoded audio data from the third memory, it may send the audio data to the audio playing module, so that the audio playing simulates playing the decoded audio data.
When receiving a second notification message sent by the second application processor to avoid the content in the third memory from being overwritten, that is, when receiving the second notification message, the second signal processor acquires the decoded audio data from the third memory.
Optionally, after the decoded audio data is fetched from the third memory, the second signal processor returns the second response information to the second application processor.
In this embodiment, the second application processor continues to store the decoded audio data to the third memory after receiving the second response message, so as to avoid that the audio data in the third memory is overwritten.
In this embodiment, after the second application processor stores the decoded audio data in the third memory, the second application processor sends a second notification message to the second signal processor, so that the second signal processor can take out the decoded audio data from the third memory in time, and when the second signal processor takes out the audio data to be encoded, the second application processor returns a second response message to the second application processor to notify the second application processor that the decoded audio data has been taken away, and the second application processor continues to store new decoded audio data in the third memory, so that synchronous storage and taking out of data are realized through an inter-core message mechanism, and content in the third memory is prevented from being covered.
In this embodiment, when sending the decoded audio data to the audio playing module, the second signal processor may send the decoded audio data obtained earlier to the audio playing module according to a first-in first-out rule, for example, the second signal processor adds a timestamp to the decoded audio data according to a time when the decoded audio data is received, then obtains the encoded audio data according to a sequence of the timestamps, and sends the encoded audio data to the audio playing module, and a specific process thereof is similar to a type of a process in which the first signal processor sends the encoded audio data to the first modem according to the timestamp in the embodiment of fig. 3, and is not described herein again.
As can be seen from the above description, after receiving the encoded audio data, the second signal processor needs to send the encoded audio data to the second application processor, so that the second application processor decodes the encoded audio data, because the decoded audio data is large, the second application processor needs to first store the audio data in the third memory, so that the second signal processor obtains the decoded audio data from the third memory, and implements decoding of the audio data, and the second signal processor obtains the decoded audio data and plays the decoded audio data through the audio playing module, so as to construct a novel transmission mode, so that the audio data transmission device can decode the encoded audio data and play the decoded audio data, i.e., implement transmission of the audio data and playing of the speech.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and these modifications or substitutions do not depart from the spirit of the corresponding technical solutions of the embodiments of the present invention.
Claims (8)
1. The audio data transmission method is applied to an audio data transmission device, and the transmission device comprises an audio acquisition module, a first signal processor, a first application processor and a first modem;
the method comprises the following steps:
the audio acquisition module acquires audio data to be coded and sends the audio data to be coded to the first signal processor;
the first signal processor saves the audio data to be coded to a first memory; the first signal processor sending a first notification message to the first application processor;
when the first notification message is received, the first application processor acquires the audio data to be coded from the first memory, returns first response information to the first signal processor, codes the audio data to be coded, and sends the coded audio data to the first signal processor;
and the first signal processor receives the coded audio data and sends the coded audio data to a target terminal through a first modem.
2. The method of claim 1, further comprising, after said receiving said encoded audio data:
and adding a time stamp to the encoded audio data, and saving the encoded audio data added with the time stamp to a second memory.
3. The method of claim 2, wherein sending the encoded audio data to a target terminal via a first modem comprises:
and acquiring the coded audio data from the second memory according to the sequence of the time stamps in the second memory, and sending the coded audio data to a target terminal through the first modem.
4. The method of claim 1, wherein the transmission device further comprises an audio playing module, a second signal processor, a second application processor, and a second modem;
the method further comprises the following steps:
the second modem acquires the encoded audio data and sends the encoded audio data to a second signal processor;
the second signal processor sending the encoded audio data to the second application processor;
the second application processor decodes the encoded audio data to obtain decoded audio data, and stores the decoded audio data to a third memory;
and the second signal processor acquires the decoded audio data from the third memory and plays the decoded audio data through the audio playing module.
5. The method of claim 4, further comprising, after said saving the decoded audio data to a third memory:
the second application processor sending a second notification message to the second signal processor;
accordingly, the second signal processor retrieves the decoded audio data from the third memory, including:
upon receiving the second notification message, the second signal processor retrieves the decoded audio data from the third memory.
6. The audio data transmission device is characterized by comprising an audio acquisition module, a first signal processor, a first application processor and a first modem;
the audio acquisition module is used for acquiring audio data to be encoded and sending the audio data to be encoded to the first signal processor;
the first signal processor is used for saving the audio data to be coded to a first memory; the first signal processor sending a first notification message to the first application processor;
the first application processor is configured to, when receiving the first notification message, acquire the audio data to be encoded from the first memory, return first response information to the first signal processor, encode the audio data to be encoded, and send the encoded audio data to the first signal processor;
the first signal processor is further configured to receive the encoded audio data and send the encoded audio data to a target terminal through a first modem.
7. The apparatus of claim 6, wherein the transmission means further comprises an audio playback module, a second signal processor, a second application processor, and a second modem;
the second modem is used for acquiring the encoded audio data and sending the encoded audio data to the second signal processor;
the second signal processor is used for sending the encoded audio data to the second application processor;
the second application processor is configured to decode the encoded audio data to obtain decoded audio data, and store the decoded audio data in a third memory;
the second signal processor is further configured to obtain the decoded audio data from the third memory, and play the decoded audio data through the audio playing module.
8. A terminal, characterized in that it comprises an audio data transmission device according to claim 6 or 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911148361.XA CN112825488B (en) | 2019-11-21 | 2019-11-21 | Audio data transmission method and device and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911148361.XA CN112825488B (en) | 2019-11-21 | 2019-11-21 | Audio data transmission method and device and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112825488A CN112825488A (en) | 2021-05-21 |
| CN112825488B true CN112825488B (en) | 2022-07-22 |
Family
ID=75907336
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911148361.XA Active CN112825488B (en) | 2019-11-21 | 2019-11-21 | Audio data transmission method and device and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112825488B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113488065B (en) * | 2021-07-01 | 2024-05-14 | 上海卓易科技股份有限公司 | Audio output method, device, computer equipment and storage medium based on cloud phone |
| CN114362887B (en) * | 2022-01-11 | 2024-11-22 | 北京梧桐车联科技有限责任公司 | Data sending, data receiving method, device, equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102271197A (en) * | 2010-06-04 | 2011-12-07 | 苹果公司 | User interface tone echo cancellation |
| CN102970394A (en) * | 2011-08-30 | 2013-03-13 | 瑞萨移动公司 | Semiconductor device, radio communication terminal using the same, and control method |
| CN105306110A (en) * | 2015-09-18 | 2016-02-03 | 深圳市冠旭电子有限公司 | Methods and system for realizing music synchronous play |
| CN106028369A (en) * | 2015-03-27 | 2016-10-12 | 英特尔公司 | Device and method for processing audio data |
| WO2019192030A1 (en) * | 2018-04-04 | 2019-10-10 | 华为技术有限公司 | Bluetooth playing method and electronic device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2432765B (en) * | 2005-11-26 | 2008-04-30 | Wolfson Microelectronics Plc | Audio device |
-
2019
- 2019-11-21 CN CN201911148361.XA patent/CN112825488B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102271197A (en) * | 2010-06-04 | 2011-12-07 | 苹果公司 | User interface tone echo cancellation |
| CN102970394A (en) * | 2011-08-30 | 2013-03-13 | 瑞萨移动公司 | Semiconductor device, radio communication terminal using the same, and control method |
| CN106028369A (en) * | 2015-03-27 | 2016-10-12 | 英特尔公司 | Device and method for processing audio data |
| CN105306110A (en) * | 2015-09-18 | 2016-02-03 | 深圳市冠旭电子有限公司 | Methods and system for realizing music synchronous play |
| WO2019192030A1 (en) * | 2018-04-04 | 2019-10-10 | 华为技术有限公司 | Bluetooth playing method and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112825488A (en) | 2021-05-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7822050B2 (en) | Buffering, pausing and condensing a live phone call | |
| KR101877699B1 (en) | De-jitter buffer update | |
| US7792675B2 (en) | System and method for automatic merging of multiple time-stamped transcriptions | |
| US8583431B2 (en) | Communications system with speech-to-text conversion and associated methods | |
| KR101550462B1 (en) | A method and an apparatus for embedding data in a media stream | |
| CN112825488B (en) | Audio data transmission method and device and terminal | |
| HK1200620A1 (en) | Voice communication method and system in game application | |
| JP2001331199A (en) | Audio processing method and audio processing device | |
| TW200917764A (en) | System and method for providing AMR-WB DTX synchronization | |
| CN1093340C (en) | Speech transmission/reception system in which error data is replaced by speech synthesized data | |
| RU2018109764A (en) | Method and system for generating and transmitting emergency call signal | |
| CN109040818B (en) | Audio and video synchronization method, storage medium, electronic equipment and system during live broadcasting | |
| CN111787420B (en) | Data processing method and device, electronic equipment and readable storage medium | |
| US8326123B2 (en) | Movie player, mobile terminal, and data processing method of mobile terminal | |
| CN111277864B (en) | Encoding method and device of live data, streaming system and electronic equipment | |
| CN1316841C (en) | Communication terminal, communicating system | |
| CN1140985C (en) | Circuit and method for recording and playback of speech and other sounds in a digital mobile radio device | |
| CN103325385A (en) | Method and device for speech communication and method and device for operating jitter buffer | |
| JP4551555B2 (en) | Encoded data transmission device | |
| US20060259618A1 (en) | Method and apparatus of processing audio of multimedia playback terminal | |
| JPS593492A (en) | Voice signal controller | |
| JP2002223296A (en) | Key telephone equipment | |
| CN118887944A (en) | A method for processing voice data, electronic equipment, service equipment and readable storage medium | |
| JP6476768B2 (en) | Voice processing apparatus, program and method | |
| CN116781180A (en) | PCM channel capacity expansion method and capacity expansion system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |