CN111107296B - Audio data acquisition method and device, electronic equipment and readable storage medium - Google Patents

Abstract

The embodiment of the application provides an audio data acquisition method, an audio data acquisition device, electronic equipment and a readable storage medium, wherein the method is applied to a terminal, the terminal is provided with a plurality of Universal Serial Bus (USB) interfaces, and the method comprises the following steps: when a USB interface of the terminal is accessed to data acquisition equipment with an audio data acquisition function, determining the data acquisition equipment as target equipment for executing audio data acquisition; detecting whether the plurality of USB interfaces are connected with new audio acquisition equipment or not; when the audio acquisition equipment is detected to be accessed, determining a first audio quality priority corresponding to the data acquisition equipment and a second audio quality priority corresponding to the audio acquisition equipment; and when the first audio quality priority is lower than the second audio quality priority, switching the target equipment for executing the audio data acquisition to the audio acquisition equipment. The method and the device can improve the quality of the audio data collected in the audio and video conference.

Description

Audio data collection method, device, electronic device and readable storage medium

technical field

The present application relates to the technical field of data collection, in particular to an audio data collection method, device, electronic equipment and readable storage medium.

Background technique

With the continuous development of network communication technologies, various instant messaging applications are widely used. For example, users can conduct video calls or voice calls through instant messaging applications, and can also conduct video conferences.

Taking video conferencing as an example, in order to keep some video conferencing content confidential, it is often necessary to use an external camera or microphone to the terminal, connect the camera when participating in the video conference, and unplug the camera when exiting the video conference equipment. Among them, the terminal used by most users is a terminal with an Android system installed. However, when an existing Android terminal uses a camera device for audio and video collection, the audio collection function of the camera device is often poor, resulting in unclear audio and noisy audio. Noise issue. Therefore, the quality of the audio data collected by the existing Android terminal needs to be improved.

Contents of the invention

In view of the above problems, the embodiments of the present application are proposed to provide an audio data collection method, device, electronic device, and readable storage medium that overcome the above problems or at least partially solve the above problems.

In the first aspect, the embodiment of the present application discloses a method for collecting audio data, the method is applied to a terminal, and the terminal is configured with multiple Universal Serial Bus USB interfaces, and the method includes:

When the USB interface of the terminal is connected to a data collection device with an audio data collection function, the data collection device is determined as a target device for performing audio data collection;

Detect whether the multiple USB interfaces are connected to a new audio collection device;

When detecting access to the audio collection device, determine the first audio quality priority corresponding to the data collection device, and the second audio quality priority corresponding to the audio collection device;

When the first audio quality priority is lower than the second audio quality priority, switch the target device for executing the audio data collection to the audio collection device.

Optionally, after switching the target device for executing the audio data collection to the audio collection device, the method further includes:

When it is determined that the audio collection device is removed, the target device for performing the audio data collection is re-switched to the data collection device.

Optionally, the data acquisition device also has a video data acquisition function, and the terminal is communicatively connected to a streaming media server, and the method further includes:

Determining the data acquisition device as a video acquisition device performing video data acquisition;

While switching the target device for performing the audio data collection to the audio collection device, the method further includes:

Obtaining video data collected by the data collection device, and obtaining audio data collected by the audio collection device;

Mixing the audio data and the video data into audio and video data, and sending the audio and video data to the streaming media server.

Optionally, before detecting whether the multiple USB interfaces are connected to a new audio collection device, the method also includes:

determining a first device ID corresponding to the data collection device, and adding the first device ID to a preset routing list;

Determining the first audio quality priority corresponding to the data collection device, and the second audio quality priority corresponding to the audio collection device, including:

determining a second device ID corresponding to the audio collection device, and acquiring the first device ID from the routing list;

Based on the first device ID and the second device ID, determine a first audio quality priority corresponding to the data collection device and a second audio quality priority corresponding to the audio collection device.

Optionally, after determining the second device ID of the audio collection device, the method further includes:

adding the second device ID to the routing list;

determining whether the audio capture device is removed, and determining whether the data capture device is removed;

When it is determined that the data collection device is removed, deleting the first device ID from the routing list;

When it is determined that the audio collection device is removed, the second device ID is deleted from the routing list.

In the second aspect, the embodiment of the present application discloses an audio data collection device, the device is applied to a terminal, and the terminal is configured with multiple Universal Serial Bus USB interfaces, and the device includes:

An audio collection determination module, configured to determine the data collection device as the target device for performing audio data collection when the USB interface of the terminal is connected to a data collection device with audio data collection function;

An audio device detection module, configured to detect whether the multiple USB interfaces are connected to a new audio collection device;

A priority determination module, configured to determine a first audio quality priority corresponding to the data collection device and a second audio quality priority corresponding to the audio collection device when access to the audio collection device is detected;

An audio collection switching module, configured to switch the target device for executing the audio data collection to the audio collection device when the first audio quality priority is lower than the second audio quality priority.

Optionally, the device also includes:

a device ID determining unit, configured to determine a first device ID corresponding to the data collection device;

a device ID adding unit, configured to add the first device ID to a preset routing list;

The priority determination module may specifically include the following units:

The device ID determining unit may be used to determine a second device ID corresponding to the audio collection device;

a device ID obtaining unit, configured to obtain a first device ID corresponding to the data collection device from a preset routing list;

A priority determination unit, configured to determine the first audio quality priority corresponding to the first audio collection device and the second audio quality priority corresponding to the data collection device based on the first device ID and the second device ID. Audio quality priority.

Optionally, the data collection device also has a video data collection function, the terminal is connected to a streaming media server in communication, and the device also includes:

A video data acquisition determining module, configured to determine the data acquisition device as a video acquisition device performing video data acquisition;

An audio and video data acquisition module, configured to acquire video data collected by the data collection device, and obtain audio data collected by the audio collection device;

The audio and video data sending module is used for mixing the audio data and the video data into audio and video data, and sending the audio and video data to the streaming media server.

In a third aspect, the embodiment of the present application provides an electronic device, including:

one or more processors; and

One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, causes the device to perform the audio data collection method as described in the first aspect.

In a fourth aspect, an embodiment of the present application is a computer-readable storage medium, and a computer program stored therein enables a processor to execute the audio data collection method as described in the first aspect.

The embodiment of the present application includes the following advantages:

In this embodiment of the application, when the USB interface of the terminal is connected to a data collection device, the data collection device can be determined as the target device for audio data collection, and it is detected whether multiple USBs of the terminal are connected to a new audio collection device. When a new audio collection device is connected, determine the first audio quality priority of the data collection device and the second audio quality priority of the audio collection device, and the second audio quality priority of the audio collection device is higher than the first audio quality priority When the level is higher, the new audio collection device is determined as the target device for audio data collection, that is, the new audio collection device collects audio data instead. Since the terminal has multiple USB interfaces and can identify a newly connected audio collection device, and when the audio quality priority of the newly connected audio collection device is high, the audio data can be collected by the new audio collection device. The audio quality priority of the audio collection device is higher, and the quality of the audio collection is better, thereby improving the quality of the collected audio data.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments of the present application. Obviously, the accompanying drawings in the following description are only some embodiments of the present application , for those skilled in the art, other drawings can also be obtained according to these drawings without paying creative labor.

FIG. 1 is a schematic diagram of a terminal to which an audio data collection method according to an embodiment of the present application is applied;

Fig. 2 is a flow chart of the steps of a method for collecting audio data according to an embodiment of the present application;

Fig. 3 is the complete schematic flow chart of the actual execution audio data acquisition method of the embodiment of the present application;

Fig. 4 is a structural block diagram of an audio data collection device according to an embodiment of the present application.

detailed description

In order to make the above objects, features and advantages of the present application more obvious and comprehensible, the present application will be further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

In view of the problem of low quality of audio data collected by existing terminals that need to be solved above, the applicant found that existing terminals are mainly connected to camera equipment and microphones through USB, but the terminal is for all devices connected by USB (regardless of Whether it is a camera device or a microphone), it will be recognized as an audio device, that is, only the audio device that is first inserted into the USB can be recognized.

For example, if camera device 1 (with audio collection function) is plugged into USB1, the terminal recognizes it as usb-Audio, and uses the device. When USB2 is plugged into high-quality microphone 2, the terminal continues to recognize it as usb-Audo, and then connect it to The device does not process. In this way, the audio data is still collected by the imaging device 1, but the audio collection effect of the imaging device is not good, so that the quality of the audio data cannot be improved. Generally, the microphone 2 can be used to collect high-quality audio data only after the camera device 1 and the microphone 2 are completely unplugged and then reinserted into the microphone 2 . In this way, the camera device 1 cannot collect video data, and the user has to change the video conference to an audio conference, which affects user experience. In addition, the process of unplugging all devices will cause a large loss of audio data, resulting in inefficient video conferencing.

Therefore, the applicant proposes the audio data collection method described in the embodiment of the present application, so that in the process of collecting audio data, it can be switched to using a new high-quality audio collection device to collect audio data, so as to improve the audio frequency in video conferencing. Improve the quality of audio data, optimize user experience, and improve the efficiency of video conferencing.

Referring to FIG. 1 , it shows a schematic diagram of a terminal applied to an audio data collection method according to an embodiment of the present application. As shown in FIG. 1 , multiple Universal Serial Bus USB interfaces can be configured on the terminal, and the USB interface It can be used to access equipment with audio data collection function, such as microphone 11, camera equipment 12 with audio collection function, etc. The terminal can be a terminal running an Android system or a linux system, and the method can be specifically applied to audio and video conference scenarios.

Referring to FIG. 2 , it shows a flow chart of the steps of a method for collecting audio data according to an embodiment of the present application. In conjunction with the terminal shown in FIG. 1 , the method for collecting audio data according to the embodiment of the present application is described in detail. Include the following steps:

Step S21, when the USB interface of the terminal is connected to a data collection device capable of collecting audio data, determine the data collection device as a target device for audio data collection.

In this embodiment, the data collection device may be a device that only has audio data collection functions, such as a microphone, or may be a device that has other data collection functions in addition to audio data collection functions, such as a video camera that can collect audio equipment. Wherein, other data collection functions may refer to video data collection functions or image collection functions. When any one of the multiple USB interfaces of the terminal is connected with a data collection device, it can be determined that the data collection device performs audio data collection. Furthermore, when the audio and video conference starts, the data collection device can collect audio data.

In an optional example, after a data collection device is connected to the USB interface of the terminal, it can be determined that the data collection device performs audio data collection when the terminal performs audio and video services, that is, the terminal performs audio and video services , the audio data is collected by the data collection device. For example, if the terminal performs video services, the data collection device may be a device with video data collection functions and audio data collection functions, and the data collection device may collect audio data and video data. If the terminal performs an audio service, the data collection device may only collect audio data.

For example, as shown in FIG. 1 , if the terminal 100 is currently connected to a camera device 12 capable of collecting audio data, the camera device 12 may be determined as a target device for collecting audio data.

Step S22, detecting whether the multiple USB interfaces are connected to a new audio collection device.

In the embodiment of the present application, since the terminal is equipped with multiple USB interfaces, after the terminal is connected with a data acquisition device, the terminal can start scanning for multiple USB interfaces to detect whether other USB interfaces are connected with a new audio acquisition device . Specifically, the new audio collection device may be a newly connected device after the data collection device is connected, and the audio collection device and the data collection device are respectively connected to different USB interfaces. The audio collection device can be used for audio data collection, such as a microphone.

Step S23, when it is detected that the audio collection device is connected, determine the first audio quality priority corresponding to the data collection device and the second audio quality priority corresponding to the audio collection device.

In practice, when it is detected that an audio collection device is connected to a USB interface of the terminal, the terminal can start an audio routing strategy for the data collection device and the audio collection device to collect audio data between the data collection device and the audio collection device switching, so that the audio data acquisition can be performed with a device with higher audio acquisition quality.

Specifically, since different devices have different sampling rates when performing audio data collection, the quality of the finally collected audio data is also different. Therefore, the respective audio quality priorities of the audio collection device and the data collection device may be determined first. Wherein, the first audio quality priority may refer to the audio quality priority of the audio data collected by the data collection device, and the second audio quality priority may refer to the audio quality priority of the audio data collected by the data collection device.

In practice, the higher the sampling rate, the better the audio quality, and the higher the audio quality priority. Therefore, the first audio quality priority may be determined according to the sampling rate of the data collection device, and the second audio quality priority may be determined according to the sampling rate of the audio collection device.

For example, as shown in FIG. 1, after the terminal 100 is connected to the camera device 12, it can detect whether other multiple USB ports are connected to a new audio collection device. For example, if it detects that other USB ports are connected to the microphone 11, then The audio quality priority of the microphone 11 and the audio quality priority of the camera 12 can be determined.

Step S24, when the first audio quality priority is lower than the second audio quality priority, switch the audio data collection target device to the audio collection device.

In the embodiment of the present application, when the second audio quality priority is higher than the first audio quality priority, it means that the sampling rate of the newly connected audio collection device is higher, and the audio quality collected by it is higher than that of the data collection device. Preferably, the audio collection device can be used as the target device for audio data collection.

During specific implementation, since the target device for performing audio data collection is the data collection device before the audio collection device is connected, when it is determined that the second audio quality priority of the audio collection device is higher, the routing strategy can be executed, and the audio Acquisition is initialized to switch the target device performing audio data acquisition to an audio acquisition device. In this way, the data collection device no longer performs audio data collection, but switches to the audio data collection performed by the audio collection device, thereby improving the quality of collected audio in an audio-video conference. And because the application is to switch between multiple devices as the target device for audio data collection, in this way, the video data collection function of the video data collection device can be maintained, ensuring that the video data collection is not affected during the video conference.

For example, as shown in FIG. 1, if it is determined that the audio quality priority of the microphone 11 is higher than the audio quality priority of the camera device 12, then the microphone 11 may be determined as the target device for audio data collection instead, and the camera device 12 does not Perform audio data collection again.

In the embodiment of this application, when the terminal accesses the data collection device, it can determine the data collection device as the target device for audio data collection, and detect whether multiple USBs of the terminal are connected to a new audio collection device. When using an audio collection device, determine the first audio quality priority of the data collection device and the second audio quality priority of the audio collection device, and when the second audio quality priority of the audio collection device is higher than the first audio quality priority, Then the new audio collection device is determined as a target device for audio data collection, that is, the new audio collection device collects audio data.

Since the terminal has multiple USB interfaces and can identify a newly connected audio collection device, and when the audio quality priority of the audio collection device is high, the audio data can be collected by the new audio collection device. The higher the audio quality priority, the better the quality of its audio collection, thereby improving the quality of the collected audio data.

And because the terminal can automatically detect whether there is a new audio collection device connected, and when the audio quality priority of the connected new audio collection device is higher, it will automatically switch to the audio collection device to collect audio data, thereby avoiding all The audio collection and video collection are interrupted by pulling out the audio collection device and the data collection device and then reinserting the audio collection device, thus ensuring the normal progress of the video conference.

In combination with the above embodiments, in order to ensure the normal progress of the video conference and avoid the problem that the high-quality audio collection device is disconnected from the terminal during the collection of audio data, and then the audio data cannot be collected, in an optional implementation mode , after step S24, the audio data collection method may specifically include the following steps:

Step S25, when it is determined that the audio collection device is removed, re-switch the target device for executing the audio data collection to the data collection device.

In this optional example, when it is determined that the audio data is collected by the audio collection device, whether the audio collection device is removed may be determined by detecting the connection status between the audio collection device and the terminal. If it is detected that the audio collection device is disconnected from the terminal, it may indicate that the audio collection device has been removed. At this time, in order not to affect the normal collection of audio data, the data collection device may be re-determined as the device for performing audio data collection, that is, the data collection device is resumed to collect audio data.

For example, if the microphone 11 is disconnected from the terminal, the camera device 12 may perform audio data collection again.

In combination with the above embodiments, in order to ensure the normal progress of the video conference conducted by the user, the data collection device also has a video data collection function, so that the data collection device can not only collect audio data but also collect video data. In an optional example, the terminal is communicatively connected to a streaming media server, and the streaming media server can be used to forward audio and video data in an audio and video conference that the terminal currently participates in. Specifically, the method may also include the following steps:

Step S211, determining the data collection device as a video collection device that performs video data collection.

In this optional embodiment, step S211 can be performed simultaneously with step S21, that is, when the data collection device is determined as the target device for audio data collection, the data collection device can also be determined as the device for video data collection at the same time. For example, when the camera device 12 is determined to collect audio data, it may also be determined that the camera device 12 performs video data collection.

In step S24, while switching the target device for performing the audio data collection to the audio collection device, the following steps may also be performed:

Step S41, acquiring the video data collected by the data collection device, and obtaining the audio data collected by the audio collection device.

In this optional embodiment, when the target device for performing the audio data collection is switched to the audio collection device, in the current audio and video conference, the audio data can be collected by the audio data collection device, and the audio data can be collected by the video data collection device. The device collects video data. Furthermore, the terminal can acquire the video data collected by the data collection device and the audio data collected by the audio collection device.

Step S42, mixing the audio data and the video data into audio and video data, and sending the audio and video data to the streaming media server.

In this optional embodiment, since audio data and video data are respectively collected by different devices, the terminal may mix the audio data and video data to obtain audio and video data. Specifically, audio data and video data may be mixed into audio and video data according to the time stamp included in the audio data and the time stamp included in the video data, so as to realize the synchronization of video images and audio. Furthermore, the audio and video data can be sent to the streaming media server.

Wherein, the streaming media server can send the audio and video data of the terminal to other terminal devices participating in the current audio and video conference.

In combination with the above embodiments, in order to implement unified management of access terminal devices, the conditions of access terminal devices can be monitored in real time. In an optional example, before step S20, the following steps may also be performed:

Step S00, determining a first device ID corresponding to the data collection device, and adding the first device ID to a preset routing list.

Among them, the routing list can be used to store the ID of the device that has connected to the terminal, that is, the terminal can add the ID of the device that has connected to itself to the routing list, so as to monitor the status of the device connected to the terminal in real time through the routing list .

In the embodiment of the present application, since the data collection device has been connected to the terminal, the ID of the data collection device can be added to the routing list. Specifically, the first device ID corresponding to the data collection may be determined first. Wherein, the first device ID may refer to the ID corresponding to the device type of the data collection device, and the ID may be a character string or a digital code. The device type refers to the device model of the data collection device. If the device models of two data collection devices are the same, the performance of the two data collection devices is the same. In this embodiment of the application, two devices with the same device model may have the same device ID.

For example, as shown in FIG. 1, the first device ID of the camera device 12 may be determined according to the device type of the camera device 12, and the first device ID may be added to the routing list to represent that the device currently accessing the terminal is camera equipment 12.

Correspondingly, determining the first audio quality priority of the data collection device and the second audio quality priority of the audio collection device in step S23 can be performed through the following steps:

Step S231, determine the second device ID corresponding to the audio collection device, and obtain the first device ID from the routing list.

When it is detected that the audio collection device is connected, the second device ID may be determined, where the second device ID may refer to an ID corresponding to the device type of the audio collection device. And the first device ID of the data collection device can be obtained from the routing list. Since the terminal can obtain the first device ID of the data collection device from the routing list when determining the audio quality priority, in practice, it is to obtain the ID of the device connected to the terminal. Furthermore, the audio quality priority of the newly connected device may be compared with that of the connected device.

Step S232, based on the first device ID and the second device ID, determine a first audio quality priority corresponding to the data collection device and a second audio quality priority corresponding to the audio collection device.

In this optional embodiment, since the first device ID corresponds to the device type of the data collection device, and the second device ID corresponds to the device type of the audio collection device, since the device type can reflect the performance of a device, the device types are different, and the performance different. Furthermore, the first audio quality priority and the second audio quality priority can be quickly determined through the first device ID and the second device ID, thereby improving the switching efficiency of audio data collection.

Specifically, a priority comparison table can be pre-stored in the terminal, and the respective audio quality priorities corresponding to each device ID can be written in the priority comparison table, and then, it can be determined according to the priority comparison table that the first device The first audio quality priority corresponding to the ID, and the second audio quality priority corresponding to the second device ID.

Correspondingly, in order to prevent the device that has been removed from being used as an audio data collection device for quality priority comparison during the switching process of audio data collection, and to improve the efficiency of audio data collection in this application, an optional In the example, after determining the second device ID of the audio collection device, the method may further include the following steps:

Step S233, adding the second device ID to the routing list.

In practice, this step S233 can be performed while step S231 is being performed, or can be performed after step S232. Specifically, after the second device ID is added to the routing list, it can be indicated that the terminal is currently connected to an audio collection device.

Step S26, determine whether the audio collection device is removed, and determine whether the data collection device is removed.

In this optional embodiment, after step S24 is executed, in order to realize real-time monitoring of the equipment connected to the terminal, the connection status between the data collection equipment and the audio collection equipment and the terminal can be further detected to determine whether the audio collection equipment has been moved. removed, and to determine if the data collection device was removed.

Specifically, if it is detected that the connection state between the data collection device and the terminal is disconnected, it is determined that the data collection device is removed, and if it is detected that the connection state between the audio collection device and the terminal is disconnected, it is determined that the audio collection device is removed.

Step S261, when it is determined that the data collection device is removed, delete the first device ID from the routing list.

Step S262, when it is determined that the audio collection device is removed, delete the second device ID from the routing list.

In practice, when it is determined that the data collection device is removed, the first device ID may be deleted from the routing list, and when it is determined that the audio collection device is removed, the second device ID may be deleted from the routing list. In this way, it is avoided that the removed device still exists in the device routing list, resulting in the comparison of audio quality priority with the newly connected device, so that when the newly connected device is a device with low audio quality priority, it cannot The problem of collecting audio data.

Referring to Figure 3, it shows a schematic diagram of the complete process of actually implementing the audio data collection method. In Figure 3, V2Vapp refers to the audio and video application APP installed on the terminal. Make audio and video calls in the Internet of Things. Among them, the Internet of View adopts real-time high-definition video exchange technology, which can provide required services on a network platform, such as high-definition video conferencing, video surveillance, intelligent monitoring and analysis, emergency command, digital broadcast TV, delayed TV, online teaching, Live broadcast, VOD on demand, TV mail, personalized recording (PVR), intranet (self-managed) channel, intelligent video broadcast control, information release and other dozens of video, voice, picture, text, communication, data and other services are all integrated On a system platform, realize high-definition quality video playback through TV or computer.

Specifically, the following processes are included:

First, when the V2Vapp service is started, audio collection may be initialized, that is, audio collection may be initialized so that the terminal can start collecting audio data. Specifically, the terminal may use a data collection device already connected to the terminal to collect audio data, and the supporting device ID described in FIG. 3 is the first device ID of the data collection device.

Then, scan the audio device to detect whether other USB ports are connected to new audio collection devices. When a new audio collection device is connected, the ID of the new audio collection device can be obtained. In FIG. 3, the inserted device ID refers to the second device ID of the new audio collection device.

Afterwards, the routing policy is executed, that is, the priority between the supporting device and the plug-in device is determined, so as to determine whether audio data collection needs to be switched. In FIG. 3 , whether to restart the audio module refers to determining whether to switch audio data collection to be performed by the plug-in device. Wherein, the audio module can be understood as a module for collecting and controlling audio data in the terminal.

Then, if the audio module does not need to be restarted, the collection starts, and the audio data collection is performed by the supporting device. If the audio module needs to be restarted, re-initialize the audio collection to stop the current support device from collecting audio data, and switch to the plug-in device to perform audio data collection.

Finally, the collected audio data is obtained. In FIG. 3 , using the audio data refers to playing the audio data or sending the audio data to the peer user who is making an audio and video call.

It should be noted that, for the method embodiment, for the sake of simple description, it is expressed as a series of action combinations, but those skilled in the art should know that the embodiment of the present application is not limited by the described action sequence, because According to the embodiment of the present application, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present application.

Referring to FIG. 4 , it shows a structural block diagram of an audio data acquisition device according to an embodiment of the present application. The device can be applied to a terminal, and the terminal can be configured with a plurality of Universal Serial Bus (USB) interfaces. The device can specifically Includes the following modules:

The audio collection determination module 41 can be used to determine the data collection device as the target device for performing audio data collection when the USB interface of the terminal is connected to a data collection device with audio data collection function;

The audio device detection module 42 can be used to detect whether the multiple USB interfaces are connected to a new audio collection device;

The priority determination module 43 may be configured to determine the first audio quality priority corresponding to the data collection device and the second audio quality priority corresponding to the audio collection device when it is detected that the audio collection device is connected. class;

The audio collection switching module 44 may be configured to switch the target device for executing the audio data collection to the audio collection device when the first audio quality priority is lower than the second audio quality priority.

Optionally, the device may specifically include the following modules:

The audio device switching module is configured to re-switch the target device for executing the audio data collection to the data collection device when it is determined that the audio collection device is removed.

Optionally, the device may specifically include the following modules:

a device ID determining unit, configured to determine a first device ID corresponding to the data collection device;

a device ID adding unit, configured to add the first device ID to a preset routing list;

The priority determination module 43 may specifically include the following units:

The device ID determining unit may be used to determine a second device ID corresponding to the audio collection device;

a device ID obtaining unit, configured to obtain a first device ID corresponding to the data collection device from a preset routing list;

The priority determination unit may be configured to determine the first audio quality priority corresponding to the first audio collection device and the first audio quality priority corresponding to the data collection device based on the first device ID and the second device ID. Two audio quality priorities.

Correspondingly, in an optional example, the device ID adding unit may also specifically be configured to add the second device ID to the routing list;

The device can also specifically include the following modules:

A device removal determination module, which can be used to determine whether the audio collection device is removed, and determine whether the data collection device is removed;

The device ID deletion module can be used to delete the first device ID from the routing list when it is determined that the data collection device is removed; and can be used to delete the first device ID when it is determined that the audio collection device is removed. removing the second device ID from the routing list.

Optionally, the data acquisition device also has a video data acquisition function, and the terminal is communicatively connected to a streaming media server, and the device may specifically include the following modules:

A video data collection determination module, which may be used to determine the data collection device as a video collection device for performing video data collection;

The audio and video data acquisition module can be used to obtain the video data collected by the data collection device, and obtain the audio data collected by the audio collection device;

The audio and video data sending module can be used to mix the audio data and the video data into audio and video data, and send the audio and video data to the streaming media server.

As for the embodiment of the audio data collection device, since it is basically similar to the embodiment of the audio data collection method, the description is relatively simple, and for relevant parts, please refer to the part of the description of the embodiment of the audio data collection method.

The embodiment of the present application also provides an electronic device, including:

one or more processors; and

One or more machine-readable media with instructions stored thereon, when executed by the one or more processors, causes the device to perform one or more audio data collection methods as described in the embodiments of the present application .

The embodiment of the present application also provides a computer-readable storage medium, and the computer program stored therein enables the processor to execute the audio data collection method as described in the embodiment of the present application.

Each embodiment in this specification is described in a progressive manner, each embodiment focuses on the difference from other embodiments, and the same and similar parts of each embodiment can be referred to each other.

Those skilled in the art should understand that the embodiments of the embodiments of the present application may be provided as methods, devices, or computer program products. Therefore, the embodiment of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

Embodiments of the present application are described with reference to flowcharts and/or block diagrams of methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor or processor of other programmable data processing terminal equipment to produce a machine such that instructions executed by the computer or processor of other programmable data processing terminal equipment Produce means for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the The instruction means implements the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions can also be loaded into a computer or other programmable data processing terminal equipment, so that a series of operational steps are performed on the computer or other programmable terminal equipment to produce computer-implemented processing, thereby The instructions executed above provide steps for implementing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

While the preferred embodiments of the embodiments of the present application have been described, additional changes and modifications can be made to these embodiments by those skilled in the art once the basic inventive concept is understood. Therefore, the appended claims are intended to be interpreted to cover the preferred embodiment and all changes and modifications that fall within the scope of the embodiments of the application.

Finally, it should also be noted that in this text, relational terms such as first and second etc. are only used to distinguish one entity or operation from another, and do not necessarily require or imply that these entities or operations, any such actual relationship or order exists. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or terminal equipment comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements identified, or also include elements inherent in such a process, method, article, or end-equipment. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or terminal device comprising said element.

Above, a kind of audio data collection method, a kind of audio data collection device, a kind of electronic equipment and a kind of computer-readable storage medium provided by the application have been introduced in detail. In this paper, specific examples are applied to the principle and implementation of the application. Way has been set forth, and the description of the above embodiment is only used to help understand the method of the present application and its core new ideas; Simultaneously, for those of ordinary skill in the art, according to the thought of the application, both in the specific implementation and application scope There will be changes. In summary, the content of this specification should not be construed as limiting the application.

Claims (10)

1. A method for collecting audio data, characterized in that, the method is applied to a terminal, and the terminal is configured with a plurality of Universal Serial Bus USB interfaces, and the method comprises: When the USB interface of the terminal is connected to a data collection device with an audio data collection function, the data collection device is determined as a target device for performing audio data collection; In the audio and video conference, detect whether the multiple USB interfaces are connected to a new audio collection device; When detecting access to the audio collection device, determine the first audio quality priority corresponding to the data collection device, and the second audio quality priority corresponding to the audio collection device, determined according to the sampling rate of the data collection device The first audio quality priority is determined according to the sampling rate of the audio collection device, and the second audio quality priority is determined; When the first audio quality priority is lower than the second audio quality priority, switch the target device for executing the audio data collection to the audio collection device. 2. The method according to claim 1, wherein, after switching the target device for performing the audio data collection to the audio collection device, the method further comprises: When it is determined that the audio collection device is removed, the target device for performing the audio data collection is re-switched to the data collection device. 3. method according to claim 1, it is characterized in that, described data acquisition device also has video data acquisition function, and described terminal is connected with streaming media server communication, and described method also comprises: Determining the data acquisition device as a video acquisition device performing video data acquisition; While switching the target device for performing the audio data collection to the audio collection device, the method further includes: Obtaining video data collected by the data collection device, and obtaining audio data collected by the audio collection device; Mixing the audio data and the video data into audio and video data, and sending the audio and video data to the streaming media server. 4. The method according to claim 1, wherein, before detecting whether the plurality of USB interfaces are connected to a new audio collection device, the method also includes: determining a first device ID corresponding to the data collection device, and adding the first device ID to a preset routing list; Determine the first audio quality priority corresponding to the data collection device, and the second audio quality priority corresponding to the audio collection device, determine the first audio quality priority according to the sampling rate of the data collection device, and determine the first audio quality priority according to the audio collection The sampling rate of the device determines the second audio quality priority, including: determining a second device ID corresponding to the audio collection device, and acquiring the first device ID from the routing list; Based on the first device ID and the second device ID, determine a first audio quality priority corresponding to the data collection device and a second audio quality priority corresponding to the audio collection device. 5. The method according to claim 4, characterized in that, after determining the second device ID of the audio collection device, the method further comprises: adding the second device ID to the routing list; determining whether the audio capture device is removed, and determining whether the data capture device is removed; When it is determined that the data collection device is removed, deleting the first device ID from the routing list; When it is determined that the audio collection device is removed, the second device ID is deleted from the routing list. 6. An audio data acquisition device, characterized in that the device is applied to a terminal, and the terminal is configured with a plurality of Universal Serial Bus USB interfaces, and the device comprises: An audio collection determination module, configured to determine the data collection device as the target device for performing audio data collection when the USB interface of the terminal is connected to a data collection device with audio data collection function; The audio device detection module is used to detect whether the multiple USB interfaces are connected to a new audio collection device in an audio and video conference; A priority determination module, configured to determine a first audio quality priority corresponding to the data collection device and a second audio quality priority corresponding to the audio collection device when access to the audio collection device is detected, Determine the first audio quality priority according to the sampling rate of the data collection device, and determine the second audio quality priority according to the sampling rate of the audio collection device; An audio collection switching module, configured to switch the target device for executing the audio data collection to the audio collection device when the first audio quality priority is lower than the second audio quality priority. 7. The device according to claim 6, further comprising: a device ID determining unit, configured to determine a first device ID corresponding to the data collection device; a device ID adding unit, configured to add the first device ID to a preset routing list; The priority determination module specifically includes the following units: The device ID determining unit may be used to determine a second device ID corresponding to the audio collection device; a device ID obtaining unit, configured to obtain a first device ID corresponding to the data collection device from a preset routing list; A priority determining unit, configured to determine a first audio quality priority corresponding to the audio collection device and a second audio quality corresponding to the data collection device based on the first device ID and the second device ID Priority, the first audio quality priority is determined according to the sampling rate of the data collection device, and the second audio quality priority is determined according to the sampling rate of the audio collection device. 8. The device according to claim 6, wherein the data collection device also has a video data collection function, and the terminal is communicatively connected with a streaming media server, and the device also includes: A video data acquisition determining module, configured to determine the data acquisition device as a video acquisition device performing video data acquisition; An audio and video data acquisition module, configured to acquire video data collected by the data collection device, and obtain audio data collected by the audio collection device; The audio and video data sending module is used for mixing the audio data and the video data into audio and video data, and sending the audio and video data to the streaming media server. 9. An electronic device, characterized in that it comprises: one or more processors; and One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, causes the electronic device to perform the audio data collection method according to any one of claims 1 to 5 . 10. A computer-readable storage medium, characterized in that the computer program stored therein enables a processor to execute the audio data collection method according to any one of claims 1 to 5.

Images