CN108449495A - Voice call data processing method and device, storage medium and mobile terminal - Google Patents
Voice call data processing method and device, storage medium and mobile terminal Download PDFInfo
- Publication number
- CN108449495A CN108449495A CN201810200541.7A CN201810200541A CN108449495A CN 108449495 A CN108449495 A CN 108449495A CN 201810200541 A CN201810200541 A CN 201810200541A CN 108449495 A CN108449495 A CN 108449495A
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- voice call
- processing
- howling
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 22
- 238000012545 processing Methods 0.000 claims abstract description 144
- 238000000034 method Methods 0.000 claims abstract description 48
- 238000004891 communication Methods 0.000 claims description 25
- 238000001514 detection method Methods 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 10
- 230000001174 ascending effect Effects 0.000 claims 2
- 230000002265 prevention Effects 0.000 abstract 1
- 230000001629 suppression Effects 0.000 description 18
- 238000010586 diagram Methods 0.000 description 16
- 230000006870 function Effects 0.000 description 13
- 238000004458 analytical method Methods 0.000 description 12
- 230000008901 benefit Effects 0.000 description 10
- 230000002093 peripheral effect Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 8
- 238000010183 spectrum analysis Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 6
- 230000003313 weakening effect Effects 0.000 description 6
- 230000000737 periodic effect Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 238000001914 filtration Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 238000011426 transformation method Methods 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0272—Voice signal separating
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72484—User interfaces specially adapted for cordless or mobile telephones wherein functions are triggered by incoming communication events
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M9/00—Arrangements for interconnection not involving centralised switching
- H04M9/08—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Quality & Reliability (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Environmental & Geological Engineering (AREA)
- Telephone Function (AREA)
Abstract
Description
技术领域technical field
本申请实施例涉及语音通话技术领域,尤其涉及语音通话数据处理方法、装置、存储介质及移动终端。The embodiments of the present application relate to the technical field of voice calls, and in particular, to a voice call data processing method, device, storage medium, and mobile terminal.
背景技术Background technique
目前,随着移动终端的快速普及,手机及平板电脑等移动终端已经成为人们必备的通信工具之一。移动终端用户之间的通信方式越来越丰富,早已不局限于移动通信运营商提供的传统的电话及短信息等服务,在许多场景下,用户更倾向于使用基于互联网的通信方式,如各种社交软件中的语音聊天及视频聊天功能等。At present, with the rapid popularization of mobile terminals, mobile terminals such as mobile phones and tablet computers have become one of the necessary communication tools for people. The communication methods between mobile terminal users are becoming more and more abundant, and they are no longer limited to the traditional telephone and short message services provided by mobile communication operators. In many scenarios, users are more inclined to use Internet-based communication methods, such as various Voice chat and video chat functions in social software.
此外,移动终端中的应用程序(Application,APP)功能日益完善,许多应用程序中都设置了语音通话功能,方便使用同款应用程序的用户之间的沟通和交流。以游戏应用为例,一些需要玩家之间进行互动的游戏已经添加了内置的语音通话功能,用户可以在使用移动终端玩游戏的过程中,与其他玩家进行语音交流。然而,在语音通话过程中,语音通话数据中包含的声音种类较多,如包含各玩家说话的声音、应用程序本身的声音(如游戏的背景音或特效音等)以及移动终端所处环境中的其他声音等,由于声音比较复杂,很容易发生啸叫现象,严重影响用户的使用。In addition, functions of applications (Applications, APPs) in mobile terminals are becoming more and more perfect, and voice call functions are set in many applications to facilitate communication among users using the same application. Taking game applications as an example, some games that require interaction between players have added a built-in voice call function, and users can communicate with other players by voice while using mobile terminals to play games. However, in the voice call process, there are many types of sounds contained in the voice call data, such as the voice of each player, the sound of the application itself (such as the background sound or special effect sound of the game, etc.), and the environment in which the mobile terminal is located. Other sounds, etc., due to the complexity of the sound, howling is prone to occur, which seriously affects the use of users.
发明内容Contents of the invention
本申请实施例提供一种语音通话数据处理方法、装置、存储介质及移动终端,可以在移动终端应用程序中的语音通话功能开启后,选择合适的时机进行防啸叫处理。Embodiments of the present application provide a voice call data processing method, device, storage medium, and mobile terminal, which can select an appropriate time to perform anti-howling processing after the voice call function in the application program of the mobile terminal is enabled.
第一方面,本申请实施例提供了一种语音通话数据处理方法,包括:In the first aspect, the embodiment of the present application provides a voice call data processing method, including:
检测到移动终端的预设应用程序中的语音通话组建立成功;It is detected that the voice talk group in the preset application program of the mobile terminal is successfully established;
获取所述移动终端连接的第一WiFi信息以及所述语音通话组中其他移动终端连接的第二WiFi信息;Obtaining the first WiFi information connected by the mobile terminal and the second WiFi information connected by other mobile terminals in the voice call group;
根据所述第一WiFi信息和所述第二WiFi信息,判断所述语音通话组中是否存在与所述移动终端连接至同一个WiFi热点的目标移动终端,若存在,则对所述移动终端中的语音通话数据进行防啸叫处理。According to the first WiFi information and the second WiFi information, it is judged whether there is a target mobile terminal connected to the same WiFi hotspot as the mobile terminal in the voice call group, and if there is a target mobile terminal in the mobile terminal Anti-howling processing for voice call data.
第二方面,本申请实施例提供了一种语音通话数据处理装置,包括:In the second aspect, the embodiment of the present application provides a voice call data processing device, including:
通话组检测模块,用于检测移动终端的预设应用程序中的语音通话组是否建立成功;The talk group detection module is used to detect whether the voice talk group in the preset application program of the mobile terminal is established successfully;
WiFi信息获取模块,用于在检测到移动终端的预设应用程序中的语音通话组建立成功后,获取所述移动终端连接的第一WiFi信息以及所述语音通话组中其他移动终端连接的第二WiFi信息;The WiFi information acquisition module is used to obtain the first WiFi information connected by the mobile terminal and the first WiFi information connected by other mobile terminals in the voice talk group after detecting that the voice talk group in the preset application program of the mobile terminal is successfully established. 2. WiFi information;
判断模块,用于根据所述第一WiFi信息和所述第二WiFi信息,判断所述语音通话组中是否存在与所述移动终端连接至同一个WiFi热点的目标移动终端;A judging module, configured to judge whether there is a target mobile terminal connected to the same WiFi hotspot as the mobile terminal in the voice call group according to the first WiFi information and the second WiFi information;
防啸叫处理模块,用于在所述判断模块的判断结果为存在时,对所述移动终端中的语音通话数据进行防啸叫处理。The anti-howling processing module is configured to perform anti-howling processing on the voice call data in the mobile terminal when the judging result of the judging module is yes.
第三方面,本申请实施例提供了一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现如本申请实施例所述的语音通话数据处理方法。In a third aspect, the embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, the method for processing voice call data as described in the embodiment of the present application is implemented.
第四方面,本申请实施例提供了一种移动终端,包括存储器,处理器及存储在存储器上并可在处理器运行的计算机程序,所述处理器执行所述计算机程序时实现如本申请实施例所述的语音通话数据处理方法。In the fourth aspect, the embodiment of the present application provides a mobile terminal, including a memory, a processor, and a computer program stored in the memory and executable by the processor, and when the processor executes the computer program, the implementation of the present application is implemented. The voice call data processing method described in the example.
本申请实施例中提供的语音通话数据处理方案,检测到移动终端的预设应用程序中的语音通话组建立成功,获取当前移动终端连接的第一WiFi信息以及语音通话组中其他移动终端连接的第二WiFi信息,根据第一WiFi信息和第二WiFi信息,判断语音通话组中是否存在与移动终端连接至同一个WiFi热点的目标移动终端,若存在,则对移动终端中的语音通话数据进行防啸叫处理。通过采用上述技术方案,可以在移动终端中的预设应用程序的语音通话组建立成功后,检测到语音通话组中存在与当前移动终端距离较近的其他移动终端时,及时对当前的移动终端的语音通话数据进行防啸叫处理,减少啸叫音给用户使用带来的不便。The voice call data processing solution provided in the embodiment of the present application detects that the voice call group in the preset application program of the mobile terminal is successfully established, and obtains the first WiFi information connected to the current mobile terminal and the connection information of other mobile terminals in the voice call group. The second WiFi information, according to the first WiFi information and the second WiFi information, judge whether there is a target mobile terminal connected to the same WiFi hotspot with the mobile terminal in the voice call group, and if there is, the voice call data in the mobile terminal is processed Anti-howling treatment. By adopting the above technical solution, after the voice talk group of the preset application program in the mobile terminal is successfully established, when it is detected that there are other mobile terminals in the voice talk group that are closer to the current mobile terminal, the current mobile terminal Anti-howling processing is performed on the voice call data to reduce the inconvenience caused by howling sound to users.
附图说明Description of drawings
图1为本申请实施例提供的一种语音通话数据处理方法的流程示意图;FIG. 1 is a schematic flow diagram of a voice call data processing method provided in an embodiment of the present application;
图2为本申请实施例提供的一种原始啸叫语音频谱分析示意图;FIG. 2 is a schematic diagram of an original howling voice spectrum analysis provided by an embodiment of the present application;
图3为本申请实施例提供的一种陷波滤波器示意图;FIG. 3 is a schematic diagram of a notch filter provided in an embodiment of the present application;
图4为本申请实施例提供的一种经过陷波滤波器处理后的啸叫语音频谱分析示意图;FIG. 4 is a schematic diagram of howling speech spectrum analysis provided by an embodiment of the present application after being processed by a notch filter;
图5为本申请实施例提供的另一种语音通话数据处理方法的流程示意图;FIG. 5 is a schematic flow diagram of another voice call data processing method provided by the embodiment of the present application;
图6为本申请实施例提供的又一种语音通话数据处理方法的流程示意图;FIG. 6 is a schematic flow diagram of another voice call data processing method provided by the embodiment of the present application;
图7为本申请实施例提供的一种语音通话数据处理装置的结构框图;FIG. 7 is a structural block diagram of a voice call data processing device provided by an embodiment of the present application;
图8为本申请实施例提供的一种移动终端的结构示意图;FIG. 8 is a schematic structural diagram of a mobile terminal provided by an embodiment of the present application;
图9为本申请实施例提供的又一种移动终端的结构示意图。FIG. 9 is a schematic structural diagram of another mobile terminal provided by an embodiment of the present application.
具体实施方式Detailed ways
下面结合附图并通过具体实施方式来进一步说明本申请的技术方案。可以理解的是,此处所描述的具体实施例仅仅用于解释本申请,而非对本申请的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与本申请相关的部分而非全部结构。The technical solution of the present application will be further described below in conjunction with the accompanying drawings and through specific implementation methods. It should be understood that the specific embodiments described here are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, for the convenience of description, only some structures related to the present application are shown in the drawings but not all structures.
在更加详细地讨论示例性实施例之前应当提到的是,一些示例性实施例被描述成作为流程图描绘的处理或方法。虽然流程图将各步骤描述成顺序的处理,但是其中的许多步骤可以被并行地、并发地或者同时实施。此外,各步骤的顺序可以被重新安排。当其操作完成时所述处理可以被终止,但是还可以具有未包括在附图中的附加步骤。所述处理可以对应于方法、函数、规程、子例程、子程序等等。Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe the steps as sequential processing, many of the steps may be performed in parallel, concurrently, or simultaneously. Additionally, the order of steps may be rearranged. The process may be terminated when its operations are complete, but may also have additional steps not included in the figure. The processing may correspond to a method, function, procedure, subroutine, subroutine, or the like.
图1为本申请实施例提供的一种语音通话数据处理方法的流程示意图,该方法可以由语音通话数据处理装置执行,其中该装置可由软件和/或硬件实现,一般可集成在移动终端中。如图1所示,该方法包括:FIG. 1 is a schematic flowchart of a voice call data processing method provided by an embodiment of the present application. The method can be executed by a voice call data processing device, wherein the device can be implemented by software and/or hardware, and can generally be integrated in a mobile terminal. As shown in Figure 1, the method includes:
步骤101、检测到移动终端的预设应用程序中的语音通话组建立成功。Step 101, detecting that the voice talk group in the preset application program of the mobile terminal is successfully established.
示例性的,本申请实施例中的移动终端可包括手机及平板电脑等移动设备。预设应用程序可以是内置语音群组通话功能的应用程序,如网络游戏应用、在线课堂应用、视频会议应用或者需要多人协作的其他应用程序等等。Exemplarily, the mobile terminal in the embodiment of the present application may include mobile devices such as mobile phones and tablet computers. The preset application program may be an application program with a built-in voice group call function, such as an online game application, an online classroom application, a video conferencing application, or other applications requiring multi-person collaboration, and the like.
示例性的,语音通话组中可以包含2个成员,但多数情况下,一般包含3个或3个以上的成员,即可实现3个或3个以上的移动终端之间的语音通话。语音通话组可以由在移动终端上使用预设应用程序的用户发起而建立,在语音通话组建立成功后,语音通话组中包含的所有移动终端之间可进行通信。一般的,当移动终端未处于静音模式,也未处于耳机模式时,可理解为移动终端处于外放模式,语音通话组中每个用户的声音会被自己正在使用的移动终端的麦克风采集,并经过网络传输及处理后通过其他用户的移动终端的扬声器进行播放。以游戏应用为例,如需要组队协战,可开启组队语音功能,假设队内有5个玩家,那么语音通话组建立成功后,这5个人相互之间可以进行通话,任意一个玩家可以同时听到另外4个玩家说的话,仿佛另外4个玩家在自己身边讲话一样,方便边交流边游戏。本申请技术方案的执行主体,即当前的移动终端,可以是语音通话组中的任意一个移动终端,也可以是语音通话组中的某个或某几个指定的移动终端。也就是说,语音通话组中可以由任意一个移动终端执行本申请实施例提供的方法,也可以由指定的一个或多个移动终端执行本申请实施例提供的方法,也可以所有移动终端均执行本申请实施例提供的方法。Exemplarily, the voice call group may include 2 members, but in most cases, it generally includes 3 or more members, so that voice calls between 3 or more mobile terminals can be realized. The voice talk group can be established by a user who uses a preset application program on the mobile terminal. After the voice talk group is established successfully, all mobile terminals included in the voice talk group can communicate with each other. Generally, when the mobile terminal is not in the silent mode or in the earphone mode, it can be understood that the mobile terminal is in the loudspeaker mode, and the voice of each user in the voice call group will be collected by the microphone of the mobile terminal he is using, and After network transmission and processing, it is played through speakers of other users' mobile terminals. Take the game application as an example. If you need to form a team to cooperate in battle, you can enable the team voice function. Suppose there are 5 players in the team. After the voice call group is established successfully, these 5 people can communicate with each other. Any player can Hear what the other 4 players are saying at the same time, as if the other 4 players are talking beside you, which is convenient for communicating and playing games. The executive subject of the technical solution of the present application, that is, the current mobile terminal, may be any mobile terminal in the voice talk group, or one or several designated mobile terminals in the voice talk group. That is to say, any mobile terminal in the voice call group may execute the method provided by the embodiment of the present application, or one or more designated mobile terminals may execute the method provided in the embodiment of the present application, or all mobile terminals may execute the method provided in the embodiment of the present application. The method provided in the embodiment of this application.
一般的,当移动终端处于外放模式时,移动终端麦克风采集到的声音中不仅包含用户自身说话的声音,还可能包含扬声器播放的预设应用程序本身发出的声音,如背景音乐等,还可能包含周围环境的声音,还可能包含扬声器播放的语音通话组内其他人说话的声音,这样,当多个移动终端将各自采集的包含各种声音的数据经过网络发送至同一个移动终端时(例如语音通话组内包含5个移动终端,那么其中4个移动终端就会把各自采集的声音发送至服务器,服务器将4个移动终端的声音数据发送给第5个移动终端),这些声音由会在该移动终端中混合起来播放,可能会产生啸叫现象。Generally, when the mobile terminal is in the speaker mode, the sound collected by the microphone of the mobile terminal includes not only the voice of the user himself, but also the sound of the preset application program played by the speaker, such as background music, etc. Contains the sound of the surrounding environment, and may also contain the voices of other people in the voice call group played by the speaker, so that when multiple mobile terminals collect data containing various sounds and send them to the same mobile terminal through the network (such as There are 5 mobile terminals in the voice talk group, then 4 of them will send the collected sounds to the server, and the server will send the sound data of the 4 mobile terminals to the 5th mobile terminal), these sounds will be in Mixed playback in the mobile terminal may cause howling.
步骤102、获取所述移动终端连接的第一WiFi信息以及所述语音通话组中其他移动终端连接的第二WiFi信息。Step 102. Obtain first WiFi information connected to the mobile terminal and second WiFi information connected to other mobile terminals in the voice call group.
本申请实施例中,为了在合适的时机进行啸叫检测,避免在不恰当的时间里进行无用的啸叫检测而带来额外的功耗,可以先检测语音通话组中是否存在与当前的移动终端距离较近的其他移动终端。在多人语音的应用场景下,发明人发现,当存在两个移动终端之间的距离比较近时,极易发生啸叫。假设语音通话组中的移动终端甲和移动终端乙距离较近,移动终端甲的扬声器会放大并播放接收到的移动终端乙的麦克风采集的声音,而由于两个移动终端比较近,这个声音就会被移动终端乙的麦克风再次采集并发送到移动终端甲,该声音被继续放大并播放,极易形成声音的正反馈放大,从而产生啸叫音。因此,本申请实施例中,可先判断语音通话中是否存在一个其他移动终端与当前的移动终端的距离比较近,若存在,则需要移动终端中的语音通话数据进行防啸叫处理。In the embodiment of the present application, in order to perform howling detection at an appropriate time and avoid extra power consumption caused by useless howling detection at an inappropriate time, it is possible to first detect whether there is a mobile phone in the voice group. Other mobile terminals with a relatively short terminal distance. In the application scenario of multi-person voice, the inventor found that when the distance between two mobile terminals is relatively short, howling is very likely to occur. Assuming that the distance between mobile terminal A and mobile terminal B in the voice call group is relatively close, the speaker of mobile terminal A will amplify and play the received sound collected by the microphone of mobile terminal B, and since the two mobile terminals are relatively close, the sound will be It will be collected again by the microphone of mobile terminal B and sent to mobile terminal A, and the sound will be continuously amplified and played, which can easily form positive feedback amplification of the sound, thus generating howling sound. Therefore, in the embodiment of the present application, it may first be determined whether there is another mobile terminal that is relatively close to the current mobile terminal during the voice call, and if so, the voice call data in the mobile terminal is required to perform anti-howling processing.
具体的,本申请实施例中,可根据两个移动终端是否连接至同一个WiFi热点来确定距离是否比较近。这样设置的好处在于,用户为了节约流量费用,一般采用连接WiFi热点的方式进行语音通话,可以利用这一特点快速准确地判断出是否存在目标移动终端,进而确定是否需要进行防啸叫处理。示例性的,WiFi信息中可包括WiFi热点的属性信息,属性信息例如可以是WiFi热点名称或WiFi热点的媒介访问控制(Media Access Control,MAC)地址等,还可包括WiFi信号强度等。可以理解的是,语音通话组中除了当前移动终端,可能存在多个其他移动终端,其他移动终端获取的WiFi信息统称为第二WiFi信息,对于不同的其他移动终端来说,各自的第二WiFi信息可能是不相同的。示例性的,其他移动终端可以将自身的第二WiFi信息通过预设应用程序对应的服务器转发给当前的移动终端,当然也可以采用其他方式直接或间接发送给当前的移动终端,本申请实施例不做限定。Specifically, in the embodiment of the present application, it may be determined whether the distance between the two mobile terminals is relatively close according to whether the two mobile terminals are connected to the same WiFi hotspot. The advantage of this setting is that in order to save traffic costs, users generally use the way of connecting to WiFi hotspots for voice calls. This feature can be used to quickly and accurately determine whether there is a target mobile terminal, and then determine whether anti-howling processing is required. Exemplarily, the WiFi information may include attribute information of the WiFi hotspot, for example, the attribute information may be the name of the WiFi hotspot or the Media Access Control (MAC) address of the WiFi hotspot, etc., and may also include the WiFi signal strength, etc. It can be understood that, in addition to the current mobile terminal in the voice call group, there may be multiple other mobile terminals, and the WiFi information acquired by other mobile terminals is collectively referred to as the second WiFi information. For different other mobile terminals, the respective second WiFi information Information may be different. Exemplarily, other mobile terminals may forward their own second WiFi information to the current mobile terminal through the server corresponding to the preset application program, and of course other methods may also be used to directly or indirectly send the information to the current mobile terminal. No limit.
步骤103、根据所述第一WiFi信息和所述第二WiFi信息,判断所述语音通话组中是否存在与所述移动终端连接至同一个WiFi热点的目标移动终端,若存在,则对所述移动终端中的语音通话数据进行防啸叫处理。Step 103, according to the first WiFi information and the second WiFi information, determine whether there is a target mobile terminal connected to the same WiFi hotspot as the mobile terminal in the voice call group, and if so, then The voice call data in the mobile terminal is subjected to anti-howling processing.
一般的,WiFi热点的信号有效范围有限,一般在50米左右,若用于衡量是否需要进行防啸叫处理的预设距离值大于WiFi热点的信号有效范围,可根据是否存在一个第二WiFi信息的WiFi热点属性信息与第一WiFi信息的WiFi热点属性信息相同来确定是否需要进行防啸叫处理,若存在任意一个第二WiFi信息的WiFi热点属性信息与第一WiFi信息的WiFi热点属性信息相同,则确定语音通话组中存在目标移动终端,也就是说,当语音通话组中有一个其他移动终端与当前移动终端连接同一个WiFi热点时,可认为该其他移动终端为目标移动终端,这种情况可能发生啸叫,需要进行防啸叫处理。Generally, the signal effective range of WiFi hotspots is limited, generally around 50 meters. If the preset distance value used to measure whether anti-howling processing is required is greater than the effective range of WiFi hotspot signals, it can be determined according to whether there is a second WiFi information The WiFi hotspot attribute information of the second WiFi information is the same as the WiFi hotspot attribute information of the first WiFi information to determine whether anti-howling processing is required. If there is any WiFi hotspot attribute information of the second WiFi information is the same as the WiFi hotspot attribute information of the first WiFi information , it is determined that there is a target mobile terminal in the voice call group, that is to say, when there is another mobile terminal in the voice call group connected to the same WiFi hotspot as the current mobile terminal, the other mobile terminal can be considered as the target mobile terminal. Howling may occur, and anti-howling treatment is required.
语音通话数据可包括上行语音通话数据和/或下行语音通话数据,本申请不做具体限定。其中,上行语音通话数据可以包括移动终端的麦克风采集到的声音数据;下行语音通话数据可以是预设应用程序对应的服务器在接收到语音通话组内其他移动终端的声音数据后,经过混音等处理发送给移动终端的数据,或者直接转发给移动终端的数据,本申请对服务器处理语音通话数据的处理方式不做限定。对于防啸叫处理的具体方式本申请实施例也不做限定,下文中将给出具体的实现方式作为示意性说明。The voice call data may include uplink voice call data and/or downlink voice call data, which is not specifically limited in this application. Wherein, the uplink voice call data may include the sound data collected by the microphone of the mobile terminal; the downlink voice call data may be the sound data collected by the server corresponding to the preset application program after receiving the sound data of other mobile terminals in the voice call group, after mixing, etc. For processing the data sent to the mobile terminal, or directly forwarding the data to the mobile terminal, this application does not limit the processing method of the server to process the voice call data. The embodiment of the present application also does not limit the specific manner of anti-howling processing, and a specific implementation manner will be given below as a schematic illustration.
本申请实施例中提供的语音通话数据处理方法,检测到移动终端的预设应用程序中的语音通话组建立成功,获取当前移动终端连接的第一WiFi信息以及语音通话组中其他移动终端连接的第二WiFi信息,根据第一WiFi信息和第二WiFi信息,判断语音通话组中是否存在与移动终端连接至同一个WiFi热点的目标移动终端,若存在,则对移动终端中的语音通话数据进行防啸叫处理。通过采用上述技术方案,可以在移动终端中的预设应用程序的语音通话组建立成功后,检测到语音通话组中存在与当前移动终端距离较近的其他移动终端时,及时对当前的移动终端的语音通话数据进行防啸叫处理,减少啸叫音给用户使用带来的不便。The voice call data processing method provided in the embodiment of the present application detects that the voice call group in the preset application program of the mobile terminal is successfully established, and obtains the first WiFi information connected to the current mobile terminal and the connection information of other mobile terminals in the voice call group. The second WiFi information, according to the first WiFi information and the second WiFi information, judge whether there is a target mobile terminal connected to the same WiFi hotspot with the mobile terminal in the voice call group, and if there is, the voice call data in the mobile terminal is processed Anti-howling treatment. By adopting the above technical solution, after the voice talk group of the preset application program in the mobile terminal is successfully established, when it is detected that there are other mobile terminals in the voice talk group that are closer to the current mobile terminal, the current mobile terminal Anti-howling processing is performed on the voice call data to reduce the inconvenience caused by howling sound to users.
在一些实施例中,所述获取所述移动终端连接的第一WiFi信息以及所述语音通话组中其他移动终端连接的第二WiFi信息,包括:获取所述移动终端连接的第一WiFi信息;向所述预设应用程序对应的服务器发送WiFi信息获取请求,所述WiFi信息获取请求用于指示所述服务器收集所述语音通话组中其他移动终端的第二WiFi信息,并将所述第二WiFi信息返回至所述移动终端。这样设置的好处在于,语音通话组中的各移动终端已经可以通过预设应用程序对应的服务器实现通信,那么无需额外寻找其他方式来传输第二WiFi信息,节约网络资源。此外,在移动终端成功获取到第一WiFi信息后,再通知其他移动终端进行WiFi信息获取操作,避免因移动终端获取WiFi信息失败(如移动终端并未连接任何WiFi热点),导致其他移动终端执行多余的WiFi信息操作。In some embodiments, the obtaining the first WiFi information connected to the mobile terminal and the second WiFi information connected to other mobile terminals in the voice call group includes: obtaining the first WiFi information connected to the mobile terminal; Sending a WiFi information acquisition request to the server corresponding to the preset application program, the WiFi information acquisition request is used to instruct the server to collect second WiFi information of other mobile terminals in the voice call group, and transfer the second WiFi information is returned to the mobile terminal. The advantage of this setting is that each mobile terminal in the voice call group can already communicate through the server corresponding to the preset application program, so there is no need to find other ways to transmit the second WiFi information, saving network resources. In addition, after the mobile terminal successfully obtains the first WiFi information, it notifies other mobile terminals to perform the WiFi information obtaining operation, so as to avoid other mobile terminals from performing the operation due to the failure of the mobile terminal to obtain the WiFi information (for example, the mobile terminal is not connected to any WiFi hotspot). Redundant WiFi information manipulation.
在一些实施例中,所述WiFi信息中包含WiFi热点的信号强度;所述若存在,则对所述移动终端中的语音通话数据进行防啸叫处理,包括:若存在,则根据第一信号强度和第二信号强度,确定所述移动终端与所述目标移动终端之间的目标距离;当所述目标距离小于第一预设距离阈值时,对所述移动终端中的语音通话数据进行防啸叫处理。示例性的,第一预设距离阈值可以是10米。这样设置的好处在于,能够更加准确的根据移动终端之间的距离来确定是否需要进行防啸叫处理,可以将用于衡量是否需要进行防啸叫处理的预设距离值设置的小一些,小于WiFi热点的信号有效范围。一般的,移动终端距离WiFi热点越远,获取到的WiFi信号越弱,可利用这一规律根据WiFi信息中的信号强度来估算移动终端与WiFi热点的距离,进而确定两个移动终端之间的距离。假设当前移动终端与WiFi热点之间的距离为L1,目标移动终端与WiFi热点之间的距离为L2,由于当前移动终端、目标移动终端以及WiFi热点三者连线可能不在一条直线上,因此,当前移动终端与目标移动终端之间的目标距离的最大值为L1+L2,最小值为L1-L2,为了防止漏判,可以取最小值作为实际距离与第一预设距离阈值进行比较,也即,当L1-L2小于第一预设距离阈值时,对移动终端中的语音通话数据进行防啸叫处理。另外,为了更加准确地确定当前移动终端与目标移动终端的实际距离,WiFi信息中还可包括移动终端搜索到的WiFi热点列表以及列表中每个WiFi热点的信号强度,进而估算当前移动终端、目标移动终端以及所连接的WiFi热点之间的相对方位,便于更加准确地计算当前移动终端与目标移动终端的实际距离。In some embodiments, the WiFi information includes the signal strength of the WiFi hotspot; if it exists, performing anti-howling processing on the voice call data in the mobile terminal, including: if it exists, performing the anti-howling processing according to the first signal Strength and second signal strength, determine the target distance between the mobile terminal and the target mobile terminal; when the target distance is less than the first preset distance threshold, prevent the voice call data in the mobile terminal Howling processing. Exemplarily, the first preset distance threshold may be 10 meters. The advantage of this setting is that it can be more accurately determined whether anti-howling processing is required according to the distance between mobile terminals, and the preset distance value used to measure whether anti-howling processing is required can be set smaller, less than The effective range of the signal of the WiFi hotspot. Generally, the farther the mobile terminal is from the WiFi hotspot, the weaker the obtained WiFi signal is. This rule can be used to estimate the distance between the mobile terminal and the WiFi hotspot according to the signal strength in the WiFi information, and then determine the distance between the two mobile terminals. distance. Assuming that the distance between the current mobile terminal and the WiFi hotspot is L 1 , and the distance between the target mobile terminal and the WiFi hotspot is L 2 , since the connection between the current mobile terminal, the target mobile terminal and the WiFi hotspot may not be on a straight line, Therefore, the maximum value of the target distance between the current mobile terminal and the target mobile terminal is L 1 +L 2 , and the minimum value is L 1 -L 2 . In order to prevent missed judgments, the minimum value can be taken as the actual distance and the first preset The distance threshold is compared, that is, when L 1 -L 2 is smaller than the first preset distance threshold, anti-howling processing is performed on the voice call data in the mobile terminal. In addition, in order to more accurately determine the actual distance between the current mobile terminal and the target mobile terminal, the WiFi information may also include a list of WiFi hotspots searched by the mobile terminal and the signal strength of each WiFi hotspot in the list, thereby estimating the distance between the current mobile terminal and the target mobile terminal. The relative orientation between the mobile terminal and the connected WiFi hotspot facilitates more accurate calculation of the actual distance between the current mobile terminal and the target mobile terminal.
在一些实施例中,所述对所述移动终端中的语音通话数据进行防啸叫处理,包括:根据所述目标距离确定防啸叫处理的目标强度;其中,目标距离越小,对应的目标强度越大;根据所述目标强度对所述移动终端中的语音通话数据进行相应的防啸叫处理。发明人发现,两个移动终端之间的距离越近,通常发生啸叫的情况越严重,所以本申请实施例中可根据当前移动终端与目标移动终端之间的实际距离(即目标距离)来选择对应的防啸叫处理强度(即目标强度),可以做到更有针对性的防啸叫处理,提升防啸叫效果。In some embodiments, the anti-howling processing of the voice call data in the mobile terminal includes: determining the target strength of the anti-howling processing according to the target distance; wherein, the smaller the target distance, the corresponding target The higher the strength is, the corresponding anti-howling processing is performed on the voice call data in the mobile terminal according to the target strength. The inventor found that the closer the distance between two mobile terminals, the more serious the howling usually occurs, so in the embodiment of the present application, the actual distance between the current mobile terminal and the target mobile terminal (i.e., the target distance) can be determined. Selecting the corresponding anti-howling processing strength (ie target strength) can achieve more targeted anti-howling processing and improve the anti-howling effect.
可以理解的是,目标移动终端可能存在不止一个,当存在两个以上的目标移动终端时,对应的目标距离也存在两个以上,可以以数值最小的目标距离为标准,确定防啸叫处理的目标强度。It can be understood that there may be more than one target mobile terminal. When there are more than two target mobile terminals, there are more than two corresponding target distances. target strength.
在一些实施例中,所述根据所述目标距离确定防啸叫处理的目标强度,包括:根据所述目标距离,确定对所述移动终端中的上行语音通话数据和/或下行语音通话数据进行防啸叫处理;其中,当所述目标距离大于第二预设距离值时,确定对所述移动终端中的上行语音通话数据进行防啸叫处理;当所述目标距离大于第三预设距离值且小于或等于所述第二预设距离值时,确定对所述移动终端中的下行语音通话数据进行防啸叫处理;当所述目标距离小于或等于所述第三预设距离值时,确定对所述移动终端中的上行语音通话数据和下行语音通话数据进行防啸叫处理。In some embodiments, the determining the target strength of the anti-howling processing according to the target distance includes: determining to perform the processing on the uplink voice call data and/or downlink voice call data in the mobile terminal according to the target distance Anti-howling processing; wherein, when the target distance is greater than a second preset distance value, it is determined to perform anti-howling processing on the uplink voice call data in the mobile terminal; when the target distance is greater than a third preset distance value and is less than or equal to the second preset distance value, determine to perform anti-howling processing on the downlink voice call data in the mobile terminal; when the target distance is less than or equal to the third preset distance value and determine to perform anti-howling processing on the uplink voice call data and downlink voice call data in the mobile terminal.
下行语音通话数据一般数据量较大,啸叫抑制处理难度稍大,耗时稍长,因此,本申请实施例中,在目标距离小于第一预设距离值但大于第二预设距离时,说明若产生啸叫,啸叫程度并不严重,可以仅针对上行语音通话数据进行防啸叫处理。当目标距离小于或等于第二预设距离值,但大于第三距离值时,说明若产生啸叫,啸叫程度会比较严重,可以针对下行语音通话数据进行防啸叫处理,以得到较佳的防啸叫效果。当目标距离很小,小于或等于第三预设距离值时,说明若产生啸叫,啸叫程度会非常严重,可以同时针对下行语音通话数据和下行语音通话数据进行防啸叫处理,以得到最佳的防啸叫效果。本申请对第一预设距离、第二预设距离及第三预设距离的数值依次减小,但对具体数值不做限定,示例性的,第一预设距离为10米,第二预设距离为5米,第三预设距离为2米。Downlink voice call data generally has a large amount of data, and howling suppression processing is slightly more difficult and time-consuming. Therefore, in the embodiment of the present application, when the target distance is less than the first preset distance value but greater than the second preset distance, It shows that if howling occurs, the degree of howling is not serious, and anti-howling processing can be performed only for uplink voice call data. When the target distance is less than or equal to the second preset distance value, but greater than the third distance value, it means that if howling occurs, the degree of howling will be more serious, and anti-howling processing can be performed on the downlink voice call data to obtain better anti-howling effect. When the target distance is very small, less than or equal to the third preset distance value, it means that if howling occurs, the degree of howling will be very serious, and anti-howling processing can be performed on the downlink voice call data and downlink voice call data at the same time to obtain The best anti-howling effect. In this application, the values of the first preset distance, the second preset distance and the third preset distance are successively reduced, but the specific values are not limited. For example, the first preset distance is 10 meters, and the second preset distance is 10 meters. Let the distance be 5 meters, and the third preset distance is 2 meters.
示例性的,在对下行语音通话数据进行防啸叫处理时,可先对下行语音通话数据进行啸叫检测,在判断出存在啸叫音时,针对啸叫点进行衰减处理,从而达到防啸叫效果。Exemplarily, when anti-howling processing is performed on the downlink voice call data, howling detection may be performed on the downlink voice call data first, and when it is judged that there is a howling sound, attenuation processing is performed on the howling point, so as to achieve anti-howling called effect.
在一些实施例中,可采用如下方式判断下行语音通话数据中是否存在啸叫音:In some embodiments, the following method can be used to determine whether there is a howling sound in the downlink voice call data:
第一种,对所述下行语音通话数据进行分块处理;对于每个数据块,采用预设分析方式确定当前数据块中存在的疑似啸叫点;当存在呈现周期性特征的多个疑似啸叫点群,且疑似啸叫点对应的能量值依照所属数据块的顺序呈上升趋势时,确定所述下行语音通话数据中存在啸叫音;其中,所述疑似啸叫点群为连续相邻数据块中的频率差异处于预设范围内的疑似啸叫点,所述连续相邻数据块的数量达到预设连续阈值。The first method is to divide the downlink voice call data into blocks; for each data block, use a preset analysis method to determine the suspected howling points existing in the current data block; when there are multiple suspected howling points showing periodic characteristics, When a point group is called, and the energy value corresponding to the suspected howling point shows an upward trend according to the order of the data blocks it belongs to, it is determined that there is a howling sound in the downlink voice call data; wherein, the suspected howling point group is consecutively adjacent The frequency difference in the data block is a suspected howling point within a preset range, and the number of consecutive adjacent data blocks reaches a preset continuous threshold.
第二种,对所述下行语音通话数据进行分块处理,得到M个数据块;采用预设分析方式依次分析当前数据块中是否存在疑似啸叫点,将首次出现疑似啸叫点的数据块确定为起始数据块;从所述起始数据块开始,依次以n个数据块为待分析的数据段,采用所述预设分析方式分析出当前数据段中包含的疑似啸叫点,当N个数据段中包含的疑似啸叫点之间的频率差异处于预设范围内时,确定所述下行语音通话数据中存在啸叫音;其中,n=2,3,…,N;N小于或等于M,大于或等于2;每个数据段的起始点均与所述起始数据块的起始点相同,所述起始数据块为第一个数据段。In the second method, the downlink voice call data is divided into blocks to obtain M data blocks; the preset analysis method is used to sequentially analyze whether there is a suspected howling point in the current data block, and the data block of the suspected howling point will appear for the first time Determined as the initial data block; starting from the initial data block, taking n data blocks as data segments to be analyzed in turn, using the preset analysis method to analyze the suspected howling points contained in the current data segment, when When the frequency difference between the suspected howling points contained in the N data segments is within the preset range, it is determined that there is a howling sound in the downlink voice call data; wherein, n=2, 3, ..., N; N is less than Or equal to M, greater than or equal to 2; the starting point of each data segment is the same as the starting point of the starting data block, and the starting data block is the first data segment.
当然,本申请实施例中还可采用其他方式来判断下行语音通话数据中是否存在啸叫音,本申请不做限定。下面以上述两种方式为例进行详细的说明。Of course, in the embodiment of the present application, other methods may also be used to determine whether there is howling sound in the downlink voice call data, which is not limited in the present application. The following two methods are taken as examples for detailed description.
对于第一种方式,对下行语音通话数据进行分块处理可以是按照预设单位长度进行分块处理,预设单位长度例如可以是40毫秒。假设预设时间长度为1.2秒,预设单位长度为40毫秒,那么可以分为30个数据块。For the first manner, the block processing of the downlink voice call data may be block processing according to a preset unit length, and the preset unit length may be, for example, 40 milliseconds. Assuming that the preset time length is 1.2 seconds and the preset unit length is 40 milliseconds, it can be divided into 30 data blocks.
本申请实施例对预设分析方式不作具体限定。例如,所述预设分析方式可包括:在频域上获取高频区域中能量值高于预设能量阈值的待判定频点,计算所述待判定频点周围预设数量的频点的能量差异值,当所述能量差异值大于预设差异阈值时,确定所述待判定频点为疑似啸叫点;所述高频区域为频率高于预设频率阈值的频率范围。The embodiment of the present application does not specifically limit the preset analysis method. For example, the preset analysis method may include: acquiring frequency points to be determined in the high-frequency region whose energy value is higher than a preset energy threshold in the frequency domain, and calculating the energy of a preset number of frequency points around the frequency points to be determined difference value, when the energy difference value is greater than a preset difference threshold, it is determined that the frequency point to be determined is a suspected howling point; the high-frequency region is a frequency range whose frequency is higher than a preset frequency threshold.
具体的,对于当前数据块,可先将其从时域变换到频域,便于进行频谱分析。变换方式本申请实施例不做限定,可以采用傅里叶变换方式,如离散傅氏变换的快速算法(FastFourier Transformation,FFT)。以40ms为例,40ms的音频数据(16bit,16k采样率)大小为40*16*16/2=1280字节,适合于使用1024做FFT变换进行频谱分析,经过FFT处理后的频率分析中的频率范围为0~16K/2,步长为(16K/2)/1024,步长约为8Hz。Specifically, for the current data block, it may first be transformed from the time domain to the frequency domain, so as to facilitate spectrum analysis. The transformation method is not limited in this embodiment of the present application, and a Fourier transformation method, such as a fast algorithm of discrete Fourier transform (FastFourier Transformation, FFT), may be used. Taking 40ms as an example, the size of 40ms audio data (16bit, 16k sampling rate) is 40*16*16/2=1280 bytes, which is suitable for using 1024 for FFT transformation for spectrum analysis, and the frequency analysis after FFT processing The frequency range is 0~16K/2, the step size is (16K/2)/1024, and the step size is about 8Hz.
本申请实施例中,可以预设频率阈值作为分界值来划分高频区域和其他区域。预设频率阈值可根据实际情况进行设置,如可根据人声频率和容易出现啸叫声的频率特点进行设置,例如可以是1KHz,1.5KHz,或2KHz等等。例如预设频率阈值为2KHz,即大于2KHz的部分为高频区域。一般啸叫声的频率会出现在高频区域,且声音较大(即能量值较高),本申请实施例能够根据能量值分布特点快速确定一个数据块中的疑似啸叫点。In the embodiment of the present application, a preset frequency threshold may be used as a boundary value to divide the high-frequency region and other regions. The preset frequency threshold can be set according to the actual situation, for example, it can be set according to the human voice frequency and the frequency characteristics that are prone to howling sound, for example, it can be 1KHz, 1.5KHz, or 2KHz and so on. For example, the preset frequency threshold is 2KHz, that is, the part greater than 2KHz is a high-frequency region. Generally, the frequency of the howling sound will appear in the high-frequency region, and the sound is relatively loud (that is, the energy value is high). The embodiment of the present application can quickly determine the suspected howling point in a data block according to the distribution characteristics of the energy value.
示例性的,获取数据块中每个频率点(简称频点)对应的能量值,然后从高频区域中找到能量值高于预设能量阈值的待判定频点,计算待判定频点周围预设数量的频点的能量差异值。预设能量阈值和预设数量可根据实际需求设置,例如预设能量阈值可以是-10dB,预设数量可以是8个(待判定频点前面4个和后面4个)。以上文步长约为8Hz为例,假设待判定频点的频率值为3362Hz,那么其周围预设数量的频点的频率值约为3330Hz、3338Hz、3346Hz、3354Hz、3370Hz、3378Hz、3386Hz和3394Hz。能量差异值用于衡量待判定频点与周围预设数量的频点之间相差程度,具体可以是最大能量值和最小能量值的差值,还可以是能量方差值或能量均方差值等等,本申请不做限定。预设差异阈值与能量差异值相对应,例如,能量差异值为能量方差值时,预设差异阈值为预设方差阈值。当能量差异值大于预设差异阈值时,说明待判定频点比较突出,非常有可能是啸叫点,因此,确定待判定频点为疑似啸叫点。这样设置能够快速准确地识别出疑似啸叫点,为提高啸叫检测效率打下基础。Exemplarily, the energy value corresponding to each frequency point (referred to as frequency point) in the data block is obtained, and then the frequency point to be determined whose energy value is higher than the preset energy threshold is found from the high-frequency area, and the predicted frequency point around the frequency point to be determined is calculated. Set the energy difference value of the number of frequency points. The preset energy threshold and the preset number can be set according to actual needs, for example, the preset energy threshold can be -10dB, and the preset number can be 8 (4 before and 4 after the frequency point to be determined). Taking the above step size of about 8Hz as an example, assuming that the frequency value of the frequency point to be determined is 3362Hz, then the frequency values of the preset number of frequency points around it are about 3330Hz, 3338Hz, 3346Hz, 3354Hz, 3370Hz, 3378Hz, 3386Hz and 3394Hz . The energy difference value is used to measure the degree of difference between the frequency point to be determined and the surrounding preset number of frequency points. Specifically, it can be the difference between the maximum energy value and the minimum energy value, or the energy variance value or the energy mean square error value. Etc., this application does not limit. The preset difference threshold corresponds to the energy difference value, for example, when the energy difference value is the energy variance value, the preset difference threshold is the preset variance threshold. When the energy difference value is greater than the preset difference threshold, it indicates that the frequency point to be determined is relatively prominent, and it is very likely to be a howling point. Therefore, the frequency point to be determined is determined to be a suspected howling point. This setting can quickly and accurately identify suspected howling points, laying a foundation for improving the efficiency of howling detection.
示例性的,一个数据块中可能存在多个待判定频点,本申请可从对应能量最高的待判定频点开始进行疑似啸叫点的判定。Exemplarily, there may be multiple frequency points to be determined in one data block, and the application may determine the suspected howling point starting from the frequency point to be determined with the highest corresponding energy.
此外,所述预设分析方式还可包括:在频域上获取高频区域中能量值最大的第一频点和低频区域中能量值最大的第二频点,当所述第一频点满足预设疑似啸叫条件时,确定所述第一频点为当前数据块中的疑似啸叫点,所述预设疑似啸叫条件包括所述第一频点的能量值大于预设能量阈值,且所述第一频点与所述第二频点的能量差值大于预设差值阈值。In addition, the preset analysis method may also include: acquiring the first frequency point with the largest energy value in the high-frequency region and the second frequency point with the largest energy value in the low-frequency region in the frequency domain, when the first frequency point satisfies When the suspected howling condition is preset, it is determined that the first frequency point is a suspected howling point in the current data block, and the preset suspected howling condition includes that the energy value of the first frequency point is greater than a preset energy threshold, And the energy difference between the first frequency point and the second frequency point is greater than a preset difference threshold.
具体的,对于当前数据块,可先将其从时域变换到频域,便于进行频谱分析。同样也可以预设划分频率作为分界值来划分高频区域和低频区域。预设划分频率可根据实际情况进行设置,如可根据人声频率和容易出现啸叫声的频率特点进行设置,例如可以是1KHz,1.5KHz,或2KHz等等。例如预设划分频率为2KHz,即大于2KHz的部分为高频区域,小于或等于2KHz的部分为低频区域。Specifically, for the current data block, it may first be transformed from the time domain to the frequency domain, so as to facilitate spectrum analysis. Similarly, the division frequency can also be preset as a boundary value to divide the high-frequency region and the low-frequency region. The preset division frequency can be set according to the actual situation, for example, it can be set according to the frequency characteristics of the human voice and the frequency that is prone to howling, for example, it can be 1KHz, 1.5KHz, or 2KHz and so on. For example, the preset division frequency is 2KHz, that is, the part greater than 2KHz is a high-frequency region, and the part less than or equal to 2KHz is a low-frequency region.
示例性的,获取数据块中每个频率点对应的能量值,然后从高频区域中找到能量值最大的第一频点,从低频区域找到能量值最大的第二频点,若第一频点的能量值大于预设能量阈值(如-30dB),且第一频点的能量值与第二频点的能量值的差值大于预设差值阈值(如60)时,可认为第一频点为当前数据块中的疑似啸叫点。这样设置能够快速准确地识别出疑似啸叫点,为提高啸叫检测效率打下基础。Exemplarily, the energy value corresponding to each frequency point in the data block is obtained, and then the first frequency point with the largest energy value is found from the high-frequency region, and the second frequency point with the largest energy value is found from the low-frequency region. When the energy value of the point is greater than the preset energy threshold (such as -30dB), and the difference between the energy value of the first frequency point and the energy value of the second frequency point is greater than the preset difference threshold (such as 60), it can be considered as the first The frequency point is the suspected howling point in the current data block. This setting can quickly and accurately identify suspected howling points, laying a foundation for improving the efficiency of howling detection.
示例性的,对于每个数据块,分别采用如上预设分析方式判断是否存在疑似啸叫点,若存在,则记录下疑似啸叫点,并进一步判断当前的下行语音通话数据中是否包含啸叫音。Exemplarily, for each data block, the above preset analysis method is used to judge whether there is a suspected howling point, and if there is, record the suspected howling point, and further judge whether the current downlink voice call data contains howling sound.
可以理解的是,若某个数据块中存在疑似啸叫音,并不能认为整段下行语音通话音频中包含啸叫音,还可能是由于某些特殊声音被误识别为啸叫音,例如物体摩擦时产生的刺耳的声音,一般频率较高且声音较大,很可能被识别为疑似啸叫音,但这种声音一般比较短促,持续时间较短,不属于啸叫音,因此,需要增加进一步的判定。It is understandable that if there is a suspected howling sound in a certain data block, it cannot be considered that the entire downlink voice call audio contains the howling sound, and it may also be because some special sounds are misidentified as howling sounds, such as objects The ear-piercing sound produced during friction is generally high in frequency and loud, and may be identified as a suspected howling sound, but this sound is generally short and short in duration, and does not belong to howling sound, so it needs to be added further judgment.
本申请实施例中,对各数据块中存在的疑似啸叫音的分布特点进行分析。当连续多个相邻数据块中存在频率差异较小的疑似啸叫点时,可将这几个疑似啸叫点称为疑似啸叫点群。即,疑似啸叫点群为连续相邻数据块中的频率差异处于预设范围内的疑似啸叫点,所述连续相邻数据块的数量达到预设连续阈值。其中,预设连续阈值可根据实际情况确定,例如3个;频率差异对应的预设范围也可根据实际情况确定,例如40Hz。发明人发现,啸叫声一般在短时间内表现出持续性特征,并周期性出现,另外声音逐渐变大。因此,本申请实施例中,将多个(可理解为大于或等于2个)疑似啸叫点群呈现周期性特征,以及疑似啸叫点对应的能量值依照所属数据块的顺序呈上升趋势作为判定条件,来识别当前的下行语音通话数据中是否存在啸叫音,若满足上述条件,则确定存在啸叫音,这样能够快速准确地识别出啸叫音。In the embodiment of the present application, the distribution characteristics of the suspected howling sounds existing in each data block are analyzed. When there are suspected howling points with small frequency differences in consecutive multiple adjacent data blocks, these suspected howling points may be called a suspected howling point group. That is, the suspected howling point group is a suspected howling point whose frequency difference in consecutive adjacent data blocks is within a preset range, and the number of the consecutive adjacent data blocks reaches a preset continuous threshold. Wherein, the preset continuous thresholds may be determined according to actual conditions, for example, three; the preset range corresponding to the frequency difference may also be determined according to actual conditions, such as 40 Hz. The inventors found that the howling sound generally exhibits a continuous feature in a short period of time and occurs periodically, and the sound gradually becomes louder. Therefore, in the embodiment of the present application, multiple (can be understood as greater than or equal to 2) suspected howling point groups exhibit periodic characteristics, and the energy values corresponding to the suspected howling points show an upward trend in the order of the data blocks they belong to as The judgment condition is used to identify whether there is a howling sound in the current downlink voice call data. If the above conditions are met, it is determined that there is a howling sound, so that the howling sound can be identified quickly and accurately.
示例性的,假设下行语音通话数据被分为30个数据块。例如,若第1、2、3、7、8、9、13、14、15、19、20、21、25、26和27这15个数据块中都检测到了频率在(A-40,A+40)区间内的疑似啸叫点,每3个数据块对应的疑似啸叫点成为一个疑似啸叫点群,5个疑似啸叫点群呈周期性特征,且疑似啸叫点对应的能量值依次增大,因此,确定下行语音通话数据中包含啸叫音。又如,若仅第1、2和3这3个数据块中检测到了频率在(B-40,B+40)区间内的疑似啸叫点,这3个数据块对应的疑似啸叫点成为一个疑似啸叫点群,但仅存在这一个,并未呈现周期性特征,因此,可确定下行语音通话数据中不包含啸叫音。Exemplarily, it is assumed that the downlink voice call data is divided into 30 data blocks. For example, if the 15 data blocks 1, 2, 3, 7, 8, 9, 13, 14, 15, 19, 20, 21, 25, 26 and 27 all detect frequencies in (A-40, A For the suspected howling points in the interval of +40), the suspected howling points corresponding to every 3 data blocks become a suspected howling point group, and the 5 suspected howling point groups show periodic characteristics, and the energy corresponding to the suspected howling points The values increase sequentially, therefore, it is determined that the downlink voice call data contains howling tones. As another example, if only the suspected howling points with frequencies in the interval (B-40, B+40) are detected in the 1st, 2nd and 3rd data blocks, the suspected howling points corresponding to these 3 data blocks become A suspected howling point group exists, but only this one exists, and does not show periodic characteristics. Therefore, it can be determined that the downlink voice call data does not contain howling tones.
对于第二种方式,分块处理方式以及预设分析方式可参考第一种方式中的相关内容,本申请实施例不再赘述。For the second method, the block processing method and the preset analysis method can refer to the relevant content in the first method, which will not be repeated in the embodiment of the present application.
具体的,采用上述预设分析方式分析第一个数据块中是否存在疑似啸叫点,若存在,则疑似啸叫点首次出现,将第一个数据块确定为起始数据块;若不存在,则将当前数据块的下一个数据块作为新的当前数据块,并采用上述预设分析方式分析新的当前数据块中是否存在疑似啸叫点。依次类推,直到首次出现疑似啸叫点的数据块确定为起始数据块,若M个数据块中均不存在疑似啸叫点,则可认为当前的下行语音通话数据中不包含啸叫音。Specifically, the above-mentioned preset analysis method is used to analyze whether there is a suspected howling point in the first data block. If it exists, the suspected howling point appears for the first time, and the first data block is determined as the initial data block; if it does not exist , the next data block of the current data block is used as a new current data block, and the above-mentioned preset analysis method is used to analyze whether there is a suspected howling point in the new current data block. By analogy, until the data block where the suspected howling point appears for the first time is determined as the initial data block, if there is no suspected howling point in the M data blocks, it can be considered that the current downlink voice call data does not contain howling sound.
以上述分块方式为例,M=30,2≤N≤30。在进行频谱分析时,待分析的数据长度对分析结果会产生影响,因为数据点较少时,精度可能不是太准确,所以,使用长度大一些的数据再次进行分析,相当于有一个修正的处理,能够更加准确地确定是否为啸叫。本申请对N的具体取值不做限定,假设N=4,一个数据块的长度为40ms,那么起始数据块的时间范围可记为0至40ms,由于起始数据块已经分析完毕,并作为第一数据段,所以从n=2开始,为第二个数据段,第二个数据段的时间范围可记为0至80ms,依次类推,第三个数据段的时间范围可记为0至120ms,第三个数据段的时间范围可记为0至160ms。Taking the above block method as an example, M=30, 2≤N≤30. When performing spectrum analysis, the length of the data to be analyzed will have an impact on the analysis results, because when there are fewer data points, the accuracy may not be too accurate. Therefore, using data with a larger length to analyze again is equivalent to a modified process. , can more accurately determine whether it is howling. The application does not limit the specific value of N. Suppose N=4, and the length of a data block is 40ms, so the time range of the initial data block can be recorded as 0 to 40ms. Since the initial data block has been analyzed, and As the first data segment, starting from n=2, it is the second data segment, the time range of the second data segment can be recorded as 0 to 80ms, and so on, the time range of the third data segment can be recorded as 0 to 120ms, the time range of the third data segment can be recorded as 0 to 160ms.
示例性的,预设范围可以根据实际情况设置,例如可以是40Hz(如上述举例,可认为相当于5个步长)。假设4个数据段分析出来的疑似啸叫点的频率分别为A、B、C和D,而A、B、C和D相互之间的差异均在40Hz以内,那么可确定下行语音通话数据中存在啸叫音。Exemplarily, the preset range can be set according to actual conditions, for example, it can be 40 Hz (as the above example, it can be considered as equivalent to 5 steps). Assuming that the frequencies of the suspected howling points analyzed by the four data segments are A, B, C and D respectively, and the differences between A, B, C and D are all within 40Hz, then it can be determined that in the downlink voice call data There is howling sound.
可选的,若当前数据段中包含的疑似啸叫点与前面的数据段中包含的疑似啸叫点之间的频率差异未处于所述预设范围内,则从当前数据段的下一个数据块开始获取所述预设时间长度的下行语音通话数据,并重复执行对下行语音通话数据进行分块处理的相关操作。这样设置的好处在于,当任意两个数据段中包含的疑似啸叫点的频率差距较大时,可说明前面的疑似啸叫点可能不是真正的啸叫点,需要继续检测,而不需要对后面的数据段进行疑似啸叫点检测,节省功耗,提高啸叫音检测效率及准确度。例如,当C与A或与B之间的差异超出40Hz时,则从120ms开始,重新获取移动终端中的预设时间长度的下行语音通话数据,并对所述下行语音通话数据进行分块处理,得到M个数据块,再确定新的起始数据块,并继续采用上述方式确定下行语音通话数据中是否存在啸叫音。Optionally, if the frequency difference between the suspected howling points contained in the current data segment and the suspected howling points contained in the previous data segment is not within the preset range, then the next data from the current data segment The block starts to acquire the downlink voice call data of the preset time length, and repeatedly executes related operations of dividing the downlink voice call data into blocks. The advantage of this setting is that when the frequency difference between the suspected howling points contained in any two data segments is large, it can indicate that the previous suspected howling points may not be real howling points, and it is necessary to continue detection instead of The subsequent data segment is used for detection of suspected howling points, which saves power consumption and improves the efficiency and accuracy of howling sound detection. For example, when the difference between C and A or B exceeds 40 Hz, start from 120 ms to reacquire the downlink voice call data of the preset time length in the mobile terminal, and perform block processing on the downlink voice call data , to obtain M data blocks, and then determine a new initial data block, and continue to use the above method to determine whether there is a howling sound in the downlink voice call data.
在确定所述下行语音通话数据中存在啸叫音之后,还包括:将所述疑似啸叫点确定为啸叫点;根据所述啸叫点对所述下行语音通话数据进行啸叫抑制处理。在确定下行语音通话数据中存在啸叫音后,说明之前识别出来的满足啸叫音判定条件的疑似啸叫点确实为啸叫点,那么需要根据啸叫点对下行语音进行啸叫抑制处理,防止啸叫音从扬声器或听筒播放出去,影响用户的使用。进一步的,在进行啸叫抑制处理后,通过扬声器或听筒播放经过啸叫抑制处理后的下行语音通话数据。After determining that howling sounds exist in the downlink voice call data, the method further includes: determining the suspected howling point as a howling point; performing howling suppression processing on the downlink voice call data according to the howling point. After it is determined that there is howling sound in the downlink voice call data, it means that the previously identified suspected howling point that satisfies the howling sound determination condition is indeed a howling point, then it is necessary to perform howling suppression processing on the downlink voice according to the howling point, Prevent the howling sound from being played out from the speaker or earpiece, affecting the user's use. Further, after the howling suppression processing is performed, the downlink voice call data after the howling suppression processing is played through the loudspeaker or the earpiece.
在一些实施例中,所述根据所述啸叫点对所述下行语音通话数据进行啸叫抑制处理,包括:选取预设数量的对应能量值较高的啸叫点的频率,作为目标频率,对所述下行语音通话数据中与所述目标频率对应的音频信号进行衰减处理。预设数量可自由设置,如1个,3个,甚至更多,还可以根据啸叫点的数量来动态确定。可将啸叫点按照能量值从高到低的顺序进行排序,选取排在前面预设数量的啸叫点,将选取出来的啸叫点的频率确定为目标频率。能量值越高,啸叫声的声音越大,对用户的影响程度越高,这样设置的好处在于,能够更有针对性地对能量值较高的频率进行啸叫抑制,提高啸叫抑制效率,保证语音通话的时效性。In some embodiments, performing howling suppression processing on the downlink voice call data according to the howling point includes: selecting a preset number of frequencies corresponding to howling points with higher energy values as target frequencies, Perform attenuation processing on the audio signal corresponding to the target frequency in the downlink voice call data. The preset number can be set freely, such as 1, 3, or even more, and can also be dynamically determined according to the number of howling points. The howling points can be sorted according to the order of energy value from high to low, select the first preset number of howling points, and determine the frequency of the selected howling points as the target frequency. The higher the energy value, the louder the howling sound and the higher the impact on the user. The advantage of this setting is that it can more specifically suppress howling at frequencies with higher energy values and improve the howling suppression efficiency. , to ensure the timeliness of voice calls.
在一些实施例中,所述根据所述啸叫点对所述下行语音通话数据进行啸叫抑制处理,也可包括:对所述下行语音通话数据中与所有啸叫点的频率对应的音频信号进行衰减处理。这样设置的好处在于,能够全面地对所有啸叫点进行啸叫抑制,阻止啸叫音的播放。In some embodiments, performing howling suppression processing on the downlink voice call data according to the howling points may also include: performing audio signals corresponding to frequencies of all howling points in the downlink voice call data Perform attenuation. The advantage of this setting is that the howling suppression can be performed on all howling points in an all-round way to prevent the howling sound from playing.
示例性的,可采用陷波滤波器来对需要进行抑制的啸叫点的频率(即目标频率)所对应的音频信号进行衰减处理。陷波滤波器能够在某一个频率点迅速衰减输入信号,以达到阻碍该频率信号通过的滤波效果。本申请对陷波滤波器的类型以及具体参数值不做限定。一般的,将目标频率作为陷波滤波器的中心频率,陷波滤波器的处理带宽及增益等参数可根据实际需求进行设置。Exemplarily, a notch filter may be used to attenuate the audio signal corresponding to the frequency of the howling point that needs to be suppressed (ie, the target frequency). The notch filter can quickly attenuate the input signal at a certain frequency point to achieve the filtering effect of blocking the passage of the frequency signal. The application does not limit the type and specific parameter values of the notch filter. Generally, the target frequency is used as the center frequency of the notch filter, and parameters such as processing bandwidth and gain of the notch filter can be set according to actual requirements.
示例性的,在对上行语音通话数据进行防啸叫处理时,可获取移动终端采集的声音数据;对声音数据进行人声和背景音分离操作;对分离出的背景音进行削弱处理;将经过削弱处理后的背景音和分离出的人声进行混音处理后,作为处理后的上行语音通话数据发送至所述预设应用程序对应的服务器。这样设置的好处在于,能够有效削弱由于背景音引起的啸叫。示例性的,当移动终端中存在麦克风阵列(麦克风数量大于或等于2)时,可判断出声源位置,根据声源位置筛选出距离移动终端较远(如大于1米)的声音作为背景音;或者,可预先获取移动终端用户的声纹信息,根据声纹信息从声音数据中提取出用户说话的声音作为人声,剩余的声音作为背景音。示例性的,对分离出的背景音进行削弱处理可以是通过调整增益的方式减小背景音的声音,也可以滤除背景音。背景音经过削弱处理后,音量减小,破坏声音越来越大的条件,进而有效削弱由于背景音引起的啸叫。Exemplarily, when performing anti-howling processing on the uplink voice call data, the sound data collected by the mobile terminal can be obtained; the sound data can be separated from the human voice and the background sound; the separated background sound can be weakened; After the weakened background sound and the separated human voice are mixed, the processed uplink voice call data is sent to the server corresponding to the preset application program. The advantage of this setting is that it can effectively weaken the howling caused by the background sound. Exemplarily, when there is a microphone array (the number of microphones is greater than or equal to 2) in the mobile terminal, the position of the sound source can be determined, and the sound that is far away from the mobile terminal (such as greater than 1 meter) can be filtered out as the background sound according to the position of the sound source Or, the voiceprint information of the mobile terminal user can be obtained in advance, and the voice of the user's speech can be extracted from the voice data according to the voiceprint information as the human voice, and the remaining voice can be used as the background sound. Exemplarily, weakening the separated background sound may be reducing the sound of the background sound by adjusting a gain, or filtering the background sound. After the background sound is weakened, the volume is reduced, which destroys the condition that the sound is getting louder, and then effectively weakens the howling caused by the background sound.
此外,针对上行语音通话数据的防啸叫处理,还可以根据下行语音通话数据的啸叫检测结果来进行。若下行语音通话数据中存在啸叫音,通过移动终端的扬声器或听筒播放下行语音通话数据时,就会播放啸叫音,用户能够听到,此外,移动终端的麦克风也能够采集到啸叫音,也即移动终端的上行语音通话数据中也会包含啸叫音。本申请实施例中,对上行语音通话数据进行防啸叫处理,避免啸叫音再次被传送至网络,被其他移动终端接收,从而可破坏啸叫音越来越大的条件,进而达到防啸叫的目的。具体的,可采用预设陷波滤波器对移动终端中的上行语音通话数据进行防啸叫处理,其中,预设陷波滤波器的中心频率为下行语音通话数据中的啸叫点对应的频率。In addition, the anti-howling processing for the uplink voice call data can also be performed according to the howling detection result of the downlink voice call data. If there is a howling sound in the downlink voice call data, when the downlink voice call data is played through the speaker or earpiece of the mobile terminal, the howling sound will be played, and the user can hear it. In addition, the microphone of the mobile terminal can also collect the howling sound , that is, the uplink voice call data of the mobile terminal also includes howling tones. In the embodiment of the present application, anti-howling processing is performed on the uplink voice call data to prevent howling sounds from being transmitted to the network again and received by other mobile terminals, thereby breaking the condition that howling sounds are getting louder, and then achieving anti-howling purpose of calling. Specifically, a preset notch filter can be used to perform anti-howling processing on the uplink voice call data in the mobile terminal, wherein the center frequency of the preset notch filter is the frequency corresponding to the howling point in the downlink voice call data .
可选的,针对上行语音通话数据的防啸叫处理,还可以是:获取当前待上传的第一上行数据,以及缓存的上一时刻上传的第二上行数据,判断所述第一上行数据与所述第二上行数据的相似度是否高于预设相似度阈值,若是,则对所述第一上行数据进行削弱处理。这样设置的好处在于,能够快速判断是否需要进行衰减处理,提高防啸叫处理效率。其中,对所述第一上行数据进行削弱处理,可包括:将所述第一上行数据中与所述第二上行数据特征相同的音频数据进行削弱或滤除。这里的削弱可包括降低声音能量。进一步的,还可对所述第一上行数据和所述第二上行数据进行模拟叠加,判断叠加后的数据中是否包含啸叫特征,若包含,则对所述第一上行数据进行削弱处理。所述啸叫特征可包括能量集中、周期性以及频率高于预设频率阈值等。也可按照上述对下行语音通话数据进行啸叫检测的方式来判断叠加后的数据中是否包含啸叫特征,本申请实施例不做限定。Optionally, for the anti-howling processing of the uplink voice call data, it may also be: acquire the first uplink data to be uploaded currently, and the cached second uplink data uploaded at the last moment, and determine whether the first uplink data is related to Whether the similarity of the second uplink data is higher than a preset similarity threshold, and if so, perform weakening processing on the first uplink data. The advantage of this setting is that it can quickly determine whether attenuation processing is required, and improve the anti-howling processing efficiency. Wherein, performing weakening processing on the first uplink data may include: weakening or filtering out audio data in the first uplink data having the same characteristics as the second uplink data. Attenuation here may include reducing sound energy. Further, the first uplink data and the second uplink data may be simulated and superimposed, and it is judged whether the superimposed data contains howling features, and if so, weakening processing is performed on the first uplink data. The characteristics of howling may include energy concentration, periodicity, frequency higher than a preset frequency threshold, and the like. It is also possible to judge whether the superimposed data includes the howling feature according to the above method of performing howling detection on the downlink voice call data, which is not limited in this embodiment of the present application.
在一些实施例中,所述根据所述目标强度对所述移动终端中的语音通话数据进行相应的防啸叫处理,包括:获取移动终端中的预设时间长度的下行语音通话数据;确定所述下行语音通话数据中的啸叫点;采用预设陷波滤波器对所述移动终端中的语音通话数据进行啸叫抑制处理;其中,所述预设陷波器的中心频率为所述啸叫点对应的频率,处理宽度及增益值由所述目标强度确定,所述目标强度越高,对应的处理宽度越宽或对应的增益值越小。In some embodiments, performing corresponding anti-howling processing on the voice call data in the mobile terminal according to the target strength includes: acquiring downlink voice call data of a preset time length in the mobile terminal; determining the The howling point in the downlink voice call data; the voice call data in the mobile terminal is subjected to howling suppression processing by using a preset notch filter; wherein, the center frequency of the preset notch filter is the howling The frequency corresponding to the point, the processing width and gain value are determined by the target intensity, the higher the target intensity, the wider the corresponding processing width or the smaller the corresponding gain value.
采用预设陷波滤波器对语音通话数据进行啸叫抑制处理,此处的语音通话数据可以包括上行语音通话数据和/或下行语音通话数据,本申请实施例不做限定。这样设置的好处在于,可以根据不同的目标距离有针对性的设置预设陷波滤波器的处理宽度或增益值,从而实现不同程度的啸叫抑制处理。Howling suppression processing is performed on the voice call data by using a preset notch filter, where the voice call data may include uplink voice call data and/or downlink voice call data, which is not limited in this embodiment of the present application. The advantage of this setting is that the processing width or gain value of the preset notch filter can be set in a targeted manner according to different target distances, so as to achieve different degrees of howling suppression processing.
图2为本申请实施例提供的一种原始啸叫语音频谱分析示意图,该图中示出的是从某包含啸叫音的音频中截取的一个啸叫段,该音频中3362Hz对应的能量值最大,为-6.64dB,如果播放出去,声音会很大,需要进行啸叫抑制处理。Fig. 2 is a schematic diagram of an original howling speech spectrum analysis provided by the embodiment of the present application, which shows a howling segment intercepted from an audio containing howling sound, and the energy value corresponding to 3362 Hz in the audio The maximum is -6.64dB. If it is played out, the sound will be very loud, and howling suppression processing is required.
图3为本申请实施例提供的一种陷波滤波器示意图。在对下行语音通话数据进行啸叫抑制处理时,预设陷波滤波器的中心频率为啸叫点对应的频率,如图2中的3362Hz,可根据目标强度确定对应的处理宽度。处理宽度为中心频率左右需要处理的范围,假设-6.64dB对应的处理宽度为50Hz,则需要处理的范围为3312Hz至3412Hz,即对这个范围内的音频信号进行处理。根据目标强度确定处理宽度的好处在于,啸叫点附近可能出现能量大的频点,扩大处理范围,可以得到更好的抑制效果。此外,如图2所示,陷波滤波器中设置有增益值,以g表示,图中的gmin表示增益值的最小值,取值范围一般为0至1,g值越大,衰减程度越小。因此,本申请中,可根据目标强度确定增益值,目标强度越高,增益值越小,使得处理范围内能量衰减程度越高,对啸叫音的抑制程度越高。FIG. 3 is a schematic diagram of a notch filter provided by an embodiment of the present application. When performing howling suppression processing on downlink voice call data, the center frequency of the preset notch filter is the frequency corresponding to the howling point, such as 3362 Hz in Figure 2, and the corresponding processing width can be determined according to the target strength. The processing width is the range that needs to be processed around the center frequency. Assuming that the processing width corresponding to -6.64dB is 50Hz, the range that needs to be processed is 3312Hz to 3412Hz, that is, the audio signal in this range is processed. The advantage of determining the processing width according to the target intensity is that frequency points with high energy may appear near the howling point, and expanding the processing range can obtain better suppression effect. In addition, as shown in Figure 2, a gain value is set in the notch filter, represented by g. In the figure, gmin represents the minimum value of the gain value, and the value range is generally 0 to 1. The larger the value of g, the greater the attenuation degree. Small. Therefore, in this application, the gain value can be determined according to the target intensity. The higher the target intensity, the smaller the gain value, so that the higher the energy attenuation degree in the processing range, the higher the suppression degree of howling sound.
图4为本申请实施例提供的一种经过陷波滤波器处理后的啸叫语音频谱分析示意图,如图4所示,3312Hz至3412Hz范围内的能量经过陷波滤波器处理后得到了明显的衰减,从而实现对啸叫音的抑制。Fig. 4 is a schematic diagram of howling speech spectrum analysis provided by the embodiment of the present application after being processed by a notch filter. As shown in Fig. Attenuation, so as to suppress the howling sound.
图5为本申请实施例提供的另一种语音通话数据处理方法的流程示意图,以预设应用程序为网络游戏应用程序为例,该方法包括如下步骤:FIG. 5 is a schematic flow diagram of another voice call data processing method provided in the embodiment of the present application. Taking the preset application program as an online game application program as an example, the method includes the following steps:
步骤501、在游戏应用程序中的语音通话组建立成功。Step 501, the voice call group in the game application is established successfully.
示例性的,以团队对战游戏为例,如王者荣耀,每队有5个玩家,红蓝两队进行对战,每个队伍的5个玩家之间需要进行沟通交流商量对战策略,因此,许多玩家会选择开启队内语音通话功能,如一个玩家申请开启队内语音通话功能后,语音通话组建立成功。开始正式语音通话后,同一战队的5个玩家中的任意一个,可听到其余4个玩家说话的声音。本申请实施例中,在语音通话组建立成功后,不会立即开始语音通话,而是先进行距离测试。Exemplarily, take a team battle game as an example, such as Glory of Kings, each team has 5 players, and the red and blue teams play against each other. The 5 players of each team need to communicate and discuss the battle strategy. Therefore, many players It will choose to enable the voice call function within the team. For example, after a player applies to enable the voice call function within the team, the voice call group is successfully established. After starting the official voice call, any one of the 5 players in the same team can hear the voices of the other 4 players. In the embodiment of the present application, after the voice call group is established successfully, the voice call will not be started immediately, but the distance test will be performed first.
步骤502、获取移动终端连接的第一WiFi信息以及语音通话组中其他移动终端连接的第二WiFi信息。Step 502, acquiring first WiFi information connected by the mobile terminal and second WiFi information connected by other mobile terminals in the voice call group.
其中,WiFi信息中包含WiFi热点的MAC地址(简称地址)和WiFi热点的信号强度。Wherein, the WiFi information includes the MAC address (referred to as address) of the WiFi hotspot and the signal strength of the WiFi hotspot.
步骤503、根据第一WiFi地址和第二WiFi地址,判断语音通话组中是否存在与移动终端连接至同一个WiFi热点的目标移动终端,若是,则执行步骤504;否则,执行步骤510。Step 503, according to the first WiFi address and the second WiFi address, determine whether there is a target mobile terminal connected to the same WiFi hotspot as the mobile terminal in the voice call group, if so, perform step 504; otherwise, perform step 510.
若5个玩家中,有两个玩家的移动终端距离较近,如两个好朋友在家中一起玩,又同时将移动终端设置为外放模式,这样就非常容易引起啸叫。因此,本申请实施例中,可先判断语音通话组中是否存在与当前的移动终端距离较近的其他移动终端,若存在,则需要进行防啸叫处理。If among 5 players, there are two players whose mobile terminals are relatively close to each other, such as two good friends playing together at home, and at the same time setting the mobile terminal to the external playback mode, it is very easy to cause howling. Therefore, in the embodiment of the present application, it may first be determined whether there are other mobile terminals in the voice call group that are closer to the current mobile terminal, and if so, anti-howling processing needs to be performed.
步骤504、根据第一信号强度和第二信号强度,确定移动终端与目标移动终端之间的目标距离D。Step 504: Determine a target distance D between the mobile terminal and the target mobile terminal according to the first signal strength and the second signal strength.
示例性的,若目标移动终端存在至少两个,那么可取数值最小的目标距离作为D,用于后续的判断。Exemplarily, if there are at least two target mobile terminals, then the target distance with the smallest value may be taken as D for subsequent judgments.
步骤505、判断D是否小于X,若是,则执行步骤506;否则,执行步骤510。Step 505, judge whether D is smaller than X, if yes, execute step 506; otherwise, execute step 510.
步骤506、判断D与Y及Z的大小关系;D>Y时,执行步骤507;Z<D≤Y时,执行步骤508;D≤Z时,执行步骤509。Step 506, determine the size relationship between D, Y and Z; when D>Y, execute step 507; when Z<D≤Y, execute step 508; when D≤Z, execute step 509.
其中,X、Y及Z的数值依次减小。Wherein, the numerical values of X, Y and Z decrease successively.
步骤507、开始语音通话,并对移动终端中的上行语音通话数据进行防啸叫处理。Step 507, start the voice call, and perform anti-howling processing on the uplink voice call data in the mobile terminal.
步骤508、开始语音通话,并对移动终端中的下行语音通话数据进行防啸叫处理。Step 508, start the voice call, and perform anti-howling processing on the downlink voice call data in the mobile terminal.
步骤509、开始语音通话,并对移动终端中的上行语音通话数据和下行语音通话数据进行防啸叫处理。Step 509: Start a voice call, and perform anti-howling processing on the uplink voice call data and downlink voice call data in the mobile terminal.
步骤510、开始语音通话,不进行防啸叫处理。Step 510: Start a voice call without performing anti-howling processing.
本申请实施例在游戏应用中的语音通话组建立成功后,不会立即开始语音通话,而是先通过获取WiFi信息的方式,确定语音通话组中是否存在与当前移动终端距离较近的其他移动终端,若存在,则根据具体的距离值选择对上行和/或下行语音通话数据进行防啸叫处理,在开始语音通话后,对相应的语音通话数据进行防啸叫处理,削弱啸叫音对用户游戏过程产生的干扰,减少游戏玩家痛点,使移动终端的功能更加完善。In the embodiment of the present application, after the voice call group in the game application is successfully established, the voice call will not be started immediately, but firstly, by obtaining WiFi information, it is determined whether there are other mobile phones in the voice call group that are closer to the current mobile terminal. The terminal, if it exists, chooses to perform anti-howling processing on the uplink and/or downlink voice call data according to the specific distance value, and performs anti-howling processing on the corresponding voice call data after starting the voice call, weakening the howling sound to the The interference generated by the user's game process reduces the pain points of gamers and makes the functions of mobile terminals more perfect.
图6为本申请实施例提供的又一种语音通话数据处理方法的流程示意图,仍以网络游戏应用为例,该方法包括:Fig. 6 is a schematic flow chart of another voice call data processing method provided by the embodiment of the present application, still taking an online game application as an example, the method includes:
步骤601、在游戏应用程序中的语音通话组建立成功。Step 601, the voice call group in the game application is established successfully.
步骤602、获取移动终端连接的第一WiFi信息以及语音通话组中其他移动终端连接的第二WiFi信息。Step 602, acquiring the first WiFi information connected by the mobile terminal and the second WiFi information connected by other mobile terminals in the voice call group.
其中,WiFi信息中包含WiFi热点的MAC地址(简称地址)和WiFi热点的信号强度。Wherein, the WiFi information includes the MAC address (referred to as address) of the WiFi hotspot and the signal strength of the WiFi hotspot.
步骤603、根据第一WiFi地址和第二WiFi地址,判断语音通话组中是否存在与移动终端连接至同一个WiFi热点的目标移动终端,若是,则执行步骤604;否则,执行步骤608。Step 603, according to the first WiFi address and the second WiFi address, determine whether there is a target mobile terminal connected to the same WiFi hotspot as the mobile terminal in the voice call group, if so, perform step 604; otherwise, perform step 608.
步骤604、根据第一信号强度和第二信号强度,确定移动终端与目标移动终端之间的目标距离F。Step 604: Determine a target distance F between the mobile terminal and the target mobile terminal according to the first signal strength and the second signal strength.
示例性的,若目标移动终端存在至少两个,那么可取数值最小的目标距离作为F,用于后续的判断。Exemplarily, if there are at least two target mobile terminals, then the target distance with the smallest value may be selected as F for subsequent judgment.
步骤605、判断F是否小于E,若是,则执行步骤606;否则,执行步骤608。Step 605, judge whether F is smaller than E, if so, execute step 606; otherwise, execute step 608.
步骤606、根据F确定预设陷波器的处理宽度和增益值。Step 606: Determine the processing width and gain value of the preset notch filter according to F.
其中,F值越小,对应的处理宽度越大,增益值越小。Wherein, the smaller the F value is, the larger the corresponding processing width is, and the smaller the gain value is.
步骤607、开始语音通话,采用预设陷波滤波器对移动终端中的语音通话数据进行啸叫抑制处理。Step 607: Start the voice call, and perform howling suppression processing on the voice call data in the mobile terminal by using a preset notch filter.
示例性的,对下行语音通话数据进行啸叫检测,确定啸叫点,预设陷波器的中心频率为啸叫点对应的频率。Exemplarily, the howling detection is performed on the downlink voice call data to determine the howling point, and the center frequency of the preset notch filter is the frequency corresponding to the howling point.
步骤608、开始语音通话,不进行防啸叫处理。Step 608: Start a voice call without performing anti-howling processing.
本申请实施例在游戏应用中的语音通话组建立成功后,不会立即开始语音通话,而是先通过获取WiFi信息的方式,确定语音通话组中是否存在与当前移动终端距离较近的其他移动终端,若存在,则根据具体的距离值对即将用于防啸叫处理的预设陷波滤波器的参数进行设置,在开始语音通话后,采用参数设置完毕的预设陷波滤波器对相应的语音通话数据进行防啸叫处理,削弱啸叫音对用户游戏过程产生的干扰,减少游戏玩家痛点,使移动终端的功能更加完善。In the embodiment of the present application, after the voice call group in the game application is successfully established, the voice call will not be started immediately, but firstly, by obtaining WiFi information, it is determined whether there are other mobile phones in the voice call group that are closer to the current mobile terminal. The terminal, if it exists, sets the parameters of the preset notch filter to be used for anti-howling processing according to the specific distance value, and uses the preset notch filter whose parameters have been set to the corresponding Anti-howling processing is performed on the voice call data, which weakens the interference of howling sound on the user's game process, reduces the pain points of game players, and makes the functions of the mobile terminal more perfect.
图7为本申请实施例提供的一种语音通话数据处理装置的结构框图,该装置可由软件和/或硬件实现,一般集成在移动终端中,可通过执行语音通话数据处理方法来对语音通话数据进行防啸叫处理。如图7所示,该装置包括:Fig. 7 is a structural block diagram of a voice call data processing device provided by the embodiment of the present application. The device can be implemented by software and/or hardware, and is generally integrated in a mobile terminal, and can process voice call data by executing a voice call data processing method. Perform anti-howling treatment. As shown in Figure 7, the device includes:
通话组检测模块701,用于检测移动终端的预设应用程序中的语音通话组是否建立成功;Talkgroup detection module 701, used to detect whether the voice talkgroup in the preset application program of the mobile terminal is established successfully;
WiFi信息获取模块702,用于在检测到移动终端的预设应用程序中的语音通话组建立成功后,获取所述移动终端连接的第一WiFi信息以及所述语音通话组中其他移动终端连接的第二WiFi信息;The WiFi information acquiring module 702 is configured to acquire the first WiFi information connected by the mobile terminal and the first WiFi information connected by other mobile terminals in the voice talk group after detecting that the voice talk group in the preset application program of the mobile terminal is successfully established. Second WiFi information;
判断模块703,用于根据所述第一WiFi信息和所述第二WiFi信息,判断所述语音通话组中是否存在与所述移动终端连接至同一个WiFi热点的目标移动终端;A judging module 703, configured to judge whether there is a target mobile terminal connected to the same WiFi hotspot as the mobile terminal in the voice call group according to the first WiFi information and the second WiFi information;
防啸叫处理模块704,用于在所述判断模块的判断结果为存在时,对所述移动终端中的语音通话数据进行防啸叫处理。The anti-howling processing module 704 is configured to perform anti-howling processing on the voice call data in the mobile terminal when the judging result of the judging module is yes.
本申请实施例中提供的语音通话数据处理装置,可以在移动终端中的预设应用程序的语音通话组建立成功后,检测到语音通话组中存在与当前移动终端距离较近的其他移动终端时,及时对当前的移动终端的语音通话数据进行防啸叫处理,减少啸叫音给用户使用带来的不便。The voice call data processing device provided in the embodiment of the present application can detect that there are other mobile terminals in the voice call group that are closer to the current mobile terminal after the voice call group of the preset application program in the mobile terminal is successfully established. , timely perform anti-howling processing on the voice call data of the current mobile terminal, and reduce the inconvenience caused by the howling sound to the user.
可选的,所述获取所述移动终端连接的第一WiFi信息以及所述语音通话组中其他移动终端连接的第二WiFi信息,包括:Optionally, the acquiring the first WiFi information connected by the mobile terminal and the second WiFi information connected by other mobile terminals in the voice call group includes:
获取所述移动终端连接的第一WiFi信息;Obtaining first WiFi information connected by the mobile terminal;
向所述预设应用程序对应的服务器发送WiFi信息获取请求,所述WiFi信息获取请求用于指示所述服务器收集所述语音通话组中其他移动终端的第二WiFi信息,并将所述第二WiFi信息返回至所述移动终端。Sending a WiFi information acquisition request to the server corresponding to the preset application program, the WiFi information acquisition request is used to instruct the server to collect second WiFi information of other mobile terminals in the voice call group, and transfer the second WiFi information is returned to the mobile terminal.
可选的,所述WiFi信息中包含WiFi热点的信号强度;Optionally, the WiFi information includes the signal strength of the WiFi hotspot;
所述在所述判断模块的判断结果为存在时,对所述移动终端中的语音通话数据进行防啸叫处理,包括:When the judging result of the judging module is that it exists, performing anti-howling processing on the voice call data in the mobile terminal includes:
在所述判断模块的判断结果为存在时,根据第一信号强度和第二信号强度,确定所述移动终端与所述目标移动终端之间的目标距离;When the determination result of the determination module is existence, according to the first signal strength and the second signal strength, determine the target distance between the mobile terminal and the target mobile terminal;
当所述目标距离小于第一预设距离阈值时,对所述移动终端中的语音通话数据进行防啸叫处理。When the target distance is less than a first preset distance threshold, anti-howling processing is performed on the voice call data in the mobile terminal.
可选的,所述对所述移动终端中的语音通话数据进行防啸叫处理,包括:Optionally, performing anti-howling processing on the voice call data in the mobile terminal includes:
根据所述目标距离确定防啸叫处理的目标强度;其中,目标距离越小,对应的目标强度越大;Determine the target strength of the anti-howling processing according to the target distance; wherein, the smaller the target distance, the greater the corresponding target strength;
根据所述目标强度对所述移动终端中的语音通话数据进行相应的防啸叫处理。Perform corresponding anti-howling processing on the voice call data in the mobile terminal according to the target intensity.
可选的,所述根据所述目标距离确定防啸叫处理的目标强度,包括:Optionally, the determining the target strength of the anti-howling treatment according to the target distance includes:
根据所述目标距离,确定对所述移动终端中的上行语音通话数据和/或下行语音通话数据进行防啸叫处理;According to the target distance, determine to perform anti-howling processing on the uplink voice call data and/or downlink voice call data in the mobile terminal;
其中,当所述目标距离大于第二预设距离值时,确定对所述移动终端中的上行语音通话数据进行防啸叫处理;Wherein, when the target distance is greater than a second preset distance value, it is determined to perform anti-howling processing on the uplink voice call data in the mobile terminal;
当所述目标距离大于第三预设距离值且小于或等于所述第二预设距离值时,确定对所述移动终端中的下行语音通话数据进行防啸叫处理;When the target distance is greater than a third preset distance value and less than or equal to the second preset distance value, it is determined to perform anti-howling processing on the downlink voice call data in the mobile terminal;
当所述目标距离小于或等于所述第三预设距离值时,确定对所述移动终端中的上行语音通话数据和下行语音通话数据进行防啸叫处理。When the target distance is less than or equal to the third preset distance value, it is determined to perform anti-howling processing on the uplink voice call data and downlink voice call data in the mobile terminal.
可选的,所述根据所述目标强度对所述移动终端中的语音通话数据进行相应的防啸叫处理,包括:Optionally, performing corresponding anti-howling processing on the voice call data in the mobile terminal according to the target intensity includes:
获取移动终端中的预设时间长度的下行语音通话数据;Acquiring downlink voice call data of a preset time length in the mobile terminal;
确定所述下行语音通话数据中的啸叫点;Determining howling points in the downlink voice call data;
采用预设陷波滤波器对所述移动终端中的语音通话数据进行啸叫抑制处理;其中,所述预设陷波器的中心频率为所述啸叫点对应的频率,处理宽度及增益值由所述目标强度确定,所述目标强度越高,对应的处理宽度越宽或对应的增益值越小。Using a preset notch filter to perform howling suppression processing on the voice call data in the mobile terminal; wherein, the center frequency of the preset notch filter is the frequency corresponding to the howling point, and the processing width and gain value Determined by the target intensity, the higher the target intensity, the wider the corresponding processing width or the smaller the corresponding gain value.
可选的,所述预设应用程序为网络游戏应用程序。Optionally, the preset application program is an online game application program.
本申请实施例还提供一种包含计算机可执行指令的存储介质,所述计算机可执行指令在由计算机处理器执行时用于执行语音通话数据处理方法,该方法包括:The embodiment of the present application also provides a storage medium containing computer-executable instructions, the computer-executable instructions are used to execute a voice call data processing method when executed by a computer processor, the method comprising:
检测到移动终端的预设应用程序中的语音通话组建立成功;It is detected that the voice talk group in the preset application program of the mobile terminal is successfully established;
获取所述移动终端连接的第一WiFi信息以及所述语音通话组中其他移动终端连接的第二WiFi信息;Obtaining the first WiFi information connected by the mobile terminal and the second WiFi information connected by other mobile terminals in the voice call group;
根据所述第一WiFi信息和所述第二WiFi信息,判断所述语音通话组中是否存在与所述移动终端连接至同一个WiFi热点的目标移动终端,若存在,则对所述移动终端中的语音通话数据进行防啸叫处理。According to the first WiFi information and the second WiFi information, it is judged whether there is a target mobile terminal connected to the same WiFi hotspot as the mobile terminal in the voice call group, and if there is a target mobile terminal in the mobile terminal Anti-howling processing for voice call data.
存储介质——任何的各种类型的存储器设备或存储设备。术语“存储介质”旨在包括:安装介质,例如CD-ROM、软盘或磁带装置;计算机系统存储器或随机存取存储器,诸如DRAM、DDRRAM、SRAM、EDORAM,兰巴斯(Rambus)RAM等;非易失性存储器,诸如闪存、磁介质(例如硬盘或光存储);寄存器或其它相似类型的存储器元件等。存储介质可以还包括其它类型的存储器或其组合。另外,存储介质可以位于程序在其中被执行的第一计算机系统中,或者可以位于不同的第二计算机系统中,第二计算机系统通过网络(诸如因特网)连接到第一计算机系统。第二计算机系统可以提供程序指令给第一计算机用于执行。术语“存储介质”可以包括可以驻留在不同位置中(例如在通过网络连接的不同计算机系统中)的两个或更多存储介质。存储介质可以存储可由一个或多个处理器执行的程序指令(例如具体实现为计算机程序)。storage medium - any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media, such as CD-ROMs, floppy disks, or tape drives; computer system memory or random access memory, such as DRAM, DDRRAM, SRAM, EDORAM, Rambus RAM, etc.; Volatile memory, such as flash memory, magnetic media (eg hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. Also, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system connected to the first computer system through a network such as the Internet. The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media that may reside in different locations, such as in different computer systems connected by a network. The storage medium may store program instructions (eg embodied as computer programs) executable by one or more processors.
当然,本申请实施例所提供的一种包含计算机可执行指令的存储介质,其计算机可执行指令不限于如上所述的语音通话数据处理操作,还可以执行本申请任意实施例所提供的语音通话数据处理方法中的相关操作。Certainly, a storage medium containing computer-executable instructions provided in the embodiments of the present application, the computer-executable instructions are not limited to the above-mentioned voice call data processing operations, and can also execute the voice call provided in any embodiment of the present application. Relevant operations in data processing methods.
本申请实施例提供了一种移动终端,该移动终端中可集成本申请实施例提供的语音通话数据处理装置。图8为本申请实施例提供的一种移动终端的结构示意图。移动终端800可以包括:存储器801,处理器802及存储在存储器801上并可在处理器802运行的计算机程序,所述处理器802执行所述计算机程序时实现如本申请实施例所述的语音通话数据处理方法。An embodiment of the present application provides a mobile terminal, in which the device for processing voice call data provided in the embodiment of the present application can be integrated. FIG. 8 is a schematic structural diagram of a mobile terminal provided by an embodiment of the present application. The mobile terminal 800 may include: a memory 801, a processor 802, and a computer program stored on the memory 801 and operable on the processor 802. When the processor 802 executes the computer program, it realizes the voice as described in the embodiment of the present application. Method for processing call data.
本申请实施例提供的移动终端,可以在移动终端中的预设应用程序的语音通话组建立成功后,检测到语音通话组中存在与当前移动终端距离较近的其他移动终端时,及时对当前的移动终端的语音通话数据进行防啸叫处理,减少啸叫音给用户使用带来的不便。The mobile terminal provided by the embodiment of the present application can timely respond to the current mobile terminal when it detects that there are other mobile terminals in the voice talk group that are close to the current mobile terminal after the voice call group of the preset application program in the mobile terminal is successfully established. Anti-howling processing is performed on the voice call data of the mobile terminal to reduce the inconvenience caused by the howling sound to the user.
图9为本申请实施例提供的另一种移动终端的结构示意图,该移动终端可以包括:壳体(图中未示出)、存储器901、中央处理器(central processing unit,CPU)902(又称处理器,以下简称CPU)、电路板(图中未示出)和电源电路(图中未示出)。所述电路板安置在所述壳体围成的空间内部;所述CPU902和所述存储器901设置在所述电路板上;所述电源电路,用于为所述移动终端的各个电路或器件供电;所述存储器901,用于存储可执行程序代码;所述CPU902通过读取所述存储器901中存储的可执行程序代码来运行与所述可执行程序代码对应的计算机程序,以实现以下步骤:FIG. 9 is a schematic structural diagram of another mobile terminal provided by an embodiment of the present application. The mobile terminal may include: a casing (not shown in the figure), a memory 901, and a central processing unit (central processing unit, CPU) 902 (also Said processor, hereinafter referred to as CPU), circuit board (not shown in the figure) and power supply circuit (not shown in the figure). The circuit board is placed inside the space surrounded by the housing; the CPU902 and the memory 901 are arranged on the circuit board; the power supply circuit is used to supply power to each circuit or device of the mobile terminal The memory 901 is used to store executable program codes; the CPU902 executes a computer program corresponding to the executable program codes by reading the executable program codes stored in the memory 901, to achieve the following steps:
检测到移动终端的预设应用程序中的语音通话组建立成功;It is detected that the voice talk group in the preset application program of the mobile terminal is successfully established;
获取所述移动终端连接的第一WiFi信息以及所述语音通话组中其他移动终端连接的第二WiFi信息;Obtaining the first WiFi information connected by the mobile terminal and the second WiFi information connected by other mobile terminals in the voice call group;
根据所述第一WiFi信息和所述第二WiFi信息,判断所述语音通话组中是否存在与所述移动终端连接至同一个WiFi热点的目标移动终端,若存在,则对所述移动终端中的语音通话数据进行防啸叫处理。According to the first WiFi information and the second WiFi information, it is judged whether there is a target mobile terminal connected to the same WiFi hotspot as the mobile terminal in the voice call group, and if there is a target mobile terminal in the mobile terminal Anti-howling processing for voice call data.
所述移动终端还包括:外设接口903、RF(Radio Frequency,射频)电路905、音频电路906、扬声器911、电源管理芯片908、输入/输出(I/O)子系统909、其他输入/控制设备910、触摸屏912、其他输入/控制设备910以及外部端口904,这些部件通过一个或多个通信总线或信号线907来通信。The mobile terminal also includes: peripheral interface 903, RF (Radio Frequency, radio frequency) circuit 905, audio circuit 906, speaker 911, power management chip 908, input/output (I/O) subsystem 909, other input/control device 910 , touch screen 912 , other input/control devices 910 , and external ports 904 , these components communicate via one or more communication buses or signal lines 907 .
应该理解的是,图示移动终端900仅仅是移动终端的一个范例,并且移动终端900可以具有比图中所示出的更多的或者更少的部件,可以组合两个或更多的部件,或者可以具有不同的部件配置。图中所示出的各种部件可以在包括一个或多个信号处理和/或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。It should be understood that the illustrated mobile terminal 900 is only an example of a mobile terminal, and the mobile terminal 900 may have more or fewer components than those shown in the figure, and two or more components may be combined, Or can have a different component configuration. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.
下面就本实施例提供的用于语音通话数据处理的移动终端进行详细的描述,该移动终端以手机为例。The mobile terminal used for voice call data processing provided in this embodiment will be described in detail below, and the mobile terminal is taken as an example.
存储器901,所述存储器901可以被CPU902、外设接口903等访问,所述存储器901可以包括高速随机存取存储器,还可以包括非易失性存储器,例如一个或多个磁盘存储器件、闪存器件、或其他易失性固态存储器件。Memory 901, the memory 901 can be accessed by the CPU 902, the peripheral interface 903, etc., the memory 901 can include a high-speed random access memory, and can also include a non-volatile memory, such as one or more disk storage devices, flash memory devices , or other volatile solid-state storage devices.
外设接口903,所述外设接口903可以将设备的输入和输出外设连接到CPU902和存储器901。Peripheral interface 903 , which can connect the input and output peripherals of the device to CPU 902 and memory 901 .
I/O子系统909,所述I/O子系统909可以将设备上的输入输出外设,例如触摸屏912和其他输入/控制设备910,连接到外设接口903。I/O子系统909可以包括显示控制器9091和用于控制其他输入/控制设备910的一个或多个输入控制器9092。其中,一个或多个输入控制器9092从其他输入/控制设备910接收电信号或者向其他输入/控制设备910发送电信号,其他输入/控制设备910可以包括物理按钮(按压按钮、摇臂按钮等)、拨号盘、滑动开关、操纵杆、点击滚轮。值得说明的是,输入控制器9092可以与以下任一个连接:键盘、红外端口、USB接口以及诸如鼠标的指示设备。The I/O subsystem 909 , the I/O subsystem 909 can connect input and output peripherals on the device, such as a touch screen 912 and other input/control devices 910 , to the peripheral interface 903 . The I/O subsystem 909 may include a display controller 9091 and one or more input controllers 9092 for controlling other input/control devices 910 . Among them, one or more input controllers 9092 receive electrical signals from or send electrical signals to other input/control devices 910, which may include physical buttons (push buttons, rocker buttons, etc. ), dials, slide switches, joysticks, click wheels. It is worth noting that the input controller 9092 can be connected to any of the following: a keyboard, an infrared port, a USB interface, and a pointing device such as a mouse.
触摸屏912,所述触摸屏912是用户移动终端与用户之间的输入接口和输出接口,将可视输出显示给用户,可视输出可以包括图形、文本、图标、视频等。A touch screen 912, the touch screen 912 is an input interface and an output interface between the user's mobile terminal and the user, and displays visual output to the user, and the visual output may include graphics, text, icons, videos, and the like.
I/O子系统909中的显示控制器9091从触摸屏912接收电信号或者向触摸屏912发送电信号。触摸屏912检测触摸屏上的接触,显示控制器9091将检测到的接触转换为与显示在触摸屏912上的用户界面对象的交互,即实现人机交互,显示在触摸屏912上的用户界面对象可以是运行游戏的图标、联网到相应网络的图标等。值得说明的是,设备还可以包括光鼠,光鼠是不显示可视输出的触摸敏感表面,或者是由触摸屏形成的触摸敏感表面的延伸。The display controller 9091 in the I/O subsystem 909 receives electrical signals from the touch screen 912 or sends electrical signals to the touch screen 912 . The touch screen 912 detects the contact on the touch screen, and the display controller 9091 converts the detected contact into an interaction with the user interface object displayed on the touch screen 912, that is, realizes human-computer interaction, and the user interface object displayed on the touch screen 912 can be a running Icons for games, icons for networking to appropriate networks, etc. It is worth noting that the device may also include an optical mouse, which is a touch-sensitive surface that does not display visual output, or that is an extension of a touch-sensitive surface formed by a touch screen.
RF电路905,主要用于建立手机与无线网络(即网络侧)的通信,实现手机与无线网络的数据接收和发送。例如收发短信息、电子邮件等。具体地,RF电路905接收并发送RF信号,RF信号也称为电磁信号,RF电路905将电信号转换为电磁信号或将电磁信号转换为电信号,并且通过该电磁信号与通信网络以及其他设备进行通信。RF电路905可以包括用于执行这些功能的已知电路,其包括但不限于天线系统、RF收发机、一个或多个放大器、调谐器、一个或多个振荡器、数字信号处理器、CODEC(COder-DECoder,编译码器)芯片组、用户标识模块(Subscriber Identity Module,SIM)等等。The RF circuit 905 is mainly used to establish communication between the mobile phone and the wireless network (that is, the network side), and realize data reception and transmission between the mobile phone and the wireless network. Such as sending and receiving short messages, e-mails, etc. Specifically, the RF circuit 905 receives and sends RF signals, which are also called electromagnetic signals, and the RF circuit 905 converts electrical signals into electromagnetic signals or converts electromagnetic signals into electrical signals, and communicates with communication networks and other devices through the electromagnetic signals to communicate. RF circuitry 905 may include known circuitry for performing these functions including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC ( COder-DECoder, Codec) Chipset, Subscriber Identity Module (Subscriber Identity Module, SIM) and so on.
音频电路906,主要用于从外设接口903接收音频数据,将该音频数据转换为电信号,并且将该电信号发送给扬声器911。The audio circuit 906 is mainly used to receive audio data from the peripheral interface 903 , convert the audio data into electrical signals, and send the electrical signals to the speaker 911 .
扬声器911,用于将手机通过RF电路905从无线网络接收的语音信号,还原为声音并向用户播放该声音。The speaker 911 is used to restore the voice signal received by the mobile phone from the wireless network through the RF circuit 905 into sound and play the sound to the user.
电源管理芯片908,用于为CPU902、I/O子系统及外设接口所连接的硬件进行供电及电源管理。The power management chip 908 is used for power supply and power management for the hardware connected to the CPU 902 , the I/O subsystem and the peripheral interface.
上述实施例中提供的语音通话数据处理装置、存储介质及移动终端可执行本申请任意实施例所提供的语音通话数据处理方法,具备执行该方法相应的功能模块和有益效果。未在上述实施例中详尽描述的技术细节,可参见本申请任意实施例所提供的语音通话数据处理方法。The voice call data processing device, storage medium, and mobile terminal provided in the above embodiments can execute the voice call data processing method provided in any embodiment of the present application, and have corresponding functional modules and beneficial effects for executing the method. For technical details not exhaustively described in the foregoing embodiments, reference may be made to the method for processing voice call data provided in any embodiment of the present application.
注意,上述仅为本申请的较佳实施例及所运用技术原理。本领域技术人员会理解,本申请不限于这里所述的特定实施例,对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本申请的保护范围。因此,虽然通过以上实施例对本申请进行了较为详细的说明,但是本申请不仅仅限于以上实施例,在不脱离本申请构思的情况下,还可以包括更多其他等效实施例,而本申请的范围由所附的权利要求范围决定。Note that the above are only preferred embodiments and technical principles used in this application. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present application, and the present application The scope is determined by the scope of the appended claims.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810200541.7A CN108449495A (en) | 2018-03-12 | 2018-03-12 | Voice call data processing method and device, storage medium and mobile terminal |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810200541.7A CN108449495A (en) | 2018-03-12 | 2018-03-12 | Voice call data processing method and device, storage medium and mobile terminal |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108449495A true CN108449495A (en) | 2018-08-24 |
Family
ID=63194132
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810200541.7A Pending CN108449495A (en) | 2018-03-12 | 2018-03-12 | Voice call data processing method and device, storage medium and mobile terminal |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108449495A (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109671445A (en) * | 2018-12-28 | 2019-04-23 | 广东美电贝尔科技集团股份有限公司 | A kind of suppressing method that audio system sound is uttered long and high-pitched sounds |
CN110176234A (en) * | 2019-05-30 | 2019-08-27 | 芋头科技(杭州)有限公司 | Control method, device, controller, medium and the terminal of mobile intelligent terminal |
CN110708330A (en) * | 2019-10-16 | 2020-01-17 | 北京字节跳动网络技术有限公司 | Howling prevention method, device, equipment and storage medium |
CN110933225A (en) * | 2019-11-04 | 2020-03-27 | Oppo(重庆)智能科技有限公司 | Call information acquisition method and device, storage medium and electronic equipment |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104469934A (en) * | 2014-11-27 | 2015-03-25 | 广东小天才科技有限公司 | Method for determining relative position of positioning terminal |
CN106100676A (en) * | 2016-06-07 | 2016-11-09 | 海能达通信股份有限公司 | Control method, user terminal and the interphone terminal of audio frequency output |
CN106373587A (en) * | 2016-08-31 | 2017-02-01 | 北京容联易通信息技术有限公司 | Automatic sound feedback detection and elimination method of real-time communication system |
CN106878533A (en) * | 2015-12-10 | 2017-06-20 | 北京奇虎科技有限公司 | Communication method and device for a mobile terminal |
-
2018
- 2018-03-12 CN CN201810200541.7A patent/CN108449495A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104469934A (en) * | 2014-11-27 | 2015-03-25 | 广东小天才科技有限公司 | Method for determining relative position of positioning terminal |
CN106878533A (en) * | 2015-12-10 | 2017-06-20 | 北京奇虎科技有限公司 | Communication method and device for a mobile terminal |
CN106100676A (en) * | 2016-06-07 | 2016-11-09 | 海能达通信股份有限公司 | Control method, user terminal and the interphone terminal of audio frequency output |
CN106373587A (en) * | 2016-08-31 | 2017-02-01 | 北京容联易通信息技术有限公司 | Automatic sound feedback detection and elimination method of real-time communication system |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109671445A (en) * | 2018-12-28 | 2019-04-23 | 广东美电贝尔科技集团股份有限公司 | A kind of suppressing method that audio system sound is uttered long and high-pitched sounds |
CN110176234A (en) * | 2019-05-30 | 2019-08-27 | 芋头科技(杭州)有限公司 | Control method, device, controller, medium and the terminal of mobile intelligent terminal |
CN110176234B (en) * | 2019-05-30 | 2021-05-25 | 芋头科技(杭州)有限公司 | Control method, device, controller, medium and terminal of mobile intelligent terminal |
CN110708330A (en) * | 2019-10-16 | 2020-01-17 | 北京字节跳动网络技术有限公司 | Howling prevention method, device, equipment and storage medium |
CN110708330B (en) * | 2019-10-16 | 2021-12-24 | 北京字节跳动网络技术有限公司 | Howling prevention method, device, equipment and storage medium |
CN110933225A (en) * | 2019-11-04 | 2020-03-27 | Oppo(重庆)智能科技有限公司 | Call information acquisition method and device, storage medium and electronic equipment |
CN110933225B (en) * | 2019-11-04 | 2022-03-15 | Oppo(重庆)智能科技有限公司 | Call information acquisition method and device, storage medium and electronic equipment |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108449493B (en) | Voice call data processing method and device, storage medium and mobile terminal | |
CN108449502B (en) | Voice call data processing method, device, storage medium and mobile terminal | |
CN108449507B (en) | Voice call data processing method and device, storage medium and mobile terminal | |
CN108449503B (en) | Voice call data processing method and device, storage medium and mobile terminal | |
CN108494954B (en) | Voice call data detection method and device, storage medium and mobile terminal | |
CN108449496B (en) | Voice call data detection method, device, storage medium and mobile terminal | |
CN108418968B (en) | Voice call data processing method and device, storage medium and mobile terminal | |
CN108172237B (en) | Voice call data processing method and device, storage medium and mobile terminal | |
CN108449498A (en) | Voice call data processing method, device, storage medium and mobile terminal | |
CN108449506B (en) | Voice call data processing method and device, storage medium and mobile terminal | |
CN107566658A (en) | Call method, device, storage medium and mobile terminal | |
CN103650533A (en) | Generating a masking signal on an electronic device | |
CN108449495A (en) | Voice call data processing method and device, storage medium and mobile terminal | |
CN108449499B (en) | Voice call data processing method and device, storage medium and mobile terminal | |
CN108449497B (en) | Voice call data processing method and device, storage medium and mobile terminal | |
CN108418982A (en) | Voice call data processing method, device, storage medium and mobile terminal | |
CN107621933B (en) | Audio playing method and device and related medium product | |
KR102505345B1 (en) | System and method for removal of howling and computer program for the same | |
CN108449504B (en) | Voice call data detection method, device, storage medium and mobile terminal | |
CN108449492B (en) | Voice call data processing method, device, storage medium and mobile terminal | |
CN108429858A (en) | Voice call data processing method, device, storage medium and mobile terminal | |
CN108449508A (en) | Voice call processing method, device, storage medium and mobile terminal | |
CN107707721A (en) | Recording method, device, storage medium and mobile terminal of mobile terminal | |
CN108449505B (en) | Voice call data detection method, device, storage medium and mobile terminal | |
CN108449500B (en) | Voice call data processing method and device, storage medium and mobile terminal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180824 |