Disclosure of Invention
The technical problem to be solved by the present invention is to provide an audio adjusting method aiming at the deficiency of the prior art, which is characterized by comprising the following steps: receiving a plurality of directional audio signals; calculating a displacement amount through a positioning module; calculating a plurality of gain values corresponding to the displacement amount through a processing module; adjusting respective volume levels of the plurality of directional audio signals according to the plurality of gain values; converting the plurality of directional audio signals into a playing audio signal; and playing the played audio signal through a head-mounted playing device.
Preferably, a user wears the head mounted display device at a listening reference position in a listening scene, the head mounted display device receives the playing audio signal, and the displacement is obtained when the user does not leave the listening reference position of the listening scene.
Preferably, the user takes the displacement amount in a physical action without leaving the listening reference position of the listening scene.
Preferably, the step of adjusting the volume according to the plurality of gain values further includes the following steps: selecting one of a plurality of gain modes, and adjusting the respective volume of the directional audio signal according to the gain values and the gain mode.
Preferably, the positioning module comprises a sensor for detecting the displacement.
Preferably, the plurality of gain adjustment modes include a first mode, and the first mode adjusts the magnitude of each directional audio signal according to the plurality of gain values.
Preferably, the plurality of gain adjustment modes includes a second mode, and the second mode calculates the respective gain values of the plurality of directional audio signals and a gain value of at least one specific audio content signal of the plurality of directional audio signals according to the displacement of the positioning module.
Preferably, in the step of calculating gain values, the respective gain values corresponding to the plurality of direction signals are inversely proportional to the respective distance values of the plurality of direction signals.
Preferably, in the step of calculating gain values, the respective gain values corresponding to the plurality of direction signals are inversely proportional to the square of the distance value of each of the plurality of direction signals.
The invention also discloses an audio adjusting device, which is characterized by comprising the following components: the receiving module receives a plurality of directional audio signals; a positioning module for calculating a displacement; a processing module electrically connected to the receiving module and the positioning module, the processing module comprising: a gain calculating unit, for calculating respective gain values corresponding to the audio signals in the plurality of directions according to the displacement; a volume adjustment module, electrically connected to the processing module, for adjusting respective volume of the audio signals in the plurality of directions according to a plurality of gain values of the gain calculation unit of the processing module; and the sound channel conversion module is electrically connected with the volume adjustment module and used for converting the audio signals in the plurality of directions after the volume is adjusted into a playing audio signal.
Preferably, a user wears a head mounted playback device at a listening reference position in a listening scene, the head mounted playback device receives the playback audio signal, and the displacement amount is obtained when the user does not leave the listening reference position of the listening scene.
Preferably, the user takes the displacement amount in a physical action without leaving the listening reference position of the listening scene.
Preferably, the method further comprises the following steps: and the dynamic range compression module is electrically connected with the sound channel conversion module and is used for judging whether a volume value of the audio signal is greater than a critical value so as to determine whether volume compression is carried out.
Preferably, the audio signal is played through a head-mounted playing device.
Preferably, the positioning module comprises: a sensing unit for detecting the displacement.
Preferably, the audio adjusting device is connected to an audio providing device and the head-mounted playing device; wherein the plurality of directional audio signals are provided by the audio providing means.
Preferably, the processing module further comprises: a mode selection unit selects one of a plurality of gain adjustment modes according to a mode selection signal.
Preferably, the plurality of gain adjustment modes include a first mode, and the first mode adjusts the magnitude of each directional audio signal according to the plurality of gain values.
Preferably, the plurality of gain adjustment modes includes a second mode, and the second mode calculates the respective gain values of the plurality of directional audio signals and a gain value of at least one specific audio content signal of the plurality of directional audio signals according to the displacement of the positioning module.
Preferably, the respective gain values corresponding to the plurality of directional signals are inversely proportional to the respective distance values of the plurality of directional signals.
Preferably, respective plurality of gain values corresponding to the plurality of direction signals are inversely proportional to a square of the distance value of each of the plurality of direction signals.
The audio adjusting device is used for generating displacement to adjust the volume of the audio signals in different directions, so that a user can further identify the audio content through the audio adjusting device, and the interactive audio experience of the user can be effectively increased.
For a better understanding of the features and technical content of the present invention, reference should be made to the following detailed description of the invention and accompanying drawings, which are provided for purposes of illustration and description only and are not intended to limit the invention.
Detailed Description
The following is a description of embodiments of the present invention related to an audio adjusting apparatus and an audio adjusting method according to specific embodiments, and those skilled in the art can understand the advantages and effects of the present invention from the content provided in the present specification. The invention is capable of other and different embodiments and its several details are capable of modification and various other changes, which can be made in various details within the specification and without departing from the spirit and scope of the invention. The drawings of the present invention are for illustrative purposes only and are not intended to be drawn to scale. The following embodiments will further explain the related art of the present invention in detail, but the contents are not provided to limit the scope of the present invention.
It will be understood that, although the terms "first," "second," "third," etc. may be used herein to describe various components or signals, these components or signals should not be limited by these terms. These terms are used primarily to distinguish one element from another element or from one signal to another signal. In addition, the term "or" as used herein should be taken to include any one or combination of more of the associated listed items as the case may be.
[ first embodiment ]
Referring to fig. 1 and fig. 2, fig. 1 is a block diagram of an audio adjusting system according to an embodiment of the invention. Fig. 2 is a block diagram of an audio adjusting apparatus according to an embodiment of the invention.
In the present embodiment, the audio adjusting system 900 includes an audio adjusting device 1, an audio providing device 2, and a head-mounted playing device 3.
In the present embodiment, the audio providing apparatus 2 is communicatively connected to the audio adjusting apparatus 1. The audio adjusting device 2 is in communication connection with the head-mounted playing device 3. That is, the audio providing apparatus 2 may provide a plurality of audio signals to the audio adjusting apparatus 1 through a wired communication method or a wireless communication method. The audio adjusting apparatus 1 can provide a plurality of audio signals to the head-mounted playing apparatus 3 through a wired communication method or a wireless communication method.
In this embodiment, the audio providing device 2 may be a computer system, a tablet computer, a mobile phone, a wearable device, an augmented reality device, or a virtual reality device, which can be designed and adjusted according to actual requirements, and the invention is not limited thereto.
The head-mounted playing device 3 may be a wired or wireless earphone device, and its form may be a head-mounted type, an in-ear type, etc., and it can be adjusted and designed according to the actual requirement, and the invention is not limited.
The audio adjusting apparatus 1 receives a plurality of directional audio signals of the audio providing apparatus 2. The plurality of directional audio signals provided by the audio providing apparatus 2 are audio contents provided according to a listening reference position in a listening environment. For example, when the audio providing apparatus 2 is a virtual reality apparatus, the audio providing apparatus 2 provides directional audio signals with unadjusted gain values in the surrounding environment (listening scene) according to the location (listening reference location) of the user. When the user walks to different positions in the scene, the audio signals in all directions of the different positions without adjusting the gain value can be heard.
The audio adjusting apparatus 1 includes a processing module 10, a positioning module 11, a receiving module 12, a volume adjusting module 13, a channel converting module 14, and a dynamic range compressing module 15.
The receiving module 12 is used for receiving a plurality of directional audio signals. The positioning module 11 is used for calculating a displacement. The processing module 10 is electrically connected to the receiving module 12 and the positioning module 11. The positioning module 11 provides the displacement to the processing module 10.
In this embodiment, the processing module 10 includes a gain calculating unit 101 and a mode selecting unit 102.
In the present embodiment, the gain calculating unit 101 calculates respective gain values corresponding to the audio signals in the plurality of directions according to the displacement provided by the positioning module 11.
In this embodiment, the mode selection unit 102 selects one of a plurality of gain adjustment modes according to a mode selection signal.
The volume adjustment module 13 is electrically connected to the processing module 10. The volume adjustment module 13 correspondingly adjusts the volume of the directional audio signals according to the respective gain values of the directional audio signals provided by the gain calculation unit 101 of the processing module 10.
The sound channel conversion module 14 is electrically connected to the volume adjustment module 13, and is configured to convert the audio signals in multiple directions into a playing audio signal after the volume adjustment. In the present embodiment, the playback audio signal is an audio signal that conforms to the number of channels set by the head mounted playback apparatus 3. That is, the head-mounted playing apparatus 3 may be configured with a dual-channel playing module or a multi-channel playing module, and the channel converting module 14 provides the playing audio signals with the same number of channels according to the number of channels of the head-mounted playing apparatus 3.
The dynamic range compression module 15 is electrically connected to the sound channel conversion module 14 to determine whether a volume value of the played audio signal is greater than a threshold value, so as to determine whether to perform volume compression. If the volume value of the played audio signal is greater than the threshold value, the volume compression is performed on the played audio signal.
In the present embodiment, the audio signal is played by the head-mounted playing device 3.
The positioning module 11 can be a joystick device, a button device, a touch device, or a position sensing device, which can be designed according to actual requirements, and is not limited in the present invention.
In the present embodiment, the positioning module 11 includes a sensing unit 111 and a timing unit 112. The sensing unit 111 of the positioning module 11 is configured to detect that a movement variation of the positioning module 11 within a predetermined time does not exceed a predetermined distance, and then determine the positioning point, and the timing unit 112 is configured to detect the predetermined time.
In the present embodiment, the sensing unit 111 can be a three-dimensional acceleration sensor, a gyroscope sensor, and any sensor capable of detecting head movement, such as a lens, an infrared sensor, an ultrasonic sensor, etc., which can be designed and adjusted according to actual requirements, and is not limited in the present invention.
In addition, in the present embodiment, the mode selection unit 102 includes a plurality of gain adjustment modes, wherein the plurality of gain adjustment modes includes a first mode and a second mode.
The first mode is that the gain calculating unit 101 calculates the respective gain values of the audio signals in the plurality of directions only according to the displacement calculated by the positioning module 11.
In the second mode, the gain calculating unit 101 calculates respective gain values of the plurality of directional audio signals according to the displacement calculated by the positioning module 11, and further analyzes whether each directional audio signal contains important contents for the user, such as gunshot, talk, etc., to determine whether to increase the gain value. That is, in the second mode, the specific audio content signal in the audio signals in the plurality of directions is analyzed and selected, and then the gain value is adjusted. That is, the second mode is that the gain calculating unit 101 calculates respective gain values of the plurality of directional audio signals and respective gain values of a specific audio content signal in the plurality of directional audio signals according to the displacement of the positioning module 11.
In the present embodiment, the respective gain values corresponding to the plurality of directional audio signals are inversely proportional to the respective distance values of the plurality of directional audio signals. That is, the more distant the sound is, the smaller. When the user is at an arbitrary position of the listening scene, he can hear the directional audio signals of the surrounding environment at the position without adjusting the gain value, and the user can hear the directional audio signals after adjusting the gain value as long as the user slightly shifts his head to obtain the displacement amount mentioned earlier. That is, the user can hear the audio contents of the audio signals in multiple directions without adjusting the gain value provided by the audio providing device 2 at any listening reference position of the listening scene, and the user can clearly distinguish the audio contents of the audio signals in all directions in the listening scene by listening to the audio signals in all directions after adjusting the gain value only by slightly shifting his/her head, tilting his/her body or using the joystick to obtain a displacement amount without adjusting the listening reference position in the listening scene. In this embodiment, the user only needs to use the body motion to obtain the displacement. The body movements of the user include head-leaning, body-tilting, flapping, pressing, body-turning, head-turning, etc., and the design of the positioning module 11 is matched, so that the user can not move the position in the listening scene, and the audio contents of the audio signals in multiple directions of the surrounding environment can be clearly distinguished.
In other embodiments, the respective gain values corresponding to the plurality of directional signals are inversely proportional to the square of the respective distance values of the plurality of directional audio signals. That is, sounds at greater distances will sound less loudly than sounds at closer distances and will be louder than sounds at volumes inversely proportional to the distance values.
[ second embodiment ]
Referring to fig. 3 and fig. 4, fig. 3 is a flowchart of an audio adjusting method according to an embodiment of the invention. Fig. 4 is a schematic diagram illustrating a user identifying a first-direction audio signal and a second-direction audio signal by using an audio adjusting method according to an embodiment of the invention.
In the present embodiment, an audio adjusting method is provided, which is suitable for the audio adjusting system 900 described above. In the present embodiment, the structure and function of the audio adjusting system 900 are the same as those of the previous embodiments, and are not described herein again.
The audio adjusting method of the embodiment comprises the following steps:
receiving a plurality of directional audio signals (step S101);
calculating a displacement amount by a positioning module (step S102);
calculating a plurality of gain values corresponding to the displacement amount by a processing module (step S103);
adjusting respective volume levels of the plurality of directional audio signals according to the plurality of gain values (step S104);
converting the plurality of directional audio signals into a playing audio signal (step S105); and
the playing audio signal is played through a head-mounted playing device (step S106).
Further, in step S104, the following steps are further included:
selecting one of a plurality of gain modes, and adjusting the respective volume of the directional audio signal according to the gain values and the gain mode.
In step S101, the audio adjusting apparatus 1 is communicatively connected to the audio providing apparatus 2 to receive the plurality of directional audio signals provided by the audio providing apparatus 2.
In step S102, the positioning module 11 first calculates a displacement. The displacement is determined according to the moving distance of the positioning module 11.
In the present embodiment, the head-mounted playing device 3 is a headphone. The audio adjusting device 1 is disposed on the head-mounted playing device 3. The user can move the head, that is, move the head-mounted playing device 3 (headset), so that the positioning module 11 of the audio adjusting device 1 generates a displacement D1. For example: the positioning module 11 records the start point (positioning point P1) and the end point of the displacement D1 to determine the direction and distance of the displacement D1. After the displacement D1 is calculated, the positioning module 11 provides the displacement D1 to the processing module 10. In this embodiment, the positioning point P1 can be designed according to actual requirements, and is not limited in the present invention.
In the present embodiment, the positioning module 11 includes a sensing unit 111 and a timing unit 112. The sensing unit 111 of the positioning module 11 is used for detecting the displacement of the positioning module 11, and the timing unit 112 is used for detecting a predetermined time. In this embodiment, the predetermined time may be adjusted and designed according to actual requirements, and is not limited in the present invention.
In this embodiment, the positioning module 11 can be a joystick device, a button device, a touch device, or a position sensing device, which can be designed and adjusted according to actual requirements, and is not limited in the present invention.
In steps S103 and S104, the gain calculating unit 101 of the processing module 10 calculates respective gain values corresponding to the audio signals in the plurality of directions according to the displacement provided by the positioning module 11. In the embodiment, the first direction audio signal AS1 and the second direction audio signal AS2 are audio signals that can be received by the anchor point P1, and the user can move to the anchor point P1' by a small-amplitude movement to generate the displacement amount D1, and by the audio adjusting apparatus 2 according to the embodiment of the present invention, the gain values of the first direction audio signal AS1 and the second direction audio signal AS2 are adjusted to adjust the volume, so AS to further identify the audio contents of the first direction audio signal AS1 and the second direction audio signal AS 2.
The volume adjustment module 13 is used for correspondingly adjusting the respective volume levels of the audio signals in the plurality of directions according to the gain values of the gain calculation unit 101 of the processing module 10.
In the present embodiment, the respective gain values of the directional audio signals are inversely proportional to the respective distance values of the directional audio signals. That is, the more distant the sound is, the smaller.
In other embodiments, the respective gain values of the plurality of directional audio signals are inversely proportional to the square of the respective distance values. That is, sounds at greater distances will sound less loudly than sounds at closer distances and will be louder than sounds at volumes inversely proportional to the distance values.
In addition, in step S104, the volume adjusting module 13 may further adjust the respective volume levels of the audio signals in the plurality of directions according to the gain adjusting mode selected by the mode selecting unit 102. That is, the volume adjusting module 13 may adjust the volume of the audio signals in the respective directions only according to the gain values of the gain calculating unit 101, or may adjust the volume of the audio signals in the respective directions according to the gain values of the gain calculating unit 101 and the gain adjusting mode selected by the mode selecting unit 102.
In this embodiment, the mode selection unit 102 selects one of a plurality of gain adjustment modes according to a mode selection signal.
The mode selection unit 102 includes a plurality of gain adjustment modes, wherein the plurality of gain adjustment modes includes a first mode and a second mode.
The first mode is that the gain calculating unit 101 adjusts the volume of each directional audio signal according to a plurality of gain values. That is, the volume of each audio signal around the anchor point is adjusted.
In the second mode, the gain calculating unit 101 calculates respective gain values of the plurality of directional audio signals according to the displacement calculated by the positioning module 11, and further analyzes whether each directional audio signal contains important contents for the user, such as gunshot, talk, etc., to determine whether to increase the gain value. That is, in the second mode, the specific audio content signal in the audio signals in the plurality of directions is analyzed and selected, and then the gain value is adjusted. That is, the second mode is that the gain calculating unit 101 calculates respective gain values of the plurality of directional audio signals and respective gain values of a specific audio content signal in the plurality of directional audio signals according to the displacement of the positioning module 11.
The positioning module 11 can be a joystick device, a button device, a touch device, or a position sensing device, which can be designed according to actual requirements, and is not limited in the present invention.
In the present embodiment, the positioning module 11 includes a sensing unit 111 and a timing unit 112. The sensing unit 111 of the positioning module 11 is configured to detect that a movement variation of the positioning module 11 within a predetermined time does not exceed a predetermined distance, and then determine the positioning point, and the timing unit 112 is configured to detect the predetermined time. In this embodiment, the predetermined time may be adjusted and designed according to actual requirements, and is not limited in the present invention.
In the present embodiment, the sensing unit 111 can be a three-dimensional acceleration sensor, a gyroscope sensor, and any sensor capable of detecting head movement, such as a lens, an infrared sensor, an ultrasonic sensor, etc., which can be designed and adjusted according to actual requirements, and is not limited in the present invention.
In step S105 and step S106, the channel conversion module 14 is configured to convert the audio signals with the adjusted volume into a playback audio signal. In the present embodiment, the playback audio signal is an audio signal that conforms to the number of channels set by the head mounted playback apparatus 3. That is, the head-mounted playing apparatus 3 may be configured with a dual-channel playing module or a multi-channel playing module, and the channel converting module 14 provides the playing audio signals with the same number of channels according to the number of channels of the head-mounted playing apparatus 3. The dynamic range compression module 15 is electrically connected to the sound channel conversion module 14 to determine whether a volume value of the played audio signal is greater than a threshold value, so as to determine whether to perform volume compression. If the volume value of the played audio signal is greater than the threshold value, the volume compression is performed on the played audio signal.
Finally, the superimposed audio signal is played by the head-mounted playing device 3.
The audio adjusting apparatus 1 receives a plurality of directional audio signals of the audio providing apparatus 2. The plurality of directional audio signals provided by the audio providing apparatus 2 are audio contents provided according to a listening reference position in a listening environment. For example, when the audio providing apparatus 2 is a virtual reality apparatus, the audio providing apparatus 2 provides audio contents of each direction of the audio signal in each direction with the gain value not adjusted in the surrounding environment (listening scene) according to the location (listening reference location) of the user. When the user walks to different positions in the scene, the user can hear the audio signals in all directions of the audio signals in different positions without adjusting the gain values.
In this embodiment, in addition to the user being at an arbitrary position of the listening scene, he can hear the directional audio signals of the surrounding environment at the position without adjusting the gain value, and the user can also obtain the displacement amount mentioned above and hear the directional audio signals after adjusting the gain value as long as the user slightly shifts his head. That is, the user can hear the audio contents of the audio signals in the plurality of directions without adjusting the gain value provided by the audio providing apparatus 2 at any one of the listening reference positions of the listening scene, and the user can clearly distinguish the audio contents of the audio signals in the plurality of directions in the listening scene by listening to the audio signals in the plurality of directions with the gain value adjusted by only slightly tilting the head, tilting the body, or using the joystick to obtain a displacement amount without adjusting the listening reference position in the listening scene. In addition, in the present embodiment, the user can obtain the displacement amount only by using the body motion. The body movements of the user include head-leaning, body-tilting, flapping, pressing, body-turning, head-turning, etc., and the design of the positioning module 11 is matched, so that the user can not move the position in the listening scene, and the audio contents of the audio signals in multiple directions of the surrounding environment can be clearly distinguished.
[ advantageous effects of the embodiments ]
The audio adjusting device is used for generating displacement to adjust the volume of the audio signals in different directions, so that a user can further identify the audio content through the audio adjusting device, and the interactive audio experience of the user can be effectively increased.
The above-mentioned contents are only the preferred and feasible embodiments of the present invention, and are not limited to the claims of the present invention, so that all the technical changes which are made by using the contents of the description of the present invention and the drawings are included in the claims of the present invention.