CN101916569A - Method and device for displaying sound - Google Patents
Method and device for displaying sound Download PDFInfo
- Publication number
- CN101916569A CN101916569A CN2010102444634A CN201010244463A CN101916569A CN 101916569 A CN101916569 A CN 101916569A CN 2010102444634 A CN2010102444634 A CN 2010102444634A CN 201010244463 A CN201010244463 A CN 201010244463A CN 101916569 A CN101916569 A CN 101916569A
- Authority
- CN
- China
- Prior art keywords
- sound
- array
- sound signal
- frequency
- microphone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The invention provides a method and a device for displaying sound. The method comprises the following steps of: collecting multipath audio signals by a microphone array and recording the position information of a microphone corresponding to each path of audio signal; converting the sound frequency of each path of audio signal into color frequency and converting the sound strength of each path of audio signal into a gray value so that each path of audio signal correspondingly generates a pixel point containing the position information, the color frequency and the gray value; and displaying a pixel point array which is correspondingly generated by multipath audio signals on a display screen. The invention can solve the technical problems of failing to image the sound and research sound distribution by using images in the prior art.
Description
Technical field
The present invention relates to study sound method and equipment, particularly relate to a kind of demonstration sound method and device.
Background technology
Human sensation to sound, come from ear fully, but ear is not a very sensitive organ, the scope of the sound signal that it can be heard is that 20HZ is to 20KHZ, occurring in nature has the infrasonic wave (all can produce infrasonic wave in spontaneous phenomenon that contained energy such as for example, volcanic explosion, earthquake, tsunami, typhoon are huge and the nuclear blast) that much is lower than 20HZ and can not be perceiveed by people's ear the ultrasound wave that is higher than 20KHZ.And the directivity of people's ear is also very poor, can only judge the roughly source of sound, can not carry out very accurate in locating.In addition, people's ear only can be perceiveed the sound of position, can not perception distribute than the sound in the large space, for example, and the acoustics of a music hall of research, just can there be a general understanding every nook and cranny that needs the tester to go around music hall sometimes.
In addition, come perceives sound in the mode of the sense of hearing, that gives the people feels it is temporary transient, fuzzy, aftertaste after hearing out and feel that discrepancy is arranged when just listening, even record, also be one time one time tin, one time one time aftertaste can not form lasting impression.
The sonograms of prior art and medical ultrasound diagnosis imaging technique are image and the position that forms testee according to echo mostly, and it is not the imaging at sound itself, and its discomfort is used for studying the distribution and the feature of sound itself.
Therefore, need a kind of method and apparatus of studying the space distribution of sound intuitively,
Summary of the invention
The purpose of this invention is to provide a kind of demonstration sound method and device, solving prior art can not carry out imaging at sound itself, can not study the technical matters of the distribution of sound itself with image.
To achieve these goals, on the one hand, provide a kind of demonstration sound method, having comprised:
Gather multipath audio signal by microphone array, and write down the positional information of the microphone of every road sound signal correspondence;
The sound frequency of every road sound signal is converted to the color frequency, the intensity of sound of every road sound signal is converted to gray-scale value, generate a pixel that comprises positional information, color frequency and gray-scale value thereby every road sound signal is corresponding;
On display screen, show the corresponding pixel array that generates of described multipath audio signal.
Preferably, in the above-mentioned method, also comprise: the position and the intensity of the row portion information calculations source of sound by described picture element array.
Preferably, in the above-mentioned method, also comprise:, obtain the sound signal of different spaces by moving described microphone array.
Preferably, in the above-mentioned method, the solid array that described microphone array is classified planar array as or formed for the multilayer planar array, described sound signal comprises ultrasound wave and infrasonic wave.
To achieve these goals, the embodiment of the invention also provides a kind of device that shows sound, comprising:
Microphone array;
Sampling module is used for: gather the multipath audio signal that described microphone array produces, and write down the positional information of the microphone of every road sound signal correspondence;
Data processing module, be used for: the sound frequency of every road sound signal is converted to the color frequency, the intensity of sound of every road sound signal is converted to gray-scale value, thus pixel that comprises positional information, color frequency and gray-scale value of the corresponding generation of every road sound signal;
Display screen is used for: show the corresponding pixel array that generates of described multipath audio signal.
Preferably, in the above-mentioned device, also comprise: central processing unit is used for: the position and the intensity of the row portion information calculations source of sound by described picture element array.
Preferably, in the above-mentioned device, also comprise: displacement module is used for moving described microphone array.
Preferably, in the above-mentioned device, the solid array that described microphone array is classified planar array as or formed for the multilayer planar array, described microphone can be gathered ultrasound wave and infrasonic wave.
There is following technique effect at least in the present invention:
1) the invention provides a kind of demonstration sound method, the voice signal that distributes in the space can be converted to picture signal, can carry out imaging at sound itself, thereby can take pictures or generate video sound, therefore the embodiment of the invention provides a kind of new research angle and method for expressing to sound, and enable voice can not only be heard can also be as photo seeing of visual pattern more.
2) embodiment of the invention is associated sound frequency and color of image, the pairing light frequency of the high more color of sound frequency is also high more, intensity of sound big more the gray scale of corresponding photo also big more, make image can show the feature of sound self accurately, allow the people come into plain view.
3) microphone among the present invention can be gathered ultrasound wave and infrasonic wave, thereby can show the sound that people's ear can not be heard.
4) the described microphone array solid array classifying planar array as or form for the multilayer planar array can move or rotate, and can show the sound of different spaces.
Description of drawings
The flow chart of steps of the method that Fig. 1 provides for the embodiment of the invention;
The structural drawing of the device that Fig. 2 provides for the embodiment of the invention.
Embodiment
For the purpose, technical scheme and the advantage that make the embodiment of the invention is clearer, specific embodiment is described in detail below in conjunction with accompanying drawing.
The flow chart of steps of the method that Fig. 1 provides for the embodiment of the invention as shown in Figure 1, shows that sound method comprises:
Wherein, can also comprise: the position and the intensity of the row portion information calculations source of sound by described picture element array; By moving described microphone array, obtain the sound signal of different spaces.
As seen, the inventive method embodiment is to gather parameters such as the intensity of sound on a plane and frequency by the dot matrix that small microphone is formed, by generating piece image after the digital processing.The light and shade of image and color can reflect information such as the power, frequency, sound source position of sound.
Audio frequency can adopt the mode of linear function to the method for the conversion of video, H=kh for example, and wherein H is the color frequency, and h is a sound frequency, and k is adjustable coefficient.Regulate k and be for the easy frequency range of identification of the color frequency adjustment to changing out.
If the difference of the sound signal that each microphone is gathered is very little, also can adopt quadratic function or more the function of high order amplify difference, H=ah for example
2+ bh+c, a, b, c are the default coefficient that experience obtains that passes through.
In like manner, the intensity of sound of every road sound signal is converted to the mode of gray-scale value, also can by linear function or repeatedly the mode of function even logarithm change.
After the conversion, each pixel has shown piece image on display screen, and this image can present the sound difference of each location point by the mode of vision.If carry out continual real-time collection, will present a dynamic video image on the display screen.
Picture element in the present embodiment, when the microphone number that comprises in microphone matrix is abundant (for example 800 * 600), it can be exactly the true picture element in the screen, if during the microphone number deficiency that comprises in the microphone matrix (for example 30 * 20), in order to make image enough big, this picture element can be enlarged into the viewing area of a fritter.
The solid array that described microphone array is classified planar array as or formed for the multilayer planar array, described sound signal can comprise ultrasound wave and infrasonic wave, thereby can study the sound that people's ear can not be heard.
The structural drawing of the device that Fig. 2 provides for the embodiment of the invention.As shown in Figure 2, the device of demonstration sound comprises:
Microphone array 210;
Sampling module 220 is used for: gather the multipath audio signal that described microphone array produces, and write down the positional information of the microphone of every road sound signal correspondence;
Data processing module 230, be used for: the sound frequency of every road sound signal is converted to the color frequency, the intensity of sound of every road sound signal is converted to gray-scale value, thus pixel that comprises positional information, color frequency and gray-scale value of the corresponding generation of every road sound signal;
Display screen 240 is used for: show the corresponding pixel array that generates of described multipath audio signal.
Can also comprise:
Central processor CPU 250 is used for: the position and the intensity of the row portion information calculations source of sound by described picture element array.Calculation Method can be that direction or the like the mature technology that successively decreases by intensity of sound calculates, and does not repeat them here.
Can also comprise: displacement module be used for moving described microphone array, thereby the sound that can measure different spaces distributes.At this moment, microphone array 210 and sampling module 220 are placed on the scene, and the data of its sampling can send to data processing module 230 by Data Transmission Controlling module 260.
Further comprise in the sampling module 220: sound frequency sampling module and intensity of sound sampling module.
Wherein, data processing module 230 carries out the mode of audio frequency to the conversion of video, can adopt the mode of linear function, H=kh for example, and wherein H is the color frequency, and h is a sound frequency, and k is adjustable coefficient.Regulate k and be for the easy frequency range of identification of the color frequency adjustment to changing out.If the difference of the sound signal that each microphone is gathered is very little, also can adopt quadratic function or more the function of high order amplify difference, H=ah for example
2+ bh+c, a, b, c are the default coefficient that experience obtains that passes through.In like manner, the intensity of sound of every road sound signal is converted to the mode of gray-scale value, also can by linear function or repeatedly the mode of function even logarithm change.
The solid array that described microphone array is classified planar array as or formed for the multilayer planar array, described microphone can be gathered ultrasound wave and infrasonic wave.
Microphone array of the present invention, each microphone is as a pixel, gather the frequency and the sound intensity data of the received sound of each microphone by frequency sampling module and the scan round of sound intensity sampling module, by the Data Transmission Controlling module data are sent to data processing module by data bus again, finally the sound frequency that is received and intensity are generated a width of cloth picture and show by data processing algorithm.Can handle these pictures in this way in real time and also be presented at continuously on the LCD, so just can show scenery as digital camera, be some information that this image is a sound.The embodiment of the invention is associated sound frequency and photo color, and the pairing light frequency of the high more color of sound frequency is also high more, intensity of sound big more the gray scale of corresponding photo also big more, can also judge the position of sound source according to the distribution of gray scale.The resolution of microphone array has determined the quality of sound photo, the performance of the high more photo of resolution careful more.
As from the foregoing, the embodiment of the invention has following advantage:
1) the invention provides a kind of demonstration sound method, the voice signal that distributes in the space can be converted to picture signal, can carry out imaging at sound itself, thereby can take pictures or generate video sound, therefore the embodiment of the invention provides a kind of new research angle and method for expressing to sound, and enable voice can not only be heard can also be as photo seeing of visual pattern more.
2) embodiment of the invention is associated sound frequency and color of image, the pairing light frequency of the high more color of sound frequency is also high more, intensity of sound big more the gray scale of corresponding photo also big more, make image can show the feature of sound self accurately, allow the people come into plain view.
3) microphone among the present invention can be gathered ultrasound wave and infrasonic wave, thereby can show the sound that people's ear can not be heard.
4) the described microphone array solid array classifying planar array as or form for the multilayer planar array can move or rotate, and can show the sound of different spaces.
The above only is a preferred implementation of the present invention; should be pointed out that for those skilled in the art, under the prerequisite that does not break away from the principle of the invention; can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.
Claims (8)
1. one kind shows sound method, it is characterized in that, comprising:
Gather multipath audio signal by microphone array, and write down the positional information of the microphone of every road sound signal correspondence;
The sound frequency of every road sound signal is converted to the color frequency, the intensity of sound of every road sound signal is converted to gray-scale value, generate a pixel that comprises positional information, color frequency and gray-scale value thereby every road sound signal is corresponding;
On display screen, show the corresponding pixel array that generates of described multipath audio signal.
2. method according to claim 1 is characterized in that, also comprises:
The position and the intensity of the row portion information calculations source of sound by described picture element array.
3. method according to claim 1 is characterized in that, also comprises:
By moving described microphone array, obtain the sound signal of different spaces.
4. method according to claim 3 is characterized in that, the solid array that described microphone array is classified planar array as or formed for the multilayer planar array, and described sound signal comprises ultrasound wave and infrasonic wave.
5. a device that shows sound is characterized in that, comprising:
Microphone array;
Sampling module is used for: gather the multipath audio signal that described microphone array produces, and write down the positional information of the microphone of every road sound signal correspondence;
Data processing module, be used for: the sound frequency of every road sound signal is converted to the color frequency, the intensity of sound of every road sound signal is converted to gray-scale value, thus pixel that comprises positional information, color frequency and gray-scale value of the corresponding generation of every road sound signal;
Display screen is used for: show the corresponding pixel array that generates of described multipath audio signal.
6. device according to claim 5 is characterized in that, also comprises:
Central processing unit is used for: the position and the intensity of the row portion information calculations source of sound by described picture element array.
7. device according to claim 5 is characterized in that, also comprises:
Displacement module is used for moving described microphone array.
8. device according to claim 7 is characterized in that, the solid array that described microphone array is classified planar array as or formed for the multilayer planar array, and described microphone can be gathered ultrasound wave and infrasonic wave.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010244463.4A CN101916569B (en) | 2010-08-03 | 2010-08-03 | Method and device for displaying sound |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010244463.4A CN101916569B (en) | 2010-08-03 | 2010-08-03 | Method and device for displaying sound |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101916569A true CN101916569A (en) | 2010-12-15 |
| CN101916569B CN101916569B (en) | 2015-05-06 |
Family
ID=43324061
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010244463.4A Expired - Fee Related CN101916569B (en) | 2010-08-03 | 2010-08-03 | Method and device for displaying sound |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101916569B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013178129A1 (en) * | 2012-09-03 | 2013-12-05 | 中兴通讯股份有限公司 | Voice scrawling implementation method, device and terminal |
| CN103946733A (en) * | 2011-11-14 | 2014-07-23 | 谷歌公司 | Displaying sound indications on a wearable computing system |
| CN104464741A (en) * | 2014-12-29 | 2015-03-25 | 中山大学花都产业科技研究院 | Method and system for converting audio frequency signals into vision color information |
| CN106162418A (en) * | 2015-04-22 | 2016-11-23 | 环旭电子股份有限公司 | Sound receiving method and sound receiving device |
| CN106373579A (en) * | 2016-08-31 | 2017-02-01 | 天脉聚源（北京）科技有限公司 | Method and device for displaying audio information |
| CN106485991A (en) * | 2016-12-23 | 2017-03-08 | 天津城建大学 | Sound three elements demonstrator |
| CN106571149A (en) * | 2015-10-07 | 2017-04-19 | 三星电子株式会社 | Electronic device and music content visualization method thereof |
| CN109524022A (en) * | 2018-11-16 | 2019-03-26 | 方雯晖 | Vision, the sense of hearing, smell mutually convert system and Music Visualization application |
| CN112857560A (en) * | 2021-02-06 | 2021-05-28 | 河海大学 | Acoustic imaging method based on sound frequency |
| CN114018499A (en) * | 2021-09-28 | 2022-02-08 | 雅砻江流域水电开发有限公司 | Noise sound source imaging method for hydropower station waterwheel room |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1748221A (en) * | 2003-03-10 | 2006-03-15 | 有限会社Adeu.Nek | Color dot code system |
| CN1885976A (en) * | 2005-06-24 | 2006-12-27 | 英华达(上海)电子有限公司 | Method for making sound graphic display and playing on mobile phone display screen |
| JP2007086365A (en) * | 2005-09-21 | 2007-04-05 | Eiko Denshi:Kk | ILLUMINATION DEVICE, ITS DRIVE CIRCUIT, ILLUMINATION METHOD, AND ILLUMINATION DEVICE DRIVE METHOD |
| US20080183751A1 (en) * | 2007-01-25 | 2008-07-31 | Cazier Robert P | Applying visual effect to image data based on audio data |
| CN101488346A (en) * | 2009-02-24 | 2009-07-22 | 深圳先进技术研究院 | Speech visualization system and speech visualization method |
-
2010
- 2010-08-03 CN CN201010244463.4A patent/CN101916569B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1748221A (en) * | 2003-03-10 | 2006-03-15 | 有限会社Adeu.Nek | Color dot code system |
| CN1885976A (en) * | 2005-06-24 | 2006-12-27 | 英华达(上海)电子有限公司 | Method for making sound graphic display and playing on mobile phone display screen |
| JP2007086365A (en) * | 2005-09-21 | 2007-04-05 | Eiko Denshi:Kk | ILLUMINATION DEVICE, ITS DRIVE CIRCUIT, ILLUMINATION METHOD, AND ILLUMINATION DEVICE DRIVE METHOD |
| US20080183751A1 (en) * | 2007-01-25 | 2008-07-31 | Cazier Robert P | Applying visual effect to image data based on audio data |
| CN101488346A (en) * | 2009-02-24 | 2009-07-22 | 深圳先进技术研究院 | Speech visualization system and speech visualization method |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103946733A (en) * | 2011-11-14 | 2014-07-23 | 谷歌公司 | Displaying sound indications on a wearable computing system |
| US9838814B2 (en) * | 2011-11-14 | 2017-12-05 | Google Llc | Displaying sound indications on a wearable computing system |
| WO2013178129A1 (en) * | 2012-09-03 | 2013-12-05 | 中兴通讯股份有限公司 | Voice scrawling implementation method, device and terminal |
| CN103685683A (en) * | 2012-09-03 | 2014-03-26 | 中兴通讯股份有限公司 | Voice scrawling implementation method, device and terminal |
| CN103685683B (en) * | 2012-09-03 | 2015-08-12 | 中兴通讯股份有限公司 | Implementation method, device and terminal that voice are scribbled |
| CN104464741A (en) * | 2014-12-29 | 2015-03-25 | 中山大学花都产业科技研究院 | Method and system for converting audio frequency signals into vision color information |
| CN104464741B (en) * | 2014-12-29 | 2018-04-06 | 中山大学花都产业科技研究院 | A kind of audio signal turns the method and system of visual color information |
| CN106162418A (en) * | 2015-04-22 | 2016-11-23 | 环旭电子股份有限公司 | Sound receiving method and sound receiving device |
| CN106571149A (en) * | 2015-10-07 | 2017-04-19 | 三星电子株式会社 | Electronic device and music content visualization method thereof |
| US11812232B2 (en) | 2015-10-07 | 2023-11-07 | Samsung Electronics Co., Ltd. | Electronic device and music visualization method thereof |
| US12363491B2 (en) | 2015-10-07 | 2025-07-15 | Samsung Electronics Co., Ltd. | Electronic device and music visualization method thereof |
| CN106373579A (en) * | 2016-08-31 | 2017-02-01 | 天脉聚源（北京）科技有限公司 | Method and device for displaying audio information |
| CN106485991A (en) * | 2016-12-23 | 2017-03-08 | 天津城建大学 | Sound three elements demonstrator |
| CN109524022A (en) * | 2018-11-16 | 2019-03-26 | 方雯晖 | Vision, the sense of hearing, smell mutually convert system and Music Visualization application |
| CN112857560A (en) * | 2021-02-06 | 2021-05-28 | 河海大学 | Acoustic imaging method based on sound frequency |
| CN114018499A (en) * | 2021-09-28 | 2022-02-08 | 雅砻江流域水电开发有限公司 | Noise sound source imaging method for hydropower station waterwheel room |
| CN114018499B (en) * | 2021-09-28 | 2022-09-09 | 雅砻江流域水电开发有限公司 | Hydropower station waterwheel chamber noise sound source imaging method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101916569B (en) | 2015-05-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101916569B (en) | Method and device for displaying sound | |
| AU2022201783B2 (en) | Technique for directing audio in augmented reality system | |
| AU2017247070B2 (en) | Three-dimensional, 360-degree virtual reality camera exposure control | |
| JP6771548B2 (en) | A portable system that allows the blind or visually impaired to interpret the surrounding environment by voice or touch. | |
| US10547961B2 (en) | Signal processing apparatus, signal processing method, and storage medium | |
| US20220369044A1 (en) | Technique for directing audio in augmented reality system | |
| CN104113747A (en) | Image acquisition and pseudo 3D display system based on binocular vision | |
| JP7317119B2 (en) | Information processing device, information processing method, and program | |
| US10979733B1 (en) | Systems and methods for measuring image quality based on an image quality metric | |
| JP2018157314A (en) | Information processing system, information processing method and program | |
| EP3229070B1 (en) | Three-dimensional, 360-degree virtual reality camera exposure control | |
| JP6427300B2 (en) | All-sky camera camera image display system, method and program | |
| JP7463907B2 (en) | Noise source identification support system and noise source identification support method | |
| KR100781332B1 (en) | Underwater Imaging Device and Image Display Method | |
| Iyer et al. | Response techniques and auditory localization accuracy | |
| JP2018074437A (en) | Signal processing device, signal processing system, signal processing method, and program | |
| Wersényi et al. | On the direct measurement and interactive 3D rendering of dummy-head directional characteristics using polar coordinates |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150506 Termination date: 20170803 |