CN109900354A - A kind of whistle sound detection equipment, whistle voice recognition localization method and system - Google Patents
A kind of whistle sound detection equipment, whistle voice recognition localization method and system Download PDFInfo
- Publication number
- CN109900354A CN109900354A CN201910133820.0A CN201910133820A CN109900354A CN 109900354 A CN109900354 A CN 109900354A CN 201910133820 A CN201910133820 A CN 201910133820A CN 109900354 A CN109900354 A CN 109900354A
- Authority
- CN
- China
- Prior art keywords
- sound
- whistle
- information
- environmental
- blast
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
Abstract
Present disclose provides a kind of whistle sound detection equipment, whistle voice recognition localization method and systems, it include: at least three support plates, multiple voice detectors, control chip and more than two video cameras, wherein, multiple voice detectors are provided in each support plate, each voice detector is electrically connected with the control chip；Angle between the two neighboring support plate is identical.Video camera is captured for different directions, using 4 video cameras, can be captured to 4 directions of crossroad.For solving the problems, such as that coverage area is narrow in existing whistle candid photograph technology, sound positional accuracy is low.
Description
Technical Field
The disclosure relates to the technical field of information, in particular to a whistle sound detection device, a whistle sound identification and positioning method and a whistle sound identification and positioning system.
Background
With the increase of the number of urban motor vehicles, the whistle of the motor vehicles becomes a main source of urban environmental noise, and a banning zone is arranged in a specific area by a traffic control department, but the lawless vehicles are difficult to be subjected to evidence obtaining and punishment due to the evidence obtaining difficulty, so that the banning zone is in the same nominal form.
In the prior art, a camera arranged at an intersection is used for shooting an image of a vehicle, license plate information in the image is extracted, the vehicle with a whistle is finally determined by combining a sound source positioning terminal and the license plate information, and sampling evidence is stored. However, when positioning a whistling vehicle, the conventional sound positioning terminal mostly adopts a planar array structure, can only aim at a single vehicle coming direction, causes a snapshot coverage area to be not high, and can only realize two-dimensional positioning.
Disclosure of Invention
In view of the above, an object of the present disclosure is to provide a whistle sound detection device, a whistle sound recognition and positioning method, and a sound pickup system, which are used to solve the problem in the prior art that coverage for capturing a whistle vehicle is small.
In a first aspect, an embodiment of the present application provides a whistling sound detection apparatus, including: at least three support plates, a plurality of sound detectors, a control chip, wherein,
a plurality of sound detectors are arranged in each supporting plate, and each sound detector is electrically connected with the control chip;
the included angle between two adjacent supporting plates is the same.
Alternatively, the number of sound detectors provided in each of the support plates is the same.
Optionally, the plurality of sound detectors in each of the support plates are arranged in an array.
Optionally, the support plate is quadrilateral in shape.
In a second aspect, the present application provides a whistle sound identification and location method, which is applied to the whistle sound detection device as described above, and includes:
acquiring environmental sound information of the whistling sound detection equipment;
determining whether there is a whistle sound in the ambient sound information;
if the environmental sound information has a whistle sound, determining the direction of a sound source generating the whistle sound;
and sending the sound source direction and the environmental sound information to computer equipment so that the computer equipment acquires an environmental image for generating the whistle sound according to the sound source direction.
Optionally, the determining whether the environmental sound information has a whistle sound includes:
comparing the environmental sound information with the set sound information;
if the environmental sound information is consistent with the set sound information, determining that the environmental sound information has a whistle sound;
and if the ratio of the environmental sound information to the set sound information is consistent, determining that the environmental sound information does not have a whistle sound.
Optionally, the determining a direction of a sound source generating the blast sound includes:
and determining the position information of the article generating the whistle sound according to the position information of the sound detector in the whistle sound detection device.
Optionally, the determining the position information of the article generating the whistle sound according to the position information of the sound detector in the whistle sound detecting device includes:
and processing the position information of the sound detection equipment in the whistle sound detection equipment by utilizing a beam forming or arrival time difference method to obtain the position information of the article generating the whistle sound.
In a third aspect, a blast sound recognition positioning system, the system comprising: a whistle sound detection device for performing the method as described above and a computer device to which the whistle sound detection device is communicatively connected;
the whistle sound detection device is used for acquiring environmental sound information of the whistle sound detection device, determining whether the environmental sound information has whistle sound, if the environmental sound information has the whistle sound, determining position information of an article corresponding to the whistle sound, and sending the position information and the whistle sound to computer equipment;
and the computer equipment is used for acquiring the environment image which is consistent with the position information and generates the whistle sound.
Optionally, the computer device is further configured to:
and marking the article in the environment image according to the position information.
The embodiment of the present disclosure provides a sound check out test set whistles, every be provided with a plurality of sound detector in the backup pad, every sound detector with control chip electricity is connected, adjacent two contained angle between the backup pad is the same. The supporting structure formed by the supporting plates forms a three-dimensional sound detector array, three-dimensional positioning can be carried out, 360-degree omnidirectional positioning of the whole crossroad is realized, and the sound pickup range of the whistle sound detection equipment is increased.
In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
To more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present disclosure and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings may be obtained from the drawings without inventive effort.
Fig. 1 is a schematic structural diagram of a whistling sound detection device provided in an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a first application of a whistling sound detection device according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a whistle sound recognition and positioning system according to an embodiment of the present disclosure;
fig. 4 is a schematic diagram of a second application of a whistling sound detection device according to an embodiment of the present disclosure;
fig. 5 is a schematic diagram of a polar coordinate system provided in an embodiment of the disclosure;
FIG. 6 is a schematic diagram of a device coordinate and camera coordinate system provided by an embodiment of the present disclosure;
fig. 7 is a schematic flow chart illustrating a whistle sound identification and positioning method according to an embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of a computer device according to an embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, not all of the embodiments. The components of the embodiments of the present disclosure, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure, presented in the figures, is not intended to limit the scope of the claimed disclosure, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the disclosure without making creative efforts, shall fall within the protection scope of the disclosure.
The embodiment of the present application provides a sound check out test set whistles, as shown in fig. 1, this sound check out test set whistles includes: at least three support plates 11, a plurality of sound detectors 12, a control chip 13.
A plurality of sound detectors 12 are arranged in each support plate 11, and each sound detector 12 is electrically connected with the control chip 13;
the included angle between two adjacent supporting plates 11 is the same.
The material of the support plate 11 may be metal, plastic, etc., for example, the material of the support plate may be iron, aluminum, etc. The shape of the support plate is generally a quadrilateral, such as a square, a rectangle, a trapezoid, etc., preferably, the shape of the support plate is an isosceles trapezoid, and when the support plate is an isosceles trapezoid, the size of the isosceles trapezoid can be set according to practical situations, which is not limited in this application.
The figure of backup pad can set up according to actual conditions, and preferably, the figure of backup pad is three, and when the figure of backup pad was three and the shape of backup pad was isosceles trapezoid, the long limit of backup pad was connected with the long limit of backup pad, the minor face was connected with the minor face, and like this, three isosceles trapezoid formed the pyramid shape, and the contained angle between the adjacent backup pad is the same, and preferably, the contained angle of adjacent backup pad time is 60 degrees.
The number of the sound detectors arranged in each support plate is the same, the plurality of sound detectors in each support plate are arranged in an array form, in practical application, the number of the sound detectors arranged in each support plate is 32, when the 32 sound detectors are arranged in the array form, a rectangular matrix can be formed, for example, 4 sound detectors in each row are arranged in 8 rows, the intervals among the sound detectors in each row are the same, and the distances among the rows are the same; a circular matrix can also be formed, for example, three rows of circles are arranged, the circle with the smallest radius can be provided with 4 sound detectors, the circle with the second smallest radius is provided with 12 sound detectors, and the circle with the largest radius is provided with 16 sound detectors; an irregular matrix may also be formed, for example, 8 rows are provided, the number of sound detectors provided in each row may be set according to actual conditions, and the distances between the sound detectors may be the same or different, as shown in fig. 2. The sound detector may be a sound pickup, a microphone, or the like, and is preferably a sound pickup.
The embodiment of the present disclosure provides a sound check out test set whistles, every be provided with a plurality of sound detector in the backup pad, every sound detector with control chip electricity is connected, adjacent two contained angle between the backup pad is the same. A plurality of sound detector are fixed to bearing structure through the backup pad formation, can enlarge sound detector's pickup scope for the sound that sound detector acquireed is more clear, and then makes the degree of accuracy of the sound of surely whistling higher.
An embodiment of the present application provides a sound pickup system, as shown in fig. 3, the system includes: a whistle sound detection device 31 and a computer device 32, the whistle sound detection device 31 being configured to perform the whistle sound recognition localization method hereinafter, the whistle sound detection device 31 being communicatively connected to the computer device 32.
The whistle sound detection device 31 is configured to acquire environmental sound information where the whistle sound detection device is located, determine whether there is whistle sound in the environmental sound information, determine a sound source direction generating the whistle sound if there is whistle sound in the environmental sound information, and send the sound source direction and the environmental sound information to a computer device;
the computer device 32 is configured to acquire an environment image that is consistent with the sound source direction and generates the whistle sound.
Here, the whistle sound detection device is generally disposed on a post or a kiosk around the whistle-forbidden area, the whistle-forbidden area is generally an urban traffic intersection (such as a crossroad), and when the whistle-forbidden area is an urban traffic intersection, the whistle sound detection device is generally disposed on a signal lamp post or in a command booth of the traffic intersection, and can be set according to actual conditions; the environment sound information comprises voiceprint information of the environment where the whistle sound detection equipment is located, such as vehicle noise, environment background sound, vehicle whistle sound and the like; considering that the environmental sound information is abnormal when the environmental sound information comprises the vehicle whistle sound; the sound source direction comprises an east direction, a south direction, a west direction and a north direction.
In a specific implementation, each sound detector in the whistle sound detection device 31 acquires the environmental sound information where the whistle sound detection device is located, and determines whether the decibel of the sound included in each environmental sound information is greater than a set sound pressure threshold, the set sound pressure threshold is generally set to 80 decibels, because the decibels of the sounds of different vehicle whistles are close, and the decibel of the sounds of the vehicle whistles is generally greater than 80 decibels, and the sounds lower than the sound pressure threshold may be background sounds in the environment, the background sounds are filtered by setting the sound pressure threshold, so that the data processing amount of post-recognition whistle sounds is reduced, and the recognition efficiency is improved.
Because the number of sound detectors in the whistle sound detection device is large, the decibels of the sounds in the environment sound information acquired by all the sound detectors are not all larger than the set threshold, and there is a possibility that a part of the sound detectors fail to acquire the low sound, the environment sound information larger than the set sound pressure threshold is marked from the environment sound information acquired by all the sound detectors, so that the environment sound information caused by the failure of the sound detectors can be filtered.
After the environmental sound information which is larger than the set sound pressure threshold is obtained, comparing each piece of environmental sound information with the set sound information, wherein the set sound information is generally the whistle sound of the motor vehicle, if the voiceprint information in the environmental sound information is consistent with the voiceprint information in the set sound information, the environmental sound information is determined to be abnormal, namely the whistle sound is contained in the environmental sound information, otherwise, the environmental sound information is normal sound information, namely the whistle sound is not contained in the environmental sound information.
After the environmental sound information has the whistle sound, the encoding of the sound detector corresponding to the environmental sound information with the sound field intensity greater than the set intensity threshold is further acquired, the sound source direction generating the whistle sound is determined according to the surface of the support plate to which the acquired encoding of the sound detector belongs and the position of the sound detector in the support plate, and the sound source direction and the environmental sound information with the whistle sound are sent to the computer device 32.
The computer device 32 acquires an environmental image corresponding to the sound source direction, which generates the whistle sound.
When the sound source direction generating the whistle sound is determined, the position information of the article generating the whistle sound is determined according to the position information of the sound detector in the whistle sound detection device, and further, the position information of the sound detection device in the whistle sound detection device is processed by utilizing a beam forming emission or sound arrival time difference method to obtain the position information of the article generating the whistle sound. The position information of the sound detector in the whistle sound detection device is the coordinates of the sound detector in the coordinate system of the whistle sound detection device, and the position information of the article generating the whistle sound is generally the coordinate information of the article in the coordinate system of the whistle sound detection device.
For example, 32 sound detectors in each support plate of the whistle sound detection device acquire the environmental sound information of the whistle sound detection device, each sound detector transmits the acquired environmental sound information to a control chip in the whistle sound detection device, the control chip firstly judges whether the environmental sound is greater than 80 db or not for the environmental sound information acquired by each sound detector, if the environmental sound information is greater than 80 db, the environmental sound information is compared with the set sound information, if the environmental sound information is consistent with the set sound information, the environmental sound information is determined to be the whistle sound, after the environmental sound information is judged to be the whistle sound, the codes of the sound detectors corresponding to the environmental sound information with the whistle sound having the sound field intensity greater than the set intensity threshold are acquired, and the positioning array is formed by the coded sound detectors, the whistle vehicle is positioned by adopting a beam forming method or a method based on sound arrival time difference, wherein a sound detector in the whistle sound detection device is a microphone generally.
Assume that a total of n microphones are picked out to form an array for localization. The center of the prism table formed by the supporting plates is used as a coordinate origin to construct a right-hand coordinate system, and the coordinates of the n microphones are respectively (x)i,yi,zi) 1,2, ·, n; the coordinates (x) of the whistling vehicle need to be matched accordinglys,ys,zs) And (6) positioning.
The microphones being co-ordinates differently, the time τ of a single blast sound from the blast vehicle to each microphoneiI 1,2, n are also different, and the positioning can be completed by using the sound arrival time difference. Whistling vehicleThe line positioning can be realized according to any one of the following modes:
(1) beam forming method
Let S (ω) denote a whistle sound, the whistle signal picked up by each microphone can be expressed as:
Xi(ω)＝exp(-jωτi)S(ω)+N(ω),i＝1,2,...,n；
wherein, Xi(ω) is the whistling signal acquired by the ith microphone; j is the imaginary unit and ω is the angular frequency in radians/second. Tau isiIs the propagation time of the blast signal from the blast vehicle to the ith microphone. S (omega) is the frequency spectrum of the whistle signal, N (omega) is the noise signal, which can be considered to be independent of the whistle sound, i.e. E [ N (omega) S (omega) ]]＝0。
Let A (ω) ═ exp (j ω τ'1) exp(jωτ′2) … exp(jωτ'n)]；
Wherein,
where x, y, and z are coordinates of the location where the whistle signal occurs, and c represents the speed of sound propagation in air, typically 340 m/s.
Constructing a signal vector:
obviously, only if (x, y, z) ═ xs,ys,zs) When, | a (ω) X (ω) | takes a maximum value. Therefore, the whistle vehicle positioning (X, y, z) can be completed by only obtaining (X, y, z) corresponding to the maximum value of | a (ω) X (ω) |s,ys,zs)。
(2) Time difference of arrival method
A certain microphone is selected as a reference microphone, and the reference microphone is numbered as 1 without loss of generality.
First, the time difference of arrival between the other microphone and the reference microphone can be estimated using a cross-correlation method:
Δτn1＝τn-τ1,n＝2,3,...,n；
wherein, Δ τn1τ is the difference between the propagation time of the blast signal from the blast vehicle to the nth microphone and the propagation time of the blast signal from the blast vehicle to the 1 st microphonenFor the propagation time of the blast signal from the blast vehicle to the nth microphone, τ1Is the travel time of the blast signal from the blast vehicle to the 1 st microphone.
Secondly, according to the geometrical relationship, an equation set is constructed:
…
requirement n>4, the above formula forms an overdetermined equation set, and the overdetermined equation set is solved by using an optimization method or a least square method to obtain the position (x) of the whistle vehicles,ys,zs) (the coordinates are those in the device coordinate system).
After the position of the whistle vehicle is determined, the control system calls the cameras in the corresponding directions to start snapshot, and marks the whistle vehicle in the snapshot image according to the positioning result.
In practical applications, the whistle sound detecting device 10 is generally used in combination with a camera, and the usage scenario is schematically shown in fig. 4, the whistle sound detecting device 10 is disposed above the camera 20, and the camera 10 and the whistle sound detecting device 10 are disposed on the intersection sign.
Suppose that a set of equipment monitors a crossroad, namely a set of microphone array with 4 cameras, respectively corresponding to four directions of the crossroad. The blast sound detection apparatus is installed at the center position of the intersection as shown in fig. 5.
A vertical rod is arranged in the center of a crossing, a whistle sound detection device is arranged on the vertical rod, the center of a three-dimensional array is used as an origin, the upward direction of the vertical rod is used as the positive direction of a z axis, the south direction is used as the positive direction of an x axis, and the east direction is used as the positive direction of a y axis, so that a three-dimensional coordinate system can be constructeds,ys,zs). The equipment mounting location will be much higher than the vehicle and therefore the correct positioning result must be zs<0. The next job is to determine the camera that needs to be activated based on the location coordinates.
Coordinate (x)s,ys,zs) Travelling rewritable to polar coordinates, i.e.r represents a pole diameter, theta represents a pitch angle,indicating the azimuth, as shown in fig. 5:
only the azimuth needs to be concerned, and obviously the following relation is satisfied:
| range of azimuth angles(Unit:degree) | Direction of rotation |
| 315～360,0～45 | South orientation |
| 45～135 | East direction |
| 135～225 | North direction |
| 225～315 | West direction |
Considering that the range of viewing angles of the camera does not exceed ± 10 °, the above-mentioned range of azimuth angles does not appear blurred.
The calculation mode of the azimuth angle is as follows:
| (xs,ys) | azimuth angle |
| xs>0,ys>0 | tan-1(ys/xs) [ inverse tangent to ys/xs] |
| xs<0,ys>0 | 180°-tan-1(| ys/xs |) [ | | denotes an absolute value] |
| xs<0,ys<0 | 180°+tan-1(| ys/xs |) [ | | denotes an absolute value] |
| xs>0,ys<0 | 360°-tan-1(| ys/xs |) [ | | denotes an absolute value] |
| xs＝0,ys>0 | 90° |
| xs＝0,ys<0 | 270° |
| xs>0,ys＝0 | 0° |
| xs<0,ys＝0 | 180° |
| xs＝0,ys＝0 | Non-starting snapshot |
The pitch angle is calculated by the formula
From which the camera that needs to be activated can be determined. Due to (x)s,ys,zs) The positioning result is obtained under the equipment coordinate system, and the accurate marking can be carried out only by rotating the positioning result under the corresponding camera coordinate system. And constructing a right-hand coordinate system by taking the optical center position of the camera as an original point, taking the direction towards the visual field as the positive direction of a z-axis and the horizontal line direction of the visual field as an x-axis. Depending on the mounting position of the camera and microphone array, a rotation matrix can be constructed, which will be (x)s,ys,zs) ConversionAs coordinates in the camera coordinate systemAnd calculating the azimuth angle and the pitch angle of the whistle vehicle in the corresponding camera according to the above, and finally finishing the vehicle marking work in the picture shot by the camera.
Taking a camera mounted in the south direction as an example, XYZ represents the device coordinate system, and XYZ represents the south camera coordinate system.
The positive direction of the X axis of the camera is the positive direction of the Y axis of the device coordinate system, the positive direction of the Z axis is the same as the positive direction of the X axis of the device coordinate system, but there is an included angle γ because the camera needs to be installed towards the ground, similarly, the positive direction of the Y axis is the same as the positive direction of the Z axis of the device coordinate system, there is a same included angle γ, refer to fig. 6.
Let the coordinates of the optical center of the camera (i.e., the origin of the camera coordinate system) in the device coordinate system xyz be (xc, yc, zc). Then (x) can be expressed as followss,ys,zs) Conversion to camera coordinate system:
first, translating the origin of the device coordinate system to the origin of the camera coordinate system yields:
(x's,y's,z's)＝(xs,ys,zs)-(xc,yc,zc)；
secondly, taking the x axis of the equipment coordinate system as a rotating axis, facing the positive direction of the x axis, rotating 90 degrees anticlockwise, and the rotating matrix is as follows:
thirdly, taking the y axis of the equipment coordinate system as a rotating axis, taking the y axis as a positive direction, rotating 90 degrees anticlockwise, and the rotating matrix is as follows:
and finally, taking the x axis of the equipment coordinate system as a rotating axis, facing the positive direction of the x axis, rotating the angle gamma counterclockwise, wherein the rotating matrix is as follows:
from this (x) can be obtaineds,ys,zs) Coordinates in the camera coordinate system
The computer device is further configured to, after obtaining the position information of the item in the camera coordinate system: and marking the article in the environment image according to the position information. The method for marking an article in an image by a computer device according to position information is described in detail in the prior art, and will not be described too much here.
The application provides a pickup system, sound detection equipment that whistles acquire the environmental sound information that sound detection equipment that whistles locates, confirms whether have the sound of whistling in the environmental sound information, if have the sound of whistling in the environmental sound information, then confirm to produce the sound source direction of the sound of whistling, with sound source direction and have the environmental sound information transmission of the sound of whistling to computer equipment, computer equipment is used for acquireing with the sound source direction unanimously and produce the environmental image of the sound of whistling. Thus, the accuracy of recognizing the blast sound can be improved.
The embodiment of the application provides a whistle sound identification and positioning method, as shown in fig. 7, the method is applied to the whistle sound detection device, and the method includes the following steps:
s701, acquiring the environmental sound information of the whistle sound detection equipment;
s702, determining whether the environmental sound information has a whistle sound;
s703, if the environmental sound information has a whistle sound, determining the direction of a sound source generating the whistle sound;
s704, sending the sound source direction and the environmental sound information to computer equipment, so that the computer equipment obtains an environmental image for generating the whistle sound according to the sound source direction.
Optionally, the determining whether the environmental sound information has a whistle sound includes:
comparing the environmental sound information with the set sound information;
if the environmental sound information is consistent with the set sound information, determining that the environmental sound information has a whistle sound;
and if the ratio of the environmental sound information to the set sound information is consistent, determining that the environmental sound information has a whistle sound.
Optionally, the determining a direction of a sound source generating the blast sound includes:
and determining the position information of the whistle sound according to the position information of the sound detector in the whistle sound detection device.
Optionally, the determining the position information of the article generating the whistle sound according to the position information of the sound detector in the whistle sound detecting device includes:
and processing the position information of the sound detection equipment in the whistle sound detection equipment by utilizing a beam forming or arrival time difference method to obtain the position information of the article generating the whistle sound.
The application provides a sound identification positioning method of whistling obtains the environmental sound information that whistling sound check out test set locates, confirms whether have the sound of whistling in the environmental sound information, if have the sound of whistling in the environmental sound information, then confirm the sound source direction that produces the sound of whistling, send sound source direction and the sound of whistling to computer equipment to make computer equipment obtain the environmental image that produces the sound of whistling according to the sound source direction. Thus, the accuracy of recognizing the whistle sound is improved.
Corresponding to the whistle sound identification and location method in fig. 7, the embodiment of the present application further provides a computer device 800, as shown in fig. 8, the device includes a memory 801, a processor 802, and a computer program stored on the memory 801 and executable on the processor 802, wherein the processor 802 implements the whistle sound identification and location method when executing the computer program.
Specifically, the memory 801 and the processor 802 can be general memories and processors, and are not limited in this embodiment, when the processor 802 runs a computer program stored in the memory 801, the method for recognizing and locating a whistle sound can be executed, so as to solve the problem of low accuracy in recognition of a whistle sound in the prior art. Thus, the accuracy of recognizing the whistle sound is improved.
Corresponding to the whistle sound identification and location method in fig. 7, the embodiment of the present application further provides a computer readable storage medium, on which a computer program is stored, and the computer program is executed by a processor to perform the steps of the whistle sound identification and location method.
Specifically, the storage medium can be a general storage medium, such as a mobile disk, a hard disk, and the like, and when a computer program on the storage medium is executed, the method for recognizing and locating the whistle sound can be executed, so as to solve the problem of low accuracy in recognizing the whistle sound in the prior art. Thus, the accuracy of recognizing the whistle sound is improved.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments provided by the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus once an item is defined in one figure, it need not be further defined and explained in subsequent figures, and moreover, the terms "first", "second", "third", etc. are used merely to distinguish one description from another and are not to be construed as indicating or implying relative importance.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the present invention in its spirit and scope. Are intended to be covered by the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. A whistling sound detection apparatus, comprising: at least three support plates, a plurality of sound detectors, a control chip, wherein,
a plurality of sound detectors are arranged in each supporting plate, and each sound detector is electrically connected with the control chip;
the included angle between two adjacent supporting plates is the same.
2. The apparatus of claim 1, wherein the number of sound detectors provided in each of the support plates is the same.
3. The apparatus of claim 1, wherein the plurality of sound detectors in each of the support plates are arranged in an array.
4. The apparatus of claim 1, wherein the support plate is quadrilateral in shape.
5. A blast sound recognition positioning method applied to the blast sound detection apparatus according to any one of claims 1 to 4, comprising:
acquiring environmental sound information of the whistling sound detection equipment;
determining whether there is a whistle sound in the ambient sound information;
if the environmental sound information has a whistle sound, determining the direction of a sound source generating the whistle sound;
and sending the sound source direction and the environmental sound information to computer equipment so that the computer equipment acquires an environmental image for generating the whistle sound according to the sound source direction.
6. The method of claim 5, wherein the determining whether the ambient sound information has a whistle sound comprises:
comparing the environmental sound information with the set sound information;
if the environmental sound information is consistent with the set sound information, determining that the environmental sound information has a whistle sound;
and if the ratio of the environmental sound information to the set sound information is consistent, determining that the environmental sound information does not have a whistle sound.
7. The method of claim 5, wherein said determining a direction of a sound source generating said blast sound comprises:
and determining the position information of the article generating the whistle sound according to the position information of the sound detector in the whistle sound detection device.
8. The method of claim 5, wherein determining the location information of the article generating the blast sound based on the location information of the sound detector in the blast sound detection apparatus comprises:
and processing the position information of the sound detection equipment in the whistle sound detection equipment by utilizing a beam forming or arrival time difference method to obtain the position information of the article generating the whistle sound.
9. A blast sound identification and localization system, comprising: a blast sound detection device for performing the method of any one of claims 5-8 and a computer device, the blast sound detection device being communicatively connected to the computer device;
the whistle sound detection device is used for acquiring environmental sound information of the whistle sound detection device, determining whether the environmental sound information has whistle sound, if the environmental sound information has the whistle sound, determining position information of an article corresponding to the whistle sound, and sending the position information and the whistle sound to computer equipment;
and the computer equipment is used for acquiring the environment image which is consistent with the position information and generates the whistle sound.
10. The system of claim 9, wherein the computer device is further to: and marking the article in the environment image according to the position information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910133820.0A CN109900354B (en) | 2019-02-22 | 2019-02-22 | Whistling sound detection device, and whistling sound identification and positioning method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910133820.0A CN109900354B (en) | 2019-02-22 | 2019-02-22 | Whistling sound detection device, and whistling sound identification and positioning method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109900354A true CN109900354A (en) | 2019-06-18 |
| CN109900354B CN109900354B (en) | 2021-08-03 |
Family
ID=66945450
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910133820.0A Active CN109900354B (en) | 2019-02-22 | 2019-02-22 | Whistling sound detection device, and whistling sound identification and positioning method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109900354B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111007462A (en) * | 2019-12-13 | 2020-04-14 | 北京小米智能科技有限公司 | Positioning method, positioning device, positioning equipment and electronic equipment |
| CN111785032A (en) * | 2020-06-22 | 2020-10-16 | 杭州海康威视数字技术股份有限公司 | Audio signal positioning method and device, electronic equipment and intelligent traffic system |
| CN114359390A (en) * | 2022-01-10 | 2022-04-15 | 中国计量科学研究院 | Sound source positioning deviation estimation method of whistle detection system based on image |
| CN117437790A (en) * | 2023-12-08 | 2024-01-23 | 南京浦云交通科技有限公司 | Urban road whistling noise snapshot system |
| WO2024077366A1 (en) * | 2022-10-11 | 2024-04-18 | Perkons S/A | System and method for detecting motor vehicle noise and corresponding computer-readable memory |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS6450980A (en) * | 1987-08-21 | 1989-02-27 | Hitachi Shipbuilding Eng Co | Apparatus for detecting position of whistle sound generating source |
| CN101030328A (en) * | 2007-04-23 | 2007-09-05 | 凌子龙 | Violation whistling automatic evidence-collecting method for vehicle |
| CN101030327A (en) * | 2007-04-23 | 2007-09-05 | 凌子龙 | Violation whistling electronic evidence-collecting method for vehicle |
| KR101152967B1 (en) * | 2010-11-30 | 2012-06-08 | (주)대도기계 | Real time estimation system and method of ships position using ships source |
| CN102722983A (en) * | 2012-06-13 | 2012-10-10 | 浙江大学 | Audio and video based detection system and method for horn blowing of motor vehicle in violation of regulations |
| CN106355893A (en) * | 2016-10-28 | 2017-01-25 | 东方智测（北京）科技有限公司 | Method and system for real-time positioning of whistling motor vehicle |
| CN106774930A (en) * | 2016-12-30 | 2017-05-31 | 中兴通讯股份有限公司 | A kind of data processing method, device and collecting device |
| CN206523226U (en) * | 2017-03-10 | 2017-09-26 | 倪群莉 | A kind of road noise monitoring device |
-
2019
- 2019-02-22 CN CN201910133820.0A patent/CN109900354B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS6450980A (en) * | 1987-08-21 | 1989-02-27 | Hitachi Shipbuilding Eng Co | Apparatus for detecting position of whistle sound generating source |
| CN101030328A (en) * | 2007-04-23 | 2007-09-05 | 凌子龙 | Violation whistling automatic evidence-collecting method for vehicle |
| CN101030327A (en) * | 2007-04-23 | 2007-09-05 | 凌子龙 | Violation whistling electronic evidence-collecting method for vehicle |
| KR101152967B1 (en) * | 2010-11-30 | 2012-06-08 | (주)대도기계 | Real time estimation system and method of ships position using ships source |
| CN102722983A (en) * | 2012-06-13 | 2012-10-10 | 浙江大学 | Audio and video based detection system and method for horn blowing of motor vehicle in violation of regulations |
| CN106355893A (en) * | 2016-10-28 | 2017-01-25 | 东方智测（北京）科技有限公司 | Method and system for real-time positioning of whistling motor vehicle |
| CN106774930A (en) * | 2016-12-30 | 2017-05-31 | 中兴通讯股份有限公司 | A kind of data processing method, device and collecting device |
| CN206523226U (en) * | 2017-03-10 | 2017-09-26 | 倪群莉 | A kind of road noise monitoring device |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111007462A (en) * | 2019-12-13 | 2020-04-14 | 北京小米智能科技有限公司 | Positioning method, positioning device, positioning equipment and electronic equipment |
| CN111785032A (en) * | 2020-06-22 | 2020-10-16 | 杭州海康威视数字技术股份有限公司 | Audio signal positioning method and device, electronic equipment and intelligent traffic system |
| CN114359390A (en) * | 2022-01-10 | 2022-04-15 | 中国计量科学研究院 | Sound source positioning deviation estimation method of whistle detection system based on image |
| WO2024077366A1 (en) * | 2022-10-11 | 2024-04-18 | Perkons S/A | System and method for detecting motor vehicle noise and corresponding computer-readable memory |
| CN117437790A (en) * | 2023-12-08 | 2024-01-23 | 南京浦云交通科技有限公司 | Urban road whistling noise snapshot system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109900354B (en) | 2021-08-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109900354B (en) | Whistling sound detection device, and whistling sound identification and positioning method and system | |
| CN111179358A (en) | Calibration method, device, equipment and storage medium | |
| CN106842131A (en) | Microphone array sound localization method and device | |
| CN112837207B (en) | Panoramic depth measurement method, four-eye fisheye camera and binocular fisheye camera | |
| CN112423191B (en) | Video call device and audio gain method | |
| US12067741B2 (en) | Systems and methods of measuring an object in a scene of a captured image | |
| CN111862208B (en) | Vehicle positioning method, device and server based on screen optical communication | |
| CN103852066A (en) | Equipment positioning method, control method, electronic equipment and system | |
| CA3112187C (en) | Optics based multi-dimensional target and multiple object detection and tracking method | |
| CN111046121A (en) | Environment monitoring method, device and system | |
| CN104748754A (en) | Vehicle positioning method and system thereof | |
| CN109035294A (en) | A kind of image extraction system and method for moving target | |
| EP3967969B1 (en) | Fisheye camera calibration system, method and apparatus, electronic device, and storage medium | |
| CN113188569A (en) | Vehicle and laser radar coordinate system calibration method, device and storage medium | |
| KR20180126408A (en) | Method for locating a user device | |
| CN112488022B (en) | Method, device and system for monitoring panoramic view | |
| CN119131157A (en) | A method and computer device for realizing target positioning based on a single camera | |
| CN111325790B (en) | Target tracking method, device and system | |
| Lu et al. | Image-based system for measuring objects on an oblique plane and its applications in 2-D localization | |
| CN112288821A (en) | Method and device for calibrating external parameters of camera | |
| CN105045582A (en) | Mobile phone photographing behavior based event positioning method | |
| CN202535480U (en) | Panoramic monitoring device based on wireless detection | |
| CN113223076A (en) | Coordinate system calibration method, device and storage medium for vehicle and vehicle-mounted camera | |
| KR102788944B1 (en) | Terminal location providing system and location providing method | |
| JP7479200B2 (en) | Position and orientation estimation device and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: No. 70, Nantang Road, Lugu street, high tech Development Zone, Changsha, Hunan 410000 Applicant after: Shibang Communication Co., Ltd Address before: No. 70, Nantang Road, Lugu street, high tech Development Zone, Changsha, Hunan 410000 Applicant before: CHANGSHA SPON COMMUNICATION TECHNOLOGY Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |