CN115596955A - Linkage method and linkage equipment for environmental noise detection and pan-tilt camera - Google Patents
Linkage method and linkage equipment for environmental noise detection and pan-tilt camera Download PDFInfo
- Publication number
- CN115596955A CN115596955A CN202211228423.XA CN202211228423A CN115596955A CN 115596955 A CN115596955 A CN 115596955A CN 202211228423 A CN202211228423 A CN 202211228423A CN 115596955 A CN115596955 A CN 115596955A
- Authority
- CN
- China
- Prior art keywords
- pan
- camera
- tilt
- sound source
- target object
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 238000001514 detection method Methods 0.000 title claims abstract description 23
- 230000007613 environmental effect Effects 0.000 title claims abstract description 12
- 238000012544 monitoring process Methods 0.000 claims abstract description 18
- 238000004891 communication Methods 0.000 claims abstract description 12
- 230000002159 abnormal effect Effects 0.000 claims description 104
- 238000009434 installation Methods 0.000 claims description 14
- 230000005236 sound signal Effects 0.000 claims description 7
- 238000012216 screening Methods 0.000 claims description 3
- 230000005611 electricity Effects 0.000 claims description 2
- 230000006855 networking Effects 0.000 abstract 1
- 230000006399 behavior Effects 0.000 description 8
- 230000000007 visual effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 238000003491 array Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 238000005422 blasting Methods 0.000 description 1
- 230000008034 disappearance Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F16—ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
- F16M—FRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
- F16M11/00—Stands or trestles as supports for apparatus or articles placed thereon ; Stands for scientific apparatus such as gravitational force meters
- F16M11/02—Heads
- F16M11/04—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand
- F16M11/06—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand allowing pivoting
- F16M11/08—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand allowing pivoting around a vertical axis, e.g. panoramic heads
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F16—ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
- F16M—FRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
- F16M11/00—Stands or trestles as supports for apparatus or articles placed thereon ; Stands for scientific apparatus such as gravitational force meters
- F16M11/02—Heads
- F16M11/04—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand
- F16M11/06—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand allowing pivoting
- F16M11/10—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand allowing pivoting around a horizontal axis
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F16—ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
- F16M—FRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
- F16M11/00—Stands or trestles as supports for apparatus or articles placed thereon ; Stands for scientific apparatus such as gravitational force meters
- F16M11/02—Heads
- F16M11/18—Heads with mechanism for moving the apparatus relatively to the stand
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01H—MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
- G01H7/00—Measuring reverberation time ; room acoustic measurements
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B17/00—Details of cameras or camera bodies; Accessories therefor
- G03B17/56—Accessories
- G03B17/561—Support related camera accessories
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Studio Devices (AREA)
Abstract
The application relates to an environmental noise detection and pan-tilt camera linkage method, more than two pan-tilt cameras integrated with a microphone array are arranged at intervals on a road, and the method comprises the following steps: s1: the microphone array collects information, the controller judges a suspicious sound source, and the sound direction is judged according to the judgment result of the direction of the suspicious sound source; s2: the controller sends a control signal to drive the pan-tilt camera to turn to the direction of the suspicious sound source according to the sound direction judged by the microphone array; s3: the cradle head camera locks a target object corresponding to the suspicious sound source according to the audio information and the identified image information, records the audio and video information and uploads the audio and video information to the service terminal; s4: and the pan-tilt camera at the current position sends a control signal to another pan-tilt camera at the position closest to the target object in the moving direction of the target object to take over the monitoring of the target object by the current pan-tilt camera. And a plurality of pan-tilt cameras are in communication networking, so that linkage monitoring is realized, and more accurate judgment is facilitated.
Description
Technical Field
The application relates to the technical field of intelligent monitoring equipment, in particular to a linkage method and linkage equipment of environmental noise detection and a pan-tilt camera.
Background
The society is developing at a rapid pace, the popularity of motor vehicles is also higher and higher, the motor vehicle 'street-blasting' behavior often appears at night, for the motor vehicle with high noise and high speed, great interference is brought to the lives of residents along the street, and law enforcement is difficult to obtain evidence by law enforcement agencies.
Many supervisory equipment all adopt the fixed mounting mode now, can only carry out video acquisition to fixed region, perhaps control the rotation through backstage staff and come information acquisition, however, often the noise that the illegal activities all can accompany produces, if the illegal activities surpass fixed video acquisition scope or backstage staff does not in time discover illegal activities, then hardly obtain relevant evidence, be unfavorable for going on of follow-up law enforcement procedure.
Disclosure of Invention
In view of this, the present application provides an environmental noise detection and pan/tilt camera linkage method, in which more than two pan/tilt cameras integrated with a microphone array are arranged on a road at intervals, including the following steps:
s1: the microphone array collects information, the controller judges a suspicious sound source, and the sound direction is judged according to the direction judgment result of the suspicious sound source;
s2: the controller sends a control signal to drive the pan-tilt camera to turn to the direction of the suspicious sound source according to the sound direction judged by the microphone array;
s3: the holder camera locks a target object corresponding to the suspicious sound source according to the audio information and the identified image information, starts to record the audio and video information and uploads the audio and video information to the service terminal;
s4: the pan-tilt camera at the current position sends a control signal to the moving direction of the target object, and another position cloud platform camera closest to the target object takes over the cloud platform camera at the current position to monitor the target object.
In a possible implementation manner, in S1, if the suspicious sound source information acquired by the microphone array exceeds a threshold, the sound direction structure is determined, and if the suspicious sound source information does not exceed the threshold, the remaining sound sources are continuously monitored;
the abnormal sound source signals exceeding the threshold value comprise a human sound abnormal signal threshold value and a vehicle sound abnormal signal threshold value; when the microphone array detects abnormal sound source signals exceeding a threshold value, the controller identifies the abnormal sound source signals as human sounds or vehicle sounds;
if the identified abnormal sound source signal is the voice, comparing the identified abnormal sound source signal with the voice abnormal signal threshold, if the identified abnormal sound source signal exceeds the voice abnormal signal threshold, locking the abnormal sound source by the pan-tilt camera, otherwise, judging the abnormal sound source to be a non-abnormal sound source;
if the identified abnormal sound source signal is car sound, the abnormal sound source signal is compared with the abnormal car sound signal threshold, if the abnormal car sound signal threshold is exceeded, the holder camera locks the abnormal sound source, and if the abnormal sound source signal is not the abnormal sound source, the holder camera is judged.
In a possible implementation manner, in the step S3, after the pan/tilt camera locks the target object, the interference of another suspicious sound source signal sent by the microphone array is no longer received until the monitoring operation is completed.
In a possible implementation manner, a storage module is arranged in the pan-tilt camera, and in the step S3, the recorded audio/video information is stored in the storage module and is sent to the service terminal in real time; the controller judges according to the current audio information and the real-time video image and judges whether the abnormal event is ended or not;
if the abnormal event is not finished, judging whether the abnormal event exceeds the monitoring range of the holder camera at the current position, if so, executing the step S4, otherwise, continuously recording the audio and video information;
and if the abnormal event is ended, the holder camera is restored to a state to be locked.
In a possible implementation manner, in the step S4, after the pan-tilt camera closest to the target object in the moving direction of the target object is based on the moving direction information of the target object sent by the controller, the controller drives this pan-tilt camera to rotate in advance to the direction in which the target object may enter the field of view, so as to prepare to lock the target object in succession.
In a possible implementation manner, in the step S4, after the pan-tilt camera at the current position identifies and processes the target moving direction information through the service terminal, the service terminal sends control information to another pan-tilt camera at another position closest to the target object; wherein, the service terminal identifies and processes the moving direction information of the target object and sends the control information to another pan-tilt camera comprises: searching the holder camera integrated with the microphone array in a certain distance range of the current position; predicting a next one or more of the mic-array integrated pan-tilt cameras that the target object may pass through in its direction of movement; screening out the pan-tilt camera integrated with the microphone array in the state to be locked; and sending the target movement information to the pan-tilt camera which is in a state to be locked and is integrated with the microphone array on the possible passing route of the target object.
On the other hand, the application also provides a pan-tilt camera with an environmental noise detection device, which comprises a pan-tilt camera main body, a camera shell, a pan-tilt bracket and a microphone array; a control component is arranged in the holder camera main body; the camera shell is covered on the holder camera main body; the holder camera main body is arranged on the holder support through the camera shell, and the holder camera main body can rotate on the holder support; the microphone array is mounted on the camera housing, and the microphone array is electrically connected with the control assembly.
In one possible implementation, the microphone array includes a mounting portion and a microphone sensor; the mounting part is of an annular structure, a mounting space is formed in the mounting part, and a plurality of sound receiving holes are formed in the outer periphery of the mounting part; the microphone sensors are arranged in the installation space, the number of the microphone sensors is multiple, and the microphone sensors are uniformly distributed on the periphery of the installation part.
In a possible implementation manner, one of the microphone sensors is arranged over a camera in the pan/tilt camera main body, and is located at a position right above or below the camera, and the reception direction of the microphone sensor is the same as the facing direction of the camera.
In one possible implementation manner, the control assembly comprises a power supply module, and a control module, a storage module and a network communication module which are electrically connected with the power supply module; the control module is respectively and electrically connected with the holder camera main body, the microphone array, the storage module and the network communication module; still include antenna module, antenna module sets up on the cloud platform camera main part, with the network communication module electricity is connected.
The beneficial effect of this application: the cloud platform cameras integrated with the microphone arrays are arranged on the road at intervals, in use, suspicious sound source information is collected through the microphone arrays and sent to the controller to judge the sound direction, and the sound information and the video information collected by the cloud platform cameras are used for continuously and timely providing noise data and illegal video information.
Other features and aspects of the present application will become apparent from the following detailed description of exemplary embodiments, which proceeds with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments, features, and aspects of the application and, together with the description, serve to explain the principles of the application.
Fig. 1 illustrates a work flow chart of an ambient noise detection and pan/tilt/zoom camera linkage method according to an embodiment of the present disclosure;
fig. 2 is a schematic structural diagram of a main body of a pan-tilt camera with an ambient noise detection device according to an embodiment of the present application;
FIG. 3 shows an exploded view of a pan-tilt-zoom camera with an ambient noise detection device according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a main body of a pan/tilt head camera with an ambient noise detection device according to another embodiment of the present application;
fig. 5 shows an exploded view of a pan/tilt head camera with an ambient noise detection device according to another embodiment of the present application.
Detailed Description
Various exemplary embodiments, features and aspects of the present application will be described in detail below with reference to the accompanying drawings. In the drawings, like reference numbers can indicate functionally identical or similar elements. While the various aspects of the embodiments are presented in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.
It will be understood, however, that the terms "central," "longitudinal," "lateral," "length," "width," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," "circumferential," and the like are used in an orientation or positional relationship indicated in the drawings for convenience in describing the present application or for simplicity of description, and do not indicate or imply that the device or element so referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore should not be considered limiting of the present application.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present application, "a plurality" means two or more unless specifically limited otherwise.
The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.
Furthermore, in the following detailed description, numerous specific details are set forth in order to provide a better understanding of the present application. It will be understood by those skilled in the art that the present application may be practiced without some of these specific details. In some instances, methods, means, elements and circuits that are well known to those skilled in the art have not been described in detail so as not to obscure the present application.
Fig. 1 illustrates a workflow diagram of an ambient noise detection and pan-tilt camera linkage method according to an embodiment of the present disclosure; fig. 2 is a schematic structural diagram of a main body of a pan-tilt camera with an ambient noise detection device according to an embodiment of the present application; fig. 3 shows an exploded view of a pan-tilt-zoom camera with an ambient noise detection device according to an embodiment of the present application; fig. 4 is a schematic structural diagram of a main body of a pan/tilt head camera with an ambient noise detection device according to another embodiment of the present application; fig. 5 shows an exploded view of a pan/tilt head camera with an ambient noise detection device according to another embodiment of the present application.
As shown in fig. 1 to 5, a method for detecting environmental noise and linking pan/tilt/zoom cameras, in which two or more pan/tilt/zoom cameras integrated with a microphone array are arranged on a road at intervals, includes the following steps:
s1: the microphone array collects information, the controller judges a suspicious sound source, and the sound direction is judged according to the judgment result of the direction of the suspicious sound source;
s2: the controller sends a control signal to drive the pan-tilt camera to turn to the direction of the suspicious sound source according to the sound direction judged by the microphone array;
s3: the holder camera locks a target object corresponding to the suspicious sound source according to the audio information and the identified image information, starts to record audio and video information and uploads the audio and video information to the service terminal;
s4: and the pan-tilt camera at the current position sends a control signal to another pan-tilt camera at the position closest to the target object in the moving direction of the target object to take over the pan-tilt camera at the current position to monitor the target object.
In the embodiment, the pan-tilt cameras integrated with the microphone arrays are arranged on the road at intervals, in use, suspicious sound source information is collected through the microphone arrays and sent to the controller to judge the sound direction, and the sound information and the video information collected by the pan-tilt cameras are used for continuously and timely providing noise data and illegal video information.
It should be noted that, regarding the arrangement positions, the intervals, etc. of the multiple pan-tilt cameras, the implementer in the field can take many considerations according to the specific road conditions, the local economic conditions, etc. of the arrangement positions, and the specific interval distance, etc. is not limited. The linkage device is more suitable for places with dense population and large pedestrian volume, so that a plurality of camera devices are used in a linkage manner, and the monitoring dead angle is reduced.
In one embodiment, in step S1, if the suspicious sound source information collected by the microphone array exceeds a threshold, the sound direction structure is determined, and if the suspicious sound source information does not exceed the threshold, the remaining sound sources are continuously monitored; when the microphone array detects abnormal sound source signals exceeding the threshold value, the controller identifies the abnormal sound source signals as human sounds or vehicle sounds; if the identified abnormal sound source signal is the voice, comparing the identified abnormal sound source signal with a voice abnormal signal threshold value, if the identified abnormal sound source signal exceeds the voice abnormal signal threshold value, locking the abnormal sound source by the pan-tilt camera, otherwise, judging the abnormal sound source as a non-abnormal sound source; if the identified abnormal sound source signal is car sound, the abnormal sound source signal is compared with a car sound abnormal signal threshold value, if the abnormal sound source signal exceeds the car sound abnormal signal threshold value, the holder camera locks the abnormal sound source, and if not, the abnormal sound source is judged to be a non-abnormal sound source.
In one embodiment, in step S3, after the pan-tilt camera locks the target object, the interference of another suspicious sound source signal sent by the microphone array is no longer received until the monitoring operation is completed.
In one embodiment, once the pan-tilt camera locks the noise source, the pan-tilt camera does not immediately retrace the new noise source due to the sudden disappearance of the noise source, and autonomously judges whether an abnormal event generated by the noise source exists through a depth recognition algorithm of the controller, if the abnormal event exists, the pan-tilt camera does not transfer a tracking target, and sends the event to the service terminal to notify background personnel and nearby connected pan-tilt cameras with the microphone array of the present application.
In one specific embodiment, a storage module is arranged in the pan-tilt camera, in the step S3, recorded audio and video information is stored in the storage module and is sent to the service terminal in real time, the controller judges according to the current audio information and the real-time video image whether an abnormal event is finished or not, if the abnormal event is not finished, whether the abnormal event exceeds the monitoring range of the pan-tilt camera at the current position or not is judged, if the abnormal event exceeds the monitoring range, the direction information of the target object is judged, otherwise, the audio and video information is continuously recorded, and if the abnormal event is finished, the pan-tilt camera is restored to a state to be locked.
In one embodiment, after the pan-tilt camera closest to the target object in the moving direction of the target object is based on the moving direction information of the target object sent by the controller, the controller drives the pan-tilt camera to rotate in advance to the direction in which the target object may enter the visual field, and the target object is ready to be locked in succession.
In one embodiment, after the pan-tilt camera at the current position identifies and processes the moving direction information of the target through the service terminal, the service terminal sends the control information to another pan-tilt camera at another position closest to the target, wherein the step of identifying and processing the moving direction information of the target by the service terminal and sending the control information to another pan-tilt camera includes: the method comprises the steps of searching for the pan-tilt camera integrated with the microphone array in a certain distance range at the current position, predicting the moving direction of a target object, and possibly passing through the next one or more pan-tilt cameras integrated with the microphone array, screening out the pan-tilt cameras integrated with the microphone array which are in a state to be locked, sending target moving information to the pan-tilt cameras integrated with the microphone array which are in the state to be locked, and enabling the target object to possibly pass through the pan-tilt cameras integrated with the microphone array on a route.
More specifically, in one embodiment, the method for detecting environmental noise and linking the pan/tilt camera specifically comprises the following steps:
the method comprises the steps that a microphone array collects sound information of the surrounding environment, a pan-tilt camera monitors pictures of the surrounding environment in real time, when a suspicious sound source exceeding a threshold value is detected by the microphone array, a suspicious sound source signal is sent to a controller for judgment, the suspicious sound source exceeding the threshold value is sent to the pan-tilt camera by the controller, the sending direction of the suspicious sound source is turned, the pan-tilt camera locks a target object corresponding to the suspicious sound source, the pan-tilt camera continuously tracks the target object and records audio and video information until the target object leaves the visible range of the pan-tilt camera, the audio and video information is sent to a service terminal, when the video information is recorded, the controller judges whether the target object is illegal through the behavior of the target object in a video picture, if the target object is judged to be an illegal abnormal event, whether the target object continuously moves is judged, and if the target object does not move out of the monitoring range of the current pan-tilt camera, the method comprises the steps that audio and video information is continuously recorded, if a target object moves out of a monitoring range of a pan-tilt camera, a controller identifies the moving direction of the target object leaving the current monitoring range and sends the moving direction information to a service terminal, the service terminal predicts that the target object may pass through nearby pan-tilt cameras through identification and judgment, screens out the pan-tilt cameras in a to-be-locked state (an idle state), sends the predicted moving direction information which may pass through to the pan-tilt cameras in the to-be-locked state, and when the target object may pass through a route, the controller in the pan-tilt camera judges that the target object enters the position direction of a monitoring visual field through the moving direction information, and sends a control signal to the pan-tilt cameras to enable the pan-tilt cameras to rotate to the position direction in advance that the target object may enter the monitoring visual field.
Further, for the judgment of the moving direction of the target object, the controller preprocesses the moving direction information of the moving sound source signals received from the microphone array and the video signals identified by the pan-tilt camera, because the pan-tilt camera is usually arranged on a road, the road has a rough moving direction, so that the moving direction of most object targets can be basically judged based on the road direction, if the target object does not move along the road direction, if the target object transversely passes through the center of the road, the target object is also judged to be an abnormal event, the abnormal event is locked and the audio-video information is recorded, the controller sends the preprocessed information to the service terminal, and the service terminal predicts and judges the possible moving direction of the target based on the target moving direction information preprocessed by the controller, for example, the target object is predicted to possibly appear in the visual field range of the next adjacent pan-tilt camera by combining with the big data of the service terminal, and sends the predicted information to each camera which is adjacent to the current position and is in the state to be locked.
It should be noted that, when the controller determines the behavior of the target object through the video image and the audio information, it already determines whether the target object is illegal continuously, and moves continuously at a certain speed, such as the street burst behavior of a modified motorcycle or automobile at night, at which time the target object is monitored continuously in the visual field of the camera, and for the abnormal event that the vehicle is stationary or moving slowly, such as the dispute between people, the cradle head camera will monitor continuously at the position until the abnormal event is ended.
In one embodiment, in step S2, after the controller drives the pan/tilt camera to turn to the emission direction of the suspected sound source, the main controller analyzes the picture of the target image through a deep learning algorithm, identifies the behavior of the target object, intelligently identifies whether the target object is an abnormal event, and locks the target object if the target object is the abnormal event, otherwise, the pan/tilt camera returns to the state to be locked.
In this embodiment, the main controller analyzes the picture of the target object, and may also analyze and determine the behavior of the target object by combining some non-civilized words, sensitive words, etc. in the audio information, to determine whether the target object has an illegal behavior, that is, only a suspicious sound source exceeding a threshold value is present, and the behavior is not certain illegal.
It should also be noted that the deep learning algorithm mentioned in the present application can be implemented directly by using the prior art, and no improvement is made in the present application.
In one embodiment, in step S3, the abnormal sound source signals exceeding the threshold include a human sound abnormal signal threshold and a vehicle sound abnormal signal threshold, after the microphone array detects the abnormal sound source signals exceeding the threshold, the controller intelligently identifies the abnormal sound source signals as human sounds or vehicle sounds, if the identified abnormal sound source signals are human sounds, the abnormal sound source signals are compared with the human sound abnormal signal threshold, and if the identified abnormal sound source signals are human sounds, the pan-tilt camera locks the abnormal sound source, otherwise, the abnormal sound source signals are determined as non-abnormal sound sources, if the identified abnormal sound source signals are vehicle sounds, the abnormal sound source signals are compared with the vehicle sound abnormal signal threshold, the vehicle sound abnormal signal threshold is exceeded, the pan-tilt camera locks the abnormal sound source, otherwise, the abnormal sound source signals are determined as non-abnormal sound sources.
In one embodiment, in step S3, after the pan/tilt camera locks the target object, the interference of another suspicious sound source signal sent by the microphone array is no longer received until the monitoring operation is completed.
In one specific embodiment, the holder camera is internally provided with a storage module, in the step S3, recorded audio and video information is stored in the storage module and is sent to the service terminal in real time, and if the target object moves continuously, in the step S4, the controller sends a moving direction signal of the target object moving out of the monitoring range and the audio and video information recorded in the step S3 to the service terminal together.
Cloud platform camera with ambient noise detection device includes: the camera comprises a tripod head camera main body, a camera shell 60, a tripod head bracket 30 and a microphone array 10, wherein a control component is arranged in the tripod head camera main body; the camera housing 60 covers the pan/tilt camera body; the pan/tilt/zoom camera main body is mounted on the pan/tilt/zoom support 30 through the camera housing 60, and the pan/tilt/zoom camera main body can rotate on the pan/tilt/zoom support 30; the microphone array 10 is mounted on the camera housing 6, the microphone array 10 being electrically connected to a control assembly.
In this embodiment, the microphone array 10 is installed on the camera housing 60 covering the main body of the pan/tilt/zoom camera and installed on the pan/tilt/zoom support 30 together, and the microphone array 10 is electrically connected to the control component in the camera to form a linkage device, and installed on the pan/tilt/zoom support 30, which is compact in structure, convenient to install, and in the specific using process, the microphone array 10 is mainly used for detecting the sound size and sound source direction of the surrounding environment, the control component receives the signal sent by the microphone array 10 and judges the noise level, after the early warning noise level is exceeded, the control component passes through the sound source direction identified by the microphone array 10, guides the main body of the pan/tilt/zoom camera to rotate on the pan/tilt/zoom support 30 and lock the sound source, so as to realize more timely collection of illegal evidence, which is beneficial for law enforcement personnel to call and check the evidence. Moreover, compare in the mode of fixed video acquisition, this cloud platform camera main part that can rotate on cloud platform support 30 has bigger shooting supervision scope, the going on of follow-up law enforcement procedure.
In one embodiment, the microphone array 10 includes an installation portion and a plurality of microphone sensors, the installation portion is a ring structure, the installation portion has an installation space therein, and a plurality of sound receiving holes are formed in the outer circumference of the installation portion, the microphone sensors are disposed in the installation space, and the number of the microphone sensors is multiple, and the microphone sensors are uniformly distributed around the installation portion.
In this embodiment, the microphone array 10 is composed of different numbers of microphone collecting sensors, and is uniformly distributed in the circumferential direction of the mounting portion, each microphone collecting sensor simultaneously collects sound signals of the surrounding environment, and the noise sound source position is calculated and located by analyzing the difference of the sound signal strength.
It should be pointed out here that do not do too much to restrict to the quantity of microphone sensor in this application, only need ensure that it can be evenly divided in the installation department can, if need higher judgement sound source direction, then lay more microphone sensors in the installation department, otherwise, lay less microphone sensor in the installation department to satisfy its conventional user demand can, do not do the repeated description herein.
Preferably, the microphone array 10 is a circular ring structure.
The microphone array 10 with the annular structure is more uniform in arrangement of a plurality of microphone sensors arranged inside the microphone array, and can effectively improve the judgment precision of the sound source direction compared with other annular structures when the sound source direction is judged.
In one specific embodiment, one of the microphone sensors is arranged right opposite to the camera in the holder camera body and is positioned right above or right below the camera, and the sound receiving direction of the microphone sensor is the same as the direction of the camera.
In one embodiment, when the pan/tilt camera body is a pan/tilt ball machine 20A, the camera housing 60 is covered on the pan/tilt camera body, and the microphone array 10 is installed at the bottom of the camera housing 60.
In this embodiment, it should be noted that the way of mounting the pan-tilt ball machine 20A to the support on the road is an inverted suspension type mounting, and this way is matched with the pan-tilt ball machine 20A to have a better view range, so as to avoid that the ball camera assembly 24 is blocked by the support below the ball camera assembly after being mounted, thereby avoiding more dead angles.
It should be added here that, based on the ambient noise detection and pan-tilt camera linkage method described in the foregoing, for the case where the pan-tilt camera is the pan-tilt ball machine 20A, the microphone array at least includes a horizontal annular microphone array; the microphone array 10 is fixed to the camera housing 60 so as not to rotate with the camera body; in the step S3, the microphone array 10 has a first microphone sensor that receives the abnormal sound source signal with the maximum decibel, the camera body continuously rotates until the shooting direction of the camera body and the first microphone sensor keep the same direction, and the pan-tilt camera finishes locking the abnormal sound source.
In one embodiment, when the cradle head camera main body is the cradle head gun 20B, the camera housing 60 is a hollow rectangular structure, and is wrapped outside the cradle head camera main body, and the lower part of the camera housing 60 is rotatably connected with the cradle head support 30; the microphone array 10 is installed on the outer wall of the camera housing 60 on the same side rotatably connected with the pan/tilt head support 30.
In this embodiment, the way of mounting the cradle head bolt face 20B to the support on the road is the normal mount, and the front-back length of the gun camera is long, so that the situation that the lower support blocks the view field during shooting does not occur.
In short, the pan/tilt/ball machine 20A drives the camera to move through the rotating mechanism inside the pan/tilt/camera body, and the pan/tilt/gun machine 20B drives the whole machine body to move through the rotating mechanism at the lower part of the pan/tilt/camera body.
It should be added here that, based on the ambient noise detection and pan-tilt camera linkage method described in the foregoing, for the case where the pan-tilt camera is the pan-tilt gun strike 20B, the microphone array 10 at least includes a horizontal annular microphone array; the microphone array 10 is fixed to a camera body and rotates with the camera body, and a second microphone sensor is installed right above or right below the camera body, and the sound receiving direction of the second microphone sensor is consistent with the shooting direction of the camera body; in the step S3, the camera body continuously rotates until the second microphone sensor receives the abnormal sound source signal with the maximum decibel, and the pan-tilt camera completes locking the abnormal sound source.
In one embodiment, the camera housing 60 comprises a housing 21, a transverse rotation assembly and a ball-type camera head assembly 24, wherein the camera housing 60 is hollow, one end of the camera housing is connected with the pan-tilt support 30, the other end of the camera housing is provided with a mounting platform, the transverse rotation assembly and the microphone array 10 are both fixed on the mounting platform, and the ball-type camera head assembly 24 is mounted on the rotation end of the transverse rotation assembly.
In one embodiment, the camera housing 60 is shaped as an ellipsoid with a half cut along a short axis, a small-diameter end of the camera housing 60 along a long axis direction is fixedly connected with the pan/tilt head bracket 30, a mounting platform is arranged at a large-diameter end of the camera housing 60 along the long axis direction, the transverse rotating assembly comprises a transverse rotating motor 22 and a rotating bracket 23, the transverse rotating motor 22 is in a cylindrical structure, the transverse rotating motor 22 is arranged in the middle of the mounting platform, the microphone array 10 is annularly arranged at the outer edge of the mounting platform and is located in the outer circumferential direction of the transverse rotating motor 22, the microphone array 10 does not interfere with the rotating assembly, the rotating end of the transverse rotating motor 22 penetrates through the microphone array 10 to be connected with one end of the rotating bracket 23, a mounting ear extends outwards from two sides at the other end of the rotating bracket 23, a longitudinal rotating motor is arranged in the spherical camera assembly 24, an output shaft of the longitudinal rotating motor extends out of the spherical camera assembly 24, and the spherical camera assembly 24 is connected to the mounting ear through the rotatable output shaft.
In one embodiment, the main body of the pan/tilt head camera comprises a gun-shaped camera head, a biaxial rotation mechanism 50 is installed at one end of the pan/tilt head frame 30 connected to the camera housing 60, the camera housing 60 is a square structure, and the middle of the bottom side of the camera housing 60 is rotatably installed on the pan/tilt head frame 30 through the biaxial rotation mechanism 50.
It should be noted that, as shown in fig. 3 and 4, the dual-axis rotating mechanism 50 can be implemented by directly using the prior art, and therefore, the detailed description thereof is omitted.
In one embodiment, the microphone array 10 is disposed around the periphery of the camera housing 60 at the connection with the pan/tilt head support 30.
In one embodiment, the control component includes a power module 44, and a control module 41, a storage module 42 and a network communication module 43 electrically connected to the power module 44, where the control module 41 is electrically connected to the pan/tilt camera body, the microphone array 10, the storage module 42 and the network communication module 43, respectively, and further includes an antenna module 45, and the antenna module 45 is disposed on the pan/tilt camera body upward and electrically connected to the network communication module 43.
In this embodiment, the storage module 42 records and stores the noise data and the video data, and actively pushes the noise data and the video data to the backend service personnel through the network communication module 43.
More specifically, the control module 41 may set a noise threshold level, and after the ambient sound reaches or exceeds the predetermined noise threshold level, the microphone array 10 starts to guide the pan/tilt camera to lock on the noise source, and the storage medium in the storage module 42 starts to cyclically store the collected noise data and visual data.
In one embodiment, adjacent pan-tilt cameras with the ambient noise detection devices are networked through network communication equipment, and continuous locking on a moving noise source can be achieved continuously.
In this embodiment, the cloud deck cameras with the environmental noise detection devices are matched with each other, so that the noise data and the video data can be continuously and timely provided, the background service personnel can be timely informed of the illegal criminal information in real time, and the problem of difficult evidence collection is solved.
Having described embodiments of the present application, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.
Claims (10)
1. The linkage method of the environmental noise detection and the pan-tilt camera is characterized in that more than two pan-tilt cameras integrated with a microphone array are arranged on a road at intervals, and the linkage method comprises the following steps:
s1: the microphone array collects information, the controller judges a suspicious sound source, and the sound direction is judged according to the direction judgment result of the suspicious sound source;
s2: the controller sends a control signal to drive the pan-tilt camera to turn to the direction of the suspicious sound source according to the sound direction judged by the microphone array;
s3: the holder camera locks a target object corresponding to the suspicious sound source according to the audio information and the identified image information, starts to record the audio and video information and uploads the audio and video information to the service terminal;
s4: and the pan-tilt camera at the current position sends a control signal to another pan-tilt camera at the position closest to the target object in the moving direction of the target object, and the pan-tilt camera at the current position is taken over to monitor the target object.
2. The method for detecting the environmental noise and linking the pan/tilt/zoom camera according to claim 1, wherein in the step S1, if the suspicious sound source information collected by the microphone array exceeds a threshold, the sound direction structure is determined, and if the suspicious sound source information does not exceed the threshold, the rest sound sources are continuously monitored;
the abnormal sound source signals exceeding the threshold value comprise a human sound abnormal signal threshold value and a vehicle sound abnormal signal threshold value;
when the microphone array detects abnormal sound source signals exceeding a threshold value, the controller identifies the abnormal sound source signals as human sounds or vehicle sounds;
if the identified abnormal sound source signal is the voice, comparing the identified abnormal sound source signal with the voice abnormal signal threshold, if the identified abnormal sound source signal exceeds the voice abnormal signal threshold, locking the abnormal sound source by the pan-tilt camera, otherwise, judging the abnormal sound source to be a non-abnormal sound source;
if the identified abnormal sound source signal is the car sound, the abnormal sound source signal is compared with the abnormal car sound signal threshold, if the abnormal car sound signal exceeds the abnormal car sound signal threshold, the holder camera locks the abnormal sound source, and if not, the abnormal sound source is judged to be a non-abnormal sound source.
3. The method as claimed in claim 1, wherein in the step S3, after the pan/tilt camera locks the target object, the interference of another suspicious sound source signal sent by the microphone array is no longer received until the monitoring is completed.
4. The method for detecting the environmental noise and linking the pan-tilt camera according to claim 1, wherein a storage module is arranged in the pan-tilt camera, and in the step S3, the recorded audio-video information is stored in the storage module and is sent to the service terminal in real time;
the controller judges according to the current audio information and the real-time video image and judges whether the abnormal event is ended or not;
if the abnormal event is not finished, judging whether the abnormal event exceeds the monitoring range of the holder camera at the current position, if so, executing the step S4, otherwise, continuously recording the audio and video information;
and if the abnormal event is ended, the holder camera is restored to a state to be locked.
5. The method according to claim 1, wherein in the step S4, after the pan/tilt camera closest to the target object in the moving direction of the target object is based on the moving direction information of the target object sent by the controller, the controller drives the pan/tilt camera to rotate in advance to a direction in which the target object may enter the field of view, and the target object is ready to be locked in succession.
6. The method according to claim 1, wherein in the step S4, after the pan/tilt camera at the current position is identified and processed by the service terminal according to the target moving direction information, the service terminal sends control information to another pan/tilt camera at a position closest to the target object;
wherein, the service terminal identifies and processes the moving direction information of the target object and sends the control information to another pan-tilt camera comprises: searching the holder camera integrated with the microphone array in a certain distance range of the current position;
predicting a next one or more of the microphone array integrated pan-tilt cameras that the target object may pass through in its direction of movement;
screening out the pan-tilt camera integrated with the microphone array in the state to be locked;
and sending the target movement information to the pan-tilt camera which is in a state to be locked and is integrated with the microphone array on the possible passing route of the target object.
7. A linkage device using the linkage method of the ambient noise detection and pan/tilt head camera according to any one of claims 1 to 6, comprising a pan/tilt head camera body, a camera housing, a pan/tilt head holder, and a microphone array;
a control component is arranged in the holder camera main body;
the camera shell is covered on the holder camera main body;
the holder camera main body is mounted on the holder bracket through the camera housing, and the holder camera main body can rotate on the holder bracket;
the microphone array is mounted on the camera housing, the microphone array being electrically connected to the control assembly.
8. The linkage of claim 7, wherein the microphone array includes a mounting portion and a microphone sensor;
the mounting part is of an annular structure, a mounting space is formed in the mounting part, and a plurality of sound receiving holes are formed in the outer periphery of the mounting part;
the microphone sensors are arranged in the installation space, the number of the microphone sensors is multiple, and the microphone sensors are uniformly distributed on the periphery of the installation part.
9. The linkage equipment according to claim 8, wherein one of the microphone sensors is arranged opposite to the camera in the pan/tilt camera body and is located right above or right below the camera, and the sound receiving direction of the microphone sensor is the same as the direction faced by the camera.
10. The linkage device according to any one of claims 7 to 9, wherein the control assembly comprises a power module and a control module, a storage module and a network communication module electrically connected thereto;
the control module is respectively and electrically connected with the holder camera main body, the microphone array, the storage module and the network communication module;
still include antenna module, antenna module sets up on the cloud platform camera main part, with the network communication module electricity is connected.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211228423.XA CN115596955A (en) | 2022-10-09 | 2022-10-09 | Linkage method and linkage equipment for environmental noise detection and pan-tilt camera |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211228423.XA CN115596955A (en) | 2022-10-09 | 2022-10-09 | Linkage method and linkage equipment for environmental noise detection and pan-tilt camera |
Publications (1)
Publication Number | Publication Date |
---|---|
CN115596955A true CN115596955A (en) | 2023-01-13 |
Family
ID=84846572
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211228423.XA Pending CN115596955A (en) | 2022-10-09 | 2022-10-09 | Linkage method and linkage equipment for environmental noise detection and pan-tilt camera |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115596955A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN119380449A (en) * | 2024-12-25 | 2025-01-28 | 浙江德施曼科技智能股份有限公司 | A door lock dual-panel monitoring system and intelligent door lock |
-
2022
- 2022-10-09 CN CN202211228423.XA patent/CN115596955A/en active Pending
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN119380449A (en) * | 2024-12-25 | 2025-01-28 | 浙江德施曼科技智能股份有限公司 | A door lock dual-panel monitoring system and intelligent door lock |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5306660B2 (en) | Monitoring system and security management system | |
RU2679338C2 (en) | Mobile gunshot detection | |
JP4617269B2 (en) | Monitoring system | |
KR101445367B1 (en) | Intelligent cctv system to recognize emergency using unusual sound source detection and emergency recognition method | |
US8471910B2 (en) | Methods and apparatus for providing fault tolerance in a surveillance system | |
CA2656268A1 (en) | Video surveillance system and method with combined video and audio recognition | |
JP5525903B2 (en) | Security system | |
US20170223314A1 (en) | Limited Access Community Surveillance System | |
WO1997008896A1 (en) | Open area security system | |
US20200001827A1 (en) | Obtaining identifying information when intrusion is detected | |
JP2006350520A (en) | Peripheral information collection system | |
CN109905672A (en) | A kind of vehicle monitoring method, apparatus and system | |
KR20150060626A (en) | Active Type Unmanned Security System | |
CN106373395A (en) | Driving accident monitoring method and apparatus | |
CN115596955A (en) | Linkage method and linkage equipment for environmental noise detection and pan-tilt camera | |
JP2003219412A (en) | Image recorder for on-vehicle camera | |
CN111613013A (en) | Security positioning analysis early warning system, storage medium and method | |
US20190208168A1 (en) | Limited Access Community Surveillance System | |
CN114365203A (en) | Damage detection and troublemaker tracking | |
CN109410532A (en) | Automatic detection alarm system and method | |
JP2004140586A (en) | Intrusion monitoring system, its control device, monitoring terminal device, and intrusion monitoring program | |
KR102330346B1 (en) | Cctv system using sensor of motion and sensitivity and for the same control method | |
KR20100073671A (en) | Security device | |
JPH1132322A (en) | Automatic tracing system for possessor of dangerous weapon | |
CN219198717U (en) | Cradle head camera with environment noise detection device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB02 | Change of applicant information |
Address after: 100086 1705-712, 17th floor, Qingyun contemporary building, building 9, Manting Fangyuan community, Qingyun Li, Haidian District, Beijing Applicant after: BEIJING ZHI NENG JIA TECHNOLOGY Co.,Ltd. Address before: 100086 1705-713, 17th floor, Qingyun contemporary building, building 9, Manting Fangyuan community, Qingyun Li, Haidian District, Beijing Applicant before: BEIJING ZHI NENG JIA TECHNOLOGY Co.,Ltd. |
|
CB02 | Change of applicant information |