CN113747124A - Video monitoring method and device, storage medium and electronic equipment - Google Patents
Video monitoring method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN113747124A CN113747124A CN202111014739.4A CN202111014739A CN113747124A CN 113747124 A CN113747124 A CN 113747124A CN 202111014739 A CN202111014739 A CN 202111014739A CN 113747124 A CN113747124 A CN 113747124A
- Authority
- CN
- China
- Prior art keywords
- video
- frame image
- current frame
- monitoring
- abnormal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 179
- 238000000034 method Methods 0.000 title claims abstract description 45
- 230000002159 abnormal effect Effects 0.000 claims abstract description 102
- 238000001514 detection method Methods 0.000 claims description 14
- 230000006870 function Effects 0.000 description 13
- 238000012545 processing Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000005484 gravity Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 238000012806 monitoring device Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B17/00—Fire alarms; Alarms responsive to explosion
- G08B17/12—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions
- G08B17/125—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions by using a video camera to detect fire or smoke
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
- G08B21/0407—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis
- G08B21/043—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis detecting an emergency event, e.g. a fall
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
- G08B21/0438—Sensor means for detecting
- G08B21/0476—Cameras to detect unsafe condition, e.g. video cameras
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
- G08B25/08—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using communication transmission lines
Landscapes
- General Physics & Mathematics (AREA)
- Emergency Management (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Gerontology & Geriatric Medicine (AREA)
- Psychiatry (AREA)
- Signal Processing (AREA)
- Social Psychology (AREA)
- Psychology (AREA)
- Alarm Systems (AREA)
Abstract
The application discloses a video monitoring method and device, a storage medium and electronic equipment. The method comprises the following steps: acquiring a monitoring video in real time and uploading the monitoring video to a server; detecting whether a current frame image in the monitoring video is abnormal or not; when the current frame image is detected to be abnormal, the monitoring time point corresponding to the current frame image is sent to the server, so that the server intercepts a video segment from the monitoring video and pushes the video segment to a user side, and the monitoring time period corresponding to the video segment comprises the monitoring time point corresponding to the current frame image. The embodiment of the application can timely remind of monitoring abnormal conditions.
Description
Technical Field
The present application relates to the field of communications technologies, and in particular, to a video monitoring method and apparatus, a storage medium, and an electronic device.
Background
Currently, the application of TV cameras has limited scenes, and most of the applications are limited to video calls or video surveillance. The monitored video needs to be actively viewed by a user through a mobile phone. However, the viewing of the user is random, and if an abnormal condition occurs in the area monitored by the TV camera, the user cannot be notified in time.
Disclosure of Invention
The embodiment of the application provides a video monitoring method and device, a storage medium and electronic equipment, which can prompt monitoring of abnormal conditions in time.
In a first aspect, an embodiment of the present application provides a video monitoring method, where the method includes:
acquiring a monitoring video in real time and uploading the monitoring video to a server;
detecting whether a current frame image in the monitoring video is abnormal or not;
when the current frame image is detected to be abnormal, the monitoring time point corresponding to the current frame image is sent to the server, so that the server intercepts a video segment from the monitoring video and pushes the video segment to a user side, and the monitoring time period corresponding to the video segment comprises the monitoring time point corresponding to the current frame image.
Preferably, the detecting whether the current frame image in the surveillance video is abnormal includes:
detecting whether a current frame image in the monitoring video is the same as a previous frame image;
if not, determining that the current frame image is abnormal.
Preferably, the detecting whether the current frame image in the surveillance video is abnormal includes:
detecting whether a preset object exists in the current frame image;
and if so, determining that the current frame image is abnormal.
Preferably, the detecting whether the current frame image in the surveillance video is abnormal includes:
detecting whether the figure posture in the current frame image is a preset posture or not;
and if so, determining that the current frame image is abnormal.
Preferably, the server comprises a first cloud server and a second cloud server, and the monitoring video is uploaded to the first cloud server;
the sending the monitoring time point corresponding to the current frame image to the server to enable the server to intercept the video segment from the monitoring video and push the video segment to the user side includes:
and sending the monitoring time point corresponding to the current frame image to the second cloud server, so that the second cloud server downloads the video segment in the monitoring video from the first cloud server, generates a video link according to the video segment and sends the video link to the user side.
Preferably, the method further comprises:
when the current frame image is detected to be abnormal, determining the abnormal grade of the current frame image, and sending the abnormal grade to the server, so that the server determines a reminding mode according to the abnormal grade and reminds the user terminal according to the reminding mode.
Preferably, the abnormal level includes a low level, a middle level and a high level, the reminding mode corresponding to the low level is information reminding, the reminding mode corresponding to the middle level is ringing reminding, and the reminding mode corresponding to the high level is telephone reminding.
In a second aspect, an embodiment of the present application further provides a video monitoring apparatus, where the apparatus includes:
the acquisition module is used for acquiring the monitoring video in real time and uploading the monitoring video to the server;
the detection module is used for detecting whether the current frame image in the monitoring video is abnormal or not; and the number of the first and second groups,
and the sending module is used for sending the monitoring time point corresponding to the current frame image to the server when the current frame image is detected to be abnormal, so that the server intercepts a video segment from the monitoring video and pushes the video segment to a user side, wherein the monitoring time period corresponding to the video segment comprises the monitoring time point corresponding to the current frame image.
In a third aspect, an embodiment of the present application further provides a computer-readable storage medium, where a plurality of instructions are stored in the storage medium, and the instructions are adapted to be loaded by a processor to perform the above video monitoring method.
In a fourth aspect, an embodiment of the present application further provides an electronic device, which includes a processor and a memory, where the processor is electrically connected to the memory, the memory is used to store instructions and data, and the processor is used to execute the above video monitoring method.
The video monitoring method, the video monitoring device, the storage medium and the electronic equipment can acquire the monitoring video in real time and upload the monitoring video to the server, when the current frame image in the monitoring video is detected to be abnormal, the monitoring time point corresponding to the current frame image is sent to the server, so that the server intercepts the video segment from the monitoring video and pushes the video segment to the user side, wherein the monitoring time period corresponding to the video segment comprises the monitoring time point corresponding to the current frame image, namely when the abnormal condition is monitored, the related video segment can be sent to the user side in time, and therefore the user is reminded of viewing the corresponding video segment in time.
Drawings
The technical solution and other advantages of the present application will become apparent from the detailed description of the embodiments of the present application with reference to the accompanying drawings.
Fig. 1 is a schematic flowchart of a video monitoring method according to an embodiment of the present application.
Fig. 2 is another schematic flow chart of a video monitoring method according to an embodiment of the present application.
Fig. 3 is a timing diagram of a video monitoring method according to an embodiment of the present application.
Fig. 4 is a schematic structural diagram of a video monitoring apparatus according to an embodiment of the present application.
Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Fig. 6 is another schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a schematic flowchart of a video monitoring method provided in an embodiment of the present application, where the video monitoring method is applied to an electronic device, and the video monitoring method may include steps 101 to 103:
101. and acquiring the monitoring video in real time and uploading the monitoring video to a server.
In the embodiment of the present application, the electronic device has an image capturing apparatus, for example, the electronic device may refer to a display device (such as a television TV) having a camera. The electronic equipment has a monitoring function, and during the working period of the electronic equipment, if the monitoring function of the electronic equipment is turned on, the electronic equipment starts the image acquisition device and acquires a video in real time through the image acquisition device, and the video acquired by the electronic equipment in real time is the monitoring video. Meanwhile, the electronic equipment uploads the monitoring video acquired in real time to the server, and the server stores the monitoring video uploaded by the electronic equipment. It should be noted that the monitoring video in this embodiment may include image data and may also include audio data.
The server may include a first cloud server, and the first cloud server may be a streaming server specifically for a live service scenario, for example, a streaming server of the arrhizus. The electronic equipment uploads the monitoring video collected in real time to the first cloud server for storage, and the processing efficiency of the monitoring video is improved.
102. And detecting whether the current frame image in the monitoring video is abnormal.
In the embodiment of the present application, an AI identification SDK (Software Development Kit) is installed in the electronic device. The electronic equipment uploads the collected monitoring video to the server, and simultaneously detects each frame of image in the monitoring video through AI identification SDK, namely, each frame of image is detected every time the electronic equipment collects one frame of image, so as to judge whether the collecting area of the electronic equipment is abnormal or not. The abnormal condition may include that a person, a pet, or other objects appear in the acquisition area of the electronic device, dangerous objects such as flames appear in the acquisition area of the electronic device, the person falls down in the acquisition area of the electronic device, and the like. The electronic equipment can train the recognition model in advance, so that when the electronic equipment acquires the current frame image of the monitoring video, whether the current frame image is abnormal can be rapidly detected through the recognition model.
103. When the current frame image is detected to be abnormal, the monitoring time point corresponding to the current frame image is sent to the server, so that the server intercepts a video segment from the monitoring video and pushes the video segment to a user side, and the monitoring time period corresponding to the video segment comprises the monitoring time point corresponding to the current frame image.
In the embodiment of the present application, the monitoring time point corresponding to the current frame image refers to an acquisition time point when the electronic device acquires the current frame image. The server further comprises a second cloud server, and when the electronic equipment detects that the current frame image is abnormal, the monitoring time point corresponding to the current frame image can be sent to the second cloud server. And the second cloud server determines a monitoring time period containing the monitoring time point, and downloads a video clip corresponding to the monitoring time period from the monitoring video stored in the first cloud server.
The monitoring time period corresponding to the video segment comprises the monitoring time point corresponding to the current frame image, so that the video segment is associated with the current frame image, namely the video segment can reflect the occurrence process of abnormal conditions. Because the processing of image detection and information sending needs a certain time, the downloading time point of the second cloud server downloading the video clip is different from the monitoring time point corresponding to the current frame image, and the downloading time point is located after the monitoring time point, so the monitoring time period corresponding to the video clip can include a time period located after the monitoring time point.
The monitoring time period may further include a pre-set time period before the monitoring time point and/or a post-set time period after the monitoring time point, for example, the monitoring time period includes 10 seconds before and after the monitoring time point. The preset time period can be set by a user, and can also be set by the electronic equipment correspondingly according to different abnormal conditions. The pre-set time period and the post-set time period may be the same or different.
The second cloud server stores the video clips after acquiring the video clips, and pushes the video clips to the user side according to a preset mode, so that the user can check the video clips through the user side and know abnormal monitoring conditions in time. The preset mode can be that the video clip is directly sent to the user side, or a plurality of frames of images are obtained from the video clip, the plurality of frames of images are converted into dynamic images to be sent to the user side, or a video link is generated according to the video clip, the video link is sent to the user side, and the user can view the video clip from the second cloud server through the video link.
Referring to fig. 2, it is another schematic flow chart of the video monitoring method provided in the embodiment of the present application, where the video monitoring method is applied to an electronic device, and a specific flow of the video monitoring method may be as follows:
201. and acquiring a monitoring video in real time and uploading the monitoring video to the first cloud server.
For example, the electronic device is a television with a camera, and as shown in fig. 3, the television starts the camera to shoot a monitoring video in real time through the camera. And then, the television terminal uploads the monitoring video shot in real time to the first cloud server, and the first cloud server stores the monitoring video uploaded by the television terminal.
202. And detecting whether the current frame image in the monitoring video is abnormal, if so, detecting the next frame image in the monitoring video, and if not, executing the step 203.
As shown in fig. 3, an AI identification SDK is installed in the television terminal, and the television terminal acquires each frame of image in the monitoring video in real time and transmits each frame of image to the AI identification SDK one by one. Every time the AI identification SDK acquires one frame of image, detecting the current frame of image to judge whether the current frame of image is abnormal, and if the current frame of image is not abnormal, continuously detecting the next frame of image by the AI identification SDK; if the current frame image is abnormal, step 203 is executed.
The AI recognition SDK may detect whether the current frame image is abnormal in various ways. In the first embodiment, the detecting whether the current frame image in the surveillance video is abnormal in step 102 includes: detecting whether a current frame image in the monitoring video is the same as a previous frame image; if not, determining that the current frame image is abnormal.
It should be noted that, if a person, a pet, or another object appears in the acquisition area of the electronic device, or the person, the pet, or another object moves in the acquisition area of the electronic device, that is, the current frame image acquired by the electronic device has a person, a pet, or another object, but the previous frame image acquired by the electronic device does not have a person, a pet, or another object, or the position of the person, the pet, or another object in the current frame image is different from the position of the previous frame image, it indicates that the current frame image is different from the previous frame image, determines that the current frame image is abnormal, and continues to execute step 103; if the person, the pet or other objects do not appear in the acquisition area of the electronic equipment or the person, the pet or other objects do not move in the acquisition area of the electronic equipment, it is indicated that the current frame image is the same as the previous frame image, and it is determined that the current frame image is not abnormal and does not need to be processed. The current frame image abnormality means that the current frame image needs to be reminded to a user, and does not mean that the current frame image is abnormal.
In the second embodiment, the detecting whether the current frame image in the surveillance video is abnormal in step 102 includes: detecting whether a preset object exists in the current frame image; and if so, determining that the current frame image is abnormal.
The preset object may be a preset dangerous object, such as a flame. If dangerous objects such as flames and the like appear in the current frame image, indicating that dangerous objects appear in the acquisition area of the electronic equipment, determining that the current frame image is abnormal, and continuing to execute the step 103; if the current frame image does not have dangerous objects such as flames and the like, it is indicated that dangerous objects do not appear in the acquisition area of the electronic equipment, and the current frame image is determined to be abnormal without any processing.
In a third embodiment, the detecting whether the current frame image in the surveillance video is abnormal in step 102 includes: detecting whether the figure posture in the current frame image is a preset posture or not; and if so, determining that the current frame image is abnormal.
Wherein, predetermine the gesture and can be the dangerous gesture of presetting, for example fall, climb to eminence etc.. If the person posture in the current frame image is a dangerous posture, the person in the acquisition area of the electronic equipment is in a dangerous state, the current frame image is determined to be abnormal, and the step 103 is continuously executed; if the character posture in the current frame image is not the dangerous posture, the character in the acquisition area of the electronic equipment is not in the dangerous state, the current frame image is determined to be abnormal, and no processing is needed.
It should be noted that when the gesture of the person in the current frame image is determined to be the preset gesture, a multi-frame image before the current frame image may also be acquired, and the lowering height and the lowering speed of the gravity center of the person are determined by combining the acquired multi-frame image and the current frame image, so as to further determine whether the person in the acquisition area of the electronic device falls down.
The first to third embodiments may be used alone or in combination. For example, whether the current frame image is the same as the previous frame image is detected, if not, whether a preset object exists in the current frame image is detected, if so, the current frame image is determined to be abnormal, otherwise, the current frame image is determined to be abnormal. For another example, whether a person exists in the current frame image is detected, if so, whether the person posture in the current frame image is a preset posture is detected, if so, the current frame image is determined to be abnormal, otherwise, the current frame image is determined to be abnormal.
203. And determining the monitoring time point and the abnormal grade of the current frame image.
As shown in fig. 3, when the AI identification SDK detects that the current frame image is abnormal, the abnormal result is fed back to the television. The abnormal result comprises a monitoring time point and an abnormal grade of the current frame image. The monitoring time point is the shooting time point of the current frame image.
The current frame image may have a plurality of anomaly types, and different anomaly types may correspond to different anomaly levels. The exception levels may include a low level, a medium level, and a high level, among others. For example, if the current frame image has a preset object (such as a dangerous object like a flame), determining that the abnormal level of the current frame image is a high level; if the posture of the person in the current frame image is a preset posture (such as falling), determining that the abnormal grade of the current frame image is a medium grade; and if the current frame image does not have the preset object, the posture of the person in the current frame image is not the preset posture, but the current frame image is different from the previous frame image, determining that the abnormal grade of the current frame image is low grade.
204. Sending a monitoring time point and an abnormal grade corresponding to a current frame image to a second cloud server, enabling the second cloud server to download a video segment in the monitoring video from the first cloud server, generating a video link according to the video segment, determining a reminding mode according to the abnormal grade, pushing the video segment to the user side, and reminding the user side according to the reminding mode; and the monitoring time section corresponding to the video clip comprises the monitoring time point corresponding to the current frame image.
As shown in fig. 3, the tv sends the abnormal result to the second cloud server through webhook technology. webhook in the web development process is a method for adding or changing the behavior of a web page or a web app (web-based application) through a normal callback. The second cloud server downloads the video segments in the monitoring videos from the first cloud server, the first cloud server feeds the video segments back to the second cloud server, and the monitoring time periods corresponding to the video segments comprise monitoring time points corresponding to the current frame images, so that the video segments are videos related to the current frame images. And after the second cloud server acquires the video clip, storing the video clip and generating a video link URL according to the video clip.
Meanwhile, the second cloud server determines a reminding mode according to the abnormal grade. The reminding mode can comprise information reminding, ringing reminding, telephone reminding and the like. If the abnormal grade is a low grade, the reminding mode can be information reminding; if the abnormal grade is a medium grade, the reminding mode can be ringing reminding; if the abnormal grade is high grade, the reminding mode can be telephone reminding.
And then, the second cloud server sends the video link URL to the user side, meanwhile, the user side is reminded according to the determined reminding mode, and the user can check the video clips through the URL according to the reminding mode and timely know the abnormal condition. For example, if a person or a pet appears in a shooting area of the television, the second cloud server sends information to the user side to remind the user; if the person falls down in the shooting area of the television end, the second cloud server controls the user end to ring so as to remind the user; and if the fire occurs in the shooting area of the television end, namely a fire occurs, the second cloud server makes a call to the user end, and the user is reminded in time. According to the embodiment, the abnormal condition of the user is reminded through monitoring of the television end, so that the use scene of the television end is enriched, and more service experience is brought to the user.
The video monitoring method can acquire the monitoring video in real time and upload the monitoring video to the server, and when the current frame image in the monitoring video is detected to be abnormal, the monitoring time point corresponding to the current frame image is sent to the server, so that the server intercepts the video segment from the monitoring video and pushes the video segment to the user side, wherein the monitoring time period corresponding to the video segment comprises the monitoring time point corresponding to the current frame image, namely when the abnormal condition is monitored, the related video segment can be sent to the user side in time, and therefore the user is reminded to check the corresponding video segment in time.
According to the method described in the foregoing embodiment, this embodiment will be further described from the perspective of a video monitoring apparatus, which may be specifically implemented as an independent entity, or may be integrated in an electronic device, where the electronic device may include a PC terminal and the like. The electronic device may be connected to a network.
Referring to fig. 4, fig. 4 specifically illustrates a video monitoring apparatus provided in an embodiment of the present application, where the video monitoring apparatus may include:
the acquisition module 301 is configured to acquire a monitoring video in real time and upload the monitoring video to a server;
a detecting module 302, configured to detect whether a current frame image in the surveillance video is abnormal; and the number of the first and second groups,
a sending module 303, configured to send the monitoring time point corresponding to the current frame image to the server when the current frame image is detected to be abnormal, so that the server captures a video segment from the monitoring video and pushes the video segment to a user side, where the monitoring time period corresponding to the video segment includes the monitoring time point corresponding to the current frame image.
In some embodiments of the present application, the detection module 302 is specifically configured to:
detecting whether a current frame image in the monitoring video is the same as a previous frame image;
if not, determining that the current frame image is abnormal.
In some embodiments of the present application, the detection module 302 is specifically configured to:
detecting whether a preset object exists in the current frame image;
and if so, determining that the current frame image is abnormal.
In some embodiments of the present application, the detection module 302 is specifically configured to:
detecting whether the figure posture in the current frame image is a preset posture or not;
and if so, determining that the current frame image is abnormal.
In some embodiments of the present application, the server includes a first cloud server and a second cloud server, and the monitoring video is uploaded to the first cloud server;
the sending module 303 is further configured to:
and sending the monitoring time point corresponding to the current frame image to the second cloud server, so that the second cloud server downloads the video segment in the monitoring video from the first cloud server, generates a video link according to the video segment and sends the video link to the user side.
In some embodiments of the present application, the apparatus further comprises a determination module to:
when the current frame image is detected to be abnormal, determining the abnormal grade of the current frame image, and sending the abnormal grade to the server, so that the server determines a reminding mode according to the abnormal grade and reminds the user terminal according to the reminding mode.
In some embodiments of the present application, the exception levels include a low level, a middle level, and a high level, the reminding manner corresponding to the low level is information reminding, the reminding manner corresponding to the middle level is ringing reminding, and the reminding manner corresponding to the high level is telephone reminding.
According to the video monitoring device, the monitoring video can be acquired in real time and uploaded to the server, when the current frame image in the monitoring video is detected to be abnormal, the monitoring time points corresponding to the current frame image are sent to the server, the server can intercept the video segments from the monitoring video and push the video segments to the user side, the monitoring time periods corresponding to the video segments comprise the monitoring time points corresponding to the current frame image, namely when the abnormal condition is monitored, the related video segments can be sent to the user side in time, and therefore the user is reminded of viewing the corresponding video segments in time.
In addition, the embodiment of the application also provides electronic equipment. As shown in fig. 5, the electronic device 800 includes a processor 801, a memory 802. The processor 801 is electrically connected to the memory 802.
The processor 801 is a control center of the electronic device 800, connects various parts of the entire electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by running or loading an application program stored in the memory 802 and calling data stored in the memory 802, thereby performing overall monitoring of the electronic device.
In this embodiment, the acquisition module 301, the detection module 302, and the detection module 303 shown in fig. 4 may be application programs stored in the memory 802. The processor 801 in the electronic device 800 executes the acquisition module 301, the detection module 302, and the transmission module 303 stored in the memory 802 to thereby implement various functions. The acquisition module 301, when executed by the processor 801, is configured to acquire and upload a surveillance video to a server in real time. The detecting module 302, when executed by the processor 801, is configured to detect whether a current frame image in the surveillance video is abnormal. When being executed by the processor 801, the sending module 303 is configured to send the monitoring time point corresponding to the current frame image to the server when detecting that the current frame image is abnormal, so that the server intercepts a video segment from the monitoring video and pushes the video segment to a user side, where the monitoring time period corresponding to the video segment includes the monitoring time point corresponding to the current frame image.
Referring to fig. 6, fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. The electronic device may be configured to implement the video monitoring method provided in the above-described embodiment. The electronic device may be connected to a network.
The RF circuit 710 is used for receiving and transmitting electromagnetic waves, and performing interconversion between the electromagnetic waves and electrical signals, thereby communicating with a communication network or other devices. The RF circuitry 710 may include various existing circuit elements for performing these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption/decryption chips, Subscriber Identity Module (SIM) cards, memory, and so forth. The RF circuit 710 may communicate with various networks such as the internet, an intranet, a wireless network, or with other devices over a wireless network. The wireless network may comprise a cellular telephone network, a wireless local area network, or a metropolitan area network. The Wireless network may use various Communication standards, protocols, and technologies, including, but not limited to, Global System for Mobile Communication (GSM), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (WCDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Wireless Fidelity (Wi-Fi) (e.g., Institute of Electrical and Electronics Engineers (IEEE) standard IEEE802.11 a, IEEE802.11 b, IEEE802.11g, and/or IEEE802.11 n), Voice over Internet Protocol (VoIP), world wide mail Access (Microwave Access for micro), wimax-1, other suitable short message protocols, and any other suitable Protocol for instant messaging, and may even include those protocols that have not yet been developed.
The memory 720 may be used to store software programs and modules, such as the corresponding program instructions/modules in the above-described embodiments, and the processor 780 may execute various functional applications and data processing by executing the software programs and modules stored in the memory 720. The memory 720 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, memory 720 may further include memory located remotely from processor 780, which may be connected to electronic device 700 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input unit 730 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, the input unit 730 may include a touch-sensitive surface 731 as well as other input devices 732. Touch-sensitive surface 731, also referred to as a touch display screen (touch screen) or touch pad, can collect touch operations by a user on or near touch-sensitive surface 731 (e.g., operations by a user on or near touch-sensitive surface 731 using a finger, a stylus, or any other suitable object or attachment), and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface 731 may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts it to touch point coordinates, and sends the touch point coordinates to the processor 780, and can receive and execute commands from the processor 780. In addition, the touch-sensitive surface 731 can be implemented in a variety of types, including resistive, capacitive, infrared, and surface acoustic wave. The input unit 730 may also include other input devices 732 in addition to the touch-sensitive surface 731. In particular, other input devices 732 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.
The display unit 740 may be used to display information input by or provided to the user and various graphical user interfaces of the electronic device 700, which may be made up of graphics, text, icons, video, and any combination thereof. The Display unit 740 may include a Display panel 741, and optionally, the Display panel 741 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Further, touch-sensitive surface 731 can overlay display panel 741, such that when touch-sensitive surface 731 detects a touch event thereon or nearby, processor 780 can determine the type of touch event, and processor 780 can then provide a corresponding visual output on display panel 741 based on the type of touch event. Although in the figure the touch sensitive surface 731 and the display panel 741 are shown as two separate components to implement input and output functions, it will be appreciated that the touch sensitive surface 731 and the display panel 741 are integrated to implement input and output functions.
The electronic device 700 may also include at least one sensor 750, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel 741 according to the brightness of ambient light, and a proximity sensor that may generate an interrupt when the folder is closed or closed. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which may be further configured to the electronic device 700, detailed descriptions thereof are omitted.
The audio circuit 760, speaker 761, and microphone 762 may provide an audio interface between a user and the electronic device 700. The audio circuit 760 can transmit the electrical signal converted from the received audio data to the speaker 761, and the electrical signal is converted into a sound signal by the speaker 761 and output; on the other hand, the microphone 762 converts the collected sound signal into an electric signal, converts the electric signal into audio data after being received by the audio circuit 760, processes the audio data by the audio data output processor 780, and transmits the processed audio data to, for example, another terminal via the RF circuit 710, or outputs the audio data to the memory 720 for further processing. The audio circuitry 760 may also include an earbud jack to provide communication of a peripheral headset with the electronic device 700.
The electronic device 700, via the transport module 770 (e.g., a Wi-Fi module), may assist the user in receiving requests, sending information, etc., which provides the user with wireless broadband internet access. Although the transmission module 770 is illustrated, it is understood that it does not belong to the essential constitution of the electronic device 700 and may be omitted entirely as needed within the scope not changing the essence of the invention.
The processor 780 is a control center of the electronic device 700, connects various parts of the entire cellular phone using various interfaces and lines, and performs various functions of the electronic device 700 and processes data by operating or executing software programs and/or modules stored in the memory 720 and calling data stored in the memory 720, thereby integrally monitoring the electronic device. Optionally, processor 780 may include one or more processing cores; in some embodiments, processor 780 may integrate an application processor that handles primarily the operating system, user interface, applications, etc. and a modem processor that handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 780.
The electronic device 700 also includes a power supply 790 (e.g., a battery) that provides power to various components, and in some embodiments may be logically coupled to the processor 780 via a power management system that may perform functions such as managing charging, discharging, and power consumption. The power supply 790 may also include any component including one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.
Although not shown, the electronic device 700 further includes a camera (e.g., a front camera, a rear camera), a bluetooth module, and the like, which are not described in detail herein. Specifically, in this embodiment, the display unit of the electronic device is a touch screen display, the electronic device further includes a memory, and the obtaining module 301, the detecting module 302, and the detecting module 303 shown in fig. 4 may be application programs stored in the memory 720. The processor 780 in the electronic device 800 executes the acquisition module 301, the detection module 302, and the transmission module 303 stored in the memory 720 to implement various functions. The acquisition module 301, when executed by the processor 780, is configured to acquire and upload the surveillance video to a server in real time. The detection module 302, when executed by the processor 780, is configured to detect whether a current frame image in the surveillance video is abnormal. When being executed by the processor 780, the sending module 303 is configured to send the monitoring time point corresponding to the current frame image to the server when the current frame image is detected to be abnormal, so that the server intercepts a video segment from the monitoring video and pushes the video segment to a user side, where the monitoring time period corresponding to the video segment includes the monitoring time point corresponding to the current frame image.
In specific implementation, the above modules may be implemented as independent entities, or may be combined arbitrarily to be implemented as the same or several entities, and specific implementation of the above modules may refer to the foregoing method embodiments, which are not described herein again.
It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor. To this end, embodiments of the present invention provide a storage medium, in which a plurality of instructions are stored, where the instructions can be loaded by a processor to execute steps in any one of the video monitoring methods provided by the embodiments of the present invention.
Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
Since the instructions stored in the storage medium can execute the steps in any video monitoring method provided in the embodiments of the present invention, beneficial effects that can be achieved by any video monitoring method provided in the embodiments of the present invention can be achieved, which are detailed in the foregoing embodiments and will not be described herein again.
The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.
In summary, although the present application has been described with reference to the preferred embodiments, the above-described preferred embodiments are not intended to limit the present application, and those skilled in the art can make various changes and modifications without departing from the spirit and scope of the present application, so that the scope of the present application shall be determined by the appended claims.
Claims (10)
1. A video surveillance method, the method comprising:
acquiring a monitoring video in real time and uploading the monitoring video to a server;
detecting whether a current frame image in the monitoring video is abnormal or not;
when the current frame image is detected to be abnormal, the monitoring time point corresponding to the current frame image is sent to the server, so that the server intercepts a video segment from the monitoring video and pushes the video segment to a user side, and the monitoring time period corresponding to the video segment comprises the monitoring time point corresponding to the current frame image.
2. The video monitoring method according to claim 1, wherein the detecting whether the current frame image in the monitored video is abnormal comprises:
detecting whether a current frame image in the monitoring video is the same as a previous frame image;
if not, determining that the current frame image is abnormal.
3. The video monitoring method according to claim 1, wherein the detecting whether the current frame image in the monitored video is abnormal comprises:
detecting whether a preset object exists in the current frame image;
and if so, determining that the current frame image is abnormal.
4. The video monitoring method according to claim 1, wherein the detecting whether the current frame image in the monitored video is abnormal comprises:
detecting whether the figure posture in the current frame image is a preset posture or not;
and if so, determining that the current frame image is abnormal.
5. The video monitoring method according to claim 1, wherein the server comprises a first cloud server and a second cloud server, and the monitoring video is uploaded to the first cloud server;
the sending the monitoring time point corresponding to the current frame image to the server to enable the server to intercept the video segment from the monitoring video and push the video segment to the user side includes:
and sending the monitoring time point corresponding to the current frame image to the second cloud server, so that the second cloud server downloads the video segment in the monitoring video from the first cloud server, generates a video link according to the video segment and sends the video link to the user side.
6. The video surveillance method of claim 1, further comprising:
when the current frame image is detected to be abnormal, determining the abnormal grade of the current frame image, and sending the abnormal grade to the server, so that the server determines a reminding mode according to the abnormal grade and reminds the user terminal according to the reminding mode.
7. The video monitoring method according to claim 6, wherein the abnormal levels include a low level, a middle level and a high level, the reminding mode corresponding to the low level is an information reminding mode, the reminding mode corresponding to the middle level is a ringing reminding mode, and the reminding mode corresponding to the high level is a telephone reminding mode.
8. A video monitoring apparatus, comprising:
the acquisition module is used for acquiring the monitoring video in real time and uploading the monitoring video to the server;
the detection module is used for detecting whether the current frame image in the monitoring video is abnormal or not; and the number of the first and second groups,
and the sending module is used for sending the monitoring time point corresponding to the current frame image to the server when the current frame image is detected to be abnormal, so that the server intercepts a video segment from the monitoring video and pushes the video segment to a user side, wherein the monitoring time period corresponding to the video segment comprises the monitoring time point corresponding to the current frame image.
9. A computer readable storage medium having stored therein a plurality of instructions adapted to be loaded by a processor to perform the video surveillance method of any of claims 1 to 7.
10. An electronic device comprising a processor and a memory, the processor being electrically connected to the memory, the memory being configured to store instructions and data, the processor being configured to perform the video surveillance method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111014739.4A CN113747124A (en) | 2021-08-31 | 2021-08-31 | Video monitoring method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111014739.4A CN113747124A (en) | 2021-08-31 | 2021-08-31 | Video monitoring method and device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113747124A true CN113747124A (en) | 2021-12-03 |
Family
ID=78734403
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111014739.4A Pending CN113747124A (en) | 2021-08-31 | 2021-08-31 | Video monitoring method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113747124A (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130016213A1 (en) * | 2011-07-12 | 2013-01-17 | Solutions Xyz, Llc. | System and method for capturing and delivering video images |
| CN203482325U (en) * | 2013-08-27 | 2014-03-12 | 东南大学 | Intelligent video monitoring system |
| CN104796660A (en) * | 2014-01-20 | 2015-07-22 | 腾讯科技（深圳）有限公司 | Antitheft alarm method and device |
| CN205754640U (en) * | 2016-05-23 | 2016-11-30 | 深圳市爱丰达盛科技有限公司 | A kind of drive recorder and video monitoring apparatus thereof |
| CN108769604A (en) * | 2018-06-13 | 2018-11-06 | 深圳绿米联创科技有限公司 | Processing method, device, terminal device and the storage medium of monitor video |
| CN109361903A (en) * | 2018-11-20 | 2019-02-19 | 左凌云 | A kind of mining real-time method for inspecting and its device |
| CN109922310A (en) * | 2019-01-24 | 2019-06-21 | 北京明略软件系统有限公司 | The monitoring method of target object, apparatus and system |
| CN110443109A (en) * | 2019-06-11 | 2019-11-12 | 万翼科技有限公司 | Abnormal behaviour monitor processing method, device, computer equipment and storage medium |
| CN111243127A (en) * | 2018-11-13 | 2020-06-05 | 中国电信股份有限公司 | Intelligent door lock configuration method and device and intelligent door lock system |
| CN111563396A (en) * | 2019-01-25 | 2020-08-21 | 北京嘀嘀无限科技发展有限公司 | Method and device for online identifying abnormal behavior, electronic equipment and readable storage medium |
| CN111666915A (en) * | 2020-06-18 | 2020-09-15 | 上海眼控科技股份有限公司 | Monitoring method, device, equipment and storage medium |
| CN112052765A (en) * | 2020-08-27 | 2020-12-08 | 江苏建筑职业技术学院 | A kind of intelligent furniture for the elderly with protective function and control method thereof |
| CN112476452A (en) * | 2020-11-26 | 2021-03-12 | 陕西科技大学 | Indoor service robot for solitary old people and operation method |
-
2021
- 2021-08-31 CN CN202111014739.4A patent/CN113747124A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130016213A1 (en) * | 2011-07-12 | 2013-01-17 | Solutions Xyz, Llc. | System and method for capturing and delivering video images |
| CN203482325U (en) * | 2013-08-27 | 2014-03-12 | 东南大学 | Intelligent video monitoring system |
| CN104796660A (en) * | 2014-01-20 | 2015-07-22 | 腾讯科技（深圳）有限公司 | Antitheft alarm method and device |
| CN205754640U (en) * | 2016-05-23 | 2016-11-30 | 深圳市爱丰达盛科技有限公司 | A kind of drive recorder and video monitoring apparatus thereof |
| CN108769604A (en) * | 2018-06-13 | 2018-11-06 | 深圳绿米联创科技有限公司 | Processing method, device, terminal device and the storage medium of monitor video |
| CN111243127A (en) * | 2018-11-13 | 2020-06-05 | 中国电信股份有限公司 | Intelligent door lock configuration method and device and intelligent door lock system |
| CN109361903A (en) * | 2018-11-20 | 2019-02-19 | 左凌云 | A kind of mining real-time method for inspecting and its device |
| CN109922310A (en) * | 2019-01-24 | 2019-06-21 | 北京明略软件系统有限公司 | The monitoring method of target object, apparatus and system |
| CN111563396A (en) * | 2019-01-25 | 2020-08-21 | 北京嘀嘀无限科技发展有限公司 | Method and device for online identifying abnormal behavior, electronic equipment and readable storage medium |
| CN110443109A (en) * | 2019-06-11 | 2019-11-12 | 万翼科技有限公司 | Abnormal behaviour monitor processing method, device, computer equipment and storage medium |
| CN111666915A (en) * | 2020-06-18 | 2020-09-15 | 上海眼控科技股份有限公司 | Monitoring method, device, equipment and storage medium |
| CN112052765A (en) * | 2020-08-27 | 2020-12-08 | 江苏建筑职业技术学院 | A kind of intelligent furniture for the elderly with protective function and control method thereof |
| CN112476452A (en) * | 2020-11-26 | 2021-03-12 | 陕西科技大学 | Indoor service robot for solitary old people and operation method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9697622B2 (en) | Interface adjustment method, apparatus, and terminal | |
| CN104383681B (en) | Method for controlling game program, device and mobile terminal | |
| EP3594848B1 (en) | Queue information acquisition method, device and computer readable storage medium | |
| CN107241552B (en) | Image acquisition method, device, storage medium and terminal | |
| CN111741058A (en) | Message pushing method and device, electronic equipment and storage medium | |
| CN110719319B (en) | Resource sharing method, device, terminal equipment and storage medium | |
| CN105094501B (en) | Method, device and system for displaying messages in mobile terminal | |
| CN106101764A (en) | A kind of methods, devices and systems showing video data | |
| CN107801201A (en) | Network recovery method and device | |
| CN103068016B (en) | The method of mobile terminal and reduction power consumption thereof | |
| CN109714476B (en) | Data processing method and device, mobile terminal and storage medium | |
| CN108810057B (en) | User behavior data acquisition method and device and storage medium | |
| CN108718389B (en) | Shooting mode selection method and mobile terminal | |
| CN107018328A (en) | A kind of image scan method method and image-scanning device | |
| KR20190101427A (en) | Image Synthesis Methods, Devices, and Non-Volatile Computer-readable Media | |
| CN109561255B (en) | Terminal photographing method and device and storage medium | |
| CN110868531B (en) | Method and device for sending trigger signal | |
| CN107622234B (en) | Method and device for displaying budding face gift | |
| CN115174418A (en) | Communication environment safety early warning method and device, electronic equipment and storage medium | |
| CN105700801B (en) | Interface intercepting method and equipment | |
| CN107688498B (en) | Application program processing method and device, computer equipment and storage medium | |
| CN110086999B (en) | Image information feedback method and terminal equipment | |
| CN108076287B (en) | Image processing method, mobile terminal and computer readable storage medium | |
| CN107800720B (en) | Hijacking reporting method, device, storage medium and equipment | |
| CN113747124A (en) | Video monitoring method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211203 |
|
| RJ01 | Rejection of invention patent application after publication |