CN105786975A - Massive video storage method used for quick search - Google Patents
Massive video storage method used for quick search Download PDFInfo
- Publication number
- CN105786975A CN105786975A CN201610079407.7A CN201610079407A CN105786975A CN 105786975 A CN105786975 A CN 105786975A CN 201610079407 A CN201610079407 A CN 201610079407A CN 105786975 A CN105786975 A CN 105786975A
- Authority
- CN
- China
- Prior art keywords
- video data
- block
- file
- video
- space
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/71—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Software Systems (AREA)
- Library & Information Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a massive video storage method used for quick search. The method comprises the following steps of creating a video data block space; judging whether an IP block is received, if yes, ending, otherwise entering the next step; judging whether the current video data block space is full, if yes, entering the next step, otherwise continuing to receive the IP block; settling, closing and renaming the current video data block space; judging whether the updating time of a filing catalog is up, if yes, entering the next step, otherwise jumping to a filing step; deleting a content of the filing catalog with the longest storage time; filing the current video data block space; creating a new video data block space; and extracting video data in the IP block, analyzing VMD (Visual Merchandising) information of the IP block, updating an REC file, an IDX file and a TLI file in the current video block space and returning to the step of judging whether the IP block is received. The method has the advantages of high storage efficiency, no disk fragmentation and high search speed and search efficiency for massive videos.
Description
Technical field
The present invention relates to a kind of massive video storage method being applicable to massive video is carried out quick-searching location, belong to video data technical field of memory.
Background technology
Along with the appearance of the deep construction of safe city and HD video, video memory presents the situation of quickly growth.For Tianjin, the whole city's 1,000,000 video cameras video memory of month nearly just can reach E level, it is seen then that so video data of flood tide, how to realize quick-searching and location, it is achieved effectively utilizing of massive video is to put a difficult problem at all system for managing video.
Traditional system for managing video generally adopts the storage mode of large database concept to realize the management of massive video, retrieval and location, this storage mode needs to expend substantial amounts of database resource, huge workload is all there is in system deployment, database maintenance etc., and the professional standards of personnel are required height, visible, not only hardware cost is high, and cost of labor is not low yet.Additionally; increase along with the video data volume of storage; on the one hand; factor data bank is limited; the storage size of video data can be restricted, and on the other hand, the capacity of database retrieval is also by linear increment; retrieval rate becomes very slow because of the video data of flood tide, it is impossible to meet the demand of quick-searching now.
Summary of the invention
It is an object of the invention to provide a kind of massive video for quick-searching and store method, it stores with the form of " time index+block of video data ", it is to avoid disk fragments, improves storage efficiency, and when massive video is retrieved, improve retrieval rate and efficiency.
To achieve these goals, present invention employs techniques below scheme:
A kind of massive video for quick-searching stores method, it is characterised in that it includes step:
1) video data block space is created, wherein: video data block space is provided with block of video data storage file, block of video data index file and video display state storage file；
2) judge whether block of video data has received: if so, then terminate；If it is not, then enter 3)；
3) judge whether current video data block space stores full: if so, then enter 4)；If it is not, then enter 9) continue to block of video data；
4) arrange current video data block space, close and rename current video data block space；
5) judge whether that arriving filing catalogue updates the time: if so, then enter 6)；If it is not, then enter 7)；
6) the filing directory content that the deletion holding time is the longest；
7) filing current video data block space；
8) new video data block space is created；
9) extract the video data in block of video data and analyze the motion vector detecting information of block of video data, update the block of video data storage file in current video data block space, block of video data index file and video display state storage file, return 2).
The invention have the advantage that
1, although what video data itself embodied when storage is random destructuring feature, but it is can be structurized on Method of Data Organization, it has very strong systematicness, therefore, the present invention is directed to this structured features in video data tissue mode, the video data of stream mode is carried out structuring abstract, store with the form of " time index+block of video data (or claiming video data sequences) ", avoid disk fragments, improve disk storage efficiency, make use of memory space in maximum efficiency, video data is achieved efficient management, thus when retrieving massive video, retrieval rate and efficiency are greatly improved.
2, because the present invention adopts the memory module of block of video data, when the video data in block of video data is deleted by circulating rolling after long-time storage, it does not result in tapering into of memory space, without the reduction causing disk performance, can remain efficiently such as the memory property of.
3, the present invention is departing from data base, reduces the dependence to data base to greatest extent, it is adaptable to large-scale cloud storage application.
4, the retrieval granularity by the inventive method realization is little, can be accurate to the video data of Millisecond according to the actual requirements, and degree of accuracy is high, and because of the setting of shooting time index, video data location is greatly improved with retrieval rate.
Accompanying drawing explanation
Fig. 1 is the implementing procedure figure of the present invention.
Detailed description of the invention
As it is shown in figure 1, the massive video storage method that the present invention is used for quick-searching comprises the steps:
1) video data block space is created, wherein: video data block space is provided with block of video data storage file (REC file), block of video data index file (IDX file) and video display state storage file (TLI file)；
2) judge whether block of video data (IP block) has received: if so, then terminate；If it is not, then enter 3)；
3) judge whether current video data block space stores full: if so, then enter 4)；If it is not, then enter 9) continue to block of video data；
4) arrange the current video data block space that storage is full, close and rename current video data block space；
5) judge whether that arriving filing catalogue updates the time: if so, then enter 6)；If it is not, then enter 7)；
6) the filing directory content that the deletion holding time is the longest；
7) filing current video data block space；
8) new video data block space is created；
9) extract the video data in block of video data and analyze motion vector detecting information (the VMD information of block of video data, for weighing the information of field motion severe degree), update the block of video data storage file in current video data block space, block of video data index file and video display state storage file, return 2).
During actual enforcement, in step 4) in, after video data block space is carried out data redundancy process, unloading enters in the disk of server, realizes the arrangement of the video data block space that storage is full.
When reality is implemented, it is preferred that, video data block space creates in the internal memory of server, and files directory creating in the disk of server.
Actual when implementing, in step 7) in, make and set up corresponding relation as indexing setting shooting time granularity between current video data block space and filing catalogue, realize the filing of current video data block space.
In the present invention, filing catalogue is a kind of multistage time index catalogue, and itself and video data block space are the relation of one-to-many, and namely filing catalogue can include multistage catalogue, there is corresponding relation between catalogue and several video data block spaces of each minimal level.
In actual use, video camera captured in real-time picture and by video data with the form of block of video data in real time to server transport, the disk of server creates and has some filing catalogues, each retention time filing catalogue sets, such as the time of one month, therefore, when arriving retention time, a holding time filing catalogue at most to be just updated, and namely this filing catalogue reaches the filing catalogue renewal time.
In the present invention, block of video data storage file is for storing the video data of some block of video data, and the shooting time information of each block of video data, motion vector are detected information, display status information, stored the storage positional information in file and data length information etc. in block of video data.Block of video data index file is to set interval time as index, for the index file that block of video data is set up, the position in the block of video data storage file at block of video data place can be quickly oriented, thus finding this block of video data by block of video data index file.
In actual design, preferably, block of video data storage file can include some video data module units of Coutinuous store, each video data module unit includes frame head, video data storage region and video data storage expansion area, wherein: frame head is for storing the shooting time information of block of video data, motion vector detecting information, display status information, code stream type information, storing the storage positional information in file and data length information etc. in block of video data.
nullIn actual design，Preferably，Block of video data index file can include the Head Section of Coutinuous store、Index area and some memory element，Each memory element includes data field and the data extension area of Coutinuous store、Data reserved area，Wherein: Head Section is used for storing memory element number information、The REC file number information etc. that block of video data index file relates to，Index area is for storing the shooting time information of last block of video data corresponding to each memory element、The number information etc. of each memory element storage positional information in block of video data index file and the block of video data corresponding to each memory element，The data field of each memory element sets the shooting time information of the some block of video data being continuously shot in interval time for being stored in、The storage positional information in file and data length information etc. are stored in block of video data.
In actual design, video display state storage file be for display terminal display use, with set the time as granularity (as with " minute " for granularity) by colouring information record show state file, display state can include normal display, abnormal display, some type of errors, wherein: display state can store from block of video data to extract in the display status information file and sum up.
When practical operation, step 9) in in current video data block space block of video data store file, block of video data index file and video display state storage file renewal refer to based on receive block of video data, related content block of video data stored in file, block of video data index file and video display state storage file is updated, and update content can carry out flexible design according to the actual requirements.
During use, by the inventive method, massive video is stored, the setting shooting time granularity of filing catalogue is designed as " day ", but this " day " non-natural day but time span is day, the Folder Name of storage filing catalogue is designed as initial time and terminates the time but to set time format expression, such as the unix time, the setting of block of video data index file is designed as " 10 minutes " interval time.
nullWhen the block of video data of certain year a certain second in such a month, and on such a day or millisecond shooting is retrieved，First shooting time is converted to the unix time，Find the filing catalogue corresponding to this unix time，Again through this filing directory search to shooting some video data block spaces corresponding to the same day，Then successively to each video data block space，To set interval time (10 minutes) for granularity，Block of video data index file finds the memory element corresponding to this block of video data by index area，Which then in this memory element, it is pin-pointed to this block of video data to be arranged in block of video data storage file and store the position in file in block of video data，This block of video data is finally found thus storing in file in the block of video data of location further，So，This block of video data can show, by video, the display state that this block of video data found in state storage file is corresponding then，Display terminal realizes display.
The invention have the advantage that
1, although what video data itself embodied when storage is random destructuring feature, but it is can be structurized on Method of Data Organization, it has very strong systematicness, therefore, the present invention is directed to this structured features in video data tissue mode, the video data of stream mode is carried out structuring abstract, store with the form of " time index+block of video data (or claiming video data sequences) ", avoid disk fragments, improve disk storage efficiency, make use of memory space in maximum efficiency, video data is achieved efficient management, thus when retrieving massive video, retrieval rate and efficiency are greatly improved.
2, because the present invention adopts the memory module of block of video data, when the video data in block of video data is deleted by circulating rolling after long-time storage, it does not result in tapering into of memory space, without the reduction causing disk performance, can remain efficiently such as the memory property of.
3, the present invention is departing from data base, reduces the dependence to data base to greatest extent, it is adaptable to large-scale cloud storage application.
4, the retrieval granularity by the inventive method realization is little, can be accurate to the video data of Millisecond according to the actual requirements, and degree of accuracy is high, and because of the setting of shooting time index, video data location is greatly improved with retrieval rate.
The above is present pre-ferred embodiments and the know-why used thereof; for a person skilled in the art; when without departing substantially from the spirit and scope of the present invention; any based on apparent changes such as the equivalent transformation on technical solution of the present invention basis, simple replacements, belong within scope.
Claims (6)
1. the massive video storage method for quick-searching, it is characterised in that it includes step:
1) video data block space is created, wherein: video data block space is provided with block of video data storage file, block of video data index file and video display state storage file；
2) judge whether block of video data has received: if so, then terminate；If it is not, then enter 3)；
3) judge whether current video data block space stores full: if so, then enter 4)；If it is not, then enter 9) continue to block of video data；
4) arrange current video data block space, close and rename current video data block space；
5) judge whether that arriving filing catalogue updates the time: if so, then enter 6)；If it is not, then enter 7)；
6) the filing directory content that the deletion holding time is the longest；
7) filing current video data block space；
8) new video data block space is created；
9) extract the video data in block of video data and analyze the motion vector detecting information of block of video data, update the block of video data storage file in current video data block space, block of video data index file and video display state storage file, return 2).
2. the massive video storage method for quick-searching as claimed in claim 1, it is characterised in that:
Described 4) in, after described video data block space is carried out data redundancy process, unloading enters in the disk of server, realizes the arrangement of the described video data block space that storage is full.
3. the massive video storage method for quick-searching as claimed in claim 2, it is characterised in that:
Described video data block space creates in the internal memory of described server, and described filing directory creating is in the disk of described server.
4. the massive video storage method for quick-searching as claimed in claim 1, it is characterised in that:
Described 7) in, make between presently described video data block space and described filing catalogue with set shooting time granularity as index set up corresponding relation, realize the filing of presently described video data block space.
5. the massive video storage method for quick-searching as described in claim 1 or 4, it is characterised in that:
Described block of video data storage file is for storing the video data of some described block of video data, and the shooting time information of each described block of video data, motion vector detecting information, display status information, storage positional information and data length information；
Described block of video data index file is to set interval time as index, for the index file that described block of video data is set up, the position in the described block of video data storage file at described block of video data place can be oriented, thus finding described block of video data by described block of video data index file.
6. the massive video storage method for quick-searching as claimed in claim 5, it is characterised in that:
Described video display state storage file be use for display terminal display, to set the time as the granularity file by colouring information record display state, wherein: display state stores from described block of video data in the display status information file and extracts.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610079407.7A CN105786975B (en) | 2016-02-04 | 2016-02-04 | Massive video storage method for quick-searching |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610079407.7A CN105786975B (en) | 2016-02-04 | 2016-02-04 | Massive video storage method for quick-searching |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105786975A true CN105786975A (en) | 2016-07-20 |
| CN105786975B CN105786975B (en) | 2018-12-28 |
Family
ID=56403316
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610079407.7A Active CN105786975B (en) | 2016-02-04 | 2016-02-04 | Massive video storage method for quick-searching |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105786975B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116107969A (en) * | 2022-12-29 | 2023-05-12 | 北京中盛益华科技有限公司 | A Video Locking Method Based on File Index and Time |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101354713A (en) * | 2008-09-08 | 2009-01-28 | 大唐软件技术股份有限公司 | Method and system for storing data |
| CN104090987A (en) * | 2014-07-28 | 2014-10-08 | 华中科技大学 | Historical data storage and indexing method |
| CN104408064A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Data storage method and device |
| US9767098B2 (en) * | 2012-08-08 | 2017-09-19 | Amazon Technologies, Inc. | Archival data storage system |
-
2016
- 2016-02-04 CN CN201610079407.7A patent/CN105786975B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101354713A (en) * | 2008-09-08 | 2009-01-28 | 大唐软件技术股份有限公司 | Method and system for storing data |
| US9767098B2 (en) * | 2012-08-08 | 2017-09-19 | Amazon Technologies, Inc. | Archival data storage system |
| CN104090987A (en) * | 2014-07-28 | 2014-10-08 | 华中科技大学 | Historical data storage and indexing method |
| CN104408064A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Data storage method and device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116107969A (en) * | 2022-12-29 | 2023-05-12 | 北京中盛益华科技有限公司 | A Video Locking Method Based on File Index and Time |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105786975B (en) | 2018-12-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101216821B (en) | Storage Management Method of Data Acquisition System | |
| CN102244758A (en) | Video-recording-file-based data acquisition method and equipment | |
| CN103984710B (en) | Video interactive querying method and system based on mass data | |
| CN107958220B (en) | Face library compression processing method based on face recognition and intelligent device thereof | |
| CN110046168A (en) | A kind of incremental data consistency implementation method and device | |
| CN101446984A (en) | Method and device for storing files and method and device for deleting files | |
| CN112579593B (en) | Population database partitioning method and device | |
| CN107918612A (en) | The implementation method and device of key assignments memory system data structure | |
| CN102880854B (en) | Distributed processing and Hash mapping-based outdoor massive object identification method and system | |
| CN108415671B (en) | Method and system for deleting repeated data facing green cloud computing | |
| CN103488709A (en) | Method and system for building indexes and method and system for retrieving indexes | |
| CN101599079A (en) | A Management Method for Centralized Storage of Backup Data | |
| Xu et al. | Video analytics with zero-streaming cameras | |
| CN103744913A (en) | Database retrieval method based on search engine technology | |
| CN108337482A (en) | Surveillance video storage method and system | |
| CN105068761A (en) | Easy-to-retrieve video screenshot storing method and system | |
| CN110377757A (en) | A kind of real time knowledge map construction system | |
| CN102779138A (en) | Hard disk access method of real time data | |
| CN108460075A (en) | A kind of file content search method and system | |
| CN115422479A (en) | Track association method and device, electronic equipment and machine-readable storage medium | |
| CN107391769B (en) | Index query method and device | |
| JP2023531751A (en) | Vehicle data storage method and system | |
| CN106326439B (en) | A kind of storage of real-time video, search method and device | |
| CN105786975A (en) | Massive video storage method used for quick search | |
| Ma et al. | A retrieval optimized surveillance video storage system for campus application scenarios |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |