CN109600410A - Data-storage system and method - Google Patents
Data-storage system and method Download PDFInfo
- Publication number
- CN109600410A CN109600410A CN201710944091.8A CN201710944091A CN109600410A CN 109600410 A CN109600410 A CN 109600410A CN 201710944091 A CN201710944091 A CN 201710944091A CN 109600410 A CN109600410 A CN 109600410A
- Authority
- CN
- China
- Prior art keywords
- node
- memory node
- target
- storage system
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims 25
- 238000013500 data storage Methods 0.000 title claims 10
- 238000007726 management method Methods 0.000 claims 41
- 238000013468 resource allocation Methods 0.000 claims 3
- 230000005540 biological transmission Effects 0.000 claims 1
- 238000000151 deposition Methods 0.000 claims 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/09—Mapping addresses
- H04L61/10—Mapping addresses of different types
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/30—Managing network names, e.g. use of aliases or nicknames
- H04L61/3015—Name registration, generation or assignment
- H04L61/3025—Domain name generation or assignment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/02—Network architectures or network communication protocols for network security for separating internal from external traffic, e.g. firewalls
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to a kind of data-storage system and methods, belong to technical field of video monitoring.By being all made of management node-memory node framework in the Intranet storage system in data-storage system and outer net storage system, and, it is laid in memory node and volume and FTP catalogue is locally stored, make it possible to the ftp client by being run on gateway to read the multi-medium data of FTP catalogue in Intranet memory node, the multi-medium data is ferried to the FTP catalogue of outer net memory node again, the ferry-boat process can make Intranet no longer need to rely on independent ftp server in Intranet and outer net to the data transmission of outer net, it disposes relatively simple, it is desirable that lower.
Description
Technical field
The present invention relates to technical field of video monitoring, in particular to a kind of data-storage system and method.
Background technique
In recent years, with the enhancing of public awareness of safety, video monitoring system is come into being.In order to guarantee each place
Safety, safety guarantee department can retrieve for examination the monitor video data in each place at any time, when necessary, it is also necessary to retrieve for examination each place
Real time monitoring, to carry out United Dispatching and commander.In video monitoring system, it can be divided according to the property of monitored site
Network structure, the places such as important unit, key sector belong to inside due to being related to the confidential information of each department
Place in network;The places such as school, residential area are consequently belonging to the field in external network due to being public place
Institute, internal network independently work with external network, internal in order to ensure the safety of the confidential information in internal network
It needs to establish gateway between network and external network, realizes and be physically separated between internal network and external network, and in order to
The unified call and flexible transmission for realizing multi-medium data in internal network and external network, between internal network and external network
Have to the transmission that inter-network lock carries out multi-medium data.
In the related technology, independent FTP (File Transfer is disposed respectively in internal network and external network
Protocol, File Transfer Protocol) server, multi-medium data uploads to Intranet FTP service by the capture machine in internal network
Device and Intranet cloud storage system are moved the multi-medium data in Intranet cloud storage system to outer net by the built-in application in gateway
In cloud storage system, realize that the multi-medium data of inter-network lock between internal network and external network transmits.
In the implementation of the present invention, inventor find the relevant technologies the prior art has at least the following problems:
In order to realize that multi-medium data by the transmission of Intranet to outer net, is required to dispose independent FTP in Intranet and outer net
Server, when multi-medium data is uploaded to Intranet ftp server by capture machine, if the multi-medium data for currently needing to upload
Data volume is larger, and the time requirement that multi-medium data is synchronized to outer net ftp server by Intranet ftp server is shorter, then right
The ftp server of Intranet and outer net can generate larger pressure, at this moment, just need to use and dispose multiple FTP clothes in Intranet and outer net
Business device is just able to satisfy the performance requirement of multi-medium data upload, higher to the deployment request of equipment in Intranet and outer net, disposes
Journey is complex.
Summary of the invention
To overcome the problems in correlation technique, the present invention provides a kind of data-storage system and method.
On the one hand, a kind of data-storage system, including Intranet storage system, gateway and outer net storage system are provided;
Wherein, the Intranet storage system includes the first management node and multiple first memory nodes, and each first memory node includes
Cloud storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system include the second management node and
Multiple second memory nodes, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;The gateway
Upper operation has ftp client;
First management node of the Intranet storage system is used to receive the resource allocation request of capture machine, will be the multiple
The first memory node of target in first memory node distributes to the capture machine;
First memory node of target is used to receive the multi-medium data and short general unique knowledge that the capture machine is sent
When other code UUID, the multi-medium data and the short UUID are stored into the cloud storage volume of first memory node of target
And in the FTP catalogue of first memory node of target;
The gateway is used to read the institute in the FTP catalogue of first memory node of target by the ftp client
Multi-medium data and the short UUID are stated, and the multi-medium data and the short UUID are sent to the outer net storage system
The second memory node of target FTP catalogue in;
Second memory node of target is for receiving the net in the FTP catalogue of second memory node of target
When the multi-medium data and UUID that lock is sent, the multi-medium data and the short UUID are stored to the target second
In the cloud storage volume of memory node.
On the one hand, a kind of multimedia data storage method is provided, the method is applied to the Intranet of data-storage system
In storage system, the data-storage system includes Intranet storage system, gateway and outer net storage system;Wherein, in described
Net storage system includes the first management node and multiple first memory nodes, and each first memory node includes cloud storage volume and branch
Hold the FTP catalogue of File Transfer Protocol FTP service;The outer net storage system includes the second management node and multiple second storages
Node, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;Operation has FTP objective on the gateway
Family end;
The described method includes:
First management node of the Intranet storage system receives the resource allocation request of capture machine, by the multiple first
The first memory node of target in memory node distributes to the capture machine;
First memory node of target receives the multi-medium data and short Universally Unique Identifier that the capture machine is sent
When UUID, by the multi-medium data and the short UUID store to first memory node of target cloud storage volume in and
In the FTP catalogue of first memory node of target, by the ftp client on the gateway by first memory node of target
FTP catalogue in the multi-medium data and the short UUID be sent to the outer net storage system.
On the one hand, a kind of date storage method is provided, the outer net that the method is applied to data-storage system stores system
In system, the data-storage system includes Intranet storage system, gateway and outer net storage system;Wherein, the Intranet storage
System includes the first management node and multiple first memory nodes, and each first memory node includes cloud storage volume and support file
The FTP catalogue of transport protocol FTP service;The outer net storage system includes the second management node and multiple second memory nodes,
Each second memory node includes cloud storage volume and the FTP catalogue for supporting FTP service;Operation has ftp client on the gateway;
Any one second memory node receives the multi-medium data and short UUID sent by the ftp client of the gateway;
Second memory node stores multi-medium data and short UUID to the FTP catalogue of second memory node
In;
Second memory node stores the multi-medium data and the short UUID to second memory node
In cloud storage volume.
On the one hand, a kind of date storage method is provided, data-storage system is applied to, the data-storage system includes
Intranet storage system, gateway and outer net storage system;Wherein, the Intranet storage system includes the first management node and multiple
First memory node, each first memory node include cloud storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;
The outer net storage system includes the second management node and multiple second memory nodes, and each second memory node includes cloud storage
Volume and the FTP catalogue for supporting FTP service;Operation has ftp client on the gateway;
First management node of the Intranet storage system receives the resource allocation request of capture machine, by the multiple first
The first memory node of target in memory node distributes to the capture machine;
First memory node of target receives the capture machine and sends multi-medium data and short Universally Unique Identifier
When UUID, by the multi-medium data and the short UUID store to first memory node of target cloud storage volume in and
In the FTP catalogue of first memory node of target;
The gateway is read described more in the FTP catalogue of first memory node of target by the ftp client
Media data and the short UUID, and the multi-medium data and the short UUID are sent to the mesh of the outer net storage system
It marks in the FTP catalogue of the second memory node;
Second memory node of target receives the gateway hair in the FTP catalogue of second memory node of target
When the multi-medium data and the short UUID that send, the multi-medium data and the short UUID are stored to the target
In the cloud storage volume of two memory nodes.
On the one hand, a kind of data-storage system, including Intranet storage system, gateway and outer net storage system are provided;
Wherein, the Intranet storage system includes the first management node and multiple first memory nodes, and each first memory node includes
Cloud storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system include the second management node and
Multiple second memory nodes, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;The gateway
Upper operation has ftp client;
First management node of the Intranet storage system is used to manage the storage resource of the multiple first memory node,
Each first memory node is used for the short UUID of storing data and the data in the cloud storage volume of first memory node;
Or,
Second management node of the outer net storage system is used to manage the storage resource of the multiple second memory node,
Each second memory node is used for storing data and the number in the cloud storage volume and FTP catalogue of second memory node
According to short UUID.
On the one hand, a kind of data query method, including Intranet storage system, gateway and outer net storage system are provided;
Wherein, the Intranet storage system includes the first management node and multiple first memory nodes, and each first memory node includes
Cloud storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system include the second management node and
Multiple second memory nodes, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;The gateway
Upper operation has ftp client;
The short UUID of storing multimedia data and the multi-medium data in the cloud storage volume of the first memory node of target;Institute
The multimedia data query request that the first management node receives terminal is stated, it is virtual that the multimedia data query request carries first
Address;According to first virtual address, multimedia data query request is redirected to first virtual address and is referred to
The first memory node of target shown;First memory node of target receives the multimedia data query request, by described the
The multi-medium data of one virtual address instruction returns to the terminal;Or,
Storing multimedia data and the multi-medium data in the cloud storage volume and FTP catalogue of the second memory node of target
Short UUID;Second management node receives the multimedia data query request of terminal, the multimedia data query request
Carry the second virtual address;According to second virtual address, multimedia data query request is redirected to described the
The second memory node of target of two virtual addresses instruction;Second memory node of target receives the multimedia data query and asks
It asks, the multi-medium data that second virtual address indicates is returned into the terminal.
The technical solution that the embodiment of the present invention provides can include the following benefits:
By being all made of management node-storage section in the Intranet storage system in data-storage system and outer net storage system
The framework of point, also, laid in memory node and volume and FTP catalogue is locally stored, make it possible to by being run on gateway
Ftp client ferry to read the multi-medium data of FTP catalogue in Intranet memory node, then by the multi-medium data to outer net
The FTP catalogue of memory node, the ferry-boat process can make Intranet no longer need to rely on Intranet and outer net to the data transmission of outer net
In independent ftp server, dispose it is relatively simple, it is desirable that it is lower.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not
It can the limitation present invention.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows and meets implementation of the invention
Example, and be used to explain the principle of the present invention together with specification.
Figure 1A is a kind of architecture diagram of data-storage system shown according to an exemplary embodiment;
Figure 1B is a kind of schematic diagram of data-storage system shown according to an exemplary embodiment;
Fig. 1 C is a kind of schematic diagram of multi-medium data storage format shown according to an exemplary embodiment;
Fig. 2 is a kind of stream compression schematic diagram based on data-storage system provided in an embodiment of the present invention;
Fig. 3 is a kind of flow chart of date storage method provided in an embodiment of the present invention;
Fig. 4 is a kind of flow chart of data query method provided in an embodiment of the present invention;
Fig. 5 is a kind of structural schematic diagram of data storage device provided in an embodiment of the present invention;
Fig. 6 is a kind of structural schematic diagram of data storage device provided in an embodiment of the present invention;
Fig. 7 is a kind of block diagram of computer equipment 700 shown according to an exemplary embodiment.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to
When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistented with the present invention.On the contrary, they be only with it is such as appended
The example of device and method being described in detail in claims, some aspects of the invention are consistent.
Video monitoring system is divided into Intranet and outer net, Intranet include capture machine, Intranet bayonet server, intranet data storehouse and
Intranet storage system;Outer net storage system includes outer net bayonet server, outer grid database and outer net storage system, which deposits
Storage system and outer net storage system constitute the data-storage system in video monitoring system.Referring to Figure 1A, Intranet storage system
It is all made of distributed structure/architecture with outer net storage system, is divided into management node and multiple memory nodes according to physical aspect.Each deposit
Block device on storage node is divided into two parts, and a part is rolled up by cloud storage service as cloud storage come using a part passes through
Carry local file system comes as FTP service using being specifically provided as FTP catalogue.
Specifically, referring to Figure 1B, which includes the first management node and multiple first memory nodes, each
First memory node includes cloud storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system includes
Second management node and multiple second memory nodes, each second memory node include cloud storage volume and the FTP for supporting FTP service
Catalogue;Operation has ftp client on the gateway.
In the following, being based on data storage procedure, the function of above-mentioned Intranet storage system, gateway and outer net storage system is carried out
It introduces:
Intranet storage system: the first management node and multiple first memory nodes
First management node is for being managed the storage resource of multiple first memory nodes, each first memory node
It is divided into cloud storage volume and FTP catalogue, the FTP catalogue refers to the FTP service of carry local file system.Each first storage
Node corresponds to only one first node mark, and the first node mark of each first memory node is all different.
First management node of the Intranet storage system is used to receive the resource allocation request of capture machine, by multiple first
The first memory node of target in memory node distributes to the capture machine;First memory node of target is for receiving the capture machine
The multi-medium data of transmission and short Universally Unique Identifier UUID (Universally Unique Identifier, it is general unique
Identification code) when, the multi-medium data and the short UUID are stored into the cloud storage volume of the first memory node of the target and be somebody's turn to do
In the FTP catalogue of the first memory node of target.It should be noted that the first memory node of target can be synchronized multi-medium data
It is written with the short UUID in the FTP catalogue of first memory node of target.
Wherein, first management node is for determining target first according to preset rules from multiple first memory node
Memory node, and the first node of first memory node of target mark is sent to the capture machine, by capture machine by multimedia
First memory node of target is written in data and the short UUID.First management node can be according to load balancing principle from multiple
Determine that a present load meets the second memory node of demand as the first memory node of target in two memory nodes, certainly,
Each first memory node can correspond to a cryptographic Hash range, which is also based on hash value algorithms
The cryptographic Hash of multi-medium data is calculated, to select the first memory node of cryptographic Hash range corresponding to the cryptographic Hash as mesh the
One memory node, how the embodiment of the present invention is to specifically selecting node without limitation.
Wherein, short UUID can be stored in more by memory node when being stored multi-medium data and short UUID correspondence
In the data head of media data (as shown in Figure 1 C), corresponding short UUID is carried by multi-medium data, to incite somebody to action subsequent
When multi-medium data is transmitted in outer net storage system, the UUID of multi-medium data is remained unchanged, and is allowed to directly according to short
UUID determines same multi-medium data in Intranet storage system and outer net storage system, and upper layer application storage multimedia is omitted
The mapping relations of physical address of the data in Intranet storage system and outer net storage system avoid occurring in upper layer application different
Chang Shi, the mapping relations that may cause permanently are lost, and lead to not search in Intranet storage system and outer net storage system more
Media data.
After storing multi-medium data and short UUID in the cloud storage volume to the first memory node of target, due to multimedia
Data are stored on the memory node of Intranet, and therefore, multi-medium data can correspond to a physical address, the target in Intranet
One memory node can store the mapping relations between physical address and short UUID.The first memory node of target can be generated
Mapping table as shown in Table 1 stores the mapping relations between short UUID and physical address into mapping table.
Table 1
Short UUID | abc |
Physical address | def |
Timestamp information | 22:02:06 |
Random code | 123456 |
In order to which the information of more detailed data recording multimedia data and enhancing are to the confidentiality of multimedia messages, in reality
In, the timestamp information and random code of multi-medium data can also be increased in mapping table.It should be noted that
The mode of mapping relations is without specifically limiting between present invention UUID short to storage and physical address.The physics of multi-medium data
The mapping relations of address and short UUID have also been made in the storage volume of the bottom of cloud storage system other than being stored in database
Backup, is saved together with multi-medium data.It can also be restored by tool even if the map information of local data base loss,
Improve Information Security.
It should be noted that the first memory node of target is when storing multi-medium data and short UUID to FTP catalogue, one
Aspect can generate multi-medium data title for each multi-medium data, include short UUID in multi-medium data title, and will be more
Media data is corresponding with multi-medium data title to be stored;It on the other hand, can be directly corresponding with short UUID by multi-medium data
It is stored, the embodiment of the present invention is to this without specifically limiting.
In order to which the storage location of data recording multimedia data can directly exist when to inquire multi-medium data in Intranet
Storage location obtains multi-medium data, which can be sent to the first management node for the short UUID;It should
First management node is also used to the first node of the short UUID and first memory node of target mark being back to the capture machine,
First virtual address is sent by the inside network interface card mouth server of the capture machine, and by the Intranet bayonet server by this first virtually
Location is stored to intranet data storehouse, which is based on the short UUID and first node mark generates, so as to subsequent base
Multi-medium data is obtained in the first virtual address.Wherein, virtual address can be URL ((Uniform Resource
Locator, uniform resource locator) form.
In addition, the capture machine in Intranet is used to acquire the multi-medium data of its position, the short of multi-medium data is generated
UUID, and based on the first memory node of target that the first management node is distributed, multi-medium data and short UUID are stored to interior
The first memory node of target of net storage system, moreover, can be by first in the first virtual address for receiving multi-medium data
Virtual address is uploaded to Intranet bayonet server;Wherein, multi-medium data can be image data or video data, each more matchmakers
Volume data corresponds to the short UUID of only one, and the UUID of each multi-medium data is different.Short UUID is right with it for identifying
The multi-medium data answered, capture machine can be generated using preset algorithm, be preset when generating short UUID for each multi-medium data
Algorithm can be SHA1 (Secure Hash Algorithm, Secure Hash Algorithm) digest algorithm and Boost (portable) library
Deng the present invention is to this without specifically limiting.
Intranet bayonet server is used to receive the first virtual address of capture machine transmission, and the first virtual address is transmitted to
Intranet data storehouse is stored by intranet data storehouse;Intranet data storehouse is empty when receive Intranet bayonet server transport first
Behind quasi- address, the first virtual address is stored.
Gateway
Gateway is used to read the multimedia number in the FTP catalogue of first memory node of target by the ftp client
According to the short UUID, and the multi-medium data and the short UUID are sent to the second memory node of target of the outer net storage system
FTP catalogue in;The gateway can be periodically detected each first memory node in Intranet storage system by ftp client
FTP catalogue in whether be stored with new multi-medium data and short UUID, deposited when detecting in first memory node of target
When containing new multi-medium data and the short UUID, more matchmakers in the FTP catalogue for reading first memory node of target are executed
Volume data and the short UUID and the process sent to outer net storage system.
The target second that the gateway is also used to for the multi-medium data and the short UUID being sent to the outer net storage system is deposited
It is after storing up in the FTP catalogue of node, the multi-medium data stored in the FTP catalogue of first memory node of target is short with this
UUID is deleted, it is possible to reduce the data volume stored in Intranet storage system mitigates the pressure of Intranet storage system.
It should be noted that since the ftp client in gateway may manage multiple Intranet storage systems and outer net is deposited
Storage system avoids multi-medium data and short UUID for the corresponding relationship established between Intranet FTP service and outer net FTP service
The situation of data connection object mistake occurs when being transmitted, it therefore, can be by the of Intranet FTP service in ftp client
One address of service is corresponding with the second service address of outer net FTP service to be stored.In this way, gateway before being worked, needs
The first service address of the Intranet FTP service of Intranet storage system is obtained, the outer net FTP service of outer net storage system is obtained
Second service address, and by first service address and second service address correspondence store the ftp client into gateway, so as to
It is subsequent when multi-medium data and short UUID are transmitted to outer net storage system, it can determine outer net corresponding with Intranet storage system
Storage system avoids connection object that mistake occurs.
Correspondingly, in embodiments of the present invention, due to being stored with first service address and second service in ftp client
Corresponding relationship between location, therefore, after ftp client obtains multi-medium data and short UUID in Intranet FTP service, FTP
Client can determine corresponding second service address according to the first service address of Intranet storage system, and by multimedia
Data and short UUID are transmitted in the outer net storage system of second service address instruction.
Outer net storage system: the second management node and multiple second memory nodes
Second management node is for being managed the storage resource of multiple second memory nodes, each second memory node
It is divided into cloud storage volume and FTP catalogue, the FTP catalogue refers to the FTP service of carry local file system.Each second storage
Node corresponds to only one second node mark, and the second node mark of each second memory node is all different.
For any one second memory node, which is used for the FTP mesh in second memory node
When receiving multi-medium data and UUID of gateway transmission in record, by the multi-medium data and the short UUID store to this second
In the cloud storage volume of memory node.It should be noted that due to the second memory node by multi-medium data and short UUID storage
When to FTP catalogue, on the one hand, multi-medium data title can be generated for each multi-medium data, wrapped in multi-medium data title
Include short UUID, and store multi-medium data is corresponding with multi-medium data title;It on the other hand, can be directly by multimedia number
It is stored according to corresponding with short UUID, therefore, if multi-medium data and multimedia number that the FTP catalogue of the first memory node stores
According to title, then store multi-medium data is corresponding with multi-medium data title;If the FTP catalogue of the first memory node stores
Multi-medium data and short UUID, then store multi-medium data is corresponding with short UUID.
In embodiments of the present invention, since the FTP catalogue of the second memory node stores the multimedia of gateway transmission first
Data and short UUID, therefore, when increasing newly in Intranet storage system has multi-medium data and short UUID, in outer net storage system
Also multi-medium data and short UUID can be increased newly.For the second memory node of each of outer net storage system, this second
Memory node can periodically detect newly-increased multi-medium data and short UUID whether are stored in FTP catalogue, and work as and detect
When FTP catalogue is stored with newly-increased multi-medium data and short UUID, newly-increased multi-medium data and short UUID are obtained, so as to will be new
The multi-medium data of increasing and short UUID are stored to cloud storage and are rolled up, and complete multi-medium data and short UUID by Intranet storage system to outer
The transmission of net storage system.After storing multi-medium data and short UUID into outer net storage system, can also be formed with it is interior
Mapping relations in net storage system similarly, are no longer repeated herein.
Further, which identifies according to the second node of the short UUID and second memory node, raw
The second management node, second pipe are sent at the second virtual address of the multi-medium data, and by second virtual address
Manage node will second virtual address transmission outer net bayonet server, by the outer net bayonet server by second virtual address
It stores to outer grid database.
Framework provided in an embodiment of the present invention, provide it is following the utility model has the advantages that
By being all made of management node-storage in the Intranet storage system in data-storage system and outer net storage system
The framework of node, also, laid in memory node and volume and FTP catalogue is locally stored, make it possible to by being transported on gateway
Capable ftp client is ferried to read the multi-medium data of FTP catalogue in Intranet memory node, then by the multi-medium data to outer
The FTP catalogue of net memory node, the ferry-boat process can make Intranet no longer need to rely on Intranet and outer to the data transmission of outer net
Independent ftp server in net is disposed relatively simple, it is desirable that lower.
Further, additionally provide it is below the utility model has the advantages that
(1) multi-medium data of capture machine is directly stored to the cloud storage volume of Intranet storage system and local FTP service,
And by the ferry-boat of gateway, it also can directly store to the cloud storage volume of outer net storage system and local FTP service, provide
The scheme that multi-medium data directly stores.Since data flow is without bayonet server, the property of platform card mouth server is reduced
It can pressure.
(2) gateway program is combined to realize the high speed ferry-boat of multi-medium data between intranet and extranet, multi-medium data is by Intranet FTP
After service ferry-boat to outer net FTP service, the update of multi-medium data is detected by cloud storage plug-in, it is automatic to realize more matchmakers
Volume data is written in cloud storage volume, to provide multi-medium data inter-network lock automatic synchronization scheme between two cloudlets.
(3) it since Intranet storage system and outer net storage system are when storing multi-medium data, has been all made of short
UUID is identified, and the upper layer application platform of intranet and extranet can access intranet and extranet difference cloud storage system using same short UUID
The same multi-medium data in system, eliminates external program come the step of recording mapping relations.
To carry out date storage method provided in an embodiment of the present invention below based on the framework of above-mentioned data-storage system
It introduces, in order to make it easy to understand, can be illustrated in conjunction with the data flow in Fig. 2 and the interaction of the specific steps in Fig. 3:
301, the first management node of Intranet storage system receives the resource allocation request of capture machine, and multiple first is deposited
The first memory node of target in storage node distributes to the capture machine.
Capture machine acquires the multi-medium data of position, and the first management node into Intranet storage system sends money
Source distribution request stores multi-medium data to request storage resource.Specifically, first management node be used for from
The first memory node of target is determined according to preset rules in multiple first memory node, and by first memory node of target
First node mark is sent to the capture machine.When capture machine gets the first node mark of the first memory node of target, meeting
The short UUID of the multi-medium data and multi-medium data is sent to first memory node of target.
302, the first memory node of target receives the multi-medium data and short UUID that capture machine is sent, and by the multimedia number
According to the short UUID store to the first memory node of the target cloud storage volume in and first memory node of target FTP mesh
In record.
In a kind of possible implementation, which is sent to the first management node for the short UUID;It should
The first node of the short UUID and first memory node of target mark is also back to the capture machine by the first management node;This is grabbed
The inside network interface card mouth server of bat machine sends the first virtual address, which stores first virtual address to interior
Grid database, which is based on the short UUID and first node mark generates.
303, gateway has newly-increased multimedia by being periodically detected in determining the first memory node of target for ftp client
Data and short UUID read the multi-medium data and the short UUID in the FTP catalogue of first memory node of target.
304, the gateway stores the target second that the multi-medium data and the short UUID are sent to the outer net storage system
In the FTP catalogue of node.
Further, which is sent to the multi-medium data and the short UUID target second of the outer net storage system
After in the FTP catalogue of memory node, by the multi-medium data stored in the FTP catalogue of first memory node of target and it is somebody's turn to do
Short UUID is deleted.
305, the second memory node of target receives gateway transmission in the FTP catalogue of second memory node of target
The multi-medium data and when UUID, the multi-medium data and the short UUID are stored to the cloud storage of the second memory node of the target
In volume.
Further, second memory node of target is according to the second node of the short UUID and second memory node of target
Mark, generates the second virtual address of the multi-medium data, and second virtual address is sent to the second management node, this
Second virtual address is sent to outer net bayonet server by two management nodes;The outer net bayonet server is second virtual by this
Address is stored to outer grid database.
Method provided in an embodiment of the present invention reads Intranet memory node by the ftp client run on gateway
The multi-medium data of middle FTP catalogue, then the multi-medium data is ferried to the FTP catalogue of outer net memory node, the ferry-boat process
Intranet can be made to no longer need to rely on independent ftp server in Intranet and outer net to the data transmission of outer net, deployment is more simple
It is single, it is desirable that lower.Further, method provided in an embodiment of the present invention makes full use of video cloud storage system distributed type assemblies
The advantage of framework, the built-in FTP service on the memory node of cloud storage system, eliminates the expense of ftp server.Simultaneously because
FTP service is also clustered deploy(ment), and gateway application is allow concurrently to access FTP service, improves the performance of inter-network lock picture storage.
The embodiment of the invention also provides a kind of data-storage system, the data-storage system include Intranet storage system,
Gateway and outer net storage system;Wherein, which includes the first management node and multiple first memory nodes, often
A first memory node includes cloud storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system packet
The second management node and multiple second memory nodes are included, each second memory node includes cloud storage volume and support FTP service
FTP catalogue;Operation has ftp client on the gateway.Specific system structure can with similarly, data are stored shown in Fig. 1 and Fig. 2
For system, when being stored with multi-medium data, data query function can also be provided for user, be based on data query function,
The function of above-mentioned Intranet storage system, gateway and outer net storage system is introduced:
By taking Intranet storage system as an example, the first management node of the Intranet storage system is for managing multiple first storage
The storage resource of node, each first memory node are used for storing data and number in the cloud storage volume of first memory node
According to short UUID;
First management node is used to receive the multimedia data query request of terminal, and multimedia data query request is taken
The first virtual address of band;According to first virtual address, multimedia data query request is redirected to this first virtually
The first memory node of target of location instruction;First memory node of target is for receiving multimedia data query request, by this
The multi-medium data of first virtual address instruction returns to the terminal.
First management node obtains the short UUID and first node mark for parsing to first virtual address
Know;Multimedia data query request is redirected to the first memory node of target of first node mark instruction;
First memory node of target obtains more matchmakers according to the short UUID for receiving multimedia data query request
The physical address of volume data, obtains the multi-medium data from the physical address, returns to the multi-medium data to the terminal.
Terminal can access Intranet storage system by platform, and search intranet data based on certain search condition
Library to get the first virtual address of multi-medium data, and the first virtual address is carried and is asked in multimedia data query
The first management node is sent in asking, it can be by the method for Redirect URL, by the multimedia of the platform by the first management node
Data inquiry request is redirected to the memory node of the actual storage data, by memory node by being analyzed and acquired by multimedia number
According to physical address, and get multi-medium data based on physical address and return to platform, terminal is returned to by platform.Certainly,
The redirection can also refer to request the multimedia data query to be redirected to cloud storage service, enable cloud storage service
It parses and determines physical address, that is to say that data are stored on which address of which node, then obtain more matchmakers from the node
Volume data returns to platform.
By taking outer net storage system as an example, the second management node of the outer net storage system is for managing multiple second storage
The storage resource of node, each second memory node are used in the cloud storage volume and FTP catalogue of second memory node store
The short UUID of data and the data.
Second management node is used to receive the multimedia data query request of terminal, and multimedia data query request is taken
The second virtual address of band;According to second virtual address, multimedia data query request is redirected to this second virtually
Second memory node of location instruction;
Second memory node is for receiving multimedia data query request, more matchmakers which is indicated
Volume data returns to the terminal.
Further, second management node is for parsing second virtual address, obtains the short UUID and the
Two node identifications;Multimedia data query request is redirected to the second memory node of second node mark instruction;
Second memory node obtains the multimedia number according to the short UUID for receiving multimedia data query request
According to physical address, obtain the multi-medium data from the physical address, return to the multi-medium data to the terminal.
Terminal can access outer net storage system by platform, and outer network data is searched based on certain search condition
Library to get the second virtual address of multi-medium data, and the second virtual address is carried and is asked in multimedia data query
The second management node is sent in asking, it can be by the method for Redirect URL, by the multimedia of the platform by the second management node
Data inquiry request is redirected to the memory node of the actual storage data, by memory node by being analyzed and acquired by multimedia number
According to physical address, and get multi-medium data based on physical address and return to platform, terminal is returned to by platform.Certainly,
The redirection can also refer to request the multimedia data query to be redirected to cloud storage service, enable cloud storage service
It parses and determines physical address, that is to say that data are stored on which address of which node, then obtain more matchmakers from the node
Volume data returns to platform.
It should be noted that since Intranet storage system and outer net storage system are when storing multi-medium data,
Short UUID has been all made of to be identified, then it is same to media data when user inquires multi-medium data by respective platform
Corresponding short UUID be it is identical, eliminate external program come the step of recording mapping relations.
Certainly, the storage method of multi-medium data can be with depositing in above-mentioned data-storage system in the data-storage system
Method for storing similarly, can also be stored, it is not limited in the embodiment of the present invention using different stream compression modes.
To carry out date storage method provided in an embodiment of the present invention below based on the framework of above-mentioned data-storage system
It introduces, in order to make it easy to understand, can be illustrated in conjunction with the specific steps interaction in Fig. 4, the inquiry with Intranet storage system is
Example:
401, Intranet platform receives the search condition of terminal, according to search condition, meets the inspection from intranet data storehouse acquisition
First virtual address of rope condition.
Intranet platform can refer to Intranet platform application program, and for Intranet inquiry system, operation has Intranet flat
Platform application program can realize query process based on the programmed logic of the Intranet platform application program.
402, Intranet platform sends multimedia data query request, multimedia data query request to the first management node
Carry first virtual address.
403, when the first management node receives first virtual address, the first virtual address is parsed, is obtained
Short UUID and first node mark.
404, the first management node redirects multimedia data query request.
It should be noted that after the first management node gets short UUID and first node mark, it can be by the Intranet
First virtual address of platform is redirected to the memory node of actual storage, that is to say, the first management node can be short by this
UUID and first node mark return to Intranet platform, are based on short UUID by Intranet platform and first node mark is reset
To, and multimedia data query request is sent to the access address of redirection.
405, Intranet platform requests the target that instruction is identified to first node based on the multimedia data query of redirection
One memory node sends multimedia data query request.
406, the first memory node of target receives multimedia data query request, gets the multimedia by short UUID
The physical address of data gets multi-medium data by the physical address.
Due to having been set up the mapping relations between short UUID and physical address in memory node in storing process, because
This, it is available to physical address based on the mapping relations, and requested multi-medium data is got in turn.
Above-mentioned steps 404- step 406 is that Intranet storage system is stored from the target first of first node mark instruction
The process that the corresponding multi-medium data of the short UUID is obtained in volume is locally stored in node.
407, multi-medium data is sent to Intranet platform by the first memory node of target.
It should be noted that process shown in above-mentioned steps 401 and step 407 is the query process of Intranet, outer net
Similarly, this will not be repeated here for query process and the process.
Fig. 5 is a kind of structural schematic diagram of data storage device provided in an embodiment of the present invention.The device is applied to data
In the Intranet storage system of storage system, which includes Intranet storage system, gateway and outer net storage system;
Wherein, which includes management services module 501, service module 502 and FTP service module 503 is locally stored, should
Operation has ftp client on gateway;
The management services module will be in multiple first memory node for receiving the resource allocation request of capture machine
The first memory node of target distributes to the capture machine;
This is locally stored service module and FTP service module sends the capture machine multi-medium data and it is short it is general only
One identification code UUID is stored respectively into cloud storage volume and FTP catalogue, ftp client on the gateway by FTP catalogue should
Multi-medium data and the short UUID are sent to the outer net storage system.
In a kind of possible implementation, management services module is also used to the short UUID and first memory node of target
First node mark be back to the capture machine, the first virtual address is sent by the inside network interface card mouth server of the capture machine, and by
The Intranet bayonet server stores first virtual address to intranet data storehouse, first virtual address be based on the short UUID and
First node mark generates.
In a kind of possible implementation, management services module is also used to receive the multimedia data query request of terminal,
Multimedia data query request carries the first virtual address;According to first virtual address, which is asked
Seek the first memory node of target for being redirected to first virtual address instruction;
This is locally stored service module and is also used to receive multimedia data query request, which is indicated
Multi-medium data return to the terminal.
In a kind of possible implementation, management services module is also used to a little parse first virtual address, obtains
It is identified to the short UUID and first node;Multimedia data query request is redirected to the mesh of first node mark instruction
Mark the first memory node;
This is locally stored service module and is also used to receive multimedia data query request, and it is more to obtain this according to the short UUID
The physical address of media data, obtains the multi-medium data from the physical address, returns to the multi-medium data to the terminal.
Fig. 6 is a kind of structural schematic diagram of data storage device provided in an embodiment of the present invention.The device is applied to data
In the outer net storage system of storage system, which includes Intranet storage system, gateway and outer net storage system;
Wherein, which includes management services module 601, service module 602 and FTP service module 603 is locally stored, should
Operation has ftp client on gateway;
Management services module 601 is used for service module 602 being locally stored and FTP service module 603 is managed;
FTP service module 603 is used to receive by the multi-medium data and short UUID of the ftp client transmission of the gateway;With
It stores in by multi-medium data and short UUID into FTP catalogue;
Service module 602 is locally stored for storing the multi-medium data and the short UUID into cloud storage volume.
In a kind of possible implementation, service module is locally stored for the short UUID to be sent to management service mould
Block;
Service module 602 is locally stored to be used to be identified according to the second node of the short UUID and current second memory node,
The second virtual address of the multi-medium data is generated, and second virtual address is sent to management services module 601, by managing
Second virtual address is sent to outer net bayonet server by service module 601, by the outer net bayonet server by this second
Virtual address is stored to outer grid database.
In a kind of possible implementation, which is also used to receive the multimedia data query of terminal
Request, multimedia data query request carry the second virtual address;According to second virtual address, which is looked into
Ask the second memory node that request is redirected to second virtual address instruction;
Service module is locally stored and is also used to receive multimedia data query request, by second virtual address instruction
Multi-medium data returns to the terminal.
In a kind of possible implementation, which is also used to parse second virtual address,
Obtain the short UUID and second node mark;Multimedia data query request is redirected to second node mark instruction
Second memory node;
Service module is locally stored and is also used to receive multimedia data query request, which is obtained according to the short UUID
The physical address of volume data, obtains the multi-medium data from the physical address, returns to the multi-medium data to the terminal.
About the device in above-described embodiment, wherein modules execute the concrete mode of operation in related this method
Embodiment in be described in detail, no detailed explanation will be given here.
Fig. 7 is a kind of block diagram of computer equipment 700 shown according to an exemplary embodiment.For example, computer equipment
700 may be provided as a server.Referring to Fig. 7, computer equipment 700 includes processor 722, and by 732 institute of memory
The memory resource of representative, can be by the instruction of the execution of processor 722, such as application program for storing.It is deposited in memory 732
The computer executable instructions that can be run on a processor are stored up.In addition, the processor executes, the computer is executable to be referred to
Above-mentioned multimedia data storage method is realized when enabling.
Computer equipment 700 can also include that a power supply module 726 is configured as executing the power supply of computer equipment 700
Management, a wired or wireless network interface 750 is configured as computer equipment 700 being connected to network and an input is defeated
(I/O) interface 757 out.Computer equipment 700 can be operated based on the operating system for being stored in memory 732, such as Windows
ServerTM, Mac OS XTM, UnixTM,LinuxTM, FreeBSDTMOr it is similar.
The embodiment of the invention also provides a kind of computer readable storage mediums, when the instruction in the storage medium is by card
When the processor of piece writing station executes, so that card writing station is able to carry out above-mentioned multimedia data storage method.
Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to of the invention its
Its embodiment.This application is intended to cover any variations, uses, or adaptations of the invention, these modifications, purposes or
Person's adaptive change follows general principle of the invention and including the undocumented common knowledge in the art of the disclosure
Or conventional techniques.The description and examples are only to be considered as illustrative, and true scope and spirit of the invention are by following
Claim is pointed out.
It should be understood that the present invention is not limited to the precise structure already described above and shown in the accompanying drawings, and
And various modifications and changes may be made without departing from the scope thereof.The scope of the present invention is limited only by the attached claims.
Claims (28)
1. a kind of data-storage system, which is characterized in that including Intranet storage system, gateway and outer net storage system;Wherein,
The Intranet storage system includes the first management node and multiple first memory nodes, and each first memory node includes cloud storage
Volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system includes the second management node and multiple the
Two memory nodes, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;It is run on the gateway
There is ftp client;
First management node of the Intranet storage system is used to receive the resource allocation request of capture machine, by the multiple first
The first memory node of target in memory node distributes to the capture machine;
First memory node of target is used to receive the multi-medium data and short Universally Unique Identifier that the capture machine is sent
When UUID, by the multi-medium data and the short UUID store to first memory node of target cloud storage volume in and
In the FTP catalogue of first memory node of target;
The gateway is described more in the FTP catalogue of first memory node of target for being read by the ftp client
Media data and the short UUID, and the multi-medium data and the short UUID are sent to the mesh of the outer net storage system
It marks in the FTP catalogue of the second memory node;
Second memory node of target in the FTP catalogue of second memory node of target for receiving the gateway hair
When the multi-medium data and UUID that send, the multi-medium data and the short UUID are stored to the target second and stored
In the cloud storage volume of node.
2. system according to claim 1, which is characterized in that first management node from the multiple first for depositing
The first memory node of target is determined according to preset rules in storage node, and by the first node mark of first memory node of target
Knowledge is sent to the capture machine.
3. system according to claim 1, which is characterized in that first management node be also used to the short UUID and
The first node mark of first memory node of target is back to the capture machine, by the oral business of the inside network interface card of the capture machine
Device sends the first virtual address, and is stored first virtual address to intranet data storehouse by the Intranet bayonet server,
First virtual address is based on the short UUID and first node mark generates.
4. system according to claim 1, which is characterized in that second memory node of target is also used to according to described short
The second node of the second memory node of UUID and the target identifies, and generates the second virtual address of the multi-medium data, and
Second virtual address is sent to the second management node, second management node is used to send out second virtual address
It send to outer net bayonet server, is stored second virtual address to outer grid database by the outer net bayonet server.
5. system according to claim 1, which is characterized in that the gateway is also used to the multi-medium data and described
After short UUID is sent in the FTP catalogue of the second memory node of target of the outer net storage system, by the target first
The multi-medium data and the short UUID stored in the FTP catalogue of memory node is deleted.
6. system according to claim 5, which is characterized in that the gateway is used to be periodically detected by ftp client
Whether new multi-medium data and short UUID are stored in Intranet storage system in the FTP catalogue of each first memory node, when
When detecting the multi-medium data and the short UUID, execute in the FTP catalogue for reading first memory node of target
The multi-medium data and the short UUID and the process sent to outer net storage system.
7. a kind of multimedia data storage method, which is characterized in that the Intranet that the method is applied to data-storage system stores
In system, the data-storage system includes Intranet storage system, gateway and outer net storage system;Wherein, the Intranet is deposited
Storage system includes the first management node and multiple first memory nodes, and each first memory node includes cloud storage volume and supports literary
The FTP catalogue of part transport protocol FTP service;The outer net storage system includes the second management node and multiple second storage sections
Point, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;Operation has FTP client on the gateway
End;
The described method includes:
First management node of the Intranet storage system receives the resource allocation request of capture machine, and the multiple first is stored
The first memory node of target in node distributes to the capture machine;
First memory node of target receives the multi-medium data and short Universally Unique Identifier UUID that the capture machine is sent
When, the multi-medium data and the short UUID are stored into the cloud storage volume of first memory node of target and described
In the FTP catalogue of the first memory node of target, by the ftp client on the gateway by first memory node of target
The multi-medium data and the short UUID in FTP catalogue are sent to the outer net storage system.
8. the method according to the description of claim 7 is characterized in that the target by the multiple first memory node
One memory node distributes to the capture machine
First management node determines the first memory node of target according to preset rules from the multiple first memory node,
And the first node of first memory node of target mark is sent to the capture machine.
9. the method according to the description of claim 7 is characterized in that the method also includes:
The first node mark of the first memory node of the short UUID and the target is back to institute by first management node
Capture machine is stated, the first virtual address is sent by the inside network interface card mouth server of the capture machine, and by the Intranet bayonet server
First virtual address is stored to intranet data storehouse, first virtual address is based on the short UUID and the first segment
Point identification generates.
10. according to the method described in claim 9, it is characterized in that, the method also includes:
First management node receives the multimedia data query request of terminal, and the multimedia data query request carries the
One virtual address;According to first virtual address, it is virtual that multimedia data query request is redirected to described first
The first memory node of target of address instruction;
First memory node of target receives the multimedia data query request, by the more of first virtual address instruction
Media data returns to the terminal.
11. according to the method described in claim 10, it is characterized in that,
First management node parses first virtual address, obtains the short UUID and first node mark;
Multimedia data query request is redirected to the first memory node of target of the first node mark instruction;
First memory node of target receives the multimedia data query request, obtains more matchmakers according to the short UUID
The physical address of volume data obtains the multi-medium data from the physical address, and Xiang Suoshu terminal returns to the multimedia number
According to.
12. a kind of date storage method, which is characterized in that the method is applied to the outer net storage system of data-storage system
In, the data-storage system includes Intranet storage system, gateway and outer net storage system;Wherein, Intranet storage system
System includes the first management node and multiple first memory nodes, and each first memory node includes cloud storage volume and file is supported to pass
The FTP catalogue of defeated agreement FTP service;The outer net storage system includes the second management node and multiple second memory nodes, often
A second memory node includes cloud storage volume and the FTP catalogue for supporting FTP service;Operation has ftp client on the gateway;
Any one second memory node receives the multi-medium data and short UUID sent by the ftp client of the gateway;
Second memory node stores multi-medium data and short UUID into the FTP catalogue of second memory node;
The multi-medium data and the short UUID are stored to the cloud of second memory node and are deposited by second memory node
In storage volume.
13. according to the method for claim 12, which is characterized in that the method also includes:
Second memory node is identified according to the second node of the short UUID and second memory node, is generated described more
Second virtual address of media data, and second virtual address is sent to the second management node, the second management section
Second virtual address is sent to outer net bayonet server by point, by the outer net bayonet server by described second virtually
Location is stored to outer grid database.
14. according to the method for claim 13, which is characterized in that second management node receives the multimedia number of terminal
According to inquiry request, the multimedia data query request carries the second virtual address;It, will be described according to second virtual address
Multimedia data query request is redirected to the second memory node of the second virtual address instruction;
Second memory node receives the multimedia data query request, the multimedia that second virtual address is indicated
Data return to the terminal.
15. according to the method for claim 14, which is characterized in that
Second management node parses second virtual address, obtains the short UUID and second node mark;
Multimedia data query request is redirected to the second memory node of the second node mark instruction;
Second memory node receives the multimedia data query request, obtains the multimedia number according to the short UUID
According to physical address, obtain the multi-medium data from the physical address, Xiang Suoshu terminal returns to the multi-medium data.
16. a kind of date storage method, which is characterized in that be applied to data-storage system, the data-storage system includes interior
Net storage system, gateway and outer net storage system;Wherein, the Intranet storage system includes the first management node and multiple the
One memory node, each first memory node include cloud storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;Institute
Stating outer net storage system includes the second management node and multiple second memory nodes, and each second memory node includes cloud storage volume
With the FTP catalogue for supporting FTP service;Operation has ftp client on the gateway;
First management node of the Intranet storage system receives the resource allocation request of capture machine, and the multiple first is stored
The first memory node of target in node distributes to the capture machine;
When first memory node of target receives the capture machine transmission multi-medium data and short Universally Unique Identifier UUID,
By the multi-medium data and the short UUID store to first memory node of target cloud storage volume in and the mesh
It marks in the FTP catalogue of the first memory node;
The gateway reads the multimedia in the FTP catalogue of first memory node of target by the ftp client
Data and the short UUID, and the multi-medium data and the short UUID are sent to the target of the outer net storage system
In the FTP catalogue of two memory nodes;
Second memory node of target receives what the gateway was sent in the FTP catalogue of second memory node of target
The multi-medium data and when the short UUID, the multi-medium data and the short UUID are stored to the target second and deposited
It stores up in the cloud storage volume of node.
17. according to the method for claim 16, which is characterized in that first management node is stored from the multiple first
The first memory node of target is determined according to preset rules in node, and the first node of first memory node of target is identified
It is sent to the capture machine.
18. according to the method for claim 16, which is characterized in that first management node is by the short UUID and described
The first node mark of the first memory node of target is back to the capture machine;
The inside network interface card mouth server of capture machine sends the first virtual address,
The Intranet bayonet server stores first virtual address to intranet data storehouse, and first virtual address is based on
The short UUID and first node mark generate.
19. according to the method for claim 16, which is characterized in that the gateway is by the multi-medium data and described short
After UUID is sent in the FTP catalogue of the second memory node of target of the outer net storage system, the target first is deposited
It stores up the multi-medium data stored in the FTP catalogue of node and the short UUID is deleted.
20. according to the method for claim 16, which is characterized in that second memory node of target is according to the short UUID
It is identified with the second node of second memory node of target, generates the second virtual address of the multi-medium data, and by institute
It states the second virtual address and is sent to the second management node, second virtual address is sent to outer net by second management node
Bayonet server;
The outer net bayonet server stores second virtual address to outer grid database.
21. a kind of data-storage system, which is characterized in that including Intranet storage system, gateway and outer net storage system;Its
In, the Intranet storage system includes the first management node and multiple first memory nodes, and each first memory node includes cloud
Storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system includes the second management node and more
A second memory node, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;On the gateway
Operation has ftp client;
First management node of the Intranet storage system is used to manage the storage resource of the multiple first memory node, each
First memory node is used for the short UUID of storing data and the data in the cloud storage volume of first memory node;Or,
Second management node of the outer net storage system is used to manage the storage resource of the multiple second memory node, each
Second memory node is used for storing data and the data in the cloud storage volume and FTP catalogue of second memory node
Short UUID.
22. system according to claim 21, which is characterized in that first management node is used to receive more matchmakers of terminal
Volume data inquiry request, the multimedia data query request carry the first virtual address;It, will according to first virtual address
The multimedia data query request is redirected to the first memory node of target of the first virtual address instruction;
First memory node of target indicates first virtual address for receiving the multimedia data query request
Multi-medium data return to the terminal.
23. system according to claim 22, which is characterized in that first management node is used for virtual to described first
Address is parsed, and the short UUID and first node mark are obtained;Multimedia data query request is redirected to institute
State the first memory node of target of first node mark instruction;
First memory node of target is for receiving the multimedia data query request, according to the short UUID acquisition
The physical address of multi-medium data obtains the multi-medium data from the physical address, and Xiang Suoshu terminal returns to more matchmakers
Volume data.
24. system according to claim 21, which is characterized in that second management node is used to receive more matchmakers of terminal
Volume data inquiry request, the multimedia data query request carry the second virtual address;It, will according to second virtual address
The multimedia data query request is redirected to the second memory node of target of the second virtual address instruction;
Second memory node of target indicates second virtual address for receiving the multimedia data query request
Multi-medium data return to the terminal.
25. system according to claim 24, which is characterized in that second management node is used for virtual to described second
Address is parsed, and the short UUID and second node mark are obtained;Multimedia data query request is redirected to institute
State the second memory node of target of second node mark instruction;
Second memory node of target is for receiving the multimedia data query request, according to the short UUID acquisition
The physical address of multi-medium data obtains the multi-medium data from the physical address, and Xiang Suoshu terminal returns to more matchmakers
Volume data.
26. a kind of data query method, which is characterized in that including Intranet storage system, gateway and outer net storage system;Its
In, the Intranet storage system includes the first management node and multiple first memory nodes, and each first memory node includes cloud
Storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system includes the second management node and more
A second memory node, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;On the gateway
Operation has ftp client;
The short UUID of storing multimedia data and the multi-medium data in the cloud storage volume of the first memory node of target;Described
One management node receives the multimedia data query request of terminal, and the multimedia data query request carries first virtually
Location;According to first virtual address, multimedia data query request is redirected to first virtual address and is indicated
The first memory node of target;First memory node of target receives the multimedia data query request, by described first
The multi-medium data of virtual address instruction returns to the terminal;Or,
Storing multimedia data and the multi-medium data is short in the cloud storage volume and FTP catalogue of the second memory node of target
UUID;Second management node receives the multimedia data query request of terminal, and the multimedia data query request carries
Second virtual address;According to second virtual address, it is empty that multimedia data query request is redirected to described second
The second memory node of target of quasi- address instruction;Second memory node of target receives the multimedia data query request,
The multi-medium data that second virtual address indicates is returned into the terminal.
27. according to the method for claim 26, which is characterized in that first management node is to first virtual address
It is parsed, obtains the short UUID and first node mark;Multimedia data query request is redirected to described the
The first memory node of target of one node identification instruction;
First memory node of target receives the multimedia data query request, obtains more matchmakers according to the short UUID
The physical address of volume data obtains the multi-medium data from the physical address, and Xiang Suoshu terminal returns to the multimedia number
According to.
28. according to the method for claim 26, which is characterized in that second management node is to second virtual address
It is parsed, obtains the short UUID and second node mark;Multimedia data query request is redirected to described the
The second memory node of target of two node identifications instruction;
Second memory node of target receives the multimedia data query request, obtains more matchmakers according to the short UUID
The physical address of volume data obtains the multi-medium data from the physical address, and Xiang Suoshu terminal returns to the multimedia number
According to.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710944091.8A CN109600410B (en) | 2017-09-30 | 2017-09-30 | Data storage system and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710944091.8A CN109600410B (en) | 2017-09-30 | 2017-09-30 | Data storage system and method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109600410A true CN109600410A (en) | 2019-04-09 |
CN109600410B CN109600410B (en) | 2021-11-09 |
Family
ID=65956231
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710944091.8A Active CN109600410B (en) | 2017-09-30 | 2017-09-30 | Data storage system and method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109600410B (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110381093A (en) * | 2019-09-03 | 2019-10-25 | 北京旷视科技有限公司 | Method, apparatus, the system and electronic equipment of data transmission of data protocol conversion |
CN111343263A (en) * | 2020-02-21 | 2020-06-26 | 北京京东尚科信息技术有限公司 | Operation and maintenance system and operation and maintenance method for batch private cloud |
CN111447256A (en) * | 2020-03-05 | 2020-07-24 | 中国司法大数据研究院有限公司 | Cross-domain micro-service registration and release method and system based on file exchange |
CN111967054A (en) * | 2020-06-30 | 2020-11-20 | 国网浙江省电力有限公司培训中心 | Block chain-based anti-electricity-stealing evidence-obtaining image data storage method and system |
CN113271301A (en) * | 2021-05-12 | 2021-08-17 | 大连交通大学 | Network gate system communication method based on embedded multi-core processing mode |
CN113315846A (en) * | 2021-07-29 | 2021-08-27 | 武汉中科通达高新技术股份有限公司 | Data transmission method and device |
CN115296940A (en) * | 2022-10-09 | 2022-11-04 | 网御安全技术(深圳)有限公司 | Secure remote data interaction method for isolated network and related equipment |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2001033801A2 (en) * | 1999-10-30 | 2001-05-10 | Ibrixx Ag | Method and transaction interface for secure data exchange between distinguishable networks |
CN101083607A (en) * | 2006-05-30 | 2007-12-05 | 倪海生 | Internet accessing server for inside and outside network isolation and its processing method |
CN102307221A (en) * | 2011-03-25 | 2012-01-04 | 国云科技股份有限公司 | Cloud storage system and implementation method thereof |
CN106230870A (en) * | 2016-10-13 | 2016-12-14 | 成都东方盛行电子有限责任公司 | Proprietary protocol document transmission system and method |
CN106790521A (en) * | 2016-12-20 | 2017-05-31 | 创新科存储技术(深圳)有限公司 | The system and method for distributed networking is carried out using the node device based on FTP |
CN106850710A (en) * | 2015-12-03 | 2017-06-13 | 杭州海康威视数字技术股份有限公司 | A kind of safe data cloud storage system, client terminal, storage server and application process |
CN106960037A (en) * | 2017-03-22 | 2017-07-18 | 河海大学 | A kind of distributed index the resources integration and share method across intranet and extranet |
-
2017
- 2017-09-30 CN CN201710944091.8A patent/CN109600410B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2001033801A2 (en) * | 1999-10-30 | 2001-05-10 | Ibrixx Ag | Method and transaction interface for secure data exchange between distinguishable networks |
CN101083607A (en) * | 2006-05-30 | 2007-12-05 | 倪海生 | Internet accessing server for inside and outside network isolation and its processing method |
CN102307221A (en) * | 2011-03-25 | 2012-01-04 | 国云科技股份有限公司 | Cloud storage system and implementation method thereof |
CN106850710A (en) * | 2015-12-03 | 2017-06-13 | 杭州海康威视数字技术股份有限公司 | A kind of safe data cloud storage system, client terminal, storage server and application process |
CN106230870A (en) * | 2016-10-13 | 2016-12-14 | 成都东方盛行电子有限责任公司 | Proprietary protocol document transmission system and method |
CN106790521A (en) * | 2016-12-20 | 2017-05-31 | 创新科存储技术(深圳)有限公司 | The system and method for distributed networking is carried out using the node device based on FTP |
CN106960037A (en) * | 2017-03-22 | 2017-07-18 | 河海大学 | A kind of distributed index the resources integration and share method across intranet and extranet |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110381093A (en) * | 2019-09-03 | 2019-10-25 | 北京旷视科技有限公司 | Method, apparatus, the system and electronic equipment of data transmission of data protocol conversion |
CN110381093B (en) * | 2019-09-03 | 2022-07-19 | 北京旷视科技有限公司 | Method and device for converting data protocol, system for transmitting data and electronic equipment |
CN111343263A (en) * | 2020-02-21 | 2020-06-26 | 北京京东尚科信息技术有限公司 | Operation and maintenance system and operation and maintenance method for batch private cloud |
CN111447256A (en) * | 2020-03-05 | 2020-07-24 | 中国司法大数据研究院有限公司 | Cross-domain micro-service registration and release method and system based on file exchange |
CN111447256B (en) * | 2020-03-05 | 2022-07-01 | 中国司法大数据研究院有限公司 | Cross-domain micro-service registration and release method and system based on file exchange |
CN111967054A (en) * | 2020-06-30 | 2020-11-20 | 国网浙江省电力有限公司培训中心 | Block chain-based anti-electricity-stealing evidence-obtaining image data storage method and system |
CN113271301A (en) * | 2021-05-12 | 2021-08-17 | 大连交通大学 | Network gate system communication method based on embedded multi-core processing mode |
CN113271301B (en) * | 2021-05-12 | 2023-04-25 | 大连交通大学 | Communication method of network gate system based on embedded multi-core processing mode |
CN113315846A (en) * | 2021-07-29 | 2021-08-27 | 武汉中科通达高新技术股份有限公司 | Data transmission method and device |
CN115296940A (en) * | 2022-10-09 | 2022-11-04 | 网御安全技术(深圳)有限公司 | Secure remote data interaction method for isolated network and related equipment |
CN115296940B (en) * | 2022-10-09 | 2023-01-17 | 网御安全技术(深圳)有限公司 | Secure remote data interaction method for isolated network and related equipment |
Also Published As
Publication number | Publication date |
---|---|
CN109600410B (en) | 2021-11-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109600410A (en) | Data-storage system and method | |
US8069224B2 (en) | Method, equipment and system for resource acquisition | |
US9445162B2 (en) | Interactive personal/internet protocol television reservation system, reservation plan management method and device | |
CN109391664A (en) | System and method for the deployment of more cluster containers | |
JP2008533816A5 (en) | ||
CN105141672B (en) | A kind of date storage method, apparatus and system | |
CN106933550B (en) | Global information obtaining, processing and updating method, device and system | |
CN103761256B (en) | Maintenance system and method of branch points of remote directories | |
US11044343B2 (en) | Method and apparatus for serving and managing storage of data streams in a surveillance and/or monitoring system | |
CN107851122A (en) | The data of Mass storage and retrieval with good bounded life | |
CN108933798A (en) | Date storage method, storage server and system | |
CN105512279A (en) | Metadata access method, related equipment and system | |
KR100977159B1 (en) | Method and system for managing file metadata transparent to data server address change and disk movement | |
CN105450964B (en) | Method, system and management node for cloud storage of video data | |
CN110457307B (en) | Metadata management system, user cluster creation method, device, equipment and medium | |
US20160308871A1 (en) | Network element data access method and apparatus, and network management system | |
CN108205468A (en) | A kind of distributed system and implementation method towards massive video image | |
KR100754227B1 (en) | Method and apparatus for preventing duplicate storage of resources among GPNP devices providing content directory services in content synchronization | |
WO2007011164A1 (en) | Virtual storage system and method for managementing virtual storage based on ad-hoc network | |
CN109996031B (en) | Monitoring system and monitoring method | |
US9348847B2 (en) | Data access control apparatus and data access control method | |
CN106649528A (en) | Picture writing and reading methods and devices | |
US9286305B2 (en) | Virtual storage gate system | |
KR20070012210A (en) | How to manage virtual storage systems and virtual storage based on ad hoc networks | |
KR101592860B1 (en) | Distributed storage system using Internet of Things Device and operating method thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |