[go: up one dir, main page]

CN109600410A - Data-storage system and method - Google Patents

Data-storage system and method Download PDF

Info

Publication number
CN109600410A
CN109600410A CN201710944091.8A CN201710944091A CN109600410A CN 109600410 A CN109600410 A CN 109600410A CN 201710944091 A CN201710944091 A CN 201710944091A CN 109600410 A CN109600410 A CN 109600410A
Authority
CN
China
Prior art keywords
node
memory node
target
storage system
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710944091.8A
Other languages
Chinese (zh)
Other versions
CN109600410B (en
Inventor
许爱秋
汪渭春
林起芊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Priority to CN201710944091.8A priority Critical patent/CN109600410B/en
Publication of CN109600410A publication Critical patent/CN109600410A/en
Application granted granted Critical
Publication of CN109600410B publication Critical patent/CN109600410B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L61/00Network arrangements, protocols or services for addressing or naming
    • H04L61/09Mapping addresses
    • H04L61/10Mapping addresses of different types
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L61/00Network arrangements, protocols or services for addressing or naming
    • H04L61/30Managing network names, e.g. use of aliases or nicknames
    • H04L61/3015Name registration, generation or assignment
    • H04L61/3025Domain name generation or assignment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/02Network architectures or network communication protocols for network security for separating internal from external traffic, e.g. firewalls
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Hardware Design (AREA)
  • Computer Security & Cryptography (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present invention relates to a kind of data-storage system and methods, belong to technical field of video monitoring.By being all made of management node-memory node framework in the Intranet storage system in data-storage system and outer net storage system, and, it is laid in memory node and volume and FTP catalogue is locally stored, make it possible to the ftp client by being run on gateway to read the multi-medium data of FTP catalogue in Intranet memory node, the multi-medium data is ferried to the FTP catalogue of outer net memory node again, the ferry-boat process can make Intranet no longer need to rely on independent ftp server in Intranet and outer net to the data transmission of outer net, it disposes relatively simple, it is desirable that lower.

Description

Data-storage system and method
Technical field
The present invention relates to technical field of video monitoring, in particular to a kind of data-storage system and method.
Background technique
In recent years, with the enhancing of public awareness of safety, video monitoring system is come into being.In order to guarantee each place Safety, safety guarantee department can retrieve for examination the monitor video data in each place at any time, when necessary, it is also necessary to retrieve for examination each place Real time monitoring, to carry out United Dispatching and commander.In video monitoring system, it can be divided according to the property of monitored site Network structure, the places such as important unit, key sector belong to inside due to being related to the confidential information of each department Place in network;The places such as school, residential area are consequently belonging to the field in external network due to being public place Institute, internal network independently work with external network, internal in order to ensure the safety of the confidential information in internal network It needs to establish gateway between network and external network, realizes and be physically separated between internal network and external network, and in order to The unified call and flexible transmission for realizing multi-medium data in internal network and external network, between internal network and external network Have to the transmission that inter-network lock carries out multi-medium data.
In the related technology, independent FTP (File Transfer is disposed respectively in internal network and external network Protocol, File Transfer Protocol) server, multi-medium data uploads to Intranet FTP service by the capture machine in internal network Device and Intranet cloud storage system are moved the multi-medium data in Intranet cloud storage system to outer net by the built-in application in gateway In cloud storage system, realize that the multi-medium data of inter-network lock between internal network and external network transmits.
In the implementation of the present invention, inventor find the relevant technologies the prior art has at least the following problems:
In order to realize that multi-medium data by the transmission of Intranet to outer net, is required to dispose independent FTP in Intranet and outer net Server, when multi-medium data is uploaded to Intranet ftp server by capture machine, if the multi-medium data for currently needing to upload Data volume is larger, and the time requirement that multi-medium data is synchronized to outer net ftp server by Intranet ftp server is shorter, then right The ftp server of Intranet and outer net can generate larger pressure, at this moment, just need to use and dispose multiple FTP clothes in Intranet and outer net Business device is just able to satisfy the performance requirement of multi-medium data upload, higher to the deployment request of equipment in Intranet and outer net, disposes Journey is complex.
Summary of the invention
To overcome the problems in correlation technique, the present invention provides a kind of data-storage system and method.
On the one hand, a kind of data-storage system, including Intranet storage system, gateway and outer net storage system are provided; Wherein, the Intranet storage system includes the first management node and multiple first memory nodes, and each first memory node includes Cloud storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system include the second management node and Multiple second memory nodes, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;The gateway Upper operation has ftp client;
First management node of the Intranet storage system is used to receive the resource allocation request of capture machine, will be the multiple The first memory node of target in first memory node distributes to the capture machine;
First memory node of target is used to receive the multi-medium data and short general unique knowledge that the capture machine is sent When other code UUID, the multi-medium data and the short UUID are stored into the cloud storage volume of first memory node of target And in the FTP catalogue of first memory node of target;
The gateway is used to read the institute in the FTP catalogue of first memory node of target by the ftp client Multi-medium data and the short UUID are stated, and the multi-medium data and the short UUID are sent to the outer net storage system The second memory node of target FTP catalogue in;
Second memory node of target is for receiving the net in the FTP catalogue of second memory node of target When the multi-medium data and UUID that lock is sent, the multi-medium data and the short UUID are stored to the target second In the cloud storage volume of memory node.
On the one hand, a kind of multimedia data storage method is provided, the method is applied to the Intranet of data-storage system In storage system, the data-storage system includes Intranet storage system, gateway and outer net storage system;Wherein, in described Net storage system includes the first management node and multiple first memory nodes, and each first memory node includes cloud storage volume and branch Hold the FTP catalogue of File Transfer Protocol FTP service;The outer net storage system includes the second management node and multiple second storages Node, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;Operation has FTP objective on the gateway Family end;
The described method includes:
First management node of the Intranet storage system receives the resource allocation request of capture machine, by the multiple first The first memory node of target in memory node distributes to the capture machine;
First memory node of target receives the multi-medium data and short Universally Unique Identifier that the capture machine is sent When UUID, by the multi-medium data and the short UUID store to first memory node of target cloud storage volume in and In the FTP catalogue of first memory node of target, by the ftp client on the gateway by first memory node of target FTP catalogue in the multi-medium data and the short UUID be sent to the outer net storage system.
On the one hand, a kind of date storage method is provided, the outer net that the method is applied to data-storage system stores system In system, the data-storage system includes Intranet storage system, gateway and outer net storage system;Wherein, the Intranet storage System includes the first management node and multiple first memory nodes, and each first memory node includes cloud storage volume and support file The FTP catalogue of transport protocol FTP service;The outer net storage system includes the second management node and multiple second memory nodes, Each second memory node includes cloud storage volume and the FTP catalogue for supporting FTP service;Operation has ftp client on the gateway;
Any one second memory node receives the multi-medium data and short UUID sent by the ftp client of the gateway;
Second memory node stores multi-medium data and short UUID to the FTP catalogue of second memory node In;
Second memory node stores the multi-medium data and the short UUID to second memory node In cloud storage volume.
On the one hand, a kind of date storage method is provided, data-storage system is applied to, the data-storage system includes Intranet storage system, gateway and outer net storage system;Wherein, the Intranet storage system includes the first management node and multiple First memory node, each first memory node include cloud storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service; The outer net storage system includes the second management node and multiple second memory nodes, and each second memory node includes cloud storage Volume and the FTP catalogue for supporting FTP service;Operation has ftp client on the gateway;
First management node of the Intranet storage system receives the resource allocation request of capture machine, by the multiple first The first memory node of target in memory node distributes to the capture machine;
First memory node of target receives the capture machine and sends multi-medium data and short Universally Unique Identifier When UUID, by the multi-medium data and the short UUID store to first memory node of target cloud storage volume in and In the FTP catalogue of first memory node of target;
The gateway is read described more in the FTP catalogue of first memory node of target by the ftp client Media data and the short UUID, and the multi-medium data and the short UUID are sent to the mesh of the outer net storage system It marks in the FTP catalogue of the second memory node;
Second memory node of target receives the gateway hair in the FTP catalogue of second memory node of target When the multi-medium data and the short UUID that send, the multi-medium data and the short UUID are stored to the target In the cloud storage volume of two memory nodes.
On the one hand, a kind of data-storage system, including Intranet storage system, gateway and outer net storage system are provided; Wherein, the Intranet storage system includes the first management node and multiple first memory nodes, and each first memory node includes Cloud storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system include the second management node and Multiple second memory nodes, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;The gateway Upper operation has ftp client;
First management node of the Intranet storage system is used to manage the storage resource of the multiple first memory node, Each first memory node is used for the short UUID of storing data and the data in the cloud storage volume of first memory node; Or,
Second management node of the outer net storage system is used to manage the storage resource of the multiple second memory node, Each second memory node is used for storing data and the number in the cloud storage volume and FTP catalogue of second memory node According to short UUID.
On the one hand, a kind of data query method, including Intranet storage system, gateway and outer net storage system are provided; Wherein, the Intranet storage system includes the first management node and multiple first memory nodes, and each first memory node includes Cloud storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system include the second management node and Multiple second memory nodes, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;The gateway Upper operation has ftp client;
The short UUID of storing multimedia data and the multi-medium data in the cloud storage volume of the first memory node of target;Institute The multimedia data query request that the first management node receives terminal is stated, it is virtual that the multimedia data query request carries first Address;According to first virtual address, multimedia data query request is redirected to first virtual address and is referred to The first memory node of target shown;First memory node of target receives the multimedia data query request, by described the The multi-medium data of one virtual address instruction returns to the terminal;Or,
Storing multimedia data and the multi-medium data in the cloud storage volume and FTP catalogue of the second memory node of target Short UUID;Second management node receives the multimedia data query request of terminal, the multimedia data query request Carry the second virtual address;According to second virtual address, multimedia data query request is redirected to described the The second memory node of target of two virtual addresses instruction;Second memory node of target receives the multimedia data query and asks It asks, the multi-medium data that second virtual address indicates is returned into the terminal.
The technical solution that the embodiment of the present invention provides can include the following benefits:
By being all made of management node-storage section in the Intranet storage system in data-storage system and outer net storage system The framework of point, also, laid in memory node and volume and FTP catalogue is locally stored, make it possible to by being run on gateway Ftp client ferry to read the multi-medium data of FTP catalogue in Intranet memory node, then by the multi-medium data to outer net The FTP catalogue of memory node, the ferry-boat process can make Intranet no longer need to rely on Intranet and outer net to the data transmission of outer net In independent ftp server, dispose it is relatively simple, it is desirable that it is lower.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not It can the limitation present invention.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows and meets implementation of the invention Example, and be used to explain the principle of the present invention together with specification.
Figure 1A is a kind of architecture diagram of data-storage system shown according to an exemplary embodiment;
Figure 1B is a kind of schematic diagram of data-storage system shown according to an exemplary embodiment;
Fig. 1 C is a kind of schematic diagram of multi-medium data storage format shown according to an exemplary embodiment;
Fig. 2 is a kind of stream compression schematic diagram based on data-storage system provided in an embodiment of the present invention;
Fig. 3 is a kind of flow chart of date storage method provided in an embodiment of the present invention;
Fig. 4 is a kind of flow chart of data query method provided in an embodiment of the present invention;
Fig. 5 is a kind of structural schematic diagram of data storage device provided in an embodiment of the present invention;
Fig. 6 is a kind of structural schematic diagram of data storage device provided in an embodiment of the present invention;
Fig. 7 is a kind of block diagram of computer equipment 700 shown according to an exemplary embodiment.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all embodiments consistented with the present invention.On the contrary, they be only with it is such as appended The example of device and method being described in detail in claims, some aspects of the invention are consistent.
Video monitoring system is divided into Intranet and outer net, Intranet include capture machine, Intranet bayonet server, intranet data storehouse and Intranet storage system;Outer net storage system includes outer net bayonet server, outer grid database and outer net storage system, which deposits Storage system and outer net storage system constitute the data-storage system in video monitoring system.Referring to Figure 1A, Intranet storage system It is all made of distributed structure/architecture with outer net storage system, is divided into management node and multiple memory nodes according to physical aspect.Each deposit Block device on storage node is divided into two parts, and a part is rolled up by cloud storage service as cloud storage come using a part passes through Carry local file system comes as FTP service using being specifically provided as FTP catalogue.
Specifically, referring to Figure 1B, which includes the first management node and multiple first memory nodes, each First memory node includes cloud storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system includes Second management node and multiple second memory nodes, each second memory node include cloud storage volume and the FTP for supporting FTP service Catalogue;Operation has ftp client on the gateway.
In the following, being based on data storage procedure, the function of above-mentioned Intranet storage system, gateway and outer net storage system is carried out It introduces:
Intranet storage system: the first management node and multiple first memory nodes
First management node is for being managed the storage resource of multiple first memory nodes, each first memory node It is divided into cloud storage volume and FTP catalogue, the FTP catalogue refers to the FTP service of carry local file system.Each first storage Node corresponds to only one first node mark, and the first node mark of each first memory node is all different.
First management node of the Intranet storage system is used to receive the resource allocation request of capture machine, by multiple first The first memory node of target in memory node distributes to the capture machine;First memory node of target is for receiving the capture machine The multi-medium data of transmission and short Universally Unique Identifier UUID (Universally Unique Identifier, it is general unique Identification code) when, the multi-medium data and the short UUID are stored into the cloud storage volume of the first memory node of the target and be somebody's turn to do In the FTP catalogue of the first memory node of target.It should be noted that the first memory node of target can be synchronized multi-medium data It is written with the short UUID in the FTP catalogue of first memory node of target.
Wherein, first management node is for determining target first according to preset rules from multiple first memory node Memory node, and the first node of first memory node of target mark is sent to the capture machine, by capture machine by multimedia First memory node of target is written in data and the short UUID.First management node can be according to load balancing principle from multiple Determine that a present load meets the second memory node of demand as the first memory node of target in two memory nodes, certainly, Each first memory node can correspond to a cryptographic Hash range, which is also based on hash value algorithms The cryptographic Hash of multi-medium data is calculated, to select the first memory node of cryptographic Hash range corresponding to the cryptographic Hash as mesh the One memory node, how the embodiment of the present invention is to specifically selecting node without limitation.
Wherein, short UUID can be stored in more by memory node when being stored multi-medium data and short UUID correspondence In the data head of media data (as shown in Figure 1 C), corresponding short UUID is carried by multi-medium data, to incite somebody to action subsequent When multi-medium data is transmitted in outer net storage system, the UUID of multi-medium data is remained unchanged, and is allowed to directly according to short UUID determines same multi-medium data in Intranet storage system and outer net storage system, and upper layer application storage multimedia is omitted The mapping relations of physical address of the data in Intranet storage system and outer net storage system avoid occurring in upper layer application different Chang Shi, the mapping relations that may cause permanently are lost, and lead to not search in Intranet storage system and outer net storage system more Media data.
After storing multi-medium data and short UUID in the cloud storage volume to the first memory node of target, due to multimedia Data are stored on the memory node of Intranet, and therefore, multi-medium data can correspond to a physical address, the target in Intranet One memory node can store the mapping relations between physical address and short UUID.The first memory node of target can be generated Mapping table as shown in Table 1 stores the mapping relations between short UUID and physical address into mapping table.
Table 1
Short UUID abc
Physical address def
Timestamp information 22:02:06
Random code 123456
In order to which the information of more detailed data recording multimedia data and enhancing are to the confidentiality of multimedia messages, in reality In, the timestamp information and random code of multi-medium data can also be increased in mapping table.It should be noted that The mode of mapping relations is without specifically limiting between present invention UUID short to storage and physical address.The physics of multi-medium data The mapping relations of address and short UUID have also been made in the storage volume of the bottom of cloud storage system other than being stored in database Backup, is saved together with multi-medium data.It can also be restored by tool even if the map information of local data base loss, Improve Information Security.
It should be noted that the first memory node of target is when storing multi-medium data and short UUID to FTP catalogue, one Aspect can generate multi-medium data title for each multi-medium data, include short UUID in multi-medium data title, and will be more Media data is corresponding with multi-medium data title to be stored;It on the other hand, can be directly corresponding with short UUID by multi-medium data It is stored, the embodiment of the present invention is to this without specifically limiting.
In order to which the storage location of data recording multimedia data can directly exist when to inquire multi-medium data in Intranet Storage location obtains multi-medium data, which can be sent to the first management node for the short UUID;It should First management node is also used to the first node of the short UUID and first memory node of target mark being back to the capture machine, First virtual address is sent by the inside network interface card mouth server of the capture machine, and by the Intranet bayonet server by this first virtually Location is stored to intranet data storehouse, which is based on the short UUID and first node mark generates, so as to subsequent base Multi-medium data is obtained in the first virtual address.Wherein, virtual address can be URL ((Uniform Resource Locator, uniform resource locator) form.
In addition, the capture machine in Intranet is used to acquire the multi-medium data of its position, the short of multi-medium data is generated UUID, and based on the first memory node of target that the first management node is distributed, multi-medium data and short UUID are stored to interior The first memory node of target of net storage system, moreover, can be by first in the first virtual address for receiving multi-medium data Virtual address is uploaded to Intranet bayonet server;Wherein, multi-medium data can be image data or video data, each more matchmakers Volume data corresponds to the short UUID of only one, and the UUID of each multi-medium data is different.Short UUID is right with it for identifying The multi-medium data answered, capture machine can be generated using preset algorithm, be preset when generating short UUID for each multi-medium data Algorithm can be SHA1 (Secure Hash Algorithm, Secure Hash Algorithm) digest algorithm and Boost (portable) library Deng the present invention is to this without specifically limiting.
Intranet bayonet server is used to receive the first virtual address of capture machine transmission, and the first virtual address is transmitted to Intranet data storehouse is stored by intranet data storehouse;Intranet data storehouse is empty when receive Intranet bayonet server transport first Behind quasi- address, the first virtual address is stored.
Gateway
Gateway is used to read the multimedia number in the FTP catalogue of first memory node of target by the ftp client According to the short UUID, and the multi-medium data and the short UUID are sent to the second memory node of target of the outer net storage system FTP catalogue in;The gateway can be periodically detected each first memory node in Intranet storage system by ftp client FTP catalogue in whether be stored with new multi-medium data and short UUID, deposited when detecting in first memory node of target When containing new multi-medium data and the short UUID, more matchmakers in the FTP catalogue for reading first memory node of target are executed Volume data and the short UUID and the process sent to outer net storage system.
The target second that the gateway is also used to for the multi-medium data and the short UUID being sent to the outer net storage system is deposited It is after storing up in the FTP catalogue of node, the multi-medium data stored in the FTP catalogue of first memory node of target is short with this UUID is deleted, it is possible to reduce the data volume stored in Intranet storage system mitigates the pressure of Intranet storage system.
It should be noted that since the ftp client in gateway may manage multiple Intranet storage systems and outer net is deposited Storage system avoids multi-medium data and short UUID for the corresponding relationship established between Intranet FTP service and outer net FTP service The situation of data connection object mistake occurs when being transmitted, it therefore, can be by the of Intranet FTP service in ftp client One address of service is corresponding with the second service address of outer net FTP service to be stored.In this way, gateway before being worked, needs The first service address of the Intranet FTP service of Intranet storage system is obtained, the outer net FTP service of outer net storage system is obtained Second service address, and by first service address and second service address correspondence store the ftp client into gateway, so as to It is subsequent when multi-medium data and short UUID are transmitted to outer net storage system, it can determine outer net corresponding with Intranet storage system Storage system avoids connection object that mistake occurs.
Correspondingly, in embodiments of the present invention, due to being stored with first service address and second service in ftp client Corresponding relationship between location, therefore, after ftp client obtains multi-medium data and short UUID in Intranet FTP service, FTP Client can determine corresponding second service address according to the first service address of Intranet storage system, and by multimedia Data and short UUID are transmitted in the outer net storage system of second service address instruction.
Outer net storage system: the second management node and multiple second memory nodes
Second management node is for being managed the storage resource of multiple second memory nodes, each second memory node It is divided into cloud storage volume and FTP catalogue, the FTP catalogue refers to the FTP service of carry local file system.Each second storage Node corresponds to only one second node mark, and the second node mark of each second memory node is all different.
For any one second memory node, which is used for the FTP mesh in second memory node When receiving multi-medium data and UUID of gateway transmission in record, by the multi-medium data and the short UUID store to this second In the cloud storage volume of memory node.It should be noted that due to the second memory node by multi-medium data and short UUID storage When to FTP catalogue, on the one hand, multi-medium data title can be generated for each multi-medium data, wrapped in multi-medium data title Include short UUID, and store multi-medium data is corresponding with multi-medium data title;It on the other hand, can be directly by multimedia number It is stored according to corresponding with short UUID, therefore, if multi-medium data and multimedia number that the FTP catalogue of the first memory node stores According to title, then store multi-medium data is corresponding with multi-medium data title;If the FTP catalogue of the first memory node stores Multi-medium data and short UUID, then store multi-medium data is corresponding with short UUID.
In embodiments of the present invention, since the FTP catalogue of the second memory node stores the multimedia of gateway transmission first Data and short UUID, therefore, when increasing newly in Intranet storage system has multi-medium data and short UUID, in outer net storage system Also multi-medium data and short UUID can be increased newly.For the second memory node of each of outer net storage system, this second Memory node can periodically detect newly-increased multi-medium data and short UUID whether are stored in FTP catalogue, and work as and detect When FTP catalogue is stored with newly-increased multi-medium data and short UUID, newly-increased multi-medium data and short UUID are obtained, so as to will be new The multi-medium data of increasing and short UUID are stored to cloud storage and are rolled up, and complete multi-medium data and short UUID by Intranet storage system to outer The transmission of net storage system.After storing multi-medium data and short UUID into outer net storage system, can also be formed with it is interior Mapping relations in net storage system similarly, are no longer repeated herein.
Further, which identifies according to the second node of the short UUID and second memory node, raw The second management node, second pipe are sent at the second virtual address of the multi-medium data, and by second virtual address Manage node will second virtual address transmission outer net bayonet server, by the outer net bayonet server by second virtual address It stores to outer grid database.
Framework provided in an embodiment of the present invention, provide it is following the utility model has the advantages that
By being all made of management node-storage in the Intranet storage system in data-storage system and outer net storage system The framework of node, also, laid in memory node and volume and FTP catalogue is locally stored, make it possible to by being transported on gateway Capable ftp client is ferried to read the multi-medium data of FTP catalogue in Intranet memory node, then by the multi-medium data to outer The FTP catalogue of net memory node, the ferry-boat process can make Intranet no longer need to rely on Intranet and outer to the data transmission of outer net Independent ftp server in net is disposed relatively simple, it is desirable that lower.
Further, additionally provide it is below the utility model has the advantages that
(1) multi-medium data of capture machine is directly stored to the cloud storage volume of Intranet storage system and local FTP service, And by the ferry-boat of gateway, it also can directly store to the cloud storage volume of outer net storage system and local FTP service, provide The scheme that multi-medium data directly stores.Since data flow is without bayonet server, the property of platform card mouth server is reduced It can pressure.
(2) gateway program is combined to realize the high speed ferry-boat of multi-medium data between intranet and extranet, multi-medium data is by Intranet FTP After service ferry-boat to outer net FTP service, the update of multi-medium data is detected by cloud storage plug-in, it is automatic to realize more matchmakers Volume data is written in cloud storage volume, to provide multi-medium data inter-network lock automatic synchronization scheme between two cloudlets.
(3) it since Intranet storage system and outer net storage system are when storing multi-medium data, has been all made of short UUID is identified, and the upper layer application platform of intranet and extranet can access intranet and extranet difference cloud storage system using same short UUID The same multi-medium data in system, eliminates external program come the step of recording mapping relations.
To carry out date storage method provided in an embodiment of the present invention below based on the framework of above-mentioned data-storage system It introduces, in order to make it easy to understand, can be illustrated in conjunction with the data flow in Fig. 2 and the interaction of the specific steps in Fig. 3:
301, the first management node of Intranet storage system receives the resource allocation request of capture machine, and multiple first is deposited The first memory node of target in storage node distributes to the capture machine.
Capture machine acquires the multi-medium data of position, and the first management node into Intranet storage system sends money Source distribution request stores multi-medium data to request storage resource.Specifically, first management node be used for from The first memory node of target is determined according to preset rules in multiple first memory node, and by first memory node of target First node mark is sent to the capture machine.When capture machine gets the first node mark of the first memory node of target, meeting The short UUID of the multi-medium data and multi-medium data is sent to first memory node of target.
302, the first memory node of target receives the multi-medium data and short UUID that capture machine is sent, and by the multimedia number According to the short UUID store to the first memory node of the target cloud storage volume in and first memory node of target FTP mesh In record.
In a kind of possible implementation, which is sent to the first management node for the short UUID;It should The first node of the short UUID and first memory node of target mark is also back to the capture machine by the first management node;This is grabbed The inside network interface card mouth server of bat machine sends the first virtual address, which stores first virtual address to interior Grid database, which is based on the short UUID and first node mark generates.
303, gateway has newly-increased multimedia by being periodically detected in determining the first memory node of target for ftp client Data and short UUID read the multi-medium data and the short UUID in the FTP catalogue of first memory node of target.
304, the gateway stores the target second that the multi-medium data and the short UUID are sent to the outer net storage system In the FTP catalogue of node.
Further, which is sent to the multi-medium data and the short UUID target second of the outer net storage system After in the FTP catalogue of memory node, by the multi-medium data stored in the FTP catalogue of first memory node of target and it is somebody's turn to do Short UUID is deleted.
305, the second memory node of target receives gateway transmission in the FTP catalogue of second memory node of target The multi-medium data and when UUID, the multi-medium data and the short UUID are stored to the cloud storage of the second memory node of the target In volume.
Further, second memory node of target is according to the second node of the short UUID and second memory node of target Mark, generates the second virtual address of the multi-medium data, and second virtual address is sent to the second management node, this Second virtual address is sent to outer net bayonet server by two management nodes;The outer net bayonet server is second virtual by this Address is stored to outer grid database.
Method provided in an embodiment of the present invention reads Intranet memory node by the ftp client run on gateway The multi-medium data of middle FTP catalogue, then the multi-medium data is ferried to the FTP catalogue of outer net memory node, the ferry-boat process Intranet can be made to no longer need to rely on independent ftp server in Intranet and outer net to the data transmission of outer net, deployment is more simple It is single, it is desirable that lower.Further, method provided in an embodiment of the present invention makes full use of video cloud storage system distributed type assemblies The advantage of framework, the built-in FTP service on the memory node of cloud storage system, eliminates the expense of ftp server.Simultaneously because FTP service is also clustered deploy(ment), and gateway application is allow concurrently to access FTP service, improves the performance of inter-network lock picture storage.
The embodiment of the invention also provides a kind of data-storage system, the data-storage system include Intranet storage system, Gateway and outer net storage system;Wherein, which includes the first management node and multiple first memory nodes, often A first memory node includes cloud storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system packet The second management node and multiple second memory nodes are included, each second memory node includes cloud storage volume and support FTP service FTP catalogue;Operation has ftp client on the gateway.Specific system structure can with similarly, data are stored shown in Fig. 1 and Fig. 2 For system, when being stored with multi-medium data, data query function can also be provided for user, be based on data query function, The function of above-mentioned Intranet storage system, gateway and outer net storage system is introduced:
By taking Intranet storage system as an example, the first management node of the Intranet storage system is for managing multiple first storage The storage resource of node, each first memory node are used for storing data and number in the cloud storage volume of first memory node According to short UUID;
First management node is used to receive the multimedia data query request of terminal, and multimedia data query request is taken The first virtual address of band;According to first virtual address, multimedia data query request is redirected to this first virtually The first memory node of target of location instruction;First memory node of target is for receiving multimedia data query request, by this The multi-medium data of first virtual address instruction returns to the terminal.
First management node obtains the short UUID and first node mark for parsing to first virtual address Know;Multimedia data query request is redirected to the first memory node of target of first node mark instruction;
First memory node of target obtains more matchmakers according to the short UUID for receiving multimedia data query request The physical address of volume data, obtains the multi-medium data from the physical address, returns to the multi-medium data to the terminal.
Terminal can access Intranet storage system by platform, and search intranet data based on certain search condition Library to get the first virtual address of multi-medium data, and the first virtual address is carried and is asked in multimedia data query The first management node is sent in asking, it can be by the method for Redirect URL, by the multimedia of the platform by the first management node Data inquiry request is redirected to the memory node of the actual storage data, by memory node by being analyzed and acquired by multimedia number According to physical address, and get multi-medium data based on physical address and return to platform, terminal is returned to by platform.Certainly, The redirection can also refer to request the multimedia data query to be redirected to cloud storage service, enable cloud storage service It parses and determines physical address, that is to say that data are stored on which address of which node, then obtain more matchmakers from the node Volume data returns to platform.
By taking outer net storage system as an example, the second management node of the outer net storage system is for managing multiple second storage The storage resource of node, each second memory node are used in the cloud storage volume and FTP catalogue of second memory node store The short UUID of data and the data.
Second management node is used to receive the multimedia data query request of terminal, and multimedia data query request is taken The second virtual address of band;According to second virtual address, multimedia data query request is redirected to this second virtually Second memory node of location instruction;
Second memory node is for receiving multimedia data query request, more matchmakers which is indicated Volume data returns to the terminal.
Further, second management node is for parsing second virtual address, obtains the short UUID and the Two node identifications;Multimedia data query request is redirected to the second memory node of second node mark instruction;
Second memory node obtains the multimedia number according to the short UUID for receiving multimedia data query request According to physical address, obtain the multi-medium data from the physical address, return to the multi-medium data to the terminal.
Terminal can access outer net storage system by platform, and outer network data is searched based on certain search condition Library to get the second virtual address of multi-medium data, and the second virtual address is carried and is asked in multimedia data query The second management node is sent in asking, it can be by the method for Redirect URL, by the multimedia of the platform by the second management node Data inquiry request is redirected to the memory node of the actual storage data, by memory node by being analyzed and acquired by multimedia number According to physical address, and get multi-medium data based on physical address and return to platform, terminal is returned to by platform.Certainly, The redirection can also refer to request the multimedia data query to be redirected to cloud storage service, enable cloud storage service It parses and determines physical address, that is to say that data are stored on which address of which node, then obtain more matchmakers from the node Volume data returns to platform.
It should be noted that since Intranet storage system and outer net storage system are when storing multi-medium data, Short UUID has been all made of to be identified, then it is same to media data when user inquires multi-medium data by respective platform Corresponding short UUID be it is identical, eliminate external program come the step of recording mapping relations.
Certainly, the storage method of multi-medium data can be with depositing in above-mentioned data-storage system in the data-storage system Method for storing similarly, can also be stored, it is not limited in the embodiment of the present invention using different stream compression modes.
To carry out date storage method provided in an embodiment of the present invention below based on the framework of above-mentioned data-storage system It introduces, in order to make it easy to understand, can be illustrated in conjunction with the specific steps interaction in Fig. 4, the inquiry with Intranet storage system is Example:
401, Intranet platform receives the search condition of terminal, according to search condition, meets the inspection from intranet data storehouse acquisition First virtual address of rope condition.
Intranet platform can refer to Intranet platform application program, and for Intranet inquiry system, operation has Intranet flat Platform application program can realize query process based on the programmed logic of the Intranet platform application program.
402, Intranet platform sends multimedia data query request, multimedia data query request to the first management node Carry first virtual address.
403, when the first management node receives first virtual address, the first virtual address is parsed, is obtained Short UUID and first node mark.
404, the first management node redirects multimedia data query request.
It should be noted that after the first management node gets short UUID and first node mark, it can be by the Intranet First virtual address of platform is redirected to the memory node of actual storage, that is to say, the first management node can be short by this UUID and first node mark return to Intranet platform, are based on short UUID by Intranet platform and first node mark is reset To, and multimedia data query request is sent to the access address of redirection.
405, Intranet platform requests the target that instruction is identified to first node based on the multimedia data query of redirection One memory node sends multimedia data query request.
406, the first memory node of target receives multimedia data query request, gets the multimedia by short UUID The physical address of data gets multi-medium data by the physical address.
Due to having been set up the mapping relations between short UUID and physical address in memory node in storing process, because This, it is available to physical address based on the mapping relations, and requested multi-medium data is got in turn.
Above-mentioned steps 404- step 406 is that Intranet storage system is stored from the target first of first node mark instruction The process that the corresponding multi-medium data of the short UUID is obtained in volume is locally stored in node.
407, multi-medium data is sent to Intranet platform by the first memory node of target.
It should be noted that process shown in above-mentioned steps 401 and step 407 is the query process of Intranet, outer net Similarly, this will not be repeated here for query process and the process.
Fig. 5 is a kind of structural schematic diagram of data storage device provided in an embodiment of the present invention.The device is applied to data In the Intranet storage system of storage system, which includes Intranet storage system, gateway and outer net storage system; Wherein, which includes management services module 501, service module 502 and FTP service module 503 is locally stored, should Operation has ftp client on gateway;
The management services module will be in multiple first memory node for receiving the resource allocation request of capture machine The first memory node of target distributes to the capture machine;
This is locally stored service module and FTP service module sends the capture machine multi-medium data and it is short it is general only One identification code UUID is stored respectively into cloud storage volume and FTP catalogue, ftp client on the gateway by FTP catalogue should Multi-medium data and the short UUID are sent to the outer net storage system.
In a kind of possible implementation, management services module is also used to the short UUID and first memory node of target First node mark be back to the capture machine, the first virtual address is sent by the inside network interface card mouth server of the capture machine, and by The Intranet bayonet server stores first virtual address to intranet data storehouse, first virtual address be based on the short UUID and First node mark generates.
In a kind of possible implementation, management services module is also used to receive the multimedia data query request of terminal, Multimedia data query request carries the first virtual address;According to first virtual address, which is asked Seek the first memory node of target for being redirected to first virtual address instruction;
This is locally stored service module and is also used to receive multimedia data query request, which is indicated Multi-medium data return to the terminal.
In a kind of possible implementation, management services module is also used to a little parse first virtual address, obtains It is identified to the short UUID and first node;Multimedia data query request is redirected to the mesh of first node mark instruction Mark the first memory node;
This is locally stored service module and is also used to receive multimedia data query request, and it is more to obtain this according to the short UUID The physical address of media data, obtains the multi-medium data from the physical address, returns to the multi-medium data to the terminal.
Fig. 6 is a kind of structural schematic diagram of data storage device provided in an embodiment of the present invention.The device is applied to data In the outer net storage system of storage system, which includes Intranet storage system, gateway and outer net storage system; Wherein, which includes management services module 601, service module 602 and FTP service module 603 is locally stored, should Operation has ftp client on gateway;
Management services module 601 is used for service module 602 being locally stored and FTP service module 603 is managed;
FTP service module 603 is used to receive by the multi-medium data and short UUID of the ftp client transmission of the gateway;With It stores in by multi-medium data and short UUID into FTP catalogue;
Service module 602 is locally stored for storing the multi-medium data and the short UUID into cloud storage volume.
In a kind of possible implementation, service module is locally stored for the short UUID to be sent to management service mould Block;
Service module 602 is locally stored to be used to be identified according to the second node of the short UUID and current second memory node, The second virtual address of the multi-medium data is generated, and second virtual address is sent to management services module 601, by managing Second virtual address is sent to outer net bayonet server by service module 601, by the outer net bayonet server by this second Virtual address is stored to outer grid database.
In a kind of possible implementation, which is also used to receive the multimedia data query of terminal Request, multimedia data query request carry the second virtual address;According to second virtual address, which is looked into Ask the second memory node that request is redirected to second virtual address instruction;
Service module is locally stored and is also used to receive multimedia data query request, by second virtual address instruction Multi-medium data returns to the terminal.
In a kind of possible implementation, which is also used to parse second virtual address, Obtain the short UUID and second node mark;Multimedia data query request is redirected to second node mark instruction Second memory node;
Service module is locally stored and is also used to receive multimedia data query request, which is obtained according to the short UUID The physical address of volume data, obtains the multi-medium data from the physical address, returns to the multi-medium data to the terminal.
About the device in above-described embodiment, wherein modules execute the concrete mode of operation in related this method Embodiment in be described in detail, no detailed explanation will be given here.
Fig. 7 is a kind of block diagram of computer equipment 700 shown according to an exemplary embodiment.For example, computer equipment 700 may be provided as a server.Referring to Fig. 7, computer equipment 700 includes processor 722, and by 732 institute of memory The memory resource of representative, can be by the instruction of the execution of processor 722, such as application program for storing.It is deposited in memory 732 The computer executable instructions that can be run on a processor are stored up.In addition, the processor executes, the computer is executable to be referred to Above-mentioned multimedia data storage method is realized when enabling.
Computer equipment 700 can also include that a power supply module 726 is configured as executing the power supply of computer equipment 700 Management, a wired or wireless network interface 750 is configured as computer equipment 700 being connected to network and an input is defeated (I/O) interface 757 out.Computer equipment 700 can be operated based on the operating system for being stored in memory 732, such as Windows ServerTM, Mac OS XTM, UnixTM,LinuxTM, FreeBSDTMOr it is similar.
The embodiment of the invention also provides a kind of computer readable storage mediums, when the instruction in the storage medium is by card When the processor of piece writing station executes, so that card writing station is able to carry out above-mentioned multimedia data storage method.
Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to of the invention its Its embodiment.This application is intended to cover any variations, uses, or adaptations of the invention, these modifications, purposes or Person's adaptive change follows general principle of the invention and including the undocumented common knowledge in the art of the disclosure Or conventional techniques.The description and examples are only to be considered as illustrative, and true scope and spirit of the invention are by following Claim is pointed out.
It should be understood that the present invention is not limited to the precise structure already described above and shown in the accompanying drawings, and And various modifications and changes may be made without departing from the scope thereof.The scope of the present invention is limited only by the attached claims.

Claims (28)

1. a kind of data-storage system, which is characterized in that including Intranet storage system, gateway and outer net storage system;Wherein, The Intranet storage system includes the first management node and multiple first memory nodes, and each first memory node includes cloud storage Volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system includes the second management node and multiple the Two memory nodes, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;It is run on the gateway There is ftp client;
First management node of the Intranet storage system is used to receive the resource allocation request of capture machine, by the multiple first The first memory node of target in memory node distributes to the capture machine;
First memory node of target is used to receive the multi-medium data and short Universally Unique Identifier that the capture machine is sent When UUID, by the multi-medium data and the short UUID store to first memory node of target cloud storage volume in and In the FTP catalogue of first memory node of target;
The gateway is described more in the FTP catalogue of first memory node of target for being read by the ftp client Media data and the short UUID, and the multi-medium data and the short UUID are sent to the mesh of the outer net storage system It marks in the FTP catalogue of the second memory node;
Second memory node of target in the FTP catalogue of second memory node of target for receiving the gateway hair When the multi-medium data and UUID that send, the multi-medium data and the short UUID are stored to the target second and stored In the cloud storage volume of node.
2. system according to claim 1, which is characterized in that first management node from the multiple first for depositing The first memory node of target is determined according to preset rules in storage node, and by the first node mark of first memory node of target Knowledge is sent to the capture machine.
3. system according to claim 1, which is characterized in that first management node be also used to the short UUID and The first node mark of first memory node of target is back to the capture machine, by the oral business of the inside network interface card of the capture machine Device sends the first virtual address, and is stored first virtual address to intranet data storehouse by the Intranet bayonet server, First virtual address is based on the short UUID and first node mark generates.
4. system according to claim 1, which is characterized in that second memory node of target is also used to according to described short The second node of the second memory node of UUID and the target identifies, and generates the second virtual address of the multi-medium data, and Second virtual address is sent to the second management node, second management node is used to send out second virtual address It send to outer net bayonet server, is stored second virtual address to outer grid database by the outer net bayonet server.
5. system according to claim 1, which is characterized in that the gateway is also used to the multi-medium data and described After short UUID is sent in the FTP catalogue of the second memory node of target of the outer net storage system, by the target first The multi-medium data and the short UUID stored in the FTP catalogue of memory node is deleted.
6. system according to claim 5, which is characterized in that the gateway is used to be periodically detected by ftp client Whether new multi-medium data and short UUID are stored in Intranet storage system in the FTP catalogue of each first memory node, when When detecting the multi-medium data and the short UUID, execute in the FTP catalogue for reading first memory node of target The multi-medium data and the short UUID and the process sent to outer net storage system.
7. a kind of multimedia data storage method, which is characterized in that the Intranet that the method is applied to data-storage system stores In system, the data-storage system includes Intranet storage system, gateway and outer net storage system;Wherein, the Intranet is deposited Storage system includes the first management node and multiple first memory nodes, and each first memory node includes cloud storage volume and supports literary The FTP catalogue of part transport protocol FTP service;The outer net storage system includes the second management node and multiple second storage sections Point, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;Operation has FTP client on the gateway End;
The described method includes:
First management node of the Intranet storage system receives the resource allocation request of capture machine, and the multiple first is stored The first memory node of target in node distributes to the capture machine;
First memory node of target receives the multi-medium data and short Universally Unique Identifier UUID that the capture machine is sent When, the multi-medium data and the short UUID are stored into the cloud storage volume of first memory node of target and described In the FTP catalogue of the first memory node of target, by the ftp client on the gateway by first memory node of target The multi-medium data and the short UUID in FTP catalogue are sent to the outer net storage system.
8. the method according to the description of claim 7 is characterized in that the target by the multiple first memory node One memory node distributes to the capture machine
First management node determines the first memory node of target according to preset rules from the multiple first memory node, And the first node of first memory node of target mark is sent to the capture machine.
9. the method according to the description of claim 7 is characterized in that the method also includes:
The first node mark of the first memory node of the short UUID and the target is back to institute by first management node Capture machine is stated, the first virtual address is sent by the inside network interface card mouth server of the capture machine, and by the Intranet bayonet server First virtual address is stored to intranet data storehouse, first virtual address is based on the short UUID and the first segment Point identification generates.
10. according to the method described in claim 9, it is characterized in that, the method also includes:
First management node receives the multimedia data query request of terminal, and the multimedia data query request carries the One virtual address;According to first virtual address, it is virtual that multimedia data query request is redirected to described first The first memory node of target of address instruction;
First memory node of target receives the multimedia data query request, by the more of first virtual address instruction Media data returns to the terminal.
11. according to the method described in claim 10, it is characterized in that,
First management node parses first virtual address, obtains the short UUID and first node mark; Multimedia data query request is redirected to the first memory node of target of the first node mark instruction;
First memory node of target receives the multimedia data query request, obtains more matchmakers according to the short UUID The physical address of volume data obtains the multi-medium data from the physical address, and Xiang Suoshu terminal returns to the multimedia number According to.
12. a kind of date storage method, which is characterized in that the method is applied to the outer net storage system of data-storage system In, the data-storage system includes Intranet storage system, gateway and outer net storage system;Wherein, Intranet storage system System includes the first management node and multiple first memory nodes, and each first memory node includes cloud storage volume and file is supported to pass The FTP catalogue of defeated agreement FTP service;The outer net storage system includes the second management node and multiple second memory nodes, often A second memory node includes cloud storage volume and the FTP catalogue for supporting FTP service;Operation has ftp client on the gateway;
Any one second memory node receives the multi-medium data and short UUID sent by the ftp client of the gateway;
Second memory node stores multi-medium data and short UUID into the FTP catalogue of second memory node;
The multi-medium data and the short UUID are stored to the cloud of second memory node and are deposited by second memory node In storage volume.
13. according to the method for claim 12, which is characterized in that the method also includes:
Second memory node is identified according to the second node of the short UUID and second memory node, is generated described more Second virtual address of media data, and second virtual address is sent to the second management node, the second management section Second virtual address is sent to outer net bayonet server by point, by the outer net bayonet server by described second virtually Location is stored to outer grid database.
14. according to the method for claim 13, which is characterized in that second management node receives the multimedia number of terminal According to inquiry request, the multimedia data query request carries the second virtual address;It, will be described according to second virtual address Multimedia data query request is redirected to the second memory node of the second virtual address instruction;
Second memory node receives the multimedia data query request, the multimedia that second virtual address is indicated Data return to the terminal.
15. according to the method for claim 14, which is characterized in that
Second management node parses second virtual address, obtains the short UUID and second node mark; Multimedia data query request is redirected to the second memory node of the second node mark instruction;
Second memory node receives the multimedia data query request, obtains the multimedia number according to the short UUID According to physical address, obtain the multi-medium data from the physical address, Xiang Suoshu terminal returns to the multi-medium data.
16. a kind of date storage method, which is characterized in that be applied to data-storage system, the data-storage system includes interior Net storage system, gateway and outer net storage system;Wherein, the Intranet storage system includes the first management node and multiple the One memory node, each first memory node include cloud storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;Institute Stating outer net storage system includes the second management node and multiple second memory nodes, and each second memory node includes cloud storage volume With the FTP catalogue for supporting FTP service;Operation has ftp client on the gateway;
First management node of the Intranet storage system receives the resource allocation request of capture machine, and the multiple first is stored The first memory node of target in node distributes to the capture machine;
When first memory node of target receives the capture machine transmission multi-medium data and short Universally Unique Identifier UUID, By the multi-medium data and the short UUID store to first memory node of target cloud storage volume in and the mesh It marks in the FTP catalogue of the first memory node;
The gateway reads the multimedia in the FTP catalogue of first memory node of target by the ftp client Data and the short UUID, and the multi-medium data and the short UUID are sent to the target of the outer net storage system In the FTP catalogue of two memory nodes;
Second memory node of target receives what the gateway was sent in the FTP catalogue of second memory node of target The multi-medium data and when the short UUID, the multi-medium data and the short UUID are stored to the target second and deposited It stores up in the cloud storage volume of node.
17. according to the method for claim 16, which is characterized in that first management node is stored from the multiple first The first memory node of target is determined according to preset rules in node, and the first node of first memory node of target is identified It is sent to the capture machine.
18. according to the method for claim 16, which is characterized in that first management node is by the short UUID and described The first node mark of the first memory node of target is back to the capture machine;
The inside network interface card mouth server of capture machine sends the first virtual address,
The Intranet bayonet server stores first virtual address to intranet data storehouse, and first virtual address is based on The short UUID and first node mark generate.
19. according to the method for claim 16, which is characterized in that the gateway is by the multi-medium data and described short After UUID is sent in the FTP catalogue of the second memory node of target of the outer net storage system, the target first is deposited It stores up the multi-medium data stored in the FTP catalogue of node and the short UUID is deleted.
20. according to the method for claim 16, which is characterized in that second memory node of target is according to the short UUID It is identified with the second node of second memory node of target, generates the second virtual address of the multi-medium data, and by institute It states the second virtual address and is sent to the second management node, second virtual address is sent to outer net by second management node Bayonet server;
The outer net bayonet server stores second virtual address to outer grid database.
21. a kind of data-storage system, which is characterized in that including Intranet storage system, gateway and outer net storage system;Its In, the Intranet storage system includes the first management node and multiple first memory nodes, and each first memory node includes cloud Storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system includes the second management node and more A second memory node, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;On the gateway Operation has ftp client;
First management node of the Intranet storage system is used to manage the storage resource of the multiple first memory node, each First memory node is used for the short UUID of storing data and the data in the cloud storage volume of first memory node;Or,
Second management node of the outer net storage system is used to manage the storage resource of the multiple second memory node, each Second memory node is used for storing data and the data in the cloud storage volume and FTP catalogue of second memory node Short UUID.
22. system according to claim 21, which is characterized in that first management node is used to receive more matchmakers of terminal Volume data inquiry request, the multimedia data query request carry the first virtual address;It, will according to first virtual address The multimedia data query request is redirected to the first memory node of target of the first virtual address instruction;
First memory node of target indicates first virtual address for receiving the multimedia data query request Multi-medium data return to the terminal.
23. system according to claim 22, which is characterized in that first management node is used for virtual to described first Address is parsed, and the short UUID and first node mark are obtained;Multimedia data query request is redirected to institute State the first memory node of target of first node mark instruction;
First memory node of target is for receiving the multimedia data query request, according to the short UUID acquisition The physical address of multi-medium data obtains the multi-medium data from the physical address, and Xiang Suoshu terminal returns to more matchmakers Volume data.
24. system according to claim 21, which is characterized in that second management node is used to receive more matchmakers of terminal Volume data inquiry request, the multimedia data query request carry the second virtual address;It, will according to second virtual address The multimedia data query request is redirected to the second memory node of target of the second virtual address instruction;
Second memory node of target indicates second virtual address for receiving the multimedia data query request Multi-medium data return to the terminal.
25. system according to claim 24, which is characterized in that second management node is used for virtual to described second Address is parsed, and the short UUID and second node mark are obtained;Multimedia data query request is redirected to institute State the second memory node of target of second node mark instruction;
Second memory node of target is for receiving the multimedia data query request, according to the short UUID acquisition The physical address of multi-medium data obtains the multi-medium data from the physical address, and Xiang Suoshu terminal returns to more matchmakers Volume data.
26. a kind of data query method, which is characterized in that including Intranet storage system, gateway and outer net storage system;Its In, the Intranet storage system includes the first management node and multiple first memory nodes, and each first memory node includes cloud Storage volume and the FTP catalogue for supporting File Transfer Protocol FTP service;The outer net storage system includes the second management node and more A second memory node, each second memory node include cloud storage volume and the FTP catalogue for supporting FTP service;On the gateway Operation has ftp client;
The short UUID of storing multimedia data and the multi-medium data in the cloud storage volume of the first memory node of target;Described One management node receives the multimedia data query request of terminal, and the multimedia data query request carries first virtually Location;According to first virtual address, multimedia data query request is redirected to first virtual address and is indicated The first memory node of target;First memory node of target receives the multimedia data query request, by described first The multi-medium data of virtual address instruction returns to the terminal;Or,
Storing multimedia data and the multi-medium data is short in the cloud storage volume and FTP catalogue of the second memory node of target UUID;Second management node receives the multimedia data query request of terminal, and the multimedia data query request carries Second virtual address;According to second virtual address, it is empty that multimedia data query request is redirected to described second The second memory node of target of quasi- address instruction;Second memory node of target receives the multimedia data query request, The multi-medium data that second virtual address indicates is returned into the terminal.
27. according to the method for claim 26, which is characterized in that first management node is to first virtual address It is parsed, obtains the short UUID and first node mark;Multimedia data query request is redirected to described the The first memory node of target of one node identification instruction;
First memory node of target receives the multimedia data query request, obtains more matchmakers according to the short UUID The physical address of volume data obtains the multi-medium data from the physical address, and Xiang Suoshu terminal returns to the multimedia number According to.
28. according to the method for claim 26, which is characterized in that second management node is to second virtual address It is parsed, obtains the short UUID and second node mark;Multimedia data query request is redirected to described the The second memory node of target of two node identifications instruction;
Second memory node of target receives the multimedia data query request, obtains more matchmakers according to the short UUID The physical address of volume data obtains the multi-medium data from the physical address, and Xiang Suoshu terminal returns to the multimedia number According to.
CN201710944091.8A 2017-09-30 2017-09-30 Data storage system and method Active CN109600410B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710944091.8A CN109600410B (en) 2017-09-30 2017-09-30 Data storage system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710944091.8A CN109600410B (en) 2017-09-30 2017-09-30 Data storage system and method

Publications (2)

Publication Number Publication Date
CN109600410A true CN109600410A (en) 2019-04-09
CN109600410B CN109600410B (en) 2021-11-09

Family

ID=65956231

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710944091.8A Active CN109600410B (en) 2017-09-30 2017-09-30 Data storage system and method

Country Status (1)

Country Link
CN (1) CN109600410B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110381093A (en) * 2019-09-03 2019-10-25 北京旷视科技有限公司 Method, apparatus, the system and electronic equipment of data transmission of data protocol conversion
CN111343263A (en) * 2020-02-21 2020-06-26 北京京东尚科信息技术有限公司 Operation and maintenance system and operation and maintenance method for batch private cloud
CN111447256A (en) * 2020-03-05 2020-07-24 中国司法大数据研究院有限公司 Cross-domain micro-service registration and release method and system based on file exchange
CN111967054A (en) * 2020-06-30 2020-11-20 国网浙江省电力有限公司培训中心 Block chain-based anti-electricity-stealing evidence-obtaining image data storage method and system
CN113271301A (en) * 2021-05-12 2021-08-17 大连交通大学 Network gate system communication method based on embedded multi-core processing mode
CN113315846A (en) * 2021-07-29 2021-08-27 武汉中科通达高新技术股份有限公司 Data transmission method and device
CN115296940A (en) * 2022-10-09 2022-11-04 网御安全技术(深圳)有限公司 Secure remote data interaction method for isolated network and related equipment

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001033801A2 (en) * 1999-10-30 2001-05-10 Ibrixx Ag Method and transaction interface for secure data exchange between distinguishable networks
CN101083607A (en) * 2006-05-30 2007-12-05 倪海生 Internet accessing server for inside and outside network isolation and its processing method
CN102307221A (en) * 2011-03-25 2012-01-04 国云科技股份有限公司 Cloud storage system and implementation method thereof
CN106230870A (en) * 2016-10-13 2016-12-14 成都东方盛行电子有限责任公司 Proprietary protocol document transmission system and method
CN106790521A (en) * 2016-12-20 2017-05-31 创新科存储技术(深圳)有限公司 The system and method for distributed networking is carried out using the node device based on FTP
CN106850710A (en) * 2015-12-03 2017-06-13 杭州海康威视数字技术股份有限公司 A kind of safe data cloud storage system, client terminal, storage server and application process
CN106960037A (en) * 2017-03-22 2017-07-18 河海大学 A kind of distributed index the resources integration and share method across intranet and extranet

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001033801A2 (en) * 1999-10-30 2001-05-10 Ibrixx Ag Method and transaction interface for secure data exchange between distinguishable networks
CN101083607A (en) * 2006-05-30 2007-12-05 倪海生 Internet accessing server for inside and outside network isolation and its processing method
CN102307221A (en) * 2011-03-25 2012-01-04 国云科技股份有限公司 Cloud storage system and implementation method thereof
CN106850710A (en) * 2015-12-03 2017-06-13 杭州海康威视数字技术股份有限公司 A kind of safe data cloud storage system, client terminal, storage server and application process
CN106230870A (en) * 2016-10-13 2016-12-14 成都东方盛行电子有限责任公司 Proprietary protocol document transmission system and method
CN106790521A (en) * 2016-12-20 2017-05-31 创新科存储技术(深圳)有限公司 The system and method for distributed networking is carried out using the node device based on FTP
CN106960037A (en) * 2017-03-22 2017-07-18 河海大学 A kind of distributed index the resources integration and share method across intranet and extranet

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110381093A (en) * 2019-09-03 2019-10-25 北京旷视科技有限公司 Method, apparatus, the system and electronic equipment of data transmission of data protocol conversion
CN110381093B (en) * 2019-09-03 2022-07-19 北京旷视科技有限公司 Method and device for converting data protocol, system for transmitting data and electronic equipment
CN111343263A (en) * 2020-02-21 2020-06-26 北京京东尚科信息技术有限公司 Operation and maintenance system and operation and maintenance method for batch private cloud
CN111447256A (en) * 2020-03-05 2020-07-24 中国司法大数据研究院有限公司 Cross-domain micro-service registration and release method and system based on file exchange
CN111447256B (en) * 2020-03-05 2022-07-01 中国司法大数据研究院有限公司 Cross-domain micro-service registration and release method and system based on file exchange
CN111967054A (en) * 2020-06-30 2020-11-20 国网浙江省电力有限公司培训中心 Block chain-based anti-electricity-stealing evidence-obtaining image data storage method and system
CN113271301A (en) * 2021-05-12 2021-08-17 大连交通大学 Network gate system communication method based on embedded multi-core processing mode
CN113271301B (en) * 2021-05-12 2023-04-25 大连交通大学 Communication method of network gate system based on embedded multi-core processing mode
CN113315846A (en) * 2021-07-29 2021-08-27 武汉中科通达高新技术股份有限公司 Data transmission method and device
CN115296940A (en) * 2022-10-09 2022-11-04 网御安全技术(深圳)有限公司 Secure remote data interaction method for isolated network and related equipment
CN115296940B (en) * 2022-10-09 2023-01-17 网御安全技术(深圳)有限公司 Secure remote data interaction method for isolated network and related equipment

Also Published As

Publication number Publication date
CN109600410B (en) 2021-11-09

Similar Documents

Publication Publication Date Title
CN109600410A (en) Data-storage system and method
US8069224B2 (en) Method, equipment and system for resource acquisition
US9445162B2 (en) Interactive personal/internet protocol television reservation system, reservation plan management method and device
CN109391664A (en) System and method for the deployment of more cluster containers
JP2008533816A5 (en)
CN105141672B (en) A kind of date storage method, apparatus and system
CN106933550B (en) Global information obtaining, processing and updating method, device and system
CN103761256B (en) Maintenance system and method of branch points of remote directories
US11044343B2 (en) Method and apparatus for serving and managing storage of data streams in a surveillance and/or monitoring system
CN107851122A (en) The data of Mass storage and retrieval with good bounded life
CN108933798A (en) Date storage method, storage server and system
CN105512279A (en) Metadata access method, related equipment and system
KR100977159B1 (en) Method and system for managing file metadata transparent to data server address change and disk movement
CN105450964B (en) Method, system and management node for cloud storage of video data
CN110457307B (en) Metadata management system, user cluster creation method, device, equipment and medium
US20160308871A1 (en) Network element data access method and apparatus, and network management system
CN108205468A (en) A kind of distributed system and implementation method towards massive video image
KR100754227B1 (en) Method and apparatus for preventing duplicate storage of resources among GPNP devices providing content directory services in content synchronization
WO2007011164A1 (en) Virtual storage system and method for managementing virtual storage based on ad-hoc network
CN109996031B (en) Monitoring system and monitoring method
US9348847B2 (en) Data access control apparatus and data access control method
CN106649528A (en) Picture writing and reading methods and devices
US9286305B2 (en) Virtual storage gate system
KR20070012210A (en) How to manage virtual storage systems and virtual storage based on ad hoc networks
KR101592860B1 (en) Distributed storage system using Internet of Things Device and operating method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant