[go: up one dir, main page]

CN105260402A - Data management method and apparatus - Google Patents

Data management method and apparatus Download PDF

Info

Publication number
CN105260402A
CN105260402A CN201510599578.8A CN201510599578A CN105260402A CN 105260402 A CN105260402 A CN 105260402A CN 201510599578 A CN201510599578 A CN 201510599578A CN 105260402 A CN105260402 A CN 105260402A
Authority
CN
China
Prior art keywords
data
data message
message
access equipment
source
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510599578.8A
Other languages
Chinese (zh)
Inventor
李玉亮
盛杰
任养超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Long Ying Century (beijing) Technology Co Ltd
Original Assignee
Long Ying Century (beijing) Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Long Ying Century (beijing) Technology Co Ltd filed Critical Long Ying Century (beijing) Technology Co Ltd
Priority to CN201510599578.8A priority Critical patent/CN105260402A/en
Publication of CN105260402A publication Critical patent/CN105260402A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/248Presentation of query results

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The application aims to provide a data management method and apparatus. Compared with the prior art, the method comprises: scanning a data source in a data providing device through a data management device, and initializing data acquisition configurations according to parameter information of the data source; further, obtaining data information of the data source from the data providing device according to the data acquisition configurations; the data management device receiving a request of presenting the data information, sent by a data access device, and according to the request, providing the data information corresponding to the request to the data access device; and the data access device receiving the data information corresponding to the request and presenting the data information to a user. According to the method, the data information of the data source of the data providing device is subjected to centralized management, so that the management cost is reduced; and when the user needs to use data, the data management device provides the corresponding data to the data access device for the user to operate, query and the like, so that the user experience is improved.

Description

For the method and apparatus of data management
Technical field
The present invention relates to computer realm, particularly relate to a kind of technology for data management.
Background technology
Along with the innovation of IT technology, and cloud computing, large data, the develop rapidly in social activity and mobile platform field, current enterprise needs the data of management to present volatile rising tendency.Day by day perfect along with data analysis and digging technology, enterprise also comes to realise the immense value contained in data.So the decision-making of current enterprise and strategy all or have turned to the pattern with data-driven, and data also more and more become the assets of the important of enterprise and core.
But, current Db Management Model cannot adapt to the requirement that enterprise uses for data, thus result in the appearance of following problem: the increase of data space, the increase of data copy quantity, data acquisition and the problem such as the increase of complicacy of transmission flow and the increase of the complexity of data safety management.
At present, along with the innovation of IT technology, and cloud computing, large data, the develop rapidly in social activity and mobile platform field, the problems referred to above can be more and more outstanding.
Summary of the invention
The object of the application is to provide a kind of method and apparatus for data management.
According to an aspect of the application, provide a kind of in the method for data management apparatus end for data management, wherein, the method comprises:
A scan-data provides the data source in equipment, and obtains configuration according to the parameter information initialization data of described data source;
B obtains the data message of described data source from described data providing device according to described data acquisition configuration;
The request presenting data message that c sends according to data access equipment, is provided to described data access equipment by data message corresponding for described request.
According to the another aspect of the application, additionally provide a kind of in the method for data providing device end for data management, wherein, the method comprises:
A provides the data message of described data source to described data management apparatus.
According to the another aspect of the application, additionally provide a kind of in the method for data access equipment end for data management, wherein, the method comprises:
α sends the request presenting the data message of data source to data management apparatus;
β receives data message corresponding to described request that described data management apparatus provides;
The described data message received is presented to user by γ.
According to the another aspect of the application, additionally provide a kind of data management apparatus for data management, wherein, this equipment comprises:
First device, provides the data source in equipment for scan-data, and obtains configuration according to the parameter information initialization data of described data source;
3rd device, for obtaining the data message of described data source from described data providing device according to described data acquisition configuration;
5th device, for the request presenting data message sent according to data access equipment, is provided to described data access equipment by data message corresponding for described request.
According to the another aspect of the application, additionally provide a kind of data providing device for data management, wherein, this equipment comprises:
Data supplying device, for providing the data message of described data source to described data management apparatus.
According to the another aspect of the application, additionally provide a kind of data access equipment for data management, wherein, this equipment comprises:
Second device, for sending the request presenting the data message of data source to data management apparatus;
4th device, for receiving data message corresponding to described request that described data management apparatus provides;
6th device, for presenting to user by the described data message received.
According to the one side again of the application, additionally provide a kind of system for data management, wherein, this system comprises:
Foregoing data management apparatus and foregoing data providing device and foregoing data access equipment.
Compared with prior art, the application provides the data source in equipment by data management apparatus scan-data, and obtain configuration according to the parameter information initialization data of described data source, such as, the parameter information of described data source generally can comprise: the account number cipher of data source, the deployment types of data source, path etc. deposited by the data acquisition script of data source, obtain the data message of described data source from described data providing device according to described data acquisition configuration, data management apparatus receives the request presenting data message that data access equipment sends, and according to described request, data message corresponding for described request is provided to described data access equipment, data access equipment receives data message corresponding to described request, and present to user, thus, the data message of the data source of data providing device is managed concentratedly, reduce handling cost, when user needs usage data, corresponding data are provided to data access equipment by data management apparatus, data access equipment presents to user automatically, consults for user operation, improves the experience of user.
And the application can also process the data message of described data source on data management apparatus, such as, blocking stores, data deduplication, snapshot, virtual map etc.; Wherein the blocking of the data message of data source stores, duplicate removal, snapshot etc. for data message provide basis and prerequisite, and can according to the situation of change of the data message of data source in data providing device, upgrade the data message of corresponding stored unit, thus keep the data message real-time consistency of the data source of data management apparatus and data providing device; Wherein snapshot and virtual map are carried out to data, multiple data access equipment can be met ask to present the situations such as identical data message simultaneously, and, by the process of data message virtual map to be presented, do not take unnecessary amount of physical memory, thus reduce taking of storage space.
In addition, when user consults the data message of the data source that data access equipment presents, can modify to it, the amendment information of user is sent to data management apparatus by data access equipment, data management apparatus is according to this amendment information, the described data message that presents is modified, and amended data message is stored again, when presenting data message described in this data access equipment asks to consult again, the described up-to-date storage information presenting data message is provided to corresponding data access equipment by data management apparatus, and by this data access equipment, described up-to-date storage information is presented to user, thus the data change information of each user in data access equipment end can be recorded respectively, and user is when next time, request presented corresponding data message, the up-to-date storage information that this can be presented data message corresponding to request presents to user, improve the experience of user, the flow process that reduced data obtains and sends.
Accompanying drawing explanation
By reading the detailed description done non-limiting example done with reference to the following drawings, other features, objects and advantages of the present invention will become more obvious:
Fig. 1 illustrates a kind of system schematic for data management according to the application aspect;
Fig. 2 illustrates a kind of data providing device for data management, data management apparatus and data access equipment schematic diagram according to another aspect of the application;
Fig. 3 illustrates a kind of data management apparatus schematic diagram for data management according to the application's preferred embodiment;
Fig. 4 illustrates a kind of data providing device for data management, data management apparatus and data access equipment schematic diagram according to the application's preferred embodiment;
Fig. 5 illustrates a kind of method flow diagram for data management according to another aspect of the application;
It is a kind of at the method flow diagram of data management apparatus end for data management that Fig. 6 illustrates according to the application's preferred embodiment;
Fig. 7 illustrates a kind of method flow diagram for data management according to the application's preferred embodiment.
In accompanying drawing, same or analogous Reference numeral represents same or analogous parts.
Embodiment
Below in conjunction with accompanying drawing, the present invention is described in further detail.
In the application one typically configuration, the equipment of terminal, service network and trusted party include one or more processor (CPU), input/output interface, network interface and internal memory.
Internal memory may comprise the volatile memory in computer-readable medium, and the forms such as random access memory (RAM) and/or Nonvolatile memory, as ROM (read-only memory) (ROM) or flash memory (flashRAM).Internal memory is the example of computer-readable medium.
Computer-readable medium comprises permanent and impermanency, removable and non-removable media can be stored to realize information by any method or technology.Information can be computer-readable instruction, data structure, the module of program or other data.The example of the storage medium of computing machine comprises, but be not limited to phase transition internal memory (PRAM), static RAM (SRAM), dynamic RAM (DRAM), the random access memory (RAM) of other types, ROM (read-only memory) (ROM), Electrically Erasable Read Only Memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc ROM (read-only memory) (CD-ROM), digital versatile disc (DVD) or other optical memory, magnetic magnetic tape cassette, magnetic disk stores or other magnetic storage apparatus or any other non-transmitting medium, can be used for storing the information can accessed by computing equipment.According to defining herein, computer-readable medium does not comprise non-temporary computer readable media (transitorymedia), as data-signal and the carrier wave of modulation.
For further setting forth the technological means that the application takes and the effect obtained, below in conjunction with accompanying drawing and preferred embodiment, to the technical scheme of the application, carry out clear and complete description.
Shown in ginseng Fig. 1, a kind of system schematic for data management provided according to an aspect of the application is provided, wherein, this system comprises the data providing device 1 for data management, the data management apparatus 2 for data management and the data access equipment 3 for data management.
Particularly, data providing device wherein can comprise the server storing data, and such as, enterprise stores the server of production data, and the particular type of this server does not limit, and has the computing machine storing data function; Data management apparatus wherein can comprise the computer equipment that can carry out data management, and management data provides the data on equipment, and when user is by data access device request access data information, provides corresponding data message to data access equipment; Data access equipment wherein can comprise user side to carry out operating the computing machine used, the data message that data management apparatus provides presents to user on data access equipment, thus reduce the complexity of data acquisition and distribution, and in the process of distribution, relevant treatment can be carried out to data, such as, data desensitizations etc., thus the security improving data management, also improve the experience of user simultaneously.
In addition, data management apparatus also can according to the change of the data message of data source on data providing device, upgrades the data message of data source, thus the high consistency of data on the data achieved on described data management apparatus and described data providing device; When multiple user asks identical data message by data access equipment simultaneously, by the mode of data snapshot and virtual map, meet multiple data access equipment to ask to present the situations such as identical data message simultaneously, by the process of data message virtual map to be presented, do not take unnecessary amount of physical memory, thus reduce taking of storage space; When user modifies to the data message presented, the data message of amendment is stored again, when this user asks to present corresponding data message next time, just the data message of up-to-date for this user storage is presented to this user, thus, improve the experience of user, the flow process that reduced data obtains and sends.
Shown in ginseng Fig. 2, the schematic diagram of a kind of data providing device for data management, data management apparatus and the data access equipment provided according to another aspect of the application is provided, wherein, described data providing device 1 comprises data supplying device 11, described data management apparatus 2 comprises first device, the 3rd device, the 5th device, and described DAA 3 comprises the second device, the 4th device and the 6th device.Described data providing device and data management apparatus and data access equipment cooperatively interact, to realize the management of the data message of the data source in data providing device.
Particularly, first device 12 scan-data of described data management apparatus provides the data source in equipment, and obtains configuration according to the parameter information initialization data of described data source; 3rd device 13 of described data management apparatus obtains the data message of described data source from described data providing device according to described data acquisition configuration; Correspondingly, the data supplying device 11 of described data providing device provides the data message of described data source to described data management apparatus; Second device 14 of described data access equipment sends the request presenting the data message of data source to data management apparatus; Correspondingly, the request presenting data message that the 5th device 15 of described data management apparatus sends according to data access equipment, is provided to described data access equipment by data message corresponding for described request; Correspondingly, the 4th device 16 of described data access equipment receives data message corresponding to described request that described data management apparatus provides; The described data message received is presented to user by the 6th device 17 of described data access equipment.
Constant work between above-mentioned each device, at this, those skilled in the art are to be understood that " continuing " refers to above-mentioned each device respectively in real time, or according to setting or the mode of operation requirement of in real time adjustment, carry out the acquisition of data source data information, data present request sends, data present information provides, data present information presents.
Shown in ginseng Fig. 2, first device 12 scan-data of described data management apparatus provides the data source in equipment, and obtains configuration according to the parameter information initialization data of described data source.
Particularly, first device 12 scan-data of data management apparatus provides the mode of the data source in equipment, by the wireless or wired connection that the two is set up, first device 12 based on this connection directly/automatically on data providing device, find the information search relevant to gather data source; Further, the information such as user name and password of the data providing device that the first device 12 of data management apparatus can provide according to user, through data providing device port numbers and IP address registration on the data providing device of correspondence, then corresponding scan script is performed according to the soft and hardware type characteristic of data providing device, to obtain the data source information on described data providing device, further, data source information wherein generally comprises the information such as data source types, data source version and the list of data source account.
Continue in this embodiment, the first device 12 of data management apparatus obtains configuration according to the parameter information initialization data of described data source, wherein, the parameter information of data source generally can comprise account and the encrypted message of this data source, routing information etc. deposited by deployment types information and data acquisition script, particularly, first device 12 obtains the process of configuration according to the parameter information initialization data of described data source, the data message being the data source in data management apparatus acquisition data providing device is ready, its detailed process can comprise the propelling movement of (1) data acquisition script, need the script used and instrument use standard agreement and port transmission on the data providing device at data source place by obtaining data, and be stored under user configured data acquisition script deposits path, (2) acquisition of data source environmental parameter, the account corresponding according to user configured data source and password obtain the environmental parameter of data source, as log file size and quantity etc., (3) parameter initialization of data acquisition service and startup, the data source environmental parameter according to getting carries out initialization to the acquisition of data, thus starts data acquisition on the basis that data management apparatus and data providing device connect.
At this, those skilled in the art should understand, first device 12 scan-data of data management apparatus provides the concrete mode of the data source in equipment and obtains according to the parameter information initialization data of described data source the concrete mode configured and is only citing, the scan-data of other data management apparatus that are existing or that may occur from now on provides the concrete mode of the data source in equipment and obtains the concrete mode of configuration as being applicable to the application according to the parameter information initialization data of described data source, also should be included in the application's protection domain, and be contained in this at this with way of reference.
Shown in ginseng Fig. 2, the 3rd device of described data management apparatus 2 obtains the data message of described data source from described data providing device according to described data acquisition configuration.
In this embodiment, 3rd device 13 obtains the data message of data source from data providing device according to described data acquisition configuration, particularly, 3rd device 13 needs the connection of setting up based on data management apparatus and data providing device, and the data acquisition configuration after data management apparatus initialization, from data providing device, obtain the data message of data source.Further, when data management apparatus obtains the data message of the data source of data providing device first, need the data acquisition carrying out full dose, all get in data management apparatus by the data message existed in current data source; After primary full dose data acquisition, later data acquisition all adopts the mode of increment to carry out.The part that the acquisition of described incremental data changes mainly for the data message of data source in data providing device, obtain, further, the data message of data source can be carried out block storage, adopt block tracking technique to determine the data block changed, then the data of its correspondence are sent in data management apparatus and preserve.
Correspondingly, the data supplying device 11 of described data providing device provides the data message of described data source to described data management apparatus.
In this embodiment, the data supplying device 11 of data providing device provides the data message of described data source to described data management apparatus, particularly, data providing device is connected based on the wire/wireless of data management apparatus, the data message of data source is wherein provided to data management apparatus, to realize the management of the data message of data source on data providing device.
Shown in ginseng Fig. 2, the second device 14 of described data access equipment sends the request presenting the data message of data source to data management apparatus 2.
In this embodiment, second device 14 of data access equipment sends the request presenting the data message of data source to data management apparatus 2, particularly, when user needs the data message consulted in data source, need to send corresponding request by data access equipment 3 to data management apparatus, this request comprises the contents such as the equipment (that is, present the data access equipment of described data message) that data message in the data source that user wishes to present and data message present, wherein, second device 14 of data access equipment sends the mode presenting the request of the data message of data source to data management apparatus 2, by with being wired or wirelessly connected or based on data sharing mode in described connection of setting up between data management apparatus, carry out according to each self-corresponding communication protocol, wherein, described radio connection includes but not limited to TCP/IP, near-field communication (NFC), bluetooth (Bluetooth), short message, infrared data transmission (IrDA), ZigBee, ultra-wideband (UltraWideBand), WiMedia, GPS, DECT, wireless 1394 and other private radio systems etc., wherein, describedly include but not limited to NFS (network file system(NFS): NetworkFileSystem) and iSCSI (InternetSmallComputerSystemInterface) etc. based on data sharing mode that is wireless or wired connection mode, such as, user to be sent to data management apparatus by the WEB interface of data access equipment or client end interface described in present the request of data message.
Correspondingly, the request presenting data message that the 5th device 15 of described data management apparatus sends according to data access equipment, is provided to described data access equipment by data message corresponding for described request.
In this embodiment, the request presenting data message that the 5th device 15 of described data management apparatus sends according to data access equipment, determines the data message that described request is corresponding, data message corresponding for described request is provided to described data access equipment.
Particularly, 5th device 15 of data management apparatus receives the mode presenting the request of data message of the second device 14 transmission of data access equipment, by with being wired or wirelessly connected of setting up between data access equipment, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of other parts in this embodiment, do not repeat them here.Wherein, determine the data message that described request is corresponding, particularly, when request presents the request of the data message of described correspondence only from the data access equipment of one of them user, so the described data message of correspondence is provided to corresponding data access equipment by the 5th device 15 of data management apparatus, correspondingly, the described data message of correspondence is provided to the mode of corresponding data access equipment by the 5th device 15, by with being wired or wirelessly connected of setting up between data access equipment, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of other parts in this embodiment, do not repeat them here.
Continue in this embodiment, the request presenting the data message of described correspondence when request is from multiple data access equipment corresponding to wherein multiple user, now the 5th device 15 of data management apparatus needs described data message to be carried out virtual map to corresponding multiple data access equipment, virtual map wherein does not need to take unnecessary storage space, meets the data access equipment of multiple user in correspondence to the access of identical data information simultaneously.
Continue in this embodiment, after user modifies to the data message be presented on the data access equipment of its correspondence, when again presenting the request of described data message by the transmission of data access equipment, the data message that now described request is corresponding, just for this user is to the up-to-date amended information of the data message be presented on the data access equipment of its correspondence, thus meet the independent operation of user to corresponding data information, independently present, improve the experience of user.
At this; those skilled in the art should understand; the request presenting data message that 5th device 15 sends according to data access equipment; determine that the concrete mode of the data message that described request is corresponding is only citing; other requests presenting data message sent according to data access equipment that are existing or that may occur from now on; determine that the mode of the data message that described request is corresponding is as being applicable to the application; also should be included in the application's protection domain, and be contained in this at this with way of reference.
Correspondingly, the 4th device 16 of described data access equipment receives data message corresponding to described request that described data management apparatus provides.
Particularly, 4th device 16 of described data access equipment receives the mode of data message corresponding to described request that described data management apparatus provides, by with being wired or wirelessly connected of setting up between data management apparatus, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of other parts in this embodiment, do not repeat them here.
Shown in ginseng Fig. 2, the described data message received is presented to user by the 6th device 17 of described data access equipment.
Particularly, 6th device 17 of described data access equipment receives the mode of described data message, by with being wired or wirelessly connected of setting up between data management apparatus, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of other parts in this embodiment, do not repeat them here.Further, described data message can be presented to user according to predetermined form by data access equipment, and such as, according to the typesetting form preset, font type, size, color, file type etc. present.
At this; those skilled in the art should understand; the concrete mode that the described data message received presents to user is only citing by the 6th device 17 of data access equipment; other existing or may occur from now on the described data message received is presented to the mode of user as being applicable to the application; also should be included in the application's protection domain, and be contained in this at this with way of reference.
Shown in ginseng Fig. 3, wherein in a preferred embodiment, described data management apparatus 2 also comprises:
7th device 18, processes the data message of described data source;
Wherein, the 5th device 15 of described data management apparatus:
According to the request presenting data message that data access equipment sends, the data message of the data source after described process is provided to described data access equipment.
In this embodiment, the data message of the 7th device 18 to described data source processes, and particularly, can comprise the storage data message of the data source obtained from described data providing device being carried out to certain way, and such as, blocking stores; Also can comprise and carry out duplicate removal to stored data message, to reduce storage space, concrete duplicate removal mode does not limit; Also can comprise and snapshot is carried out to stored data message, record the data information content of certain time point, as backup, so that the data of subsequent user to this time point are checked; Can also comprise and virtual map is carried out to data message, data message is shared, by identical data message virtual map to different data access equipment, to realize multiple user data message that share and access is identical simultaneously; Can also comprise data message is encrypted, desensitization etc., to guarantee that data message is provided to the security in data access device procedures; Can also comprise and store user on the data access equipment of its correspondence to described amendment information presenting data message etc.
At this; those skilled in the art should understand; the concrete mode that the data message of 7th device 18 to described data source processes is only citing; other existing or modes processed the data message of described data source that may occur from now on are as being applicable to the application; also should be included in the application's protection domain, and be contained in this at this with way of reference.
Continue in this embodiment, the request presenting data message that 5th device 15 sends according to data access equipment, the data message of the data source after described process is provided to described data access equipment, particularly, the concrete request situation presenting data message that data management apparatus sends according to data access equipment, such as, whether be that the data access equipment that multiple user is corresponding simultaneously asks identical data message simultaneously, or whether the user sending described request once modified to the data message of this request correspondence, or whether the data message of this request correspondence is the information etc. in restricted area, and after carrying out corresponding processing data information by the 7th device, by the 5th device wherein, the data message of the data source after described process is provided to described data access equipment, wherein, described data message is provided to the mode of described data access equipment, by with being wired or wirelessly connected of setting up between data access equipment, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description in above-described embodiment, do not repeat them here.
Preferably, the 7th device 18 of described data management apparatus comprises:
The July 1st, unit (not shown), carried out blocking storage to the data message of described data source.
Particularly, the July 1st, unit carried out blocking storage to the data message of described data source, and wherein, blocking is stored as and the storage space of data message is divided into several storage space unit, and the storage size of each unit can be equal, also can not wait; The distribution of unitary space can be carried out according to certain Distribution dynamics, also the distribution of unitary space can be carried out at random, such as, the unit of the spatial division that data can be stored to be several storage spaces be 64kb, the unit etc. of the spatial division that also data can be stored to be several storage spaces be 64kb to 256kb; Then by the data information memory of data source in unit storage space, just realize storing the blocking of the data message of data source; After blocking storage is carried out to the data message of data source, for other relevant treatment realizing data message provides the foundation and prerequisite, such as, duplicate removal, snapshot, virtual map etc. that data information unitsization stores the data message on basis is based upon.
More preferably, the 7th device 18 of described data management apparatus also comprises following at least any one:
Seven or two unit (not shown), carries out duplicate removal to the data message of the described data source that described blocking stores;
Seven or three unit (not shown), carries out snapshot to the data message of the described data source that described blocking stores;
Seven or four unit (not shown), carries out virtual map to the data message of the described data source that described blocking stores.
In this embodiment, the data message of Unit the seven or two to the described data source that described blocking stores carries out duplicate removal, particularly, data deduplication is by the block index technology based on the data message stored blocking, the unit storage space that the data message that release stores is identical, realize the duplicate removal of data message, thus improve the utilization rate of storage space, reduce the cost payout stored.Such as, if when the data message of data source stores in the mode that each unit storage space is 64kb, by block index technology, the unit storage space that index is all, when detecting the unit that wherein storing data information is identical, one of them unit storage space just can be discharged; From this angle analysis, the unit storage space of distribution is less, and duplicate removal effect is better, but the described unit storage space number of distribution is more, and its index also will be more complicated, therefore according to situations such as the performances of system in practice, the number of the described unit storage space of distribution can be rationally set.
Continue in this embodiment, the data message of Unit the seven or three to the described data source that described blocking stores carries out snapshot, particularly, data snapshot carries out snapshot management by the regular data message to managed data source, thus preserve the historical data information of data source; Also namely, in certain time point is to data source, the data message of all storage unit carries out snapshot, and stores.The partial data information that can get corresponding time point when using the data message of certain time point in history is needed user, further, the time of snapshot and relevant frequency information are carried out to the data message of data source, user can as required or concrete condition arrange, such as, can be once a day, snapshot can be carried out to the data message of data source at certain time point of every day, data message after snapshot can record or be stored in the respective stored space of data management apparatus, and index is set up to it, so that follow-up searching is transferred, simultaneously also can setting data source data message SNAPSHOT INFO record or automatically delete after storing certain hour, with the storage space of release busy.
Continue in this embodiment, the data message of Unit the seven or four to the described data source that described blocking stores carries out virtual map, presented the situation of identical data information herein by data access device request mainly for multiple user, need the many parts of virtual map creating described data message, to provide to the data access equipment of described multiple user, particularly, the virtual map creating data message is by the block technology of sharing of use based on file system, when user needs data, a virtual map can be created according to same serving reason storage unit space by snapshot, be supplied to this data access equipment to present to user, because the virtual map of described data message does not take amount of physical memory, and this virtual map can be read and write, and only has when carrying out data modification to the data of virtual map, just needs additional allocation data space to deposit the data message of amendment, thus greatly reduce taking of storage space.
Preferably, described data management apparatus 2 also comprises:
9th device (not shown), according to the change of the data message of data source in described data providing device, upgrades the data message of described data source.
In this embodiment, 9th device is according to the change of the data message of data source in described data providing device, upgrade the data message of described data source, wherein, data management apparatus obtains the mode of the change information of the data message of data source in data providing device, can be data providing device by the data message situation of change of its data source, be initiatively provided to data management apparatus; Also the situation of change of the data message of data source in data providing device can be detected by data management apparatus, then, the data message changed upgrades by the 9th device of data management apparatus, such as, data management apparatus determines the data storage cell changed by block tracking technique, then obtain data message corresponding in data providing device, and store.
Preferably, 5th device 15 of described data management apparatus comprises unit (not shown) and the five or two unit (not shown) on May Day, wherein, the multiple requests presenting identical data information that May Day, unit sent according to multiple data access equipment, determine many parts of virtual map of the data message that described multiple request is corresponding; The virtual map of described data message is provided to corresponding described data access equipment by Unit the five or two respectively.
In this embodiment, the multiple requests presenting identical data information that May Day, unit sent according to multiple data access equipment, determine many parts of virtual map of the data message that described multiple request is corresponding, particularly, May Day, unit determined the establishment of many parts of virtual map described in described multiple many parts of virtual map of asking corresponding data message, first May Day unit can be comprised and determine the described identical data message that described multiple request is corresponding, the number of the described request then sent by data access equipment according to user, create many parts of virtual map of corresponding described data message, also can comprise by other parts in data management apparatus, presented the information such as the number of described identical data information by the request that data access equipment sends according to the user that May Day, unit provided, create many parts of virtual map of described data message corresponding to described request, be then directly stored to the situations such as the position that May Day, unit can be transferred at any time.Further, May Day, unit was by modes such as index searchs, determined the described identical data information that the request that described multiple data access equipment sends presents.
Continue in this embodiment, the virtual map of described data message is provided to corresponding described data access equipment by Unit the five or two respectively, particularly, the virtual map of described data message is provided to the mode of corresponding data access equipment by Unit the five or two respectively, by with being wired or wirelessly connected of setting up between each data access equipment, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description in above-described embodiment, do not repeat them here.
Correspondingly, the 6th device 17 of described data access equipment:
The virtual map of the described data message received is presented to user.
Particularly, 6th device 17 of described data access equipment receives the virtual map mode of described data message, by with being wired or wirelessly connected of setting up between data management apparatus, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of other parts in this embodiment, do not repeat them here.Further, described data message can be presented to user according to predetermined form by data access equipment, and such as, according to the typesetting form preset, font type, size, color, file type etc. present.
Shown in ginseng Fig. 4, preferably, described data access equipment also comprises the 8th device 19 and the tenth device 20, and wherein the 8th device 19 obtains that user is amended presents data message; Tenth device 20 sends to described data management apparatus and describedly amendedly presents data message.
In this embodiment, owing to presenting to the data message of user or the virtual map of data message by data access equipment, with carrying out per family reading and writing and the associative operation such as amendment.If user revises the described data message presented, then data management apparatus needs to preserve the revised context of this user to corresponding data information, and when next time, request presented described data message to user, the nearest amended content that described data message is corresponding can be had access to.
Continue in this embodiment, in order to realize above-mentioned functions, 8th device 19 of data access equipment wherein needs to obtain that user is amended presents data message, and to be sent to described data management apparatus by the tenth device 20 and describedly amendedly present data message, particularly, 8th device 19 obtains the amended mode presenting data message of user, the collection that the data acquisition unit that can comprise data access equipment carries out, such as, pass through keyboard, the information input that mouse etc. carry out, by gathering the voice of user, the information such as gesture, accessed the touch screen of equipment etc. mode to realize by user's touch data.Particularly, tenth device 20 sends the described amended mode presenting data message to described data management apparatus, by with being wired or wirelessly connected of setting up between data management apparatus, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of above-described embodiment, do not repeat them here.
Correspondingly, shown in ginseng Fig. 4, described data management apparatus also comprises the 11 device the 21 and the 13 device 22, and wherein, the 11 device 21 obtains the described amended data message that presents that described data access equipment sends; 13 device 22 again stores and describedly amendedly presents data message.
Particularly, 11 device 21 of data management apparatus obtains the described amended concrete mode presenting data message of described data access equipment transmission, by with being wired or wirelessly connected of setting up between data management apparatus, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of above-described embodiment, do not repeat them here.
Continue in this embodiment, 13 device 22 stores the described amended data message that presents again, particularly, data management apparatus needs to redistribute an amount of physical memory, amendedly data information memory is presented by described, and index is set up to it, so that this user follow-up is had access to by data access equipment.
Preferably, 5th device 15 of described data management apparatus comprises the five or three unit (not shown) and the May 4th unit (not shown), wherein, the request presenting data message that Unit the five or three sends according to described data access equipment, determines that described data access equipment presents the up-to-date storage information of data message described in corresponding; The described up-to-date storage information presenting data message is provided to described data access equipment by the May 4th unit.
This embodiment mainly for, during the data message of the data source that user's the last time reading data access equipment presents, it is revised, when again having access to the data message of this data source, can have access to the nearest amended content that described data message is corresponding, be also the up-to-date storage content of described data message.When user needs to present data message, just data information request is presented by data access equipment to data management apparatus transmission, the request presenting data message that Unit the five or three sends according to described data access equipment, determine that described data access equipment presents the up-to-date storage information of data message described in corresponding, particularly, the layout scenarios that Unit the five or three stores by data in data management apparatus, and corresponding index technology etc., present data message correspondence described in finding and send the up-to-date storage information presenting the data access equipment of data information request.
At this, those skilled in the art should understand, the request presenting data message that Unit the five or three sends according to described data access equipment, determine described data access equipment corresponding described in present the up-to-date storage information of data message concrete mode be only citing, other requests presenting data message sent according to described data access equipment that are existing or that may occur from now on, determine that described data access equipment presents the mode of the up-to-date storage information of data message as being applicable to the application described in corresponding, also should be included in the application's protection domain, and be contained in this at this with way of reference.
Continue in this embodiment, the described up-to-date storage information presenting data message is provided to the concrete mode of described data access equipment by the May 4th unit, by with being wired or wirelessly connected of setting up between data access equipment, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description in previous embodiment, do not repeat them here.
Correspondingly, the 6th device 17 of described data access equipment:
The up-to-date storage information presenting data message described in receiving is presented to user.
Particularly, the concrete mode of the up-to-date storage information of data message is presented described in 6th device 17 of data access equipment receives, by with being wired or wirelessly connected of setting up between data management apparatus, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of other parts in this embodiment, do not repeat them here.
Further, the described up-to-date storage information presenting data message can be presented to user according to predetermined form by data access equipment, and such as, according to the typesetting form preset, font type, size, color, file type etc. present.Thus meet the independent operation of user to corresponding data information, independently present, improve the experience of user.
At this; those skilled in the art should understand; the concrete mode that the up-to-date storage information presenting data message described in receiving presents to user is only citing by the 6th device 17 of data access equipment; other existing or may occur from now on the up-to-date storage information presenting data message described in receiving is presented to the mode of user as being applicable to the application; also should be included in the application's protection domain, and be contained in this at this with way of reference.
Compared with prior art, the application provides the data source in equipment by data management apparatus scan-data, and obtain configuration according to the parameter information initialization data of described data source, such as, the parameter information of described data source generally can comprise: the account number cipher of data source, the deployment types of data source, path etc. deposited by the data acquisition script of data source, obtain the data message of described data source from described data providing device according to described data acquisition configuration, data management apparatus receives the request presenting data message that data access equipment sends, and according to described request, data message corresponding for described request is provided to described data access equipment, data access equipment receives data message corresponding to described request, and present to user, thus, the data message of the data source of data providing device is managed concentratedly, reduce handling cost, when user needs usage data, corresponding data are provided to data access equipment by data management apparatus, data access equipment presents to user automatically, consults for user operation, improves the experience of user.
And the application can also process the data message of described data source on data management apparatus, such as, blocking stores, data deduplication, snapshot, virtual map etc.; Wherein the blocking of the data message of data source stores, duplicate removal, snapshot etc. for data message provide basis and prerequisite, and can according to the situation of change of the data message of data source in data providing device, upgrade the data message of corresponding stored unit, thus keep the data message real-time consistency of the data source of data management apparatus and data providing device; Wherein snapshot and virtual map are carried out to data, multiple data access equipment can be met ask to present the situations such as identical data message simultaneously, and, by the process of data message virtual map to be presented, do not take unnecessary amount of physical memory, thus reduce taking of storage space.
In addition, when user consults the data message of the data source that data access equipment presents, can modify to it, the amendment information of user is sent to data management apparatus by data access equipment, data management apparatus is according to this amendment information, the described data message that presents is modified, and amended data message is stored again, when presenting data message described in this data access equipment asks to consult again, the described up-to-date storage information presenting data message is provided to corresponding data access equipment by data management apparatus, and by this data access equipment, described up-to-date storage information is presented to user, thus the data change information of each user in data access equipment end can be recorded respectively, and user is when next time, request presented corresponding data message, the up-to-date storage information that this can be presented data message corresponding to request presents to user, improve the experience of user, the flow process that reduced data obtains and sends.
Shown in ginseng Fig. 5, a kind of method flow diagram for data management provided according to another aspect of the application is provided, wherein, described data providing device and data management apparatus and data access equipment cooperatively interact, to realize the management of the data message of the data source in data providing device.
Particularly, in step sl, data management apparatus scan-data provides the data source in equipment, and obtains configuration according to the parameter information initialization data of described data source; In step s 2, described data management apparatus obtains the data message of described data source from described data providing device according to described data acquisition configuration; Correspondingly, in step s 2, described data providing device provides the data message of described data source to described data management apparatus; In step s3, described data access equipment sends the request presenting the data message of data source to data management apparatus; Correspondingly, in step s3, the request presenting data message that described data management apparatus sends according to data access equipment, is provided to described data access equipment by data message corresponding for described request; Correspondingly, in step s 4 which, described data access equipment receives data message corresponding to described request that described data management apparatus provides; In step s 5, the described data message received is presented to user by described data access equipment.
Shown in ginseng Fig. 5, in step sl, described data management apparatus 2 scan-data provides the data source in equipment 1, and obtains configuration according to the parameter information initialization data of described data source.
Particularly, in described step S1, scan-data provides the mode of the data source in equipment, the wireless or wired connection set up by the two, based on this connection directly/automatically on data providing device, find the information search relevant to gather data source; Further, the information such as the user name of the data providing device that data management apparatus can provide according to user and password, through data providing device port numbers and IP address registration on the data providing device of correspondence, then corresponding scan script is performed according to the soft and hardware type characteristic of data providing device, to obtain the data source information on described data providing device, further, data source information wherein generally comprises the information such as data source types, data source version and the list of data source account.
Continue in this embodiment, in described step S1, parameter information initialization data according to described data source obtains configuration, wherein, the parameter information of data source generally can comprise account and the encrypted message of this data source, routing information etc. deposited by deployment types information and data acquisition script, particularly, the process of configuration is obtained according to the parameter information initialization data of described data source, the data message being the data source in data management apparatus acquisition data providing device is ready, its detailed process can comprise the propelling movement of (1) data acquisition script, need the script used and instrument use standard agreement and port transmission on the data providing device at data source place by obtaining data, and be stored under user configured data acquisition script deposits path, (2) acquisition of data source environmental parameter, the account corresponding according to user configured data source and password obtain the environmental parameter of data source, as log file size and quantity etc., (3) parameter initialization of data acquisition service and startup, the data source environmental parameter according to getting carries out initialization to the acquisition of data, thus starts data acquisition on the basis that data management apparatus and data providing device connect.
At this, those skilled in the art should understand, in described step S1, scan-data provides the concrete mode of the data source in equipment and obtains according to the parameter information initialization data of described data source the concrete mode configured and is only citing, the scan-data of other data management apparatus that are existing or that may occur from now on provides the concrete mode of the data source in equipment and obtains the concrete mode of configuration as being applicable to the application according to the parameter information initialization data of described data source, also should be included in the application's protection domain, and be contained in this at this with way of reference.
Shown in ginseng Fig. 5, in step s 2, described data management apparatus obtains the data message of described data source from described data providing device according to described data acquisition configuration.
In this embodiment, in described step S2, obtain the data message of data source from data providing device according to described data acquisition configuration, particularly, need the connection of setting up based on data management apparatus and data providing device, and the data acquisition configuration after data management apparatus initialization, from data providing device, obtain the data message of data source.Further, when data management apparatus obtains the data message of the data source of data providing device first, need the data acquisition carrying out full dose, all get in data management apparatus by the data message existed in current data source; After primary full dose data acquisition, later data acquisition all adopts the mode of increment to carry out.The part that the acquisition of described incremental data changes mainly for the data message of data source in data providing device, obtain, further, the data message of data source can be carried out block storage, adopt block tracking technique to determine the data block changed, then the data of its correspondence are sent in data management apparatus and preserve.
Correspondingly, in step s 2, described data providing device provides the data message of described data source to described data management apparatus.
In this embodiment, in described step S2, the data message of described data source is provided to described data management apparatus, particularly, data providing device is connected based on the wire/wireless of data management apparatus, the data message of data source is wherein provided to data management apparatus, to realize the management of the data message of data source on data providing device.
Shown in ginseng Fig. 5, in step s3, described data access equipment sends the request presenting the data message of data source to data management apparatus.
In this embodiment, in described step S3, the request presenting the data message of data source is sent to data management apparatus 2, particularly, when user needs the data message consulted in data source, need to send corresponding request by data access equipment 3 to data management apparatus, this request comprises the contents such as the equipment (that is, present the data access equipment of described data message) that data message in the data source that user wishes to present and data message present, wherein, data access equipment 3 sends the mode presenting the request of the data message of data source to data management apparatus 2, by with being wired or wirelessly connected or based on data sharing mode in described connection of setting up between data management apparatus, carry out according to each self-corresponding communication protocol, wherein, described radio connection includes but not limited to TCP/IP, near-field communication (NFC), bluetooth (Bluetooth), short message, infrared data transmission (IrDA), ZigBee, ultra-wideband (UltraWideBand), WiMedia, GPS, DECT, wireless 1394 and other private radio systems etc., wherein, describedly include but not limited to NFS (network file system(NFS): NetworkFileSystem) and iSCSI (InternetSmallComputerSystemInterface) etc. based on data sharing mode that is wireless or wired connection mode, such as, user to be sent to data management apparatus by the WEB interface of data access equipment or client end interface described in present the request of data message.
Correspondingly, in step s3, the request presenting data message that described data management apparatus sends according to data access equipment, is provided to described data access equipment by data message corresponding for described request.
In this embodiment, in described step S3, according to the request presenting data message that data access equipment sends, determine the data message that described request is corresponding, data message corresponding for described request is provided to described data access equipment.
Particularly, in described step S3, receive the mode presenting the request of data message that data access equipment sends, by with being wired or wirelessly connected of setting up between data access equipment, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of other parts in this embodiment, do not repeat them here.Wherein, determine the data message that described request is corresponding, particularly, when request presents the request of the data message of described correspondence only from the data access equipment of one of them user, so the described data message of correspondence is provided to corresponding data access equipment by data management apparatus, correspondingly, the described data message of correspondence is provided to the mode of corresponding data access equipment, by with being wired or wirelessly connected of setting up between data access equipment, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of other parts in this embodiment, do not repeat them here.
Continue in this embodiment, the request presenting the data message of described correspondence when request is from multiple data access equipment corresponding to wherein multiple user, now data management apparatus needs described data message to be carried out virtual map to corresponding multiple data access equipment, virtual map wherein does not need to take unnecessary storage space, meets the data access equipment of multiple user in correspondence to the access of identical data information simultaneously.
Continue in this embodiment, after user modifies to the data message be presented on the data access equipment of its correspondence, when again presenting the request of described data message by the transmission of data access equipment, the data message that now described request is corresponding, just for this user is to the up-to-date amended information of the data message be presented on the data access equipment of its correspondence, thus meet the independent operation of user to corresponding data information, independently present, improve the experience of user.
At this; those skilled in the art should understand; according to the request presenting data message that data access equipment sends in described step S3; determine that the concrete mode of the data message that described request is corresponding is only citing; other requests presenting data message sent according to data access equipment that are existing or that may occur from now on; determine that the mode of the data message that described request is corresponding is as being applicable to the application; also should be included in the application's protection domain, and be contained in this at this with way of reference.
Correspondingly, in step s 4 which, described data access equipment receives data message corresponding to described request that described data management apparatus provides.
Particularly, in described step S4, receive the mode of data message corresponding to described request that described data management apparatus provides, by with being wired or wirelessly connected of setting up between data management apparatus, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of other parts in this embodiment, do not repeat them here.
In step s 5, the described data message received is presented to user by described data access equipment.
Particularly, in described step S5, receive the mode of described data message, by with being wired or wirelessly connected of setting up between data management apparatus, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of other parts in this embodiment, do not repeat them here.Further, described data message can be presented to user according to predetermined form by data access equipment, and such as, according to the typesetting form preset, font type, size, color, file type etc. present.
At this; those skilled in the art should understand; the concrete mode of the described data message received being presented to user in described step S5 is only citing; other existing or may occur from now on the described data message received is presented to the mode of user as being applicable to the application; also should be included in the application's protection domain, and be contained in this at this with way of reference.
Shown in ginseng Fig. 6, wherein in a preferred embodiment, also comprise in the method for data management of described data management apparatus end:
The data message of S6 to described data source processes;
Wherein, described step S3 comprises:
According to the request presenting data message that data access equipment sends, the data message of the data source after described process is provided to described data access equipment.
In this embodiment, in described step S6, process the data message of described data source, particularly, can comprise the storage data message of the data source obtained from described data providing device being carried out to certain way, such as, blocking stores; Also can comprise and carry out duplicate removal to stored data message, to reduce storage space, concrete duplicate removal mode does not limit; Also can comprise and snapshot is carried out to stored data message, record the data information content of certain time point, as backup, so that the data of subsequent user to this time point are checked; Can also comprise and virtual map is carried out to data message, data message is shared, by identical data message virtual map to different data access equipment, to realize multiple user data message that share and access is identical simultaneously; Can also comprise data message is encrypted, desensitization etc., to guarantee that data message is provided to the security in data access device procedures; Can also comprise and store user on the data access equipment of its correspondence to described amendment information presenting data message etc.
At this; those skilled in the art should understand; in described step S6, citing is only to the concrete mode that the data message of described data source processes; other existing or modes processed the data message of described data source that may occur from now on are as being applicable to the application; also should be included in the application's protection domain, and be contained in this at this with way of reference.
Continue in this embodiment, in described step S3, according to the request presenting data message that data access equipment sends, the data message of the data source after described process is provided to described data access equipment, particularly, the concrete request situation presenting data message that data management apparatus sends according to data access equipment, such as, whether be that the data access equipment that multiple user is corresponding simultaneously asks identical data message simultaneously, or whether the user sending described request once modified to the data message of this request correspondence, or whether the data message of this request correspondence is the information etc. in restricted area, and after carrying out corresponding processing data information, the data message of the data source after described process is provided to described data access equipment, wherein, described data message is provided to the mode of described data access equipment, by with being wired or wirelessly connected of setting up between data access equipment, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description in above-described embodiment, do not repeat them here.
Shown in ginseng Fig. 6, preferably, described step S6 comprises:
Blocking storage is carried out to the data message of described data source.
Particularly, in described step S6, blocking storage is carried out to the data message of described data source, wherein, blocking is stored as and the storage space of data message is divided into several storage space unit, and the storage size of each unit can be equal, also can not wait; The distribution of unitary space can be carried out according to certain Distribution dynamics, also the distribution of unitary space can be carried out at random, such as, the unit of the spatial division that data can be stored to be several storage spaces be 64kb, the unit etc. of the spatial division that also data can be stored to be several storage spaces be 64kb to 256kb; Then by the data information memory of data source in unit storage space, just realize storing the blocking of the data message of data source; After blocking storage is carried out to the data message of data source, for other relevant treatment realizing data message provides the foundation and prerequisite, such as, duplicate removal, snapshot, virtual map etc. that data information unitsization stores the data message on basis is based upon.
Shown in ginseng Fig. 6, more preferably, described step S6 also comprises following at least any one:
The data message of S61 (not shown) to the described data source that described blocking stores carries out duplicate removal;
The data message of S62 (not shown) to the described data source that described blocking stores carries out snapshot;
The data message of S63 (not shown) to the described data source that described blocking stores carries out virtual map.
In this embodiment, in described step S61, duplicate removal is carried out to the data message of the described data source that described blocking stores, particularly, data deduplication is by the block index technology based on the data message stored blocking, the unit storage space that the data message that release stores is identical, realizes the duplicate removal of data message, thus improve the utilization rate of storage space, reduce the cost payout stored.Such as, if when the data message of data source stores in the mode that each unit storage space is 64kb, by block index technology, the unit storage space that index is all, when detecting the unit that wherein storing data information is identical, one of them unit storage space just can be discharged; From this angle analysis, the unit storage space of distribution is less, and duplicate removal effect is better, but the described unit storage space number of distribution is more, and its index also will be more complicated, therefore according to situations such as the performances of system in practice, the number of the described unit storage space of distribution can be rationally set.
Continue in this embodiment, in described step S62, snapshot is carried out to the data message of the described data source that described blocking stores, particularly, data snapshot carries out snapshot management by the regular data message to managed data source, thus preserve the historical data information of data source; Also namely, in certain time point is to data source, the data message of all storage unit carries out snapshot, and stores.The partial data information that can get corresponding time point when using the data message of certain time point in history is needed user, further, the time of snapshot and relevant frequency information are carried out to the data message of data source, user can as required or concrete condition arrange, such as, can be once a day, snapshot can be carried out to the data message of data source at certain time point of every day, data message after snapshot can record or be stored in the respective stored space of data management apparatus, and index is set up to it, so that follow-up searching is transferred, simultaneously also can setting data source data message SNAPSHOT INFO record or automatically delete after storing certain hour, with the storage space of release busy.
Continue in this embodiment, in described step S63, virtual map is carried out to the data message of the described data source that described blocking stores, presented the situation of identical data information herein by data access device request mainly for multiple user, need the many parts of virtual map creating described data message, to provide to the data access equipment of described multiple user, particularly, the virtual map creating data message is by the block technology of sharing of use based on file system, when user needs data, a virtual map can be created according to same serving reason storage unit space by snapshot, be supplied to this data access equipment to present to user, because the virtual map of described data message does not take amount of physical memory, and this virtual map can be read and write, and only has when carrying out data modification to the data of virtual map, just needs additional allocation data space to deposit the data message of amendment, thus greatly reduce taking of storage space.
Preferably, also comprise in the method for described data management apparatus end for data management:
S9 (not shown), according to the change of the data message of data source in described data providing device, upgrades the data message of described data source.
In this embodiment, in described step S9, according to the change of the data message of data source in described data providing device, upgrade the data message of described data source, wherein, data management apparatus obtains the mode of the change information of the data message of data source in data providing device, can be data providing device by the data message situation of change of its data source, be initiatively provided to data management apparatus; Also the situation of change of the data message of data source in data providing device can be detected by data management apparatus, then, the data message changed upgrades by data management apparatus, such as, data management apparatus determines the data storage cell changed by block tracking technique, then obtain data message corresponding in data providing device, and store.
Preferably, described step S3 comprises:
The multiple requests presenting identical data information that S31 (not shown) sends according to multiple data access equipment, determine many parts of virtual map of the data message that described multiple request is corresponding;
The virtual map of described data message is provided to corresponding described data access equipment by S32 (not shown) respectively.
In this embodiment, in described step S31, according to the multiple requests presenting identical data information that multiple data access equipment sends, determine many parts of virtual map of the data message that described multiple request is corresponding, particularly, determine the establishment of many parts of virtual map described in described multiple many parts of virtual map of asking corresponding data message in this step, the described identical data message first determining that described multiple request is corresponding can be comprised, the number of the described request then sent by data access equipment according to user, create many parts of virtual map of corresponding described data message, also can comprise by other parts in data management apparatus, presented the information such as the number of described identical data information by the request that data access equipment sends according to user, create many parts of virtual map of described data message corresponding to described request, be then directly stored to the situations such as the position can transferred at any time in data management apparatus.Further, by modes such as index searchs, determine the described identical data information that the request that described multiple data access equipment sends presents.
Continue in this embodiment, in described step S32, the virtual map of described data message is provided to respectively corresponding described data access equipment, particularly, in this step the virtual map of described data message is provided to respectively the mode of corresponding data access equipment, by with being wired or wirelessly connected of setting up between each data access equipment, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description in above-described embodiment, do not repeat them here.
Correspondingly, described step S5 comprises:
The virtual map of the described data message received is presented to user.
Particularly, in described step S5, receive the virtual map mode of described data message, by with being wired or wirelessly connected of setting up between data management apparatus, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of other parts in this embodiment, do not repeat them here.Further, described data message can be presented to user according to predetermined form by data access equipment, and such as, according to the typesetting form preset, font type, size, color, file type etc. present.
Shown in ginseng Fig. 7, preferably, the method being used for data management in described data access equipment end also comprises:
S10 obtains that user is amended presents data message;
S7 sends to described data management apparatus and describedly amendedly presents data message.
In this embodiment, owing to presenting to the data message of user or the virtual map of data message by data access equipment, with carrying out per family reading and writing and the associative operation such as amendment.If user revises the described data message presented, then data management apparatus needs to preserve the revised context of this user to corresponding data information, and when next time, request presented described data message to user, the nearest amended content that described data message is corresponding can be had access to.
Continue in this embodiment, in order to realize above-mentioned functions, in described step S10, need to obtain that user is amended presents data message, and in described step S7, send to described data management apparatus and describedly amendedly present data message, particularly, in described step S10, obtain the amended mode presenting data message of user, the collection that the data acquisition unit that can comprise data access equipment carries out, such as, pass through keyboard, the information input that mouse etc. carry out, by gathering the voice of user, the information such as gesture, accessed the touch screen of equipment etc. mode to realize by user's touch data.Particularly, in described step S7, send the described amended mode presenting data message to described data management apparatus, by with being wired or wirelessly connected of setting up between data management apparatus, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of above-described embodiment, do not repeat them here.
Shown in ginseng Fig. 7, correspondingly, the method being used for data management at described data management apparatus end also comprises:
S7 obtains the described amended of described data access equipment transmission and presents data message;
S8 again stores and describedly amendedly presents data message.
Particularly, in described step S7, obtain the described amended concrete mode presenting data message that described data access equipment sends, by with being wired or wirelessly connected of setting up between data management apparatus, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of above-described embodiment, do not repeat them here.
Continue in this embodiment, in described step S8, again store and describedly amendedly present data message, particularly, data management apparatus needs to redistribute an amount of physical memory, amendedly present data information memory by described, and index is set up to it, so that this user follow-up is had access to by data access equipment.
Shown in ginseng Fig. 7, preferably, described step S3 comprises:
The request presenting data message that S33 (not shown) sends according to described data access equipment, determines that described data access equipment presents the up-to-date storage information of data message described in corresponding;
The described up-to-date storage information presenting data message is provided to described data access equipment by S34 (not shown).
This embodiment mainly for, during the data message of the data source that user's the last time reading data access equipment presents, it is revised, when again having access to the data message of this data source, can have access to the nearest amended content that described data message is corresponding, be also the up-to-date storage content of described data message.When user needs to present data message, just data information request is presented by data access equipment to data management apparatus transmission, in described step S33, according to the request presenting data message that described data access equipment sends, determine that described data access equipment presents the up-to-date storage information of data message described in corresponding, particularly, in described step S33 by data management apparatus in data store layout scenarios, and corresponding index technology etc., present data message correspondence described in finding and send the up-to-date storage information presenting the data access equipment of data information request.
At this, those skilled in the art should understand, according to the request presenting data message that described data access equipment sends in described step S33, determine described data access equipment corresponding described in present the up-to-date storage information of data message concrete mode be only citing, other requests presenting data message sent according to described data access equipment that are existing or that may occur from now on, determine that described data access equipment presents the mode of the up-to-date storage information of data message as being applicable to the application described in corresponding, also should be included in the application's protection domain, and be contained in this at this with way of reference.
Continue in this embodiment, in described step S34, the described up-to-date storage information presenting data message is provided to the concrete mode of described data access equipment, by with being wired or wirelessly connected of setting up between data access equipment, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description in previous embodiment, do not repeat them here.
Shown in ginseng Fig. 7, correspondingly, described step S5 comprises:
The up-to-date storage information presenting data message described in receiving is presented to user.
Particularly, in described step S5, present the concrete mode of the up-to-date storage information of data message described in reception, by with being wired or wirelessly connected of setting up between data management apparatus, or based on the data sharing mode of described connection, carry out according to each self-corresponding communication protocol, wherein, described wired or wireless connected mode, and based on the concrete form that the data sharing mode of this connection comprises, please refer to the description of other parts in this embodiment, do not repeat them here.
Further, the described up-to-date storage information presenting data message can be presented to user according to predetermined form by data access equipment, and such as, according to the typesetting form preset, font type, size, color, file type etc. present.Thus meet the independent operation of user to corresponding data information, independently present, improve the experience of user.
At this; those skilled in the art should understand; the concrete mode of the up-to-date storage information presenting data message described in receiving being presented to user in described step S5 is only citing; other existing or may occur from now on the up-to-date storage information presenting data message described in receiving is presented to the mode of user as being applicable to the application; also should be included in the application's protection domain, and be contained in this at this with way of reference.
Compared with prior art, the application provides the data source in equipment by data management apparatus scan-data, and obtain configuration according to the parameter information initialization data of described data source, such as, the parameter information of described data source generally can comprise: the account number cipher of data source, the deployment types of data source, path etc. deposited by the data acquisition script of data source, obtain the data message of described data source from described data providing device according to described data acquisition configuration, data management apparatus receives the request presenting data message that data access equipment sends, and according to described request, data message corresponding for described request is provided to described data access equipment, data access equipment receives data message corresponding to described request, and present to user, thus, the data message of the data source of data providing device is managed concentratedly, reduce handling cost, when user needs usage data, corresponding data are provided to data access equipment by data management apparatus, data access equipment presents to user automatically, consults for user operation, improves the experience of user.
And the application can also process the data message of described data source on data management apparatus, such as, blocking stores, data deduplication, snapshot, virtual map etc.; Wherein the blocking of the data message of data source stores, duplicate removal, snapshot etc. for data message provide basis and prerequisite, and can according to the situation of change of the data message of data source in data providing device, upgrade the data message of corresponding stored unit, thus keep the data message real-time consistency of the data source of data management apparatus and data providing device; Wherein snapshot and virtual map are carried out to data, multiple data access equipment can be met ask to present the situations such as identical data message simultaneously, and, by the process of data message virtual map to be presented, do not take amount of physical memory, thus reduce taking of storage space.
In addition, when user consults the data message of the data source that data access equipment presents, can modify to it, the amendment information of user is sent to data management apparatus by data access equipment, data management apparatus is according to this amendment information, the described data message that presents is modified, and amended data message is stored again, when presenting data message described in this data access equipment asks to consult again, the described up-to-date storage information presenting data message is provided to corresponding data access equipment by data management apparatus, and by this data access equipment, described up-to-date storage information is presented to user, thus the data change information of each user in data access equipment end can be recorded respectively, and user is when next time, request presented corresponding data message, the up-to-date storage information that this can be presented data message corresponding to request presents to user, improve the experience of user, the flow process that reduced data obtains and sends.
To those skilled in the art, obviously the invention is not restricted to the details of above-mentioned one exemplary embodiment, and when not deviating from spirit of the present invention or essential characteristic, the present invention can be realized in other specific forms.Therefore, no matter from which point, all should embodiment be regarded as exemplary, and be nonrestrictive, scope of the present invention is limited by claims instead of above-mentioned explanation, and all changes be therefore intended in the implication of the equivalency by dropping on claim and scope are included in the present invention.Any Reference numeral in claim should be considered as the claim involved by limiting.In addition, obviously " comprising " one word do not get rid of other unit or step, odd number does not get rid of plural number.Multiple unit of stating in device claim or device also can be realized by software or hardware by a unit or device.First, second word such as grade is used for representing title, and does not represent any specific order.

Claims (27)

1. be used for a method for data management at data management apparatus end, wherein, the method comprises:
A scan-data provides the data source in equipment, and obtains configuration according to the parameter information initialization data of described data source;
B obtains the data message of described data source from described data providing device according to described data acquisition configuration;
The request presenting data message that c sends according to data access equipment, is provided to described data access equipment by data message corresponding for described request.
2. method according to claim 1, wherein, described method also comprises:
The data message of d to described data source processes;
Wherein, described step c comprises:
According to the request presenting data message that data access equipment sends, the data message of the data source after described process is provided to described data access equipment.
3. method according to claim 2, wherein, described steps d comprises:
Blocking storage is carried out to the data message of described data source.
4. according to the method described in claim 3, wherein, described steps d also comprises following at least any one:
Duplicate removal is carried out to the data message of the described data source that described blocking stores;
Snapshot is carried out to the data message of the described data source that described blocking stores;
Virtual map is carried out to the data message of the described data source that described blocking stores.
5. the method according to any one of claim 2 to 4, wherein, the method also comprises:
E, according to the change of the data message of data source in described data providing device, upgrades the data message of described data source.
6. method according to any one of claim 1 to 5, wherein, described step c comprises:
The multiple requests presenting identical data information that c1 sends according to multiple data access equipment, determine many parts of virtual map of the data message that described multiple request is corresponding;
The virtual map of described data message is provided to corresponding described data access equipment by c2 respectively.
7. method according to any one of claim 1 to 6, wherein, described method also comprises:
F obtains the described amended of described data access equipment transmission and presents data message;
G again stores and describedly amendedly presents data message.
8. method according to any one of claim 1 to 7, wherein, described step c comprises:
The request presenting data message that c3 sends according to described data access equipment, determines that described data access equipment presents the up-to-date storage information of data message described in corresponding;
The described up-to-date storage information presenting data message is provided to described data access equipment by c4.
9. be used for a method for data management at data providing device end, wherein, the method comprises:
A provides the data message of described data source to described data management apparatus.
10. be used for a method for data management in data access equipment end, wherein, the method comprises:
α sends the request presenting the data message of data source to data management apparatus;
β receives data message corresponding to described request that described data management apparatus provides;
The described data message received is presented to user by γ.
11. methods according to claim 10, wherein, described step γ comprises:
The virtual map of the described data message received is presented to user.
12. methods according to claim 10 or 11, wherein, described method also comprises:
δ obtains that user is amended presents data message;
ε sends to described data management apparatus and describedly amendedly presents data message.
13. according to claim 10 to the method according to any one of 12, and wherein, described step γ comprises:
The up-to-date storage information presenting data message described in receiving is presented to user.
14. 1 kinds of data management apparatus for data management, wherein, this equipment comprises:
First device, provides the data source in equipment for scan-data, and obtains configuration according to the parameter information initialization data of described data source;
3rd device, for obtaining the data message of described data source from described data providing device according to described data acquisition configuration;
5th device, for the request presenting data message sent according to data access equipment, is provided to described data access equipment by data message corresponding for described request.
15. equipment according to claim 14, wherein, described equipment also comprises:
7th device, for processing the data message of described data source;
Wherein, described 5th device is used for:
According to the request presenting data message that data access equipment sends, the data message of the data source after described process is provided to described data access equipment.
16. equipment according to claim 15, wherein, described 7th device comprises:
The July 1st, unit, carried out blocking storage to the data message of described data source.
17. according to the equipment described in claim 16, and wherein, described 7th device also comprises following at least any one:
Unit the seven or two, the data message for the described data source stored described blocking carries out duplicate removal;
Unit the seven or three, the data message for the described data source stored described blocking carries out snapshot;
Unit the seven or four, the data message for the described data source stored described blocking carries out virtual map.
18. according to claim 15 to the equipment according to any one of 17, and wherein, this equipment also comprises:
9th device, for the change according to the data message of data source in described data providing device, upgrades the data message of described data source.
19. according to claim 14 to the equipment according to any one of 18, and wherein, described 5th device comprises:
May Day, unit, for the multiple requests presenting identical data information sent according to multiple data access equipment, determined many parts of virtual map of the data message that described multiple request is corresponding;
Unit the five or two, for being provided to corresponding described data access equipment respectively by the virtual map of described data message.
20. according to claim 14 to the equipment according to any one of 19, and wherein, described equipment also comprises:
11 device, presents data message for obtaining the described amended of described data access equipment transmission;
13 device, describedly amendedly presents data message for again storing.
21. according to claim 14 to the equipment according to any one of 20, and wherein, described 5th device comprises:
Unit the five or three, for the request presenting data message sent according to described data access equipment, determines that described data access equipment presents the up-to-date storage information of data message described in corresponding;
The May 4th unit, for being provided to described data access equipment by the described up-to-date storage information presenting data message.
22. 1 kinds of data providing devices for data management, wherein, this equipment comprises:
Data supplying device, for providing the data message of described data source to described data management apparatus.
23. 1 kinds of data access equipment for data management, wherein, this equipment comprises:
Second device, for sending the request presenting the data message of data source to data management apparatus;
4th device, for receiving data message corresponding to described request that described data management apparatus provides;
6th device, for presenting to user by the described data message received.
24. equipment according to claim 23, wherein, described 6th device is used for:
The virtual map of the described data message received is presented to user.
25. equipment according to claim 23 or 24, wherein, described equipment also comprises:
8th device, for obtaining, user is amended presents data message;
Tenth device, describedly amendedly presents data message for sending to described data management apparatus.
26. equipment according to any one of claim 23 to 25, wherein, described 6th device is used for:
The up-to-date storage information presenting data message described in receiving is presented to user.
27. 1 kinds of systems for data management, wherein, this system comprises data management apparatus according to any one of claim 14 to 21 and data providing device as claimed in claim 22 and the data access equipment according to any one of claim 23 to 26.
CN201510599578.8A 2015-09-18 2015-09-18 Data management method and apparatus Pending CN105260402A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510599578.8A CN105260402A (en) 2015-09-18 2015-09-18 Data management method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510599578.8A CN105260402A (en) 2015-09-18 2015-09-18 Data management method and apparatus

Publications (1)

Publication Number Publication Date
CN105260402A true CN105260402A (en) 2016-01-20

Family

ID=55100094

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510599578.8A Pending CN105260402A (en) 2015-09-18 2015-09-18 Data management method and apparatus

Country Status (1)

Country Link
CN (1) CN105260402A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105812489A (en) * 2016-05-11 2016-07-27 深圳市智物联网络有限公司 Methods and devices for data storage management and presentation and server
CN108270834A (en) * 2016-12-30 2018-07-10 北京国双科技有限公司 Data transmission method and device
CN110221988A (en) * 2019-05-05 2019-09-10 福建天泉教育科技有限公司 A kind of cache optimization method and system of third party's data
CN110472434A (en) * 2019-07-12 2019-11-19 北京字节跳动网络技术有限公司 Data desensitization method, system, medium and electronic equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102316117A (en) * 2011-09-29 2012-01-11 中兴通讯股份有限公司南京分公司 Resource processing method and device
CN103593422A (en) * 2013-11-01 2014-02-19 国云科技股份有限公司 A Virtual Access Management Method for Heterogeneous Database
CN103631820A (en) * 2012-08-27 2014-03-12 阿里巴巴集团控股有限公司 Metadata management method and device of distributed file system
CN103699655A (en) * 2013-12-27 2014-04-02 福建星网视易信息系统有限公司 Method and device for internationalizing databases and method and system for converting data
WO2014101199A1 (en) * 2012-12-31 2014-07-03 华为技术有限公司 Data processing method and device
CN104809201A (en) * 2015-04-24 2015-07-29 联动优势科技有限公司 Database synchronization method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102316117A (en) * 2011-09-29 2012-01-11 中兴通讯股份有限公司南京分公司 Resource processing method and device
CN103631820A (en) * 2012-08-27 2014-03-12 阿里巴巴集团控股有限公司 Metadata management method and device of distributed file system
WO2014101199A1 (en) * 2012-12-31 2014-07-03 华为技术有限公司 Data processing method and device
CN103593422A (en) * 2013-11-01 2014-02-19 国云科技股份有限公司 A Virtual Access Management Method for Heterogeneous Database
CN103699655A (en) * 2013-12-27 2014-04-02 福建星网视易信息系统有限公司 Method and device for internationalizing databases and method and system for converting data
CN104809201A (en) * 2015-04-24 2015-07-29 联动优势科技有限公司 Database synchronization method and device

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105812489A (en) * 2016-05-11 2016-07-27 深圳市智物联网络有限公司 Methods and devices for data storage management and presentation and server
CN108270834A (en) * 2016-12-30 2018-07-10 北京国双科技有限公司 Data transmission method and device
CN108270834B (en) * 2016-12-30 2021-08-10 北京国双科技有限公司 Data transmission method and device
CN110221988A (en) * 2019-05-05 2019-09-10 福建天泉教育科技有限公司 A kind of cache optimization method and system of third party's data
CN110221988B (en) * 2019-05-05 2021-04-30 福建天泉教育科技有限公司 Cache optimization method and system for third-party data
CN110472434A (en) * 2019-07-12 2019-11-19 北京字节跳动网络技术有限公司 Data desensitization method, system, medium and electronic equipment

Similar Documents

Publication Publication Date Title
EP3646226B1 (en) Access control manager configuration based on log files mining
US9426221B2 (en) Dynamic proximity based networked storage
EP2656210B1 (en) Providing a persona-based application experience
CN109873839B (en) Data access method, server and distributed system
US9607170B2 (en) Compromise free cloud data encryption and security
CN105989275B (en) Method and system for certification
CN106817388B (en) Method and device for acquiring data by virtual machine and host machine and system for accessing data
CN105260402A (en) Data management method and apparatus
CN103369002A (en) A resource downloading method and system
US11363111B2 (en) Customized application architecture utilizing sparse and base metadata layers
US10979392B2 (en) Preventing unauthorized access to secure enterprise information systems using a multi-filtering and randomizing control system
CN113312669A (en) Password synchronization method, device and storage medium
US9648103B2 (en) Non-uniform file access in a distributed file system
KR101419275B1 (en) Data synchronizing and servicing apparatus and method based on cloud storage
EP4348936B1 (en) Secure multi-tenant cloud subscription sharing
KR20140088962A (en) System and method for storing data in a cloud environment
US20240232191A9 (en) Permission-based index for query processing
US10231269B2 (en) Dynamic generation of geographically bound manet IDs
US11652849B2 (en) Identifying recommended feature sets based on application feature popularity
KR101495562B1 (en) Method And Apparatus for Providing Data Analysis Service
CN107548090B (en) Method and apparatus for determining owner of wireless hotspot group
CN114785781B (en) Data access method and device
EP2565814A2 (en) Assigning access rights in enterprise digital rights management systems
CN105354148A (en) Data processing method and related apparatus
CN115587394A (en) Cloud native architecture human resource data processing method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160120

RJ01 Rejection of invention patent application after publication