WO2019141128A1

WO2019141128A1 - Data processing method, apparatus and device

Info

Publication number: WO2019141128A1
Application number: PCT/CN2019/071145
Authority: WO
Inventors: 温涛
Original assignee: 阿里巴巴集团控股有限公司
Priority date: 2018-01-18
Filing date: 2019-01-10
Publication date: 2019-07-25
Also published as: TW201933812A; CN108304503A; TWI700905B

Abstract

Disclosed are a data processing method, apparatus and device. The method comprises: receiving a data block to be stored, and acquiring a first check value of the data block to be stored; and if, in stored data blocks, there is a target data block having a check value matching the first check value, and the data block to be stored is different from the target data block, then storing the data block to be stored, and allocating an assisted query identifier different from that of the target data block to the data block to be stored. By means of the embodiments of the present description, when a stored target data block and a data block to be stored have the same check value but different data content, the data block to be stored can be stored, and an assisted query identifier different from that of the target data block is re-allocated to the data block to be stored so as to distinguish the two data blocks having the same check value but different data content, such that the problem that a data block to be stored having the same check value but different data content cannot be stored in a server, thereby preventing the disordering of service scenarios.

Description

Data processing method, device and device

Technical field

The present specification relates to the field of computer technology, and in particular, to a data processing method, device and device.

Background technique

With the continuous development of network technology and terminal technology, data transmission and data storage have become more and more data. Generally, in the process of data storage, in order to avoid repeated storage of data, it is usually necessary to determine whether the data (or data block) to be stored has been stored by some detection means. The check value is one of the primary means for detecting whether two or more data are identical.

Generally, if the check values of two data or data blocks are the same, it means that the two data or data blocks are the same data or data block, but the check value will produce the same value within a certain range, that is, two Different data blocks generate the same check value. At this time, even if the data block to be stored is different from the stored target data block, but only the check values of the two are the same, the server will not be able to store the data to be stored. Blocks, which cause leakage of data or data blocks, may even cause confusion in business scenarios.

Summary of the invention

The purpose of the embodiments of the present specification is to provide a data processing method, apparatus, and device, so as to implement storage of data blocks to be stored with the same check value but different data contents.

In order to solve the above technical problem, the embodiment of the present specification is implemented as follows:

A method for processing data according to an embodiment of the present disclosure, the method includes:

Receiving a data block to be stored, and acquiring a first check value of the to-be-stored data block;

If the stored data block has a target data block whose check value matches the first check value, and the to-be-stored data block is different from the target data block, storing the to-be-stored data block, and And assigning, to the stored data block, an auxiliary query identifier different from the target data block.

Optionally, the target data block includes a plurality of different sub-data blocks, and each of the sub-data blocks is configured with a corresponding auxiliary query identifier;

After the receiving the data block to be stored and acquiring the first check value of the data block to be stored, the method further includes: if there is a check value in the stored data block that matches the first check value Determining, by the target data block, whether the data block to be stored is the same as each of the target data blocks;

And if the to-be-stored data block is the same as the first sub-block in the target data block, outputting the auxiliary query identifier of the first sub-block and the first check value.

Optionally, the storing the data block to be stored, and allocating the auxiliary query identifier different from the target data block to the to-be-stored data block, includes:

And storing the to-be-stored data block and the auxiliary query identifier of the to-be-stored data block, and the target data block and the auxiliary query identifier of the target data block in the same data block set.

Optionally, the auxiliary query identifier is a character or a character string.

Optionally, the first check value is a hash value.

Sending a data block to be stored to the server;

Receiving a storage result of the to-be-stored data block sent by the server, where the storage result is that the server has a check value in the stored data block that matches a first check value of the to-be-stored data block. A target data block is generated if the to-be-stored data block is different from the target data block.

Optionally, after the sending the data block to be stored to the server, the method further includes:

Receiving, by the server, the first check value and the target auxiliary query identifier, where the target auxiliary query identifier is a target data block whose check value matches the first check value, and the to-be-stored Auxiliary query identifier of the first sub-block of the same data block;

Sending the first check value and the target auxiliary query identifier to the risk control server.

A data processing apparatus provided by an embodiment of the present specification, the apparatus includes:

An acquiring module, configured to receive a data block to be stored, and obtain a first check value of the to-be-stored data block;

a data processing module, configured to store, if the stored data block has a target data block whose check value matches the first check value, and the to-be-stored data block is different from the target data block, A data block to be stored, and an auxiliary query identifier different from the target data block is allocated to the to-be-stored data block.

Optionally, the target data block includes a plurality of different sub-blocks, each sub-block is provided with a corresponding auxiliary query identifier, and the device further includes:

a determining module, configured to determine, if the stored data block has a target data block whose check value matches the first check value, determine the data block to be stored and each of the target data blocks Whether they are the same;

And an output module, configured to output an auxiliary query identifier of the first sub-block and the first check value if the to-be-stored data block is identical to the first sub-block in the target data block.

Optionally, the data processing module is configured to store the to-be-stored data block and the auxiliary query identifier of the to-be-stored data block, and the auxiliary data identifier of the target data block and the target data block in the same In the data block collection.

Optionally, the first check value is a hash value.

a data sending module, configured to send a data block to be stored to the server;

a result receiving module, configured to receive a storage result of the to-be-stored data block sent by the server, where the storage result is that the server has a check value and a first block of the to-be-stored data block in the stored data block The target data block whose check value matches, and the data block to be stored is generated differently from the target data block.

Optionally, the device further includes:

An information receiving module, configured to receive the first check value and the target auxiliary query identifier sent by the server, where the target auxiliary query identifier is a target data block whose check value matches the first check value And an auxiliary query identifier of the first sub-block of the same as the data block to be stored;

The information sending module is configured to send the first check value and the target auxiliary query identifier to the risk control server.

A data processing device provided by an embodiment of the present disclosure, the device includes:

Processor;

A memory arranged to store computer executable instructions that, when executed, cause the processor to perform the following operations:

Processor;

Sending a data block to be stored to the server;

As can be seen from the technical solutions provided in the foregoing embodiments, the embodiment of the present disclosure receives the data block to be stored, and obtains the first check value of the data block to be stored, and the check value and the first school are stored in the stored data block. When the target data block matches the target data block, and the data block to be stored is different from the target data block, the data block to be stored is stored, and the auxiliary data identifier of the data block to be stored is different from the target data block, so that the stored data is stored. For the target data block and the data block to be stored, when the check values of the two are the same, but the data contents of the two are different, the data block to be stored may be stored, and the data block to be stored is re-allocated and different from the target data block. Auxiliary query identifier, thereby further distinguishing two data blocks with the same check value and different data contents, thereby solving the problem that the data block to be stored with different data contents of the same check value cannot be stored in the server, thereby avoiding the business The confusion of the scene.

DRAWINGS

In order to more clearly illustrate the embodiments of the present specification or the technical solutions in the prior art, the drawings to be used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a few embodiments described in the present specification, and other drawings can be obtained from those skilled in the art without any creative work.

1 is an embodiment of a method for processing data according to the present specification;

2 is a schematic diagram of data interaction between devices in a data processing process according to the present specification;

FIG. 3 is a schematic diagram of another method for processing data according to the present specification; FIG.

4 is another embodiment of a method for processing data according to the present specification;

Figure 5 is an embodiment of a data processing apparatus of the present specification;

Figure 6 is an embodiment of another data processing apparatus of the present specification;

Figure 7 is a diagram of an embodiment of a data processing apparatus of the present specification;

Figure 8 is an embodiment of a processing device for another data of the present specification.

Detailed ways

The embodiment of the present specification provides a data processing method, device and device.

In order to make those skilled in the art better understand the technical solutions in the present specification, the technical solutions in the embodiments of the present specification will be clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the specification. The embodiments are only a part of the embodiments of the specification, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present specification without departing from the scope of the invention shall fall within the scope of the present disclosure.

Embodiment 1

As shown in FIG. 1 , the embodiment of the present disclosure provides a data processing method, where the execution body of the method may be a terminal device or a server, where the terminal device may be a mobile terminal device such as a mobile phone or a tablet computer, or may be, for example, For a terminal device such as a personal computer, the server may be a stand-alone server or a server cluster composed of multiple servers. In the embodiment of the present specification, in order to improve the processing efficiency of the data, the execution body of the method is described in detail by using a server as an example. For the case of the terminal device, the specific processing of the following server may be performed, and details are not described herein. The method may specifically include the following steps:

In step S102, the data block to be stored is received, and the first check value of the data block to be stored is obtained.

The data block to be stored may be any data block, where the data block to be stored may be composed of one or more pieces of data, such as a data block for registering a piece of data of a website, and the data block may include a user registration. User name, password and email address. The first check value may be a check value calculated by the check value algorithm to calculate data in the stored data block, and the check value algorithm may include multiple types, such as a parity check algorithm, a BCC (Block Check Character) Code verification) XOR check method, vertical redundancy check algorithm, cyclic redundancy check algorithm and data digest algorithm (or Hash algorithm).

In an implementation, the server may receive a data block to be stored sent by another device (such as a terminal device of the user or a server of the merchant, etc.), and may specifically include multiple manners, for example, when the user registers on the website, the user may pass the website. The registration option is found in the home page. After the search is found, the registration option can be clicked. At this time, the user's terminal device can obtain the registration page, and the user can input the user name and password in the registration page. After the input is completed, the OK button in the registration page can be clicked, and the terminal device can obtain the information input by the user in the registration page, and can use the obtained information as a data block to be stored, and send the to-be-stored data block to the server.

For another example, as shown in FIG. 2, after the user completes the purchase, the user checks out at the cashier, and the user pays with a payment card (such as a bank card or a shopping card, etc.), and the merchant can input the user's payment card into the cash register device. The card number and the like, the cash register device may store the input information, and may use the card number of the payment card as a data block to be stored, and send the to-be-stored data block to a server of the payment card center, and the server may receive the data block to be stored. .

A check value algorithm may be set in the server. When the server receives the data block to be stored sent by the terminal device, the check value of the data block to be stored may be calculated by using a preset check value algorithm (ie, the first check value). .

It should be noted that the processing manner of the data block to be stored by the server to be sent by other devices may include a plurality of achievable manners in addition to the above two methods, which is not limited in the embodiment of the present specification.

In step S104, if there is a target data block in the stored data block that matches the first check value, and the data block to be stored is different from the target data block, the data block to be stored is stored, and A secondary query identifier that is different from the target data block is allocated to the data block to be stored.

The auxiliary query identifier may be an auxiliary identifier according to whether the data block to be stored is a stored data block, and the auxiliary query identifier may include multiple representation forms, and the specific form of the auxiliary query identifier may be set according to actual conditions. Specifically, a numeric character string composed of one or more digits, such as 2 or 15, or the like, or a string of one or more letters, such as rl or rk, or alternatively, may be a number and A string formed by a combination of letters, such as x1 or y2. In the embodiment of the present specification, the auxiliary identifiers other than the check value specified by the auxiliary query identifier may be used in the actual application, and the auxiliary query identifier may have other different representation forms, such as a version number.

In an implementation, the check value is one of the primary means for detecting whether two or more data are identical. Generally, if the check values of two data or data blocks are the same, the two data or data are represented. Blocks are the same data or data block, but the check value will produce the same value within a certain range, that is, two different data blocks produce the same check value. After the server receives the data block to be stored, the first check value of the data block to be stored may be calculated. At this time, the check value of each data block stored in advance may be obtained, and the first check value may be separately stored. Comparing the check values of the data blocks, if the first check value is the same as the check value of one of the stored data blocks or the plurality of data blocks (ie, the target data block), based on the above content, it can be considered that the check value is to be stored. The data block should be the same as the target data block. In this case, even if the data block to be stored is different from the target data block, but only the check values of the two are the same, the server will not be able to store the data block to be stored, thereby causing data or The data block is stored in a leak, and even if the data to be stored is stored in the server by some method, finally, since the server has a plurality of different data blocks of the same check value, the server reads the first check. When the data block of the value is used, the data blocks that may be read at different times are different. For example, the data block corresponding to the first check value read by the server for the first time is the data block to be stored. A first check value corresponding to the data block is read for the second time the target data block and the like. To this end, the embodiment of the present specification provides an optional processing manner. For details, refer to the following related content:

After the server obtains the first check value of the data to be stored, the check value of each data block stored in advance may be compared with the first check value, respectively, if the stored data block includes the check value and the first If the stored data block includes the same target data as the first check value, the data content of the data block to be stored and the target data block may be respectively extracted, and The extracted data content of the data block to be stored is compared with the data content of the target data block. If the data content of the data block to be stored is different from the data content of the target data block, it may be determined that the data block to be stored has the same school as the target data block. If the data is not the same, the server can store the data block to be stored in the server and reallocate an auxiliary query identifier for the data block to be stored. In order to distinguish different data blocks having the same check value, different auxiliary query identifiers may be set for different data blocks having the same check value, so that when the server receives a new data block to be stored again, The checksum value and the auxiliary query identifier may be respectively used to determine whether the new data block to be stored is already stored in the server, that is, the check value is first used for querying, and if the check value and the stored data of the new data block to be stored are determined. If the check value of the block is the same, the data content can be compared. If the new data block to be stored is the same as one of the data blocks, it can be determined that the new data block to be stored is the same data block as the data block. Otherwise, it is a different data block, and the auxiliary query identifier can be assigned to the new data block to be stored.

For example, the data block to be stored is “CD”, the first check value is “Xfdsafdsfdlasf”, and the target data block is “AB”. If the check value of the target data block “AB” stored in the server is “Xfdsafdsfdlasf”, wait The storage data block is “CD”, and the first check value of the to-be-stored data block “CD” is calculated by the above check value algorithm to be “Xfdsafdsfdlasf”, and the to-be-stored data block has the same check value as the target data block, however, The data content of the data block to be stored is not the same as the data content of the target data block. In this case, the data block “CD” to be stored may be stored, and then the auxiliary data identifier and the target data block may be respectively assigned different auxiliary query identifiers, for example, to be stored. The auxiliary query identifier (or version number, etc.) of the data block is 1, and the auxiliary query identifier (or version number, etc.) of the target data block is 2 or the like.

As shown in FIG. 3, the embodiment of the present disclosure provides a method for processing data. The execution entity of the method may be an electronic device, and the electronic device may be a device for requesting storage of a certain data block from a server, such as a checkout counter. The electronic device or the like may be a mobile terminal device such as a mobile phone or a tablet computer, or may be a terminal device such as a personal computer. The method may specifically include the following steps:

In step S302, a data block to be stored is transmitted to the server.

In step S304, the storage result of the to-be-stored data block sent by the server is received, and the storage result is that the server has a target data block in the stored data block that has a check value matching the first check value of the to-be-stored data block, and Generated when the data block to be stored is different from the target data block.

For the specific processing of the foregoing steps S302 and S304, refer to the related content in the foregoing steps S102 and S104, and details are not described herein again.

The embodiment of the present specification provides a data processing method, by receiving a data block to be stored, and acquiring a first check value of the data block to be stored, and the check value exists in the stored data block to match the first check value. a target data block, and when the data block to be stored is different from the target data block, storing the data block to be stored, and assigning an auxiliary query identifier different from the target data block to the data block to be stored, thus, for the stored target data block and For the data block to be stored, when the check values of the two are the same, but the data contents of the two are different, the data block to be stored may be stored, and the auxiliary query identifier different from the target data block may be re-allocated for the data block to be stored. Therefore, the two data blocks having the same check value and different data contents are further distinguished, thereby solving the problem that the data block to be stored with different data contents of the same check value cannot be stored in the server, thereby avoiding confusion of the service scene.

Embodiment 2

As shown in FIG. 4, the embodiment of the present disclosure provides a data processing method, where the execution body of the method may be an electronic device and a server, where the electronic device may be a device for requesting storage of a certain data block from a server, such as The electronic device of the cash register, etc., wherein the electronic device may be a mobile terminal device such as a mobile phone or a tablet computer, or may be a terminal device such as a personal computer, and the server may be a stand-alone server or a plurality of servers. Server cluster. The method may specifically include the following steps:

In step S402, the server receives the data block to be stored, and acquires a first check value of the data block to be stored.

The first check value may be a hash value, and the check value is a hash value in the embodiment of the present specification.

For the specific processing of the foregoing step S402, refer to the related content of step S102 in the first embodiment, and details are not described herein again.

In step S404, if there is a target data block in which the check value matches the first check value in the stored data block, the server determines whether the data block to be stored is identical to each of the target data blocks.

In an implementation, the hash value may be one of the main means for detecting whether the data are identical. Generally, if the hash values of the two data or data blocks are the same, it means that the two data or data blocks are the same. Data or data blocks, however, hashes will collide within a certain range, ie two different data blocks have the same hash value. In the embodiment of the present specification, a device for processing data conflict may be set, and the device may be used to solve a service problem caused by a hash value collision. The device may be divided into two main parts, namely, device pre-processing and device processing. A data storage model is preset in the device front, and the data storage model may include three items: a character string (ie, a data block to be stored), a hash value, and a conflicting version (ie, an auxiliary query identifier).

After the server receives the data block to be stored, the device pre-position can calculate a hash value (ie, the first check value) of the data block to be stored, and at this time, obtain a hash value of each data block stored in advance. The first check value may be compared with the hash value of the stored data block respectively, and if the first check value is the same as the hash value of the stored target data block, determining the data block to be stored and the target data block Whether each sub-block is the same.

In step S406, if there is a target data block in the stored data block that matches the first check value, and the data block to be stored is different from the target data block, the server stores the data block to be stored, and waits for The storage data block is assigned an auxiliary query identifier that is different from the target data block.

The auxiliary query identifier may be a character or a string, and the characters may be numbers, letters, symbols, or characters, and the string may be composed of multiple characters, such as R12 or 5.

In an implementation, as shown in FIG. 2, after the server receives the data block to be stored, the device pre-determine can calculate a hash value (ie, a first check value) of the to-be-stored data block, and at this time, the pre-acquisition can be obtained. The stored hash value of each data block may compare the first check value with the hash value of the stored data block respectively, and if the first check value is the same as the hash value of the stored target data block, Extracting the data content of the data block to be stored and the target data block respectively, and comparing the data content of the extracted data block to be stored with the data content of the target data block, if the data content of the data block to be stored is different from the data content of the target data block, It can be determined that the data block to be stored has the same hash value as the home of the target data block, but the data content is different, the device pre-position can store the data block to be stored into the server, and reallocate a data block to be stored. Auxiliary query ID. Then, based on the example of step S104 in the first embodiment, the device front is as shown in Table 1.

Table 1

The above processing process is mainly a process that needs to be performed in the front part of the device. In an actual application, the device processing part can process any operation of querying the hash value, specifically, when re-introducing the data block to be stored, the device processes The part can detect whether the conflict data is stored in the data storage model. If not, execute the above processing process. If yes, all the data blocks with the same hash value need to be extracted, and the processing part of the device will judge one by one. , to determine whether the value of the string is the same as re-incoming the data block to be stored.

The foregoing process of storing the data block to be stored and assigning the auxiliary query identifier different from the target data block to the data block to be stored may include multiple processing manners in the actual application, and may include, in addition to the implementation manner provided by the related content, A plurality of implementable manners may be specifically as follows: storing the data block to be stored and the auxiliary query identifier of the data block to be stored, and the auxiliary query identifier of the target data block and the target data block in the same data block set.

The same data block set can be as shown in Table 1, so that the query for the above two data blocks can be comprehensively determined by the check value and the auxiliary query identifier respectively.

In step S408, if the data block to be stored is the same as the first sub data block in the target data block, the server outputs the auxiliary query identifier and the first check value of the first sub data block.

In an implementation, as shown in FIG. 2, if it is determined by comparison that the data block to be stored is the same as the first sub data block in the target data block, it may be determined that the data block to be stored is the same as the first sub data block, and in this case, The check value and the auxiliary query identifier of the first sub-block are used as the check value of the data block to be stored and the auxiliary query identifier (collided version), and the auxiliary query identifier and the first check value of the first sub-block may be output. .

In step S410, the electronic device receives a storage result of the to-be-stored data block sent by the server, where the storage result is that the server has the target data in the stored data block that the check value matches the first check value of the to-be-stored data block. A block is generated if the data block to be stored is different from the target data block.

In an implementation, as shown in FIG. 2, after the server stores the data block to be stored, and allocates the auxiliary query identifier different from the target data block for the data block to be stored, the storage result of the data block to be stored may be sent to the electronic device, The electronic device is prompted to store the data block to be stored.

In order to control the data risk that may exist in the server in time, the risk control server may be set, and the electronic device may send the check value of the to-be-stored data block and the auxiliary query identifier processed by the server to the risk control server for preparation. Managers manage and control the risks that may exist in data storage. For details, refer to the related contents of step S412 and step S414 described below.

In step S412, the electronic device receives the first check value sent by the server and the target auxiliary query identifier, where the target auxiliary query identifier is a target data block whose check value matches the first check value, and the data block to be stored. The auxiliary query identifier of the same first sub-block.

In step S414, the electronic device transmits the first check value and the target auxiliary query identifier to the risk control server.

In an implementation, as shown in FIG. 2, the electronic device may receive the first check value and the target auxiliary query identifier sent by the server, and generate wind control information by using the first check value and the target auxiliary query identifier, which may be generated. The wind control information is sent to the risk control server. Managers can use wind control information to understand even the data storage conditions in the server.

Embodiment 3

The above is the data processing method provided by the embodiment of the present specification. Based on the same idea, the embodiment of the present specification further provides a data processing device, as shown in FIG. 5 .

The processing device of the data includes: an obtaining module 501 and a data processing module 502, wherein:

The obtaining module 501 is configured to receive a data block to be stored, and obtain a first check value of the to-be-stored data block.

The data processing module 502 is configured to: if there is a target data block in the stored data block that matches the first check value, and the to-be-stored data block is different from the target data block, the storage unit The storage data block is referred to, and the auxiliary data identifier different from the target data block is allocated to the to-be-stored data block.

Optionally, in the embodiment of the present disclosure, the target data block includes a plurality of different sub-blocks, each sub-block is provided with a corresponding auxiliary query identifier, and the device further includes:

Optionally, in the embodiment of the present specification, the data processing module 502 is configured to: the to-be-stored data block and the auxiliary query identifier of the to-be-stored data block, and the target data block and the target data block. The secondary query IDs are stored in the same data block set.

Optionally, in the embodiment of the present disclosure, the auxiliary query identifier is a character or a character string.

Optionally, in the embodiment of the present disclosure, the first check value is a hash value.

The embodiment of the present specification provides a data processing apparatus, by receiving a data block to be stored, and acquiring a first check value of a data block to be stored, and the check value exists in the stored data block to match the first check value. a target data block, and when the data block to be stored is different from the target data block, storing the data block to be stored, and assigning an auxiliary query identifier different from the target data block to the data block to be stored, thus, for the stored target data block and For the data block to be stored, when the check values of the two are the same, but the data contents of the two are different, the data block to be stored may be stored, and the auxiliary query identifier different from the target data block may be re-allocated for the data block to be stored. Therefore, the two data blocks having the same check value and different data contents are further distinguished, thereby solving the problem that the data block to be stored with different data contents of the same check value cannot be stored in the server, thereby avoiding confusion of the service scene.

Embodiment 4

The above is the data processing method provided by the embodiment of the present specification. Based on the same idea, the embodiment of the present specification further provides a data processing apparatus, as shown in FIG. 6.

The data processing device includes: a data sending module 601 and a result receiving module 602, wherein:

a data sending module 601, configured to send a data block to be stored to the server;

a result receiving module 602, configured to receive a storage result of the to-be-stored data block sent by the server, where the storage result is that the server has a check value and a data block to be stored in the stored data block. A target data block whose check value matches, and the data block to be stored is generated differently from the target data block.

Optionally, in the embodiment of the present specification, the device further includes:

Embodiment 5

Based on the same idea, the embodiment of the present specification further provides a data processing device, as shown in FIG. 7.

The processing device of the data may be a server or the like provided by the above embodiment.

The processing device of the data may vary considerably depending on configuration or performance, and may include one or more processors 701 and memory 702 in which one or more storage applications or data may be stored. Among them, the memory 702 can be short-term storage or persistent storage. An application stored in memory 702 may include one or more modules (not shown), each of which may include a series of computer executable instructions in a processing device for data. Still further, processor 701 can be arranged to communicate with memory 702 to execute a series of computer executable instructions in memory 702 on a processing device of data. The data processing device may also include one or more power sources 703, one or more wired or wireless network interfaces 704, one or more input and output interfaces 705, one or more keyboards 706.

Specifically in this embodiment, the data processing device includes a memory, and one or more programs, wherein one or more programs are stored in the memory, and one or more programs may include one or more modules, and each The modules can include a series of computer executable instructions in a processing device for data, and are configured to be executed by one or more processors. The one or more programs are included for performing the following computer executable instructions:

After the receiving the to-be-stored data block and acquiring the first check value of the to-be-stored data block, the method further includes:

Determining, if the stored data block has a target data block whose check value matches the first check value, determining whether the data block to be stored is the same as each of the target data blocks;

Optionally, the first check value is a hash value.

The embodiment of the present specification provides a data processing device, by receiving a data block to be stored, and acquiring a first check value of the data block to be stored, and the check value exists in the stored data block to match the first check value. a target data block, and when the data block to be stored is different from the target data block, storing the data block to be stored, and assigning an auxiliary query identifier different from the target data block to the data block to be stored, thus, for the stored target data block and For the data block to be stored, when the check values of the two are the same, but the data contents of the two are different, the data block to be stored may be stored, and the auxiliary query identifier different from the target data block may be re-allocated for the data block to be stored. Therefore, the two data blocks having the same check value and different data contents are further distinguished, thereby solving the problem that the data block to be stored with different data contents of the same check value cannot be stored in the server, thereby avoiding confusion of the service scene.

Embodiment 6

Based on the same idea, the embodiment of the present specification further provides a data processing device, as shown in FIG. 8.

The processing device of the data may be an electronic device or the like provided by the above embodiment.

The processing device of the data may vary considerably depending on configuration or performance, and may include one or more processors 801 and memory 802 in which one or more storage applications or data may be stored. The memory 802 can be short-lived or persistent. An application stored in memory 802 may include one or more modules (not shown), each of which may include a series of computer executable instructions in a processing device for data. Still further, processor 801 can be configured to communicate with memory 802 to execute a series of computer executable instructions in memory 802 on a processing device of data. The data processing device may also include one or more power sources 803, one or more wired or wireless network interfaces 804, one or more input and output interfaces 805, one or more keyboards 806.

Sending a data block to be stored to the server;

The foregoing description of the specific embodiments of the specification has been described. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than the embodiments and still achieve the desired results. In addition, the processes depicted in the figures are not necessarily in a particular order or in a sequential order to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

In the 1990s, improvements to a technology could clearly distinguish between hardware improvements (eg, improvements to circuit structures such as diodes, transistors, switches, etc.) or software improvements (for process flow improvements). However, as technology advances, many of today's method flow improvements can be seen as direct improvements in hardware circuit architecture. Designers almost always get the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that the improvement of a method flow cannot be implemented by hardware entity modules. For example, a Programmable Logic Device (PLD) (such as a Field Programmable Gate Array (FPGA)) is an integrated circuit whose logic function is determined by the user programming the device. Designers program themselves to "integrate" a digital system on a single PLD without having to ask the chip manufacturer to design and fabricate a dedicated integrated circuit chip. Moreover, today, instead of manually making integrated circuit chips, this programming is mostly implemented using "logic compiler" software, which is similar to the software compiler used in programming development, but before compiling The original code has to be written in a specific programming language. This is called the Hardware Description Language (HDL). HDL is not the only one, but there are many kinds, such as ABEL (Advanced Boolean Expression Language). AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc., are currently the most commonly used VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog. It should also be apparent to those skilled in the art that the hardware flow for implementing the logic method flow can be easily obtained by simply programming the method flow into the integrated circuit with a few hardware description languages.

The controller can be implemented in any suitable manner, for example, the controller can take the form of, for example, a microprocessor or processor and a computer readable medium storing computer readable program code (eg, software or firmware) executable by the (micro)processor. In the form of logic gates, switches, application specific integrated circuits (ASICs), programmable logic controllers, and embedded microcontrollers, examples of controllers include, but are not limited to, the following microcontrollers: ARC625D, Atmel AT91SAM, Microchip The PIC18F26K20 and the Silicone Labs C8051F320, the memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art will also appreciate that in addition to implementing the controller in purely computer readable program code, the controller can be logically programmed by means of logic gates, switches, ASICs, programmable logic controllers, and embedding. The form of a microcontroller or the like to achieve the same function. Such a controller can therefore be considered a hardware component, and the means for implementing various functions included therein can also be considered as a structure within the hardware component. Or even a device for implementing various functions can be considered as a software module that can be both a method of implementation and a structure within a hardware component.

The system, device, module or unit illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product having a certain function. A typical implementation device is a computer. Specifically, the computer can be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or A combination of any of these devices.

For the convenience of description, the above devices are described separately by function into various units. Of course, the functions of each unit may be implemented in the same software or software and/or hardware when implementing the present application.

Those skilled in the art will appreciate that embodiments of the present specification can be provided as a method, system, or computer program product. Accordingly, the description may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment in combination of software and hardware. Moreover, the description may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The present description is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present specification. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include non-persistent memory, random access memory (RAM), and/or non-volatile memory in a computer readable medium, such as read only memory (ROM) or flash memory. Memory is an example of a computer readable medium.

Computer readable media includes both permanent and non-persistent, removable and non-removable media. Information storage can be implemented by any method or technology. The information can be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary storage of computer readable media, such as modulated data signals and carrier waves.

It is also to be understood that the terms "comprises" or "comprising" or "comprising" or any other variations are intended to encompass a non-exclusive inclusion, such that a process, method, article, Other elements not explicitly listed, or elements that are inherent to such a process, method, commodity, or equipment. An element defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device including the element.

Those skilled in the art will appreciate that embodiments of the present specification can be provided as a method, system, or computer program product. Accordingly, the description may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment in combination of software and hardware. Moreover, the description may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

This description can be described in the general context of computer-executable instructions executed by a computer, such as a program module. Generally, program modules include routines, programs, objects, components, data structures, and the like that perform particular tasks or implement particular abstract data types. The present application can also be practiced in distributed computing environments where tasks are performed by remote processing devices that are connected through a communication network. In a distributed computing environment, program modules can be located in both local and remote computer storage media including storage devices.

The various embodiments in the specification are described in a progressive manner, and the same or similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.

The above descriptions are only examples of the present specification and are not intended to limit the present specification. Various modifications and changes can be made in the present specification to those skilled in the art. Any modifications, equivalents, improvements, etc. made within the spirit and scope of the specification are intended to be included within the scope of the appended claims.

Claims

A method for processing data, characterized in that the method comprises:

Receiving a data block to be stored, and acquiring a first check value of the to-be-stored data block;

If the stored data block has a target data block whose check value matches the first check value, and the to-be-stored data block is different from the target data block, storing the to-be-stored data block, and And assigning, to the stored data block, an auxiliary query identifier different from the target data block.
The method according to claim 1, wherein the target data block includes a plurality of different sub-data blocks, and each of the sub-data blocks is provided with a corresponding auxiliary query identifier;

After the receiving the data block to be stored and acquiring the first check value of the data block to be stored, the method further includes:

Determining, if the stored data block has a target data block whose check value matches the first check value, determining whether the data block to be stored is the same as each of the target data blocks;

And if the to-be-stored data block is the same as the first sub-block in the target data block, outputting the auxiliary query identifier of the first sub-block and the first check value.
The method according to claim 2, wherein the storing the data block to be stored and assigning the auxiliary data identifier different from the target data block to the data block to be stored comprises:

And storing the to-be-stored data block and the auxiliary query identifier of the to-be-stored data block, and the target data block and the auxiliary query identifier of the target data block in the same data block set.
The method according to any one of claims 1 to 3, wherein the auxiliary query identifier is a character or a character string.
The method of claim 4 wherein said first check value is a hash value.
A method for processing data, characterized in that the method comprises:

Sending a data block to be stored to the server;

Receiving a storage result of the to-be-stored data block sent by the server, where the storage result is that the server has a check value in the stored data block that matches a first check value of the to-be-stored data block. A target data block is generated if the to-be-stored data block is different from the target data block.
The method according to claim 6, wherein after the sending the data block to be stored to the server, the method further comprises:

Receiving, by the server, the first check value and the target auxiliary query identifier, where the target auxiliary query identifier is a target data block whose check value matches the first check value, and the to-be-stored Auxiliary query identifier of the first sub-block of the same data block;

Sending the first check value and the target auxiliary query identifier to the risk control server.
A data processing device, characterized in that the device comprises:

An acquiring module, configured to receive a data block to be stored, and obtain a first check value of the to-be-stored data block;

a data processing module, configured to store, if the stored data block has a target data block whose check value matches the first check value, and the to-be-stored data block is different from the target data block, A data block to be stored, and an auxiliary query identifier different from the target data block is allocated to the to-be-stored data block.
The apparatus according to claim 8, wherein the target data block includes a plurality of different sub-blocks, each sub-block is provided with a corresponding auxiliary query identifier, and the apparatus further comprises:

a determining module, configured to determine, if the stored data block has a target data block whose check value matches the first check value, determine the data block to be stored and each of the target data blocks Whether they are the same;

And an output module, configured to output an auxiliary query identifier of the first sub-block and the first check value if the to-be-stored data block is identical to the first sub-block in the target data block.
The device according to claim 9, wherein the data processing module is configured to: the to-be-stored data block and the auxiliary query identifier of the to-be-stored data block, and the target data block and the target The auxiliary query ID of the data block is stored in the same data block set.
Apparatus according to any one of claims 8-10, wherein the auxiliary query identifier is a character or a character string.
The apparatus of claim 11 wherein said first check value is a hash value.
A data processing device, characterized in that the device comprises:

a data sending module, configured to send a data block to be stored to the server;

a result receiving module, configured to receive a storage result of the to-be-stored data block sent by the server, where the storage result is that the server has a check value and a first block of the to-be-stored data block in the stored data block The target data block whose check value matches, and the data block to be stored is generated differently from the target data block.
The device according to claim 13, wherein the device further comprises:

An information receiving module, configured to receive the first check value and the target auxiliary query identifier sent by the server, where the target auxiliary query identifier is a target data block whose check value matches the first check value And an auxiliary query identifier of the first sub-block of the same as the data block to be stored;

The information sending module is configured to send the first check value and the target auxiliary query identifier to the risk control server.
A data processing device, the device comprising:

Processor;

A memory arranged to store computer executable instructions that, when executed, cause the processor to:

Receiving a data block to be stored, and acquiring a first check value of the to-be-stored data block;

If the stored data block has a target data block whose check value matches the first check value, and the to-be-stored data block is different from the target data block, storing the to-be-stored data block, and And assigning, to the stored data block, an auxiliary query identifier different from the target data block.
A data processing device, the device comprising:

Processor;

A memory arranged to store computer executable instructions that, when executed, cause the processor to perform the following operations:

Sending a data block to be stored to the server;

Receiving a storage result of the to-be-stored data block sent by the server, where the storage result is that the server has a check value in the stored data block that matches a first check value of the to-be-stored data block. A target data block is generated if the to-be-stored data block is different from the target data block.