WO2022083190A1

WO2022083190A1 - Data downloading method and apparatus, computer device, and storage medium

Info

Publication number: WO2022083190A1
Application number: PCT/CN2021/107049
Authority: WO
Inventors: 邓利斌; 张天瑜; 张建国; 许宁
Original assignee: 深圳市广和通无线股份有限公司
Priority date: 2020-10-19
Filing date: 2021-07-19
Publication date: 2022-04-28
Also published as: CN112291317B; CN112291317A

Abstract

The present application relates to a data downloading method and apparatus, a computer device, and a storage medium. The method comprises: responding to a data downloading request, and when synchronous data corresponding to the data downloading request exists, obtaining downloaded data in the synchronous data and number of nodes corresponding to the downloaded data; comparing an actual byte length of the downloaded data according to a preset fixed byte length and the number of nodes to obtain a comparison result; determining, according to the comparison result and the downloaded data, a node of data to be downloaded; and downloading the data according to the node of the data to be downloaded. According to the present method, data processing resources in a data downloading process can be saved.

Description

Data download method, apparatus, computer equipment and storage medium

Cross-reference to related applications

This application claims the priority of the Chinese patent application entitled "Data Download Method, Apparatus, Computer Equipment and Storage Medium", filed on October 19, 2020, with application number 2020111183798, the disclosure of which is incorporated herein by reference in its entirety Applying.

technical field

The present application relates to the field of Internet technologies, and in particular, to a data downloading method, apparatus, computer equipment and storage medium.

Background technique

At present, with the rapid development of Internet technology, data download technology based on network transmission protocol is also increasingly developed. When there is a problem with network transmission, the data download solution technology of continuous data transmission is realized for subsequent data transmission recovery.

In the technology of the data download solution for resuming data transmission at a breakpoint, it is a solution for continuing to download data at the breakpoint again when the network transmission is faulty or the network is disconnected.

However, in the event of a power outage, this type of data download solution technology for resuming the data download cannot provide recovery and resume downloading of data. Since a power outage can occur at any time, it is unpredictable. Once a power outage occurs, there will be a The unavoidable problem of continuing to run on the basis of the download before the power failure leads to the need to re-download the data, resulting in a waste of data processing resources.

SUMMARY OF THE INVENTION

Based on this, it is necessary to provide a data download method, apparatus, computer device and storage medium that can save data processing resources in response to the above technical problems.

A method for downloading data, the method comprising:

In response to the data download request, when there is synchronization data corresponding to the data download request, obtain the downloaded data in the synchronization data and the number of nodes corresponding to the downloaded data;

According to the preset fixed byte length and the number of nodes, compare the actual byte length of the downloaded data, and obtain the comparison result;

According to the comparison result and the downloaded data, determine the data node to be downloaded;

Data download is performed according to the data node to be downloaded.

In one embodiment, in response to the data download request, when there is synchronization data corresponding to the data download request, acquiring the downloaded data in the synchronization data and the number of nodes corresponding to the downloaded data includes:

In response to the data download request, extract the first file for storing the downloaded data and the second file for storing the number of nodes corresponding to the downloaded data;

The downloaded data is obtained from the first file, and the number of nodes corresponding to the downloaded data is obtained from the second file.

In one embodiment, after responding to the data download request, the method further includes:

When there is no synchronization data corresponding to the data download request, data download is performed, and the obtained downloaded data and the number of nodes corresponding to the downloaded data are stored synchronously.

When there is no synchronous data corresponding to the data download request, perform data download, and create a first file for synchronously storing the downloaded data and a second file for synchronously storing the number of nodes corresponding to the downloaded data;

The downloaded data is synchronously stored in the first file according to the fixed byte length, and the number of nodes corresponding to the synchronously stored downloaded data is stored in the second file.

In one embodiment, synchronously storing the downloaded data in the first file according to a fixed byte length, and storing the number of nodes corresponding to the synchronously stored downloaded data in the second file includes:

Count the byte length of the data downloaded to the file buffer;

When the counting result reaches the fixed byte length, synchronously store the downloaded data of the fixed byte length to the first file;

When the synchronous storage of the downloaded data of the fixed byte length is completed, record the number of nodes corresponding to the downloaded data in the second file;

Clear the data in the file buffer and clear the count result to zero, and return to the step of counting the byte length of the data downloaded to the file buffer until the download is completed or the power is turned off.

In one embodiment, according to the preset fixed byte length and the number of nodes, the actual byte length of the downloaded data is compared, and the comparison result obtained includes:

Multiply the fixed byte length and the number of nodes to obtain the record byte length;

Perform byte length comparison processing between the recorded byte length and the actual byte length, and obtain a comparison result. The comparison result includes that the recorded byte length is consistent with the actual byte length or the recorded byte length is inconsistent with the actual byte length.

In one embodiment, a byte length comparison process is performed between the recorded byte length and the actual byte length, and a comparison result is obtained, and the comparison result includes that the recorded byte length is consistent with the actual byte length or the recorded byte length is the same as the actual byte length. Actual byte length inconsistencies include:

When the comparison result is that the recorded byte length is consistent with the actual byte length, according to the downloaded data, determine the data node to be downloaded;

When the comparison result is that the recorded byte length is inconsistent with the actual byte length, delete the downloaded data whose byte length is greater than the recorded byte length to obtain updated downloaded data, and determine the pending data according to the updated downloaded data. Download data nodes.

A data download device, the device includes:

The data response acquisition module is used to respond to the data download request, and when there is synchronization data corresponding to the data download request, acquire the downloaded data in the synchronization data and the number of nodes corresponding to the downloaded data;

The data comparison module is used to compare the actual byte length of the downloaded data according to the preset fixed byte length and the number of nodes, and obtain the comparison result;

The data processing module is used to determine the data node to be downloaded according to the comparison result and the downloaded data;

The data download module performs data download according to the data node to be downloaded.

A computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:

Data download is performed according to the data node to be downloaded.

A computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

Data download is performed according to the data node to be downloaded.

The above data download method, device, computer equipment and storage medium, by responding to the data download request, on the condition that there is synchronization data corresponding to the data download request, it is judged whether the download data and the number of nodes have been backed up in advance, when there is a synchronization When the data is downloaded, the synchronized downloaded data and the number of nodes corresponding to the downloaded data are obtained, and the downloaded data is stored synchronously to prevent the loss of the previously downloaded data. Based on the synchronized downloaded data and the preset number of nodes Fixed byte length, realizes the synchronous record of the byte length of the downloaded data, and compares the byte length of the downloaded data according to the preset fixed byte length and the number of nodes. The number of bytes of the downloaded data is processed, which simplifies the complex processing process of all the downloaded data, and the comparison result is obtained to verify whether the recorded byte length is consistent with the byte length of the downloaded data. According to the comparison The result and the downloaded data are used to determine the data node to be downloaded, and the data download process is performed starting from the data node to be downloaded, without re-downloading all the data, which saves data processing resources in the data download process.

Description of drawings

Fig. 1 is the application environment diagram of the data downloading method in one embodiment;

2 is a schematic flowchart of a data download method in one embodiment;

3 is a schematic flowchart of a data download method in another embodiment;

4 is a schematic flowchart of a data downloading method in another embodiment;

5 is a schematic flowchart of a data download method in yet another embodiment;

Fig. 6 is the schematic flow chart that there is no synchronization data in the data downloading method in one embodiment;

7 is a schematic flowchart of a data downloading method in another embodiment;

8 is a schematic flowchart of a data downloading method in another embodiment;

Fig. 9 is the application scene diagram of the data downloading method in one embodiment;

10 is a structural block diagram of a data downloading apparatus in one embodiment;

Figure 11 is a diagram of the internal structure of a computer device in one embodiment.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

The data downloading method provided in this application can be applied to the application environment shown in FIG. 1 . The terminal 102 responds to the data download request, and when there is synchronization data corresponding to the data download request, the terminal 102 first obtains the downloaded data in the synchronization data and the number of nodes corresponding to the downloaded data, and then according to the preset fixed bytes length and the number of nodes, the terminal 102 compares the actual byte length of the downloaded data to obtain the comparison result, then the terminal 102 determines the data node to be downloaded according to the comparison result and the downloaded data, and finally, the terminal 102 according to To download the data node, download the data. The terminal 102 may be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices.

In one embodiment, as shown in FIG. 2 , a data download method is provided, and the method is applied to the terminal in FIG. 1 as an example for description, including the following steps:

Step 202, responding to the data download request.

Wherein, the data download includes a situation in which there is synchronization data corresponding to the data download request and a situation in which there is no synchronization data corresponding to the data download request.

Specifically, the terminal will first perform network registration, that is, network registration, and ensure that the network can be activated, which is used to allocate IP (Internet Protocol, Internet Protocol) addresses, and ensuring that there is an IP address is a prerequisite for downloading. In this embodiment, , the download method can use the FTP (File Transfer Protocol, file transfer protocol) download method or the HTTP (Hyper Text Transfer Protocol, hypertext transfer protocol) download method, in other embodiments, other download methods can also be used, but not limited to It is a variety of download methods that provide download, and this program has nothing to do with the download method. When the terminal receives the data download request, it responds to the data download request. In one embodiment, the responding end of the data download request may be a user operation, or may be an automatic response download process after power off and restart, which may be but not limited to the above Response sending method. After the terminal responds to the data download request, before the data download, it will also perform detection processing to detect whether there is corresponding synchronization data.

Step 204, when there is synchronization data corresponding to the data download request, acquire the downloaded data and the number of nodes corresponding to the downloaded data in the synchronization data.

The synchronization data corresponding to the data download request includes the downloaded data and the number of nodes corresponding to the downloaded data.

Specifically, when there is synchronization data corresponding to the data download request in the permanent storage space of the terminal, the downloaded data in the synchronization data and the number of nodes corresponding to the downloaded data are acquired from the permanent storage space. In one embodiment, the permanent storage space may be hard disk storage such as Flash memory, which is a storage space that will not lose data due to power failure during the download process. non-volatile memory. When the data is stored in the storage space, it will exist permanently, and other permanent storage spaces can also be used, including but not limited to various storage spaces that provide data storage. This storage space is associated with the terminal. It should be noted that once the data is stored For writing, the Fsync function must be called to immediately synchronize from the file buffer to the file written to the Flash memory or other hard disk storage, wherein the Fsync function belongs to a synchronization function in the computer operating system.

Step 206 , compare the actual byte length of the downloaded data according to the preset fixed byte length and the number of nodes, and obtain a comparison result.

Among them, the fixed byte length is preset in advance. For example, it can be set to 10000 bytes or 20000 bytes. When it is not limited to the above byte length, only a fixed byte length needs to be set during the download process. , the number of nodes is the number of nodes corresponding to the downloaded data, and the downloaded data has the corresponding actual byte length,

Specifically, read the number of nodes corresponding to the downloaded data in the synchronization data, and multiply the fixed byte length and the number of nodes corresponding to the downloaded data according to the preset fixed byte length and the number of nodes corresponding to the downloaded data. , get the record byte length, then read the downloaded data in the synchronization data, get the corresponding actual byte length according to the downloaded data, compare the record byte length with the actual byte length, and get The comparison result includes that the recorded byte length is consistent with the actual byte length or the recorded byte length is inconsistent with the actual byte length. In this embodiment, for example, when the fixed byte length is 10000 bytes, the downloaded data If the corresponding number of nodes is 5, it can be known that the terminal has downloaded at least the number of bytes of data corresponding to the record byte length of 5*10000=50000. There are only two results for the processing. The first comparison result is that the recorded byte length is consistent with the actual byte length, and the second comparison result is that the recorded byte length is inconsistent with the actual byte length.

Step 208: Determine the data node to be downloaded according to the comparison result and the downloaded data.

The comparison result includes a first comparison result in which the recorded byte length is consistent with the actual byte length and a second comparison result in which the recorded byte length is inconsistent with the actual byte length. According to different comparison results, different data nodes to be downloaded are determined, and the data nodes to be downloaded correspond to the downloaded data.

Specifically, according to the first comparison result and the downloaded data in the synchronization data, when the comparison result is that the recorded byte length is consistent with the actual byte length, the data node to be downloaded is determined according to the downloaded data, and the data node to be downloaded is determined according to the second comparison result. For the downloaded data in the result and synchronization data, when the comparison result is that the recorded byte length is inconsistent with the actual byte length, delete the downloaded data, and delete the downloaded data whose byte length is greater than the recorded byte length. The deletion process is performed to obtain updated downloaded data, and according to the updated downloaded data, a data node to be downloaded is determined.

In step 210, data download is performed according to the data node to be downloaded.

The data nodes to be downloaded include data nodes to be downloaded corresponding to the downloaded data associated with the first comparison result and data nodes to be downloaded corresponding to the updated downloaded data associated with the second comparison result.

Specifically, through the above processing, the terminal continues to start the data download process after the data node to be downloaded based on the data node to be downloaded determined by the first comparison result, or, through the second comparison result, according to the deletion For the data node to be downloaded determined by the updated downloaded data after processing, the data download process after the data node to be downloaded continues.

In the above data download method, by responding to the data download request, on the condition that there is synchronization data corresponding to the data download request, it is judged whether the download data and the number of nodes have been backed up in advance, and when there is synchronization data, the synchronized data is obtained. The downloaded data and the number of nodes corresponding to the downloaded data are stored synchronously to prevent the loss of the previously downloaded data. Based on the number of nodes corresponding to the synchronized downloaded data and the preset fixed byte length, the The synchronous record of the byte length of the downloaded data, compares the byte length of the downloaded data according to the preset fixed byte length and the number of nodes, and compares the byte length of the downloaded data with the fixed byte length and the number of nodes. This simplifies the complex processing process of all downloaded data, and obtains the comparison result to verify whether the byte length of the record is consistent with the byte length of the downloaded data. According to the comparison result and the downloaded data, determine For the data node to be downloaded, the data download processing is performed starting from the data node to be downloaded, and there is no need to re-download all the data, which saves data processing resources in the data download process.

In one embodiment, as shown in FIG. 3 , when there is synchronization data corresponding to the data download request, the downloaded data in the synchronization data and the number of nodes corresponding to the downloaded data are acquired, that is, step 204, include:

Step 302: Extract a first file for storing the downloaded data and a second file for storing the number of nodes corresponding to the downloaded data.

Specifically, the terminal detects the number of nodes corresponding to the downloaded data in the first file and the downloaded data in the second file, and detects the number of nodes corresponding to the downloaded data in the first file and the downloaded data in the second file Whether it exists, when the number of nodes corresponding to the downloaded data in the first file and the downloaded data in the second file exists, it means that a part of the data has been downloaded before this, and the data has been backed up, and the extracted data is used to store the A first file of the downloaded data and a second file for storing the number of nodes corresponding to the downloaded data.

Step 304: Obtain the downloaded data from the first file, and obtain the number of nodes corresponding to the downloaded data from the second file.

Specifically, when the number of nodes corresponding to the downloaded data in the first file and the downloaded data in the second file exists, it means that a part of the data has been downloaded before and the data has been backed up. At this time, the terminal can When continuing the download process after power off and restart, the terminal will obtain the number of nodes corresponding to the downloaded data in the first file that has been backed up and the downloaded data in the second file.

In this embodiment, it is judged whether the download data and the number of nodes have been backed up in advance by taking the existence of synchronization data corresponding to the data download request as a condition, and when there is synchronization data, the synchronized downloaded data and the The number of nodes corresponding to the downloaded data, and by synchronously storing the downloaded data, the loss of the previously downloaded data can be prevented.

In one embodiment, as shown in FIG. 4 , step 202, after responding to the data download request, further includes:

Step 402 , when there is no synchronization data corresponding to the data download request, perform data download, and store the obtained downloaded data and the number of nodes corresponding to the downloaded data synchronously.

Specifically, after the terminal responds to the data download request, it will perform detection processing. When there is no synchronization data corresponding to the data download request, it indicates that the data has not been downloaded before. At this time, the terminal starts the download process, and the terminal downloads the data. The downloaded data and the number of nodes corresponding to the downloaded data are synchronously stored in the Flash memory or the hard disk in the file buffer. file and a second file for storing the number of nodes corresponding to the downloaded data.

In this embodiment, by synchronously storing the obtained downloaded data and the number of nodes corresponding to the downloaded data, subsequent data backup can be used to prevent data loss.

In one embodiment, as shown in FIG. 5, step 202, after responding to the data download request, further includes:

Step 502, when there is no synchronization data corresponding to the data download request, perform data download, and create a first file for synchronously storing the downloaded data and a second file for synchronously storing the number of nodes corresponding to the downloaded data;

Specifically, after the terminal responds to the data download request, it will perform detection processing. When there is no synchronization data corresponding to the data download request, it means that the data has not been downloaded before. At this time, the terminal starts the download process, the terminal starts to download the data, and A first file for storing the downloaded data and a second file for storing the number of nodes corresponding to the downloaded data are created in the permanent storage space.

Step 504: Store the downloaded data synchronously in the first file according to the fixed byte length, and store the number of nodes corresponding to the synchronously stored downloaded data in the second file.

Specifically, after creating the first file and the second file, download according to the fixed byte length. For example, if the fixed byte length of 10,000 bytes is set, it is 10,000 bytes each time. First, when downloading to 10,000 bytes, download The downloaded data corresponding to the fixed byte length of 10000, call the Faync function to synchronously store the downloaded data corresponding to the fixed byte length from the file buffer to the first file, when the downloaded data corresponding to the fixed byte length is synchronously completed , synchronously store the number of nodes corresponding to the downloaded data in the second file. After the synchronous storage is completed, the first file and the second file are both in the permanent storage space associated with the terminal, which can be written into Flash memory or other hard disk storage. middle.

In this embodiment, when there is no synchronization data corresponding to the data download request, by creating a first file for storing the downloaded data and a second file for storing the number of nodes corresponding to the downloaded data, the downloaded The data is synchronously stored in the first file according to the fixed byte length, and the number of nodes corresponding to the synchronously stored downloaded data is stored in the second file, so that the downloaded data can be backed up.

In one embodiment, as shown in FIG. 6 , the downloaded data is synchronously stored in the first file according to the fixed byte length, and the number of nodes corresponding to the synchronously stored downloaded data is stored in the second file, that is, step 502 ,include:

Step 602: Count the byte length of the data downloaded into the file buffer.

Specifically, the byte length of the data downloaded into the file cache is counted. It should be noted that the count here will not exceed the preset fixed byte length. For example, the fixed byte length is 10000 bytes. Just from 0 to 10000 bytes.

Step 604, when the counting result reaches the fixed byte length, synchronously store the downloaded data of the fixed byte length to the first file.

Specifically, when the count result reaches the fixed byte length, at this time, the Fsync function is called, and the terminal synchronously stores the downloaded data corresponding to the fixed byte length from the file buffer to the first file.

Step 606: When the synchronous storage of the downloaded data of the fixed byte length is completed, record the number of nodes corresponding to the downloaded data in the second file.

Specifically, when the terminal synchronously stores the downloaded data of the fixed byte length from the file buffer, at this time, the number of nodes corresponding to the downloaded data is recorded in the second file, for example, according to the fixed byte length of 10000 words When the fixed byte length of 10,000 bytes is reached, the downloaded data corresponding to 10,000 bytes is stored synchronously in the first file. When the number of nodes is 1, the data has been downloaded in the second file. The corresponding number of nodes is 1. If the byte length of the downloaded data in the first file is 20000 bytes, the number of nodes is 2, and the number of nodes corresponding to the downloaded data in the second file is 2.

Step 608: Clear the data in the file buffer and clear the counting result to zero, and return to the step of counting the byte length of the data downloaded into the file buffer until the download is completed or the power is turned off.

Specifically, when the byte length of the downloaded data in the file buffer reaches the fixed byte length and the synchronous storage is completed, the data in the file buffer is cleared, the counting result is cleared to zero, and a response to the download to the file buffer is returned. The step of counting the byte length of the data in the terminal will repeat the above process until the download is completed or a power failure occurs. It should be noted that the subsequent downloaded data will continue to be counted and stored synchronously, and the previously downloaded data will not be Repeat the download again. In addition, if the synchronized downloaded data is not equal to the fixed byte length during the download process, it will return to the step of counting the byte length.

In this embodiment, by synchronously storing the downloaded data, it is possible to prevent the loss of the previously downloaded data, and based on the number of nodes corresponding to the synchronized downloaded data and the preset fixed byte length, the bytes of the downloaded data can be stored. The length of the sync record.

In one embodiment, as shown in FIG. 7 , according to the preset fixed byte length and the number of nodes, the actual byte length of the downloaded data is compared to obtain a comparison result, that is, step 206, including:

Step 702: Multiply the fixed byte length and the number of nodes to obtain the record byte length.

Specifically, the preset fixed byte length is multiplied by the number of nodes corresponding to the downloaded data in the second file, and the result obtained by multiplying the data is the record byte length. For example, the preset fixed byte length is 10000 bytes, and the number of nodes corresponding to the downloaded data in the second file is 5, then the data is multiplied to 5*10000=50000, and the value of the record byte length is 50000.

Step 704, performing a byte length comparison process on the recorded byte length and the actual byte length to obtain a comparison result. The comparison result includes that the recorded byte length is consistent with the actual byte length or the recorded byte length and the actual byte length. inconsistent.

Specifically, the terminal performs a byte length comparison process between the recorded byte length obtained by multiplying the data with the actual byte length corresponding to the downloaded data in the first file, and the comparison result includes that the recorded byte length is consistent with the actual byte length Or the record byte length is inconsistent with the actual byte length. It should be noted that when the record byte length is inconsistent with the actual byte length, the actual byte length will not be less than the record byte length, because it is guaranteed during the download process. The downloaded data is synchronously completed in the first file, and after the synchronous storage in the first file is completed, the number of nodes is stored in the second file synchronously, so it is guaranteed that the actual byte length will not be less than the record byte. length.

In this embodiment, the byte length of the downloaded data is processed by fixing the byte length and the number of nodes, so as to simplify the complex processing process of all the downloaded data, and obtain a comparison result to verify that the recorded byte length is consistent with that of the downloaded data. Whether the byte length of the downloaded data is consistent.

In one embodiment, as shown in FIG. 8 , according to the comparison result and the downloaded data, determining the data node to be downloaded, that is, step 208 , includes:

Step 802, when the comparison result is that the recorded byte length is consistent with the actual byte length, determine the data node to be downloaded according to the downloaded data.

Specifically, when the comparison result is that the recorded byte length is consistent with the actual byte length, the terminal determines the node to be downloaded corresponding to the downloaded data according to the downloaded data corresponding to the actual byte length and through the downloaded data.

Step 804, when the comparison result is that the recorded byte length is inconsistent with the actual byte length, delete the downloaded data whose byte length is greater than the recorded byte length to obtain updated downloaded data, according to the updated downloaded data. to determine the data node to be downloaded.

Specifically, when the comparison result is that the recorded byte length is inconsistent with the actual byte length, the terminal will delete the downloaded data whose byte length is greater than the recorded byte length to obtain updated downloaded data. Through the updated downloaded data at this time, determine the data node to be downloaded corresponding to the updated byte length

In this embodiment, by determining the data node to be downloaded according to the comparison result and the downloaded data, and performing data download processing with the data node to be downloaded as a starting point, it is possible to save all data from downloading again, thus saving data processing in the data download process. resource.

In an application example, as shown in FIG. 9 , the present application further provides an application scenario where the above-mentioned data downloading method is applied. Specifically, the application of the data downloading method in this application scenario is as follows:

In one of the embodiments, the terminal first registers with the network to ensure that the network can be activated, the network is activated to assign an IP address, and the terminal responds to the data download request. At this time, the terminal can choose to use the FTP download method or the HTTP download method. After that, a detection process is first performed to detect whether the first file for storing the downloaded data and the second file for storing the number of nodes corresponding to the downloaded data exist.

In one of the embodiments, when the detection result is that the first file and the second file exist, the process of resuming the download after power failure is performed, and the downloaded data is obtained from the first file, and the corresponding data of the downloaded data is obtained from the second file. The number of nodes multiplies the fixed byte length and the data of the number of nodes to obtain the record byte length, compares the record byte length with the actual byte length, and obtains the comparison result. Download data, determine the data node to be downloaded, and perform data download according to the data node to be downloaded. For example, if the fixed byte length is set to 10000 bytes and the number of nodes corresponding to the downloaded data is 5, it can be known that the terminal has downloaded at least the number of bytes corresponding to the record byte length of 5*10000=50000 bytes. , the actual byte length of the downloaded data is equal to 50000 bytes or greater than 50000 bytes. When it is equal to 50000 bytes, it indicates that at the moment of power failure, the contents of the first file and the second file have been synchronized. At this time, the data node to be downloaded is determined according to the downloaded data corresponding to the length of 50000 bytes, and the subsequent data download can be performed directly. When it is greater than 50000 bytes, it indicates that when the data synchronization in the first file is completed when the power failure occurs, the power failure occurs before the corresponding number of nodes in the second file has time to be recorded. At this time, it is necessary to ensure the consistency of the number of nodes corresponding to the downloaded data in the first file and the downloaded data in the second file, delete data larger than 50,000 bytes, and continue downloading according to the data after 50,000 bytes.

In one embodiment, when the detection result is that the first file and the second file do not exist, start the download process, and create a first file for storing the downloaded data and a node number for storing the downloaded data corresponding to the data. In the second file, the byte length of the data downloaded into the file buffer is counted. When the count result reaches the fixed byte length, the downloaded data of the fixed byte length is synchronously stored in the first file. When the synchronous storage of the downloaded data of the length is completed, the number of nodes corresponding to the downloaded data is recorded in the second file, the data in the file buffer is cleared and the count result is cleared to zero, and the digital count of the data downloaded to the file buffer is returned. section length count steps until the download is complete or power is removed. For example, set the fixed byte to 10000 bytes, download according to 10000 bytes, when the data downloaded to the file buffer reaches 10000 bytes, call the Fsync function to store the downloaded data corresponding to 10000 bytes in Flash synchronously In the first file in the memory, after the synchronous storage is completed, the number of nodes is 1, and the number of nodes is recorded in the second file in the Flash memory, and so on. It should be noted that the download process must be counted and downloaded according to the fixed byte length. Two files can also be created in the file buffer to store the data downloaded to the file buffer. When the data is written to the file in the file buffer according to fixed bytes, the Fsync synchronization function must be called to immediately transfer the data to the file buffer. Write to a file in Flash memory.

In this embodiment, by responding to the data download request, it is detected whether the first file for storing the downloaded data and the second file for storing the number of nodes corresponding to the downloaded data exist, and it is judged whether the download data and the number of nodes have been checked. Pre-backup, when there is synchronized data, obtain the downloaded data in the synchronized data and the number of nodes corresponding to the downloaded data, and store the downloaded data synchronously to prevent the loss of the previously downloaded data. The number of nodes and the preset fixed byte length realizes the synchronous record of the byte length of the downloaded data. According to the preset fixed byte length and the number of nodes, the byte length of the downloaded data is compared and processed. Fixed byte length and number of nodes The byte length of the downloaded data is processed to simplify the complex processing of all downloaded data, and the comparison result is obtained to verify the byte length of the record and the byte length of the downloaded data. Whether it is consistent or not, according to the comparison result and the downloaded data, determine the data node to be downloaded, and perform data download processing with the data node to be downloaded as the starting point. When there is no synchronized data, by starting the download process, the data is synchronously stored in real time to achieve data backup processing. The download process of resumed download after power failure in the above embodiment realizes that after the power outage is restarted, the download can be resumed. In the existing resumed download after the power outage, because there is no data backup after the power outage, the sudden power failure causes the cached data. If the file disappears, it needs to be downloaded again. In this solution, the first file and the second file are backed up by starting the download process. After the power is turned off, the effect of continuing the download of the data node to be downloaded can be achieved, and there is no need to redo all the data. Downloading saves data processing resources in the data downloading process.

It should be understood that, although the steps in the flowcharts in the above-mentioned embodiments are sequentially displayed according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited to the order, and these steps may be performed in other orders. Moreover, at least a part of the steps in each flowchart may include multiple steps or multiple stages, these steps or stages are not necessarily executed at the same time, but may be executed at different times, and the execution sequence of these steps or stages is also It does not have to be performed sequentially, but may be performed alternately or alternately with other steps or at least a portion of the steps or stages within the other steps.

In one embodiment, as shown in FIG. 10, a data downloading apparatus is provided, including: a data response acquisition module 1002, a data comparison module 1004, a data processing module 1006 and a data downloading module 1008, wherein:

The data response acquisition module 1002 is used to respond to the data download request, and when there is synchronization data corresponding to the data download request, acquire the downloaded data in the synchronization data and the number of nodes corresponding to the downloaded data;

The data comparison module 1004 is configured to perform comparison processing on the actual byte length of the downloaded data according to the preset fixed byte length and the number of nodes, to obtain a comparison result;

The data processing module 1006 is configured to determine the data node to be downloaded according to the comparison result and the downloaded data;

The data download module 1008 is configured to download data according to the data node to be downloaded.

In one embodiment, the data response obtaining module is further configured to, in response to the data download request, extract a first file for storing the downloaded data and a second file for storing the number of nodes corresponding to the downloaded data; from the first file The downloaded data is obtained from the second file, and the number of nodes corresponding to the downloaded data is obtained from the second file.

In one of the embodiments, after responding to the data download request, the data response acquisition module is further configured to create a first file for storing the downloaded data and a first file for storing the downloaded data when there is no synchronization data corresponding to the data download request. The second file of the number of nodes corresponding to the data.

In one embodiment, the data response obtaining module is further configured to create a first file for storing the downloaded data and a first file for storing the number of nodes corresponding to the downloaded data when there is no synchronization data corresponding to the data download request. Second file. The data response acquisition module is further configured to synchronously store the downloaded data in the first file according to the fixed byte length, and store the number of nodes corresponding to the synchronously stored downloaded data in the second file.

In one embodiment, the data response acquisition module is used to count the byte length of the data downloaded into the file buffer; when the counting result reaches the fixed byte length, the downloaded data of the fixed byte length is synchronously stored in the file buffer. The first file; when the synchronous storage of the downloaded data of the fixed byte length is completed, record the number of nodes corresponding to the downloaded data in the second file; clear the data in the file buffer and clear the count result, and return to the downloaded data. Steps to count byte lengths to the data in the file buffer until the download is complete or power is removed.

In one of the embodiments, the data comparison module is used to multiply data by the fixed byte length and the number of nodes to obtain the record byte length; perform byte length comparison processing on the record byte length and the actual byte length, A comparison result is obtained, and the comparison result includes that the recorded byte length is consistent with the actual byte length or the recorded byte length is inconsistent with the actual byte length.

In one embodiment, the data processing module is configured to determine the data node to be downloaded according to the downloaded data when the comparison result is that the recorded byte length is consistent with the actual byte length; when the comparison result is that the recorded byte length is the same as the actual byte length When the actual byte length is inconsistent, delete the downloaded data whose byte length is greater than the recorded byte length to obtain updated downloaded data, and determine the data node to be downloaded according to the updated downloaded data.

For the specific limitation of the data downloading apparatus, reference may be made to the above limitation on the method of the data downloading apparatus, which will not be repeated here. Each module in the above-mentioned data downloading apparatus may be implemented in whole or in part by software, hardware and combinations thereof. The above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

In one embodiment, a computer device is provided, and the computer device may be a terminal, and its internal structure diagram may be as shown in FIG. 11 . The computer equipment includes a processor, memory, a communication interface, a display screen, and an input device connected by a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium, an internal memory. The nonvolatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the execution of the operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for wired or wireless communication with an external terminal, and the wireless communication can be realized by WIFI, operator network, NFC (Near Field Communication) or other technologies. The computer program, when executed by the processor, implements a data downloading method. The display screen of the computer equipment may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment may be a touch layer covered on the display screen, or a button, a trackball or a touchpad set on the shell of the computer equipment , or an external keyboard, trackpad, or mouse.

Those skilled in the art can understand that the structure shown in FIG. 11 is only a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer equipment to which the solution of the present application is applied. Include more or fewer components than shown in the figures, or combine certain components, or have a different arrangement of components.

In one embodiment, a computer device is provided, including a memory and a processor, a computer program is stored in the memory, and the processor implements the following steps when executing the computer program:

According to the preset fixed byte length and the number of nodes, compare the actual byte length of the downloaded data to obtain the comparison result;

Data download is performed according to the data node to be downloaded.

In one embodiment, the processor further implements the following steps when executing the computer program:

In response to the data download request, extract a first file for storing the downloaded data and a second file for storing the number of nodes corresponding to the downloaded data; obtain the downloaded data from the first file, and obtain the downloaded data from the second file The number of nodes corresponding to the data.

When there is no synchronous data corresponding to the data download request, data download is performed, and a first file for synchronously storing the downloaded data and a second file for synchronously storing the number of nodes corresponding to the downloaded data are created. The downloaded data is synchronously stored in the first file according to the fixed byte length, and the number of nodes corresponding to the synchronously stored downloaded data is stored in the second file.

Count the byte length of the data downloaded to the file buffer; when the counting result reaches the fixed byte length, store the downloaded data of the fixed byte length to the first file synchronously; when the fixed byte length has been downloaded When the data synchronization storage is completed, record the number of nodes corresponding to the downloaded data in the second file; clear the data in the file buffer and clear the count result, and return the byte length count of the data downloaded to the file buffer. steps until the download is complete or the power is turned off.

Multiply the fixed byte length and the number of nodes to obtain the record byte length; compare the record byte length with the actual byte length to obtain the comparison result, which includes the record byte length It is consistent with the actual byte length or the recorded byte length is inconsistent with the actual byte length.

When the comparison result is that the recorded byte length is consistent with the actual byte length, the data node to be downloaded is determined according to the downloaded data; when the comparison result is that the recorded byte length is inconsistent with the actual byte length, the byte length is greater than The downloaded data with the recorded byte length is deleted to obtain updated downloaded data, and a data node to be downloaded is determined according to the updated downloaded data.

In one embodiment, a computer-readable storage medium is provided on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

Data download is performed according to the data node to be downloaded.

In one embodiment, the computer program further implements the following steps when executed by the processor:

Count the byte length of the data downloaded to the file buffer; when the counting result reaches the fixed byte length, store the downloaded data of the fixed byte length synchronously to the first file; when the fixed byte length has been downloaded When the data synchronization storage is completed, record the number of nodes corresponding to the downloaded data in the second file; clear the data in the file buffer and clear the count result, and return the byte length count of the data downloaded to the file buffer. steps until the download is complete or the power is turned off.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage In the medium, when the computer program is executed, it may include the processes of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database or other media used in the various embodiments provided in this application may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory, or optical memory, and the like. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, the RAM can be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM).

The technical features of the above embodiments can be combined arbitrarily. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features It is considered to be the range described in this specification.

The above-mentioned embodiments only represent several embodiments of the present application, and the descriptions thereof are specific and detailed, but should not be construed as a limitation on the scope of the invention patent. It should be pointed out that for those skilled in the art, without departing from the concept of the present application, several modifications and improvements can be made, which all belong to the protection scope of the present application. Therefore, the scope of protection of the patent of the present application shall be subject to the appended claims.

Claims

A data download method, comprising:

In response to the data download request, when there is synchronization data corresponding to the data download request, obtain the downloaded data in the synchronization data and the number of nodes corresponding to the downloaded data;

According to the preset fixed byte length and the number of nodes, compare the actual byte length of the downloaded data to obtain a comparison result;

According to the comparison result and the downloaded data, determine the data node to be downloaded;

Data download is performed according to the data node to be downloaded.
The method according to claim 1, wherein, in the response to the data download request, when there is synchronization data corresponding to the data download request, the downloaded data in the synchronization data and the corresponding data of the downloaded data are acquired. The number of nodes includes:

In response to the data download request, extracting a first file for storing the downloaded data and a second file for storing the number of nodes corresponding to the downloaded data;

The downloaded data is obtained from the first file, and the number of nodes corresponding to the downloaded data is obtained from the second file.
The method of claim 1, further comprising: after said responding to the data download request,

When there is no synchronization data corresponding to the data download request, data download is performed, and the obtained downloaded data and the number of nodes corresponding to the downloaded data are stored synchronously.
The method of claim 1, further comprising: after said responding to the data download request,

When there is no synchronous data corresponding to the data download request, perform data download, and create a first file for synchronously storing the downloaded data and a first file for synchronously storing the number of nodes corresponding to the downloaded data. two documents;

The downloaded data is synchronously stored in the first file according to the fixed byte length, and the number of nodes corresponding to the synchronously stored downloaded data is stored in the second file.
The method according to claim 4, wherein the synchronously storing the downloaded data in the first file according to a fixed byte length, and storing the number of nodes corresponding to the synchronously stored downloaded data in the second file comprises:

Count the byte length of the data downloaded to the file buffer;

When the counting result reaches the fixed byte length, synchronously storing the downloaded data of the fixed byte length to the first file;

When the synchronous storage of the downloaded data of the fixed byte length is completed, record the number of nodes corresponding to the downloaded data in the second file;

Clear the data in the file buffer and clear the count result to zero, and return to the step of counting the byte length of the data downloaded into the file buffer until the download is completed or the power is turned off.
The method according to claim 1, wherein the comparing the actual byte length of the downloaded data according to the preset fixed byte length and the number of nodes, and obtaining a comparison result comprises:

Multiply data by the fixed byte length and the number of nodes to obtain the record byte length;

Perform a byte length comparison process on the recorded byte length and the actual byte length to obtain a comparison result, where the comparison result includes that the recorded byte length is consistent with the actual byte length or the The recorded byte length is inconsistent with the actual byte length.
The method according to claim 6, wherein the determining the data node to be downloaded according to the comparison result and the downloaded data comprises:

When the comparison result is that the recorded byte length is consistent with the actual byte length, determine the data node to be downloaded according to the downloaded data;

When the comparison result is that the recorded byte length is inconsistent with the actual byte length, delete the downloaded data whose byte length is greater than the recorded byte length to obtain updated downloaded data , and determine the data node to be downloaded according to the updated downloaded data.
The method of claim 1, further comprising: after responding to the data download request and before the data download, detecting whether there is synchronization data corresponding to the data download request.
The method of claim 8, wherein the synchronization data corresponding to the data download request includes the downloaded data and the number of nodes corresponding to the downloaded data.
The method according to claim 1, wherein the comparison result comprises a first comparison result in which the recorded byte length is consistent with the actual byte length and a second comparison result in which the recorded byte length is inconsistent with the actual byte length ;

The method further includes: determining different data nodes to be downloaded according to different comparison results;

The node of the data to be downloaded corresponds to the downloaded data.
The method according to claim 4, further comprising: after creating the first file and the second file, performing data download according to a fixed byte length.
A data download device, comprising:

a data response acquisition module, configured to respond to the data download request, when there is synchronization data corresponding to the data download request, acquire the downloaded data in the synchronization data and the number of nodes corresponding to the downloaded data;

a data comparison module, configured to perform a comparison process on the actual byte length of the downloaded data according to a preset fixed byte length and the number of nodes to obtain a comparison result;

a data processing module, configured to determine a data node to be downloaded according to the comparison result and the downloaded data;

A data download module, configured to download data according to the data node to be downloaded.
A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor, when executing the computer program, implements the steps of the method of any one of claims 1 to 11.
A computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the method of any one of claims 1 to 11.