JPH0498551A - Data sweep-out system - Google Patents

Abstract

PURPOSE:To prevent the system down caused by the shortage of read memory buffers by storing the data arrived first in a memory with an information proces sor requiring the accurate processing sequence. CONSTITUTION:The data A4 - A7 which are generated from the same generator in the later order of generation are swept out to an external storage device EM 6. Meanwhile the data A1 - A3 generated in the earlier order of generation remain in a memory buffer MB 3. Therefore a data processing part 4 can process the data A1 - A3 stored in the MB 3 with no read operation required from the EM 6. Furthermore the data A4 - A7 stored in the EM 6 can be read into the unused MB 3 while the data A1 - A3 are processed. At the same time, the MB 3 used for the data A1 - A3 is released when these data are processed even if no unused buffer is available. Thus the MB 3 is available as a buffer that reads the data A4 - A7 stored in the EM 6.

Description

DETAILED DESCRIPTION OF THE INVENTION [Field of Industrial Application] The present invention relates to a data flushing method for flushing data on a memory to an external storage device.

[Conventional technology]

A data management method for processing data that occurs at irregular times uses a buffer in memory to receive and receive the generated data, and a buffer in an external storage device that is used when the buffer is insufficient. The method is traditionally used.

Also, as a method for flushing data from the memory buffer to an external storage device, old data generated from among the data on the memory buffer is flushed out to the external storage device one by one.
A method was adopted in which the memory buffer that had been flushed out was used for other new data.

FIG. 3 shows the relationship of data existing on an external storage device of a conventional memory buffer.

In the conventional system, there is no serial number assigned to each generation source. The numbers in the figure are added for convenience of explanation and indicate the serial numbers arrived from the data generation section. Here, the number 1 indicates the earliest data on a first-come, first-served basis, and the number 10 indicates the latest data. Also, the data shown in numbers 1 to 6, which are first come, first served, are being flushed out to the external storage device. This is because the number of used memory buffers has reached the flushing starting point on the memory buffer. , indicates that the data numbers 1 to 6 that previously existed on the memory buffer have been flushed out to the external storage device. Note that if the external storage device is full and cannot be flushed out, the memory buffer after the flushing starting point is used for data reception.

In this way, since the first-arriving data is first flushed out to the external storage device, when the data processing unit 4 performs data processing, the data to be processed first exists on the external storage device, so the external storage device is A read operation is required.

[Problem to be solved by the invention]

The conventional method of sequentially flushing old data from the memory buffer to an external storage device as described above has the following problems because it is necessary to process the data that arrives first.

(1) Since the probability that the first arriving data will be flushed out to the external storage device increases, the data processing delay time due to reading from the external storage device increases accordingly.

(2) When a large amount of data is generated and the memory buffer and external storage device become full, it is necessary to read the data from the external storage device in order to process the first arriving data, but the memory buffer for reading it is also full and cannot be used. As a result, the system ended up going down.

[Means to solve the problem]

The present invention relates to a data sweeping method in an information processing device, which includes a data generation unit that generates data irregularly and adds information indicating the generation source of the data to the data, and a plurality of data generation units each having a predetermined size as a unit. a memory buffer section composed of a memory buffer; an external storage device that holds the data overflowing from the memory buffer section; and one unused buffer secured from the memory buffer section, and the data generation section in the buffer. a data receiving unit that receives data generated from the data, adds a serial number assigned to each generation source of the data to the received data, and causes the memory buffer unit to wait until the data processing unit processes the data; an external storage purge section that purges the data received after the point in time to the external storage device when the number of unused buffers in the memory buffer reaches a specified value determined by the system; and the same occurrence on the memory buffer section. The original data is processed in the order of the smallest number, and the memory buffer in which the data has been processed is released as the unused buffer, and the data on the memory buffer section is flushed out to the external storage device. The present invention is characterized by comprising a data processing unit that reads data of successive older numbers into the unused buffer.

〔Example〕

Next, the present invention will be explained with reference to the drawings.

FIG. 1 is a block diagram showing an embodiment of the data sweeping method of the present invention.

The data generation unit 1 is a part where data is generated irregularly, and if we take an online system as an example, it corresponds to the part that receives messages from a terminal device or business program and sends the data to the control side that processes the messages. .

The data generated from the data generation section 1 is appended with information indicating the data generation source. This information corresponds to the terminal device name if the data is generated from a terminal device, and the business program name if the data is generated from a business program.

When such data is generated from the data generating section 1, the data receiving section 2 secures one unused buffer of a certain size from the memory buffer section 3, and transfers the data generated from the data generating section 1 to that buffer. is received, a serial number assigned for each generation source is added to the received data, and the memory buffer section 3 is made to wait until the data processing section 4 processes it.

Furthermore, when the data that has been kept waiting in the memory buffer unit 3 is no longer needed due to the completion of processing by the data processing unit 4, the memory buffer used by this data is released, and from now on, this memory buffer is generated from other data generation units 1. It is used to receive data.

When there is a large amount of data generated from the data generation section 1 and the number of unused buffers in the memory buffer reaches a certain specified value determined by the system, the external memory sweep comparison section 5 is activated, and the data received thereafter is stored in the external memory. It is swept out into the device 6.

This includes transactions generated from terminal devices and terminal messages generated from business programs.
When strict orderliness of processing is required for each data generation, by allowing the first arriving data from the same source to exist in the memory buffer as much as possible, data from the external storage device 6 that causes processing delays can be removed. This is to eliminate the need for a data read operation.

The remaining memory buffers after the specified value are used when there is no unused buffer for receiving data generated from the subsequent data generator 1.

The above description will be explained using FIG. 2. FIG. 2 shows the relationship of data existing on the external storage device of the memory buffer.

Information A1 to A7 in FIG. 2 indicates a serial number for each data source by A indicating the data source and numbers 1 to 7 indicating the order of generation. For example, it may be assumed that a series of data generated from terminal name A are numbered in the order of occurrence.

As can be seen from this figure, data A4 to A7, which are from the same source and occur later in the order of occurrence, are flushed out to the external storage device 6, while data A1 to A3, which are earlier in the order of occurrence, exist on the memory buffer. Therefore, when the data processing unit 4 performs data processing, A1 to A1 existing in the memory buffer in the earliest order of occurrence without reading from the external storage device.
3 data can be processed immediately.

Further, while data A1 to A3 is being processed, data A4 to A7 existing on the external storage device can be read into an unused memory buffer in parallel.

Furthermore, even if there are no unused buffers, once the data from A1 to A3 has been processed, those A1
Since the memory buffer used for A3 is released, it can be used as a buffer for reading data from A4 to A7 that exists on the external storage device.6Unlike in the conventional method, there is no unused buffer. There is no chance that the system will go down.

〔Effect of the invention〕

As explained above, according to the present invention, in an information processing device that must accurately maintain the order of processing, by making the data that arrives first exist in memory, it is possible to It is possible to prevent system downtime due to processing delays, closing, or lack of read memory buffer.

[Brief explanation of drawings]

FIG. 1 is a block diagram showing an embodiment of the data flushing method of the present invention, FIG. 2 is a diagram showing the relationship between data existing on an external storage device of a memory buffer, and FIG. FIG. 3 is a diagram showing the relationship between data existing on a storage device. 1...Data generating section, 2...Data receiving section, 3...
-Memory buffer unit, 4...Data processing unit, 5...External memory purging unit,...External storage device.

Claims (1)

[Claims] A data flushing method in an information processing device consists of a data generation unit that randomly generates data and adds information indicating the source of the data to the data, and a plurality of memory buffers each having a predetermined size as a unit. a memory buffer section for storing data generated from the data generation section; an external storage device for holding the data overflowing from the memory buffer section; and one unused buffer secured from the memory buffer section to store the data generated from the data generation section in the buffer. receive and
a data receiving unit that adds a serial number assigned to each generation source of the data to the received data and causes the memory buffer unit to wait until the data processing unit processes the data; and the number of unused buffers in the memory buffer. an external storage purge section that purges the data received after the point in time to the external storage device when the data reaches a specified value determined by the system; At the same time, the memory buffer after the processing of the data is released and becomes the unused buffer, and the data with the highest number consecutive to the data on the memory buffer section is flushed out to the external storage device. The data flushing method is characterized by comprising a data processing unit that performs read processing on the unused buffer.