JP6885135B2 - Image processing equipment and programs - Google Patents

Description

The present invention relates to an image processing apparatus and a program.

For example, in Patent Document 1, a bus 23 for transmitting image data and a bus 23 connected to the bus 23, image data is acquired from the bus 23, the image is rotated 90 degrees or −90 degrees, and the image data after image rotation is obtained. The first image rotation circuit 19g1 that outputs to the bus 23 and the first image rotation circuit 19g1 that is connected to the bus 23 have a lower priority for using the bus than the first image rotation circuit 19g1, and the image data is acquired from the bus 23 and the image is 90 degrees or -90. Either the second image rotation circuit 19g2 that rotates the image and outputs the image data after the image rotation to the bus 23, or the first image rotation circuit 19g1 or the second image rotation circuit 19g2 that corresponds to the type of job that involves image rotation. On the other hand, an image processing apparatus including a control circuit 2 for executing image rotation processing is disclosed.

Japanese Patent No. 5186432

When performing image processing on image data, the orientation of the image data may be changed by rotation or the like. In such a case, if the input image of a predetermined processing unit is scanned in the main scanning direction regardless of whether or not the orientation of the image data is changed and the image processing is started, the image data is accumulated. It takes time, and the start of image processing may be delayed.
An object of the present invention is to perform image processing in comparison with a configuration in which an input image of a predetermined processing unit is scanned in a main scanning direction and image processing is executed regardless of whether or not the orientation of the image data is changed. The purpose is to shorten the time to complete.

The invention according to claim 1 is an image acquisition means for acquiring image data obtained by reading an image in line units along the main scanning direction over the sub-scanning direction, and the image acquisition means. The orientation changing means for changing the orientation of the image data and the image processing of the image data acquired by the image acquisition means are sequentially performed for each of the image data in a predetermined processing unit, and the orientation changing means. When the change is made by the above, the image processing means is provided with an image processing means for changing the processing unit of the image processing to a unit different from the predetermined processing unit, and the image processing means can execute the image processing. the minimum unit and based on a processing unit of image data by the preceding processing of the image processing of the image data, an image processing apparatus you and changes a processing unit of the image processing.
According to the second aspect of the present invention, when the predetermined processing unit is one or a plurality of line units, the image processing means sets the processing unit of the image processing to the one or a plurality of line units. The image processing apparatus according to claim 1 , wherein the image processing apparatus is changed to a smaller unit.
In the invention according to claim 3 , the image processing means performs the image processing along a predetermined direction, and when the change is performed by the orientation changing means, the image data by the image processing. The image processing apparatus according to claim 1 or 2 , wherein the processing direction of the above is changed to a direction different from the predetermined direction.
The invention according to claim 4 is characterized in that the image processing means changes the processing direction of the image data by the image processing based on the processing direction of the image data by the processing in the previous stage of the image processing. The image processing apparatus according to claim 3.
In the invention according to claim 5 , the image processing means sets the processing direction of the image data by the image processing in accordance with the direction in which the image data of the processing unit by the processing in the previous stage of the image processing is written in the memory. The image processing apparatus according to claim 4 , wherein the image processing apparatus is changed.
According to the sixth aspect of the present invention, the image processing means sequentially performs the image processing from a predetermined start position, and when the change by the orientation changing means is performed, the start position of the image processing is set. The image processing apparatus according to any one of claims 1 to 5 , wherein the image processing apparatus is changed to a position different from the predetermined start position.
According to the invention of claim 7 , the image processing means changes the start position of the image processing based on the position of the memory in which the writing of the image data is started by the processing in the previous stage of the image processing. The image processing apparatus according to claim 6, which is a feature.
The invention according to claim 8 has a function of acquiring image data obtained by reading an image in line units along a main scanning direction in a sub-scanning direction on a computer, and the image to be acquired. The function of changing the orientation of the data and the image processing of the acquired image data are sequentially performed for each of the image data in a predetermined processing unit, and when the change is made, the image processing is executed. A function to change the processing unit of the image processing to a unit different from the predetermined processing unit based on the minimum possible unit of the image data and the processing unit of the image data by the processing in the previous stage of the image processing. It is a program to realize it.

According to the invention of claim 1, the input image of a predetermined processing unit is scanned in the main scanning direction regardless of whether or not the orientation of the image data is changed, and compared with a configuration in which image processing is executed. , It is possible to shorten the time until the image processing is completed.
According to the invention of claim 2, the time required to complete the image processing is longer than that of the configuration in which the image processing is executed in units of one or a plurality of lines regardless of whether or not the orientation of the image data is changed. The possibility of shortening can be increased.
According to the invention of claim 3, the input image of the predetermined processing unit is scanned in the main scanning direction regardless of whether or not the orientation of the image data is changed, and compared with the configuration in which the image processing is executed. Furthermore, it is possible to increase the possibility of shortening the time required to complete the image processing.
According to the invention of claim 4, it is possible to increase the possibility of shortening the time until the image processing is completed, as compared with the configuration in which the processing direction of the image data by the processing in the previous stage is not considered.
According to the invention of claim 5, it is possible to increase the possibility of more reliably shortening the time until the image processing is completed, as compared with the configuration in which the processing direction of the image data by the processing in the previous stage is not considered. ..
According to the invention of claim 6 , the input image is scanned in the main scanning direction from a predetermined start position regardless of whether or not the orientation of the image data is changed, and compared with a configuration in which image processing is executed. , It is possible to increase the possibility of shortening the time until the image processing is completed.
According to the invention of claim 7, it is possible to increase the possibility of shortening the time until the image processing is completed, as compared with the configuration in which the writing start position of the image data by the previous stage processing is not considered.
According to the invention of claim 8, the input image of the predetermined processing unit is scanned in the main scanning direction regardless of whether or not the direction of the image data is changed, and compared with the configuration in which the image processing is executed. , The function of shortening the time until the image processing is completed can be realized by the computer.

It is a figure which shows the hardware configuration example of the image processing apparatus which concerns on this embodiment. It is a block diagram which showed the functional structure example of the image processing apparatus which concerns on this embodiment. (A) and (b) are diagrams for explaining an example of the conventional flow of processing. FIG. 3C is a diagram for explaining an example of a processing flow by the image processing apparatus according to the present embodiment. It is a figure for demonstrating the conventional process shown in FIG. 3 (b). It is a figure for demonstrating the processing by the image processing apparatus which concerns on this Embodiment. FIG. 3A is a diagram showing a specific example of the conventional process shown in FIG. 3B. FIG. (B) is a diagram showing a specific example of processing by the image processing apparatus according to the present embodiment. FIG. 3A is a diagram showing a specific example of the conventional process shown in FIG. 3B. FIG. (B) is a diagram showing a specific example of processing by the image processing apparatus according to the present embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

<Hardware configuration of image processing device>
First, the hardware configuration of the image processing device 100 according to the present embodiment will be described. FIG. 1 is a diagram showing a hardware configuration example of the image processing device 100 according to the present embodiment. The image processing device 100 according to the present embodiment is provided with various image processing functions such as an image reading function (scan function), a printing function (printer function), a copying function (copy function), and a facsimile function, so-called. It is a multifunction device.

As shown in the figure, the image processing device 100 according to the present embodiment includes a control unit 110, an HDD (Hard Disk Drive) 120, an operation panel 130, an image reading unit 140, an image forming unit 150, and a communication interface. (Hereinafter referred to as "communication I / F") 160 is provided. Each of these functional units is connected to a bus 170, and data is exchanged via the bus 170.

The control unit 110 controls the operation of each unit of the image processing device 100. The control unit 110 includes a CPU (Central Processing Unit) 110a, a RAM (Random Access Memory) 110b, and a ROM (Read Only Memory) 110c.
The CPU 110a realizes each function in the image processing device 100 by loading and executing various programs stored in the ROM 110c or the like in the RAM 110b. The RAM 110b is a memory (storage unit) used as a working memory or the like of the CPU 110a. The ROM 110c is a memory (storage unit) that stores various programs and the like executed by the CPU 110a.
In this embodiment, the RAM 110b is used as an example of the holding means.

The HDD 120 is a storage unit that stores various types of data. The HDD 120 stores, for example, image data received from the outside by the communication I / F 160.

The operation panel 130 displays various information and accepts operations from the user to perform operations using various functions. As the operation panel 130, for example, a touch panel display can be exemplified.

The image reading unit 140 reads an image formed on a recording material (manuscript) such as paper, and generates image data (image information) indicating the read image. Here, the image reading unit 140 is, for example, a scanner, and a CCD method in which the reflected light with respect to the light radiated from the light source to the document is reduced by a lens and received by a CCD (Charge Coupled Devices), or the LED light source irradiates the document in order. It is preferable to use a CIS type that receives the reflected light with respect to the light generated by the CIS (Contact Image Sensor).

More specifically, the image reading unit 140 reads the original in units of the main scanning direction orthogonal to the moving direction (sub-scanning direction) of the image sensor, and generates image data. In other words, the image reading unit 140 generates image data by reading an image in line units along the main scanning direction over the sub-scanning direction.

The image forming unit 150 is a printing mechanism that forms an image on a recording material such as paper. Here, the image forming unit 150 is, for example, a printer, and forms an image by an electrophotographic method in which toner attached to a photoconductor is transferred to a recording material to form an image or by ejecting ink onto the recording material. It is preferable to use an inkjet method.

The communication I / F 160 is a communication interface for transmitting and receiving various data to and from other devices via a network (not shown).

Then, in the image processing device 100, under the control of the control unit 110, the scanning function is realized by the image reading unit 140, the printer function is realized by the image forming unit 150, and the image reading unit 140 and the image forming unit 150 copy. The function is realized, and the facsimile function is realized by the image reading unit 140, the image forming unit 150, and the communication I / F 160.

<Functional configuration of image processing device>
Next, the functional configuration of the image processing device 100 according to the present embodiment will be described. FIG. 2 is a block diagram showing a functional configuration example of the image processing device 100 according to the present embodiment. The image processing device 100 according to the present embodiment includes an image data acquisition unit 101, an image processing order determination unit 102, an image processing direction determination unit 103, a minimum unit information storage unit 104, and an image processing unit determination unit 105. The image processing unit 106 and the image processing control unit 107 are provided.

The image data acquisition unit 101 acquires the image data generated by the image reading unit 140 reading the image on the document.

The image processing unit 106 executes various image processing on the image data. In each image processing, the processed image data is sequentially written (stored) in the memory (RAM 110b). Here, the image processing executed by the image processing unit 106 is classified into five types: first processing, rotation processing, enlargement processing, second processing, and third processing. After all the image processing by the image processing unit 106 is completed, printing is performed by, for example, the image forming unit 150.

The first process is a process performed before the rotation process and the enlargement process. For example, a character edge detection process, a filter process, a color conversion process, and the like are performed on the image data. In the color conversion process here, for example, the image data in the RGB color space (24 bits) is converted into the image data in the Lab color space (24 bits). The character edge detection process and the filter process are processes performed by referring to a plurality of lines, and as the number of pixels in one line increases, the capacity of the line memory increases accordingly.

The second process is a process performed after the rotation process and the enlargement process. For example, gamma correction, halftone process, color conversion process, gradation correction process, and the like are performed on the image data. In the color conversion process here, for example, the image data in the Lab color space (24 bits) is converted into the image data in the CMYK color space (32 bits).

In the third process, an error diffusion process (hereinafter, referred to as an ED (Error Diffusion) process) or the like is performed. In the ED process, since it is necessary to propagate the error to the peripheral pixel positions, it is necessary to continuously process the page width in the main scanning direction.

The enlargement process is a process of enlarging the image data according to the orientation of the image. The rotation process is a process of rotating the image data (a process of changing the direction of the image data) according to the direction of the image, for example, in units of 90 degrees or at a minute angle to correct the inclination of the image. Further, in the rotation process, the vertical / horizontal conversion of the image is performed by changing the direction of reading the image data before rotation from the memory and the direction of writing the image data after rotation to the memory.

As an example, when printing an A4 horizontal image on A3 vertical paper, the image reading unit 140 inputs the image in line units for the first processing, and the first processing is also performed in line units or band units. It is said. Then, by performing the rotation process and the enlargement process after the first process, it is possible to prevent an increase in the line memory for the character edge detection process and the filter process included in the first process. Further, since the rotation process and the enlargement process must be completed before the ED process of the third process is performed, the Lab before being converted into the CMYK color space (32 bits) in consideration of the intermediate data size. The rotation process and the enlargement process are performed on the color space (24 bits), that is, at a stage before the second process.

The image processing order determination unit 102 determines the execution order of image processing for each pixel of the image data. The execution order of image processing is determined according to the content (algorithm) of the image processing to be executed. For example, when a plurality of image processes are executed, it is determined whether each image process is a pre-stage process or a post-stage process in relation to other image processes.

More specifically, the order of image processing is determined according to, for example, information such as a print mode, which is a setting at the time of printing, a color setting, and a paper feeding direction. Such printing settings are set, for example, by the user operating the operation panel 130 during printing.
The print mode is a print mode when printing is performed by the image forming unit 150, and there are, for example, a photo mode for a photographic manuscript, a character mode for a character manuscript, and the like. Further, the color setting is a color setting at the time of printing, and for example, there are settings such as color, gray, and black and white. The paper feeding direction is the paper feeding direction with respect to the image forming unit 150, and for example, there are horizontal feed (LEF (Long Edge Feed)), vertical feed (SEF (Short Edge Feed)), and the like.

The image processing direction determination unit 103 determines the start position on the memory for starting the image processing for each image processing. Further, the image processing direction determination unit 103 determines the input direction of the image data of the processing unit (that is, the reading direction of each processing unit when the image data is read from the memory) and the image data of the processing unit for each image processing. The output direction (that is, the writing direction for each processing unit when writing image data to the memory) is determined.

Here, the image processing direction determination unit 103 is based on, for example, the start position of the image processing performed in the previous stage of each image processing, in other words, the position of the memory in which the writing of the image data is started by the image processing in the previous stage. To determine the start position on the memory to start image processing. Further, for each image processing, the image processing direction determination unit 103 writes, for example, the writing direction for each processing unit of the image processing performed in the previous stage, in other words, the image data of the processing unit in the memory by the image processing in the previous stage. Based on the direction, the reading direction for each processing unit of image processing is determined.

Further, when the image processing direction determination unit 103 performs the rotation processing on the image data, the image processing direction determination unit 103 changes the start position of the image processing performed thereafter in accordance with the rotation processing. In other words, the image processing by the image processing unit 106 is sequentially performed from a predetermined start position, but when the rotation processing is performed, the start position of the image processing performed thereafter is from the predetermined start position. It will be changed to a different position. In addition, in the image processing by the image processing unit 106, the image data is sequentially read from the predetermined start position on the memory, but when the rotation processing is performed, it is different from the predetermined start position. Reading is performed from the position.

Further, when the minimum unit of processing is a band unit, the image processing direction determination unit 103 determines the processing direction in the sub-scanning direction in band units in consideration of data transfer efficiency. Decide to do the processing. Further, in the image processing of the object for which the processing direction is determined, the image processing direction determination unit 103 indicates that when the minimum unit of processing is a tile unit and the image processing is not rotation processing, each processing unit of the image processing in the previous stage is used. The same direction as the writing direction of is defined as the reading direction / writing direction for each tile. On the other hand, if the image processing is rotation processing, the same direction as the writing direction for each processing unit of the image processing in the previous stage is set as the reading direction for each tile unit, and the direction rotated in the specified direction is the writing direction for each tile unit. And.

Further, when the image data is subjected to the rotation processing, the image processing direction determination unit 103 changes the processing direction of the image processing to be performed thereafter in accordance with the rotation processing. In other words, the image processing by the image processing unit 106 is performed along a predetermined direction, but when the rotation processing is performed, the processing direction of the image processing performed thereafter is the predetermined direction. It is changed in a different direction.

The minimum unit information storage unit 104 stores information (hereinafter, referred to as minimum unit information) indicating the minimum unit of image data capable of performing image processing for each image processing. The minimum unit of feasible image data is predetermined by each image processing algorithm. For example, a line unit, a tile unit, a band unit, and the like are exemplified. The line unit indicates one line in one direction (main scanning direction) with respect to the image data. The tile unit is a unit divided into rectangles of several pixels in the main scanning direction and several lines in the sub-scanning direction. The band unit indicates one or more line units (for example, one line, two lines, etc.). In the present embodiment, the line unit is treated as a band unit as a concept included in the band unit.

The image processing unit determination unit 105 determines a processing unit of image data when executing image processing for each image processing. Here, for each image processing, the image processing unit determination unit 105 writes, for example, the minimum unit information acquired from the minimum unit information storage unit 104, the processing unit of the image processing in the previous stage, and the processing unit of the image processing in the previous stage. The processing unit of image processing is determined based on the direction.

Here, the image processing unit determination unit 105 determines the processing unit as the band unit for the image processing before the rotation processing is performed. Further, the image processing unit determination unit 105 determines the processing unit for the rotation process according to the rotation angle. For example, when the rotation angle is 90 degrees and 270 degrees, the processing unit of the rotation processing is the tile unit. On the other hand, for example, when the rotation angle is 180 degrees, the processing unit of the rotation processing is a tile unit or a band unit. Further, in the image processing unit determination unit 105, for the image processing after the rotation processing is performed, the minimum unit of the image processing and the processing unit of the image processing in the previous stage are both tile units, and the image processing in the previous stage is performed. Only when the writing direction for each processing unit is the sub-scanning direction, the processing unit is determined to be the tile unit, and in other cases, the processing unit is determined to be the band unit.

Further, when the image data is subjected to the rotation processing, the image processing unit determination unit 105 changes the processing unit of the image processing to be performed thereafter in accordance with the rotation processing. In other words, the image processing by the image processing unit 106 is sequentially performed for each image data of a predetermined processing unit, but when the rotation processing is performed, the processing unit of the image processing to be performed thereafter is predetermined. It is changed to a unit different from the processing unit.

For example, when the minimum unit information of image processing is one pixel, the image processing unit determination unit 105 determines that the processing unit of the image processing is M × N tile processing. As the values of M and N, for example, preset values are used based on the capacity of the memory for storing the intermediate data of the image processing and the burst length at the time of memory transfer. Further, for example, when it is necessary to refer to the peripheral pixels in order to obtain the processing result of 1 pixel such as the filter processing of 7 pixels × 7 lines, 6 pixels and 6 lines are added to that amount (M + 6). The tile of × (N + 6) may be used as a processing unit.

The image processing control unit 107 controls the image processing by the image processing unit 106. Here, the image processing control unit 107 causes various image processing to be executed while determining the image processing to be executed next according to the progress of the image processing according to the order determined by the image processing order determination unit 102. More specifically, for example, with respect to two consecutive image processes, the image processing in the subsequent stage waits for the image data to be accumulated in the memory by the image processing in the previous stage. Then, when the image data for the processing unit of the image processing in the subsequent stage is accumulated in the memory, the image processing in the subsequent stage is started along the processing direction determined by the image processing direction determination unit 103.

Further, each functional unit constituting the image processing device 100 shown in FIG. 2 is realized by the cooperation of software and hardware resources. Specifically, when the image processing device 100 is realized with the hardware configuration shown in FIG. 1, for example, an OS (Operating System) program or application program stored in the ROM 110c is read into the RAM 110b. By being executed by the CPU 110a, each function of the image data acquisition unit 101, the image processing order determination unit 102, the image processing direction determination unit 103, the image processing unit determination unit 105, the image processing unit 106, the image processing control unit 107, and the like can be performed. It will be realized. Further, the minimum unit information storage unit 104 is realized by a storage means such as a RAM 110b or an HDD 120.

Further, in the present embodiment, the image data acquisition unit 101 is used as an example of the image acquisition means. The image processing unit 106 is used as an example of the orientation changing means and the image processing means.

<Explanation of processing flow by image processing device>
Next, the flow of processing by the image processing apparatus 100 will be described. Here, the description will be given in comparison with the conventional processing. 3A and 3B are diagrams for explaining an example of a conventional processing flow. Further, FIG. 3C is a diagram for explaining an example of the processing flow by the image processing apparatus 100 according to the present embodiment. In the examples shown in FIGS. 3A to 3C, the image data for one page of the manuscript will be processed.

First, the conventional flow of processing will be described with reference to FIGS. 3A and 3B. In the examples shown in FIGS. 3A and 3B, various image processings are performed by hardware processing using an ASIC (Application Specific Integrated Circuit) as a conventional processing. An ASIC is an integrated circuit manufactured specifically for a specific application. Individual image processing is connected via a memory, and when the amount of image data required for processing is stored in the memory, the image data is transferred to the image processing unit, the image processing is performed, and then the processing result is stored in the memory. Transferred.

In the example shown in FIG. 3A, it is assumed that the image data is not subjected to the rotation processing and the enlargement processing, but is subjected to the same magnification processing in the first processing, the second processing, and the third processing. In this case, the image reading unit 140 sequentially reads the image line by line, and sequentially performs the first processing, the second processing, and the third processing on the generated image data. More specifically, first, the image of the first line is read, and the image data of the first line is stored in the memory. After that, at the timing when the image data for one band is stored in the memory, the first process, the second process, and the third process are performed on the image data of the first band. Further, while the first processing, the second processing, and the third processing are being performed on the image data of the first band, the next image reading of the second band is performed. Therefore, when the first processing, the second processing, and the third processing for the image data of the first band are completed, the image data of the second band stored in the memory is continuously subjected to the first processing, the second processing, and the third processing. The third process is performed. In this way, the first process, the second process, and the third process are performed in band units without waiting time.

Next, in the example shown in FIG. 3B, it is assumed that the image data is subjected to 270 degree rotation processing and enlargement processing in addition to the first processing, the second processing, and the third processing. Here, the rotation process is performed in tile units, but as described above, the direction in which the image data before rotation is read from the memory in tile units and the direction in which the image data after rotation is written in the memory in tile units are determined. Since the vertical and horizontal conversion of the image is performed by changing the direction, the orientation of the image data changes before and after the rotation process. As a result, when image processing is performed in band units after rotation processing, if the start position on the memory for starting reading the image data is fixed or the direction for reading the image data from the memory is fixed, the image data is stored on the memory. There may be a waiting time until the image data after rotation is accumulated at the reading position of.

More specifically, in the example shown in FIG. 3B, first, the image of the first line is read, and the image data of the first line is stored in the memory. After that, the first process is performed on the image data of the first band at the timing when the image data of one band is stored in the memory. In the illustrated example, it is assumed that the number of lines of the band output by the first processing is equal to the tile height of the rotation processing. When the first process is completed for the image data for one band, the rotation process for each tile is executed, and the rotation result for each tile is stored in the memory from the position corresponding to the rotation direction. Then, rotation processing is performed on the image data for one band. Here, the expansion process, the second process, and the third process are not executed, and a waiting time occurs. During this time, the image reading of the second band is performed. Then, after the image data of the second band is stored in the memory, the first process and the rotation process are performed, but the enlargement process, the second process, and the third process are not executed, and a waiting time occurs again.

In this way, the first process and the rotation process are sequentially performed, but the enlargement process, the second process, and the third process are not executed, and a waiting time is generated. Then, after the rotation processing results for one page of the original are accumulated in the memory, the image data on the memory can be read, and the enlargement processing, the second processing, and the third processing are executed in band units. As described above, in the example shown in FIG. 3B, a waiting time is generated for each band before the enlargement processing.

Next, the flow of processing by the image processing apparatus 100 according to the present embodiment will be described with reference to FIG. 3C. In the example shown in FIG. 3 (c), similarly to the example shown in FIG. 3 (b), in addition to the first process, the second process, and the third process, a rotation process of 270 degrees and an enlargement process are also performed. .. Since the enlargement process and the second process can be performed by tile division, the tile unit is specified as the minimum unit. On the other hand, in the ED process of the third process, as described above, the process in line units is indispensable, so the band unit is designated as the minimum unit. Further, in the present embodiment, as described above, various image processings are performed by software processing (processing by the CPU 110a).

Here, the image processing order determination unit 102 determines the order of image processing executed on the image data. Further, the image processing unit determination unit 105 determines the processing unit of each image processing for each image processing. Further, the image processing direction determination unit 103 determines the start position of image processing, the reading direction for each processing unit, and the writing direction for each processing unit for each image processing. Then, the image processing unit 106 sequentially executes each image processing based on the determination of each unit.

As a result, as shown in FIG. 3C, the first process is performed in band units. Further, the rotation process is performed in tile units, and the result of the rotation process of 270 degrees is written in the memory in the sub-scanning direction. Here, the minimum unit of the enlargement processing is the tile unit, and the processing unit of the rotation processing in the previous stage is also the tile unit. Further, the writing direction for each processing unit of the rotation processing is the sub-scanning direction. Therefore, the image processing unit determination unit 105 determines the processing unit of the enlargement processing as the tile unit. Further, since the enlargement processing is an image processing that does not involve rotation, the image processing direction determination unit 103 inherits the scanning direction from the rotation processing and sets the same sub-scanning direction as the writing direction of the rotation processing as a processing unit (here, a tile unit). ) Determine as the read / write direction for each.

Similarly, in the second process, the process unit is determined as the tile unit, and the read direction / write direction for each process unit is determined as the sub-scanning direction. Further, in the ED process of the third process, the minimum unit is a band unit. Therefore, the image processing unit determination unit 105 determines the processing unit of the ED processing as the band unit. Further, the image processing direction determination unit 103 determines that the band, which is a processing unit, is sequentially scanned in the sub-scanning direction.

More specifically, in the example shown in FIG. 3C, first, the image of the first line is read, and the image data of the first line is stored in the memory. After that, the first process is performed on the image data of the first band at the timing when the image data of one band is stored in the memory. In the illustrated example, it is assumed that the number of lines of the band output by the first processing is equal to the tile height of the rotation processing. When the first process is completed for the image data for one band, the rotation process, the enlargement process, and the second process are executed for the image data for one tile smaller than one band. Here, by changing the start position, processing direction, and processing unit of the image processing according to the rotation processing, the enlargement processing and the second processing wait for the image data for one page of the original to be accumulated in the memory. Will be executed without. The third process is in a waiting state because the processing unit is scanned in the sub-scanning direction in band units, but the image of the second band is read while the enlargement process or the second process is being executed, and then the second band is read. The image data is subjected to the first processing, the rotation processing, the enlargement processing, and the second processing.

In this way, in the present embodiment, the first process, the rotation process, the enlargement process, and the second process can be sequentially processed, and the waiting time can be reduced. Then, after the rotation processing results for one page of the original are accumulated in the memory, the image data on the memory can be read, and the third processing is executed in band units. In this way, the first process, the rotation process, the enlargement process, the second process, and the third process are sequentially executed.

As described above, in the present embodiment, the start position, the processing direction, and the processing unit of the image processing are changed according to the rotation processing, and each image processing is sequentially executed. As a result, in the present embodiment, the time required to complete the image processing is shortened as compared with the case shown in FIG. 3 (b).

FIG. 4-1 is a diagram for explaining the conventional process shown in FIG. 3 (b). FIG. 4-2 is a diagram for explaining the processing by the image processing apparatus 100 according to the present embodiment. In the examples shown in FIGS. 4-1 and 4-2, one page of the manuscript will be described as corresponding to 11 bands.

As shown in FIG. 4-1 in the conventional processing, the image is read in line units, and the image processing is started at the timing when the image data for one band is stored in the memory. Then, the first process is sequentially executed in band units. After that, the image data for one band is input, and the rotation process is executed in tile units. Here, after the rotation processing for one output band of the first processing is completed, the first processing is performed in units of the next band without continuing the processing after the enlargement processing, but the image of the next band. There is a waiting time until the data is acquired from the image reading unit 140 and stored in the memory. In this way, the first processing and the rotation processing are performed for each band, and when the first processing and the rotation processing are completed for one page (here, 11 bands) of the image data, the enlargement processing and the second processing are performed. And the third process is sequentially executed in band units.

On the other hand, as shown in FIG. 4-2, in the present embodiment, the image is read in line units, and the image processing is started at the timing when the image data for one band is stored in the memory. Then, the first process is sequentially executed in band units. After that, the image data for one band is input, and the rotation process is executed in tile units. Further, in the present embodiment, the enlargement process and the second process are sequentially executed for each tile. Then, when the first processing, the rotation processing, the enlargement processing, and the second processing are completed for the image data for one page (here, for 11 bands), the third processing is finally executed collectively.

<Specific example of image processing by an image processing device>
Next, the image processing by the image processing apparatus 100 according to the present embodiment will be described with reference to specific examples. Here, the description will be given in comparison with the conventional processing. 5-1 (a) and 5-2 (a) are diagrams showing specific examples of the conventional processing shown in FIG. 3 (b). Further, FIGS. 5-1 (b) and 5-2 (b) are diagrams showing specific examples of processing by the image processing apparatus 100 according to the present embodiment.

Here, in the examples shown in FIGS. 5-1 and 5-2, the image data for one page of the manuscript will be processed. Further, the image data is subjected to the first processing, the rotation processing, the enlargement processing, the second processing and the third processing. In the illustrated example, the first color conversion process is the first process. The second color conversion process is the second process. The ED process is a third process.

The conventional flow of processing will be described with reference to FIGS. 5-1 (a) and 5-2 (a). First, as shown in FIG. 5-1 (a), scanning (image reading) is performed line by line along the main scanning direction (right direction in the figure). Next, at the timing when the image data for one band is stored in the memory, the first color conversion process converts the image data for one band along the horizontal direction (main scanning direction, right direction in the figure) of the image data. It is done against. Next, a rotation process of rotating the image data clockwise by 270 degrees is performed on a tile-by-tile basis.

Next, as shown in FIG. 5-2 (a), the enlargement process is performed in band units. Here, in the conventional process, the start position of the enlargement process is predetermined as the position of reference numeral 1A on the memory. Further, it is predetermined that the processing direction of the image data is also performed in the lower direction (sub-scanning direction) in the figure in band units in the horizontal direction (main scanning direction) in the figure. Therefore, in the enlargement process, the area 3A on the memory indicated by the diagonal line in the figure is read. On the other hand, as shown in FIG. 5-1 (a), the rotation process in the previous stage is performed in the upper direction (sub-scanning direction) in the figure. As a result, the enlargement processing is not started until the image data is accumulated at the position of reference numeral 2A on the memory, that is, until the image data for one page of the original is accumulated in the memory by the rotation processing.

Therefore, in the conventional process, for example, as described in FIG. 3B, the rotation process is performed before starting the enlargement process, the second process (second color conversion process), and the third process (ED process). Wait until it is completed and the image data for one page of the manuscript is accumulated in the memory. Then, when the image data for one page of the original is accumulated in the memory, the enlargement processing, the second processing, and the third processing are started. Here, the enlargement processing, the second processing, and the third processing are sequentially executed on the image data of the first band. After that, the enlargement process, the second process, and the third process are sequentially executed in band units in the sub-scanning direction.

Next, the flow of processing by the image processing apparatus 100 according to the present embodiment will be described with reference to FIGS. 5-1 (b) and 5-2 (b). First, when the image reading unit 140 starts scanning along the main scanning direction, the image processing order determining unit 102 determines the order of image processing. Here, it is determined that the first color conversion process, the rotation process, the enlargement process, the second color conversion process, and the ED process are performed in this order. Further, the image processing direction determination unit 103 determines the start position and the processing direction for each image processing. Further, the image processing unit determination unit 105 determines the processing unit of the image data for each image processing.

Then, the image processing control unit 107 causes the image processing unit 106 to execute various image processing. More specifically, as shown in FIG. 5-1 (b), in the first color conversion process, the image data for which the image has been read is sequentially processed in band units. Next, in the rotation process, the image data subjected to the first color conversion process in the previous stage is sequentially rotated clockwise by 270 degrees in tile units to change the direction of the image data, and then in the upward direction (sub-scanning) in the figure. Image data for each tile is stored in the memory in the direction).

Next, the enlargement processing is sequentially performed by scanning the image data of each tile in which the rotation processing of the previous stage has been performed in the upper direction (sub-scanning direction) in the drawing. Here, since the minimum unit of the enlargement processing and the processing unit of the rotation processing of the previous stage are tile units, and the writing direction of the rotation processing of the previous stage is the sub-scanning direction, the enlargement processing is performed in tile units. Further, the processing direction of the enlargement processing is determined to be the upper direction (secondary scanning direction) in the figure according to the processing direction of the rotation processing in the previous stage, in other words, the direction in which the image data is accumulated in the memory by the rotation processing. To. Further, the start position of the enlargement process is determined at the position of reference numeral 1B on the memory according to the start position where the image data is accumulated in the memory by the rotation process of the previous stage.

In addition, as shown in FIG. 5-2 (a), in the conventional ASIC processing, the enlargement processing is processed in the lower direction (sub-scanning direction) in the figure in band units, but in the present embodiment, the enlargement processing is performed. Is changed to the processing in the upper direction (secondary scanning direction) in the figure for each tile. Further, in the conventional ASIC process, the start position of the enlargement process is the position of the symbol 1A on the memory, but in the present embodiment, the start position of the enlargement process is changed to the position of the code 1B on the memory.

Next, since the minimum unit of the second color conversion processing and the processing unit of the enlargement processing in the previous stage are tile units, and the writing direction of the enlargement processing in the previous stage is the upper direction (sub-scanning direction) in the figure, the tile units are used. The second color conversion process is performed. Further, the processing direction is the upper direction (sub-scanning direction) in the figure according to the processing direction of the enlargement processing in the previous stage, in other words, the direction in which the image data is accumulated in the memory by the enlargement processing (or rotation processing). It is determined. Further, the start position of the second color conversion process is determined at the position of reference numeral 1B on the memory according to the start position where the image data is accumulated in the memory by the enlargement process in the previous stage.

In addition, as shown in FIG. 5-2 (a), in the conventional ASIC processing, the second color conversion processing is processed in the lower direction (sub-scanning direction) in the figure in band units, but in the present embodiment. , The second color conversion process is changed to the process in the upper direction (sub-scanning direction) in the figure for each tile. Further, in the conventional ASIC processing, the start position of the second color conversion process is the position of reference numeral 1A on the memory, but in the present embodiment, the start position of the second color conversion process is the position of reference numeral 1B on the memory. It is changed to the position.

Since the minimum unit for ED processing is a band unit, the processing unit is also a band unit. The ED process is performed collectively at the end. Further, in consideration of data transfer efficiency, ED processing is performed in the lower direction (sub-scanning direction) in the figure in band units as in the conventional case. As a result, for example, as shown in FIG. 5-2 (b), until the image data is accumulated at the position of reference numeral 2B on the memory, that is, until the image data for one page of the original is accumulated in the memory. The ED process will not be started. After waiting until the second color conversion process is completed and the image data for one page of the original is accumulated in the memory, the area 3B on the memory indicated by the diagonal line in the figure is read and the ED process is started. Will be done.

Therefore, when the second color conversion process is completed, the first color conversion process for the next pixel is started. In this way, each image processing except the ED processing is sequentially performed for each processing unit. Then, when the first process, the rotation process, the enlargement process, and the second process are completed for one page of the image data, the ED process is sequentially executed in band units as shown in FIG. 5-2 (b).

As described above, in the present embodiment, the image processing direction determination unit 103 determines the start position on the memory for starting the image processing and the processing direction of the image processing for each image processing. Further, the image processing unit determination unit 105 determines a processing unit of image data for each image processing. By using the image processing apparatus 100 according to the present embodiment, image processing is performed as compared with the case where, for example, the start position and processing direction of image processing are fixed or the processing unit is fixed in band units. The waiting time is reduced and the time to complete the image processing is shortened.

Further, in the present embodiment, the tile unit of each image processing may have a different size. For example, in the example shown in FIG. 5-2 (b), the tile unit of the enlargement processing and the tile unit of the second color conversion processing may have different sizes. For example, when the tile unit of the enlargement processing is 64 pixels × 64 pixels and the tile unit of the second color conversion processing is 256 pixels × 256 pixels, the second color conversion is performed after the enlargement processing is performed for 256 pixels × 256 pixels. The processing is performed in tile units (256 pixels × 256 pixels). Further, for example, when the tile unit of the enlargement processing is 256 pixels × 256 pixels and the tile unit of the second color conversion processing is 64 pixels × 64 pixels, the enlargement processing is performed in the tile unit (256 pixels × 256 pixels). After that, the second color conversion process is performed for 256 pixels × 256 pixels.

Further, in the above-described example, in the image processing unit determination unit 105, regarding the image processing after the rotation processing is performed, the minimum unit of the image processing and the processing unit of the image processing in the previous stage are both tile units and the previous stage. When the writing direction for each processing unit of the image processing is the sub-scanning direction, the processing unit is the tile unit, but the processing unit may be the band unit.
For example, in the example shown in FIG. 5-2 (b), the enlargement processing and the second color conversion processing are performed in the vertical direction (sub-scanning direction) band unit in the figure in the right direction (main scanning direction) in the figure. You may do it. Also in this case, the enlargement process and the second color conversion process are executed without waiting until the image data for one page of the original is accumulated in order to execute the enlargement process and the second color conversion process. When the processing unit is a band unit in the example shown in FIG. 5-2 (b), it is a band in the sub-scanning direction. Therefore, the band in the main scanning direction shown in FIG. 5-2 (a) is a processing unit. Is different. Further, for example, when image processing is performed in tile units with the upper direction (sub-scanning direction) in the figure as the processing direction, it is compared with the case where processing is performed in band units with the right direction (main scanning direction) in the figure as the processing direction. Therefore, it can be said that the amount of memory required for accumulating image data is small.

Further, the image processing apparatus 100 according to the present embodiment may of course perform the same processing even when the rotation angle of the rotation processing is not in units of 90 degrees. In this case, for example, the image processing direction determination unit 103 determines the direction rotated by the rotation angle from the main scanning direction (or the sub-scanning direction) as the processing direction of the image processing after the rotation processing is performed.

Of course, the image processing device 100 according to the present embodiment may perform the same processing even when the rotation processing or the enlargement processing of the image data is not performed.

Further, the program that realizes the embodiment of the present invention can be provided not only by communication means but also by storing it in a recording medium such as a CD-ROM.

Although various embodiments and modifications have been described above, it is of course possible to combine these embodiments and modifications.
Further, the present disclosure is not limited to the above-described embodiment, and can be implemented in various forms without departing from the gist of the present disclosure.

100 ... Image processing device, 101 ... Image data acquisition unit, 102 ... Image processing order determination unit, 103 ... Image processing direction determination unit, 104 ... Minimum unit information storage unit, 105 ... Image processing unit determination unit, 106 ... Image processing unit , 107 ... Image processing control unit, 110 ... Control unit, 110a ... CPU, 110b ... RAM

Claims (8)

An image acquisition means for acquiring image data obtained by reading an image in line units along the main scanning direction over the sub-scanning direction, and
An orientation changing means for changing the orientation of the image data acquired by the image acquisition means, and an orientation changing means.
The image processing of the image data acquired by the image acquisition means is sequentially performed for each image data of a predetermined processing unit, and when the change is performed by the orientation changing means, the processing unit of the image processing. Is provided with an image processing means for changing the unit to a unit different from the predetermined processing unit .
The image processing means is characterized in that the processing unit of the image processing is changed based on the minimum unit of the image data capable of executing the image processing and the processing unit of the image data by the processing in the previous stage of the image processing. It is that the image processing device. The image processing means is characterized in that, when the predetermined processing unit is one or a plurality of line units, the processing unit of the image processing is changed to a unit smaller than the one or a plurality of line units. The image processing apparatus according to claim 1. The image processing means performs the image processing along a predetermined direction, and when the change is performed by the orientation changing means, the processing direction of the image data by the image processing is determined in advance. The image processing apparatus according to claim 1 or 2 , wherein the image processing apparatus is changed in a direction different from the direction. The image processing according to claim 3 , wherein the image processing means changes the processing direction of the image data by the image processing based on the processing direction of the image data by the processing in the previous stage of the image processing. apparatus. The image processing means is characterized in that the processing direction of the image data by the image processing is changed according to the direction in which the image data of the processing unit by the processing in the previous stage of the image processing is written in the memory. The image processing apparatus according to 4. The image processing means sequentially performs the image processing from a predetermined start position, and when the change is performed by the orientation changing means, the start position of the image processing is referred to as the predetermined start position. The image processing apparatus according to any one of claims 1 to 5 , wherein the image processing apparatus is changed to a different position. The sixth aspect of claim 6, wherein the image processing means changes the start position of the image processing based on the position of the memory in which the writing of the image data is started by the processing in the previous stage of the image processing. Image processing device. On the computer
A function to acquire image data obtained by reading an image in line units along the main scanning direction over the sub-scanning direction, and
A function to change the orientation of the acquired image data and
The image processing of the acquired image data is sequentially performed for each of the image data in a predetermined processing unit, and when the change is made , the minimum unit of the image data capable of performing the image processing and the image. A program for realizing a function of changing the processing unit of the image processing to a unit different from the predetermined processing unit based on the processing unit of the image data by the processing in the previous stage of the processing.

Images