JP2021150768A - Printer, information processing device, method and program - Google Patents

Abstract

[Problem] Using an image to be printed, a user sets a threshold value used to detect an abnormality in a printed image. [Solution] A printing device 100 includes a reading and acquiring unit 400 that acquires an image to be inspected by reading an image formed by printing the image to be printed on a medium, an abnormality detection unit 405 that compares image features of the target image with image features of the target image and detects an abnormality in the target image based on the comparison result and a threshold value, a composition unit 410 that generates a composite image by combining a sample image for the abnormality in the target image with the target image, and a user interface 415 that includes a screen for displaying the composite image and an operation unit 430 that accepts user operations to set the threshold value. The composition unit 410 changes the image features of the sample image based on the threshold value set by the user operation accepted by the operation unit 430. [Selected Figure] FIG.

Description

This disclosure relates to image formation and, more specifically, to techniques for detecting image anomalies.

Conventionally, in order to evaluate the quality of a printed image printed on a paper, so-called spoilage detection is known in which an abnormality of the image in the printed image is detected by optically reading the printed image. In the spoilage detection, a detection level used for detecting an abnormality in an image is set.

Regarding the setting of such a detection level, Japanese Patent Application Laid-Open No. 2017-19791979 (Patent Document 1) states that "a scan image or abnormality detection information is displayed using a history image generated each time an image is formed. , Input the user's rating for the anomaly detection result ”, and disclose an image forming system that“ finalizes the anomaly in the scanned image and determines the detection parameters according to the input rating ”(see paragraph [0110]). ..

JP-A-2017-19791979

According to the technique disclosed in Patent Document 1, detection parameters corresponding to the detection level are set based on the historical image, and the set detection parameters are determined by the image to be printed (hereinafter referred to as the target image). Is not always a suitable parameter. In addition, how much an abnormality in a printed image can be tolerated differs for each user. Therefore, there is a need for a technique for detecting an abnormality in a printed image using a target image.

The present disclosure has been made in view of the above background. According to a certain aspect, a technique for detecting an abnormality in a printed image using a target image is disclosed.

A printing apparatus according to a certain embodiment has a reading acquisition unit that acquires an inspection target image by reading an image formed by printing the target image to be printed on a medium, an image feature amount of the target image, and the inspection target. An abnormality detection unit that compares an image feature amount of an image and detects an abnormality in the inspection target image based on the comparison result and a threshold, a sample image for the abnormality in the inspection target image, and the target image. It includes a compositing unit that generates a composite image by compositing the above, a screen that displays the composite image, and a user interface that includes an operation unit that accepts a user operation for setting the threshold value. The compositing unit changes the image feature amount of the sample image based on the threshold value set by the user operation received by the operation unit.

The printing device further includes a storage unit. The synthesis unit extracts a partial image from the target image and stores the extracted list of the partial images in the storage unit.

The compositing unit detects the image feature amount from a predetermined partial area in the extracted partial image, and stores the detected image feature amount in the storage unit in association with the partial image in the list. do.

The partial image includes a figure. The image feature amount includes an image feature amount related to contrast.

The image feature amount related to the contrast includes at least one of brightness, brightness, hue, density and saturation.

The predetermined partial region in the partial image includes a plurality of partial regions in the partial image.

The storage unit stores an image of an abnormal portion of the inspection target image detected by the abnormality detection unit. The sample image includes an image of the abnormal portion of the inspection target image stored in the storage unit.

The compositing unit determines the contrast between the image of the predetermined partial region in the partial image and the sample image, and the size of the sample image based on the detected image feature amount.

The composite unit generates the composite image by arranging the sample image in the predetermined partial region of the partial image.

The composite unit generates the composite image by arranging the sample image in each of the plurality of partial regions in the partial image.

The user interface includes a first screen that displays the partial image in which the sample image is synthesized by the compositing unit based on the image feature amount according to the set threshold value.

The user interface includes a second screen for displaying the composite image in which the sample image is composited with at least one of the partial images by the compositing unit.

The user interface switches between the first screen and the second screen for display.

The operation unit accepts a user operation for moving the sample image synthesized with the partial image on the first screen or the second screen.

The printing apparatus prints at least one of the partial image in which the sample image is combined and the composite image on a medium.

The compositing unit extracts the partial image in the selection area selected by the user of the target image.

The compositing unit stores the list of the partial images to which the image feature amount is associated with the first designated area and the second designated area different from the first designated area, respectively. Store in the department.

The operation unit receives a user operation for setting the threshold value for the target image in the first designated area and the target image in the second designated area, respectively.

The image feature amount related to the contrast includes at least one of RGB (Red, Blue, Green) gradation value and YMCK (Yellow, Cyan, Magenta, Key plate) gradation value.

According to other embodiments, an information processing device is provided. This information processing device compares the image feature amount of the print target image with the image feature amount of the inspection target image acquired by reading the target image printed on the medium, and determines the comparison result and the threshold value. An abnormality detection unit that detects an abnormality in the inspection target image, a composition unit that generates a composite image by synthesizing a sample image for the abnormality in the inspection target image, and the target image based on the above, and the composite image. It is provided with a screen for displaying the above and a user interface including an operation unit for receiving a user operation for setting the above threshold value. The compositing unit changes the image feature amount of the sample image based on the threshold value set by the user operation received by the operation unit.

According to still other embodiments, methods are provided. This method includes a step of acquiring an inspection target image read from an image formed by printing the target image to be printed on a medium, an image feature amount of the target image, and an image feature amount of the inspection target image. A step of detecting an abnormality in the inspection target image based on the comparison result and the threshold value, and a step of generating a composite image by synthesizing the sample image for the abnormality of the inspection target image and the target image. The image feature amount of the sample image is changed based on the step of displaying the composite image, the step of accepting the user operation for setting the threshold, and the threshold set by the accepted user operation. Including steps.

According to still other embodiments, the program is provided. This program has a step of acquiring an inspection target image read from an image formed by printing a print target image on a medium, an image feature amount of the target image, and the inspection target image of the target image. A composite image is obtained by combining the step of detecting an abnormality in the inspection target image, the sample image for the abnormality of the inspection target image, and the target image based on the comparison result with the image feature amount and the threshold value. The image feature amount of the sample image based on the step of generating, the step of displaying the composite image, the step of accepting the user operation for setting the threshold, and the step of accepting the user operation set by the accepted user operation. To perform the steps and steps to change.

According to the present disclosure, an abnormality in a printed image can be detected by using the target image. The above and other objectives, features, aspects and advantages of the present disclosure will become apparent from the following detailed description of the present disclosure as understood in connection with the accompanying drawings.

It is a figure which shows an example of the hardware composition of the printing system 50 in embodiment. It is a block diagram which shows an example of the detailed hardware composition of a printing apparatus 100. It is a figure which shows an example of the hardware composition of a client terminal 140. It is a block diagram explaining an example of the structure of the printing apparatus 100 for detecting an abnormality. It is a figure which shows an example of how the synthesis unit 410 generates a composite image 550 from a target image 500. It is a figure which shows an example of the list of partial images 505-545 extracted from the target image 500. It is a figure which shows an example of the list which each partial image and the image feature amount in each partial image are related. It is a figure which shows an example of how the sample image 560 arranged in the partial image 520 by a synthesis part 410 changes according to a detection level. It is a figure which shows an example of the screen 901 which displays the list of various buttons operated for accepting a job setting. It is a figure which shows an example of the setting screen of UI (User Interface) 415 when the detection level is "level 1". It is a figure which shows an example of the setting screen in UI415 when the detection level is "level 2". It is a figure which shows an example of the setting screen in UI415 when the detection level is "level 3". It is a figure which shows an example of the UI which displays the detail of a partial image included in a composite image. It is a flowchart which shows an example of the process which a printing apparatus 100 executes. It is a flowchart which shows the detail of the process (step S1325 of FIG. 14) in which a synthesis unit 410 synthesizes a sample image and a target image. It is a figure which shows an example of the user operation which moves the sample image combined with the partial image 530 in the 1st screen. It is a figure which shows an example of how the composite image is divided into each area on the screen 435 in order to set a detection level for each area by a user. It is a figure which shows an example of the list of the partial image included in the area designated by a user. It is a figure which shows an example of the list of the partial image included in the area different from the area specified by a user. It is a figure which shows an example of the list of the image feature amount detected from a plurality of partial regions in a partial image by a synthesis unit 410. It is a figure which shows an example of the partial image which the sample image is arranged in a plurality of partial regions. It is a figure which shows an example of the image formed on the paper. It is a figure which shows an example of the image formed on the paper. It is a figure which shows an example of the image formed on the paper. It is a figure which shows an example of the image formed on the paper.

Hereinafter, embodiments in the present disclosure will be described with reference to the drawings. In the following description, the same components are designated by the same reference numerals. Their names are the same. Therefore, the detailed description of them will not be repeated.

[Hardware configuration of printing system]
Hereinafter, the hardware configurations of the printing system 50, the printing apparatus 100, and the client terminal 140 will be described with reference to FIGS. 1 to 3. FIG. 1 is a diagram showing an example of the hardware configuration of the printing system 50 according to the embodiment.

The printing system 50 includes a printing device 100 and at least one client terminal 140 that communicates with the printing device 100 via a communication line 145. The communication line 145 includes wired or wireless.

The printing device 100 prints an image on a medium based on a printing job (hereinafter, referred to as a job) instructing printing of the target image. In this embodiment, paper is exemplified as the medium, but the medium may be a material other than paper. In another aspect, the printing apparatus 100 may be realized as an MFP (Multifunction Peripheral) having functions such as a printer, a scanner, a copier, and a facsimile.

The client terminal 140 transmits a job to the printing device 100 via the communication line 145. The job includes data of the target image. In the example of FIG. 1, the client terminal 140 is described as a stationary PC (Personal Computer), but in other aspects, it may be a portable information processing device such as a tablet computer or a smartphone.

More specifically, the printing device 100 includes a paper feeding unit 103, an image forming unit 105, a reading device 115, a conveying unit 120, a first loading unit 122, a second loading unit 126, and a control device 150. , The operation panel 160 is provided.

The paper feed unit 103 can accommodate a plurality of types of paper. The type of paper specified by the job is taken out one by one from the paper feeding unit 103 by the conveying unit 120 and fed to the image forming unit 105.

The image forming unit 105 forms a target image designated by the job on the paper fed from the paper feeding unit 103. In the present disclosure, the image formed on the paper is also referred to as a printed image. The image forming unit 105 may form an image on paper by an inkjet method, or may form an image on paper by an electrophotographic method, and the image forming method is not limited. In one aspect, the image forming unit 105 forms an image on paper using YMCK's four color toners or inks. The paper on which the image is formed according to the job is conveyed to the reading device 115 by the conveying unit 120.

The reading device 115 optically reads the printed image on the paper when the paper on which the image is formed by the image forming unit 105 passes a predetermined reading position. Further, the data of the image read by the reading device 115 is referred to as an inspection target image in order to distinguish it from the target image and the printed image. The reading device 115 is realized, for example, by an optical line sensor.

The transport unit 120 transports the paper to either the first load unit 122 or the second load unit 126 in accordance with a command from the control device 150. The transport unit 120 transports the paper on which the image on which the abnormality is detected is printed to the first loading unit, and conveys the paper on which the image on which the abnormality is detected is printed to the second loading unit 126.

The control device 150 controls the operation of the printing device 100. In a certain aspect, the control device 150 controls the image forming unit 105, the reading device 115, the transport unit 120, and the operation panel 160.

The operation panel 160 receives an operation input to the printing device 100 from the user. Further, the operation panel 160 displays information based on a command from the control device 150. The displayed information includes information on the user interface (UI: User Interface) such as the operation menu and the setting screen of the detection level (described later).

FIG. 2 is a block diagram showing an example of a detailed hardware configuration of the printing apparatus 100. In FIG. 2, the printing device 100 includes a communication I / F (Interface) 215 and data in addition to the image forming unit 105, the reading device 115, the transport unit 120, the control device 150, and the operation panel 160 shown in FIG. It is equipped with a reader / writer 222 and a bus 230.

The control device 150 includes a CPU (Central Processing Unit) 200, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 205, and an HDD (Hard Disk Drive) 210.

The CPU 200 executes a control program for controlling the printing device 100. As an example, the CPU 200 executes programs such as information display, printing processing, and abnormality detection of an image to be inspected.

The ROM 202 stores a program such as an OS (Operating System) executed by the CPU 200.

The RAM 205 stores an application program executed by the CPU 200 and referenced data. In a certain aspect, SRAM (Static Random Access Memory) or DRAM (Dynamic Random Access Memory) may be used as RAM 205.

The HDD 210 stores various programs and data used in the printing apparatus 100. In another aspect, an auxiliary storage device such as an SSD (Solid State Drive) may be used instead of the HDD 210.

The communication I / F 215 is a unit for the printing device 100 to send and receive data to and from other devices such as the client terminal 140. The printing device 100 may include a plurality of communication I / F 215s. In some aspects, the communication I / F 215 may include any or all of a LAN (Local Area Network) port or a Wi-Fi® (Wireless Fidelity) transmitter / receiver. The printing device 100 receives a job from the client terminal 140 via the communication I / F 215.

When an external storage medium 223 such as an external HDD is detachably attached, the data reader / writer 222 writes data or a program including an image to the attached storage medium 223 based on a command from the CPU 200. , Or read data from the storage medium 223. The storage medium 223 stores the information of the recorded program or the like by electrical, magnetic, optical, mechanical or chemical action so that the computer or other device can read the information of the recorded program or the like. ..

The operation panel 160 includes an input device 220 and a display device 225 in a certain aspect. The operation panel 160 can be configured by a touch screen in which an input device 220 such as a plurality of touch sensors and a display device 225 such as a liquid crystal display are combined. The operation panel 160 may further include a plurality of physical keys as an input device 220. The components of the printing apparatus 100 communicate with each other via the bus 230.

FIG. 3 is a diagram showing an example of the hardware configuration of the client terminal 140. As shown in FIG. 3, the client terminal 140 includes a CPU 300, a RAM 305, a ROM 310, an HDD 315, a data reader / writer 317, a communication I / F 320, a keyboard 322, a display 340, and a bus 345. Be prepared.

The CPU 300 controls the operation of the entire client terminal 140. As an example, the CPU 300 transmits a job to the printing device 100 via the communication I / F 320.

The communication I / F 320 is a unit for the client terminal 140 to send and receive data to and from other devices such as the printing device 100.

The configurations of the RAM 305, the ROM 310, the HDD 315, the data reader / writer 317, the storage medium 318, and the bus 345 are the RAM 205, the ROM 202, the HDD 210, and the data reader / writer 222, which constitute the printing device 100, respectively. , And each configuration of the storage medium 223 and the bus 230 is the same. Therefore, these explanations will not be repeated.

The keyboard 322 is a device used by the user to operate the client terminal 140. In another aspect, the client terminal 140 may include a mouse instead of the keyboard 322 as the device.

The display 340 displays information based on a command from the CPU 300. In a certain aspect, a liquid crystal panel or an organic EL (Electro-Luminescence) display is used as the display 340.

[Configuration to realize anomaly detection]
The printing device 100 includes a configuration for detecting an abnormality included in a printed image by using a detection level set by the user. The printing apparatus 100 also provides UI 415 as a tool for supporting the setting of the detection level. The detection level is a value that represents the user's visual tolerance for image anomalies.

FIG. 4 is a block diagram illustrating an example of the configuration of the printing device 100 for detecting an abnormality. With reference to FIG. 4, the printing apparatus 100 includes a reading acquisition unit 400, an abnormality detection unit 405, a synthesis unit 410, a UI 415, a storage unit 420, and a conversion unit 422.

In FIG. 4, the read acquisition unit 400, the abnormality detection unit 405, the synthesis unit 410, and the conversion unit 422 are executed by the CPU 200 reading a program stored in the ROM 202, HDD 210, etc. and expanding it in the RAM 205. It will be realized. In response to the user operation received by the operation panel 160, the UI 415 executes the program stored in the ROM 202, HDD 210, etc. while the CPU 200 reads the program and expands the program in the RAM 205, and displays a screen described later on the operation panel 160. Is realized by. The storage unit 420 is realized by the ROM 202, the RAM 205, the HDD 210, and the like. Hereinafter, each of the above components will be described.

First, the data stored in the storage unit 420 will be described. The storage unit 420 stores the target image 425 included in the job, the history information 445, and data such as lists 450 and 460. Lists 450 and 460 will be described later with reference to FIGS. 6 and 7.

The history information 445 has a threshold value 406 corresponding to the detection level 446 and an image of an abnormal portion in the inspection target image detected by the abnormality detection unit 405 using the detection level. For example, the detection level 446 is set by the user operation 440 to any one of the three levels of "level 1", "level 2", and "level 3". In other aspects, the number of stages of detection level 446 may be other than 3.

The reading acquisition unit 400 acquires an inspection target image by causing the reading device 115 to read the printed image from the image forming unit 105.

The abnormality detection unit 405 detects an abnormality in the image to be inspected by a known abnormality detection algorithm. More specifically, the abnormality detection unit 405 compares the image feature amount of the target image 425 with the image feature amount of the inspection target image from the reading acquisition unit 400, and based on the comparison result and the threshold value 406. , Detects abnormalities in the image to be inspected. In the present embodiment, the image to be inspected corresponds to the printed image. Therefore, detecting an abnormality in the inspection target image by the abnormality detection unit 405 corresponds to detecting an abnormality in the printed image.

The image feature amount compared by the anomaly detection unit 405 includes a feature amount related to contrast. Contrast features include at least one of lightness, brightness, hue, density and saturation.

The threshold value 406 corresponds to the detection level 446 set by the user operation 440 via the UI 415. When the detection level 446 is set by the user operation 440, the detection level 446 is converted into the threshold value 406 corresponding to the detection level 446 by the conversion unit 422. The operation of the conversion unit 422 will be described later.

The abnormality detection unit 405 compares, for example, the brightness, brightness and hue of the target image 425 with the brightness, brightness and hue of the inspection target image, and based on the result of the comparison, the target image 425 and the inspection target image are combined. Find the contrast. The contrast is, for example, a known Mickelson contrast, but other contrasts may be used.

Based on the result of the above comparison, the abnormality detection unit 405 extracts an object that can be determined to be abnormal in the image to be inspected, and determines the size of the extracted object. An object refers to an image of a portion of an image that has a certain shape.

The abnormality detection unit 405 determines whether or not an abnormality has occurred in the image to be inspected based on the threshold value 406, the above contrast, and the size of the object. For example, the abnormality detection unit 405 determines that the object is abnormal based on the determination that the linear sum of the contrast and the size of the object exceeds the threshold value 406. That is, the abnormality detection unit 405 determines that an abnormality has occurred in the inspection target image based on the determination.

In another aspect, the abnormality detection unit 405 may determine whether or not an abnormality has occurred in the image to be inspected based only on the above contrast without using the size of the object.

When the abnormality detection unit 405 detects an abnormality, the abnormality detection unit 405 associates the threshold value 406 corresponding to the detection level 446 used for the detection with the image of the detected abnormal portion, and records the threshold value 406 and the detected image of the abnormal portion. It is stored in the storage unit 420 as information 445.

The synthesizing unit 410 generates a sample image for an abnormality of the inspection target image, and generates a composite image 412 by synthesizing the generated sample image and the target image 425. Here, the "sample image for an abnormality in the image to be inspected" includes an image that models an abnormality that can be detected by the abnormality detection unit 405 at the detection level 446 set by the user operation 440. The synthesis unit 410 generates a sample image having a predetermined shape and having a feature amount corresponding to the detection level 446 set by the user operation 440 via the UI 415. The synthesis unit 410 can set or change the above-mentioned image feature amount of the sample image based on the threshold value 406 from the conversion unit 422. The specific operation of the synthesis unit 410 will be described with reference to FIGS. 5 to 8.

In another aspect, the synthesis unit 410 may acquire a sample image by searching the history information 445. More specifically, the synthesis unit 410 searches the history information 445 for an image of an abnormal portion in the inspection target image associated with the detection level based on the detection level 446 set by the user operation 440, and searches for a sample image. May be obtained as. As a result, the synthesis unit 410 can acquire the sample image associated with the detection level 446 set by the user operation 440 without generating the sample image. Further, in the UI 415 described later with reference to FIGS. 10 to 13, the user can set the detection level for the permissible abnormality while looking at the composite image based on the image of the abnormal portion actually generated.

The UI 415 includes a screen 435 that displays the composite image 412 synthesized by the composite unit 410, and an operation unit 430 that accepts the user operation 440 that sets the detection level 446. In one aspect, the screen 435 is displayed on the display device 225. Specific examples of UI415 will be described later with reference to FIGS. 10 to 13.

The conversion unit 422 converts the detection level 446 set by the user operation 440 received by the UI 415 into the threshold value 406 used by the abnormality detection unit 405 for abnormality detection. More specifically, the conversion unit 422 converts the detection level 446 into the threshold value 406 by a predetermined calculation. In another aspect, the conversion unit 422 may convert the detection level 446 to the threshold value 406 using a look-up table (not shown) stored in the storage unit 420. Here, the higher the detection level 446, that is, the higher the detection accuracy for an abnormality, the smaller the threshold value 406. On the other hand, the lower the detection level 446, that is, the lower the detection accuracy for an abnormality, the larger the threshold value 406.

The user operation 440 includes an operation of setting the detection level by the user, a touch operation on the operation panel 160, a swipe operation, a slide operation, a drag operation, and the like.

In another aspect, the abnormality detection unit 405 may use an image determined by the user as having no abnormality among the inspection target images in place of the target image in order to detect the abnormality. That is, the image determined by the user that there is no such abnormality may be an image acquired by the reading acquisition unit 400 based on the image formed on the paper loaded on the first loading unit 122. In this way, the abnormality detection unit 405 compares the feature amount of the image determined by the user that there is no abnormality with the feature amount of the inspection target image, and inspects based on the comparison result and the threshold value 406. An abnormality in the target image may be detected.

[Specific example of operation of synthesis unit 410]
Hereinafter, the specific operation of the synthesis unit 410 will be described with reference to FIGS. 5 to 8. First, a composite image generated by the composite unit 410 will be described with reference to FIG. FIG. 5 is a diagram showing an example of how the compositing unit 410 generates a composite image 550 from the target image 500.

The target image 500 is shown on the upper side of FIG. On the other hand, on the lower side of FIG. 5, a composite image 550 in which the target image 500 and the sample images 555 to 595 are combined is shown.

The target image 500 includes partial images 505, 510, 515, 520, 525, 530, 535, 540, 545, 546 and 547. Each partial image is an image extracted by the synthesis unit 410. The partial image includes a background, figures, characters, and the like. For the sake of brevity, it is assumed that the image features related to the contrast of each partial image are uniform. The partial image will be described in detail with reference to FIG.

The synthesis unit 410 produces sample images 555,560,565,570,575,580,585,590 and 595. The synthesis unit 410 generates a composite image 550 by synthesizing the sample image and the target image 500. More specifically, the synthesis unit 410 extracts partial images 505 to 545 from the target image 500 by scanning the target image 500. The synthesizing unit 410 generates a synthesizing image 550 by synthesizing each of the extracted partial images 505-545 and the sample images 555-590. In the example of FIG. 5, sample images are not combined with the partial image 546 showing the number of pages and the background partial image 547 for the sake of simplification of explanation.

The file formats of the target image, sample image, and composite image are not limited. The file format may be, for example, JPEG (Joint Photographic Experts Group), PNG (Portable Network Graphics), or PDF (Portable Document Format). Details of the operation of the compositing unit 410 to generate a sample image will be described later with reference to FIGS. 7 and 8.

Next, with reference to FIGS. 6 and 7, the detection of information on the partial image extracted from the target image by the synthesis unit 410 and the storage format thereof will be described. FIG. 6 is a diagram showing an example of a list of partial images 505 to 545 extracted from the target image 500. FIG. 7 is a diagram showing an example of a list in which each partial image and an image feature amount in each partial image are related.

The synthesis unit 410 stores the list 450 (FIG. 6) of the partial images 505 to 545 extracted from the target image 500 in the storage unit 420. For each of the partial images 505 to 545, the synthesizing unit 410 detects an image feature amount from an image of a predetermined partial region of the partial image, for example, an image of a central region of the partial image. The synthesis unit 410 generates the list 460 of FIG. 7 by associating the detected image feature amount with the partial image of the list 450, and stores the list 460 in the storage unit 420. In another aspect, the partial region may be a region different from the central region of the partial image.

Listing 460 includes brightness data 705 indicating brightness, brightness data 710 indicating brightness, and color data 715 indicating hue as data representing the amount of image features detected from the partial image. In other aspects, the data representing the image features may include density, saturation and the like.

For example, the brightness data 705, the luminance data 710, and the color data 715 for the partial image 505 are “Ma”, “Ka”, and “Ca”, respectively. The above data for the partial image 510 are "Mb", "Kb", and "Cb", respectively. The above data for the partial image 515 are "Mc", "Kc", and "Cc", respectively. Hereinafter, the same applies to the partial images 520 to 545.

The compositing unit 410 determines the contrast between the image of the predetermined partial region in the partial image and the sample image and the size of the sample image based on the detected image feature amount and the threshold value corresponding to the detection level. do. The synthesis unit 410 determines the contrast between the image in the central region of the partial image 505 and the generated sample image based on, for example, the data “Ma”, the brightness data “Ka”, and the color data “Ca”, and the sample image. The size of the sample image and the brightness, brightness, and hue are determined so that the linear sum with the size is a predetermined value equal to or less than the threshold value corresponding to the detection level.

A sample image 555 with respect to the partial image 505 will be described more specifically. For example, when the threshold value corresponding to the detection level of "level 1" is "10", the compositing unit 410 sets the lightness "Ma", the brightness "Ka", and the hue "Ca" of the partial region in the partial image 505 as a sample. The brightness, brightness, hue and size of the sample image 555 are determined so that the linear sum of the contrast based on the brightness, brightness and hue of the image 555 and the size of the sample image 555 is equal to or less than the threshold value "10". do.

The compositing unit 410 determines the size, brightness, brightness, and hue of the corresponding sample image for the other partial images as well as the partial image 505.

In another aspect, the compositing unit 410 may determine only one of the contrast and the size of the sample image based on the image feature amount and the threshold value. In still another aspect, the compositing unit 410 does not have to synthesize all of the extracted partial images with the sample image. That is, the compositing unit 410 may synthesize at least one of the partial images and the corresponding sample image.

The synthesizing unit 410 generates a composite image by arranging the sample image in a predetermined partial region of the partial image and synthesizing the partial image and the sample image. In certain aspects, the predetermined subregion includes the central region of the subimage.

FIG. 8 is a diagram showing an example of how the sample image 560 arranged in the partial image 520 by the compositing unit 410 changes according to the detection level.

In the example of FIG. 8, it is assumed that the detection level is set by the user operation 440 to any one of the three levels of "level 1", "level 2", and "level 3". The area 800 around the partial image 520 is shown enlarged for convenience of explanation. Further, the darker the hatching, the higher the density of the image.

The compositing unit 410 changes the contrast between the partial image 520 and the sample image 560 and the size of the sample image 560 according to the threshold value corresponding to the detection level set by the user operation 440.

Generally, the higher the detection level, the higher the accuracy of abnormality detection by the abnormality detection unit 405. Therefore, the higher the detection level is set by the user, the more accurate the user wants to be detected. At this time, the user's tolerance for abnormalities is low. Therefore, in FIG. 8, as the detection level changes from “level 1” → “level 2” → “level 3”, the user's tolerance for abnormality becomes lower.

Here, as described above, the sample image is an image that models an abnormality that is expected to occur in the image to be inspected. Therefore, as the detection level increases, that is, as the user's tolerance for anomalies decreases, the compositing unit 410 generates the sample image in a relatively inconspicuous manner. More specifically, the compositing unit 410 determines the brightness, brightness, and hue of the sample image 560 so that the contrast between the partial image 520 and the sample image 560 becomes smaller. Further, the synthesis unit 410 determines the size of the sample image 560 so that the size of the sample image 560 becomes smaller as the detection level becomes higher for the same reason. The same applies to other partial images.

In this way, the compositing unit 410 generates a sample image having an image feature amount and a size determined based on the detection level, and arranges the generated sample image in each partial image to generate a composite image. ..

[Specific example of UI for setting the detection level using a composite image]
Hereinafter, a specific example of the UI 415 for setting the detection level using the composite image will be described with reference to FIGS. 9 to 12. In a certain aspect, the screens shown in FIGS. 9 to 12 are displayed on the operation panel 160.

FIG. 9 is a diagram showing an example of a screen 901 that displays a list of various buttons operated by the user to accept job settings. The screen 901 includes a button group 902, an automatic inspection setting execution button 903, a level setting button 906, and a sample output button 909.

The button group 902 includes various buttons operated for making detailed settings of the job ticket. The job ticket is control data that defines various conditions for image formation and post-processing in a print job.

The automatic inspection setting execution button 903 is a button that is operated when the user decides to set the detection level for an abnormality. The user can select either "do" or "do not" perform the automatic inspection by operating the automatic inspection setting execution button 903. When the user selects "to" perform automatic inspection, the detection level can be set by operating the level setting button 906 or the sample output button 909. On the other hand, when the user selects "No" for automatic inspection, the detection level is not set. At this time, the abnormality detection unit 405 uses the detection level that has already been set.

The level setting button 906 is a button operated by the user to set the detection level without activating UI415.

The sample output button 909 is a button for the user to activate UI415. When the user operates the sample output button 909, the UI 415 described with reference to FIGS. 10 to 13 is activated. More specifically, the sample output button 909 is a button for the user to display a screen (screen 435 described later) on which a composite image corresponding to each detection level is displayed on the operation panel 160.

FIG. 10 is a diagram showing an example of a setting screen of UI415 when the detection level is “level 1”. The UI415 setting screen includes a detection level setting screen 925. The detection level setting screen 925 includes an operation unit 430, a screen 435, an indicator bar 900, a detailed display button 905, a text box 907, an OK button 910, a cancel button 915, and a message 920.

The operation unit 430 is realized by an operation panel 160 including a touch screen. In the example of FIG. 10, the user can set the detection level according to the position of the indicator bar 900 by sliding the indicator bar 900 included in the operation unit 430 up or down. More specifically, the user can set either "level 1", "level 2" or "level 3" by the slide operation. In other aspects, the operating unit 430 may be implemented as a physical button on the operating panel 160.

The screen 435 displays a composite image according to a threshold value corresponding to a detection level set by the user. In the example of FIG. 10, the detection level is "level 1" set by the user operation 440.

On screen 435, sample images 555,560,565,570,575,580,585,590 and 595 and marks 557,562,567,572,577,582,587,592 and 597 included in each partial image. It is shown. The marks 557 to 597 are marks displayed on the screen 435 to make it easier for the user to confirm the display location of each sample image 555 to 595. These sample images have image features such as brightness, brightness, and hue, depending on the "level 1" detection level. For example, the sample image 560 shown in FIG. 10 corresponds to the sample image 560 when the detection level is “detection level 1” in FIG.

The detail display button 905 is operated by the user to display the details of each partial image on the screen 435. The screen displayed on the operation panel 160 when the user operates the detail display button 905 is switched to the screen described with reference to FIG. The screen will be described later.

The text box 907 indicates an identifier of the target image displayed on the screen 435. The identifier of the text box 907 indicates that the target image on the 12th page is displayed on the screen 435 among the target images for each page from the 1st page to the 30th page included in the job.

The OK button 910 accepts a user operation that reflects the detection level set by the user operation 440 in the UI 415 in the abnormality detection by the abnormality detection unit 405. More specifically, the user determines the detection level by operating the OK button 910. The abnormality detection unit 405 detects an abnormality in the image to be inspected based on a threshold value corresponding to the determined detection level.

The cancel button 915 accepts a user operation for canceling the detection level setting. More specifically, by operating the cancel button 915, the user can switch the screen displayed on the operation panel 160 to the screen 901 and cancel the detection level setting.

The message 920 displays "If the above abnormality occurs when printing the currently set job at the selected level, it will be detected". Message 920 explains to the user that the detection level setting screen 925 is a screen that displays a UI that accepts an operation for setting a detection level for abnormality detection.

The relationship between the screen 435 and the operation unit 430 will be described in more detail. When the user slides the indicator bar 900 included in the operation unit 430 up or down, the operation unit 430 detects the detection level set by the user based on the slide amount. The conversion unit 422 converts the detected detection level into the corresponding threshold value. The compositing unit 410 sets the image feature amounts and sizes of the sample images 555,560,565,570,575,580,585,590 and 595 displayed on the screen 435 based on the converted threshold value. As a result, the feature amount and size of the sample image in the composite image displayed on the screen 435 change in conjunction with the slide operation of the indicator bar 900 by the user. At this time, the user can visually confirm the change in contrast in the composite image linked to the slide operation. Therefore, the user can determine the user's visual tolerance for anomalies, or detection level, while checking the changes in contrast and size in the displayed composite image.

FIG. 11 is a diagram showing an example of a setting screen in UI415 when the detection level is “level 2”. In FIG. 11, as in FIG. 10, the operation unit 430, the screen 435, the indicator bar 900, the detailed display button 905, the text box 907, the OK button 910, the cancel button 915, and the message 920 are detected. The level setting screen 925 is shown. These are the same as those described with reference to FIG.

On the screen 435, sample images 555 to 595 included in each partial image are shown. These sample images are the same as the sample images 555-595 described with reference to FIG.

As described above, when the user changes the detection level from "level 1" (FIG. 10) to "level 2" (FIG. 11) by sliding the indicator bar 900, the image feature amount of each sample image 555-590 And the size change in conjunction with the slide operation. Therefore, the contrast between each of the sample images 555 to 595 of FIG. 11 and the corresponding partial image, and the size of the sample image are different from those of the image of FIG. More specifically, when the detection level is "detection level 2" in FIG. 11, the user's tolerance for abnormality is lower than when the detection level is "detection level 1" in FIG. , The contrast between each sample image and the corresponding partial image and the size of the sample image are small.

FIG. 12 is a diagram showing an example of a setting screen in UI415 when the detection level is “level 3”. In FIG. 12, similarly to FIGS. 10 and 11, the operation unit 430, the screen 435, the indicator bar 900, the detailed display button 905, the text box 907, the OK button 910, the cancel button 915, and the message 920. And the detection level setting screen 925 are shown. These are the same as those described with reference to FIGS. 10 and 11.

Further, on the screen 435, sample images 555 to 595 included in each partial image are shown. These sample images are the same as the sample images 555-595 described with reference to FIGS. 10 and 11.

Here, when the user changes the detection level from "level 2" (FIG. 11) to "level 3" (FIG. 12) by sliding the indicator bar 900, the image feature amount and size of each sample image 555-595 Changes in conjunction with the slide operation. Therefore, the contrast between each of the sample images 555 to 595 of FIG. 12 and the corresponding partial image, and the size of the sample image are different from those of the image of FIG. More specifically, when the detection level is "detection level 3", the contrast between each sample image and the corresponding partial image and the sample are compared with the case where the detection level is "detection level 2". The size of the image is small.

As described above, in FIGS. 10 to 12, the user detects while visually confirming the contrast between the sample image and the partial image and the size of the sample image, which change in conjunction with the operation of the indicator bar 900. The level can be set to any of "level 1" to "level 3".

A UI for displaying the details of the partial image included in the composite image will be described with reference to FIG. FIG. 13 is a diagram showing an example of a UI for displaying the details of the partial image included in the composite image. By operating the detail display button 905, the user can display the details of the partial image in the composite image on the screen 435 as the UI 415.

In FIG. 13, the operation unit 430, the screen 435, the indicator bar 900, the text box 907, the OK button 910, the cancel button 915, the message 920, the detection level setting screen 925, and the back button 1205 are shown. ing. The components other than the message 920 and the back button 1205 are the same as those described with reference to FIGS. 10 to 12.

The text box 907 indicates that the screen 435 displays the target image on the twelfth page, as in FIGS. 10 to 12. Further, on the screen 435, a balloon 1200 indicating that "the number of partial images on the page" is 11. is displayed. The "number of partial images on the page" corresponds to 11, which is the number of partial images 505 to 545 in lists 450 and 460. “6/11” indicates that the sixth partial image 530 out of the 11 partial images is displayed on the screen 435. The user can display the details of the other partial images out of the 11 partial images on the screen 435 by changing "6/11" displayed in the text box 907, for example.

When the user switches the detection level by sliding the indicator bar 900, the feature amount and size of the sample image 580 are linked to the sliding operation as described with reference to FIGS. 8 and 10 to 12. Change. From the screen of FIG. 13, the user can set the detection level while observing how the enlarged sample image changes according to the change of the detection level.

The back button 1205 combines the screen displayed on the screen 435 with the screen of FIG. 13 displaying the details of the partial image (hereinafter, also referred to as “first screen”) as shown in FIGS. 10 to 12. This button is operated by the user to switch between a screen displaying the entire image (hereinafter, also referred to as a "second screen"). When the UI 415 accepts the operation of the back button 1205, the first screen is switched to the second screen. As a result, the screen 435 can be displayed by switching between the first screen that displays what the sample image looks like in the entire page and the second screen that displays the details of the sample image.

[Control structure for setting the detection level]
Hereinafter, the control structure of the printing apparatus 100 according to the present embodiment will be described with reference to FIGS. 14 and 15. FIG. 14 is a flowchart showing an example of processing executed by the printing apparatus 100. In a certain aspect, the operation of the printing apparatus 100 shown below is realized by the CPU 200 executing the control program stored in the ROM 202.

In step S1305, the CPU 200 receives a job from the client terminal 140 via the communication I / F 215. The CPU 200 stores the received job in the HDD 210. The job includes an image to be printed.

In step S1307, the CPU 200 acquires a print target image from the job stored in the HDD 210. In a certain aspect, the target image is the target image 500 described with reference to FIG.

In step S1310, the CPU 200 accepts a user operation for displaying the screen 435 for setting the detection level by displaying the screen 901 on the operation panel 160. The CPU 200 receives a signal from the operation panel 160 indicating that the sample output button 909 has been operated by the user. The CPU 200 activates the UI 415 based on the signal.

In step S1325, the CPU 200 synthesizes the sample image and the target image acquired in step S1307 as the compositing unit 410. Details of the process will be described later with reference to FIG.

In step S1330, the CPU 200 displays a composite image corresponding to the detection level set by the user operation 440 on the screen 435. The composite image is a composite image generated in step S1325. In a certain aspect, the CPU 200 displays the composite image of FIGS. 10 to 13 on the operation panel 160.

In step S1335, the CPU 200 determines the detection level based on the user operation. More specifically, when the user presses the OK button 910, the CPU 200 determines the detection level.

In step S1340, the CPU 200 acquires the inspection target image as the reading acquisition unit 400.

In step S1345, the CPU 200 detects an abnormality in the inspection target image acquired in step S1340 by using the detection level determined in step S1335 as the abnormality detection unit 405. More specifically, the CPU 200 compares the image feature amount of the target image acquired in step S1307 with the image feature amount of the inspection target image, and the result of the comparison and the determined detection. Abnormality of the image to be inspected is detected based on the threshold value corresponding to the level.

In step S1347, the CPU 200 causes the image forming unit 105 to print at least one of the partial image in which the sample image is combined and the composite image on paper. As a result, the user can set the detection level using the UI 415 after confirming not only the state in which the images are displayed on the operation panel 160 but also the state in which the images are actually printed on the paper.

In step S1350, the CPU 200 stores the image of the abnormal portion detected in step S1345 as history information 445 in the storage unit 420 as the abnormality detection unit 405 in association with the detection level. As a result, the image of the abnormal portion in the inspection target image detected in step S1345 can be used as a sample image in the next and subsequent print jobs. After that, the CPU 200 ends a series of processes.

FIG. 15 is a flowchart showing details of a process (step S1325 in FIG. 14) in which the synthesizing unit 410 synthesizes the sample image and the target image.

In step S1405, the CPU 200, as the synthesis unit 410, extracts a partial image by scanning the target image, generates a list 450 of the extracted partial images, and stores the list 450 in the storage unit 420.

In step S1410, the CPU 200, as the compositing unit 410, acquires the feature amount (brightness, brightness and hue value in the center of the image) from each partial image in the list 450 generated in step S1405, and stores the feature amount (brightness, brightness and hue value in the center of the image) in association with the corresponding partial image. Store in unit 420. As a result, the list 460 of FIG. 7 is stored in the storage unit 420.

In step S1415, the CPU 200, as the synthesis unit 410, generates an abnormal sample image for each partial image extracted in step S1405. In one aspect, the sample image is a sample image 555-595 described with reference to FIG.

In step S1420, the CPU 200 generates a composite image in which the abnormal sample image is synthesized in the center of each partial image as the synthesis unit 410. In one aspect, the composite image is the composite image 550 described with reference to FIG. After that, the CPU 200 returns the control to step S1330.

[Modification 1]
Hereinafter, a modification 1 of the present embodiment will be described with reference to FIG. FIG. 16 is a diagram showing an example of a user operation for moving a sample image synthesized on the partial image 530 on the first screen.

In FIG. 16, as in FIG. 13, the operation unit 430, the screen 435, the indicator bar 900, the text box 907, the OK button 910, the cancel button 915, the message 920, the detection level setting screen 925, and the like. The back button 1205 is displayed. In FIG. 16, a user's finger 1505 for moving the sample image 580 is placed on the detection level setting screen 925. The components other than the user's finger 1505 are the same as those described with reference to FIG.

In the example of FIG. 16, the operation unit 430 accepts a drag operation of the sample image 580 by the user's finger 1505. As a result, the user can move the sample image 580 on the detection level setting screen 925. In other aspects, the user may move the sample image 580 by using a keyboard 322, a mouse, a touch pen, and the like.

In still other aspects, the user may move the sample image by dragging on the second screen described with reference to FIGS. 10-12. That is, the user can move the sample image combined with the partial image on both the first screen and the second screen.

In this way, when the operation unit 430 accepts the user operation 440 as described above, the user can set the detection level in consideration of all the places where an abnormality may occur.

[Modification 2]
Hereinafter, a modification 2 of the present embodiment will be described with reference to FIGS. 17 to 19. FIG. 17 is a diagram showing an example of how the composite image is divided into each area on the screen 435 in order for the user to set the detection level for each area.

In FIG. 17, the area 1600, the area 1605, and the area 1610 included in the composite image 550 are displayed on the screen 435. Refer to FIG. 5 for partial images 505, 510, 515, 520, 525, 530, 535, 540 and 545 in FIG. 17, and sample images 555, 560, 565, 570, 575, 580, 585, 590 and 595. It is similar to those described in.

The user can draw a closed curve on the screen on which the composite image is displayed by a user operation using a finger 1505, a mouse, a touch pen, or the like. In response to the user operation, the operation unit 430 accepts the region in the closed curve as a region designated by the user (also referred to as a "first designated region"). In another aspect, in response to the user touching at least one partial image, the operation unit 430 may accept the area where the at least one partial image exists as the area designated by the user. ..

Based on the received operation, the UI 415 divides the composite image 550 into a plurality of areas designated by the closed curve and displays the composite image 550. In the example of FIG. 17, the composite image 550 is divided into three areas, an area 1600 specified by the user and an area 1605 and an area 1610 different from the area specified by the user, and displayed by the operation of the user. Has been done. An area different from the area designated by the user is also referred to as a "second designated area".

Thereby, the user can set the detection level for the target image in the area 1600 designated by the user and the target image in the different areas 1605 and 1610, respectively, via the UI415. When the detection level is set by the user, the operation unit 430 accepts a user operation for setting a threshold value corresponding to the set detection level in the areas 1600 and the areas 1605 and 1610, respectively.

FIG. 18 is a diagram showing an example of a list of partial images included in the area designated by the user.

In FIG. 18, the list 1705 of the partial images 505, 510, 515 and 520 included in the region 1600 and the list 1700 in which the brightness data 705, the brightness data 710 and the color data 715 corresponding to each of the partial images are associated with each other. It is shown.

The synthesis unit 410 extracts the partial images 505 to 520 included in the region 1600 from the partial images 505 to 547 included in the target image 500. The synthesis unit 410 generates a list 1700 in which each of the extracted partial images is associated with the brightness data 705, the luminance data 710, and the color data 715, and stores the list 1700 in the storage unit 420. Each of the relevant data is the same type of data as the data described with reference to FIG.

When the detection level in the area 1600 is set by the user, the compositing unit 410 uses the partial image included in the area 1600 based on the threshold value corresponding to the detection level and the brightness data 705, the brightness data 710 and the color data 715. Generate sample images for each of 505-520.

FIG. 19 is a diagram showing an example of a list of partial images included in an area different from the area specified by the user.

In FIG. 19, the list 1805 of the partial images 525, 530, 535, 540 and 545 included in the regions 1605 and 1610 is related to the brightness data 705, the brightness data 710 and the color data 715 corresponding to each of the partial images. List 1800 with is shown.

The synthesis unit 410 extracts the partial images 525 to 547 included in the regions 1605 and 1610 from the partial images 505 to 547 included in the target image 500. The synthesis unit 410 generates a list 1800 in which each of the extracted partial images is associated with the brightness data 705, the luminance data 710, and the color data 715, and stores the list 1800 in the storage unit 420. In the example of FIG. 19, partial images 546 and 547 are not shown for simplification of explanation. Each of the relevant data is the same type of data as the data described with reference to FIG.

When the user sets the detection level in the areas 1610 and 1615, the compositing unit 410 sets the partial image 525 to 545 based on the threshold value corresponding to the detection level and the brightness data 705, the brightness data 710 and the color data 715. Generate a sample image for each of.

In this way, the compositing unit 410 sets the list of partial images related to the image features such as brightness, brightness, and hue into the area specified by the user and the area different from the area specified by the user, respectively. Correspondingly, it is stored in the storage unit 420.

The compositing unit 410 generates a sample image for each region according to the threshold value corresponding to the detection level set by the user for each region included in the compositing image. The synthesis unit 410 generates a composite image by synthesizing the sample image generated for each region and the target image.

By displaying the composite image on the screen 435, the user can set the detection level for each area while viewing the displayed composite image.

In another aspect, the compositing unit 410 may extract the partial image in the selected area selected by the user without extracting the partial image in the entire target image. For example, in the target image, even if an abnormality occurs in a partial image such as an area where the user cannot tolerate the abnormality when an abnormality occurs, such as the central area of the target image, and an area different from the central area, the user can use it. Includes an area where the anomaly can be tolerated.

At this time, the compositing unit 410 may generate the list 1700 without generating the list 1800. The compositing unit 410 may generate the list 1700 based on the list 1700 and based on the image features of the partial images 505 to 520. A sample image is generated for each of the images in. At this time, the synthesis unit 410 does not generate a sample image for the partial images 525 to 545. As a result, the user uses UI415 to save the trouble of setting the detection level in the partial image included in the area where the user can tolerate the abnormality, and then to the partial image included in the area where the user cannot tolerate the abnormality. On the other hand, the detection level can be set.

In still other aspects, the designation or selection of areas for which the user tolerates or disallows anomalies is not limited to user operations such as dragging. More specifically, the compositing unit 410 uses a known image processing algorithm stored in the ROM 200 or the like to generally determine that the user cannot tolerate an abnormality, such as the central region of the target image. May be automatically recognized and the target image may be divided into the area concerned and an area different from the area concerned. The UI 415 may ask the user which detection level is set for each divided area or whether an abnormality is not detected. As a result, the user can set the detection level for each automatically divided area in response to the inquiry.

[Modification 3]
Hereinafter, a modification 3 of the present embodiment will be described with reference to FIGS. 20 and 21. FIG. 20 is a diagram showing an example of a list of image feature amounts detected from a plurality of partial regions in a partial image by the compositing unit 410.

In FIG. 20, the list 1900 includes brightness data 705 indicating brightness, luminance data 710 indicating luminance, and color data 715 indicating hue as data representing the amount of image features detected from the partial image 505. Also, a plurality of partial regions 1925, 1930, 1935, 1940 and 1945 in the partial image are shown.

Listing 1900 shows that the brightness data 705, the luminance data 710 and the color data 715 corresponding to the partial region 1925 are “Ma1”, “Ka1” and color data “Ca1”, respectively.

Listing 1900 also shows that the brightness data 705, the luminance data 710 and the color data 715 corresponding to the partial region 1930 are "Ma2", "Ka2" and color data "Ca2", respectively. The same applies to the other subregions 1935, 1940 and 1945.

The compositing unit 410 generates and stores the list 1900 by detecting the corresponding image features such as brightness, brightness, and hue from the plurality of partial regions 1925, 1930, 1935, 1940, and 1945 in the partial image 505. Store in unit 420.

The synthesis unit 410 generates a composite image by arranging the sample image 555 in each of the plurality of partial regions in the partial image 505.

FIG. 21 is a diagram showing an example of a partial image in which a sample image is arranged in a plurality of partial regions. In FIG. 21, the partial image 505 on the screen 435 is shown enlarged for convenience of explanation.

Here, depending on the position of the sample image 555, the reference code of the image is used properly as 555A, 555B, 555C, 555D or 555E, but these represent the same sample image. Hereinafter, when these are collectively referred to, they are referred to as sample images 555.

The sample images 555A, 555B, 555C, 555D or 555E in the partial image 505 are sample images 555 arranged in a plurality of partial regions 1925, 1930, 1935, 1940 and 1945, respectively.

In this way, the UI 415 displays the composite image in which the sample image 555 is arranged by the composite unit in the plurality of partial areas, so that the user can make an abnormality at the position according to the position where the sample image 555 is arranged. The detection level can be set while visually confirming whether or not it is acceptable for the occurrence of. For example, the user can determine whether the sample image is acceptable when the sample image 555 is placed outside the central region of the partial image 505.

For example, the user may determine that the sample images 555B, 555C, 555D and 555E placed near the contour of the partial image 505 are unobtrusive and therefore acceptable, while the sample placed in the center of the partial image 505. Since the image 555A is conspicuous, it can be judged that it is not allowed.

At this time, as the user raises the detection level, the sample image 555 becomes smaller as the detection level is raised, as described with reference to FIGS. 10 to 13. Further, the contrast between the sample image 555 and the partial image 505 becomes smaller. As a result, if the user determines that the sample image 555A can be tolerated at the raised detection level, the raised detection level may be the level desired by the user.

In another aspect, the user may determine that none of the sample images 555A, 555B, 555C, 555D and 555E is conspicuous and therefore acceptable. At this time, the user does not need to raise the detection level. The user may choose not to change the detection level or to lower the detection level in order to tolerate possible anomalies and increase the productivity of the printing apparatus 100.

[Modification example 4]
In the present embodiment, as described above, the feature amount related to contrast includes brightness, brightness, hue and the like. Further, the feature amount may include at least one of an RGB gradation value and a YMCK gradation value. For example, when the compositing unit 410 generates a sample image using the YMCK gradation value as the feature amount, the UI 415 obtains a color difference based on the hue of the sample image and the hue of the corresponding partial image in the actual printed image. Can be displayed more like.

[Modification 5]
In FIGS. 14 and 15, a configuration example for realizing the processing required for the CPU 200 to execute the program is shown. In other aspects, some or all of these provided processes are implemented using dedicated hardware circuits (eg, dedicated circuits such as ASICs (Application Specific Integrated Circuits) or FPGAs (Field-Programmable Gate Arrays). May be done.

Further, the configuration shown in FIG. 4 may be realized by the client terminal 140. That is, the program that realizes each component in FIG. 4 may be stored in a storage unit such as HDD 315 of the client terminal 140, and the CPU 300 may read the program from the storage unit and execute the program. At this time, the CPU 300 acquires the target image and the inspection target image from the printing device 100. The client terminal 140 also provides the UI 415 with a keyboard 322 and a display 340.

Further, in the present embodiment, the program may be stored in the storage media 223, 318 instead of the HDDs 210 and 315. The storage media 223 and 318 include CD-ROM (Compact Disc --Read Only Memory), DVD-ROM (Digital Versatile Disk --Read Only Memory), USB (Universal Serial Bus) memory, memory card, FD (Flexible Disk), and magnetic. Tape, cassette tape, MO (Magnetic Optical Disc), MD (Mini Disc), IC (Integrated Circuit) card (excluding memory card), optical card, mask ROM, EPROM, EEPROM (Electronically Erasable Programmable Read-Only Memory), etc. A non-volatile storage medium may be used. Further, the printing device 100 may acquire the program by downloading via, for example, the communication line 145.

Further, in the present embodiment, the reading acquisition unit 400, the abnormality detection unit 405, the synthesis unit 410, and the conversion unit 422 are realized as a configuration in the printing device 100. In another aspect, the above components may be realized as components in the printing system 50 including the printing apparatus 100. That is, the above-mentioned component is a control program for the computer included in the printing system 50 to execute the operation described in the present embodiment, and executes the program stored in the storage unit in the printing system. May be realized by. The storage unit in the printing system is realized by a storage medium such as an HDD included in the printing system.

[Advantages of Embodiment]
The advantages of the embodiments and the modifications 1 to 5 will be described with reference to FIGS. 22 to 24. 22 to 25 are diagrams showing an example of an image formed on the paper, respectively.

In FIG. 22, the paper 2100, the background image 2105, the figure 2107, and the abnormality candidate image 2110 are shown. It is assumed that the background image 2105, the figure 2107, and the abnormality candidate image 2110 are images formed by the image forming unit 105. Further, it is assumed that the hatched portion in FIG. 22 has a predetermined concentration, that is, is not plain.

The abnormality candidate image 2110 is a candidate image that can be detected as an abnormality by the abnormality detection unit 405. However, as in the example of FIG. 22, when the abnormality candidate image 2110 is located near the contour of the figure 2107 and the contrast between the background image 2105 and the abnormality candidate image is small, the user may have the abnormality candidate image 2110. It can be judged to be inconspicuous and its existence can be tolerated. Therefore, when it is assumed that the abnormality candidate image 2110 may occur in the vicinity of the contour of the figure, the user does not need to raise the detection level.

In FIG. 23, the paper 2100, the background image 2200, and the abnormality candidate image 2205 are shown. It is assumed that the background image 2200 and the abnormality candidate image 2205 are images formed by the image forming unit 105. Further, it is assumed that the contrast between the background image 2200 and the abnormality candidate image 2205 is larger than the value that the user can tolerate, and the user does not allow the existence of the abnormality candidate image 2205. Therefore, the user needs to raise the detection level so that the abnormality candidate image 2205 can be determined to be abnormal depending on the position where the abnormality candidate image 2205 can occur.

Here, by using the UI 415, the user can set the detection level while looking at the composite image assuming an abnormality that may occur in the printed image. Therefore, not only the contrast between the anomaly candidate image 2110 or 2205 that can occur and the background image thereof, the size of the anomaly candidate image, but also the position where the anomaly can occur in the inspection target image, the abnormality in the inspection target image, etc. After visually confirming whether or not the user can tolerate it, the user can set the desired detection level.

In FIG. 24, the paper 2100, the abnormality candidate image 2300, and the printed image 2305 are shown. In FIG. 25, the paper 2100, the abnormality candidate image 2400, and the printed image 2405 are shown. The printed images 2305 and 2405 and the abnormality candidate images 2300 and 2400 are images formed by the image forming unit 105.

The abnormality candidate image 2300 is located near the contour of the printed image 2400. On the other hand, the abnormality candidate image 2400 is located slightly above the central portion of the printed image 2400. At this time, it is assumed that the contrast between the abnormality candidate image 2300 and the printed image 2305 and the contrast between the abnormality candidate image 2400 and the printed image 2405 are the same. Further, it is assumed that the size of the abnormality candidate image 2300 and the size of the abnormality candidate image 2400 are the same. Further, in the examples of FIGS. 24 and 25, it is assumed that the user allows the abnormality candidate image 2300 and does not allow the abnormality candidate image 2400.

At this time, if the inspection target image corresponding to the abnormality candidate image 2300 and the print image 2305 and the inspection target image corresponding to the abnormality candidate image 2300 and the print image 2305 are different in the position where the abnormality can occur, the abnormality is found. Even if the contrast between the candidate image and the printed image and the size of the abnormal candidate image are the same, whether or not the user can visually tolerate the abnormal candidate image may differ depending on the image to be inspected. By using UI415, the user can set a desired detection level in anticipation of such a case.

Therefore, according to the printing apparatus 100, the accuracy of spoilage detection is improved. That is, it is possible to suppress inspection omissions caused by an image determined by the user to have an abnormality as an image in which an abnormality has not occurred by the abnormality detection algorithm. In addition, it is possible to suppress unexpected abnormality detection in which an image that is determined by the user that no abnormality has occurred is determined as an image in which an abnormality has occurred by the abnormality detection algorithm. As a result, it is possible to suppress the resetting of the printing device, the reprinting of the printed matter, and the like, and it is possible to improve the work efficiency and the quality of the printed matter.

It should be considered that the embodiments disclosed this time are exemplary in all respects and not restrictive. The scope of the present invention is shown not by the above description but by the scope of claims, and it is intended that all modifications are included in the meaning and scope equivalent to the scope of claims.

100 printing device, 103 paper feeding unit, 105 image forming unit, 115 reading device, 140 client terminal, 160 operation panel, 400 reading acquisition unit, 405 abnormality detection unit, 410 compositing unit, 430 operation unit, 445 history information, 900 indicator Bar, 905 detail display button, 909 sample output button, 925 detection level setting screen.

Claims (22)

A reading acquisition unit that acquires an inspection target image by reading an image formed by printing the printing target image on a medium, and a reading acquisition unit.
An abnormality detection unit that compares an image feature amount of the target image with an image feature amount of the inspection target image and detects an abnormality of the inspection target image based on the comparison result and a threshold value.
A compositing unit that generates a composite image by synthesizing a sample image for an abnormality of the inspection target image and the target image.
It is provided with a screen for displaying the composite image and a user interface including an operation unit for receiving a user operation for setting the threshold value.
The synthesis part
A printing device that changes the image feature amount of the sample image based on the threshold value set by the user operation received by the operation unit. The printing device further includes a storage unit.
The printing apparatus according to claim 1, wherein the compositing unit extracts a partial image from the target image and stores a list of the extracted partial images in the storage unit. The compositing unit detects the image feature amount from a predetermined partial region in the extracted partial image, and stores the detected image feature amount in the storage unit in association with the partial image in the list. The printing apparatus according to claim 2. The partial image includes a figure and
The printing apparatus according to claim 3, wherein the image feature amount includes an image feature amount related to contrast. The printing apparatus according to claim 4, wherein the image feature amount relating to the contrast includes at least one of brightness, brightness, hue, density and saturation. The printing apparatus according to any one of claims 3 to 5, wherein the predetermined partial region in the partial image includes a plurality of partial regions in the partial image. The storage unit stores an image of an abnormal portion of the inspection target image detected by the abnormality detection unit.
The printing apparatus according to any one of claims 3 to 6, wherein the sample image includes an image of the abnormal portion of the inspection target image stored in the storage unit. A claim that the synthesis unit determines the contrast between the image of the predetermined partial region in the partial image and the sample image and the size of the sample image based on the detected image feature amount. The printing apparatus according to any one of items 3 to 7. The printing apparatus according to any one of claims 3 to 8, wherein the compositing unit generates the composite image by arranging the sample image in the predetermined partial region of the partial image. The printing apparatus according to claim 6, wherein the compositing unit generates the composite image by arranging the sample image in each of the plurality of partial regions in the partial image. 9. The printing apparatus described in. The printing apparatus according to claim 11, wherein the user interface includes a second screen for displaying the composite image in which the sample image is synthesized into at least one of the partial images by the synthesis unit. The printing apparatus according to claim 12, wherein the user interface switches between the first screen and the second screen for display. The printing apparatus according to claim 12 or 13, wherein the operation unit accepts a user operation for moving the sample image synthesized on the partial image on the first screen or the second screen. The printing apparatus according to any one of claims 11 to 14, wherein the printing apparatus prints at least one of the partial image in which the sample image is synthesized and the composite image on a medium. The printing apparatus according to any one of claims 2 to 15, wherein the compositing unit extracts the partial image in a selection area selected by the user of the target image. The compositing unit associates the list of the partial images with which the image feature amount is associated with the first designated area and the second designated area different from the first designated area, respectively, and stores the stored image. The printing apparatus according to any one of claims 2 to 15, which is stored in a unit. The printing apparatus according to claim 17, wherein the operation unit receives a user operation for setting the threshold value for the target image in the first designated area and the target image in the second designated area, respectively. .. The printing according to claim 4 or 5, wherein the image feature amount relating to the contrast includes at least one of an RGB (Red, Blue, Green) gradation value and a YMCK (Yellow, Cyan, Magenta, Key plate) gradation value. Device. The image feature amount of the print target image is compared with the image feature amount of the inspection target image acquired by reading the target image printed on the medium, and the inspection is performed based on the comparison result and the threshold value. Anomaly detection unit that detects anomalies in the target image,
A compositing unit that generates a composite image by synthesizing a sample image for an abnormality of the inspection target image and the target image.
It is provided with a screen for displaying the composite image and a user interface including an operation unit for receiving a user operation for setting the threshold value.
The synthesis part
An information processing device that changes the image feature amount of the sample image based on the threshold value set by the user operation received by the operation unit. A step of acquiring an inspection target image read from an image formed by printing the print target image on a medium, and a step of acquiring the inspection target image.
A step of detecting an abnormality in the inspection target image based on a comparison result between the image feature amount of the target image and the image feature amount of the inspection target image and a threshold value.
A step of generating a composite image by synthesizing a sample image for an abnormality of the inspection target image and the target image.
The step of displaying the composite image and
The step of accepting the user operation for setting the threshold value and
A method comprising the step of changing the image feature amount of the sample image based on the threshold value set by the accepted user operation. On the computer
A step of acquiring an inspection target image read from an image formed by printing the print target image on a medium, and a step of acquiring the inspection target image.
A step of detecting an abnormality in the inspection target image based on a comparison result between the image feature amount of the target image and the image feature amount of the inspection target image and a threshold value.
A step of generating a composite image by synthesizing a sample image for an abnormality of the inspection target image and the target image.
The step of displaying the composite image and
The step of accepting the user operation for setting the threshold value and
A program for executing a step of changing the image feature amount of the sample image based on the threshold value set by the user operation received.

Images