JP2018023022A - Image processing system and image processing method - Google Patents

Abstract

In an image forming apparatus, there is provided a technique for correcting and outputting errors and dirt when copying an output document. An image forming apparatus scans a document to be copied, obtains original document data D11, and displays the original document data on a display panel unit. In the original document data D11 on the display panel unit, the correction part A11 is designated by the user. The image data of the corrected portion A11 is transmitted to the mobile terminal and is enlarged and displayed on the display panel unit of the mobile terminal. By the user's operation, the copy portion C11 to be inserted into the corrected portion is selected from the original document data D11 and transmitted to the portable terminal. In the portable terminal, a combined corrected portion A12 in which the copy portion C11 is inserted into the corrected portion A11 is obtained. The image data of the combined corrected portion A12 is transmitted to the image forming apparatus and printed out. [Selection] Figure 2

Description

  The present invention relates to an image processing system and an image processing method, and for example, relates to an image processing system and an image processing method having a function of correcting when outputting a document.

  2. Description of the Related Art Image forming apparatuses such as MFPs (multifunction peripherals) are becoming multifunctional in terms of hardware and software, and efforts are being made to differentiate them from other companies' products by introducing new functions. For example, due to improved display panel performance, a display panel with a touch function (which is simply referred to as a “touch panel”), which has traditionally only achieved button functions, can be used for various operations such as swiping and pinching out. It has come to be replaced by a touch panel.

  As an example of a software function, an image forming apparatus that reads a layout document and creates a desired document in a short time according to the layout document has been proposed (see, for example, Patent Document 1). When it is detected that the key input for performing the reading operation is the operation unit, the image forming apparatus stores an image read from the document and coordinates the rectangular region corresponding to the region marked on the document. Based on this, the stored image is cut out and written, and the image is printed out.

JP-A-8-235372

  By the way, when copying with the MFP, if there are mistakes in simple characters (several characters) in part of the text of the original document, or if there is dirt or scratches, Data was output as it was, and there was a need to introduce new technology. The technique disclosed in Patent Document 1 is a technique for creating a manuscript according to a predetermined format. There is no idea of correcting a manuscript that has already been output, and it cannot be applied as it is. It had been.

  This invention is made | formed in view of such a condition, and it aims at providing the technique which can solve the said subject.

The present invention is an image processing system including an image forming apparatus and a portable terminal, wherein the image forming apparatus includes an image acquisition unit that acquires image data of a document to be printed, and a display panel that displays the image data. A document correction unit that designates a correction area from the image data displayed on the display panel by a user operation and transmits the image data of the correction area to the portable terminal, and the portable terminal includes the image A terminal-side correction unit that acquires and corrects the image data of the correction area transmitted from the forming apparatus and transmits the corrected image data of the correction area to the image forming apparatus; and the document correction of the image forming apparatus The unit reflects the image data of the corrected area after the correction transmitted from the terminal side correction unit on the image data of the document and outputs the reflected image data. That.
The document correction unit extracts an area to be combined with the image data of the correction area in the terminal-side correction unit of the portable terminal from the image data of the document displayed on the display panel of the image forming apparatus. And the terminal-side correction unit generates the image data of the corrected area after the correction by combining the image data of the correction area and the image data of the composite area. Good.
An image processing method according to the present invention includes an image acquisition step of acquiring image data of a document to be printed, a display step of displaying the image data on a display panel, and correction from the image data displayed on the display panel A correction area specifying step for receiving an area specified by a user operation; and a document correction step for acquiring and correcting image data of the correction area in a correction execution device, wherein the document correction step displays the correction execution device. The image data of the correction area is displayed on the panel, and the image data of the correction area is combined with the image data of the correction area extracted from the image data of the document to be printed and the image data of the correction area. Correct and output the corrected image data of the corrected area in the image data of the document

  According to the present invention, in the image forming apparatus, it is possible to realize a technique of correcting and outputting errors and dirt when copying an output document.

1 is a functional block diagram illustrating a schematic configuration of an image processing system according to an embodiment. It is a figure explaining the flow which copies and corrects a character etc. from the document itself for correction concerning an embodiment. It is a figure explaining the flow which inputs a character etc. by setting (character input operation) on a portable terminal concerning an embodiment. 6 is a diagram illustrating an example of document data displayed on the display panel unit of the image forming apparatus and the display panel unit of the mobile terminal according to the embodiment. FIG. 6 is a diagram illustrating an example of document data displayed on the display panel unit of the image forming apparatus and the display panel unit of the mobile terminal according to the embodiment. FIG. It is a flowchart of the document correction process based on Embodiment. It is the figure which showed the example of a screen displayed when inputting correction content by character input operation of a portable terminal based on embodiment.

  Hereinafter, modes for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings. In this embodiment, when copying or printing with the image forming apparatus, if there is an error in the text of the document, if characters are not visible due to dirt or rubbing, or if you want to change the font or color In addition, we propose a technique for correcting documents using a mobile terminal such as a smartphone or tablet before printing.

  FIG. 1 is a functional block diagram showing a schematic configuration of the image processing system 1. The image processing system 1 includes an image forming apparatus 10 and a portable terminal 50, which are communicably connected.

  The image forming apparatus 10 is, for example, a multifunction peripheral (MFP) and includes a plurality of functions such as a print function, a scan function, and a FAX function. The portable terminal 50 is, for example, a tablet terminal or a smartphone.

  The image forming apparatus 10 includes a control unit 11, a communication processing unit 12, a storage unit 13, a print execution processing unit 14, a scan execution processing unit 15, a user IF 20, and a document correction unit 30.

  The control unit 11 includes an MPU (Micro-Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. It performs read processing, status monitoring processing of component operations, operation control, and the like.

  The communication processing unit 12 is a communication interface such as a wired LAN, a wireless LAN, or USB communication, and is communicably connected to the portable terminal 50 and other devices (such as a PC).

  The storage unit 13 has a capacity of 250 GB, for example. A print job for the number of copies in the print processing of the print execution processing unit 14 and a transmission job from the scan execution processing unit 15 are temporarily stored in the storage unit 13 and executed.

  The print execution processing unit 14 has a general print execution function, and executes print processing according to an instruction from the communication processing unit 12. The scan execution processing unit 15 has a general configuration and includes a scanner, a platen glass, a document reading slit, and the like, and executes a document reading process.

  The user IF 20 includes a display panel unit 21 and an operation input unit 22. The display panel unit 21 displays status information and operation information regarding the image forming apparatus 10. The operation input unit 22 receives a user operation on the image forming apparatus 10. Here, the operation input unit 22 is a touch panel interface configured integrally with the display panel unit 21 and accepts various operations such as swipe and pinch out.

  The document correction unit 30 includes a correction control unit 31 and a correction history recording unit 32. The correction control unit 31 cooperates with the portable terminal 50 when the image forming apparatus 10 performs copying, when there is a simple character mistake in a part of the text of the original document, dirt, or rubbing. If there is, correct it. Moreover, the portable terminal 50 to cooperate is registered in advance. Hereinafter, this process is referred to as a copy document correction process. The correction history recording unit 32 stores and records a history of copy document correction processing.

  The portable terminal 50 includes a control unit 51, a communication processing unit 52, a storage unit 53, a user IF 60, and a terminal side document correction unit 70.

  The control unit 51 includes an MPU, a ROM, a RAM, and the like, and executes an application or performs an interlocking process with other devices that are connected for communication by comprehensively controlling each component.

  The communication processing unit 52 is a communication interface such as a wired LAN, a wireless LAN, or USB communication, and is communicably connected to the image forming apparatus 10 and other devices.

  The storage unit 53 is, for example, a RAM or a memory card, and an application is installed or data is stored in the storage unit 53.

  The user IF 60 includes a display panel unit 61 and an operation input unit 62. The display panel unit 21 displays an application and displays an icon associated with the application. The operation input unit 62 receives a user operation on the mobile terminal 50. The display panel unit 61 and the operation input unit 62 are touch panel type interfaces configured integrally, and accept various operations such as swipe and pinch out.

  The terminal side document correction unit 70 includes a terminal side correction control unit 71 and a terminal side correction history recording unit 72. The terminal side correction control unit 71 performs a copy document correction process in cooperation with the image forming apparatus 10. The terminal-side correction history recording unit 72 records and stores a history of copy document correction processing. In particular, when image data used for correction (image data of a copy portion C11 described later) is stored, when similar correction occurs, processing using the image data can be performed.

The outline of the copy document correction process will be described with reference to FIGS.
FIG. 2 is a diagram for explaining a flow of copying and correcting characters and the like from the document to be corrected. In the image forming apparatus 10, the document to be copied is scanned by the scan execution processing unit 15, and the original document data D11 is obtained. The original document data D11 is temporarily stored in the storage unit 13 and displayed on the display panel unit 21.

  In the original document data D11 displayed on the display panel unit 21, the user designates a correction portion A11 that is an area to be corrected. The image data of the specified correction portion A11 is transmitted to the mobile terminal 50 and enlarged and displayed on the display panel unit 21 of the mobile terminal 50. It should be noted that it is desirable to set all the squares enclosed on the panel screen (display panel unit 21 and display panel unit 61) to have a fixed size so that the corrected data can be easily restored.

  Subsequently, the user uses the display panel unit 21 and the operation input unit 22 of the image forming apparatus 10 to select the content (that is, the copy portion C11) to be inserted into the correction portion from the original document data D11. The image data of the selected copy portion C11 is transmitted to the portable terminal 50.

  Next, the user uses the portable terminal 50 to insert and synthesize the copy portion C11 into the correction portion A11, and obtain a combined correction portion A12 in which the copy portion C11 is reflected. The image data of the combined corrected portion A12 is transmitted to the image forming apparatus 10, and is fitted into the area of the corrected portion A11 of the original document data D11 to obtain corrected document data D12. The user can obtain a document (corrected document data D12) in which an error has been corrected by printing out the corrected document data D12.

  FIG. 3 is a diagram for explaining a flow for inputting a character or the like by a setting on the portable terminal 50, that is, a character input operation, not a document to be corrected. The user designates the corrected portion A21 of the original document data D21 using the image forming apparatus 10. The image data of the specified correction portion A21 is transmitted to the portable terminal 50.

  In the portable terminal 50, characters to be inserted into the corrected portion A21 are generated as the terminal setting information F21 by the operation of the operation input unit 62. The terminal setting information F21 is combined with the corrected portion A21, and a combined corrected portion A22 reflecting the combination is generated. The image data of the combined corrected portion A22 is transmitted to the image forming apparatus 10, and is inserted into the area of the corrected portion A21 of the original document data D21 to obtain corrected document data D22. The user can obtain a document (corrected document data D22) in which an error has been corrected by printing out the corrected document data D22.

The copy document correction process will be described more specifically with reference to FIGS.
4 and 5 are diagrams showing examples of document data displayed on the display panel unit 21 of the image forming apparatus 10 and the display panel unit 61 of the portable terminal 50. FIG. FIG. 6 is a flowchart of the document correction process.

  The user operates the user IF 20 to select a copy output function (S10), and further selects a document correction processing function (S12). At this time, if the document to be copied is output from the image forming apparatus 10 and data is stored in the storage unit 13, a desired document is selected from the storage unit 13 (S14). Thereafter, designation of “portable terminal 50” or “image forming apparatus 10” is received as a device for executing correction (S16).

  When “portable terminal 50” is selected, the correction portion A11 is enlarged and displayed on the portable terminal 50 as described above with reference to FIGS. 2 and 3, and correction processing is performed on the display. When “image forming apparatus 10” is selected, the correction portion A11 or the like is displayed on the display panel unit 21 without using the portable terminal 50, and the correction process is performed only by the image forming apparatus 10. Hereinafter, a case where “portable terminal 50” is selected will be described. When the portable terminal 50 is selected, the correction control unit 31 may search for a device that has been registered and can communicate, and may display the searched portable terminal 50 in a selectable manner. Further, an instruction for starting up the document correction processing function may be given to the image forming apparatus 10 from the application of the portable terminal 50.

  When document selection and device selection are performed, as shown in FIG. 4A, original document data D11 is displayed on the display panel unit 21 of the image forming apparatus 10 (S18). Here, the original document data D11 is in landscape orientation. In this state, when the user selects the correction portion A11 by touching the display panel unit 21 and the operation input unit 22 (S20), the correction control unit 31 transmits the image data of the correction portion A11 to the portable terminal 50 (S22). ).

  When the image data of the corrected portion A11 is transmitted to the portable terminal 50, the corrected portion A11 is displayed on the display panel unit 61 of the portable terminal 50 as shown in FIG. 4B (S24). At this time, the terminal side correction control part 71 detects the direction of the correction part A11 using a character recognition function (for example, OCR function), and changes it to an appropriate direction. This process may be performed by the image forming apparatus 10, and image data in which the direction of the correction portion A <b> 11 is changed may be transmitted to the portable terminal 50. In FIG. 4B, there is a stain (unclear area B11) in the top line, and a part of the “interface block” sentence is unclear.

  In this state, when the user designates the unclear region B11 by a touch operation on the display panel unit 61 and the operation input unit 62, the replacement target region B12 is set with a predetermined size as shown in FIG. S26). This size may be a block area having a preset shape, or may be a block area having a shape designated by a user through a touch operation.

  When the cancel button Y1 is pressed, the display state before the replacement target area B12 is set is restored. When the OK button Y2 is pressed, the process proceeds to a process for specifying image data to be inserted into the replacement target area B12 (S28). In the image data designation process, either the original document data D11 is used as shown in FIG. 2, or a character or the like is input by a character input operation as shown in FIG. Hereinafter, an example using the original document data D11 will be described.

  In the process of specifying the image data to be inserted into the replacement target area B12, first, as shown in FIG. 5A, the user displays the original document data D11 displayed on the display panel unit 21 of the image forming apparatus 10. The copy portion C11 is selected by a touch operation on the panel unit 21 and the operation input unit 22 (S30). The copy portion C11 includes an area that the user wants to fit in the replacement target area B12. In other words, the portable terminal 50 selects an area to be inserted from the copy portion C11 into the replacement target area B12.

  After selecting the copy portion C11, the correction control unit 31 transmits the image data of the copy portion C11 to the portable terminal 50 (S32). As shown in FIG. 5B, the copy portion C11 is enlarged and displayed on the display panel unit 61 of the portable terminal 50 after the orientation is changed (S34). In this state, the user designates the copy image area C12 by touching the display panel unit 61 and the operation input unit 62 (S36). Here, the image area (copy image area C12) of “chair” is designated from the “device general setting” character string in the top line. When the cancel button Y3 is pressed, the operation / state selected at that time is canceled and the previous operation / state is restored.

  When the designation of the copy image area C12 is completed and the OK button Y4 is pressed, the combined corrected portion A12 in which the copy image area C12 is inserted into the replacement target area B12 is completed as shown in FIG. S38). When the cancel button Y5 is pressed, the operation / state selected at that time is canceled and the previous operation / state is restored.

  When the OK button Y6 is pressed after completion of the combined corrected portion A12, the terminal side correction control unit 71 transmits the completed combined corrected portion A12 to the image forming apparatus 10 (S40). In the image forming apparatus 10, the corrected document data D12 in which the combined corrected portion A12 is combined is displayed on the display panel unit 21 (S42). If the user determines that the correction is appropriate, the image data of the corrected document data D12 is printed out (S44).

  Note that, when the process proceeds to the image data designation process with reference to FIG. 7 (S28), any of the processes for inputting characters or the like by the character input operation as shown in FIG. 3 is selected. explain. FIG. 7 shows an example of a screen that is displayed when correction content is input by a character input operation of the mobile terminal. When the input process by the character input operation is selected, the correction content input screen E10 is displayed on the display panel unit 61 of the portable terminal 50 as shown in FIG. 7 instead of FIG. The correction content input screen E10 is provided with a character input field E11, a style input field E12, and a width designation field E13.

  Text is input to the character input field E11. Here, “chair” is input. In the style entry field E12, the type of text font is entered. It is configured to be selected from a plurality of lists. Fonts such as “Mincho” and “Gothic” are stored in a predetermined storage area (such as the storage unit 53) of the mobile terminal 50, and the terminal-side correction control unit 71 identifies the fonts of the preceding and following characters, A function for designating the same font may be used. If you want to change the part of the font to be modified, specify it directly. By leaving these correction records as data in the terminal-side correction history recording unit 72, the same processing can be performed even when operating with a different multifunction device or model.

  In the width designation field E13, the width (vertical width and horizontal width) of the replacement target area B12 is input, but may be changeable by the user.

  The input items shown here are merely examples, and other input items such as font colors, bold characters, and italic characters may be provided.

  As described above, according to the present embodiment, the following effects can be obtained. The correction is performed not on the user IF 20 (the display panel unit 21 and the operation input unit 22) of the image forming apparatus 10, but the mobile terminal 50 such as a smartphone or a tablet. Therefore, the state in which the entire view of the document on the image forming apparatus 10 can be seen is left and correction is performed by the portable terminal 50, so that it is possible to instantly confirm the reflection of the corrected portion on the whole. Further, when extracting an image to be synthesized from original document data, it is possible to extract a portion having a common font type, size, etc., so that the appearance of the document after correction becomes natural.

  Moreover, even if it is a case where it does not have the PC and writing instrument which can be corrected, it can correct appropriately. Further, even when there is no recording medium (memory card or the like) for storing the corrected data, if the correction is performed using the portable terminal 50, the data can be stored in the portable terminal 50. Further, by recording and registering the correction contents in the portable terminal 50 or the image forming apparatus 10, the correction work from the next time onward becomes easy.

  The present invention has been described based on the embodiments. This embodiment is an exemplification, and it will be understood by those skilled in the art that various modifications can be made to combinations of these components, and such modifications are also within the scope of the present invention.

1 image processing system 10 image forming apparatus 11 control unit 12 communication processing unit 13 storage unit 14 print execution processing unit 15 scan execution processing unit 20 user IF
21 display panel unit 22 operation input unit 30 document correction unit 31 correction control unit 32 correction history recording unit 50 portable terminal 51 control unit 52 communication processing unit 53 storage unit 60 user IF
61 Display Panel Unit 62 Operation Input Unit 70 Terminal Side Document Correction Unit 71 Terminal Side Correction Control Unit 72 Terminal Side Correction History Recording Unit

Claims (3)

An image processing system including an image forming apparatus and a mobile terminal,
The image forming apparatus includes:
An image acquisition unit for acquiring image data of a document to be printed;
A display panel for displaying the image data;
A document correction unit that designates a correction area from the image data displayed on the display panel by a user operation, and transmits the image data of the correction area to the mobile terminal;
The portable terminal is
A terminal-side display panel that acquires and displays image data of the correction area transmitted from the image forming apparatus;
A terminal-side correction unit that corrects the image data of the correction area displayed on the terminal-side display panel by a user operation, and transmits the corrected image data of the correction area to the image forming apparatus;
The document correction unit of the image forming apparatus outputs the image data of the corrected area after the correction transmitted from the terminal side correction unit while reflecting the image data of the document in the image data of the document. . The document correction unit is configured to display the correction area displayed on the terminal-side display panel in the terminal-side correction unit of the portable terminal from image data of the document displayed on the display panel of the image forming apparatus. Extract the synthesis area to be synthesized with the image data and send it to the mobile terminal,
The terminal-side correction unit generates the image data of the corrected area after the correction by combining the image data of the correction area and the synthesis area. An image acquisition process for acquiring image data of a document to be printed;
A display step of displaying the image data of the document on a display panel;
A correction area specifying step of receiving a correction area from the image data of the document displayed on the display panel by a user operation;
A document correction step of acquiring and correcting image data of the correction area in a correction execution device;
With
The document correction step displays the image data of the correction area on the display panel of the correction execution device, the image data of the synthesis area extracted from the image data of the document to be printed, the image data of the correction area, The image processing method is characterized in that the image data in the correction area is corrected by combining and the image data in the correction area after correction is reflected in the document and output.

Images