JP2010244507A - Information processing apparatus, method of controlling the same, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve construction of a logic (processing flow) of efficient image processing. <P>SOLUTION: In a PC 110, the following processing is executed when executing processing of an image input from a camera 140. At first, a processing flow-input/output information table and a branch processing condition table are stored. The processing flow-input/output information table includes each module of a processing flow formed by combining a plurality of modules respectively showing the processing to be executed to an image, and information or the like showing the execution order of each module. The branch processing condition table includes condition information relating to branch processing. Next, in response to an indication of a change relating to a module to the processing flow, a conditional expression table is generated when the module is a module relating to branch processing, and information of the processing flow-input/output information table including information to be associated with the conditional expression table is changed. The processing is executed for every module of the changed processing flow-input/output information table, and a resulting image for every module obtained by the execution is displayed on a CRT 130. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an information processing apparatus that performs image processing, a control method thereof, and a program for causing a computer to execute the control method.

  2. Description of the Related Art Conventionally, for example, an image processing apparatus that performs image processing of image data to be inspected with a camera with a certain logic (processing flow) for the purpose of positioning a substrate or a component in a chip mounter or inspecting a finished product. Widely used.

  As such an image processing apparatus, for example, a general-purpose type image processing apparatus equipped with a predetermined image processing logic, or a dedicated user that can construct a logic that meets the user's needs. There are types of image processing devices.

  Here, the general-purpose type image processing apparatus does not require the construction of a new image processing logic (processing flow), so it does not require the user's effort to introduce it into the actual manufacturing process, but the user's needs are completely met. It is rare that the logic satisfies the above. On the other hand, a dedicated type image processing apparatus can construct image processing logic that completely satisfies the user's needs. For this reason, it is necessary to develop the image processing logic each time, so a great amount of development effort is required. The development period and the cost were high.

  Therefore, conventionally, for example, a technique for improving the efficiency of logic development as shown in Patent Document 1 below has been proposed. Specifically, in Patent Document 1, a plurality of image processing modules are registered in advance in a computer that develops logic, the developer selects a module that meets the needs of the user, and is necessary for the selected module. By setting parameters and creating source code after creating source code, logic development is made more efficient.

JP 2003-296112 A

  Here, when a logic (processing flow) is constructed in the above-described dedicated type image processing apparatus, it is usually performed by combining a plurality of modules. In this case, even if the logic (processing flow) is created by combining a plurality of image processing modules each of which obtains an ideal result, there are various types of images to be processed. The target result may not be obtained. Therefore, it is usual to change the parameters of each module, change the order of modules, add new modules, etc. for various images using the built logic, and perform trial and error. It is necessary to make adjustments repeatedly. In particular, if there is a branching process or an iterative process such as a judgment process, parameters such as a threshold for judgment and the number of iterations are always adjusted.

  However, when such a module adjustment is performed, the technique disclosed in Patent Document 1 described above requires that a module is selected from the beginning and a parameter is set every time the adjustment is performed, which is a burden on the developer. There is a problem that a large work must be done.

  In addition, in the constructed logic (processing flow), for which module among the plurality of combined modules, adjustments such as change of parameters and order or addition of new ones, that is, modules to be adjusted are performed. Need to be identified.

  However, in the technique of Patent Document 1 described above, the processing result of the module in the middle of the processing flow is unknown and only the final processing result is known in the constructed logic. However, there is a problem that a heavy workload is required for the developer.

  In particular, when branch processing or iterative processing is included, it is necessary to determine whether these parameters should be adjusted or whether the preceding and following processing itself should be adjusted. However, in the technique of Patent Document 1 described above, since only the final processing result is known, eventually, adjustment by trial and error is necessary, or it is necessary to create a special program for adjustment. There is a problem that it is necessary to perform a heavy work for a person.

  Furthermore, even when the parallel processing includes the parallel processing in which a plurality of processes are separately performed after the branch processing and the next processing is performed using each processing result, the parameter of the parallel branch processing module should be adjusted, Although it is necessary to determine whether to adjust the processing itself, there is a similar problem.

  The present invention has been made in view of such problems, and provides an information processing apparatus capable of realizing construction of an efficient image processing logic (processing flow), a control method therefor, and a program. With the goal.

  An information processing apparatus according to the present invention is an information processing apparatus that performs image processing, and includes a module / source code master table in which a module indicating processing related to image processing and a source code corresponding to each module are associated. A processing flow / input / output information table including information indicating the order of execution of each module in the processing flow in which a plurality of the modules are combined, input processing and output information related to processing of each module, and branch processing A table storage means for storing a branch processing condition table including condition information relating to the module, a module specifying means for specifying the module when an instruction to change the module is given to the processing flow, and the module specifying Means that the module is related to branch processing In this case, the conditional expression table creating means for creating a conditional expression table that is information relating to branch processing, and information relating to the conditional expression table according to the change instruction, the processing flow / input / output information table includes Source code generation for generating source code for each module by using the changing means for changing information, and the information of the processing flow / input / output information table changed by the changing means and the information of the module / source code master table The object code generating means for generating an object code based on the source code generated by the means, the object code generating means, and the object code generated by the object code generating means. Processing mode / input / output information table Having a processing execution means for executing said processing for each Yuru, the resulting image display means for displaying a result image of each of the module obtained by execution of processing by the processing execution unit on the display device.

An information processing apparatus control method according to the present invention is an information processing apparatus control method for processing an image,
Modules indicating processes related to image processing, module / source code master tables in which source codes corresponding to the respective modules are associated, modules in a processing flow combining a plurality of the modules, and execution order of the modules A storage step of storing a processing flow / input / output information table including input information and input information and output information related to processing of each module, and a branch processing condition table including condition information related to branch processing in a table storage unit And when a change instruction regarding the module is instructed to the processing flow, a module specifying step for specifying the module, and when the module specifying step specifies that the module is a module for branch processing , A condition that is information about branch processing A conditional expression table creating step for creating a table, a changing step for changing information in the processing flow / input / output information table including information for associating the conditional expression table in accordance with the change instruction, and the changing step. Using the changed processing flow / input / output information table information and the module / source code master table information, a source code generation step for generating a source code for each module and the source code generation step An object code generation step for generating an object code based on the source code;
A process execution step for executing the process for each module of the process flow / input / output information table changed by the change step using the object code generated by the object code generation step; and a process by the process execution step A result image display step of displaying on the display device a result image for each module obtained by executing

The program of the present invention includes a module indicating processing related to image processing, a module / source code master table in which source code corresponding to each module is associated, each module of a processing flow combining a plurality of the modules, and the module Table storage of processing flow / input / output information table including information indicating the execution order of each module, input information and output information related to processing of each module, and branch processing condition table including condition information related to branch processing A storage step for storing in the means;
When an instruction to change the module with respect to the processing flow is given, a module specifying step for specifying the module, and a branching process when the module specifying step specifies that the module is a module for branch processing. Conditional expression table creation step for creating a conditional expression table that is information related to processing, and change to change information in the processing flow / input / output information table including information for associating the conditional expression table according to the change instruction A source code generating step for generating a source code for each module, using the step, the information of the processing flow / input / output information table changed by the changing step and the information of the module / source code master table, and the source Generated by code generation step Object code generation step for generating object code based on the source code, and each module of the processing flow / input / output information table changed by the change step using the object code generated by the object code generation step The computer executes a process execution step for executing the process and a result image display step for displaying a result image for each module obtained by executing the process in the process execution step on a display device. .

  According to the present invention, it is possible to realize efficient image processing logic (processing flow).

1 is a schematic diagram illustrating an example of a schematic configuration of an image processing system according to an embodiment of the present invention. It is a schematic diagram which shows an example of the hardware constitutions inside PC shown in FIG. It is a schematic diagram which shows an example of a function structure of PC shown in FIG. It is a schematic diagram which shows an example of the module source code master table shown in FIG. It is a schematic diagram which shows an example of the process flow and input / output parameter table shown in FIG. It is a flowchart which shows an example of the process sequence of the control method by PC shown in FIG. It is a schematic diagram which shows embodiment of this invention and shows an example of an image processing program development screen. 7 is a flowchart illustrating an example of a detailed processing procedure of “new addition processing” of a module in step S107 of FIG. FIG. 7 is a flowchart illustrating an example of a detailed processing procedure of “change processing” of a module parameter in step S <b> 109 of FIG. 6. FIG. It is a schematic diagram which shows embodiment of this invention and shows an example of a parameter edit screen. 7 is a flowchart illustrating an example of a detailed processing procedure of a “move process” of a module in step S111 in FIG. 6. 7 is a flowchart illustrating an example of a detailed processing procedure of “insertion processing” of a module in step S113 in FIG. 6. It is a flowchart which shows an example of the detailed process sequence of the "all execution process" of the process flow in step S115 of FIG. It is a flowchart which shows an example of the process sequence containing a branch process. It is a schematic diagram which shows embodiment of this invention and shows an example of a conditional expression input screen. It is a flowchart which shows an example of the process sequence at the time of a branch process module being added. An example of the processing result image comparison window with the last set value is shown. It is a schematic diagram which shows an example of a process flow / input / output parameter table including a branch process. It is a schematic diagram which shows an example of the conditional expression table used for a branch process. An example of the window which displays the progress image in process of repetition is shown. It is a flowchart which shows an example of the detailed process sequence of a "parallel branch process." It is a schematic diagram which shows an example of a node process table. It is a schematic diagram which shows an example of a branch process input screen. It is a flowchart which shows an example of the detailed process sequence of a new addition process in 2nd Example. It is a schematic diagram which shows an example of the process flow and input / output parameter table in a 2nd Example. It is a flowchart which shows an example of the detailed procedure of the new addition process in a 3rd Example. It is a schematic diagram which shows an example of the process flow and input / output parameter table in a 3rd Example. It is a flowchart which shows an example of a screen creation process. It is a schematic diagram which shows an example of the layout screen used by a screen creation process. It is a flowchart which shows the detail of the new button addition process of step S2805 of FIG. It is a flowchart which shows the detail of the new screen addition process of step S2807 of FIG. It is a flowchart which shows the detail of the new box addition process of step S2809 of FIG. It is a flowchart which shows the detail of the change / movement process of step S2811 of FIG. It is a flowchart which shows the detail of the preservation | save process of step S2813 of FIG. It is a schematic diagram which shows an example of a screen layout table. It is a schematic diagram which shows an example of a button control table. It is a schematic diagram which shows an example of a screen control table. It is a schematic diagram which shows an example of a box control table.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<First embodiment>
FIG. 1 is a schematic diagram illustrating an example of a schematic configuration of an image processing system 100 according to an embodiment of the present invention.

  As shown in FIG. 1, the image processing system 100 includes a personal computer (hereinafter referred to as “PC”) 110, an operation input device 120, a CRT display (hereinafter referred to as “CRT”) 130, and a camera 140. The illumination device controller 150, the illumination device 160, the external device controller 170, and the stage 180 on which the inspection object 181 is placed.

  The PC 110 is an information processing apparatus that comprehensively controls operations in the image processing system 100. Here, in the present embodiment, an example will be described in which the PC 110 is applied as an apparatus that supports development of an image processing program of an image processing apparatus introduced into an actual manufacturing process, but the present invention is not limited to this. However, the present invention includes a form applied as an image processing apparatus introduced into an actual manufacturing process or the like, for example.

  The PC 110 is configured to be able to communicate with a camera 140 that captures an image of the inspection object 181 via a predetermined cable or the like. The PC 110 is configured to be able to communicate with a lighting device controller 150 that controls the lighting device 160 via a predetermined cable or the like. The PC 110 is configured to be able to communicate with an external device controller 170 such as a programmable controller (PLC) that controls the stage 180 via a predetermined cable or the like. Further, the PC 110 is configured to be able to communicate with the operation input device 120 and the CRT 130 via a predetermined cable or the like. That is, the PC 110 controls the operation in the image processing system 100 by controlling the operation input device 120, the CRT 130, the camera 140, the lighting device controller 150, and the external device controller 170 connected via a predetermined cable or the like. To control.

  The operation input device 120 is operated by the user when the user gives an input instruction to the PC 110, for example, and inputs the input instruction to the PC 110 when the user gives an input instruction. is there. The operation input device 120 includes, for example, a keyboard (KB) and a mouse.

  The CRT 130 displays various images and various information on the display screen according to the control of the PC 110.

The camera 140 performs imaging (imaging) of the inspection object 181 placed on the stage 180 according to the control of the PC 110, and transmits image data obtained by the imaging to the PC 110 via a predetermined cable or the like.

  The illumination device controller 150 controls illumination in the illumination device 160 according to the control of the PC 110. Based on the control of the lighting device controller 150, the lighting device 160 switches lighting / non-lighting of the illumination on the inspection target 181 according to the inspection content of the inspection target 181.

  The external device controller 170 controls the stage 180 according to the control of the PC 110. The stage 180 moves the placed inspection object 181 to a target position and carries in or out the inspection object 181 based on the control of the external device controller 170.

  Next, the internal hardware configuration of the PC 110 will be described. FIG. 2 is a schematic diagram illustrating an example of an internal hardware configuration of the PC 110 illustrated in FIG. Here, in FIG. 2, in addition to the internal configuration of the PC 110, a device connected to the PC 110 is also described.

As shown in FIG. 2, the PC 110 has a hardware configuration including a CPU 111, a RAM 112, a ROM 113, a system bus 114, various controllers 115 (115 a to 115 f), and an external memory 116. . Specifically, as various controllers 115, an input controller 115a, a video controller 115b, a memory controller 115c, communication I / F controllers 115d and 115e, and an image input controller 115f are configured. The CPU 111 controls each device connected to the system bus 114 based on a program or the like stored in the ROM 113 or the external memory 116, and comprehensively controls the operation in the PC 110. The RAM 112 functions as a main memory and work area for the CPU 111. The CPU 111 implements various operations in the PC 110 by loading a necessary program or the like into the RAM 112 and executing the program when executing the processing. The ROM 113 has a BIOS (Basic Input) which is a control program of the CPU 111.
/ Output System), an operating system program (hereinafter referred to as “OS”), various programs necessary for the CPU 111 to realize the functions of the PC 110, and the like are stored. Note that these programs may be stored in the external memory 116.

  The system bus 114 connects the CPU 111, RAM 112, ROM 113, input controller 115a, video controller 115b, memory controller 115c, communication I / F controllers 115d and 115e, and image input controller 115f so that they can communicate with each other.

  The input controller 115a controls input from the operation input device 120 such as a keyboard (KB) and a mouse. The video controller 115b controls display on the CRT 130 which is a display device. The memory controller 115 c controls access to the external memory 116. Here, the external memory 116 is composed of, for example, a hard disk (HD) or a flexible disk (FD), and stores a boot program, various application programs, editing files, various data, various information, and the like. The external memory 116 also stores various tables, various inspection result information, and the like used when the CPU 111 performs processing using a program. The communication I / F controller 115d controls communication with the external device controller 170. Further, the communication I / F controller 115e controls communication with the lighting device controller 150. The image input controller 115 f is configured to be able to receive image data from the camera 140 by communicating with the camera 140. In the present embodiment, the description is based on the assumption that image data is input from the camera 140, but an image file may be read and input.

  Next, the functional configuration of the PC 110 will be described. FIG. 3 is a schematic diagram illustrating an example of a functional configuration of the PC 110 illustrated in FIG.

  As shown in FIG. 3, the PC 110 includes a table storage unit 310, a flow creation unit 320, a source code conversion unit 330, a compilation unit 340, a (verification) execution unit 350, a data storage unit 360, and a data input / output unit. Each functional configuration of 370 is configured. The table storage unit 310 holds a module / source code master table 311, a processing flow / input / output parameter table 312, a source code table 313, an object code table 314, and a project file table 315. Further, although not shown, a conditional expression table and a node processing flag table are also held.

  Here, in the present embodiment, the table storage unit 310 in FIG. 3 is configured in the external memory 116 shown in FIG. 2, for example (including a case where the table storage unit 310 is configured in the external memory 116 after being once configured in the RAM 112). Also, the flow creation unit 320, the source code conversion unit 330, the compilation unit 340, the (verification) execution unit 350, the data storage unit 360, and the data input / output unit 370 shown in FIG. And a program stored in the memory 116.

  First, various tables held in the table storage unit 310 of FIG. 3 will be described. FIG. 4 is a schematic diagram showing an example of the module / source code master table 311 shown in FIG.

  In the module / source code master table 311, as shown in FIG. 4, a module (image processing module) related to image processing and a source code corresponding to each module are associated with each index. This source code is used when the source code conversion unit 330 converts a module to be processed into a source code.

  FIG. 5 is a schematic diagram showing an example of the processing flow / input / output parameter table 312 shown in FIG. As illustrated in FIG. 5, the processing flow / input / output parameter table 312 includes, for each index 501, a module 503 relating to image processing, an order 502 of each module 503, and a flow registration name 504 of each module 503. The input parameter 505 and the output parameter 506 in each module 503 are associated with each other. An input parameter 505 indicates an image buffer, a processing area, and the like used in each module. The output parameter 506 indicates a result image buffer, a threshold value, and the like when each module is executed. A next step 507 indicates an index 501 of a step to be processed next. Note that this item may have a plurality of indexes. The branch reference 508 indicates a conditional expression table that specifies which step is to be processed next by each condition (node) when the “iterative processing” module and the “conditional branch processing” module are set in the module 503. .

  The index (Index) 501 in the processing flow / input / output parameter table 312 shown in FIG. 5 and the index (Index) in the module / source code master table 311 shown in FIG. In this case, each table may be created.

  The source code table 313 converts all modules 503 stored in the processing flow / input / output parameter table 312 into source codes using the module / source code master table 311 and registers them in the source code conversion unit 330. The source code in the module or a part of the modules is stored.

  The object code table 314 stores the object code of an executable module obtained by converting the source code stored in the source code table 313 by the compiling unit 340. The project file table 315 stores initial setting parameters relating to image processing, processing flow sequences, source codes, input / output parameters, and the like.

Next, the flow creation unit 320, the source code conversion unit 330, the compilation unit 340, the (verification) execution unit 350, the data storage unit 360, and the data input / output unit 370 in FIG. 3 will be described.

  The flow creation unit 320 creates a processing flow / input / output parameter table 312 for managing the processing sequence of modules included in the module / source code master table 311 and the processing flow drawing area (702 in FIG. 7 described later). It has a function to draw a module in

  The source code conversion unit 330 collates the processing data of each module stored in the processing flow / input / output parameter table 312 created by the flow creation unit 320 with the module / source code master table 311 to source each module. It has a function of converting into code and storing it in the source code table 313.

  The table modules shown in FIGS. 4 and 5 include not only image processing but also image processing such as pre-processing for acquiring images and post-processing for outputting processing results to external devices. Any process related to the process may be used. For example, a control command for setting the imaging conditions of the camera 140, a control command for the lighting device controller 150 for controlling the lighting device 160, or a control command for the external device controller 170 for controlling movement of the stage, etc. It may be what performs.

  The compiling unit 340 has a function of generating executable object code from the source code stored in the source code table 313 and storing the generated object code in the object code table 314.

  There are two types of compilation performed by the compiling unit 340: debug compilation and release compilation. Here, in this embodiment, during the process flow creation, debugging / compilation that enables step execution at the source code level is performed, and release / compilation that generates a file that can be used online is performed when data is saved. Do. At this time, both the debug compilation and the release compilation refer to the source code generated by the same conversion method.

  The (verification) execution unit 350 executes the object code stored in the object code table 314 created by the compiling unit 340, results image display area (703 in FIG. 7 described later), processing flow / input / output parameter table 312 is updated.

  For example, the data storage unit 360 outputs the source code table 313, the object code table 314, and the project file table 315 in the RAM 112 to the external memory 116, and performs data storage processing.

  The data input / output unit 370 has a function of managing input / output parameters used in each module.

  Next, the processing procedure of the control method by the PC 110 will be described. FIG. 6 is a flowchart illustrating an example of a processing procedure of a control method performed by the PC 110 illustrated in FIG.

  First, in step S101 of FIG. 6, the CPU 111 of the PC 110 performs a process of displaying an image processing program development screen for developing an image processing program on the CRT 130 based on an input instruction from the operation input device 120, for example. .

  FIG. 7 is a schematic diagram illustrating an example of the image processing program development screen 700 according to the embodiment of this invention. The image processing program development screen 700 is configured with, for example, a GUI.

  An image processing program development screen 700 shown in FIG. 7 includes a tool box 701 that displays available processing units (that is, modules related to image processing such as “camera capture”), and an execution order of image processing (that is, , The execution order of each module) in a flowchart, a process flow drawing area 702, a result image display area 703 for displaying a result image executed in each image process (that is, each module process), a menu bar 706, and a tool bar 707, a close button 708 that is operated when the development of the image processing program is finished, and the like. Further, the image processing program development screen 700 shown in FIG. 7 includes parameters used in each step (that is, each module) of the flowchart of the processing flow drawing area 702 when, for example, a new module is registered or a parameter is edited. A parameter editing screen 704 for setting the parameter and a result image display window 705 for displaying the result image executed by setting the parameter are displayed. In the example shown in FIG. 7, the parameter editing screen 704 shows a screen for setting parameters related to the “binarization” module. Here, it returns to description of FIG. 6 again.

  When the process of step S101 ends, the process proceeds to step S102. In step S102, the CPU 111 of the PC 110 determines whether or not to newly develop an image processing program using the image processing program development screen 700 displayed in step S101 based on an input instruction from the operation input device 120. to decide. Specifically, in this example, whether or not to newly develop an image processing program is determined according to whether or not a new creation button 707a is selected on the toolbar 707 of the image processing program development screen 700. That is, in this example, when the new creation button 707a is selected, it is determined that a new image processing program is to be developed.

  As a result of the determination in step S102, when a new image processing program is not developed (step S102 / NO), the process proceeds to step S103.

In step S 103, the CPU 111 of the PC 110 reads the project file table 315 saved in the external memory 116 and stores it in the RAM 112.

  When the process of step S103 is completed, or when it is determined in step S102 that a new image processing program is to be developed (YES in step S102), the process proceeds to step S104.

  In step S104, the CPU 111 of the PC 110 determines whether there is an input instruction from the operation input device 120 (specifically, an input instruction for the image processing program development screen 700 displayed in step S101).

  As a result of the determination in step S104, if there is no input instruction from the operation input device 120 (step S104 / NO), the process waits in step S104 until there is an input instruction from the operation input device 120. On the other hand, as a result of the determination in step S104, if there is an input instruction from the operation input device 120 (step S104 / YES), the process proceeds to step S105.

  In step S105, the CPU 111 of the PC 110 performs a process for determining the selected process content based on an input instruction from the operation input device 120. In this example, the processing contents determined in step S105 include “new addition processing”, “change processing”, “move processing”, “insertion processing”, “overall execution processing”, “save processing”, and “development processing”. It is “end processing”. Note that the processing content given here is an example, and other processing content can be determined in step S105.

  Here, in the determination process of step S105, for example, the following processes are determined by making the following inputs on the image processing program development screen 700 shown in FIG.

  First, when a module is selected from the tool box 701 shown in FIG. 7 and dragged and dropped to the end of the processing flow sequence in the processing flow drawing area 702 or when the module in the tool box 701 is double-clicked, the CPU 111 of the PC 110 It is determined that the event is a module “new addition process” event. When a module already registered in the processing flow drawing area 702 is double-clicked, the CPU 111 of the PC 110 determines that the event is a module parameter “change process” event. When a module already registered in the processing flow drawing area 702 is dragged and dropped between other modules, the CPU 111 of the PC 110 determines that the event is a “movement process” of the module. When a module is selected from the toolbox 701 shown in FIG. 7 and dragged and dropped between modules already registered in the processing flow drawing area 702, the CPU 111 of the PC 110 causes the event of “insertion processing” of the module. It is determined that When execution of the menu bar 706 or the tool bar 707 is selected, the CPU 111 of the PC 110 determines that the event is an “all execution process” event of the process flow set in the process flow drawing area 702. When saving of the menu bar 706 or the toolbar 707 is selected, the CPU 111 of the PC 110 determines that the event is a “save process” event of the process flow set in the process flow drawing area 702. For example, when the close button 708 or the end of the menu bar 706 is selected, the CPU 111 of the PC 110 determines that the event is a “development end process” event of the image processing program.

  In this embodiment, the processing content is determined in this way. However, this is an example. For example, an icon or the like corresponding to the processing content such as “add new” is added to the menu bar 706 or the toolbar 707. A function may be provided, and is not limited to the above-described form.

  Subsequently, in step S <b> 106, the CPU 111 of the PC 110 determines whether or not the processing content determined in step S <b> 105 is a “new addition process” of the module.

  As a result of the determination in step S106, when the processing content determined in step S105 is the “new addition process” of the module (step S106 / YES), the process proceeds to step S107.

  In step S107, the CPU 111 of the PC 110 performs a “new addition process” for the selected module. Details of step S107 will be described later with reference to FIG. When the process of step S107 is completed, the process returns to step S104, and waits until the next input instruction is received from the operation input device 120.

  On the other hand, as a result of the determination in step S106, when the processing content determined in step S105 is not the “new addition process” of the module (step S106 / NO), the process proceeds to step S108.

  In step S108, the CPU 111 of the PC 110 determines whether or not the processing content determined in step S105 is a “parameter change process” for the module.

  As a result of the determination in step S108, when the processing content determined in step S105 is “change processing” of the module parameter (step S108 / YES), the process proceeds to step S109.

  In step S109, the CPU 111 of the PC 110 performs “change processing” for the parameter of the selected module. Details of step S109 will be described later with reference to FIG. When the process of step S109 is completed, the process returns to step S104, and waits for a next input instruction from the operation input device 120.

  On the other hand, as a result of the determination in step S108, if the processing content determined in step S105 is not a “parameter change process” for the module parameter (step S108 / NO), the process proceeds to step S110. In step S110, the CPU 111 of the PC 110 determines whether or not the processing content determined in step S105 is a “movement process” of the module.

  As a result of the determination in step S110, if the processing content determined in step S105 is a “movement process” of the module (step S110 / YES), the process proceeds to step S111.

  In step S111, the CPU 111 of the PC 110 performs “move processing” for the selected module. Details of step S111 will be described later with reference to FIG. When the process of step S111 is completed, the process returns to step S104 and waits until the next input instruction is received from the operation input device 120.

  On the other hand, as a result of the determination in step S110, when the processing content determined in step S105 is not the “movement process” of the module (step S110 / NO), the process proceeds to step S112. In step S112, the CPU 111 of the PC 110 determines whether or not the processing content determined in step S105 is the “insertion processing” of the module.

  As a result of the determination in step S112, when the processing content determined in step S105 is “insertion processing” of the module (step S112 / YES), the process proceeds to step S113.

In step S113, the CPU 111 of the PC 110 performs “insertion processing” for the selected module. Details of step S113 will be described later with reference to FIG. When the process of step S113 is completed, the process returns to step S104 and waits until the next input instruction is received from the operation input device 120.

  On the other hand, as a result of the determination in step S112, if the processing content determined in step S105 is not the “insertion processing” of the module (step S112 / NO), the process proceeds to step S114. In step S114, the CPU 111 of the PC 110 determines whether the processing content determined in step S105 is “overall execution processing” in the processing flow.

  As a result of the determination in step S114, when the processing content determined in step S105 is “overall execution processing” in the processing flow (step S114 / YES), the process proceeds to step S115.

  In step S 115, the CPU 111 of the PC 110 performs “overall execution processing” of the processing flow set in the processing flow drawing area 702. Details of step S115 will be described later with reference to FIG. When the process of step S115 is completed, the process returns to step S104, and waits for a next input instruction from the operation input device 120. On the other hand, as a result of the determination in step S114, if the processing content determined in step S105 is not the “overall execution process” in the processing flow (step S114 / NO), the process proceeds to step S116.

  In step S116, the CPU 111 of the PC 110 determines whether the processing content determined in step S105 is “save processing” in the processing flow.

  As a result of the determination in step S116, when the processing content determined in step S105 is “save processing” in the processing flow (step S116 / YES), the process proceeds to step S117.

  In step S117, the CPU 111 of the PC 110 performs a source conversion process for the entire processing flow set in the processing flow drawing area 702. Specifically, in step S117, the CPU 111 (for example, the source code conversion unit 330) of the PC 110 converts the processing flow / input / output parameter table 312 stored in the RAM 112 into source code, and stores the source stored in the RAM 112. Processing for updating the code table 313 is performed. Further, the CPU 111 (for example, the compiling unit 340) of the PC 110 releases and compiles the source code of the source code table 313, converts it into a release version of the object code, and updates the object code table 314 stored in the RAM 112. I do.

  Subsequently, in step S118, the CPU 111 (for example, the data storage unit 360) of the PC 110 stores the source code table 313 on the RAM 112 as a source file, the object code table 314 as an EXE file or DLL file, and a project file table. A process of storing 315 in the external memory 116 is performed. Then, when the process of step S118 ends, the process returns to step S104, and waits for a next input instruction from the operation input device 120.

  On the other hand, as a result of the determination in step S116, if the processing content determined in step S105 is not “save processing” in the processing flow (step S116 / NO), the process proceeds to step S119.

  In step S119, the CPU 111 of the PC 110 determines whether the processing content determined in step S105 is “development end processing” of the image processing program.

  As a result of the determination in step S119, when the processing content determined in step S105 is not “development end processing” of the image processing program (step S119 / NO), the process returns to step S104, and an input instruction is issued from the operation input device 120. Wait until.

  On the other hand, as a result of the determination in step S119, when the processing content determined in step S105 is “development end processing” of the image processing program (step S119 / YES), the processing of the flowchart shown in FIG.

  Next, details of steps S107, S109, S111, S113, and S115 in FIG. 6 will be described. Specifically, processing is performed in the order of modules of “camera capture” → “binarization” → “particle analysis”. An example of registering a flow and performing subsequent processing will be described. First, detailed processing in step S107 in FIG. 6 will be described. FIG. 8 is a flowchart showing an example of a detailed processing procedure of the “new addition processing” of the module in step S107 of FIG.

  In the process of step S107 of FIG. 6, first, in step S201 of FIG. 8, the CPU 111 of the PC 110 (for example, the flow creation unit 320) performs a process of specifying the module selected in the input of step S104. Here, in this example, first, the first “camera capture” module is specified.

  Subsequently, in step S210, it is determined whether the module identified in step S201 is a module that is an iterative process or a conditional branch process. In this case, if the module is an iterative process or a conditional branch process, the process proceeds to step S211.

  In step S202, the CPU 111 of the PC 110 (for example, the flow creation unit 320) performs processing for displaying the parameter editing screen 704 of the module specified in step S201 on the CRT 130. Then, the CPU 111 of the PC 110 (for example, the flow creation unit 320) accepts editing by the operation input device 120 regarding the parameter editing screen 704. If the “camera capture” module is specified in step S201, a parameter editing screen 704 related to the “camera capture” module is displayed on the image processing program development screen 700 shown in FIG. It will be.

  In the parameter editing screen 704, parameters related to each module, input parameters such as processing areas (input parameters 505 shown in FIG. 5), and output parameters for storing processing results (output parameters 506 shown in FIG. 5) are set. It is configured to be possible.

  Subsequently, in step S203, the CPU 111 of the PC 110 (for example, the flow creation unit 320) determines whether or not to register the parameter edited on the parameter editing screen 704 based on the input instruction from the operation input device 120. Specifically, here, when the OK button 7041 on the parameter editing screen 704 shown in FIG. 7 is selected, it is determined that the parameter edited on the parameter editing screen 704 is registered, and the parameter editing screen shown in FIG. When the cancel button 7042 of 704 or the like is selected, it is determined that the parameter edited on the parameter editing screen 704 is not registered.

  If the parameter edited on the parameter editing screen 704 is registered as a result of the determination in step S203 (step S203 / YES), the process proceeds to step S204.

  In step S204, the CPU 111 of the PC 110 (for example, the flow creation unit 320) performs processing for adding the information obtained in the processing in steps S201 and S202 as one record to the processing flow / input / output parameter table 312.

  For example, a case where a record relating to the “camera capture” module is first added to the processing flow / input / output parameter table 312 shown in FIG. 5 will be described.

  In this case, “camera capture” is set as the module 503, “1” is set as the index 501, “1” is set as the order 502, and “U00001” is set as the flow registration name 504. . For example, as the output parameter 506, information (address, etc.) of “image buffer A” that is the storage destination of the result image is set. Here, since the “camera capture” process is the first module in the process flow, the input parameter 505 does not store image buffer information (such as an address). Here, it returns to description of FIG. 8 again.

  When the process of step S204 is completed, in step S205, the CPU 111 of the PC 110 (for example, the flow creation unit 320) adds the module identified in step S201 to the process flow drawing area 702 and draws (displays) it. In the present embodiment, the order of the processing related to the processing flow / input / output parameter table 312 in step S204 and the drawing processing in the processing flow drawing area 702 in step S205 may be reversed.

  Subsequently, in step S214, it is determined whether the module specified in step S201 is a module for parallel branch processing. In this case, in the case of a parallel branch processing module, the process proceeds to YES, and the process ends. However, since this time the module is a “camera capture” module, NO, that is, the process proceeds to step S206.

  In step S206, the CPU 111 of the PC 110 (for example, the source code conversion unit 330) converts the module added to the processing flow drawing area 702 in step S205 into source code using the module / source code master table 311 and obtains it by conversion. The stored source code is stored in the source code table 313. At this time, the CPU 111 of the PC 110 (for example, the source code conversion unit 330) modifies the source code read from the module / source code master table 311 to reflect the parameter edited in step S202 as necessary. The obtained source code is stored in the source code table 313.

  Thereafter, the CPU 111 (for example, the compiling unit 340) of the PC 110 generates an executable object code from the source code stored in the source code table 313, and stores the generated object code in the object code table 314. At this time, the CPU 111 (for example, the compiling unit 340) of the PC 110 debugs and compiles the source code of the source code table 313 and stores it in the object code table 314 as a debug version of the object code.

  Subsequently, in step S207, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) stores the result image buffer of the previous step stored as the input parameter 505 of the processing flow / input / output parameter table 312 as necessary. Is used to execute the object code generated in step S206. As a result, the image data from the camera 140 is acquired as a processing result image. For example, the flow creation unit 320 sets information on a buffer for storing the processing result image in the output parameter 506 of the processing flow / input / output parameter table 312. To do.

  However, in the case of the “camera capture” module, since this is the first step, image buffer information (address, etc.) is not stored in the input parameter 505. Therefore, in the case of the first “camera capture”, the image data from the camera 140 is simply captured. Therefore, in the execution process of step S207, the process is executed with reference to the input parameter and output parameter set in step S202, and the result image (image data captured from the camera 140) is displayed in the result image display window 705. It will be.

  In step S208, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) displays a result image based on the result image data stored in the address of the image buffer A in the output parameter 506 of the record added in step S204. Draw (display) in the result image display area 703. In the result image display area 703, the processing result image for each module is displayed. With this, the developer should know which processing has a problem and which module should be corrected. It becomes possible to make a judgment.

  When the process of step S208 is completed, or when it is determined not to register the parameter edited on the parameter editing screen 704 in step S203 (step S203 / NO), the operation input device 120 performs “new addition process”. 8 is terminated, and when the operation input device 120 is instructed to continue the “new addition process”, the process returns to step S201, and the processes after step S201 are performed. Will do it again.

  Here, in this example, as described above, the processing flow is registered in the order of modules of “camera capture” → “binarization” → “particle analysis”. The case of adding “binarization” and “particle analysis” modules to the processing flow will be described. In the following description, the description will focus on differences from the processing in the “camera capture” module described above.

  Adding a “binarization” module to the processing flow is basically the same as the above-described “camera capture”, but in step S204, a new index (Index) shown in FIG. ) “2” of 501 is set to “binarization” as the module 503, “2” is set as the order 502, and “U00002” is set as the flow registration name 504. Further, as the input parameter 505, information (such as an address) of the image buffer A that stores the result image of the previous step (that is, “camera capture”) is stored. In other words, the input parameter 505 of the “binarization” module stores information of the image buffer stored in the input parameter 505 of “camera capture” which is the previous step.

  Subsequently, in step S205, the module ("binarization") specified in step S201 is added to the processing flow drawing area 702 and drawn (displayed). In step S206, the module additionally registered in step S205 is converted into source code using the module / source code master table 311. The source code obtained by the conversion is stored in the source code table 313 and updated. Also, the source code of the source code table 313 is debugged and compiled, and this is stored in the object code table 314 and updated.

  In step S207, the object code stored in the object code table 314 is executed to perform binarization processing using the input parameter 505 of the “binarization” module. As a result, the binarized image data is acquired as a processing result image. For example, the flow creation unit 320 includes information on the buffer B that stores the processing result image and a threshold value (for example, numerical value = 98). Is set in the output parameter 506 of the processing flow / input / output parameter table 312.

  Thereafter, in step S208, a result image based on the image data stored in the address of the image buffer B in the output parameter 506 of the record added in step S204 is drawn (displayed) in the result image display area 703.

  In addition, when the “particle analysis” module is added to the processing flow, the processing is basically the same as the case of the above-described module, but in step S204, the module 503 is added to “3” of the index 501. “Particle analysis” is set as “3”, “3” is set here as the order 502, and “U00003” is set here as the flow registration name 504. In addition, as the input parameter 505, information (such as an address) of the image buffer B that stores the result image of the previous step (here, “binarization”) is stored.

  Subsequently, in step S205, the module (“particle analysis”) specified in step S201 is drawn (displayed) in the processing flow drawing area 702. In step S206, the module additionally registered in step S205 is converted into source code using the module / source code master table 311. The source code obtained by the conversion is stored in the source code table 313 and updated. Also, the source code of the source code table 313 is debugged and compiled, and this is stored in the object code table 314 and updated.

  Subsequently, in step S207, the object code stored in the object code table 314 is executed to perform particle analysis processing using the input parameter 505 of the “particle analysis” module. As a result, the image data subjected to particle analysis is acquired as a processing result image. For example, the flow creation unit 320 includes information on the buffer C storing the processing result image and the number of particles at that time (here, for example, the number of particles). = 51) is set in the output parameter 506 of the processing flow / input / output parameter table 312.

  Thereafter, in step S208, a result image based on the image data stored at the address of the image buffer C in the output parameter 506 of the record added in step S204 is drawn (displayed) in the result image display area 703. In this example, in the result image display area 703, for example, as shown in FIG. 7, the order of the processing flows set in the processing flow drawing area 702 (in other words, “camera capture” in order from the left side) ”→“ binarization ”→“ particle analysis ”module order), the processing result image is displayed. As described above, the “new addition process” for the module in step S107 in FIG. 6 is performed.

  Next, detailed processing in step S109 in FIG. 6 will be described.

  FIG. 9 is a flowchart showing an example of a detailed processing procedure of the “change processing” of the module parameter in step S109 of FIG. Here, an example will be described in which the parameters of the “binarization” module already registered in the processing flow of the processing flow drawing area 702 are changed by the processing shown in FIG.

  In the process of step S109 of FIG. 6, first, in step S301 of FIG. 9, the CPU 111 of the PC 110 (for example, the flow creation unit 320) specifies the module that has been selected as the input of step S104 and has already been registered as the process flow. Perform the process. Here, in this example, a “binarization” module is specified.

  Subsequently, in step S302, the CPU 111 of the PC 110 (for example, the flow creation unit 320) performs processing for displaying the parameter editing screen 704 of the module identified in step S301 on the CRT 130. In this example, a parameter editing screen 704 related to the “binarization” module is displayed.

FIG. 10 is a schematic diagram illustrating an example of the parameter editing screen 704 according to the embodiment of this invention. The parameter editing screen 704 shown in FIG. 10 is a screen for editing the parameters of the “binarization” module. The binarization type setting unit 1001 for setting the binarization type and the binarization A threshold value setting unit 1002 for setting the threshold value, an OK button 7041, a stop button 7042, and the like are provided.

  Then, the CPU 111 of the PC 110 (for example, the flow creation unit 320) accepts editing by the operation input device 120 regarding the parameter editing screen 704. Here, when the threshold value of the threshold value setting unit 1002 shown in FIG. 10 is changed, the image displayed in the result image display window 705 is updated and displayed as needed according to the change of the threshold value.

  Subsequently, in step S303, the CPU 111 of the PC 110 (for example, the flow creation unit 320) converts the parameter of the module identified in step S301 into the parameter edited on the parameter editing screen 704 based on the input instruction from the operation input device 120. Determine whether to change. Specifically, here, when the parameter is changed on the parameter edit screen 704 and the OK button 7041 on the parameter edit screen 704 shown in FIG. 10 is selected, it is determined that the parameter of the module specified in step S301 is changed. .

  As a result of the determination in step S303, when the parameter of the module specified in step S301 is changed to the parameter edited in the parameter editing screen 704 (step S303 / YES), the process proceeds to step S304.

  In step S304, the CPU 111 (for example, the source code conversion unit 330) of the PC 110 converts the module after the module determined to change the parameter in step S303 into the source code using the module / source code master table 311. The source code obtained by the conversion is stored in the source code table 313 and updated. Specifically, in this example, since the parameter of the “binarization” module is changed, the processing flow registered in the processing of FIG. 8, that is, “camera capture” → “binarization” → Among the “particle analysis” modules, source code conversion is performed for the “binarization” and “particle analysis” modules. At this time, the CPU 111 (for example, the source code conversion unit 330) of the PC 110 modifies the source code read from the module / source code master table 311 to reflect the parameter edited in step S302 as necessary. The obtained source code is stored in the source code table 313. In this way, by performing source code conversion processing only for modules after the module determined to be changed, development time can be shortened together with compilation processing described later, and efficient image processing logic (processing) Flow) can be realized.

  Thereafter, the CPU 111 (for example, the compiling unit 340) of the PC 110 generates an executable object code from the source code stored in the source code table 313, and stores the generated object code in the object code table 314. At this time, the CPU 111 (for example, the compiling unit 340) of the PC 110 debugs and compiles the source code of the source code table 313, and stores and updates the source code in the object code table 314 as a debug version of the object code.

  Subsequently, in step S305, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) is stored in the image buffer indicated as the input parameter 505 of the processing flow / input / output parameter table 312 as necessary. Using the image data, processing for executing the object code generated in step S304 is performed. Specifically, in this example, since the processing target is a “binarization” module, the module is stored in the image buffer A stored as the input parameter 505 of the processing flow / input / output parameter table 312 shown in FIG. The binarization process is performed by executing the object code generated in step S304 using the existing image data. As a result, the binarized image data is acquired as a processing result image. For example, the flow creation unit 320 displays information about the buffer B that stores the processing result image and information about the threshold value at that time. The output parameter 506 of the input / output parameter table 312 is set.

  Subsequently, in step S306, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) results image based on the result image data stored at the address of the image buffer in the output parameter 506 of the processing flow / input / output parameter table 312. Is drawn (displayed) in the result image display area 703. In this example, in the result image display area 703, for example, in order from the left side, the order of the processing flows set in the processing flow drawing area 702 (ie, “camera capture” → “binarization” → “particle” The processing result image is displayed according to the order of the “analysis” module). For example, the processing result image after the “binarization” module is changed and displayed with respect to the display in step S208 of FIG. Will be.

  When the process of step S306 is completed, or when it is determined in step S303 that the parameter of the corresponding module is not changed to the parameter edited on the parameter editing screen 704 (step S303 / NO), the operation input device 120 When the end of the “change process” is instructed, the process of the flowchart of FIG. 9 is ended. When the operation input device 120 is instructed to continue the “change process”, the process returns to step S301, and after step S301. This process is performed again. As described above, the module parameter “change process” in step S109 of FIG. 6 is performed.

  Next, detailed processing in step S111 in FIG. 6 will be described.

  FIG. 11 is a flowchart showing an example of a detailed processing procedure of the “move processing” of the module in step S111 of FIG. The order of processing flow is changed by the movement processing of this module.

  In the process of step S111 in FIG. 6, first, in step S401 of FIG. 11, the CPU 111 (for example, the flow creation unit 320) of the PC 110 identifies a module that has been selected as an input in step S104 and has already been registered as a process flow. Perform the process.

  Subsequently, in step S402, the CPU 111 of the PC 110 (for example, the flow creation unit 320) drops the module identified in step S401 for the processing flow drawn (displayed) in the processing flow drawing area 702 in step S104. A process for moving between modules and redrawing (redisplaying) the processing flow drawing area 702 is performed.

  At this time, the CPU 111 (for example, the flow creation unit 320) of the PC 110 also performs processing for changing the processing flow / input / output parameter table 312 in accordance with the movement processing of the module identified in step S401. Here, a specific example is not shown, but first, in accordance with the order of modules in the processing flow of the processing flow drawing area 702 redrawn in step S402, the order 502 of the processing flow / input / output parameter table 312 (and the flow registration name). 504) is changed. Next, in accordance with the order of modules in the processing flow of the processing flow drawing area 702 redrawn in step S402, the input parameters 505 and output parameters 506 of the modules associated with the change in the order are changed. For example, the input parameter 505 of the module to be moved stores the image buffer information of the output parameter 506 in the immediately preceding module. At this time, the output parameter 506 of the module to be moved may not be changed. However, the input parameter 505 in the next-order module stores image buffer information of the output parameter 506 of the module to be moved.

Subsequently, in step S <b> 403, the CPU 111 of the PC 110 (for example, the source code conversion unit 330) stores the module / source code master table 311 for modules after the module whose order 502 has been changed in the processing flow / input / output parameter table 312. The source code is converted into a source code, and the source code obtained by the conversion is stored in the source code table 313 and updated. At this time, the CPU 111 of the PC 110 (for example, the source code conversion unit 330) once deletes the source code corresponding to the module whose order has been changed in the source code table 313, and performs conversion to the source code again. The source code table 313 is updated.

Thereafter, the CPU 111 (for example, the compiling unit 340) of the PC 110 generates an executable object code from the source code stored in the source code table 313, and stores the generated object code in the object code table 314. At this time, the CPU 111 (for example, the compiling unit 340) of the PC 110 debugs and compiles the source code of the source code table 313, and stores and updates the source code in the object code table 314 as a debug version of the object code.

  Subsequently, in step S404, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) is stored in the image buffer indicated as the input parameter 505 of the processing flow / input / output parameter table 312 as necessary. Using the image data, processing for executing the object code generated in step S403 is performed.

  Subsequently, in step S405, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) results image based on the result image data stored at the address of the image buffer in the output parameter 506 of the processing flow / input / output parameter table 312. Is drawn (displayed) in the result image display area 703. In this example, in the result image display area 703, for example, the processing result images are displayed in order from the left side according to the order of the processing flows set in the processing flow drawing area 702.

  When the process of step S405 is completed, when the operation input device 120 instructs to end the “movement process”, the process of the flowchart of FIG. 11 is ended, and the operation input device 120 performs the “movement process”. When continuation is instructed, the process returns to step S401, and the processes after step S401 are performed again. As described above, the “move process” of the module in step S111 in FIG. 6 is performed.

  Next, detailed processing in step S113 in FIG. 6 will be described.

  FIG. 12 is a flowchart showing an example of a detailed processing procedure of the “insertion processing” of the module in step S113 of FIG. Here, the processing flow (“camera capture” → “binarization” → “particle analysis”) registered in the processing flow drawing area 702 by the processing shown in FIG. Next, “insertion processing” for adding a “morphology” module will be described. That is, here, an example of “camera capture” → “binarization” → “morphology” → “particle analysis” as in the processing flow drawing area 702 shown in FIG. 7 will be described.

  In the process of step S113 in FIG. 6, first, in step S501 of FIG. 12, the CPU 111 of the PC 110 (for example, the flow creation unit 320) specifies the insertion destination into which a new module is to be inserted dropped in the input of step S104. Process. Here, in this example, between “binarization” and “particle analysis” is specified as the insertion destination.

  Subsequently, in step S502, the CPU 111 (for example, the flow creation unit 320) of the PC 110 performs processing for specifying the module selected in the input in step S104. Here, in this example, a “morphology” module is specified. In the present embodiment, the processing order of the insertion destination specifying process in step S501 and the module specifying process in step S502 may be reversed.

  Subsequently, in step S503, the CPU 111 (for example, the flow creation unit 320) of the PC 110 performs processing for displaying the parameter editing screen 704 of the module specified in step S502 on the CRT 130. Then, the CPU 111 of the PC 110 (for example, the flow creation unit 320) accepts editing by the operation input device 120 regarding the parameter editing screen 704. In this example, a parameter editing screen 704 related to the “morphology” module is displayed on the image processing program development screen 700 shown in FIG.

  Subsequently, in step S504, the CPU 111 of the PC 110 (for example, the flow creation unit 320) determines whether or not to register the parameter edited on the parameter editing screen 704 based on the input instruction from the operation input device 120. As a specific determination method in step S504, the same method as in step S203 of FIG. 8 is used.

As a result of the determination in step S504, when the parameter edited on the parameter editing screen 704 is registered (step S504 / YES), the process proceeds to step S505.

  In step S505, the CPU 111 of the PC 110 (for example, the flow creation unit 320) performs processing for adding the information obtained in the processing in steps S502 and S503 as one record to the processing flow / input / output parameter table 312. Based on the insertion destination information specified in step S501, information in the processing flow / input / output parameter table 312 is changed and updated.

  In this example, first, as shown in FIG. 5, information on the module of “morphology” that is the module to be inserted is added to “4” of the index (Index) 501 of the processing flow / input / output parameter table 312. Specifically, “morphology” is set as the module 503, “3” is set as the order 502, “U00003” is set as the flow registration name 504, and image buffer information (address, etc.) of the input parameter 505 The information (address etc.) of the image buffer B shown in the output parameter 506 of the previous step (“binarization”) is set as the information (address etc.) of the image buffer C as the image buffer information (address etc.) of the output parameter 506. ) Is set. At this time, the order 502 is changed from “3” to “4” for the information of the “particle analysis” module whose index (Index) 501 is registered as “3” in the processing flow / input / output parameter table 312. For example, the image buffer C is set as image buffer information (address or the like) of the input parameter 505, and the image buffer D is set as image buffer information (address or the like) of the output parameter 506.

  Subsequently, in step S506, the CPU 111 of the PC 110 (for example, the flow creation unit 320) draws (displays) the processing flow drawing area 702 by adding the module specified in step S502 to the insertion destination specified in step S501. . In the present embodiment, the order of the process of the process flow / input / output parameter table 312 in step S505 and the process of drawing in the process flow drawing area 702 in step S506 may be reversed.

  Subsequently, in step S507, the CPU 111 (for example, the source code conversion unit 330) of the PC 110 starts with the module whose order 502 is changed in the processing flow / input / output parameter table 312 (that is, after the module inserted in step S506). The module is converted into source code using the module / source code master table 311, and the source code obtained by the conversion is stored in the source code table 313 and updated.

  Thereafter, the CPU 111 (for example, the compiling unit 340) of the PC 110 generates an executable object code from the source code stored in the source code table 313, and stores the generated object code in the object code table 314. At this time, the CPU 111 (for example, the compiling unit 340) of the PC 110 debugs and compiles the source code of the source code table 313, and stores and updates the source code in the object code table 314 as a debug version of the object code.

  Subsequently, in step S508, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) is stored in the image buffer shown as the input parameter 505 of the processing flow / input / output parameter table 312 as necessary. Using the image data, processing for executing the object code generated in step S403 is performed. Specifically, for example, for the “morphology” module inserted in the current process, the result image data (stored in the image buffer B) of the previous process module (in this example, the “binarization” module) The object code generated in step S507 is executed using the result image data). In the case of this example, image data that has undergone morphology processing is acquired as a processing result image. For example, the flow creation unit 320 includes information on a buffer that stores the processing result image and the number of particles at that time (here, for example, particle Number = 46) is set in the output parameter 506 of the processing flow / input / output parameter table 312.

  Subsequently, in step S509, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) results image based on the result image data stored at the address of the image buffer in the output parameter 506 of the processing flow / input / output parameter table 312. Is drawn (displayed) in the result image display area 703. In this example, in the result image display area 703, for example, in order from the left side, the order of the processing flows set in the processing flow drawing area 702 (ie, “camera capture” → “binarization” → “morphology”). "→" Particle analysis "module order), the processing result image is displayed. As described above, the “insertion process” of the module in step S113 in FIG. 6 is performed.

  Next, detailed processing in step S115 in FIG. 6 will be described.

  FIG. 13 is a flowchart showing an example of a detailed processing procedure of “overall execution processing” in the processing flow in step S115 of FIG.

  In step S115 of FIG. 6, first, in step S601 of FIG. 13, the CPU 111 of the PC 110 (for example, the source code conversion unit 330) relates to a series of processing flows set in the processing flow / input / output parameter table 312. The module is converted into source code, and the source code obtained by the conversion is stored in the source code table 313. Thereafter, the CPU 111 (for example, the compiling unit 340) of the PC 110 generates an executable object code from the source code stored in the source code table 313, and stores the generated object code in the object code table 314. At this time, the CPU 111 (for example, the compiling unit 340) of the PC 110 releases and compiles the source code of the source code table 313 and stores it in the object code table 314 as a release version of the object code.

  In step S602, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) uses the image data stored in the result image buffer stored as the input parameter 505 of the processing flow / input / output parameter table 312. Thus, processing for executing the object code generated in step S601 is performed. As a result, a plurality of image data that has undergone image processing or the like is acquired as a processing result image. For example, the flow creation unit 320 processes information about a buffer that stores the processing result image and information about numerical values at that time. Set to the output parameter 506 of the input / output parameter table 312.

  Subsequently, in step S <b> 603, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) draws various result images in the result image display area 703 in accordance with the order of the process flows set in the process flow drawing area 702. (indicate.

  When the process of step S603 ends, the process of the flowchart of FIG. 13 ends.

  As described above, the “overall execution process” of the process flow in step S115 of FIG. 6 is performed.

  As described above, the PC 110 (information processing apparatus) of the image processing system 100 according to the present embodiment performs the following processing.

  Specifically, in the PC 110, a module / source code master table 311 (FIG. 4) in which a module indicating processing related to image processing and a source code corresponding to each module are associated with each other, and a processing flow in which a plurality of modules are combined. 5, a processing flow / input / output information table (processing flow / input / output parameter table 312 in FIG. 5) including information indicating the execution order of the modules, input information and output information related to processing of the modules. ) Is stored in the external memory 116 (or RAM 112) (storage step).

  When an instruction to change the module is given to the processing flow (for example, S104 / YES in FIG. 6), the information in the processing flow / input / output parameter table 312 is changed according to the instruction to change. (For example, S204 in FIG. 8, S402 in FIG. 11, S505 in FIG. 12, etc .: change step).

  Then, the source code is generated for each module using the information in the processing flow / input / output parameter table 312 and the information in the module / source code master table 311 changed in the changing step (for example, FIG. 8). S206, S304 in FIG. 9, S403 in FIG. 11, S507 in FIG. 12, etc .: source code generation step). Thereafter, an object code is generated based on the source code generated in the source code generation step (object code generation step).

  Then, using the generated object code, processing is executed for each module of the processing flow / input / output parameter table 312 changed in the changing step (for example, S207 in FIG. 8, S305 in FIG. 9, S404 in FIG. 11, S508 in FIG. 12, etc .: processing execution step). Thereafter, the result image for each module obtained by executing the process in the process execution step is displayed in the result image display area 703 of the CRT 130 as the display device (for example, S208 in FIG. 8, S306 in FIG. 9, (S405 in FIG. 11, S509 in FIG. 12, etc .: result image display step).

  According to such a configuration, for each module in the processing flow in which a plurality of modules are combined, the processing result image is displayed on the display device. Therefore, even when an instruction to change the module is given, Modules can be specified, and the development load of logic related to image processing (that is, processing flow related to image processing) can be reduced. This makes it possible to construct an efficient image processing logic (processing flow).

  Furthermore, the PC 110 displays the processing flow set in the processing flow / input / output parameter table 312 in the processing flow drawing area 702 of the CRT 130 (processing flow display step), and further, the processing flow / input changed by the changing step. The processing flow of the output parameter table 312 is changed and displayed in the processing flow drawing area 702 of the CRT 130 (for example, S205 in FIG. 8, S402 in FIG. 11, S506 in FIG. 12, etc .: processing flow change display step).

  Furthermore, when an instruction to change a module is given to the processing flow in the processing flow drawing area 702, the PC 110 further displays a parameter editing screen 704 for editing parameters of the module on the CRT 130 (for example, FIG. S202 of FIG. 8, S302 of FIG. 9, S503 of FIG. 12, etc .: parameter edit screen display step), and in the source code generation step, the source code is further generated using the parameters of the module edited on the parameter edit screen 704. It is trying to generate.

  Next, an example will be described in which a processing flow including a branch processing module including repetitive processing, conditional branch processing, and parallel branch processing is registered and the subsequent processing is performed.

Specifically, the “binarization” process is performed, the “morphology” process is performed three times, the “positioning” process is performed, and the matching number of matching “conditional branch” process is performed. Within the “conditional branch” process, if the condition is satisfied (YES), the “rotation correction” process is performed, and if the condition is not satisfied (NO), the “mirror” process is performed. Subsequently, “median” processing is performed, and then “code recognition” processing and “defect inspection” processing are performed in parallel.
An example of performing the “output” process will be described.

  FIG. 14 is a schematic diagram illustrating an example of the image processing program development screen 1400 according to the embodiment of this invention. The image processing program development screen 1400 is composed of, for example, a GUI.

  An image processing program development screen 1400 shown in FIG. 14 includes a tool box 1404 that displays available processing units (that is, modules related to image processing such as “binarization”) and an execution order of image processing (that is, , A processing flow drawing area 1401 for drawing the execution order of each module in a flowchart, a result image display area 1402 for displaying a result image executed in each image processing (that is, processing of each module), and a menu bar (not shown). ) And a toolbar 1407, a close button 1408 operated when finishing the development of the image processing program, and the like. Further, the image processing program development screen 1400 shown in FIG. 14 includes parameters used in each step (that is, each module) of the flowchart of the processing flow drawing area 1401 when, for example, a new module is registered or a parameter is edited. A parameter editing screen (not shown) for setting, and a result image 1403 for displaying a result image executed by setting the parameter are displayed.

  The tool box 1404 includes modules for controlling the flow by branch processing such as “conditional branch processing”, “iterative processing”, and “parallel branch processing”. Examples of the processing flow using these are “iteration processing” 1410a, “conditional branch processing” 1411a, and “parallel branch processing” 1412a. Here, the result image display area 1402 is a result image of each module in the flow drawing area 1401. This may be a preview image or a reduced image. For example, if it is an iterative process, it is displayed as 1410b, and the final result image when the iterative process is performed is displayed. If it is a conditional branch process, an image of a node (branch) that satisfies the condition is displayed as in 1411b, and a blackout image is displayed because no process is performed for a node that does not satisfy the condition. If it is a parallel branch process, it is displayed as 1412b, and the result images of all nodes are displayed. At this time, if the result of all the processing flows does not fit in the result image display area 1402, the display area may be changed using horizontal and vertical scroll bars.

  Next, the processing flow / input / output parameter table 312 when a branch processing module is included will be described with reference to FIG.

  FIG. 18 is a schematic diagram T1800 showing an example of the processing flow / input / output parameter table 312 shown in FIG. 3 when the “branch processing” module is included.

  As shown in FIG. 18, the processing flow / input / output parameter table T1800 includes, for each index 1801, a module 1803 related to image processing, an order 1802 of each module 1803, and a flow registration name 1804 of each module 1803. The input parameter 1805 and the output parameter 1806 in each module 1803 are associated with each other. An input parameter 1805 indicates an image buffer, a processing area, and the like used in each module. An output parameter 1806 indicates a result image buffer, a threshold value, and the like when each module is executed. A next step 1807 indicates an index 1801 of a step to be processed next. Note that this item may have a plurality of indexes. A branch reference 1808 indicates a conditional expression table that specifies which step (condition) (node) is to be processed next when the “iterative processing” module and the “conditional branch processing” module are specified as the module 1803. .

  In the processing flow / input / output parameter table T1800, indexes 2 and 3 of index 1801 are iterative processing, 5 to 7 of index 1801, conditional branch processing, and 9 and 10 of index 1801 are parallel. It is an example of a branch process.

  A conditional expression table T1900 for registering detailed processing conditions in “branch processing” will be described with reference to FIG.

  FIG. 19 shows an example of the conditional expression table T1900. An index 1901, a conditional expression 1904, a threshold 1 (1905) and a threshold 2 (1906), and the next step 1907 are registered. The conditional expression table T1900 creates one table for one “branch processing” module.

The feature quantity 1903 registers the feature quantity used when comparing the results, for example, the number of detected matching and the number of particles in particle analysis. The conditional expression column 1904 includes Greator.
/ GreaterOrEqual / Equal
/ LessOrEqual / Less / InRange / OutRange and the like, the threshold 1 column 1905 and the threshold 2 column 1906 register values to be compared with the feature amount. In the next step column 1907, the next step (processing flow / input / output parameter table index (Index) 1801) is set for each condition. When there are a plurality of conditions, the number of rows in the conditional expression table T1900 is added to cope with it. Next, the processing procedure of the control method by the PC 110 when the “branch processing” module is included will be described.

First, the “binarization” and “morphology” modules are newly added in accordance with the procedure described with reference to FIG. Next, "Morphology" process 3
The process of newly adding and registering the “repetitive processing” module to be performed once according to the procedure of FIG. In step S201, the selected module is specified.

  In step S210, if the module identified in step S201 is determined to be “repetitive processing”, the process proceeds to step S211 to perform branch processing module registration processing. The branch processing module registration processing will be described with reference to FIG. FIG. 16 is a flowchart illustrating an example of a processing procedure of a control method performed by the CPU 111 of the PC 110 illustrated in FIG. 1 when the branch processing module is included.

  In step S801, selectable feature quantities are specified based on 1 and 2 of the index 1801 of the processing flow / input / output parameter table T1800 and the output parameter 1806 for the registration target module. That is, in this case, since only the “counter” of the iterative process is used, the “counter” is stored in the RAM 112 as a selectable feature amount.

  In step S802, a conditional expression input screen is displayed. FIG. 15 shows an example of a conditional expression input screen 1500, which includes a feature quantity list box 1501 for designating feature quantities, a conditional expression 1502 for setting conditions for determination, and a threshold value input box 1503. A feature quantity list box 1501 displays a list of feature quantities that can be selected for subsequent determination processing.

  At this time, since “counter” is stored as a selectable feature amount in the RAM 112, only “counter” − “count number” may be displayed in the feature amount list 1501 in FIG. Also in the conditional expression 1502, only items that can be set may be displayed.

  In step S <b> 803, it is determined whether or not a value has been input from the input device 120 for a predetermined item on the conditional expression input screen 1500. In step S803, when there is no input from the input device 120 (step S803 / NO), it waits for input. On the other hand, if there is an input from the input device 120 in step S803 (step S803 / YES), the process proceeds to step S804. In this example, it is assumed that the feature quantity is “number of counters”, the conditional expression is “<”, and the lower limit value is “3”.

  In step S804, the CPU 111 of the PC 110 determines whether or not the value input in step S803 is valid.

  Items to be determined here are numerical values and character strings input to the lower limit value 1503 and the upper limit value 1504 of the conditional expression input screen 1500 set in advance for each module. For example, in the case of the iterative process described above, the feature quantity to be compared is a numerical value in terms of the counter count, and if a value of “0” or “negative” is input, it is determined that the input value is not correct. . Further, when comparing with the threshold value of the binarization processing, if a value exceeding the maximum luminance value of the processing buffer, that is, a numerical value of 255 if 8 bits is input, it is determined as an incorrect value.

  In step S805, it is determined whether the value specified in step S804 is correct. As a result of the determination in step S805, when it is determined that the value is not correct (step S805 / NO), the process waits for input from the input device 120. On the other hand, if it is determined that the value is correct (step S805 / YES), the process proceeds to step S806.

  In step S806, the CPU 111 of the PC 110 (for example, the flow creation unit 320) determines whether or not to register the parameter edited on the conditional expression input screen 1500 based on the input instruction from the operation input device 120. Specifically, here, when the setting button 1505 on the conditional expression input screen 1500 shown in FIG. 15 is selected, it is determined that the parameter edited on the conditional expression input screen 1500 is registered, and the condition shown in FIG. When the cancel button 1506 or the like on the expression input screen 1500 is selected, it is determined that the parameter edited on the conditional expression input screen 1500 is not registered. Here, step S806 / YES corresponds to step S203 / YES, and step S806 / NO corresponds to S203 / NO. That is, in the case of step S806 / YES, the process proceeds to step S807, and in the case of S806 / NO, the process is terminated without registering the iterative processing module.

  In step S807, the CPU 111 of the PC 110 newly creates a conditional expression table T1900 on the RAM 112.

In step S808, a record is added to the conditional expression table T1900 created in step S807. At this time, first, an index 1901 is set to “1”, one code is added, and a setting value when the condition is satisfied is written. That is, “U00003-Count” that is the count number of the iterative process is registered in the feature quantity 1903, “Less” in the conditional expression 1904, and “3” in the threshold 1905 are registered. Since “Less” is set in the conditional expression 1904, “NULL” is set in 1906 of the threshold value 2. In the next step 1907, the first processing module to perform the iterative processing is designated. Here, an index (Index) 1801 of the processing flow / input / output parameter table T1800 indicating the “morphology” module of “U00002” is designated. A certain “3” is registered. Further, the index (Index) 1901 of the conditional expression table T1900 is set to “2”, and one record is added, and “U00003-Count” and the conditional expression 1904 “Else” are added to the feature quantity 1903. In the next step, the step to be executed next after finishing the iterative process is set. However, since the next step is not yet registered at this stage, the next step 1907 is temporarily set to “NULL”.

  Returning to the description of FIG. In S212, the processing flow / input / output parameter table T1800 is also updated, but the value “2” of the next step 1906 of the conditional expression table T1900 is also referred to in the next step 805 of the row where the index 1801 is “3”. T1900, which is the conditional expression table to be registered, is registered in the branch reference 1808.

  In step S213, the iterative process module is rendered in the process flow rendering area 1401, and the registration process of the “repetitive process” module is temporarily terminated. Here, an arrow is pointed to the input side of the “morphology” module, which is the first processing module that performs the iterative processing. Next, a process of newly adding and registering the “positioning” module after the “repetitive processing” module according to the procedure shown in FIG. 8 will be described. Here, steps S201 to S203 are the same processing.

  In step S204, this corresponds to the registration of the module following the iterative processing module. Therefore, the index (Index) 1901 of the conditional expression table T1900 is “2”, the next step 1907 is followed by the “positioning” process in the processing flow / input / output parameter table T1800. "4" of the index (Index) 1801 representing is registered. In addition, “4” is registered in the next step 1807 in which the index 1801 of the processing flow / input / output parameter table T1800 is “3”. However, since “2” has already been registered in the next step 1807 in which the index 1801 is “3”, connection is made using a comma “,” or the like. That is, “2, 4” is registered in the next step 1807 where the index 1801 is “3”.

  The processing after step S205 is the same as that described above with reference to FIG. 8, but the source conversion processing in step S206 is performed on the source code using the module / source code master table 311 for the modules of “iterative processing” and “positioning”. The source code obtained by the conversion is stored in the source code table 313 and updated. Also, the source code of the source code table 313 is debugged and compiled, and this is stored in the object code table 314 and updated.

Note that the result image displayed in the result image display area 1402 displays the final result image of the iterative process. In the result image display area 1402, when a repetitive processing module is double-clicked or a context menu is selected, a repetitive processing progress image window is displayed. FIG. 20 shows an example of the iterative process progress image window. The leftmost image in this window stores the processing results of all the iterations in the RAM 112, and then the first (1
(Second) result image, and the result image is obtained by incrementing the number of iterations as it moves to the right. Further, when the parameter changing process is performed, the processing results of all times are newly stored in the RAM 112 while the repetitive processing results before the changing process are stored in the RAM 112. After that, the image before the parameter change is displayed in the upper row, and the image after the parameter change is displayed in the lower row. Note that this window may receive an instruction to move the scroll bar and switch the displayed image. This completes registration of the “iteration process” module and creation of the program.

  Next, the processing procedure of the control method by the PC 110 when the “conditional branch processing” module is included will be described. Specifically, using the result of the previous positioning process, if the condition is satisfied (YES), the “rotation correction” process is performed. If the condition is not satisfied (NO), the “mirror” process is performed. A case will be described as an example. In step S201, the selected module is specified.

  In step S210, the module identified in step S201 is determined to be “conditional branch processing”, and in step S211, “conditional branch processing” module registration processing is performed. The registration processing of the “conditional branch processing” module will be described with reference to FIG. 16, but description overlapping with the registration processing of the “repetition processing” module will be omitted. An example of the conditional expression table used in the “conditional branch process” is shown at T1910 in FIG.

  In step S801, feature quantities that can be selected up to the current step are specified based on the output parameter 1806 of the processing flow / input / output parameter table T1800. Here, the CPU 111 of the PC 110 refers to the output parameter 1806. In this example, the selectable feature amount includes a binarization threshold “U00001-Thresh”, an iterative process time “U00003-Count”, and positioning parameters. The number is “U00004-Num”.

  In step S802, the conditional expression input screen 1500 is displayed based on the feature amount specified in step S801, and input is accepted. Here, it is assumed that the feature quantity 1913 is input as the number of positionings “U00004-Num” in the previous step, the conditional expression 1914 is “==”, and the threshold value 1 1914 is “1”.

  Steps S803 to S805 are the same as described above.

  In step S806, the CPU 111 of the PC 110 (for example, the flow creation unit 320) determines whether or not to register the parameter edited on the conditional expression input screen 1500 based on the input instruction from the operation input device 120. Specifically, here, when the setting button 1505 on the conditional expression input screen 1500 shown in FIG. 15 is selected, it is determined that the parameter edited on the conditional expression input screen 1500 is registered (step S806 / YES) Proceed to step. On the other hand, when the cancel button 1506 is selected, it is determined that the parameter edited on the conditional expression input screen 1500 is not registered (step S806 / NO), and the process ends.

  In step S807, the CPU 111 of the PC 110 newly creates a conditional expression table T1910 on the RAM 112.

  In step S808, a record is added to the conditional expression table T1910 created in step S807. At this time, first, an index (Index) 1911 is set to “1”, one code is added, and a set value when the condition is satisfied is written. In the feature amount 1913, “U00004-Num” that is the number of positioning processes is registered, “Equal” is registered in the conditional expression 1914, and “1” is registered in the threshold value 1915. Since “Less” is set in the conditional expression 1914, “NULL” is set in the threshold 2 1916. In the next step 1917, the processing module of the branch destination when the “conditional branch processing” is performed is designated, but since the next step is not yet registered, it is temporarily set to “NULL”.

  Furthermore, an index 1901 is set to “2” in the conditional expression table T1910, and one record is added, “U00004-Num” is set as the feature quantity 1913, and the conditional expression 1914 is set to “Else”. Similarly, in the next step, the step to be executed next after the “conditional branch process” is set, but since the next step has not yet been registered at this stage, the next step 1917 is temporarily set to “ "NULL".

  Returning to the description of FIG. In step S212, the processing flow / input / output parameter table T1800 is also updated, but the conditional expression table T1910 that refers to the row having the index (Index) 1801 of “4” is registered in the branch reference 1808. Since this module does not perform processing on the image, the same pointer is designated for the image buffer of the input parameter 1805 and the output parameter 1806.

  In step S213, the conditional branch module is drawn in the processing flow drawing area 1401, and the registration of the “conditional branch processing” module is temporarily ended.

  Next, a process for additionally registering the process of the node in the conditional branch after the “conditional branch” module will be described. Here, when the number of positioning is “1”, rotation correction is performed, and when it is not “1”, mirror conversion is performed, and the “rotation correction” processing module and the “mirror conversion” processing module are respectively set. A process of additionally registering to a node will be described. Steps S201 to S204 are the same processing, and thus description thereof is omitted.

  In step S204, since it corresponds to the registration of the module following the conditional branch module, the next step when the condition is satisfied in the conditional expression table T1910, that is, the next step 1917 in which the index 1911 is “1” is “6”. Register. On the other hand, if the condition is not satisfied, that is, “7” is registered in the next step 1917 in which the index 1911 is “2”. In addition, “6, 7” is registered in the next step 1807 in which the index (Index) 1801 of the processing flow / input / output parameter table T1800 is “5”.

  Here, in the processing flow / input / output parameter table T1800, the image buffer of the input parameter 1805 of “6” “rotation correction” of the index (Index) 1801 and “mirror conversion” of “7” is the index. The pointer of the image buffer of the output parameter 1806 of “conditional branch processing” of “Index” 1801 is used. That is, the positioning output image 1807 of the index (Index) 1801 which is the previous step of the “conditional branch process” is used.

  The processing after step S205 is the same as that described above with reference to FIG. However, in the source conversion process in step S206, the “conditional branch process”, “rotation process”, and “mirror process” modules are converted into source code using the module / source code master table 311 and the source obtained by the conversion is converted. The code is stored in the source code table 313 and updated. Also, the source code of the source code table 313 is debugged and compiled, and this is stored in the object code table 314 and updated. This completes registration of the “conditional branch processing” module and creation of the program.

  Next, the processing procedure of the control method by the PC 110 when “parallel branch processing” is included will be described. Specifically, following the “median” process, the “code recognition” process and the “defect inspection” process are performed in parallel, and finally the “IO output” process is performed. First, the registration of the “median” module is newly added according to the procedure described with reference to FIG. 8, but a detailed description thereof is omitted because it is duplicated. Subsequently, new addition processing is performed according to the procedure described in FIG.

  In step S201, the selected module is specified.

  In step S210, it is determined that the module specified in step S201 is a parallel branch, and the process proceeds to the parameter editing screen display in step S202.

  In step S202, a parameter editing screen for parallel branch processing is opened. FIG. 23 shows an example of a parameter editing screen, and shows a parallel branch window 2300 for designating the number of nodes (branches) to be processed in parallel with the branch setting 2301. Here, “2” is input.

  In step S203, the CPU 111 of the PC 110 (for example, the flow creation unit 320) determines whether or not to register the parameter edited in the parallel branch window 2300 based on an input instruction from the operation input device 120. Specifically, here, when the setting button 2302 of the parallel branch window 2300 shown in FIG. 23 is selected, it is determined that the parameter edited in the parallel branch window 2300 is registered, and the parallel branch window shown in FIG. When the cancel button 2303 or the like of 2300 is selected, it is determined that the parameter edited in the parallel branch window 2300 is not registered.

  In step S204, records are added to the processing flow / input / output parameter table T1800 by the number of branches specified in the parallel branch window 2300. Here, since the number of nodes is 2, “9” and “10” are added to the index 1801, and “NULL” is set in each next step 1806.

  In step S205, the parallel branch module is drawn in the processing flow drawing area 702. Here, only the connection lines that do not include processing in each node (branch) are drawn. At this time, a smaller number of the index (Index) added to the processing flow / input / output parameter table T1800 in step S204 is assigned to the left of the branch module, and the right node (branch) increases as the index (Index) increases. It shall be shown. In step S214, since the module specified in step S201 is determined to be a parallel branch, the process is exited.

  Next, a process of additionally registering the process of each node of the parallel process after the “parallel branch process” module will be described. Here, as an example, a process for additionally registering modules of “code recognition” and “defect inspection” will be described. Steps S201 to S203 are the same processing, and thus the description thereof is omitted.

  In step S204, the code recognition is registered in the index (Index) 1801 of the processing flow / input / output parameter table T1800 as “9”, and the defect inspection is registered as “10” in the index (Index) 1801. At this time, the image used in each node is the image after the median processing in the previous step, that is, the image buffer designated by the output parameter 1806 in which the index (Index) 1801 of the processing flow / input / output parameter table T1800 is “8”. Thus, the index (Index) 1801 is designated as the image buffer of the input parameter 1805 of “9” and “10”. At this point, since the next step is not registered, “NULL” is set in the next step 1807. In addition, since the branch reference is not used, “NULL” is set. Further, in the next step 1807 where the index (Index) 1801 of the previous step is “8”, there are two branch destinations and “9, 10” is set.

  The processing after step S205 is the same as that described above with reference to FIG. However, the source conversion processing in step S206 is performed by converting the modules of “parallel branch processing”, “code recognition”, and “defect inspection” into source code using the module / source code master table 311 and the source obtained by the conversion. The code is stored in the source code table 313 and updated. Also, the source code of the source code table 313 is debugged and compiled, and this is stored in the object code table 314 and updated. FIG. 21 illustrates the details of the processing procedure when executing parallel processing. Here, step S1402a and step S1402b indicate a “code recognition” process and a “defect inspection” process as indicated by the parallel branch process 1412a.

  In step S1401, preprocessing for allocating the result of the previous step to the next step of each node, creation of a node processing flag table, and the like are performed. FIG. 22 is an example of the node processing flag table T2200.

  A node processing flag table T2200 is newly created on the RAM 112. Add code for the number of nodes to be processed in parallel. After that, “NODEx” is registered in the node name of each index 1801, and “0” is registered in the end flag. In addition, the node processing flag table T2200 is designated as the branch reference 1808 whose index (Index) 1801 of the processing flow / input / output parameter table T1800 is “9” and “10”. As an example of a value registered in the end flag, completion is set to “1” and incomplete is set to “0”. FIG. 22 shows an example of the node processing flag.

In step S1402a, a processing module (code recognition processing) in which an index (Index) is registered as “9” in the processing flow / input / output parameter table is executed.
Subsequently, in step S1403a, the CPU 111 of the PC 110 sets the end flag of the node processing flag table T2200 on the RAM 112 to “1”.

  Similarly, at the same time when step S1402a is started, the processing from step S1402b (defect inspection processing) to S1403b is sequentially executed at the node (branch) 2, and the end flag is updated in the node processing flag table T2200. When there are three or more nodes (branches), the same procedure is performed.

  Next, in step S1404, the CPU 111 of the PC 110 checks the end flag in the node processing flag table T2200, and performs a determination process to determine whether all the nodes have been processed.

As a result of the determination in step S1404, when the processing content determined in step S1405 is “complete” (step S1405 / YES), the parallel branch processing is terminated and the processing flow is returned to the step. On the other hand, if it is not “complete” (step S1405 / NO), the process returns to step S1404 and waits for completion of all the nodes being executed. That is, the processing of each node is synchronized by this processing, and the subsequent processing timing can be made uniform. Finally, according to the procedure of step S107, “I / O
Register additional modules for "output" processing.

Here, since the next step of the parallel branch processing is registered, in step S204, the processing flow / input / output parameter table is added to the next step 1907 in which the index (Index) 1901 of the conditional expression table T1900 is “9” and “10”. In T1800, “I / O
“11” of an index 1901 indicating “output” processing is registered.

  Since this step is the final step of the processing flow, the next step 1807 in which the index (Index) 1801 of the processing flow / input / output parameter table T1800 is “11” is “NULL”. The step in which the next step 1807 is “NULL” is the final step.

  FIG. 17 shows an image comparison window of the processing result image with the previous parameter and the current processing result image when the parameter is changed in all modules. An image comparison window is displayed by double-clicking the result image of each module in the result image display area or selecting a context menu.

  For example, FIG. 17 shows an example in which the parameter (threshold value) of the “binarization” processing module in the processing flow is changed from “128” to “64” in accordance with the procedure of step S109.

  The previous result image 5001 represents the processing result image of the previous parameter (threshold = 182), and the current result image 5002 represents the processing result image of the current set parameter (threshold = 64). It is assumed that the result image is held in either the RAM 112 or the external memory 116.

  In the above description, the new addition process has been described as an example. However, the module movement process, the insertion process, the parameter change process, and the like also overlap with those described with reference to FIG. Omitted.

<Second embodiment>
The second embodiment of the present invention will be described below. In this embodiment, a part or all of the pre-processing is performed by a CPU (including hardware such as a proximity processing chip and FPGA) included in the image input controller of FIG. A process for creating a flowchart for creating a program for speeding up the processing by causing the CPU of the information processing apparatus and the CPU of the image input apparatus to share the preprocessing will be described.

  FIG. 24 is a flowchart illustrating an example of a detailed procedure of module new addition processing according to the second embodiment. Note that the same step numbers as those in FIG. 8 are assigned to steps for performing the same processing as the module new addition processing (FIG. 8) in the first embodiment, and detailed description of the processing is omitted.

  The parameter display screen displayed in step S202 of FIG. 24 is used to specify whether the processing subject that performs the preprocessing is the CPU of the information processing apparatus that executes the program or the CPU of the image input controller. Input field (processing subject input field) is provided, and the CPU 111 determines whether the processing subject is a CPU or an image input controller in accordance with the input content set in the processing subject input field (step) S2401).

  If the CPU 111 determines YES in step S2401 (processing is performed by the CPU of the information processing apparatus), “0” is set in the processing subject field of the record indicating the processing in the processing flow / input / output parameter table (FIG. 25). To do. On the other hand, if it is determined NO (processing by the CPU of the image input device), “1” is set. The other processing steps are the same as those in FIG. 8 and will not be described in detail.

  FIG. 25 is a schematic diagram showing an example of a processing flow / input / output parameter table in the second embodiment. In addition to the processing flow / input / output parameter table shown in FIG. When this numerical value is “0”, the CPU of the information processing apparatus creates a program whose processing subject is the CPU of the image input controller. In this example, a program is created for the CPU of the image input controller to execute camera capture, binarization, and median, and the CPU of the information processing device to execute morphology and rotation. The program is created so that the CPU of the information processing apparatus and the CPU of the image input controller share the work memory and exchange data.

  The above is a flowchart for creating a program for speeding up the processing by causing the CPU of the information processing apparatus and the CPU of the image input apparatus to share the series of preprocessing according to the second embodiment. This is an explanation of the creation process.

<Third embodiment>
Next, a third embodiment of the present invention will be described. In the third embodiment, creation of a program for performing processing with other programs and synchronization processing will be described.

  FIG. 26 is a flowchart illustrating an example of a detailed procedure of a new module addition process according to the third embodiment. Note that the same step numbers as those in the respective drawings are used for steps that are the same as the module addition process in the first embodiment (FIG. 8) and the module addition process in the second embodiment (FIG. 24). And detailed description of the process is omitted.

  In the third embodiment, an event set module and an event standby module are prepared. The event set module is a module used to generate a specific event. The event wait module is a module used to wait for an event generated by the event set module. These modules are prepared as processing units in the tool box 701 of the image processing program development screen shown in FIG.

In step S2601 in FIG. 26, the CPU 111 determines whether the designated module is an event set process. If it is determined that it is an event set process (YES in step S2601), the event set process issues it to the event reference field 2701 of the record indicating the process in the process flow / input / output parameter table (FIG. 27). Event information is set (step S2602). For the event information, the CPU 111 acquires the value input in the event input field provided on the parameter editing screen displayed in step S202 as the event information, and sets the value as the event information.

  Next, the CPU 111 determines whether the designated module is an event standby process. If it is determined that the process is an event standby process (YES in step S2601), the process waits in the event reference field 2701 of the record indicating the process in the process flow / input / output parameter table (FIG. 27). Event information is set (step S2602). For the event information, the CPU 111 acquires the value input in the event input field provided on the parameter editing screen displayed in step S202 as the event information, and sets the value as the event information.

  After that, the processing flow (related processing flow) indicated by the processing flow / input / output parameter table (FIG. 27) in which the event set processing for issuing the event set as the standby event information is set has already been displayed. If it is determined that it is not displayed (NO in step S2605), the related process flow is displayed on the screen (step S2606). If the event set process that issues an event that is set to wait is not set in any other process flow (that is, there is no process flow / input / output parameter table indicating the process of the flow), The related process flow is not displayed.

  The other steps in FIG. 26 are substantially the same as the new addition process in the first embodiment (FIG. 8) and the new addition process in the second embodiment (FIG. 24), and thus detailed description is omitted. To do.

  Next, a processing flow / input / output parameter table in the third embodiment will be described with reference to FIG. In the processing flow / input / output parameter table in the third embodiment, an event reference field 2701 is added in addition to the fields provided in the processing flow / input / output parameter table in the second embodiment. In the case of a record in which an event set is set in the module 503, the event reference field 2701 contains information on the event issued in the processing. In the field 2701, information of an event waiting in the process is set.

  Here, the processing shown in these processing flow / input / output parameter tables will be described using FIG. 27 as an example. Note that (1) and (2) in FIG. 27 show a process flow / input / output parameter table showing different processes.

  In the process of (1) in FIG. 27, the process of camera capture → morphology → event waiting → tiling is set, and in the process of (2), camera capture → event set is set. In the event waiting for the process (1), the event set in the event set for the process (2) is set to wait (event reference is both T9999).

  That is, in the process of (1) in FIG. 27, after the camera capture and morphology process are completed, the process waits until the camera capture and event set process in the process of (2) is completed. This indicates that tiling processing is performed.

The above describes the creation of a program for performing processing and synchronization processing with another program according to the third embodiment.

(Create a screen for executing the created program)
Next, a screen creation process for executing the programs created in the first to third embodiments will be described.

FIG. 28 is a flowchart illustrating an example of a screen creation process. A program for causing the CPU 111 to execute this processing is stored in the external memory 116, and when the CPU performs this processing, the CPU 111 loads the program into the RAM 112 and performs the processing according to the control of the program. Become.

First, the CPU 111 displays the layout screen shown in FIG. 29 on the CRT 130 via the video controller 115b (step S2801). Details of the layout screen will be described with reference to FIG.

Next, based on an operation by the user via the operation input device with respect to the screen of FIG. 29, it is determined whether a control input instruction has been accepted (input is present?) (Step S2802). If it is determined that an input instruction has been accepted (YES in step S2802), the processing content of the input instruction is determined (step S2803).

If it is determined in step S2803 that the input content is a new button addition process (YES in step S2804), the process proceeds to step S2805 to perform a new button addition process. Become. Details of the new button addition processing will be described with reference to FIG.

If it is determined in step S2804 that the input content is the new screen addition process (YES in step S2806), the process proceeds to step S2807 to perform the new screen addition process. Become. Details of the new screen addition processing will be described with reference to FIG.

If it is determined in step S2804 that the input content is a new box addition process (YES in step S2808), the process proceeds to step S2809 to perform a new box addition process. Become. Details of the new box addition processing will be described with reference to FIG.

If it is determined in step S2804 that the input content is a change / movement process (YES in step S2810), the process proceeds to step S2811, and the change / movement process is performed. Become. Details of the change / move process will be described with reference to FIG.

If it is determined in step S2804 that the input content is a storage process (YES in step S2812), the process proceeds to step S2813 and the storage process is performed. Details of the storage process will be described with reference to FIG.

The above processing is repeated until it is determined in step S2814 that a development end instruction has been received. The above is a rough description of the screen creation process.

Next, an example of a layout screen displayed on the CRT in step S2801 of FIG. 28 will be described with reference to FIG. The layout screen 2900 includes a tool box 2901 that displays available processing controls (that is, controls related to the configuration of the online GUI such as a text box that displays numerical results) and a screen configuration (that is, text boxes, buttons, and the like). A design area 2902 for displaying, a property display area 2903 for displaying properties related to each control, and the like are provided.

  The user drags and drops the processing control displayed in the tool box 2901 to the design area to place it at a desired position, and then changes the size of the processing control or displays it in the property display column. The screen can be created by changing the properties. The above is the description of the layout screen 2900.

  Next, with reference to FIG. 30, the new button addition processing in step S2805 of FIG. 28 will be described. First, when receiving an instruction to add a new button, the CPU 111 determines whether a screen layout table for arranging the button has already been created (step S3001). If it is determined as a result of the determination process in step S3001 that a table has not yet been created (NO with table) (NO in step S3002), a screen layout table is created. An example of the screen layout table will be described with reference to FIG.

  FIG. 35 is a schematic diagram illustrating an example of a screen layout table. In the screen layout table 3500 of FIG. 35, an index 3501, a control type 3502, a design registration name 3503, and a property table 3504 are set.

  The type of each control set on the screen is registered in the control type 3502, the control ID is registered in the design registration name, and the property table ID for managing the details of the control is registered in the property table 3504. become. The above is the description of the screen layout table.

  Returning to the description of FIG. Then, the type of the added button control is specified (step S3004). As the types of button controls, “single inspection”, “continuous inspection”, “inspection stop”, “inspection setting”, “end”, and the like are prepared.

  Thereafter, a record for registering the details of the added button control is added to the button control table (FIG. 36) showing the details of the button control (step S3005), and the basic properties of the button are read from the external memory 116. The record is set in the record (step S3006). Then, the property read in step S3006 is displayed in the property display area 2903 in FIG. 29, and the added control is drawn in the design area 2902. The above is the details of the new button addition process in step S2805 of FIG.

  An example of the button control table will be described with reference to FIG. In the button control table T3600 shown in FIG. 36, Index (3601), basic property (3602), execution content (3603), custom 1 (3604), custom 2 (3605),... Are set.

  Index (3601) includes the index information of the control, basic property (3602) includes the basic property information of the button control, and execution content (3603) indicates the execution content to be executed when the button is instructed to be pressed. However, in the custom 1 (3604), custom 2 (3605)..., Information such as button control position information, button size, and shape is registered. The above is the description of the button control table of FIG.

  Next, the details of the new screen addition process in step S2807 of FIG. 28 will be described with reference to FIG. This process is substantially the same as the new button addition process described with reference to FIG.

  First, when receiving an instruction for a new screen addition process for displaying an image processing result, the CPU 111 determines whether a screen layout table for arranging a screen for displaying the processing result has already been created (step S3101). ). If it is determined as a result of the determination processing in step S3101 that a table has not yet been created (NO with table) (NO in step S3102), a screen layout table is created (step S3103).

  Thereafter, data to be displayed on the added screen is set (step S3104). The data to be set here is, for example, the processing result in the processing flow executed by the screen control set for the screen. Specifically, the input in the processing flow / input / output parameter table indicating the processing flow A variable set as a parameter or output parameter is specified.

  Thereafter, a record for registering the details of the added button control is added to the screen control table (FIG. 37) showing the details of the screen control (step S3105), and the basic properties of the screen are read from the external memory 116. The record is set (step S3106). The property read in step S3106 is displayed in the property display area 2903 in FIG. 29, and the added control is drawn in the design area 2902. The above is the details of the new screen addition process in step S2807 of FIG.

  An example of the screen control table will be described with reference to FIG. In the screen control table T3700, Index (3701), basic property (3702), resource (3703), custom 1 (3704), custom 2 (3705), etc. are set.

  Index (3701) includes the index information of the control, basic property (3702) includes the basic property information of the screen control, and the resource includes a variable that holds data displayed on the screen as custom 1 (3604). ), Custom 2 (3605),..., Information such as screen control position information, screen control size, and the like is registered. The above is the description of the screen control table of FIG.

  Next, with reference to FIG. 32, details of the new box addition processing in step S2809 of FIG. 28 will be described. This process is substantially the same as the new button addition process described with reference to FIG.

  First, when receiving an instruction for a new box addition process for displaying an image processing result, the CPU 111 determines whether a screen layout table for arranging a box for displaying the result of the process has already been created (step S3201). ). If it is determined as a result of the determination processing in step S3201 that a table has not yet been created (NO with table) (NO in step S3102), a screen layout table is created (step S3203).

  Thereafter, data to be displayed on the added screen is set (step S3204). The data to be set here is, for example, the processing result in the processing flow executed by the button control set on the screen, and specifically, the input in the processing flow / input / output parameter table indicating the processing flow A variable set as a parameter or output parameter is specified.

  Thereafter, a record for registering the details of the added box control is added to the box control table (FIG. 38) showing the details of the box control (step S3205), and the basic properties of the screen are read from the external memory 116. The record is set (step S3206). The property read in step S3206 is displayed in the property display area 2903 of FIG. 29, and the added control is drawn in the design area 2902. The above is the details of the new box addition processing in step S2809 of FIG.

  An example of the box control table will be described with reference to FIG. In the box control table 3800, Index (3801), basic property (3802), display variable (3803), custom 1 (3804), custom 2 (3805), etc. are set.

  Index (3801) includes index information of the control, basic property (3802) includes basic property information of the screen control, and display variable (3803) includes a variable that holds data displayed on the screen. Custom 1 (3804), custom 2 (3805),... Register information such as box control position information, box control size, and the like. The above is the description of the screen control table of FIG.

  Next, with reference to FIG. 33, the details of the change / move process shown in step S2811 of FIG. 28 will be described. When the CPU 111 receives a change or movement instruction, the CPU 111 first specifies a control to be changed (step S3301). Thereafter, a record of the control to be changed is acquired from the control table that manages the details of the type control that has received the change request (step S3302).

  And the change process according to the change content received from the user is performed with respect to the record acquired by step S3302 (step S3303). For example, in the case of movement of a control, a change process for information indicating the coordinate value of the control is performed.

  Then, the changed property information is displayed in the property display area 2903 in FIG. 29, and the redrawing process of the changed control is performed. The above is the details of the change / move process in step S2811 of FIG.

  With reference to FIG. 34, the details of the storage processing in step S2813 in FIG. 28 will be described. First, the CPU 111 executes a set process according to an event generated by an operation instruction or the like on the screen created by the processes of FIGS. 28 to 33 according to the source program stored in the external memory 116. A source program is created (step S3401). Then, the source program is stored in the external memory 116 (step S3402). When this processing is performed, it is of course possible to actually execute the compile processing and link processing of the source program and then perform the debugging processing.

<Other Embodiments of the Present Invention>
3 constituting the PC 110 (information processing apparatus) according to the embodiment of the present invention described above, and the steps shown in FIGS. 6, 8, 9, and 11 to 13 showing the control method of the PC 110. Can be realized by the CPU (111) of the computer executing a program stored in the ROM (113), the external memory (116) or the like. This program and a computer-readable recording medium recording the program are included in the present invention.

  In addition, the present invention can be implemented as, for example, a system, apparatus, method, program, storage medium, or the like. Specifically, the present invention may be applied to a system including a plurality of devices. You may apply to the apparatus which consists of one apparatus.

  Note that the present invention is a software program that implements the functions of the above-described embodiments (in the embodiment, FIGS. 6, 8, 9, 11 to 13, 16, 21, 21, 24, 26, and FIG. 28, a program corresponding to the flowchart shown in FIGS. 30 to 34), or a program that directly or remotely supplies the system or apparatus. The present invention also includes a case where the system or the computer of the apparatus is achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, and the like.

  Examples of the recording medium for supplying the program include a flexible disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, and CD-RW. In addition, there are magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R), and the like.

  As another program supply method, a browser on a client computer is used to connect to an Internet home page. The computer program itself of the present invention or a compressed file including an automatic installation function can be downloaded from the homepage by downloading it to a recording medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, the present invention includes a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who have cleared predetermined conditions. Let The downloaded key information can be used to execute the encrypted program and install it on the computer.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. In addition, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can also be realized by the processing.

  Further, the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments are realized by the processing.

  The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed as being limited thereto. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

100 image processing system 110 PC (information processing apparatus)
120 Operation input device 130 CRT (CRT display)
140 Camera 150 Illumination Device Controller 160 Illumination Device 170 External Device Controller 181 Inspection Target 180 Stage 111 CPU
112 RAM
113 ROM
114 System bus 115a Input controller 115b Video controller 115c Memory controller 115d, 115e Communication I / F controller 115f Image input controller 116 External memory

Claims (11)

An information processing apparatus for processing an image,
Modules indicating processes related to image processing, module / source code master tables in which source codes corresponding to the respective modules are associated, modules in a processing flow combining a plurality of the modules, and execution order of the modules A table storage means for storing a processing flow / input / output information table including information indicating the input and output information related to processing of each module, and a branch processing condition table including condition information related to branch processing;
Module specifying means for specifying the module when an instruction to change the module is given to the processing flow;
When the module specifying means specifies that the module is a module related to branch processing, conditional expression table creating means for creating a conditional expression table that is information related to branch processing;
In accordance with the change instruction, changing means for changing information in the processing flow / input / output information table including information relating the conditional expression table;
Source code generation means for generating source code for each module, using the processing flow / input / output information table information changed by the changing means and the information of the module / source code master table;
Object code generation means for generating an object code based on the source code generated by the source code generation means;
Processing execution means for executing the processing for each module of the processing flow / input / output information table changed by the changing means, using the object code generated by the object code generating means;
An information processing apparatus comprising: a result image display unit configured to display a result image for each module obtained by execution of processing by the processing execution unit on a display device. A condition for changing the information of the next step in the conditional expression table when an instruction to change the module, which is the next step, is issued after the instruction to change the module related to the branch process is given to the processing flow. The information processing apparatus according to claim 1, further comprising an expression table changing unit. In response to the change instructions,
After an instruction to change the module related to the branch process is given to the processing flow, and when an instruction to change the module, which is the next step, is issued, the changing means follows the processing flow / input / output information table. The information processing apparatus according to claim 1, wherein the information on the number of nodes branched to step information is changed. 4. The branch condition information relating to a branch processing module is a condition related to information stored in the processing flow / input / output information table. Information processing device. The result image display means displays the result image according to information indicating the order of the processing flow / input / output information table changed by the changing means and condition information related to branch processing. Item 5. The information processing apparatus according to any one of Items 1 to 4. 6. The result image display means, when the module specifying means specifies that the module is a module related to repetitive processing, displays result images in which the number of repetitive processes is incremented and displayed side by side. The information processing apparatus according to any one of the above. The change instruction for the module is an instruction for at least one of the instructions relating to the new addition process of the module, the process of moving the module, the process of inserting the module, and the process of changing the parameter of the module. The information processing apparatus according to claim 1, wherein the information processing apparatus includes the information processing apparatus. After an instruction to change the module related to the branch process is given to the processing flow, when a change instruction related to the module, which is the next step, is issued, the module related to the branch process is included and the change is made for the subsequent modules. A source code is generated for each module using the processing flow / input / output information table information changed by the means, the module / source code master table information, and the branch processing condition table information. The information processing apparatus according to any one of claims 1 to 7. The input information and the output information in the processing flow / input / output information table are obtained by executing information of an image buffer for storing an image to be processed by each module and executing the processing by each module, respectively. Information of an image buffer for storing the result image is set,
The information processing apparatus according to claim 1, wherein the changing unit changes the input information and the output information as necessary according to a change instruction related to the module. . A method for controlling an information processing apparatus that performs image processing,
Modules indicating processes related to image processing, module / source code master tables in which source codes corresponding to the respective modules are associated, modules in a processing flow combining a plurality of the modules, and execution order of the modules A storage step of storing a processing flow / input / output information table including input information and input information and output information related to processing of each module, and a branch processing condition table including condition information related to branch processing in a table storage unit When,
A module specifying step for specifying the module when an instruction to change the module is given to the processing flow;
When the module specifying step specifies that the module is a module related to branch processing, a conditional expression table creating step for creating a conditional expression table that is information related to branch processing;
In accordance with the change instruction, a change step of changing information in the processing flow / input / output information table including information associating the conditional expression table;
A source code generation step for generating a source code for each module using the information of the processing flow / input / output information table changed by the changing step and the information of the module / source code master table;
An object code generation step for generating an object code based on the source code generated by the source code generation step;
A process execution step for executing the process for each module of the process flow / input / output information table changed by the change step using the object code generated by the object code generation step;
And a result image display step of displaying on the display device a result image for each module obtained by executing the processing in the processing execution step. A program for causing a computer to execute a control method of an information processing apparatus that performs image processing,
Modules indicating processes related to image processing, module / source code master tables in which source codes corresponding to the respective modules are associated, modules in a processing flow in which a plurality of the modules are combined, and the execution order of the modules A storage step of storing a processing flow / input / output information table including input information and input information and output information related to processing of each module, and a branch processing condition table including condition information related to branch processing in a table storage unit When,
A module specifying step for specifying the module when an instruction to change the module is given to the processing flow;
When the module specifying step specifies that the module is a module related to branch processing, a conditional expression table creating step for creating a conditional expression table that is information related to branch processing;
In accordance with the change instruction, a change step of changing information in the processing flow / input / output information table including information associating the conditional expression table;
A source code generation step for generating a source code for each module using the information of the processing flow / input / output information table changed by the changing step and the information of the module / source code master table;
An object code generation step for generating an object code based on the source code generated by the source code generation step;
A process execution step for executing the process for each module of the process flow / input / output information table changed by the change step using the object code generated by the object code generation step;
The program for making a computer perform the result image display step which displays the result image for every said module obtained by execution of the process by the said process execution step on a display apparatus.

Images