JP7531746B1 - Display control device, screen display method and program - Google Patents

Abstract

The inspection device (10) includes a memory unit (13) that stores task setting information related to processing blocks that indicate processing contents related to the inspection, correspondence information that indicates the correspondence between the processing blocks and monitor components, and layout setting information related to setting the layout of a monitor screen using the monitor components selected by a user as display targets, and a layout generation unit (151) that generates monitor layout information for displaying information related to the inspection based on the task setting information, the correspondence information, and the layout setting information.

Description

The present disclosure relates to a display control device, a screen display method, and a program.

In conventional visual inspection, a person visually checks the object to determine whether it is good or defective, but there is an increasing demand to automate visual inspection to detect defective products. To automate visual inspection, a system is required to automatically inspect the object instead of a person visually inspecting it, as well as a system to confirm whether the automated inspection was actually performed correctly. In other words, a system is needed to confirm the inspection results of such automated visual inspection.

As a technique for checking the results of such automated visual inspection, Patent Document 1 discloses a technique for easily creating a screen on which a reference tolerance range can be set and the results of determining whether an inspection target falls within the tolerance range can be checked to see whether it is a good or bad product. The technique in Patent Document 1 allows users to easily check the inspection results.

JP 2013-164313 A

The technology described in Patent Document 1 makes it possible to confirm the test results. However, if the test results seem to be erroneous, it is necessary to check the status of the test and whether the test is being conducted appropriately.

By checking the inspection status, it is possible to identify the process that caused the misjudgment, which will prevent further misjudgments and allow future inspections to be carried out appropriately. Therefore, it is important to check each step of the inspection.

The process that a user wants to focus on checking varies depending on the situation, so a mechanism that allows users to easily select the process they want to check is desirable.

In view of the above circumstances, the object of the present disclosure is to provide a display control device, etc. that allows a user to easily select and confirm the processing that he or she wishes to confirm.

In order to achieve the above object, a display control device according to the present disclosure includes a storage means for storing task setting information related to a processing block indicating processing contents related to an inspection, correspondence information indicating the correspondence between the processing block and a monitor part, and layout setting information related to the setting of a layout of a monitor screen using a monitor part selected by a user as a display target, a layout generating means for generating monitor layout information for displaying information related to the inspection based on the task setting information, the correspondence information , and the layout setting information, a display means for displaying a screen including a monitor screen and a display item setting area, a display control means for displaying a screen based on the monitor layout information generated by the layout generating means on the monitor screen, and an input means for accepting a user's operation . The monitor parts include a monitor part for notifying the user of the status of the inspection for each processing block. The layout generating means newly stores in the storage means new layout setting information for displaying a monitor part corresponding to a processing block selected based on a user's operation on the display item setting area via the input means, and newly generates monitor layout information based on the new layout setting information.

According to the present disclosure, users can easily select and check the processes they wish to check.

FIG. 1 is a diagram showing an overall configuration of an inspection system according to an embodiment of the present disclosure. FIG. 1 is a diagram showing a network configuration of an inspection system according to an embodiment of the present disclosure. FIG. 13 is a diagram illustrating an example of a task setting screen displayed on a terminal device according to an embodiment of the present disclosure. FIG. 1 is a diagram illustrating an example of a monitor screen displayed on a terminal device according to an embodiment of the present disclosure. FIG. 1 is a diagram illustrating an example of a monitor screen displayed on a terminal device according to an embodiment of the present disclosure. FIG. 1 is a diagram illustrating an example of a monitor screen displayed on a terminal device according to an embodiment of the present disclosure. FIG. 1 is a block diagram showing a functional configuration of an inspection device according to an embodiment of the present disclosure. FIG. 1 is a diagram showing an example of correspondence information stored in an inspection device according to an embodiment of the present disclosure. FIG. 1 is a block diagram showing a functional configuration of a terminal device according to an embodiment of the present disclosure. FIG. 1 is a diagram illustrating an example of a hardware configuration of an inspection device and a terminal device according to an embodiment of the present disclosure. 1 is a flowchart showing an example of a data storage operation performed by an inspection device according to an embodiment of the present disclosure. 1 is a flowchart showing an example of a layout generation operation performed by an inspection apparatus according to an embodiment of the present disclosure.

An inspection system according to an embodiment of the present disclosure will now be described with reference to the drawings. In each drawing, the same or equivalent parts are denoted by the same reference numerals.

(Embodiment)
With reference to FIG. 1, an inspection system 1 according to an embodiment will be described. The inspection system 1 is an inspection system that inspects a workpiece W, which is a product processed at a production site P, based on a captured image and a learned model. The inspection system 1 includes an inspection device 10, a terminal device 20, a learning device 30, a file server 40, a cloud system 50, a PLC (Programmable Logic Controller) 2, a camera 3, and a light 4. The PLC 2, the camera 3, and the light 4 are installed at the production site P. In addition, a belt conveyor, a robot arm, and the like (not shown) for moving the workpiece W may also be installed at the production site P. Note that, although only one inspection device is shown in FIG. 1, a plurality of inspection devices may be used. The inspection system 1 is an example of an inspection system according to the present disclosure.

The inspection device 10 executes various tasks related to inspection. Hereinafter, the tasks related to inspection are simply referred to as inspection tasks. An inspection task is a series of processes such as accepting an instruction to start inspection, capturing an image of an object to be inspected by the camera 3, performing an inspection based on the captured image, and feeding back the inspection results to a user. An inspection task includes one or more inspection-related processes, such as capturing an image of the workpiece W by the camera 3, setting the lighting 4 required for capturing the image, acquiring the device value of the PLC 2 when inspecting the workpiece W, and inspecting the workpiece W based on the captured image and the learned model. The learned model is stored in the inspection device 10 or the learning device 30. The learned model can also be additionally stored in the file server 40. The inspection device 10 stores various data obtained during the execution of the inspection task in the file server 40 on a task-by-task basis. This allows the inspection device 10 to easily link various data related to the inspection. A task unit is a unit that collectively includes a series of processes from an instruction to start inspection to feedback of the inspection result. Furthermore, the inspection device 10 transmits monitor layout information to the terminal device 20 for displaying information related to the inspection task on the terminal device 20. Details of the inspection device 10 will be described later. The inspection device 10 is an example of a display control device according to the present disclosure.

The terminal device 20 is a terminal device equipped with an input section and a display section. The terminal device 20 is used by the user to configure settings related to the inspection tasks of the inspection device 10 and to monitor information related to the execution of the inspection tasks by the inspection device 10. The terminal device 20 also realizes user interfaces related to settings related to the generation of trained models, settings for the PLC 2, settings for the camera 3, settings for the lighting 4, etc., in a single user interface. This reduces the burden on the user when configuring the inspection system 1. The terminal device 20 is, for example, a personal computer or a tablet terminal. Details of the terminal device 20 will be described later.

The learning device 30 generates a trained model for inspecting the workpiece W by machine learning based on the captured image data of the image of the workpiece W captured by the camera 3. The trained model is stored in the inspection device 10 or the learning device 30 itself. In addition, the learning device 30 downloads templates, frameworks, libraries, etc. used during machine learning from the cloud system 50. The user operates the terminal device 20 to set which templates, frameworks, libraries, etc. the learning device 30 will use.

The file server 40 stores various data obtained by the inspection device 10 through the execution of the inspection task. The file server 40 stores the trained model generated by the learning device 30.

The cloud system 50 provides templates, frameworks, libraries, etc. for use during machine learning.

The network configuration of the inspection system 1 will be described with reference to Figure 2. The inspection system 1 includes a factory network FN and an information network IN. The learning device 30 and the inspection device 10 are both connected to both the factory network FN and the information network IN. The PLC 2, camera 3 and lighting 4 installed at the production site P are connected to the factory network FN. The terminal device 20, file server 40 and cloud system 50 are connected to the information network IN.

With reference to Figures 3 to 6, the setting of inspection tasks by the terminal device 20 and the display of information related to the inspection tasks are generally described.

The user operates the terminal device 20 to call up the task setting screen shown in Figure 3. On the task setting screen, one or more processing blocks B1 to B6 (hereinafter collectively referred to as "processing blocks B") can be combined to configure one inspection task. In principle, processing blocks B have a chronological relationship, i.e., a flow, such as processing blocks B1 to B5, but some processing blocks do not have a chronological relationship, such as processing block B6.

Processing block B6 (hereinafter also referred to as "pause block B6"), which is a processing block related to suspension (hereinafter also referred to as "pause block"), is a processing block for pausing a running task in response to a user operation. When an inspection task includes the pause block B6, the user can pause the inspection task. The pause block B6 can also be used to resume a task that has already been paused. Note that resuming a task includes not only resuming a task paused by the pause block B6, but also resuming a task that has been paused for some reason. How to pause and resume a task will be described later. In this way, processing block B includes a processing block (hereinafter also referred to as "operation block") that executes processing based on a user operation.

In principle, each processing block B outputs something. For example, processing blocks B1 and B3, which are processing blocks related to imaging, output data related to captured images. Furthermore, processing blocks B2 and B4, which are processing blocks related to inspection, output data related to inspection results. Processing block B5 related to device value acquisition outputs data related to acquired device values. In addition, a processing block B may process and output data output by another processing block B. For example, there may be a processing block B that performs preprocessing on data related to captured images and outputs the preprocessed image data. This processing block related to preprocessing is provided between the processing block related to imaging and the processing block related to inspection in the flow of the inspection task. In addition to the processing block related to preprocessing, processing blocks related to data calculation, generation of new images, etc. can be provided between the processing block related to imaging and the processing block related to inspection.

Based on the inspection tasks set by the user, the inspection device 10 stores the data output by each processing block in the file server 40 on an inspection task basis. Although not shown in FIG. 3, the user can set the task setting screen to store only a portion of the data output by each processing block. For example, the user can set which types of data output by each processing block to store. Alternatively, the user can set the data to be stored for each processing block individually.

After setting the inspection task, the user can operate the terminal device 20 to call up the monitor screen shown in FIG. 4. The monitor screen shown in FIG. 4 is displayed based on the monitor layout information generated by the inspection device 10. The monitor screen shown in FIG. 4 includes monitor components C1-C4 (hereinafter also referred to as "monitor components C"). The monitor component C1 related to the front surface inspection corresponds to the processing block B2 of the front surface inspection shown in FIG. 3, the monitor component C2 related to the back surface inspection corresponds to the processing block B4 of the back surface inspection shown in FIG. 3, the monitor component C3 related to the pause button (hereinafter also referred to as the "pause button C3") corresponds to the pause block B6 shown in FIG. 3, and the monitor component C4 related to the device value corresponds to the processing block B5 of the device value acquisition shown in FIG. 3. Due to the display item setting described later, the monitor component corresponding to the processing block B1 of the front surface imaging and the monitor component corresponding to the processing block B3 of the back surface imaging are not displayed in FIG. 4.

In this way, the layout of the monitor screen is generated by combining monitor components C to display information about each processing block B that makes up the inspection task side-by-side in accordance with the settings of the inspection task configured on the task setting screen. This allows the user to check the status of the inspection on a monitor screen appropriate for the inspection task that he or she has set, making it easy to check the status of the inspection.

The user can operate the terminal device 20 to set which monitor parts to display from the display item setting area R, as shown in FIG. 5. For example, when "Memo" is checked, a monitor part C5 relating to memos is added to the monitor screen, as shown in FIG. 6. This "Memo" monitor part C5 is a monitor part into which the user can freely enter text. Unlike monitor parts C1-C4, the "Memo" monitor part C5 is not associated with processing block B. In this way, the monitor parts also include parts that are not associated with processing block B but are provided for the convenience of the user.

The functional configuration of the inspection device 10 will be described with reference to Figure 7. The inspection device 10 includes a first communication unit 11, a second communication unit 12, a memory unit 13, a task management unit 14, and a layout management unit 15.

The first communication unit 11 communicates with each device connected to the factory network FN.

The second communication unit 12 communicates with each device connected to the information network IN.

The storage unit 13 stores task setting information indicating the setting contents of the inspection task, correspondence information indicating the correspondence between the processing block B and the monitor component C, and layout setting information regarding the setting of the layout of the monitor screen. The storage unit 13 is an example of a storage means according to the present disclosure.

The task setting information includes information about the process blocks B that make up the inspection task, information about the flow between the process blocks B that make up the inspection task, and information about the data that the user has set as the target to be saved. The correspondence information is represented, for example, in a table as shown in FIG. 8. The correspondence information makes it possible to identify the monitor component C that corresponds to the process block B indicated in the task setting information. The correspondence information is created in advance, for example, by the manufacturer of the inspection device 10 and stored in the memory unit 13. The layout setting information includes information indicating which monitor component C is to be displayed and where the monitor component C to be displayed is to be displayed. The layout setting information is determined, for example, based on the user's operation in the display item setting area R shown in FIG. 5 described above.

The task management unit 14 manages the inspection tasks. The task management unit 14 particularly includes a data acquisition unit 141, a task setting unit 142, a task execution unit 143, and a data storage unit 144.

The data acquisition unit 141 acquires a device value from the PLC 2 via the first communication unit 11, and acquires captured image data relating to an image of the workpiece W from the camera 3 via the first communication unit 11. Note that this data acquisition may be performed as part of the processing of a processing block executed by the task execution unit 143 described below.

The task setting unit 142 sets the inspection task based on the user's operation via the task setting screen displayed by the terminal device 20. As described below, the terminal device 20 transmits information based on the user's operation via the task setting screen to the inspection device 10. The task setting unit 142 acquires this information via the second communication unit 12 and sets the inspection task based on this information. The task setting unit 142 stores task setting information indicating the setting contents of the inspection task in the memory unit 13. The user operates the terminal device 20 to select data to be saved, and the task setting unit 142 sets the data to be saved when setting the inspection task, so that the data selected by the user can be saved on an inspection task basis.

The task execution unit 143 refers to the task setting information stored in the storage unit 13, sequentially executes multiple processing blocks B that constitute the inspection task, and retains data output by each processing block B that the user has set as a target to be saved, on an inspection task basis. The task execution unit 143 also retains the referenced task setting information on an inspection task basis. When the user operates the terminal device 20 to operate a monitor component C corresponding to an operation block, the task execution unit 143 executes processing of the corresponding operation block. For example, when the operation block is a paused block B6, the task execution unit 143 pauses the execution of the inspection task when the inspection task is not paused. Also, when the inspection task is paused, the task execution unit 143 resumes the execution of the paused task. The task execution unit 143 is an example of a task execution means according to the present disclosure.

The data storage unit 144 stores the data held by the task execution unit 143 on an inspection task basis in the file server 40 via the second communication unit 12. For example, the data storage unit 144 stores the data when the task execution unit 143 completes execution of the inspection task. This means that various data related to the inspection are automatically linked and stored on an inspection task basis. Since the task execution unit 143 also holds task setting information on an inspection task basis, the task setting information is also stored on the file server 40 on an inspection task basis. Therefore, the user can refer to the various data and task setting information stored on the file server 40 on an inspection task basis as necessary, and reproduce and verify the inspection task.

The layout management unit 15 manages the layout of the monitor screen displayed on the terminal device 20. The layout management unit 15 includes a layout generation unit 151, a layout transmission unit 152, and an operation acquisition unit 153.

The layout generation unit 151 refers to the task setting information, correspondence information, and layout setting information stored in the storage unit 13, and generates monitor layout information for generating a monitor screen shown in FIG. 4, for example. The monitor layout information includes information regarding which monitor component C is to be placed in which position, what is to be displayed on each monitor component C, and so on. Since most monitor components C display information related to the output of the processing block B, the layout generation unit 151 refers to data held by the task execution unit 143 on an inspection task basis as necessary. The monitor layout information is expressed by Web content including, for example, an HTML (Hyper Text Markup Language) file, an image file, and the like. The layout generation unit 151 is an example of a layout generation means according to the present disclosure.

When the user performs an operation to change the layout settings, for example, an operation in the display item setting area R shown in FIG. 5, the layout generation unit 151 stores new layout setting information in the storage unit 13 and generates new monitor layout information based on the new layout setting information. The operation to change the layout settings is acquired by the operation acquisition unit 153 described later.

The layout transmission unit 152 transmits the monitor layout information generated by the layout generation unit 151 to the terminal device 20 via the second communication unit 12. For example, as described above, when the monitor layout information is represented by Web content, the layout transmission unit 152 is realized by implementing a function as a Web server.

The operation acquisition unit 153 acquires information indicating an operation related to a change in layout settings by a user from the terminal device 20 via the second communication unit 12. For example, when a user operates the display item setting area R shown in FIG. 5 to turn on the "Memo" item, the terminal device 20 transmits information regarding the operation to the inspection device 10, and the operation acquisition unit 153 acquires the information regarding the operation. Based on the information regarding the operation acquired by the operation acquisition unit 153, the layout generation unit 151 stores new layout setting information indicating that the "Memo" monitor component C is to be displayed in the storage unit 13. The layout generation unit 151 then generates new monitor layout information including the "Memo" monitor component C.

The functional configuration of the terminal device 20 will be described with reference to Figure 9. The terminal device 20 includes a communication unit 21, a display unit 22, an input unit 23, and a control unit 24.

The communication unit 21 communicates with each device connected to the information network IN.

The display unit 22 displays a screen based on the control of the control unit 24. The display unit 22 is, for example, a liquid crystal display. The display unit 22 may also be a touch screen integrated with the input unit 23 described below. The display unit 22 is an example of a display means according to the present disclosure.

The input unit 23 receives a user operation and outputs a signal indicating the user operation to the control unit 24. The input unit 23 includes an input device such as a mouse or a keyboard. Alternatively, the input unit 23 may be a touch screen integrated with the display unit 22. The input unit 23 is an example of an input means according to the present disclosure.

The control unit 24 comprehensively controls the terminal device 20. In particular, the control unit 24 acquires monitor layout information from the inspection device 10 via the communication unit 21, and displays a monitor screen on the display unit 22 based on the monitor layout information. When the user calls up a task setting screen by operating the input unit 23 and performs a task setting operation, the control unit 24 transmits information indicating the task setting contents to the inspection device 10. When the user operates a monitor component C corresponding to an operation block on the monitor screen by operating the input unit 23, the control unit 24 transmits information indicating the operation to the inspection device 10. When the user operates a display item setting operation related to the monitor component C to be displayed on the monitor screen by operating the input unit 23, the control unit 24 transmits information indicating the selected display item to the inspection device 10. The control unit 24 is an example of a display control means according to the present disclosure.

Furthermore, the control unit 24 causes the display unit 22 to display a setting screen for model generation by the learning device 30, a setting screen for the PLC 2, a setting screen for the camera 3, and a setting screen for the lighting 4 as setting screens that can be operated by the same user interface. The control unit 24 can set the PLC 2, the camera 3, and the lighting 4 via the inspection device 10 or the learning device 30. The control unit 24 sets the learning device 30, the PLC 2, the camera 3, and the lighting 4 based on user operations via the setting screens.

The control unit 24 has a function as, for example, a Web browser. The control unit 24 functioning as a Web browser communicates with the inspection device 10 or the learning device 30 functioning as a Web application server, and acquires Web content representing various setting screens from the inspection device 10 or the learning device 30. The control unit 24 displays a setting screen based on the acquired Web content on the display unit 22. The inspection device 10 or the learning device 30 functioning as a Web application server can realize various setting screens that can be operated by the same user interface, for example, by generating Web content representing various setting screens in the same Web framework. The control unit 24 transmits information representing user operations on various setting screens to the inspection device 10 or the learning device 30 functioning as a Web application server. The inspection device 10 or the learning device 30 that receives the information sets the PLC 2, the camera 3, and the lighting 4 based on the information.

An example of the hardware configuration of the inspection device 10 and the terminal device 20 will be described with reference to Fig. 10. The inspection device 10 and the terminal device 20 shown in Fig. 10 are realized by a computer such as a personal computer or a microcontroller.

The inspection device 10 and the terminal device 20 have a processor 1001, a memory 1002, an interface 1003, and a secondary storage device 1004, connected to each other via a bus 1000.

The processor 1001 is, for example, a CPU (Central Processing Unit). The processor 1001 loads an operating program stored in the secondary storage device 1004 into the memory 1002 and executes it, thereby realizing each function of the inspection device 10 and the terminal device 20.

The memory 1002 is a main storage device constituted by, for example, a RAM (Random Access Memory). The memory 1002 stores the operating program read by the processor 1001 from the secondary storage device 1004. The memory 1002 also functions as a working memory when the processor 1001 executes the operating program.

Interface 1003 is, for example, an I/O (Input/Output) interface such as a serial port, a USB (Universal Serial Bus) port, or a network interface.

The secondary storage device 1004 is, for example, a flash memory, a hard disk drive (HDD), or a solid state drive (SSD). The secondary storage device 1004 stores the operating program executed by the processor 1001.

An example of the data storage operation by the inspection device 10 will be described with reference to Figure 11. The operation shown in Figure 11 is executed on an inspection task basis.

The task execution unit 143 of the task management unit 14 of the inspection device 10 refers to the task setting information stored in the memory unit 13 and executes processing of the first processing block of the inspection task (step S101).

The task execution unit 143 holds the data output by the processing block (step S102). Since the operation shown in FIG. 11 is executed on an inspection task basis, the data output by the processing block is held on an inspection task basis.

The task execution unit 143 determines whether there is an unprocessed processing block (step S103). Note that the unprocessed processing block does not include an operation block that is independent of the flow, such as the paused block B6 shown in FIG. 3.

If there is an unprocessed processing block (step S103: Yes), the task execution unit 143 executes processing of the next processing block (step S104) and repeats the operations from step S102.

When there are no unprocessed processing blocks (step S103: No), the data storage unit 144 of the task management unit 14 stores the data that the task execution unit 143 held in step S102 in the file server 40 (step S105). Then, the task management unit 14 ends the data storage operation.

An example of the layout generation operation by the inspection device 10 will be described with reference to Figure 12. The operation shown in Figure 12 is started, for example, when a user operates the terminal device 20 to call up a monitor screen, and the operation acquisition unit 153 of the layout management unit 15 of the inspection device 10 acquires information regarding the operation from the terminal device 20.

The layout generation unit 151 of the layout management unit 15 of the inspection device 10 refers to the task setting information, correspondence information and layout setting information stored in the memory unit 13 (step S201).

Based on the task setting information referenced in step S201, the layout generation unit 151 references the data held by the task execution unit 143 on an inspection task basis (step S202).

The layout generating unit 151 generates monitor layout information based on the task setting information, correspondence information, and layout setting information referenced in step S201, and the data held for each inspection task referenced in step S202 (step S203). This generates a layout for the monitor screen including the monitor component C that displays the data output by the processing block B.

The layout transmission unit 152 of the layout management unit 15 transmits the monitor layout information generated in step S203 to the terminal device 20 (step S204). The layout management unit 15 then ends the layout generation operation.

The above describes the inspection system 1 according to the embodiment. According to the inspection system 1, the data storage unit 144 of the inspection device 10 automatically stores data obtained by executing processing block B of an inspection task on an inspection task basis, so that various data related to the inspection can be easily linked. Furthermore, according to the inspection system 1, the user can set which data to save on an inspection task basis, so that data can be freely extracted and saved.

Furthermore, according to the inspection system 1, by simply setting an inspection task on the task setting screen, monitor layout information for an appropriate monitor screen is generated according to the setting of the inspection task, so that the user can easily check the status of the inspection. Furthermore, according to the inspection system 1, monitor layout information for an appropriate monitor screen is generated, and display items can be easily set, so that the user can easily create a monitor screen that suits his or her preferences. Therefore, the user can easily select and check the process that he or she wants to check.

In addition, the inspection system 1 allows the user to reduce the number of monitor parts displayed on the monitor screen as needed, thereby improving processing speed and reducing communication load.

In addition, according to the inspection system 1, the settings related to learning of the learning device 30, the settings of the PLC 2, the settings of the camera 3 and the settings of the lighting 4 can be set using the same user interface by operating the terminal device 20, thereby reducing the burden on the user when setting up the inspection system 1.

(Modification)
In the embodiment, the inspection system 1 includes both the file server 40 and the cloud system 50, but may include only one of them. For example, the file server 40 may provide templates, frameworks, libraries, etc., and the cloud system 50 may store data for each inspection task.

In the embodiment, the inspection device 10 and the learning device 30 are separate devices, but they may be combined into a single device. In particular, when machine learning is performed in real time in parallel with the inspection, it is highly likely that it will be more efficient to combine them into a single device.

In the embodiment, the terminal device 20 and the inspection device 10 are separate devices, but the inspection device 10 may have each function of the terminal device 20 and also function as the terminal device 20. In this case, for example, the inspection device 10 functions as both a web application server and a web browser. When a user sets up the PLC 2, the camera 3, and the lighting 4 using the inspection device 10, the function of the web application server generates web content representing a setting screen, and the function of the web browser acquires the generated web content and displays various setting screens based on the acquired web content.

In the embodiment, the inspection device 10 includes a layout management unit 15 and a storage unit 13 in which task setting information, correspondence information, and layout setting information are stored, but these may be included in the terminal device 20. In that case, the terminal device 20 generates the monitor layout information. The inspection device 10 or the terminal device 20 that generates the monitor layout information may be referred to as a display control device.

In the hardware configuration shown in FIG. 10, the inspection device 10 and the terminal device 20 are equipped with a secondary storage device 1004. However, this is not limited to the above, and the secondary storage device 1004 may be provided outside the inspection device 10 and the terminal device 20, and the inspection device 10 and the terminal device 20 may be connected to the secondary storage device 1004 via the interface 1003. In this configuration, removable media such as a USB flash drive and a memory card can also be used as the secondary storage device 1004.

10, the inspection device 10 and the terminal device 20 may be configured with a dedicated circuit using an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or the like. In the hardware configuration shown in FIG. 10, some of the functions of the inspection device 10 and the terminal device 20 may be realized by a dedicated circuit connected to, for example, the interface 1003.

The programs used in the inspection device 10 and the terminal device 20 can be stored and distributed on computer-readable recording media such as CD-ROMs (Compact Disc Read Only Memory), DVDs (Digital Versatile Discs), USB flash drives, memory cards, and HDDs. By installing such programs on a specific or general-purpose computer, the computer can function as the inspection device 10 and the terminal device 20.

The above-mentioned program may also be stored in a storage device owned by another server on the Internet, and the above-mentioned program may be downloaded from that server.

Various embodiments and modifications of the present disclosure are possible without departing from the broad spirit and scope of the present disclosure. Furthermore, the above-described embodiments are intended to explain the present disclosure and do not limit the scope of the present disclosure. In other words, the scope of the present disclosure is indicated by the claims, not the embodiments. Various modifications made within the scope of the claims and within the scope of the meaning of the disclosure equivalent thereto are deemed to be within the scope of the present disclosure.

1 Inspection system, 2 PLC, 3 Camera, 4 Lighting, 10 Inspection device, 11 First communication unit, 12 Second communication unit, 13 Memory unit, 14 Task management unit, 15 Layout management unit, 20 Terminal device, 21 Communication unit, 22 Display unit, 23 Input unit, 24 Control unit, 30 Learning device, 40 File server, 50 Cloud system, 141 Data acquisition unit, 142 Task setting unit, 143 Task execution unit, 144 Data storage unit, 151 Layout generation unit, 152 Layout transmission unit, 153 Operation acquisition unit, 1000 Bus, 1001 Processor, 1002 Memory, 1003 Interface, 1004 Secondary storage device, B1-B6 Processing block, C1-C5 Monitor parts, FN Factory network, IN Information network, P Production site, R Display item setting area, W Work.

Claims (9)

a storage means for storing task setting information on processing blocks indicating processing contents related to an inspection, correspondence information indicating correspondence between the processing blocks and monitor components, and layout setting information on the setting of the layout of a monitor screen using the monitor components selected by a user as display targets;
a layout generating means for generating monitor layout information for displaying information related to the examination based on the task setting information, the correspondence information, and the layout setting information;
a display means for displaying a screen including the monitor screen and a display item setting area;
a display control means for displaying on the monitor screen a screen based on the monitor layout information generated by the layout generation means;
An input means for accepting a user's operation;
Equipped with
the monitor component includes a monitor component for notifying a user of a status of the inspection for each of the processing blocks ;
the layout generating means stores in the storage means new layout setting information for displaying the monitor components corresponding to the processing blocks selected based on the user's operation on the display item setting area via the input means, and generates new monitor layout information based on the new layout setting information.
Display control device. The task setting information includes information on a plurality of processing blocks constituting an inspection task, which is a task related to the inspection and includes a plurality of processes related to the inspection, and information on a flow between the plurality of processing blocks.
The display control device according to claim 1 . the layout generating means generates the monitor layout information for displaying information about each of the plurality of processing blocks in an arranged manner;
The display control device according to claim 2 . The plurality of processing blocks include a processing block related to imaging of an inspection object, a processing block related to inspection of the inspection object, and a processing block related to processing executed between the imaging and the inspection.
The display control device according to claim 2 . the layout generation means generates the monitor layout information further including an interface that allows the user to select which processing block information is to be displayed, and stores the new layout setting information based on an operation of the user on the interface in the storage means.
The display control device according to claim 1 . a task execution unit that executes the inspection based on the task setting information,
the processing block includes an operation block that executes a process based on an operation of the user;
the correspondence information includes information relating to a correspondence between the operation block and an operation component that is a monitor component corresponding to the operation block;
the task execution means, when the operational component is operated by the user's operation via the input means, executes a process by the operational block corresponding to the operational component.
The display control device according to claim 1 . The operational blocks include a pause block for pausing execution of the test and for resuming execution of the test that has been paused;
the operation component includes a pause button corresponding to the pause block,
When the pause button is pressed by the user's operation via the input means, the task execution means executes a process according to the pause block to pause the execution of the test, and resumes the execution of the paused test.
The display control device according to claim 6 . generating monitor layout information for displaying information relating to the inspection based on task setting information relating to a processing block indicating processing contents relating to the inspection, correspondence information indicating correspondence between the processing block and a monitor component, and layout setting information relating to setting of a layout of a monitor screen using the monitor component selected by a user as a display target;
displaying a screen based on the monitor layout information on a monitor screen of a display means for displaying a screen including a monitor screen and a display item setting area ;
Accepting a user's operation via an input means;
the monitor component includes a monitor component for notifying a user of a status of the inspection for each of the processing blocks ;
generating new monitor layout information based on new layout setting information for displaying the monitor components corresponding to the processing blocks selected based on an operation of the user on the display item setting area via the input means;
Screen display method. On the computer,
generating monitor layout information for displaying information relating to the inspection based on task setting information relating to a processing block indicating processing contents relating to the inspection, correspondence information indicating correspondence between the processing block and a monitor component, and layout setting information relating to setting of a layout of a monitor screen using the monitor component selected by a user as a display target;
displaying a screen based on the monitor layout information on a monitor screen of a display means for displaying a screen including a monitor screen and a display item setting area;
Accepting a user's operation via an input means;
the monitor component includes a monitor component for notifying a user of a status of the inspection for each of the processing blocks ;
generating new monitor layout information based on new layout setting information for displaying the monitor parts corresponding to the processing blocks selected based on an operation of the user on the display item setting area via the input means;
program.

Images