CN103826800B - Refining work support apparatus, refining Work support method and refining Work support system - Google Patents

Abstract

A refining operation support device for supporting the refining operation of steel plates, comprising: an imaging device for photographing the surface of the steel plate; a display device for displaying images on the surface of the steel plate; and a control device for The associated refining-related information and captured images obtained from the camera device are used to control the display device so that the refining reference and refining standards required for flaw removal in the refining-related information are displayed on or around the refining site where the flaw removal work is performed as the refining operation. The method is used as operation support information.

Description

Refined work support device, refined work support method, and refined work support system

technical field

The present invention relates to a finishing work support device, a finishing work support method, and a finishing work support system for supporting finishing work of a steel plate.

This application claims priority based on Japanese Patent Application No. 2012-023173 for which it applied to Japan on February 06, 2012, and uses the content here.

Background technique

The finishing work of steel plate involves various aspects such as dimensional measurement, marking printing, embossing, etc., in addition to removing flaws by grinding etc. Currently, work instructions to the operator are performed through paper sheets printed as work instruction tickets. The result input in the inspection process of a previous process etc. is reflected in the content of the said work instruction.

When the steel plate as the target material arrives at the process, the operator checks the surface of the target material again while comparing it with the above-mentioned work instruction sheet, writes the maintenance part, confirms the dimension measurement position, and prints and embosses by marking After judging the necessity, etc., start the refinement work.

After finishing the refined work, the operator checks the surface of the steel plate as the target material again, writes the result by hand on the work instruction sheet, and then inputs the refined work result into the commercial computer, thus completing a series of work processes .

In recent years, since work instruction tickets have been digitized, tablet-type terminals have been used to display images and become paperless. In addition, the size measurement result is transmitted as electronic information from the previous process and received by the tablet terminal side, thereby reducing the workload. Furthermore, in order to display on the tablet terminal, in the flaw inspection process, the flaw position is input as coordinate information.

However, marking work such as spraying or embossing on the target material, subsequent finishing work, and confirmation work after the work is completed require the operator to perform work on the steel plate many times, as before. Therefore, further improvements are required to improve work efficiency or ensure the safety of workers.

Patent Document 1 discloses the use of a self-propelled flaw removing device having a CCD imaging device in a method for removing flaws in a steel plate. This device automates the blemish removal work. However, prior to the above blemish removal work, various markings, dimension measurements, stamping, etc. corresponding to the type of blemishes on the steel plate are not automated, and require a lot of work by the operator. Labeling, etc., is the same as ever.

prior art literature

patent documents

Patent Document 1: Japanese Patent Laid-Open No. 2000-296453

Contents of the invention

The problem to be solved by the invention

An object of the present invention is to provide a finishing work support device, a finishing work support method, and a finishing work support system capable of improving the efficiency of steel plate finishing work and reducing the burden on an operator.

In order to solve the above problems and achieve related objects, the present invention adopts the following solutions.

That is, (1) according to one embodiment of the present invention, the refining operation support device supports the refining operation of a steel plate, and includes: an imaging device for photographing the surface of the steel plate; a display device for displaying an image on the surface of the steel plate; A device for controlling the display device to display the refined portion on the surface of the steel plate or its surroundings based on the refinement-related information obtained from the information management device and the image captured by the imaging device. Among the refining-related information, the information necessary for carrying out the finishing work at the finishing site is used as work support information, and the work support information displayed on or around the finishing site where the flaw removal work is performed as the finishing work includes the flaw removal work. Required refining benchmarks and refining methods.

(2) In the refinement work support device described in (1) above, preferably, the control device recognizes the movement of the operator performing the refinement work based on the captured image, and controls the display device so that the work support information The display status of changes according to the operation of the above operator.

(3) In the refined work support device described in (2) above, preferably, the control device controls the display device to switch between display and non-display of the work support information, the operation At least one of a change in the display position of the support information, a change in the display size of the work support information, and additional display of supplementary information related to the work support information.

(4) In the finishing work support device described in (1) above, preferably, the control device recognizes a movement of a worker performing the finishing work from the captured image, and controls peripheral devices based on the movement of the worker.

(5) In the finishing work support device described in (4) above, preferably, the peripheral device is a lighting device that illuminates the surface of the steel plate, and the control device controls brightness of the lighting device in accordance with actions of the operator.

(6) In the refining operation support device described in any one of (1) to (5) above, preferably, the control device recognizes that the surrounding area of the refining part or the operation support information is related to the refined part based on the captured image. When a work end mark is written in the work end mark writing area displayed together, it is determined that the refinement work of the above-mentioned refinement part is completed.

(7) In the refining operation support device described in (6) above, preferably, when the control device determines that the refining operation is completed, the display device is controlled so as to display an indication of contact at a predetermined position on the surface of the steel sheet. Down arrows for other refined parts that should be refined.

(8) In the refining operation support device described in (6) or (7) above, it is preferable that, when the control device determines that the refining operation is completed, it is preferable to inspect the refined part where the refining operation is completed based on the captured image. , and send the inspection result to the above-mentioned information management device.

(9) In the refining operation support device described in any one of the above (6) to (8), it is preferable that the control device displays the The device is controlled to display all work completion messages at predetermined positions on the surface of the steel plate.

(10) In the refining work support device described in any one of (1) to (9) above, preferably, the control device reads the surrounding area of the refined part from the captured image or displays it together with the work support information. The additional process code written in the additional process code entry area of the , and the read additional process code is sent to the information management device.

(11) In the refining operation support device described in any one of (1) to (10) above, preferably, the control device measures the size of the steel plate based on the captured image, and determines whether the measured value of the size satisfies a specified value. specifications, and send the judgment result and the measured value of the above-mentioned size to the above-mentioned information management device.

(12) In the refining work support device described in any one of (1) to (11) above, preferably, the control device specifies additional refining after recognizing the operator performing the refining work from the captured image. In the case of movement of a part, the display device is controlled to display a defect code recording area together with the work support information on the additional refined part on the surface of the steel plate or its surroundings.

(13) In the refined work support device described in (12) above, preferably, the control device reads the defect code written in the defect code entry area based on the captured image, and stores the read The defect code and the location information of the additional refined part are sent to the information management device.

(14) In the finishing work support device described in any one of (1) to (13) above, preferably, the display device is a laser drawing device that displays an image by irradiating laser light on the surface of the steel sheet.

(15) In the refining work support device described in any one of (1) to (14) above, it is preferable to further include a trimming device provided so as to be able to move freely in the in-plane direction and the out-of-plane direction of the surface of the steel plate. , for the refinement operation described above.

(16) In the finishing work support device described in (15) above, preferably, the trimming device includes at least one of a blemish grinding mechanism, a blemish melting mechanism, a painting and printing mechanism, and an embossing mechanism.

In addition, (17) a refining operation support method according to an embodiment of the present invention is for supporting the refining operation of a steel plate, comprising: a step of acquiring refining-related information related to the refining operation of the steel plate; acquiring a steel plate surface of the steel plate process of capturing an image; and based on the refining-related information and the captured image, information necessary for carrying out the refining operation at the refining site in the refining-related information in the refining-related information is displayed on or around the refining site on the surface of the steel plate as an operation support In the process of information, the above-mentioned work support information displayed on the above-mentioned refined part or its surroundings where the flaw removal work is performed as the above-mentioned finishing work includes the refinement standard and the refinement method required for the above-mentioned flaw removal work.

(18) In the refinement operation support method described in (17) above, it is preferable to further include: a step of recognizing an action of a worker performing the refinement work based on the captured image; The process in which the display status of the work support information changes.

(19) In the refinement operation support method described in (18) above, preferably, in the step of changing the display state of the operation support information, the display and non-display of the operation support information are performed according to the operation of the operator. At least one of display switching, change of display position of the work support information, change of display size of the work support information, and additional display of supplementary information related to the work support information.

(20) In the refinement operation support method described in (17) above, it is preferable to further include: the steps of recognizing the movement of the operator performing the refinement work based on the captured image; The process of the device.

(21) In the refining work support method described in (20) above, preferably, in the step of controlling the peripheral device, the brightness of an illuminating device that illuminates the surface of the steel plate is controlled according to the movement of the worker.

(22) In the refinement operation support method described in any one of (17) to (21) above, it is preferable to further include: recognizing the periphery of the refinement site based on the captured image or displaying it together with the operation support information. A process with a work-end mark written in the work-end mark entry area; and a process in which it is determined that the refinement operation of the refinement portion is completed when the work-end mark is recognized.

(23) In the refinement operation support method described in the above (22), it is preferable to further include: when it is determined that the refinement operation is completed, displaying at a predetermined position on the surface of the steel sheet indicating that the refinement operation should be performed next. The process of refining the arrow of the part.

(24) In the refinement operation support method described in (22) or (23) above, preferably, further comprising: when it is determined that the refinement operation is completed, the refinement site where the refinement operation is completed is inspected based on the captured image. and the process of making the inspection results of the above-mentioned refined parts available for viewing.

(25) In the refining operation support method described in any one of (22) to (24) above, it is preferable to further include: when it is determined that the refining operation has been completed for all the refining parts, the steel plate Predetermined positions on the surface display all operations with end-of-job messages.

(26) In the refinement operation support method described in any one of (17) to (25) above, it is preferable to further include: reading the surroundings of the refinement part from the captured image or displaying it together with the operation support information The process of the additional process code written in the additional process code input area of the additional process code; and the process of making the read additional process code readable.

(27) In the refining operation support method described in any one of (17) to (26) above, it is preferable to further include: a step of measuring the size of the steel plate based on the captured image; and determining whether the measured value of the size is a step of satisfying a predetermined standard; and a step of making the result of judging whether or not the measured value of the size satisfies the standard and the measured value of the size available for browsing.

(28) In the refinement operation support method described in any one of (17) to (27) above, it is preferable to further include: based on the captured image, it is recognized that the operator performing the refinement operation specified an additional refinement site. a step of operating; and a step of displaying a defect code written area around the additionally refined portion on the surface of the steel sheet together with the work support information.

(29) In the refinement operation support method described in (28) above, it is preferable to further include: a step of reading the defect code written in the defect code recording area based on the captured image; The above-mentioned defect code and the position information of the above-mentioned additional refined part are set to be a process that can be browsed.

Furthermore, (30) a refined work support system according to an embodiment of the present invention includes: the refined work support device described in any one of (1) to (16) above that supports the refined work of a steel plate; and an information management device and providing the refinement-related information related to the refinement operation of the steel plate to the refinement operation support device.

Invention effect

According to the refining operation supporting device described in the above (1) or the refining operation supporting method described in the above (17), when the refining operation of the steel plate is performed, at or around the refining site on the surface of the steel plate, the refining at the refining site The information necessary for the work (in particular, the refining standard and refining method at the refining site where the flaw removal operation is performed) is displayed as work support information, so the operator can easily recognize the position of the refining site on the surface of the steel plate and the position of the refining site. As a result, the information required for the refining operation can improve the efficiency of the refining operation of the steel plate and reduce the burden on the operator.

According to the refined work support device described in the above (2) or the refined work support method described in the above (18), since the operator can consciously change the display state of the work support information, the efficiency of the refined work can be further improved.

According to the refined work support device described in the above (3) or the refined work support method described in the above (19), switching between display and non-display of the work support information or display of the work support information is performed, for example, according to actions of the operator. Changing the position can prevent the display of the work support information from hindering the fine work, by changing the display size of the work support information, the operator can easily confirm the work support information visually, and by performing a display related to the work support information The additional display of supplementary information enables the operator to easily understand the work support information.

According to the finishing work support device described in the above (4) or the finishing work support method described in the above (20), since the operator can remotely operate the peripheral device while working on the steel plate, the efficiency of the finishing work can be further improved.

According to the refined work support device described in the above (5) or the refined work support method described in the above (21), for example, when the peripheral device is a lighting device that illuminates the surface of the steel plate, the operator can remotely control the brightness of the lighting device. When the operator visually confirms the refining information displayed on the surface of the steel plate, the brightness of the lighting device can be dimmed to improve the visibility of the refining information. When the operator is performing the refining operation, the brightness of the lighting device can be dimmed bright, thereby improving workability.

According to the refining work support device described in the above (6) or the refining work support method described in the above (22), the control device can automatically recognize the refined location on the surface of the steel plate where the finishing work has been completed.

According to the refining work support device described in the above (7) or the refining work support method described in the above (23), after finishing the finishing work at a certain refined position on the surface of the steel plate, the operator can easily find out what should be done next. It is the refined part where the refining operation is carried out, so the efficiency of the refining operation can be further improved.

According to the refining work support device described in the above (8) or the refining work support method described in the above (24), it is possible to automatically inspect the refined parts on the surface of the steel plate where the finishing work has been completed, and the inspection results are collected in the information management device. And it can be browsed, so the quality inspection of the steel plate after finishing the finishing process becomes easy.

According to the refining operation support device described in the above (9) or the refining operation support method described in the above (25), the operator can easily recognize the completion of the refining work at all the refining locations on the surface of the steel plate, so that the refining process can be further improved. work efficiency.

According to the refining operation support device described in the above (10) or the refining operation support method described in the above (26), when the operator needs to add an operation to a certain refined part, only by indicating the additional operation to be performed The additional process code of the process is written around the refined part or the additional process code entry area, so that the additional process code can be concentrated on the information management device and can be browsed, so it can be easily confirmed that the newly added process after the refined process is completed additional process.

According to the refined work support device described in the above (11) or the refined work support method described in the above (27), it is possible to automatically determine whether the size of the steel plate satisfies a predetermined specification, and the result of the determination and the measured value of the size are centralized in information management. It can be viewed through the device, so the dimension inspection of the steel plate after the finishing process becomes easy.

According to the refining work support device described in the above (12) or the refining work support method described in the above (28), when the operator finds a new surface flaw on the surface of the steel plate, he can locate the surface flaw at the position of the surface flaw ( Refined parts are added) to display work support information.

According to the finishing work support device described in the above (13) or the finishing work support method described in the above (29), the newly added position information and defect codes of the additional finishing parts as described above are concentrated in the information management device and can be browsed, Therefore, the operator can easily confirm the position of the surface flaw or the state of the flaw newly found on the surface of the steel sheet after finishing the finishing process.

According to the precision work support device described in (14) above, since the laser drawing device is used as the display device, the visibility of the work support information displayed on the surface of the steel plate is improved.

According to the finishing work support device described in (15) above, since the trimming device used for the finishing work is provided in advance to be movable in the in-plane direction and the out-of-plane direction of the steel plate surface, the efficiency of the finishing work can be further improved.

According to the refining work support device described in the above (16), since it can cope with any refining work, it is possible to further improve the efficiency of the refining work.

According to the refining operation support system described in (30) above, the operator can easily recognize the position of the refined portion on the surface of the steel plate and the information required for the refining operation at the refined portion. As a result, the efficiency of the refining operation of the steel plate can be improved, And reduce the burden on the operator.

Description of drawings

FIG. 1 is a schematic configuration diagram of a finishing operation support device 1 according to an embodiment of the present invention.

FIG. 2 is a system configuration diagram of a refinery operation support system 500 constructed using a production management system 600 of an ironworks plant.

FIG. 3A is an operation flowchart of the refinement operation support device 1 .

FIG. 3B is an operation flowchart of the refinement work support device 1 .

FIG. 4 is a diagram showing a state in which work support information W1 and W2 are displayed in the vicinity of each refined portion P1 and P2 on the steel plate surface 101 .

FIG. 5 is a diagram showing a state where an arrow AR indicating another refined location where the refining operation should be performed next is displayed when it is determined that the finishing operation has been completed on the steel plate surface 101 .

FIG. 6 is a diagram showing a state where an all-work completion message M is displayed at a predetermined position on the steel plate surface 101 when it is determined that all finishing operations on the steel plate surface 101 are completed.

FIG. 7 is a diagram showing a configuration in which a trimming device 14 capable of automatic finishing work is provided in the finishing work support device 1 .

detailed description

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

FIG. 1 is a schematic configuration diagram of a finishing work support device 1 according to this embodiment. The finishing operation support device 1 is used to support the operator in finishing the steel plate 100 (defect removal operation, painting and printing operation, etc.), and has an imaging device 11 , a laser drawing device 12 , and a control device 13 .

In addition, the steel plate 100 is a steel plate that is transferred to a finishing process after passing through a rolling process, a cutting process, and a surface inspection process in an ironworks. That is, the steel plate 100 is shaped so that the dimensions of thickness, length, and width conform to customer specifications in the rolling process and the cutting process, and has been inspected for surface flaws (position, type, depth, etc. of surface flaws) in the surface inspection process. comfirmed. Such a steel plate 100 is placed on a table where an operator performs finishing work in the finishing work process.

The image pickup device 11 and the laser drawing device 12 of the finishing work support device 1 are installed above the workbench. The imaging device 11 is, for example, a CCD camera, etc., images the surface of the steel plate 100 (the steel plate surface 101 ), and outputs captured image data representing the captured image to the control device 13 . In addition, when the overall image of the steel plate surface 101 cannot be captured by one imaging device 11, a plurality of imaging devices 11 may be installed.

The laser drawing device 12 irradiates the steel plate surface 101 with laser light L and displays an image under the control of the control device 13 . For example, as shown in Figure 1, if it is assumed that the specified angle of the steel plate 100 is the coordinate origin O, the long side of the steel plate 100 is the X-axis, and the short side of the steel plate 100 is the XY coordinate system of the Y-axis, then the laser drawing device 12. While scanning the laser light L two-dimensionally in the aforementioned XY coordinate system, the intensity of the laser light L is changed to display a two-dimensional image on the steel plate surface 101 .

In addition, it is necessary to use a laser drawing device 12 capable of scanning at least the entire surface of the steel plate surface 101, but when the entire surface of the steel plate surface 101 cannot be scanned by one laser drawing device 12, multiple laser drawing devices 12 may be installed. Furthermore, the display device for displaying an image on the steel plate surface 101 is not limited to the laser drawing device 12 described above, and a projection type display device (so-called projector) using a light emitting diode or a halogen lamp as a light source may also be used.

The control device 13 is based on the refinement-related information related to the refinement operation of the steel plate 100 acquired from the information management device (commercial computer 2, database server 4) described later, and the captured image data (that is, the surface of the steel plate) input from the imaging device 11 . 101) to control the laser drawing device 12 to display the information required for the finishing operation at the refined location in the above-mentioned refined related information on the refined location on the steel plate surface 101 or its surroundings as operation support information .

In addition, the above-mentioned work support information may be displayed anywhere on the refined portion on the steel plate surface 101 or its surroundings, but the case where the work support information is displayed around the refined portion will be exemplified below.

Here, the refining-related information of the steel plate 100 includes surface inspection data of the steel plate 100 (table data corresponding to XY coordinates of surface flaws existing on the steel plate 100, and flaw codes indicating types of surface flaws), refining processes required for the flaw removal work, etc. Standards and refining methods, the number of the marking template used in the painting and printing operation (for example, the marking operation), or the XY coordinates of the printing part, etc.

For details, see the subsequent part. For example, the control device 13 controls the laser drawing device 12 to display the defect code, the standard of refinement, and the refinement method in the above-mentioned refinement-related information as operation support information around the refinement site where the flaw removal operation is performed as a refinement operation. . Furthermore, for example, the control device 13 controls the laser drawing device 12 to display the number of the marking template in the above-mentioned finishing related information as the work support information around the finishing site where the labeling operation is performed as the finishing operation. In addition, the control device 13 controls the laser drawing device 12 so as to display a work end mark writing area and an additional process code writing area together with the work support information at each refined location.

As shown in FIG. 2 , the refining operation support device 1 having the above-mentioned configuration is connected to a production management system 600 of an ironworks. The production management system 600 of an iron-making plant is composed of, for example, a hierarchical system with a three-tier structure, that is, it consists of a commercial computer 2 at the upper level, a process computer 3 and a database server 4 at the middle level, and process equipment 5 and field equipment 6 at the lower level. .

The commercial computer 2 is the highest computer that overall manages the production plan of the steel plate 100 in the ironworks, and is communicably connected to the process computer 3 via the upper network HN. In the above-mentioned commercial computer 2, in addition to the customer specifications of the steel plate 100 (the specifications of the thickness, length, and width of the steel plate 100 requested by the customer, and various specifications such as flatness), the flaw removal work in the above-mentioned refining-related information is registered in advance. Various information such as the required refining standard and refining method, the number of the marking template used in the marking operation, or the XY coordinates of the printing part.

The process computer 3 is communicably connected to the business computer 2 via the upper network HN, and is communicably connected to the database server 4, the process equipment 5, and the field device 6 via the lower network LN. The above-mentioned process computer 3 is the process equipment 5 that controls each process according to the process data received from the field equipment 6 (measurement data such as temperature or table speed, flow rate, pressure, etc.), the production plan received from the commercial computer 2, and customer specifications, or A computer that displays manufacturing instructions based on the above-mentioned production plan and customer specifications or the above-mentioned process data to operators of each process.

The database server 4 is a computer that databases and manages various data such as process data received from the field device 6 via the lower network LN and surface inspection data of the steel plate 100 obtained from the surface inspection process. In addition, a production number is assigned to each steel plate 100 , and the above-mentioned surface inspection data is formed into a database in association with the production number of each steel plate 100 .

The process equipment 5 includes, for example, conveying equipment such as a belt conveyor in addition to production equipment for each process such as a calender and a cutter. In addition, it is a lower control device such as a PLC (Programmable Logic Controller: Programmable Logic Controller) installed in the process equipment 5 that actually operates the process equipment 5 under the control of the process computer 3 .

Field devices 6 are measuring devices such as thermometers, tachometers, flow meters, pressure gauges, and valve position controllers installed in process equipment 5 .

The control device 13 of the refined production support device 1 is connected to the lower network LN of the above-mentioned production management system 600, acquires the surface inspection data of the steel plate 100 from the database server 4, and acquires the defect removal operation of the steel plate 100 from the commercial computer 2 via the process computer 3. Various information such as the required refining standard and refining method, the number of the printing template, or the XY coordinates of the printing part.

In this way, the production management system 600 of the ironworks can be connected to the refinery operation support device 1, and the commercial computer 2 and the database server 4 can be used as an information management device that provides refinement-related information to the refinement operation support device 1 to construct The refinement operation support system 500 of the present invention.

In addition, in the refining operation support system 500 shown in FIG. 2 , the refining-related information of the steel plate 100 is separately registered in the business computer 2 and the database server 4, so a part of the refining-related information is sent from the business computer 2 to the refining work support device 1. In the case of a process computer 3 is required.

That is, in the refining operation support system 500 shown in FIG. 2, although the process computer 3 is an essential structural element, it is also possible to use a single computer (information management device) to collectively manage the refining-related information, and make the computer compatible with the refining process. Since the work support device 1 communicates directly, it is also possible to construct a sophisticated work support system that does not require the process computer 3 .

Next, the operation of the finishing work support device 1 will be described.

3A and 3B are flow charts of operations of the finishing work support device 1 . First, as shown in FIG. 3A , if the control device 13 detects that the steel plate 100 is placed on the workbench of the finishing process, it reads the image data (that is, the captured image of the steel plate surface 101 ) based on the captured image data input from the imaging device 11 . The manufacturing number of the steel plate 100 printed on a predetermined position on the surface 101 of the steel plate is obtained (step S1 ).

Next, the control apparatus 13 acquires the surface inspection data corresponding to the manufacturing number of the steel plate 100 from the database server 4, and stores it in an internal memory (step S2). Furthermore, the control device 13 acquires from the business computer 2 via the process computer 3 various information such as the refining standard and refining method required for the flaw removal work of the steel plate 100, the number of the marking template used in the marking work, and the XY coordinates of the printing position. , and stored in the internal memory (step S3). Thus, all refined related information is stored in the internal memory of the control device 13 .

Next, the control device 13 controls the laser drawing device 12 based on the refining-related information stored in the internal memory and the captured image data input from the imaging device 11, so that the above-mentioned refining-related information is displayed around the refined part on the steel plate surface 101. The information necessary for the refinement work at the refinement site is used as work support information (step S4).

Specifically, in the above-mentioned step S4, the control device 13 first recognizes the specified corner of the steel plate 100 as the coordinate origin O through image processing based on the captured image data, and compares the long sides of the steel plate 100 extending from the above-mentioned coordinate origin O and The short sides are identified as X-axis and Y-axis respectively (refer to Figure 1). Then, the control device 13 grasps the position of each refined part on the steel plate surface 101 based on the XY coordinate system recognized as described above, the XY coordinates of the surface defect and the XY coordinates of the printed part stored in the internal memory.

Then, as shown in FIG. 4, the control device 13 controls the laser drawing device 12 to display and store internally on the surface of the steel plate 101, for example, the area around the refined part (that is, the position of the surface flaw) P1 where the flaw removal operation is performed as a finishing operation. The defect code, the refining standard, and the refining method in the refining-related information of the memory are used as the work support information W1.

Here, as shown in FIG. 4 , characters such as "401", "5L8Y6", and "02015" are arranged as the work support information W1, for example. "401" is a defect code indicating the type of surface defect. "5" in "5L8Y6" indicates the appearance standard, "L" indicates the trimming method, "8" indicates the grain size, "Y" indicates whether welding is trimmed, and "6" indicates the welding condition. "02015" indicates the lower limit plate thickness.

That is, by displaying such work support information W1 around the refined part P1, the operator performing the refined work can easily recognize the following information necessary for the refined work (defect removal work) in addition to the state of surface flaws : Use No. 5 appearance standard as the refining standard; use the method of grinding surface flaws in the rolling direction (L direction) with a roughness of No. 8 grain size (grinding piece) as the refining method; however, in order to maintain the lower limit plate thickness, Welding repair (or dressing welding) can also be performed according to No. 6 welding conditions.

And, similarly, as shown in FIG. 4, the control device 13 controls the laser drawing device 12, so that on the steel plate surface 101, for example, as a finishing operation, the finishing position (that is, the printing position based on the marking operation) P2 of the marking operation is carried out. The number (for example, "NO.3") of the spraying template is displayed around as the work support information W2. That is, such work support information W2 is displayed around the refined part P2, so that the operator who performs the finishing operation can easily recognize the finishing work (labeling operation) required for the finishing operation (labeling operation) using the No. 3 labeling template. information.

In addition, FIG. 4 exemplifies the case where the work support information W1, W2 is displayed on the right side of the refining parts P1, P2. Work support information W1, W2 is displayed at any position of P2, up, down, left, or right. In addition, the distance between the refined parts P1, P2 and the work support information W1, W2 is not particularly limited, but from the viewpoint of allowing the operator to recognize the positions of the refined parts P1, P2 by displaying the work support information W1, W2, It is preferable to display the work support information W1, W2 as close as possible to the refined parts P1, P2.

Furthermore, as shown in FIG. 4 , the control device 13 controls the laser drawing device 12 to display the work end mark writing area B1 and the additional process on each of the refined parts P1 and P2 of the steel plate surface 101 together with the above-mentioned work support information W1 and W2. The code is entered into area B2. The work end mark entry area B1 is an area where a worker writes a work end mark (for example, a V mark) when the finishing work at the refining locations P1 and P2 is completed. The additional process code input area B2 is an area where an additional process code (for example, a 3-digit number) indicating an additional process performed by the additional work is entered when additional work is required when the finishing work at the refined locations P1 and P2 is completed.

Through the processing of the above step S4, the information required for the finishing work at each refined location P1, P2 is displayed around each refined location P1, P2 on the steel plate surface 101 as the operation support information W1, W2, and the operator completes the process on the steel plate. Surface 101 is prepared for finishing operations. Thereby, the operator can easily recognize the positions of the refined parts P1 and P2 on the steel plate surface 101 and the information required for the finishing work at the respective refined parts P1 and P2. As a result, the efficiency of the refining work of the steel plate 100 can be realized. Improve and reduce the burden on the operator.

Next, as shown in FIG. 3A , the control device 13 designates the refinement site where the operator is currently performing the refinement operation (hereinafter referred to as the current refinement site) based on the captured image data input from the imaging device 11, and recognizes the refinement site at the current refinement site. As for the operator's action, it is determined whether or not the operator has performed the specified action (step S5 ). In addition, as a technique for recognizing a movement of a person by image processing based on captured image data, known techniques such as the technique described in Japanese Patent Application Laid-Open No. 2009-176059 can be used, for example.

In the case of "NO" in the above-mentioned step S5, the control device 13 transitions to the processing of the later-described step S7, and in the case of "Yes (Yes)" in the above-mentioned step S5, the control device 13 controls the laser drawing device 12, The display state of the operation support information at the current refining site is changed based on the recognized operator's actions (step S6 ).

Specifically, in the above-mentioned step S6, the control device 13 controls the laser drawing device 12 to, for example, switch between display and non-display of the operation support information, change the display position of the operation support information, At least one of a change in the display size of , and additional display of supplementary information related to the work support information.

As described above, for example, switching between display and non-display of the work support information or changing the display position of the work support information in accordance with the operator's actions can prevent the display of the work support information from obstructing the finishing work. In addition, by changing, for example, the display size of the work support information in accordance with the operator's actions, the operator can easily visually confirm the work support information. Furthermore, by additionally displaying, for example, supplementary information related to the work support information in accordance with the actions of the operator, it is possible for the worker to easily understand the work support information.

In this way, by providing the control device 13 with the function of recognizing the movement of the operator performing the fine work, and controlling the laser drawing device 12 so that the display state of the work support information changes according to the movement of the operator, the operator can consciously By changing the display status of work support information, the efficiency of refinement work can be further improved.

In addition, if the action of the operator recognized by the control device 13 in the case of "Yes" in the above-mentioned step S5 is related to the operation of the peripheral equipment, then it is also possible to separately set a function to control the peripheral equipment according to the operator's action. step. Here, the peripheral devices refer to devices other than the finishing work support device 1 installed in the finishing work process. For example, when the peripheral equipment is a lighting device for illuminating the steel plate surface 101 , the control device 13 controls the brightness of the lighting device based on the recognized movement of the worker.

Thus, when the operator confirms the content of the operation support information of the current refined part, the brightness of the lighting device can be dimmed to improve the visibility of the operation support information. Brighten the brightness of the lighting device to improve workability. In this way, by providing the control device 13 with the function of recognizing the movement of the operator performing fine work and controlling the peripheral equipment according to the movement of the operator, the operator can remotely operate the peripheral equipment while performing work on the steel plate 100, thus The efficiency of refining operations can be further improved.

Next, the control device 13 judges whether or not a work-end mark (for example, a V letter) is written in the work-end mark writing area displayed together with the work support information around the current refined part based on the captured image data input from the imaging device 11. mark) (step S7). Such a work end mark is written by the operator using chalk or the like, for example, at the time when the refining work at the current refining location is completed.

In the case of "NO" in the above-mentioned step S7, the control device 13 returns to the processing of the above-mentioned step S5, and monitors the actions of the operator, and in the case of "Yes" in the above-mentioned step S7, it is determined that the current The refining operation at the refining location ends (step S8).

In addition, it is not necessary to display the area where the work-end mark is written on the steel plate surface 101, and the control device 13 may be provided with a function of determining that the current refining position is refined as long as the work-end mark is recorded around the current refining position. Function to end a job.

Next, as shown in FIG. 3B , the control device 13 judges whether or not an additional process is recorded in the additional process code entry area displayed with the work support information around the current refined part based on the captured image data input from the imaging device 11. code (step S9). This additional process code is written by the operator using chalk, for example, in order to register the additional process performed by the additional work in the database server 4 when an additional operation is required when the refining operation at the current refining location is completed. of.

In the case of "NO" in the above-mentioned step S9, the control device 13 transitions to the processing of the later-described step S11, and in the case of "Yes (Yes)" in the above-mentioned step S9, the control device 13 reads the The additional process code in the process code entry area is added and sent to the database server 4 (step S10 ). In this way, when the operator needs to add work at the current refining site, the additional process code can be collected (registered) in the database server only by entering the additional process code in the additional process code entry area of the current refining site. 4 and can be browsed, so it is possible to easily confirm the additional process newly added after the completion of the finishing process.

In addition, it is not necessary to display the additional process code entry area on the steel plate surface 101, and the control device 13 may also have the function of reading the above additional process code and writing it to the database as long as the additional process code is recorded around the current refining part. Function sent by server 4.

Next, the control device 13 judges whether or not the finishing work of all the finishing parts is completed, in other words, whether or not the work completion mark is written in the all work completion mark writing area (step S11 ). In the case of "NO" in the above step S11, for example, as shown in FIG. The position adjacent to the refining position) displays an arrow AR indicating another refining position where the refining operation should be performed next (step S12 ). In addition, the display position of the arrow AR may be any position as long as the position is easily recognized by the operator.

As a result, the operator can easily find other refined positions on the steel plate surface 101 that should be refined next after the finishing operation at the current refined position is completed, thereby further improving the efficiency of the refined process (especially when the size of the steel plate 100 is large) valid below). In addition, the control device 13 returns to the processing of the above-mentioned step S5 after the above-mentioned step S12 is completed, and monitors the operation of the operator at the next refining site.

On the other hand, in the case of “Yes” in the above step S11, that is, in the case where it is determined that the refining work of all refined parts is completed, for example, as shown in FIG. 6 , the control device 13 controls the laser drawing device 12, All job end messages M are displayed at a predetermined position (for example, a central position) on the steel plate surface 101 (step S13 ). Thus, the operator can easily recognize the completion of the finishing work at all the finishing locations on the steel plate surface 101, and thus the finishing work efficiency can be further improved. In addition, the display positions of all the job end messages M may be any positions as long as they are easily recognized by the operator.

As described above, according to the present embodiment, the operator can easily recognize the position of the refined part on the steel plate surface 101 and the information (operation support information) required for the finishing work at the refined part, and as a result, the safety of the steel plate 100 can be improved. Improve operational efficiency and reduce the burden on operators.

In addition, this invention is not limited to the said embodiment, The following modification example is mentioned.

(1) For example, the control device 13 may have a function of inspecting the refined part judged to be finished with the finishing operation based on the captured image data input from the imaging device 11, and sending the inspection result to the database server 4 to enable to browse.

In order to realize the above-mentioned function, in the flow chart shown in Fig. 3A and Fig. 3B, for example, after step S8 and step S9, the following steps are set: the control device 13 is based on the captured image data input from the camera device 11. Check the current refining site judged to be the end of the refining operation; the control device 13 sends the inspection result of the current refining site to the database server 4 .

Specifically, the control device 13 determines whether the surface flaws have been removed to an extent that satisfies the appearance criteria by image processing based on captured image data, for example, when inspecting a refined part that has undergone a flaw removal operation. And, the control device 13, for example, under the situation of inspecting the refined parts of the labeling operation, judges whether the printed characters after the labeling operation are correct through image processing based on the captured image data (the labeling template used in the labeling operation is it right or not).

This enables automatic inspection of the refined portion on the steel plate surface 101 where the finishing process has been completed, and the inspection results can be browsed in the database server 4, so that the quality inspection of the steel plate 100 after the finishing process becomes easy.

(2) For example, the control device 13 may have a function of measuring the size of the steel plate 100 based on the captured image data input from the imaging device 11 and judging whether the measured value of the size satisfies a predetermined specification (customer specification) , and the judgment result and the measured value of the size are sent to the database server 4 for browsing.

In order to realize the above-mentioned function, in the flowchart of FIG. 3B, for example, after step S13, the following steps are set: the control device 13 measures the size (length and width) of the steel plate 100 according to the captured image data; 13 Determine whether the measured size value satisfies the customer specification; the control device 13 sends the determination result of whether the measured size value satisfies the customer specification and the measured value of the size to the database server 4 .

Thereby, it is possible to automatically determine whether the size of the steel plate 100 satisfies the customer's specification, and the result of the determination and the measured value of the size can be browsed in the database server 4, so that the dimensional inspection of the steel plate 100 after finishing the finishing process becomes easy. .

(3) For example, the control device 13 may have a function of recognizing, based on the captured image data input from the imaging device 11 , that the operator who performed the finishing work specified the location of additional finishing (especially, the position of surface flaws). In the case of operation, the laser drawing device 12 is controlled to display the defect code recording area on the additional refined part or its surroundings on the steel plate surface 101 together with the operation support information including only the refining standard and the refining method; The defect code recorded in the defect code entry area is fetched, and the read defect code and position information (XY coordinates) of the additional refined part are sent to the database server 4 for viewing.

In order to realize these functions, in the flow chart of FIG. 3A, for example, after step S4, the following steps can be set: the control device 13 recognizes that the operator who performs the refinement operation specifies the additional refinement site according to the captured image data. Action: the control device 13 controls the laser drawing device 12 to display the defect code entry area on the steel plate surface 101 at the additional refined part or its surroundings together with the operation support information including only the refining standard and the refining method; data to read the flaw code recorded in the flaw code recording area; the control device 13 sends the read flaw code and the XY coordinates of the additional refined part to the database server 4 .

Thus, when an operator finds a new surface defect on the steel plate surface 101, the operator can display the operation support information at the position of the surface defect (additional refined part), and write the defect code into the defect code entry area, In this way, the state of the defect of the additionally refined portion can also be input to the control device 13 . In addition, since the XY coordinates and defect codes of the newly added additional refined parts are registered in the database server 4 and can be browsed, the operator can easily confirm the position of the surface defect or the surface defect newly found in the steel plate 100 after the finishing process is completed. flawed state.

(4) In the above-mentioned embodiment, the case where the operator performs the finishing work on the steel plate surface 101 based on the work support information drawn by the laser drawing device 12 is exemplified, but the following structure can be adopted to automatically perform the finishing work: The trimming device 14 freely moves in the in-plane direction (the direction in the XY plane) and the out-of-plane direction (the Z-axis direction perpendicular to the XY plane) of the steel plate surface 101, and uses the imaging device 11 to photograph the work drawn by the laser drawing device 12 Support information, and the control device 13 controls the trimming device 14 based on the captured image data.

For example, as shown in FIG. 7 , the trimming device 14 is composed of a portal frame 20 , a trolley 21 , a pillar 22 , a turret mechanism 23 , a flaw grinding mechanism 24 , and a painting and printing mechanism 25 . Specifically, a gantry frame 20 freely movable along the X-axis direction is provided straddling the steel plate 100, and a trolley 21 movable along the Y-axis direction is driven on the upper side of the gantry frame 20, This allows the trolley 21 to move to any position on the steel plate surface 101 . In the trolley 21, the pillar 22 passes through the groove on the upper side of the trolley 21 and the door frame 20, and is set in a free-rising manner. The lower end of the pillar 22 is equipped with a flaw grinding mechanism 24 and a spraying mechanism 23 via a turret mechanism 23. Formula coating printing mechanism 25. That is, the support column 22 is used to move (raise and lower) the turret mechanism 23 in the Z-axis direction.

In this structure, in the state where the work support information is drawn on the steel plate surface 101 by the laser drawing device 12, the steel plate surface 101 is photographed by the imaging device 11, and the control device 13 makes the flaw grinding process based on the work support information displayed on the captured image. The chipping mechanism 24 moves in the XYZ directions, whereby the blemish removal operation can be automatically performed.

When operations other than the blemish grinding mechanism 24 are required due to special surface blemishes, etc., the turret mechanism 23 can be used to rotate the coating and printing mechanism 25 to the position of the surface blemish (refined part) to display the product number Or the labeling operation of the delivery destination, etc.

In addition, in FIG. 7 , the case where the trimming device 14 has a flaw grinding mechanism 24 and a coating and printing mechanism 25 is illustrated, but it may have at least one of a flaw grinding mechanism, a flaw melting mechanism, a painting and printing mechanism, and One. Here, the blemish grinding mechanism refers to a mechanism that mechanically grinds and removes surface blemishes using a grinder or the like (for example, a grindstone or a belt grinder). Flaw melting mechanism refers to a mechanism for removing surface flaws by arc gouging or gouging.

By adopting the structure utilizing the trimming device 14 as described above, in principle, the operator does not need to perform operations on the steel plate 100, greatly reducing the operator's workload, thereby greatly improving the operating efficiency, and ensuring the operator's safety. Consideration has a big effect, too.

Industrial availability

According to the present invention, it is possible to improve the efficiency of the finishing operation of steel plates and to reduce the burden on workers, and thus a large industrial effect can be expected by implementing the present invention.

Explanation of reference signs

1: Refined operation support device

2: Commercial computer (information management device)

3: Craft Computer

4: Database server (information management device)

5: Process equipment

6: On-site equipment

11: camera device

12: Laser drawing device (display device)

13: Control device

14: Trimming device

100: steel plate

101: steel plate surface

500: Refined Operation Support System

600: Production Management System

Claims (36)

1. A refining operation support device for supporting the refining operation of steel plates, characterized in that it has: A camera device for photographing the steel plate surface of the above-mentioned steel plate; a display device for displaying an image on the surface of the steel sheet; and The control device controls the display device so that the refined portion on the surface of the steel plate or its surroundings is displayed on the basis of the refinement-related information related to the refinement operation of the steel sheet acquired from the information management device and the image captured by the imaging device. displaying, among the above-mentioned refining-related information, information necessary for carrying out the refining operation at the above-mentioned refining site as operation support information, The above-mentioned operation support information displayed on or around the above-mentioned finishing site where the above-mentioned blemish removal operation is performed as the above-mentioned blemish removal operation includes the elaboration standard and the elaboration method required for the above-mentioned blemish removal work, The control device recognizes the movement of the worker performing the fine work from the captured image, and controls the display device so that the display state of the work support information changes according to the movement of the worker, The control device controls the display device to change the display position of the work support information, change the display size of the work support information, and additionally display supplementary information related to the work support information in accordance with the actions of the operator. at least one of the 2. A refining operation support device for supporting the refining operation of steel plates, characterized in that it has: A camera device for photographing the steel plate surface of the above-mentioned steel plate; a display device for displaying an image on the surface of the steel sheet; and The control device controls the display device so that the refined portion on the surface of the steel plate or its surroundings is displayed on the basis of the refinement-related information related to the refinement operation of the steel sheet acquired from the information management device and the image captured by the imaging device. displaying, among the above-mentioned refining-related information, information necessary for carrying out the refining operation at the above-mentioned refining site as operation support information, The above-mentioned operation support information displayed on or around the above-mentioned finishing site where the above-mentioned blemish removal operation is performed as the above-mentioned blemish removal operation includes the elaboration standard and the elaboration method required for the above-mentioned blemish removal work, The control device recognizes the movement of the worker performing the fine work from the captured image, and controls the display device so that the display state of the work support information changes according to the movement of the worker, The control device recognizes the movement of the operator performing the finishing work based on the captured image, and controls the peripheral device based on the recognized movement of the worker. 3. A refining operation support device for supporting the refining operation of steel plates, characterized in that it has: A camera device for photographing the steel plate surface of the above-mentioned steel plate; a display device for displaying an image on the surface of the steel sheet; and The control device controls the display device so that the refined portion on the surface of the steel plate or its surroundings is displayed on the basis of the refinement-related information related to the refinement operation of the steel sheet acquired from the information management device and the image captured by the imaging device. displaying, among the above-mentioned refining-related information, information necessary for carrying out the refining operation at the above-mentioned refining site as operation support information, The above-mentioned operation support information displayed on or around the above-mentioned finishing site where the above-mentioned blemish removal operation is performed as the above-mentioned blemish removal operation includes the elaboration standard and the elaboration method required for the above-mentioned blemish removal work, The control device recognizes the movement of the worker performing the fine work from the captured image, and controls the display device so that the display state of the work support information changes according to the movement of the worker, The control device determines that the refinement work of the refinement site is performed when the control device recognizes that a work end mark is written in the vicinity of the refinement site or in a work completion mark recording area displayed together with the work support information based on the captured image. Finish. 4. A refining operation support device for supporting the refining operation of steel plates, characterized in that it has: A camera device for photographing the steel plate surface of the above-mentioned steel plate; a display device for displaying an image on the surface of the steel sheet; and The control device controls the display device so that the refined portion on the surface of the steel plate or its surroundings is displayed on the basis of the refinement-related information related to the refinement operation of the steel sheet acquired from the information management device and the image captured by the imaging device. displaying, among the above-mentioned refining-related information, information necessary for carrying out the refining operation at the above-mentioned refining site as operation support information, The above-mentioned operation support information displayed on or around the above-mentioned finishing site where the above-mentioned blemish removal operation is performed as the above-mentioned blemish removal operation includes the elaboration standard and the elaboration method required for the above-mentioned blemish removal work, The control device recognizes the movement of the worker performing the fine work from the captured image, and controls the display device so that the display state of the work support information changes according to the movement of the worker, The control device reads the additional process code written in the area around the refined part or in the additional process code entry area displayed together with the operation support information based on the captured image, and transmits the read additional process code. to the above information management device. 5. A refining operation support device for supporting the refining operation of steel plates, characterized in that it has: A camera device for photographing the steel plate surface of the above-mentioned steel plate; a display device for displaying an image on the surface of the steel sheet; and The control device controls the display device so that the refined portion on the surface of the steel plate or its surroundings is displayed on the basis of the refinement-related information related to the refinement operation of the steel sheet acquired from the information management device and the image captured by the imaging device. displaying, among the above-mentioned refining-related information, information necessary for carrying out the refining operation at the above-mentioned refining site as operation support information, The above-mentioned operation support information displayed on or around the above-mentioned finishing site where the above-mentioned blemish removal operation is performed as the above-mentioned blemish removal operation includes the elaboration standard and the elaboration method required for the above-mentioned blemish removal work, The control device recognizes the movement of the worker performing the fine work from the captured image, and controls the display device so that the display state of the work support information changes according to the movement of the worker, The control device controls the display device so that, on the surface of the steel sheet, the additional refined location or Around it, a defect code entry area is displayed together with the above-mentioned operation support information. 6. The finishing work support device according to any one of claims 2 to 5, wherein: The control device controls the display device to switch between display and non-display of the work support information, change a display position of the work support information, change a display size of the work support information, and At least one of additional display of supplementary information related to the above-mentioned work support information. 7. The refining work support device according to any one of claims 1, 3 to 5, characterized in that: The control device recognizes the movement of the operator performing the finishing work based on the captured image, and controls the peripheral device based on the recognized movement of the worker. 8. The refining work support device according to claim 2, wherein: The above-mentioned peripheral device is an illuminating device for illuminating the surface of the above-mentioned steel plate, The control device controls the brightness of the lighting device according to the operator's actions. 9. The refining operation support device according to any one of claims 1, 2, 4, and 5, wherein: The control device determines that the refinement work of the refinement site is performed when the control device recognizes that a work end mark is written in the vicinity of the refinement site or in a work completion mark recording area displayed together with the work support information based on the captured image. Finish. 10. The refining work support device according to claim 9, wherein: The control device controls the display device to display an arrow indicating another refined location where the finishing operation should be performed next at a predetermined position on the surface of the steel sheet when it is determined that the finishing operation is completed. 11. The refining work support device according to claim 9, wherein: When the control device determines that the finishing operation is completed, it inspects the finishing site where the finishing operation has been completed based on the captured image, and transmits the inspection result to the information management device. 12. The refining operation support device according to claim 9, wherein: The control device may control the display device to display a message of completion of all operations at a predetermined position on the surface of the steel sheet, when it is determined that the refining operations have been completed for all the refining locations. 13. The refining operation support device according to any one of claims 1 to 3, 5, characterized in that: The control device reads the additional process code written in the area around the refined part or in the additional process code entry area displayed together with the operation support information based on the captured image, and transmits the read additional process code. to the above information management device. 14. The refining work support device according to any one of claims 1 to 5, wherein: The control device measures the size of the steel plate based on the captured image, determines whether the measured value of the size satisfies a predetermined specification, and transmits the result of the determination and the measured value of the size to the information management device. 15. The refining work support device according to any one of claims 1 to 4, wherein: The control device controls the display device so that, on the surface of the steel sheet, the additional refined location or Around it, a defect code entry area is displayed together with the above-mentioned operation support information. 16. The refining operation support device according to claim 15, wherein: The control device reads the defect code written in the defect code recording area based on the captured image, and transmits the read defect code and position information of the additional refined part to the information management device. 17. The refining work support device according to any one of claims 1 to 5, wherein: The display device is a laser drawing device that displays an image by irradiating laser light on the surface of the steel sheet. 18. The refining work support device according to any one of claims 1 to 5, wherein: It also has a trimming device provided to be movable in the in-plane direction and the out-of-plane direction of the surface of the steel plate, and used for the above-mentioned finishing work. 19. The refining work support device according to claim 18, wherein: The above-mentioned trimming device has at least one of a blemish grinding mechanism, a blemish melting mechanism, a painting and printing mechanism, and an embossing mechanism. 20. A refining operation support method for supporting the refining operation of a steel plate, characterized by comprising: A process of obtaining refining-related information related to the refining operation of the above-mentioned steel plate; A step of obtaining a captured image of the steel plate surface of the steel plate; A step of displaying, as work support information, information necessary for carrying out finishing work at the refined location in the refining-related information, based on the refining-related information and the captured image; A process of recognizing the actions of workers performing the fine work from the captured image; and A step of changing the display state of the operation support information according to the operation of the operator, The above-mentioned operation support information displayed on or around the above-mentioned finishing site where the above-mentioned blemish removal operation is performed as the above-mentioned blemish removal operation includes the elaboration standard and the elaboration method required for the above-mentioned blemish removal work, In the step of changing the display state of the work support information, the display position of the work support information is changed, the display size of the work support information is changed, and the information related to the work support information is changed according to the operation of the operator. At least one of the additional displays of supplementary information. 21. A refining operation support method for supporting the refining operation of a steel plate, characterized by comprising: A process of obtaining refining-related information related to the refining operation of the above-mentioned steel plate; A step of obtaining a captured image of the steel plate surface of the steel plate; A step of displaying, as work support information, information necessary for carrying out finishing work at the refined location in the refining-related information, based on the refining-related information and the captured image; A process of recognizing the actions of workers performing the fine work from the captured image; and A step of changing the display state of the operation support information according to the operation of the operator, The above-mentioned operation support information displayed on or around the above-mentioned finishing site where the above-mentioned blemish removal operation is performed as the above-mentioned blemish removal operation includes the elaboration standard and the elaboration method required for the above-mentioned blemish removal work, also has: A process of recognizing the actions of workers performing the above-mentioned fine work from the above-mentioned captured image; and The processes of the peripheral devices are controlled based on the recognized actions of the worker. 22. A refining operation support method for supporting the refining operation of steel plates, characterized by comprising: A process of obtaining refining-related information related to the refining operation of the above-mentioned steel plate; A step of obtaining a captured image of the steel plate surface of the steel plate; A step of displaying, as work support information, information necessary for carrying out finishing work at the refined location in the refining-related information, based on the refining-related information and the captured image; A process of recognizing the actions of workers performing the fine work from the captured image; and A step of changing the display state of the operation support information according to the operation of the operator, The above-mentioned work support information displayed on or around the above-mentioned refined part where the above-mentioned flaw removal work is performed as the above-mentioned finishing work includes refining standards and refining methods necessary for the above-mentioned flaw removal work, also has: A process of recognizing a work-end mark written around the refined part or in a work-end mark writing area displayed together with the work support information based on the captured image; and When the above-mentioned work end mark is recognized, it is determined that the process of finishing the finishing work of the above-mentioned refined part is determined. 23. A refining operation support method for supporting the refining operation of steel plates, characterized by comprising: A process of obtaining refining-related information related to the refining operation of the above-mentioned steel plate; A step of obtaining a captured image of the steel plate surface of the steel plate; A step of displaying, as work support information, information necessary for carrying out finishing work at the refined location in the refining-related information, based on the refining-related information and the captured image; A process of recognizing the actions of workers performing the fine work from the captured image; and A step of changing the display state of the operation support information according to the operation of the operator, The above-mentioned work support information displayed on or around the above-mentioned refined part where the above-mentioned flaw removal work is performed as the above-mentioned finishing work includes refining standards and refining methods necessary for the above-mentioned flaw removal work, also has: A process of reading the additional process code written in the area around the refined part or in the additional process code entry area displayed together with the operation support information based on the captured image; and The read additional process code is set as a browseable process. 24. A refining operation support method for supporting the refining operation of steel plates, characterized by comprising: A process of obtaining refining-related information related to the refining operation of the above-mentioned steel plate; A step of obtaining a captured image of the steel plate surface of the steel plate; A step of displaying, as work support information, information necessary for carrying out finishing work at the refined location in the refining-related information, based on the refining-related information and the captured image; A process of recognizing the actions of workers performing the fine work from the captured image; and A step of changing the display state of the operation support information according to the operation of the operator, The above-mentioned work support information displayed on or around the above-mentioned refined part where the above-mentioned flaw removal work is performed as the above-mentioned finishing work includes refining standards and refining methods necessary for the above-mentioned flaw removal work, also has: Based on the above-mentioned captured image, it is recognized that the operator performing the above-mentioned finishing work has performed an operation for specifying an additional finishing part; and A step of displaying a defect code written area around the additionally refined portion on the surface of the steel sheet together with the work support information. 25. The refining work support method according to any one of claims 21 to 24, wherein: In the step of changing the display state of the work support information, switching between display and non-display of the work support information, change of the display position of the work support information, and switching of the work support information is performed according to an action of the operator. At least one of a change in display size and additional display of supplementary information related to the above-mentioned work support information. 26. The refining operation support method according to any one of claims 20, 22 to 24, further comprising: A process of recognizing the actions of workers performing the above-mentioned fine work from the above-mentioned captured image; and The processes of the peripheral devices are controlled based on the recognized actions of the worker. 27. The refining operation support method according to claim 26, wherein: In the step of controlling the peripheral device, the brightness of the lighting device that illuminates the surface of the steel plate is controlled in accordance with the movement of the worker. 28. The refinement operation support method according to any one of claims 20, 21, 23, and 24, further comprising: A process of recognizing a work-end mark written around the refined part or in a work-end mark writing area displayed together with the work support information based on the captured image; and When the above-mentioned work end mark is recognized, it is determined that the process of finishing the finishing work of the above-mentioned refined part is determined. 29. The refining operation support method according to claim 28, further comprising: When it is judged that the refining operation is completed, an arrow indicating another refined location where the refining operation should be performed next is displayed at a predetermined position on the surface of the steel sheet. 30. The refinement operation support method according to claim 28, further comprising: When it is judged that the above-mentioned refining operation is completed, a process of inspecting the refined part where the above-mentioned refining operation is completed based on the above-mentioned captured image; and Make the inspection result of the above-mentioned refined part a process that can be browsed. 31. The refinement operation support method according to claim 28, further comprising: A process of displaying a message of completion of all operations at a predetermined position on the surface of the steel sheet when it is determined that the finishing work has been completed for all the finishing locations. 32. The refining operation support method according to any one of claims 20 to 22, 24, further comprising: A process of reading the additional process code written in the area around the refined part or in the additional process code entry area displayed together with the operation support information based on the captured image; and The read additional process code is set as a browseable process. 33. The refining work support method according to any one of claims 20 to 24, further comprising: A step of measuring the size of the steel plate based on the captured image; A process of judging whether the measured value of the above-mentioned dimensions satisfies the prescribed specifications; and A step of making the determination result of whether or not the measured value of the size satisfies the specification and the measured value of the size available for browsing. 34. The refining work support method according to any one of claims 20 to 23, further comprising: Based on the above-mentioned captured image, it is recognized that the operator performing the above-mentioned finishing work has performed an operation for specifying an additional finishing part; and A step of displaying a defect code written area around the additionally refined portion on the surface of the steel sheet together with the work support information. 35. The refining operation support method according to claim 34, further comprising: A process of reading the defect code recorded in the defect code recording area based on the above-mentioned photographed image; and A process of making the read defect code and the position information of the additional refined part readable. 36. A refined work support system, comprising: The refining operation support device according to any one of claims 1 to 19 for supporting the refining operation of steel plates; and The information management device provides the refinement-related information related to the refinement operation of the steel plate to the refinement operation support device.