JP3411994B2 - Remote instruction input system - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a remote instruction input system for performing remote instruction input by using light emitted from a pointer, and more particularly to a position indicated by a laser beam emitted from a pointer and an object indicated by the laser light. The present invention relates to a remote instruction input system that creates relationship data with objects.

[0002]

2. Description of the Related Art In recent years, in operation control of a power plant, a chemical plant, etc., information shared by a plurality of operators is provided to a large-sized display device or an information display board using an electric decoration called a mimic board. In order to effectively use these shared information, it is desired to perform an input operation by remotely pointing a display object on a large display device or a mimic board. Further, also at a plant site, it is desired to develop a device that displays detailed information about the device on a mobile terminal or the like by remotely pointing to the field device by using a pointer. As a technique to meet this demand, for example, Japanese Patent Application No. 6-48234 is known. This publication describes an information display device that performs an input operation by remotely pointing a display object displayed on the display surface of the display device. In this device, a display surface of a display device is photographed by a television camera, coordinates of a point designated by a pointer are obtained by performing image processing on the photographed video, and calibration data (coordinate conversion table) created in advance with the coordinates is obtained. It is used to correct the coordinates within the display surface of the display device, and the instructed object is specified based on the corrected coordinates and the data related to the drawing displayed on the display surface of the display device. Specifically, the coordinate value on the display screen indicated by the laser light emitted from the pointer is detected, and based on this information, the coordinate value related to the drawing being displayed and the relational data of the pointing object, that is, the display drawing data, Determine the instructed object. For this determination, this apparatus is provided with means for creating calibration data for correcting the coordinates in the image captured by the image processing apparatus to the coordinates in the display surface of the display device. This is because the display drawing data is created by the coordinates on the display surface, that is, it is necessary to correct the deviation between the coordinates of the display drawing and the coordinates of the image captured by the camera. The calibration data is created by sequentially displaying a calibration marker on the display surface of the display device, detecting the marker by the image processing device to obtain coordinates, and correlating the coordinates on the display surface with the coordinates obtained by the image processing device. It is realized by creating a table.

[0003]

By the way, there is usually no data corresponding to the display drawing data in the mimic board or the field equipment of the plant. Therefore, in order to use the above conventional technique, it is necessary to newly create data. As a method of creating data corresponding to display drawing data for a mimic board or a field device, it is possible to use a design drawing or a CAD system. However, in order to create it using CAD data or the like, a complicated operation is required. Moreover, it is necessary to create the data each time the camera is set, and the amount of work for creating the data becomes enormous. Further, in the device of the above publication, the calibration data could be easily created by displaying the calibration marker on the display surface of the display device. However, the calibration marker is similarly displayed on the mimic board or the field device. It is very difficult to generate the calibration data by using. For example, when the calibration marker is substituted by the laser light emitted from the pointer, the laser light emitted from the pointer needs to be used to indicate the position required for the calibration. When the user performs this calibration position instruction work, the amount of work is determined by the number of calibration positions.
Since the number of calibration positions is proportional to the accuracy of the calibration, the amount of work performed by the user is enormous when performing the calibration with high accuracy. It is also conceivable to create a device for instructing the calibration position. However, the addition of a device is not preferable because the system configuration is currently being reduced for the purpose of using the remote instruction input system at the plant site.

An object of the present invention is to provide a remote instruction input system capable of easily creating data for determining an object pointed by a pointer for remote instruction input for a mimic board or a field device. To do.

[0005]

In order to solve the above problems, a laser beam is emitted from a pointer, and a pointing object pointed by the laser beam of the pointer or a range including the pointing object is photographed by a camera, In the initial setting mode, the image of the designated point designated by the laser light of the pointer photographed by the camera is image-processed by the image processing means, the coordinates of the designated point in the obtained image are obtained, and the plurality of designated points are obtained. The pointing area is set by the pointing area setting means based on the coordinates of the, the character information defining the pointing object in the pointing area is input from the input means, and the character information related to the pointing object and the pointing area of the pointing object are input. Are stored in the storage device in association with each other, and in the execution mode, the coordinates of the pointing point designated by the laser beam of the pointer are detected by the image processing means, and the pointing area determination means determines. When it is determined that there is a designated area including the coordinates of the designated point designated in the execution mode, the character information corresponding to the designated area is obtained from the storage means, and the designated object is obtained using the obtained character information. A display command and / or a control command regarding the are output from the command recognition means.

The present invention does not preliminarily register in the system the image taken by the device of the mimic board or the site, that is, the data necessary for setting the designated area, but the data of the mimic board or the site is not registered. The data for setting the designated area is first obtained when the camera for photographing the device is installed, and the setting work of the designated area can be easily performed when the designated area is set together with the camera installation.

[0007]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 shows a remote instruction input system according to a first embodiment of the present invention. The remote instruction input system according to the present embodiment includes a television camera (for example, an infrared camera) 1, which is a photographing means, an image processing device 2, an instruction area determination device 3, a command recognition device 4, an input device (a keyboard, a mouse, and a voice input device). Etc.) 5, a display control device 6, a plant control device 7, a display device 8 such as a CRT, an instruction area setting device 9, a memory (instruction area setting data) 10, and a memory (plant information) 11. Reference numeral 12 is a mimic board for displaying information, and 13 is a pointer for emitting laser light. In this embodiment, both infrared light and visible light are used as the laser light emitted from the pointer 13. That is, the user inputs the designated position while observing visible light, and the image processing 2 captures an image of only infrared light. Thus, the visible light is used by the input person to confirm the pointing position, and the infrared light is used by the image processing device 2 to detect the pointing position. Therefore, the television camera 1 is used in a state where the sensitivity to visible light is lowered. As a result, the image processing apparatus 2 captures the image without the influence of the display object (visible light) on the mimic board 12, so that the image processing can be realized by a simple process. As a means for lowering the sensitivity to visible light, it is possible to mount a visible light blocking filter and adjust the diaphragm of the lens. In the present embodiment, the laser light emitted from the pointer 13 points on the mimic board 12. Here, it is assumed that the pointer 13 is input by turning off the laser light emitting switch (not shown) of the pointer 13, that is, by turning off the laser light. The television camera 1 shoots a range including the mimic board 12. The image processing device 2 performs image processing on a video image captured by the television camera 1 and obtains coordinates in the image of the designated point designated by the laser light. The pointing area determination device 3 determines the pointing area using the pointing area setting data (stored in the memory 10) that is preset and stored based on the coordinates of the pointing point obtained by the image processing apparatus 2. , The information of the character string defined in this instruction area is output. The command recognition device 4 integrates the character string information and the information input from the input device 5 such as voice input and keyboard input into one input sentence. Further, the command recognition device 4 analyzes the input sentence and creates a command to the display control device 6 and the plant control device 7. Instruction recognizer 4
The command signal obtained by the recognition by is taken into the display control device 6 (in some cases, the plant control device 7). The display control device 6 creates information to be displayed on the display device 8 based on the command signal, using information in the memory 11 (for example, a system diagram of a plant, a trend diagram, a piping instrumentation diagram, etc.). The created information is taken into the display device 8 and displayed. The instruction area setting device 9 is triggered by the input of an initial setting command signal input from the input device 5 by a user operation. This device 9 has a pointer 13
A plurality of designated points designated by the emitted laser light are taken in, and the designated area is set based on the coordinates of each designated point. Further, character information input from the input device 5 is defined for this designated area, and the character information defined as the designated area is stored in the memory 10. In addition, the designated area setting device 9
Outputs to the display control device 6 a request for inputting an instruction point and a request for inputting character information, and this request is displayed on the display device 8. The user can perform the initial setting by sequentially performing the operations displayed on the display device 8. Here, after the remote instruction input system of the present embodiment is installed at a predetermined position, after changing the position of the camera or the range to be photographed by the camera, an initial setting command is input to set the instruction area and Define the character information for the area.
This process is the initial setting mode.

The initial setting mode will be described below.
When the initial setting command signal is input to the pointing area setting device 9, the pointing area setting device 9 executes the process shown in FIG. In the present embodiment, as shown in FIG. 3, the setting of the pointing area is performed by designating two pointing points P1 and P2, and setting a rectangle in which these two pointing points are diagonal as the pointing area 20.
The designated area setting device 9 first determines whether or not an initial setting command signal has been input (step 101). When this determination is "YES", the display command of the input request of the first designated point is output to the display control device 6 (step 102). Figure 4
(A) shows a display example of the input request of the first designated point displayed on the display device 8. When the pointing point P1 is input by the laser light emitted from the pointer 13, P is set as the first pointing point.
The coordinate of 1 is taken in (step 103), and the display command of the input request of the second designated point is output (step 104). FIG. 4B shows a display example. Next, when the designated point P2 is input, the coordinates of P2 are taken in as the second designated point (step 105), and the designated area 20 is set using the coordinates of the first designated point and the coordinates of the second designated point (step 105). 106), the display command requesting the input of the character string defined in the instruction area 20 is output (step 107). A display example is shown in FIG. When a character string is input from the input device 5, this character string is fetched (step 108) and the designated area and the character string are stored in the memory 10 (step 109). FIG. 5 shows an example of the designated area setting data stored in the memory 10. In the designated area setting data shown in FIG. 5, the x coordinate X1 and the y coordinate Y1 of the first designated point, the x coordinate X2 and the y coordinate Y2 of the second designated point, and the first designated point and the second designated point are set. The character string to be output when the designated area is designated is stored. Then, the display command of the input request as to whether or not the initialization is completed is output (step 110). A display example is shown in FIG. When there is an input from the input device 5, it is determined whether or not the initial setting is completed. If the result of the determination is "NO", the setting process of the next instruction area is started. On the other hand, when the result of the determination is "YES", the initial setting mode ends (step 111). To end the initial setting, the user inputs an end command from the input device 5.

In FIG. 1, the television camera 1 shoots an area including the mimic board 12. The image captured by the television camera 1 is captured by the image processing device 2.
The processing executed by the image processing apparatus 2 is shown in FIG.
The image processing apparatus 2 first takes in the video information output from the television camera 1 (step 201). In order to remove unnecessary information from this video information, the video information is binarized (step 202) and the binary image is stored in an image memory (not shown) in the image processing apparatus 2 (step 203).
To do. The feature amount of the binary image is extracted based on the binary image in the image memory (step 204). The feature amount extraction of the binary image is performed by calculating the projection distribution of each density of the binary image as shown in FIG. This projection distribution is obtained by adding the densities of the binary image of the designated point in the x-axis direction and the y-axis direction, respectively. By this processing, as shown in FIG. 7, the x-axis, y-axis
The density distribution of the binary image (feature amount of the binary image) along the axis is obtained. The coordinates (xi, yi) of the position of the image of the designated point in the image captured by the television camera 1 are calculated using the feature amount of the binary image (step 205). The coordinates (xi, yi) are the center coordinates of the portion where the density of the binary image of the designated point exceeds the predetermined determination standard (see FIG. 7). That is, in the example of FIG. 7, xi is (x1 + x2) / 2 and yi is (y1 + y2) / 2. The obtained coordinates (xi, yi) are output to the designated area determination device 3 and the designated area setting device 9 (step 206).

In this embodiment, as shown in FIG.
The original function is to display detailed information on the object on the mimic board 12 pointed by the laser beam emitted from the pointer 13 (pointing point 23) on the display device 8 as shown in FIG. 8B. Is. For this purpose, it is necessary to specify which designated area the position designated by the laser beam indicates. This process is the execution mode. In the execution mode, first, the image processing device 2 detects the coordinates of the pointing point 23 designated by the pointer 13. Here, in the mimic board 12 shown in FIG. 8A, the instruction areas 21 and 22 are set in advance. In the instruction area 21, "nuclear pressure" is defined, and in the instruction area 22, "reactor water level" is defined. It has been done. Then, the pointing area determination device 3 determines whether the coordinates of the pointing point 23 are within the range of the pointing areas 21 and 22 based on the coordinates of the pointing point 23, and determines that the pointing point 23 is within the pointing area 21. After that, the “reactor pressure” defined in the instruction area 21 is output to the command recognition unit 4. After that, when "trend display" is input from the input device 5, the command recognition device 4 outputs a command for displaying a trend diagram of the reactor pressure to the display control device 6. The display control device 6 fetches the command from the command recognition device 4, and
As shown in (b), a trend diagram of the reactor pressure is displayed on the display device 8. The processing in the execution mode will be described below. The user inputs information such as information on the display device 8 and operation instructions to the plant by inputting instructions to the mimic board 12 using laser light emitted from the pointer 13 and voice input from the input device 5. First, the image of the mimic board 12 taken by the television camera 1 is captured by the image processing device 2. Even in the execution mode, the TV camera 1 lowers the sensitivity to visible light. The image processing device 2 that receives the video signal output from the television camera 1 executes the process shown in FIG. Then, the designated area determination device 3 executes the process of FIG. 9. First, the coordinates (Xr, Yr) in the image of the pointing point pointed by the laser beam emitted from the pointer 13 from the image processing device 2 is fetched (step 301), and then the pointing area stored in the memory 10 is read. By referring to the setting data, the designated area including the coordinates (Xr, Yr) of the designated point is determined (step 302). As a result of the judgment, the coordinates of the designated point (Xr, Y
If there is no designated area including r), step 30
Return to 1 (step 303). On the other hand, the coordinates (X
If there is a designated area including r, Yr), the output character string defined in the designated area is output to the instruction recognition device 4 (step 204).

The command recognition device 4 integrates the character string output from the pointing area determination device 3 and the information (for example, voice information or keyboard input information) input by the input device 5 into one input sentence. Is generated and the input sentence is further analyzed to generate a command to the display control device 6 (in some cases, the plant control device 7). The command recognition device 4 executes the recognition process of the input command according to the processing procedure of FIG. The specific processing example shown in FIG. 10 shows a case where “reactor water level” is instructed by the pointer 13 and “trend illustration” is input by voice input. First, the command recognition device 4 has an information integration function and an input sentence analysis function,
The information integration function integrates the character string output from the designated area determination device 3 and the voice information input from the input device 5 to obtain an input sentence. Specifically, the processing of FIG. 10 is executed by the input sentence analysis function in the instruction recognition device 4. That is, the input sentence is fetched (step 401). It is separated into words using the grammar and dictionary data stored in the memory (not shown) of the instruction recognition device 4, and "meaning" and "meaning category" are associated with each other as shown in FIG. 10 (step 4).
02). Here, the meaning category is a category of the meanings of words used in the technical world of display information. In the example of FIG. 10, “system” and “state quantity”
And so on. Next, the meaning of the input sentence is analyzed using the result obtained in step 402 (step 40).
3). The semantic analysis is performed in two steps (1) and (2) as shown in FIG. First, the type of request content of the input sentence is identified. The instruction recognition device 4 prepares standard sentence patterns for each type of request in the memory for identification. The standard sentence pattern identifies the type of the requested content by matching the “meaning” or the “meaning category”. In the example of FIG. 10, the sentence pattern “<trend_
“Graph> □ Present” is matched, and the request type is identified as the trend diagram presentation request “trend”. Here, the symbol “<>” means that the semantic category is used for matching, “□”. Indicates that an arbitrary number of words may be included.After the above processing (1) is completed, processing (2) (acquisition of information necessary to execute the requested content) is performed. The necessary information and its acquisition method are prepared as frame-type knowledge in the memory of the instruction recognition device 4. Using this knowledge, the information necessary for executing the requested content is acquired. Obtains the necessary information such as the system equipment name and the state quantity name from the input sentence. If the required information is not included in the input sentence, the plant-related knowledge, the use of the dialogue history, or the user If you contact us, When the analysis of the meaning of the input sentence is completed, the processing command is output to the corresponding control device (step 404) In the example of Fig. 10, the display control device 6 is requested to display the reactor water level trend diagram. "trend reactor water level" is output.

As described above, in the initial setting mode of the present embodiment, the function of the pointing area setting device 9 causes a rectangular pointing area based on the two pointing points input by the laser light emitted from the pointer 13. Is set, character information is defined in the pointing area based on the input of character information from the input device 5, and the set pointing area and the character string defined in the pointing area are set in the pointing area setting data. Is stored in the memory 10. In this way, in the present embodiment, it is possible to easily create the pointing area setting data which is the relational data of the pointing coordinates and the pointing object, and thereby to remotely point the pointing object on the mimic board. It becomes possible to perform an input operation, and at the same time, it is possible to efficiently display the information regarding the pointing object.
Further, in the execution mode of the present embodiment, by using the designated area setting data which is the relational data of the designated coordinates created in the initial setting mode and the designated object, the designated area determination device 3 receives the instruction captured from the image processing apparatus 2. It becomes possible to quickly determine the designated area including the coordinates of the points, and the character string defined in this designated area is used for the instruction recognition device 4
It is possible to output smoothly and easily. Further, in the present embodiment, by using the visible light and the infrared light in combination for the pointer 13, the user can particularly perform an instruction input while looking at the visible light. Therefore, the mimic board that does not have the function of displaying the indicated position. It becomes an effective means for inputting instructions. Further, since the image processing 2 captures an image of only infrared light, the image processing can be simplified. This makes it possible to realize image processing by simple processing, and is an effective means for improving the processing speed.

In this embodiment, the mimic board 1 is used.
Although 2 is used, even if it is replaced with a field device, it can be realized similarly to the configuration and processing described in the present embodiment.

FIG. 11 shows a remote instruction input system according to the second embodiment of the present invention. In the present embodiment, a television camera (for example, an infrared camera) 1, which is a photographing means, an image processing device 2, a pointing area determination device 3, a command recognition device 4, an input device (keyboard, mouse, voice input device, etc.).
5, display control device 6, plant control device 7, mobile terminal 8
a, a designated area setting device 9a, a memory (designated area setting data) 10a, and a memory (plant information) 11. Reference numeral 13 is a pointer that emits a laser beam, and 14 is a field device of the plant. Hereinafter, different from the first embodiment,
The processing of the designated area setting device 9a and the designated area setting data stored in the memory 10a will be described in detail. Others are the same as those in the first embodiment.

FIG. 12 shows the processing executed in the initial setting mode of the designated area setting device 9a. Here, in the present embodiment, as shown in FIG. 13, a shape formed by an arbitrary number of pointing points is set as the pointing area. For example, when the pointing points P11, P12, P13, P14 are input, the respective pointing points are connected and set as the pointing area 30. When the pointing points P21, P22, and P23 are input, the pointing area is set as the pointing area 31. The designated area setting device 9a first determines whether or not an initial setting command signal has been input (step 501). If this determination is “YES”, set i = 0 (step 502)
Then, i = i + 1 is executed (step 503). next,
The display command of the input request of the i-th designated point is output to the display control device 6 (step 504), and the i-th designated point is input (step 505). After the i-th point is input, i <
3 is evaluated (step 506). This is because the minimum number of pointing points required to form the pointing area is three, and steps 503 to 506 are repeatedly executed until three pointing points are input. On the other hand, the designated point is 3
After the individual input, the display command of the input request as to whether or not the input of the designated points is to be output to the display control device 6 (step 5
07), the processing from step 503 to step 508 is repeatedly executed until the instruction to end the input of the designated point is input (step 508). On the other hand, when the instruction to end the input of the pointing point is input, the pointing area is set based on the input pointing point (step 509), and the display command of the input request of the character string defined in the pointing area is displayed. 6 (step 510). When the character string to be defined is input (step 511), the instruction area and the character string to be defined in this instruction area are stored in the memory 10a (step 51).
2). Here, an example of the designated area setting data stored in the memory 10a is shown in FIG. In the designated area setting data shown in FIG. 14, the x coordinate X1 and the y coordinate Y1 of the first designated point are included.
The x-coordinate Xn and the y-coordinate Yn of the n-th designated point and the character string output when the designated area set by the inputted designated point are designated are stored. Then, a display command of an input request as to whether or not to end the initialization mode is output to the display control device 6 (step 513), and if a continuation command of the initialization mode is input, steps 502 to 5
The processes up to 14 are repeatedly executed until the initialization mode end command is input (step 514).

In the present embodiment, as shown in FIG. 15 (a), detailed information on the on-site equipment pointed by the laser beam emitted from the pointer 13 (pointing point 34) is provided.
As shown in FIG. 15B, the original function is to display on the mobile terminal 8a. For this purpose, it is necessary to specify which designated area the position designated by the laser beam indicates. This process is the execution mode. In the execution mode, first, the designated point 3 designated by the pointer 13
The image processing device 2 detects the coordinates of 4. Here, FIG.
In the field device shown in (a), it is assumed that the instruction areas 32 and 33 are set in advance, and the instruction area 32 has "PLR pump A" and the instruction area 33 has "valve 1132". Next, in the pointing area determination device 3, the pointing point 3
Based on the coordinates of 4, the coordinates of the pointing point 34 are
It is determined whether or not it is within the range of 2, 33, and the instruction area 32
Then, the “PLR pump A” defined in the instruction area 32 is output to the command recognition unit 4. After that, when "design drawing display" is input from the input device 5,
The command recognition device 4 outputs a command for displaying the design drawing of the PLR pump A to the display control device 6. The display control device 6 is
A command from the command recognition device 4 is fetched, and a design drawing of the PLR pump A is displayed on the mobile terminal 8a as shown in FIG. 15 (b).

As described above, in the initial setting mode of this embodiment, the function of the pointing area setting device 9a sets the pointing area based on an arbitrary number of pointing points input by the pointing command from the pointer 13. Further, the character information is defined in the instruction area by inputting the character information from the input device 5, and the set instruction area and the character string defined in the instruction area are stored in the memory 10a as instruction area setting data. Store. In this way, in the present embodiment, it is possible to easily create the pointing area setting data, which is the relational data of the pointing coordinates and the pointing target, and thereby to remotely point and input the pointing target in the field device. It becomes possible to operate and at the same time, it becomes possible to efficiently display the information on the pointing object on the mobile terminal or the like. Further, since the pointing area is set based on an arbitrary number of pointing points from the pointer 13, the pointing area having the same shape as the pointing object is set even for the pointing object having a complicated shape such as a field device. can do.

In the present embodiment, the field device 14 is targeted, but even if it is replaced with a mimic board, it can be realized in the same manner as the configuration and processing described in the present embodiment.

[0019]

As described above, according to the present invention,
The mimic board that does not have data corresponding to the normal display drawing data or an image of a field device, that is, the data necessary for setting the designated area is not registered in advance in the system. Since the data for setting the designated area is obtained for the first time when the camera for shooting the equipment in the field is installed, when setting the designated area together with the camera installation, the setting work of the designated area can be easily performed. You can Further, for the mimic board or the field device, it is possible to easily create the pointing area setting data which is the relational data between the coordinates of the position pointed by the laser beam emitted from the pointer and the pointing object pointed by the pointer. As a result, it becomes possible to remotely instruct and input an instruction target object on a mimic board or a field device, and at the same time, it is possible to efficiently display information regarding the instruction target object. Further, as the coordinate value of the position and the coordinate value of the relational data of the pointing object as the pointing area setting data in the present invention, since the coordinates in the image taken by the camera are used,
The calibration data created in the prior art becomes unnecessary, and as a result, according to the present invention, it is possible to reduce a huge amount of work for creating data as in the prior art. Further, according to the present invention, by using the designated area created by the designated area in the initial setting mode and the designated area setting data which is the relational data of the designated object, the coordinates of the designated point captured from the image processing apparatus by the designated area determination apparatus can be determined. It is possible to quickly determine the included instruction area, and it is possible to smoothly and easily output the character string defined in the instruction area to the instruction recognition device.

[Brief description of drawings]

FIG. 1 is a configuration diagram of a remote instruction input system according to a first embodiment of the present invention.

FIG. 2 is a diagram showing a process executed in the designated area setting device of the first embodiment.

FIG. 3 is a diagram showing a designated area setting method according to the first embodiment.

FIG. 4 is a diagram showing a display example of a display device.

FIG. 5 is a diagram showing an example of designated area setting data according to the first embodiment.

FIG. 6 is a diagram showing processing of the image processing apparatus.

FIG. 7 is a diagram for explaining calculation of projection distribution and detection processing of coordinate values.

FIG. 8 is a schematic diagram illustrating processing in an execution mode according to the first embodiment.

FIG. 9 is a diagram showing processing executed in the designated area determination device.

FIG. 10 is a diagram showing processing of an instruction recognition device.

FIG. 11 is a configuration diagram of a remote instruction input system according to a second embodiment of the present invention.

FIG. 12 is a diagram showing a process executed in the designated area setting device of the second embodiment.

FIG. 13 is a diagram illustrating a designated area setting method according to the second embodiment.

FIG. 14 is a diagram showing an example of designated area setting data according to the second embodiment.

FIG. 15 is a schematic diagram illustrating processing in an execution mode according to the second embodiment.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Television camera 2 ... Image processing device 3 ... Instruction area determination device 4 ... Command recognition device 5 ... Input device 6 ... Display control device 7 ... Plant control device 8, 8a ... Display device (portable terminal) 9, 9a ... Instruction Area setting device 10, 10a, 11 ...
Memory 12 ... Mimic board 13 ... Pointer 14 ... Plant field equipment

─────────────────────────────────────────────────── ─── Continuation of the front page (72) Takeichi Maruyama 5-2-1 Omika-cho, Hitachi-shi, Ibaraki Hitachi, Ltd. Omika factory, Hitachi, Ltd. (56) Reference JP-A-63-30926 (JP, A) JP-A-6-242884 (JP, A) JP-A-2-224011 (JP, A) JP-A-4-142613 (JP, A) JP-A-5-127887 (JP, A) (58) Fields investigated (Int.Cl. ⁷ , DB name) G06F 3/03 G06F 3/033-3/037 G06T 1/00

Claims (4)

(57) [Claims] 1. A laser beam is emitted from a pointer, a pointing object pointed by the laser beam of the pointer or a range including the pointing object is shot by a camera, and in an initial setting mode, the image shot by the camera is set. The image of the designated point designated by the laser beam of the pointer is image-processed by the image processing means, the coordinates of the designated point in the obtained image are obtained, and the designated area is designated based on the coordinates of the plurality of designated points. The character information defining the pointing object in the pointing area is set by the area setting means, the character information defining the pointing object in the pointing area is input, and the character information relating to the pointing object and the pointing area of the pointing object are associated with each other and stored in the storage device. In the execution mode, the coordinates of the pointing point designated by the laser beam of the pointer are detected by the image processing means, and are stored by the pointing area determination means. When it is determined that there is a designated area that includes the coordinates of the designated point designated in the execution mode, the character information corresponding to the designated area is obtained from the storage means, and the obtained target character information is used to relate to the designated object. A remote instruction input system characterized by outputting a display instruction and / or a control instruction from an instruction recognition means. 2. The remote instruction input system according to claim 1, wherein the display instruction regarding the instruction target object is a display instruction regarding plant information regarding the instruction object. 3. The remote instruction input system according to claim 1, wherein the control instruction relating to the instruction target is a command signal to a plant control device. 4. The remote instruction input system according to claim 1, wherein the instruction target is a plant device.