JP2000207018A - Plant monitor device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To detect the state change or abnormality of a plant by acquiring plant information about the plant on-line from the plant to be monitored and controlled and also to allow a multimedia display means to display or output relation information obtained by this relationship by automatically relating related information with each other on-line based on the detection results. SOLUTION: This device is provided with a plant information inputting means 1 which fetches plant information on a plant on-line, a plant information relating means 2 which monitors on-line information to detect the abnormality and state change of the plant and obtains relation information for relating on-line information related to the monitoring results with each other, an relation plant information processing means 3 which prepares a processing sequence and display data for displaying or outputting the monitoring results and relation information related to the results from the relation information and a multimedia displaying and outputting means 4 which displays or outputs the display data.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a plant monitoring device for monitoring a plant such as a power plant or a nuclear power plant.

[0002]

2. Description of the Related Art Conventionally, this type of plant monitoring device is installed for each plant and performs monitoring control on the site of the plant. However, in the future, a plurality of plants will be installed in order to reduce costs and save labor. It is necessary to perform remote monitoring such as monitoring and controlling at one control station. Further, with the sophistication and scale of plant operation, information handled in plant monitoring and control, such as handling multimedia information such as audio and video, explosively increases. Therefore, more advanced processing and operation support functions such as information provision and automatic operation for supporting the presentation of plant status and operation are required.

[0003]

However, such a conventional plant monitoring apparatus uses a binary state such as measurement of an analog quantity by a measuring device such as current or voltage of a plant device or an open / close state of a switch device. It mainly monitors and controls, and displays video information and sound information offline, or incorporates simple image processing online to detect abnormalities, and is merely an auxiliary position.

[0004] Also, in data management, conventional monitoring information is not associated with each other or monitoring information and multimedia information such as video. For this reason, for example, when analyzing plant abnormalities and accidents, it is necessary to analyze analog values and binary information representing the state of the plant in a time series, but extract information necessary for analysis including video, Automatically calculate the relationship between these data, and display and present multiple pieces of necessary information while synchronizing.
There is a problem that analysis support such as reproduction of accidents and abnormalities has hardly been performed.

The present invention has been made in view of such circumstances, and has as its object to obtain, on-line, plant information relating to a plant to be monitored and controlled, and to change the state of the plant and the like. In addition to detecting abnormalities and the like, the online information is automatically associated with each other based on the detection result, and the associated information associated with the association is displayed or output on the multimedia display means and presented to the operator. Accordingly, it is an object of the present invention to provide a plant monitoring apparatus capable of reproducing a situation of a plant and supporting a sophistication of plant monitoring and analysis.

[0006]

Means for Solving the Problems The present invention is constituted as follows in order to solve such problems.

[0007] That is, the invention of claim 1 is an online information input device for taking in plant information on a plant online, a plant information input device having online information input means for taking in online information from the online information input device, Online information monitoring means for monitoring the online information from the information input means to detect plant abnormalities and state changes, and association calculation for associating information for associating the online information related to the monitoring results from the online information monitoring means Information associating means for creating a processing procedure for displaying or outputting the monitoring result and related information relating to the monitoring result from the associating information from the associating calculating means; And the monitoring result by performing the processing procedure of the information processing unit, an associating plant information processing means having an association online information processing means for creating display data for displaying or outputting the related information,
And a multimedia display output means having an online information display means for displaying or outputting display data from the association online information processing means.

According to a second aspect of the present invention, there is provided an online information input device for inputting plant information related to a plant online, a plant information input device having an online information input device for inputting online information from the online information input device, and the online information input device. Online information monitoring means for monitoring the online information from the means to detect plant abnormalities and status changes, and association calculating means for obtaining association information for associating the monitoring result from the online information monitoring means with the online information; Plant information associating means having online information adding means for adding associative information to online information, and online information separation for separating online information and associated information from the additional information from the online information adding means And a processing procedure for displaying or outputting the monitoring result and related information related to the result from the association information separated by the online information separating means and the online information separating means. An associating plant information processing means having an associating online information processing means for executing a processing procedure and creating display data for associating and displaying or outputting the associating information; and displaying or outputting data from the associating plant information means. And a multimedia display having online information display means for displaying or outputting.

According to a third aspect of the present invention, in the plant monitoring device according to the first or second aspect, an online database for storing online information, and the monitoring result and the online information from the online information monitoring means are stored in the online database. Online information storage means, an association information database for storing association information, an association storage means for storing the association information from the association calculation means in the association information database, and a search condition for searching for information from each of the databases. Search condition input means for setting and inputting, and information matching the search condition input to the search condition input means are searched from each of the databases, and the search information is provided to the associated plant information processing means to be included in the display data. Plant information search means and A plant monitoring apparatus comprising the.

According to a fourth aspect of the present invention, in the plant monitoring apparatus of the first aspect, an offline database for accumulating information on the plant offline and a processing procedure from the association information processing means are executed to obtain the offline information from the offline database. Associated offline information processing means for searching for and generating the display information for displaying or outputting the offline information, and offline information displaying means for displaying the offline-related information from the offline information processing means. This is a featured plant monitoring device.

According to a fifth aspect of the present invention, there is provided a video input device for capturing an image of a plant, video input means for capturing video information from the video input device, a measuring device for measuring a plant, and measurement for capturing measurement information from the measuring device. Plant information input means having information input means, monitoring the video information from the video input means and monitoring the measurement information from the measurement information input means and video monitoring means for detecting plant abnormalities and status changes Plant information having measurement information monitoring means for detecting abnormalities and state changes of the plant, and associated video means for obtaining association information for associating measurement information with video information related to each monitoring result from the measurement information monitoring means. An associating means, and the monitoring result and the Related information processing means for creating related image information and related measurement information related to the result and associated information processing means for creating the measured information processing procedure, and the monitoring result and the related image information executed by executing the above described image information processing procedure Associated image processing means for generating image display data for displaying the information, and associated measurement information processing means for executing the measurement information processing procedure and creating measurement information display data for displaying the monitoring result and its associated measurement information An associated plant information processing means having; a video display means for displaying the video information display data from the associated online information processing means; and a multimedia display means having measurement information display means for displaying the measurement information display data. A plant monitoring device comprising:

According to a sixth aspect of the present invention, in the plant monitoring apparatus according to the fifth aspect, a video adding means for adding video information from the video information monitoring means to the association information from the association calculating means, and an addition from the video adding means. A video separating unit that separates video information and association information from information and provides the association information to the associated video processing unit.

According to a seventh aspect of the present invention, in the plant monitoring apparatus according to the sixth aspect, a video database for storing video information, and a video storage means for storing the monitoring result from the video monitoring means and the video information in the video database. And a measurement information database that stores measurement information; a measurement information storage unit that stores monitoring results and measurement information from the measurement information monitoring unit in the measurement information database; and a search condition for searching for information from each of the databases. A search condition inputting means for setting and inputting, and information relating to the search condition input to the search condition inputting means are searched from the respective databases, and the associated plant information processing means is included in the display data. And a plant information search means for providing the plant information.

The invention according to claim 8 is an image input device for inputting an image of a plant, an image input means for inputting image information from the image input device, a measuring device for measuring the plant, and inputting measurement information from the measuring device. A plant information input means having a measurement information input means, a video monitoring means for monitoring the video information from the video input means to detect a plant abnormality or a state change, and a measurement information from the measurement information input means. Measurement information monitoring means for detecting plant abnormalities and state changes, and association calculation means for determining association information for associating video information, measurement information, or video information with measurement information from monitoring results from these monitoring means. And the association information from the association calculation means is added to the area where the user of the video information can set. Information adding means for adding video information to the video information storing means and the video information storing means for storing video information in the video database, and adding the relevant information from the video calculating means to the user-settable area of the measurement information. Means and a plant information associating means having a measurement information storage means for accumulating measurement information with the associating information of additional information from the measurement information information adding means, and a search condition for retrieving information from the respective databases. And set
Search condition input means for inputting, and plant information to be provided to the associated plant information processing means for searching information matching the search condition input to the search condition input means from each of the databases and including the search information in display data Search means, video separation means for separating the association information and the video information from the additional information from the video addition means, and processing procedure for displaying the video information and the measurement information from the association information separated by the video separation means, respectively Associated information processing means for creating image data, associated image processing means for creating image display data for executing the image information processing procedure to display image information, and measurement for executing the measurement information processing procedure to display measurement information. Association having association measurement information processing means for creating information display data Multimedia display means having plant information processing means, video information display means for displaying video information display data from the association video processing means, and measurement information display means for displaying measurement information display data from the association measurement information processing means According to a ninth aspect of the present invention, in the plant monitoring apparatus according to any one of the first to eighth aspects, a video input device is connected to a video input device of the plant. Image input device control means for controlling the image input device, and an image by the plant information input means including the image input device control means based on at least one of the monitoring result from the image monitoring means and the association information from the association information processing means. And a video input control means for controlling an input.

According to a tenth aspect of the present invention, there is provided a sound information input device for taking in plant sound, a sound information input means for taking in sound information information from the sound information input device, a measuring device for measuring a plant, and a measuring device for measuring the plant. A plant information input means having measurement information input means for capturing information; a sound information monitoring means for monitoring the sound information from the sound information input means to detect a plant abnormality or a state change; and Measurement information monitoring means for monitoring measurement information to detect plant abnormalities and status changes, and obtaining sound information and associated information for associating measurement information with sound information relating to each monitoring result from the measurement information monitoring means. The plant information associating means having an association calculating means, and the monitoring from the association information from the associating calculating means. Information processing means for creating a sound information processing procedure and a measurement information processing procedure for respectively outputting a result and related sound information and related measurement information related to the result, and a sound information processing procedure from the association information processing means. An associating sound information processing means for executing and generating sound information output data for outputting the monitoring result and its related sound information, and displaying the monitoring result and its related measurement information by executing the measurement information processing procedure Associated plant information processing means having related measurement information processing means for creating the measurement information display data, sound information output means for outputting the sound information output data, and multi-function having measurement information display means for displaying the measurement information display data And a media display unit.

According to an eleventh aspect of the present invention, in the plant monitoring apparatus according to the tenth aspect, a sound information database for storing sound information, and a monitoring result and sound information from the sound information monitoring means are stored in the sound information database. Sound information storage means, a measurement information database for storing measurement information, a measurement information storage means for storing monitoring results from the measurement information monitoring means and measurement information in the measurement information database, and an association information database for storing association information And an associative storage means for storing associative information between sound information and measurement information from the associative calculating means in the associative information database; and a search condition for setting and inputting a search condition for searching information from each of the databases. Input means and information matching the search condition input to the search condition input means. Searching extracted from the base, a plant monitoring apparatus being characterized in that and a plant information retrieval means for providing association plant information processing means for including the search information to the display data.

According to a twelfth aspect of the present invention, an eleventh or a first aspect
2. In the plant monitoring device described in 2, the sound information adding means for adding sound information from the sound information monitoring means to the association information from the association calculation means, and the measurement information from the measurement information monitoring means to the association information from the association calculation means. Measuring information adding means for adding, sound information separating means for separating sound information and association information from the additional information from the measuring information adding means, and measurement information and association information from the additional information from the sound information adding means. Creating a sound information monitoring result from the measurement information separating means to be separated, the sound information monitoring result from the association information separated by the sound information separating means, and related sound information related to the result and the measurement information, and From the association information separated by the measurement information separating means, the measurement information monitoring result and the related measurement information related to the result and the sound information are obtained. Associated sound information processing means for creating a measurement information processing procedure for displaying the sound information, associated sound information processing means, and associated sound information for creating output data for outputting the sound information by executing the sound information processing procedure A plant monitoring apparatus, comprising: a processing unit; and an association measurement information processing unit that executes the measurement information processing procedure and creates display data for displaying measurement information.

According to a thirteenth aspect of the present invention, in the plant monitoring apparatus according to any one of the first to twelfth aspects, the plant information of a plant that meets a search request from a plurality of plants is stored in a plant information associating means or an associating plant. An output-side distributed network processing means having a distributed access means for obtaining a name from the information processing means and a name conversion means for converting the name, and an associating plant information processing means receiving information on the plant from the output-side distributed network processing means And an input-side decentralized network processing means for displaying or outputting on a multimedia display means by associating related plant information with each other.

According to a fourteenth aspect of the present invention, there is provided a plant monitoring apparatus according to any one of the first to thirteenth aspects, wherein
A plant monitoring apparatus comprising a synchronization unit for synchronizing a plurality of pieces of related information including sound and measurement information and displaying or outputting the information on a multimedia display unit.

According to each of these inventions, the plant information indicating the state of the plant to be monitored includes plant video, sound, and measurement information. The information is taken into the plant monitoring device by an online information input device such as an information input device. Such plant information is hereinafter referred to as online information.

Further, such online information is transmitted to online information monitoring means such as video monitoring means, measurement information monitoring means and sound information monitoring means by means of online information input means such as video input means, measurement information input means and sound information input means. Is monitored respectively. Here, for example, when an abnormality, accident, or state change of the plant is detected by the online information monitoring means due to an abnormal pattern or a sudden change of input information, or a state change such as exceeding an upper / lower limit, an event is given to the association calculating means. . The types of events include state change, upper and lower limit values exceeded, device appearance abnormality, intruder detection, device operation, designated time notification, and the like.

Then, the association calculating means obtains association information associated with the monitoring result. This association information is given to the association information processing means, and here, a processing procedure for how to process each online information and display or output it on the multimedia display means is required. These processing procedures are given to and executed by the association online information processing means or the association offline information processing means such as the association video processing means, the association measurement information processing means, the association sound information processing means, and the like. Multimedia display means having online information display means such as information output means creates monitoring data to be displayed or output in multimedia and display data of related online information, and the display data is displayed in multimedia. As a result, necessary information on the abnormality or accident of the plant is displayed or output in synchronization with, that is, associated with, and presented to the operator.

Therefore, according to these inventions, a state change or an abnormality of a plant to be monitored and controlled is detected, and the monitoring result and the image and measurement of the plant are detected.
Information related to the online information such as sound and the association between these online information are automatically performed.
The related information of the online information related by the related information is displayed or output on the display means as multimedia in real time and presented to the operator. For this reason, the situation of the plant can be reproduced, and so on, and the monitoring of the plant can be enhanced and the analysis can be supported.

When a database for storing online information and association information is provided, online information such as video, sound, and measurement information of the plant is monitored by each monitoring means, while video storage means and measurement information storage means are monitored. , An online information storage means such as a sound information storage means, and an online D such as a video database (hereinafter referred to as a DB), a measurement information DB, a sound information DB, etc.
B, respectively, are stored in the association information DB.

Further, the search condition input by the search condition input means is given to the information search means, and by searching and extracting the association information DB, information suitable for the search condition is obtained. Online information is searched by online information search means, video information is searched by video information search means, measurement information is measured information search means, and sound information is searched by sound information search means. The search results are given to the associated plant information processing means. Then, the searched information is displayed by the multimedia display means in association with each other, such as being synchronized, and presented to the operator.

[0026]

BRIEF DESCRIPTION OF THE DRAWINGS FIG.
This will be described with reference to FIG. In these figures, the same or corresponding parts are denoted by the same reference characters.

FIG. 1 is a block diagram showing the configuration of a plant monitoring apparatus A according to the first embodiment of the present invention. In FIG. 1, the plant monitoring apparatus A includes a plant information input unit 1, a plant information association unit 2, an association plant information processing unit 3, and a multimedia display unit 4.

The plant information input means 1 is for inputting, in real time, plant information relating to a plant indicating the state of the plant and the like in real time, and has an online information input device 11 and an online information input means 12. The online information input device 11 captures plant information such as plant images, measurement information, and sound information. The online information input device 11 is a monitoring camera for visible light or infrared light, a digital still camera, Examples include video input devices such as cameras, current and voltage of plant equipment, measurement devices for detecting the opening and closing of valves and the like, and sound information input devices such as microphones for inputting sound of plant equipment.

The online information input means 12 takes in various types of analog information or digital information from the online information input device 11 online and converts analog signals into required formats such as digital signals required for computer processing. And gives it to the online information monitoring means 21 of the plant information association means 2.

The plant information associating means 2 calculates a plurality of online information monitoring means 21 for monitoring each type of online information such as video information and measurement information input by the plant information input means 1 and calculates an association between online information. And an association calculating means 22a. The online information monitoring means 21 monitors the online information from the online information input means 12 to detect plant abnormalities or status changes, and when these are detected, the monitoring results are associated as events and calculated. This is given to the means 22a. Event types include state changes,
There are upper and lower limit values exceeded, device appearance abnormality, intruder detection, device operation, designated time notification, and the like.

Upon receiving this event, the association calculating means 22a obtains the event, that is, association information for associating the online information related to the monitoring result, and associates the associated information with the association information processing information of the association plant information processing means 3. This is given to the means 31.

FIG. 2 is a block diagram showing the structure of the association calculating means 22a. As shown in FIG. 2, the association calculating unit 22a includes an event input unit 221, an event analysis unit 222, an association information calculation unit 223,
It has an information definition DB (database) 224, an association information creation unit 225, and an association information transmission unit 226.

The event input means 221 receives the event from the online information monitoring means 21 and gives it to the event analyzing means 222. The event analyzing means 222 analyzes the contents of the received event. In the association information calculation means 223, the information definition D
B (database) 224 is searched for equipment information of the plant to be monitored, and equipment information related to the analysis result is calculated and obtained. FIG. 4 shows a configuration example of part of device information of data stored in the information definition DB 224. The association information calculation unit 223 searches for related information together with the analysis result, and the association information creation unit 225 creates the association information shown in FIG. Arrows in FIG. 3 indicate pointers. This association information is transmitted by the association information transmission unit 226 to the association information processing unit 31 of the association plant information processing unit 3.

The associating plant information processing means 3 performs monitoring necessary for display or output by the multimedia display means 4 in order to monitor the online information based on the associating information of the on-line information associated by the plant information associating means 2. It creates a processing procedure and executes the processing procedure, and includes an association information processing means 31 and an association online information processing means 32.

Upon receiving the association information, the association information processing means 31 creates a processing procedure for synchronizing and displaying or outputting the online information related to the processing of the event as multimedia on the multimedia display means 4. Online information processing means 3 associating procedures
2 is given.

The association online information processing means 32
By executing this processing procedure, display data for displaying the related information associated with the association information on the multimedia display means 4 is created.

The multimedia display means 4 monitors the display means 41 by displaying the display data from the associating plant information processing means 3 in the online information display means 41 in such a manner as to synchronize various kinds of information as multimedia in a synchronized manner. In this case, a plurality of online information is displayed and presented in association with each online information.

Next, the plant monitoring device A according to the present embodiment
The operation of will be described.

The plant information indicating the state of the plant, which is measured and input by the online information input device 11 online, is transmitted online as analog information or binary information to the online information input means 12, where the A / D conversion is performed. The data is converted into a format necessary for taking in the equal computer, and is provided to the online information monitoring means 21 of the plant information association means 2. The online information monitoring means 21 detects the presence or absence of an abnormality in the plant, the presence or absence of a state change, and the like based on the input online information. When the abnormality or the state change of the plant is detected, the information is given to the association calculating means 22a as an event.

The types of the events include changes in plant status, upper and lower limits, abnormal appearance of the equipment, detection of intruders, operation of the equipment, notification of a designated time, and the like. Information.

The association calculator 22a calculates online information related to the input event by calculation.
That is, the event from the online information monitoring unit 21 is received by the event input unit 221, and the content of the event is analyzed by the event analysis unit 222. Further, the association information calculating means 223 searches the information definition DB 224 for equipment information based on the analysis result, obtains equipment information related to the analysis result, and obtains the association information searching means 22.
In 4, related information is searched together with the analysis result, association information is created by the association information calculation unit 225, and is given to the association information processing unit 31 by the association information transmission unit 226.

For example, when an open / close abnormality of the circuit breaker X occurs, the association information calculating means 223 outputs information such as the device name of the circuit breaker X, the device connected to the circuit breaker X, and the circuit breaker X.
The related information such as the information measured in the above is searched from the information definition DB 224, and the accident determination and the accident recovery processing program (only the recovery procedure is requested and the actual recovery operation is not performed here) is started to recover. The equipment that must be operated is requested, and the information definition DB 224 is also provided for the equipment.
Are registered in the related device information list by the association information creation unit 225 (for example, the association information shown in FIG. 3), and transmitted to the association information processing unit 31 by the association information transmission unit 226.

This association information is received by the association information processing means 31, and here, a processing procedure for displaying or outputting on the multimedia display means 4 is created based on the online information related to the processing of the event.
For example, regarding the abnormal opening and closing of the shield X, the association information processing means 31 activates an accident recovery program (actually performs a recovery operation), and outputs online information of the equipment performing the recovery operation, for example, the current and voltage values of the measuring equipment. For example,
A display procedure such as displaying as a trend graph, or displaying the open / closed state of the switchgear or the like or, in the case of skeleton display, a single-line connection diagram or the like is created and given to the association online information processing means 32. On the other hand, the associated online information processing means 32 receives the online information from the online information monitoring means 21 and
Is activated and displayed according to the above display procedure.

Therefore, according to the plant monitoring apparatus A of this embodiment, for example, a serious plant abnormality or state change can be detected in real time.
When these abnormalities occur, the information is automatically calculated and presented on the online information display means 4 in order to present necessary online information to the operator in a display method suitable for the abnormality or state change of the plant. It can be presented to the operator.

FIG. 5 is a block diagram showing a configuration of a plant monitoring apparatus B according to a second embodiment of the present invention. The plant monitoring apparatus B uses visible light or infrared light for imaging a plant as online information. This embodiment deals with video information from a surveillance camera, a digital still camera, a video camera, and the like, and current and voltage values of plant equipment, and measurement information indicating the open / closed state of the plant equipment.

That is, the plant information input means 1 includes a video input device 13 such as a monitoring camera or an infrared camera for inputting a moving image of the plant, a digital still camera for inputting a still image of the plant, and the like. For inputting to the computer, for example, in the case of a moving image, there is provided a video input means 14 for performing processing such as capturing data for each frame (frame) or processing for capturing a still image.

Further, the plant information input means 1 has a measuring device 15 for measuring the current and voltage of the plant equipment, the open / closed state of the equipment, and the like, and a required format capable of taking the information from the measuring device 15 into a computer. And measurement information input means 16 for conversion.

The plant information associating means 2 is for associating the monitoring results of the video and measurement information inputted here, or the monitoring results with the video information or measurement information, or the video information and the measurement information. A video monitoring unit 23 that monitors an image input thereto to detect a plant abnormality or state change and outputs an event, and monitors measurement information to detect a plant abnormality or state change and outputs an event. It has a measurement information monitoring means 24 and an association calculation means 22b for calculating association information for associating an image related to the monitoring result with the measurement information by calculation when such monitoring is required.

FIG. 6 shows an example of the configuration of the video monitoring means 23. The video monitoring unit 23 includes a video creation unit 231, a video input source DB (database) 232, and a video change detection unit 2.
33 and an image processing means 234. Video creation means 23
Numeral 1 encodes the video information taken in from the video input means 14. For example, MPEG (Moving
In the case of a Picture Image Cording Experts Group, encoded (compressed) data having a hierarchical structure such as a sequence, a GOP, a picture, etc., as shown in FIG. Things.

The image change detecting means 233 detects the change of the coded image. In this case, the image information is determined by the camera (camera position, camera direction, focal length, etc.) of the image input device 13. From the input source DB (database) 232, which information is obtained from the video input source DB (database) 232, which angle and zoom ratio are used to determine what information is captured on which equipment of the plant. Determine where the change was detected. further,
The image change detecting means 233 gives the input image information to the image processing means 234 in order to detect a change in the image,
Here, image processing such as pattern matching between the input video and the reference image, image conversion, feature extraction / recognition (shading, feature extraction by histogram, line extraction, etc.) is performed, and changes in the input video are detected. The result is again provided to the image change detecting means 233, where an event is generated as a plant abnormality or a state change, and the event is provided to the association calculating means 22b together with image input source information including camera information and photographing information. At the same time, the image and the image input source information are associated with each other, and are provided to the associated image processing unit 33 of the plant information processing unit 3.

In almost the same manner, the measurement information is monitored by the measurement information monitoring means 24 to check the change of binary information and the upper and lower limits in the plant measurement information, the tendency of the time series change of the data, and the like. When an abnormality or the like is monitored and a state change or abnormality is detected, an event is generated and the event is given to the association calculating means 22b, while the event and the measurement information are associated with each other. Means 34.

Since the association calculating means 22b has almost the same function as the association calculating means 22a of the first embodiment, the description of the duplicated functions will be omitted. The association information for associating the relevant image information with the measurement information is obtained. In the case of detecting an abnormality in the image, camera photographing information is set as the event detection means in FIG.

Then, in the associated video processing means 33,
The video information from the video monitoring means 23 is associated, and the video information processing procedure from the information processing means 31 is executed to create video display data for displaying a video on the video display means 42 of the multimedia display means 4.

The associating plant information processing means 3 analyzes the associating information from the associating calculating means 22, and displays the video and the measuring information which are associated with each other by the associating information on the multimedia display means 4 in association with each other. Associating information processing means 31 for respectively generating a video processing procedure and a measurement information processing procedure;
1. The associated video processing unit 3 that executes the video processing procedure from step 1 and creates video display data for displaying the video information from the video monitoring unit 23 on the multimedia display unit 4.
And an associated measurement information processing unit that creates measurement information display data for displaying the measurement information from the measurement information monitoring unit on the multimedia display unit 4 by executing the measurement information processing procedure.

FIG. 7 is a block diagram of the association information processing means 31. As shown in FIG. 7, the association information processing unit 31 includes an association information analysis unit 311, an association information separation unit 312, a processing procedure creation unit 313, and an associated processing execution unit 314.

The association information processing unit 31 performs a process for association that is not related to the creation and display of a processing procedure according to the association information and the display attribute given from the association calculation unit 22b. An analysis unit 311 analyzes whether or not to perform processing such as which data should be displayed and how based on the input association information. As a result of the analysis, processing not related to the display or processing not performing processing in accordance with the transmitted plant information, such as execution of a command of the system, is executed by the related processing execution unit 314. When processing related to display or plant information is required, the information is separated into pieces of information, for example, video and measurement information by the association information separation means 312, and the processing procedure is created by the processing procedure creation means 313 from the separated information. create.

The multimedia display means 4 includes a video display means 42 for displaying video data from the associated video processing means 33 and a measurement information display means 43 for displaying measurement information display data from the association measurement information processing means 34. Have.

Next, the operation of the plant monitoring apparatus B according to this embodiment will be described.

The plant equipment is photographed by a monitoring camera, an infrared camera, a digital still camera, or the like, which is the video input equipment 14. When these cameras are analog cameras, video signals such as NTSC are AD / DA converted by the video input means 14 for each frame, for example.
If it is a digital still camera, AD /
After being subjected to DA conversion and compression, it is taken into the video input means 12.

On the other hand, the current value and voltage value of the plant equipment, the open / closed state of the equipment, and the like are measured by the measuring equipment 15 and converted by the measurement information input means 16 into a format that can be taken into the computer.

The video information and the measurement information are given to the video monitoring means 23 and the measurement information monitoring means 24 of the plant information associating means 2, respectively. Then, the measurement information is monitored by the measurement information monitoring means 24 to detect an abnormality or a change in the state of the plant. Each monitoring result is provided to the association calculation means 22b.

The video monitoring means 23 encodes the video information taken in by the video creating means 231 shown in FIG. For example, in the case of MPEG, the sequence, GO
It becomes encoded (compressed) data having a hierarchical structure such as P and picture.

The encoded image is further subjected to image change detection by the image change detection means 233. At this time, camera information such as the position and orientation of the camera and the focal length of the video information and the shooting information are obtained by searching the video input source DB 232. Image processing such as conversion, feature extraction / recognition (shading processing, feature extraction using histogram, line extraction, etc.) is performed and detected, and the detection result is used to generate an event as a plant abnormality or change by the video change detection unit 233. Then, the event is provided to the association calculating unit 22b together with video input source information including camera information and the like, while the video and the video input source information are provided to the association information processing unit 31 of the association plant information processing unit 33.

Similarly, for the measurement information, the measurement information monitoring means 24 checks the change of the binary information and the upper and lower limit values, detects the tendency of the time series change of the data, and monitors the state change and the abnormality of the plant. If a state change or abnormality is detected, an event is generated and given to the association calculating means 22b.
The event and the measurement information are given to the association measurement information processing means 34 of the association plant information processing means 33.
The association calculating means 22b has almost the same function as the association calculating means 22 of the first embodiment. However, in the case of detecting an abnormal image, camera / photographing information is set as the event detection information in FIG. .

The associated video processing means 33 of FIG. 5 processes the video information from the video monitoring means 23 according to the video processing procedure from the associated information processing means 31. The association information processing unit 31 performs an analysis on a process such as which data is to be displayed from the association information by the association information analysis unit 311.

As a result of the analysis, processing that is not related to display or processing that does not perform processing in accordance with the transmitted plant information, such as execution of system commands, is executed by the association processing execution means 314. If processing related to display or plant information is required, the information is separated into different types of information, for example, video and measurement information, by the association information separation means 312, and a video processing procedure and measurement information processing are performed based on the separated information. The procedure is created by the processing procedure creating unit 313. For example, FIG. 8 shows main items of an example of a processing procedure when a video is displayed on the multimedia display means 4 in synchronization with measurement information displayed on a trend graph or the like. An example of the procedure is as follows.

[Outside 1]

An example of the procedure of the measurement information processing to the association measurement information processing means 34 is as follows.

[Outside 2]

When the preparation for displaying the image of the plant and the measurement information is completed, the association information processing means 31 sends a start signal, and synchronizes the image and the measurement information with the image display means 42 and the measurement information display means. 43 to display information respectively.

FIG. 9 shows an example of the configuration of the associated video processing means 33. The associated video processing unit 33 receives the video information by the video receiving unit 331, temporarily stores the received information in a memory or an external storage device by the video holding unit 332, and uses the buffer as a buffer to reduce the reception speed of the video information. Absorb the difference in video processing speed so that video can be displayed smoothly. Next, the video information from the video holding unit 232 and the video processing procedure from the association information processing unit 31 are given to the video processing procedure analysis execution unit 333, and how the video is displayed on the multimedia display unit 4. Is analyzed and executed, and the display control means 334 controls the video displayed on the multimedia display means 4 based on the analysis result.

FIG. 8 shows an example of a command used in this video processing procedure.

For example, an example of the above-mentioned video processing procedure is as follows.

[Outside 3]

This is analyzed by the processing procedure analysis execution means 333, and one window for displaying an image is first generated through the image display control means 343, the start time is designated, the reproduction time is 30 seconds, the reproduction mode is Set to playback to stop. Next, send the video for 30 seconds from the specified time to the window, and finally send the End of Stream,
Notify the end of the video to the window. The start of playback is notified when the video is sent.

Therefore, according to the plant monitoring apparatus according to the second embodiment, it is possible to present the video to the operator in association with the measurement information used in the conventional monitoring, for example, by synchronizing them.

FIG. 10 is a block diagram showing the configuration of a plant monitoring device C according to the third embodiment of the present invention. The plant monitoring device C converts the image information in the plant monitoring device B into the sound information of the plant in order to display or output the multimedia monitoring means 4 in association with the measurement information of the plant and the sound information of the plant, for example, by synchronizing the information. The feature is that it is replaced by

That is, the plant monitoring apparatus C converts a sound information input device 17 such as a microphone that takes in sound from a plant device and analog sound information from the sound information input device 17 into a digital signal or the like suitable for computer processing. Sound information input means 18 and the sound information input means 1
8 has a sound information monitoring means 25 for detecting abnormalities and state changes of the plant and for correlating events to the calculating means 22c, and a sound information output means 44 such as a speaker for outputting sound information. Except for this, the configuration is almost the same as the configuration of the plant monitoring device B, and thus the description is omitted.

FIG. 11 is a block diagram showing an overall configuration of a plant monitoring apparatus D according to a fourth embodiment of the present invention. The plant monitoring device D according to the plant monitoring device A according to the first embodiment includes an online information adding unit 26 that adds association information to online information;
The feature is that an online information separating means 36 for separating the online information and the associated information of the additional information is added again.

That is, in the plant monitoring device D, the plant information input means 1 is constituted by the online information input device 11 and the online information input means 12 similarly to the plant monitoring device A.

The plant information associating means 2 is connected to the online information monitoring means 21 similar to the plant monitoring apparatus A and the associating calculating means 22d.
6 is added. The online information adding means 26 adds related information associated with other video information or measurement information to a location where, for example, a user area of video information (a place where the user can freely store information) is determined as a specification. It is.

The association plant information processing means 3 is configured by adding an online information separation means 36 to the association online information processing means 32 and the association information processing means 31 similar to the plant monitoring apparatus A. The multimedia display means 4 is composed of an online information display means 41 similar to the plant monitoring device A.

Next, the operation of the plant monitoring device D will be described.

The online information such as video information, measurement information, and sound information input by the plant information input means 1 is monitored by the online information monitoring means 21 when an abnormality or a change in state of the plant is detected. Outputs an event.

This event is given to the association calculating means 22d, where online information relating to the monitoring result or association information for associating the online information with each other is obtained. The information is added to the information and given to the online information separating means 36 of the associated plant information processing means 3. The online information separating means 36 separates the information into association information and online information and gives the online information to the association online information processing means 32.
The association information is provided to the association information processing means 31. The associating online information processing means 32 creates display or output data for synchronizing the related online information mutually related by the associating information, for example, video information, measurement information or sound information, and displaying them on the multimedia display means 4. These data are displayed on the multimedia display means 4. Other than this, the first embodiment A
Since the operation is the same as that described above, the description is omitted.

Therefore, according to the plant monitoring device D, by adding the online information adding means 26 and the online information separating means 36 to the plant monitoring device A according to the first embodiment, it is possible to associate the existing information with the existing information. For processing.

FIG. 12 is a block diagram showing an overall configuration of a plant monitoring device E according to a fifth embodiment of the present invention. This plant monitoring device E causes the multimedia display means 4 to display the plant monitoring device D according to the fourth embodiment as multimedia using video and measurement information of the plant as online information used here. Is characterized in that it is associated with the video information in the online information and is associated with it.

In other words, the plant monitoring device E is M
In a place where the user area of video information such as PEG (a place where the user can freely store information) is specified as a specification,
This is a plant monitoring device in which association information associated with other video information or measurement information is added.

That is, in the plant monitoring apparatus E, the plant information input means 1 is constituted by the video input device 13, the video input device 14, the measuring device 15, and the measurement information input device 16.

The plant information associating means 2 associates another image or measurement information based on the monitoring result from the image monitoring means 23 for detecting a plant abnormality or the like based on a change in image of the image information. Calculating means 22e for detecting the associating information, video adding means 27 for adding the associating information from the associating calculating means 22e to the video from the video monitoring means 23, and measuring information monitoring means 24 for monitoring the measuring information. Having.

The association plant information processing means 3 comprises an association video processing means 33, a video separation means 37, an association information processing means 31, and an association measurement information processing means. The multimedia display means 4 has a video display means 42 and a measurement information display means 43.

Next, the plant monitoring apparatus E according to the present embodiment
The operation of will be described.

First, the image of the plant is captured by the image input device 13 and the image input means 14 of the plant information input means 1 in the same manner as the plant monitoring apparatus B,
The measurement information of the plant is taken in by the measurement device 15 and the measurement information input means 16. Further, the video information is monitored by the video monitoring means 23 in the same manner as the plant monitoring apparatus B, and abnormalities and state changes of the plant are detected due to image changes, etc., and when these are detected, the event is transmitted to the association calculating means 22e. The association information for associating with another image or measurement information is calculated here.
The association information is further provided to the video adding unit 27. In the video adding unit 27, when there is additional information, the association information is set and added to the user data area of the video.

The association plant information processing means 3 extracts association information from the associated video information and calculates the association. However, if there is no area defined as the format standard for the video information and the like, the video additional information to which the correlation information is added is first separated into the correlation information and the video information by the video information separating means 37, and the video information is associated. The association information is provided to the video information processing unit 33. Except for this, the operation is the same as that of the embodiment of the plant monitoring device B, and thus the description is omitted.

When the association information is added to the user data area defined as the video format standard by the video addition means 27, the user data is extracted from the video information in the association video processing means 33, The user data is provided to the video separating means 37.
In the video separating unit 37, since data is set in the user data for another purpose, the association information is extracted from the user data, and the association information is provided to the association information processing unit 31. The following operation is the same as the operation of the plant monitoring device B according to the second embodiment, and thus will not be described.

Therefore, according to this embodiment, the second
In the plant monitoring apparatus B according to the embodiment, by adding the video adding unit 27 and the video separating unit 37, it is possible to perform processing by adding association information for association to existing online information. Also, by adding the association information to the video, it is possible to display other measurement information in accordance with the video.

FIG. 13 is a block diagram showing the overall configuration of a plant monitoring device F according to the sixth embodiment of the present invention.
This plant monitoring apparatus F is characterized in that online monitoring information and association information are stored in a DB (database) and a search function of the DB is added to the plant monitoring apparatus D according to the fourth embodiment shown in FIG. is there.

That is, the plant monitoring apparatus F is configured as shown in FIG.
The online information storage unit 28a and the association storage unit 28
b, online database (hereinafter referred to as DB) 6,
It is characterized in that a plant information search means 5 having an association information DB 8, an information search means 51 and an online information search means 52, and a search condition input means 48 are provided.

That is, the online information storage means 28a
Stores the online information from the online information monitoring means 21 in the online DB by the online information storage means 28a.
6 is stored. Further, the association storage unit 28
b stores the association information from the association calculating means 22 in the association information DB 8.

The online information and the association information stored in the online DB 6 and the association information DB 8 can be obtained by inputting necessary search conditions by a manual input operation of the search condition input means 48 provided in the multimedia display means 4. The information retrieval means 51 and the online information retrieval means 52 retrieve and extract the online information and the association information meeting the retrieval conditions, and display the retrieved information on the multimedia display means 4 by the association plant information processing means 3. After the display or output data is created, it is displayed on the online information display means 41.

Therefore, according to the plant monitoring apparatus E, the online information can be accumulated and the accumulated information can be searched, so that the plant can be monitored in real time and information such as accidents and abnormalities of the plant can be monitored later. , It is possible to reproduce or analyze the accident, abnormality, or similar accident.

FIG. 14 is a block diagram showing the overall configuration of a plant monitoring device G according to a seventh embodiment of the present invention.
This plant monitoring device G is characterized in that the plant monitoring device F according to the sixth embodiment is configured to use plant image information and measurement information as on-line information taken into it.

That is, the plant monitoring apparatus G includes a video input device 13 such as a visible light or infrared monitoring camera or a digital still camera, a video input means 14 for capturing the video information, a current and a voltage of the plant device. Measuring equipment 1 such as a measuring instrument for measuring the flow rate, a flow rate system, or a detector for detecting the opening / closing or opening degree of a switchgear.
5 and measurement information input means 1 for taking in the measurement information
6 and a plant information associating means 2.

The plant information associating means 2 includes a video monitoring means 23 for monitoring the plant with the video thereof, a measurement information monitoring means 24 for monitoring the measurement information, and video information or measurement by the monitoring means 23 and 24. As a result of monitoring the information, when a change in the state of the plant or an abnormality is detected, the information is accepted as an event, and association calculating means 22g for associating information related to the event,
Video storage means 29 for storing video information in video DB 61
An associating means 28b for accumulating the associating information in the associating information DB 8;
Measurement information storage means 2 to be stored in B (database) 62
8c.

Further, the plant information search means 5 includes a video search means 53 for searching the video DB 62 for a video in the online information which matches the search condition input from the search condition input means 48 provided in the multimedia display means 4. The measurement information search unit 54 searches the measurement information DB 62 for the measurement information, and the information search unit 51 searches the association information DB for the association information.

The association plant information processing means 3 processes the association information retrieved by the plant information retrieval means 5 to create an association information processing procedure, and a video retrieved according to the association information processing procedure. It is composed of an associative image processing means 33 for executing the information processing procedure to create image display data, and an associative measurement information processing means 34 for creating display data of the retrieved measurement information.

FIG. 15 is a block diagram showing the structure of the video storage means 29. The video storage unit 29 performs an initialization process and a video information change process from the video input source information from the video monitoring unit 23. The video storage pre-processing unit 291 adds the additional information to the video if the video has additional information. on the other hand,
Video information adding means 293 which does nothing if there is no additional information
And a video DB storage processing unit 292 for storing information in the video DB 61.

FIG. 16 is a block diagram showing the structure of the image storage pre-processing means 291. Image storage pre-processing means 29
Reference numeral 1 denotes a video input source specifying unit 291 for specifying a video input source.
1, initialization means 2912 for outputting initialization information, and video source information changing means 2913 for outputting change information.

FIG. 17 is a block diagram showing the structure of the video DB 61. This video DB 61 stores the video management set 6
11 and a video set 612. Further, each video management set 611 is composed of a plurality of video management elements 6111. Each of these video management elements 6111 is configured as shown in FIG. Each video management element 6111 includes, for example, a business office name, a device type list, a device ID list, a pointer to a video element, and a shooting time.

On the other hand, the video set 612 is composed of a plurality of video elements 6121. Each video element 6121 further includes a time-series video management set 61211 and a time-series video set 6
1212. This time-series video set 61212
Are further composed of a plurality of time-series video elements 612121. The time-series video element 612111 is configured as shown in FIG. Time-series video element 612121
Has an ID, a time, a pointer to an individual video element, various types of data, a camera, and video information.

FIG. 20 is a block diagram showing the structure of the video search means 53 shown in FIG. This video search means 53
Are video search condition analysis means 531 and video DB search means 5
32, and a video synthesizing and editing means 533.

Next, the plant monitoring device G according to the present embodiment
The operation of will be described.

[0110] The video information from the plant is taken in by the plant information input means 1 and given to the video monitoring means 23, where it is monitored. The video input source information from the video monitoring unit 23 is input by the input source specifying unit 2911 of the video storage pre-processing unit 291 shown in FIG. 16, and the video input thereto is information from a new camera or information on newly photographing equipment. If it is determined that the video data is present, the initialization means 2912 performs initialization processing for creating new video data, that is, FIG.
A video management element 6111 indicated by 7 is created. Further, regarding the change of the resolution of the camera, the image source information changing means 29
13 by creating a time-series video management element 612111.

The video DB storage processing means 292 shown in FIG.
Now, the video management element 6111 and the time-series video management element 612
111, the corresponding video element 6
121 and a time-series video element 612121 are created, and the video sent from the video information adding unit 293 is stored in the newly created time-series video element 612121.

In the case of this embodiment, the video information adding means 293 transfers the video data to the video DB storage means 292 without doing anything.

Next, the time-series video element 6121 shown in FIG.
A method for creating the 21 will be described.

The image management element 6111 has the management element I
D, a link to the video element 6121, and initialization information (ID of the facility that is taking the image, camera information, date and time of creation, etc.). The video element 6121 is information for managing a video in time series, and includes a time-series element ID, a time, and an individual video element 612.
The information includes a link to 121, data type (whether it is video data or additional information), shooting information (resolution, frame rate, shooting equipment, camera information), and the like. The video information is added to the individual video element 612121.

Next, the event detection by the video monitoring means 23 using video monitoring will be described.

Here, for example, it is assumed that a lightning strike occurs on a certain device in the plant, and a device abnormality occurs.

An image of a lightning strike of a device can be detected by the image processing means 234 shown in FIG. 6 by pattern matching by matching a standard pattern with an input pattern. This detection result is output to the image change detection unit 233.
As a result, an abnormality (lightning strike) occurs in which equipment, and the shape of the equipment changed after the lightning strike is detected, and an event is generated.

The content of the event includes the type of the event (lightning strike), the specified device, the time at which the abnormality was detected, and, for the event at which the abnormality was detected, the value of the device at the time the event occurred and a link to the video. And store it in the association information DB 8 shown in FIG.

Next, the operation of information retrieval of each of the DBs 8, 61 and 62 will be described.

First, information search conditions are input by manual operation input of the detection condition input means 48 of the multimedia display means 4 shown in FIG. The search conditions include, for example, the following search methods.

[Outside 4]

The display attributes of the search result are shown below.

[Outside 5]

These search conditions are input to search condition input means 48.
And given to the information search means 51 of the plant information search means 5, where the search conditions are analyzed and searched.

In the information search means 51, for example, when a lightning strike by video is set as a search condition, an association DB
8 is searched to obtain a list of applicable items, and this list is displayed on the multimedia display means 4 by the search condition input means 48.

According to the item selected by the operator from the list, the information retrieval means 51 transmits the association information and the display attribute to the association information processing means 31, and also transmits the image information associated with the selected item to the image retrieval means. 53, and associates the result with the video processing means 33
Send to

The related measurement information is retrieved from the measurement information DB 62 by the measurement information retrieval means 53 and transmitted to the association measurement information processing means 34.

Next, a case where a video is retrieved from the video DB 61 based on the configuration diagram of the video retrieval means 53 of FIG. 20 will be described.

The search condition input by the search condition input means 48 is analyzed by the video search condition analysis means 531.
The search conditions of the video DB 61 and the conditions for synthesizing and editing the video (high-speed playback by dropping frames, only videos with scene changes,
And the like, and the DB search condition is the video DB search means 53
2. If the video 61 is searched by the method 2, if there is an editing condition, the searched video is synthesized and edited by the video synthesizing / editing means 533 so that the video can be processed at high speed by the associated video processing means 33 and the video display means 42. Synthesize according to the conditions,
Search results. If there is no editing condition, the search result of the video DB 61 is set as the search result.

Since the display operation based on the association information and thereafter are already described, the description will be omitted.

Therefore, according to the plant monitoring apparatus G of the present embodiment, online information such as video and measurement information can be stored in association with each other, and online information such as video and measurement information can be transmitted at high speed based on the association information. Searchable.

FIG. 21 is a block diagram showing the overall configuration of a plant monitoring device H according to the eighth embodiment of the present invention.
This plant monitoring device H is characterized in that the plant monitoring device G shown in FIG. 14 is configured to use the sound information and the measurement information of the plant as the online information taken into it. That is, the plant monitoring device H
The video information is replaced with sound information. The video input device 13, the video input unit 14, the video monitoring unit 23, the video storage unit 29, the video DB 61, the video search unit 53, and the association Video processing means 3
3. The video display means 42 includes the sound information input device 17, the sound information input means 18, the sound information monitoring means 25, and the sound information storage means 2.
8d, the sound information DB 63, the sound information search means 55, the associated sound information processing means 35, and the sound information output means 44.

Therefore, according to the plant monitoring apparatus H, each DB 63,
The sound information and the measuring means can be searched at high speed based on the association information.

FIG. 22 is a block diagram showing the overall configuration of a plant monitoring apparatus I according to the ninth embodiment of the present invention.
This plant monitoring device I omits the association storage means 28b and the association information DB 8 in the plant monitoring device F according to the sixth embodiment shown in FIG.
By providing a function to add related information related to the monitoring result to the online information itself, and a function to accumulate and search the added related information, the plant can be monitored in real time and a plant accident can be performed using the related information. It is characterized in that analysis and reproduction of abnormalities are possible.

FIG. 23 is a block diagram showing the overall configuration of a plant monitoring apparatus J according to the tenth embodiment of the present invention. This plant monitoring apparatus J is provided with a function of adding association information to video information as online information, a storage function of the added video information, and a search function to the plant monitoring apparatus G shown in FIG. In addition to monitoring, it is characterized in that it is possible to analyze and reproduce plant accidents and abnormalities using related information.

That is, the plant monitoring device J
In the plant monitoring device G, the association DB 8 and the association storage unit 28b are deleted, and the video addition unit 27 and the video separation unit 37 are added to the association synchronization unit 38. Video adding means 27 using MPEG
While adding the association information to the user data area specified by the MPEG data,
The image separation means 37 separates the additional data into video information and association information, and the association synchronization means 38 performs processing such as display of other measurement information in synchronization with the MPEG data.

The plant monitoring apparatus K shown in FIG. 24 is different from the plant monitoring apparatus J shown in FIG. 23 in that the measurement information adding means 27a for adding the association information to the measurement information, and Is characterized in that a new measurement information separating means 39 for separating the association information is newly provided.
23 are the same as those of the plant monitoring apparatus J shown in FIG. 23 except for the parts a and 39 and parts related thereto, and therefore the plant monitoring apparatus K will be described below with reference to FIG.

The plant monitoring apparatus K is composed of a plant information input unit 1 composed of a video input device 13, a video input unit 14, a measuring device 15, and a measurement information input unit 16, an association calculation unit 22k, a video monitoring unit 23, a measurement information monitoring unit 24, a video addition unit 27, a video storage unit 29, and a plant information association unit 2 including a measurement information storage unit 28c.

Further, the plant monitoring device K is connected to the image DB 6
Online DB that consists of 1 and measurement information DB62
And plant information search means 3 comprising information search means 51, video search means 53 and measurement information search means 54
Having.

Further, there is provided an association plant information processing means 3 comprising an image separation means 37, an association image processing means 33, an association information processing means 31, and an association measurement information processing means.

Further, it is provided with a multimedia display means 4 comprising a video display means 42, a measurement information display means 43, and a search condition input means 48.

FIG. 25 is a block diagram of the video adding means 27. FIG. 26 shows a bit stream configuration of an MPEG video which is a format of a video input to the video adding means 27. In other words, MPEG includes an MP for video.
There are two types of encoding: EG video and MPEG audio for audio. In addition, MPEG has MPE according to the purpose.
There are G-1, MPEG-2, and MPEG-4 standards. In the present embodiment, for example, MPEG-1 and MPEG-2 are assumed.

The MPEG data is hierarchized as shown in FIG. 26, and is composed of a sequence layer, a GOP layer, a picture layer, a slice layer, and a macro block layer. The sequence is an MPEG video, and the GOP is “Group Of Picture”.
s "is an abbreviation for pictures representing one frame of video. For example, by forming a GOP for each scene, coding efficiency can be improved.

A slice indicates a frame by a horizontally long band-like area. Even if an error occurs in the slice, synchronization can be achieved at the beginning of the next slice layer.

The user data can be added to the sequence header which is the first data of the sequence layer, the GOP header which is the first data of the GOP layer, and the end of the picture header which is the first header of the picture layer.

As shown in FIG. 25, the MPEG video adding means 27 includes an MPEG video determining means 271, a sequence header user data setting means 272, a GOP header user data setting plan 273, and a picture header user data setting means. 274.

FIG. 27 shows the structure of the video DB 61 when the video format is MPEG. The configuration of the video DB 61 is substantially the same as the configuration of the video DB 61 shown in FIG. 17, but in FIG. 27, each time-series video element 612121 includes a header (sequence header + GOP header) H, a picture P, and a footer (sequence end). F is different from that of FIG.

Next, the plant monitoring device J of the present embodiment,
The operation of K will be described.

The video from the video input device 13 is MPEG-compressed by the video input means 14, and the sequence header, GO
The data is provided to the video monitoring means 23 in units of a P header, a picture, and a sequence end.

The video monitoring means 23 supplies all the video information to the video adding means 27, and performs video monitoring based on the video information by the video change detecting means 233 and the image processing means 234 shown in FIG. Performed by

On the other hand, the video adding means 27 executes the processing program shown in the flowchart of FIG. In FIG. 28, S1 to S10 indicate each step of the flowchart. When the video adding means 27 starts this processing program, first, in S1, it waits for input of video data from the video monitoring means 23, and in S2, determines whether or not the video data is finished.
es, that is, when the data is over, this program is ended. No, that is, when there is video data, S3
Fetches video data from the video monitoring means 23. Next S
In step 4, it is determined whether or not there is association information from the association calculation unit 22. If Yes, that is, if it is determined that there is, the association information is fetched in step S5 in the association calculation unit 22 or S9 described below. After S5, in S6, S7, and S8, the MPEG video determining unit 271 determines whether the MPEG video is included in the sequence header, the GOP header, the picture header, the picture, or the sequence end. If it is included in the sequence header, it is determined by the user data setting means 272 of the sequence header. If it is included in the GOP header, it is determined by the user data setting means 273 of the GOP header. While the data setting means 274 adds the association information to the user data, respectively, if No in S6 to S8,
The process proceeds to S9, where the association information is temporarily stored. If there is no header in the input video data, information is set in the next video data. After this, S again
Returning to step 5, repeat the following steps. In S4, N
In the case of o, the process proceeds to S10, where it is provided to the video storage means 29 as an MPEG video, and thereafter, S5 and subsequent steps are repeated.
However, in the case of real-time monitoring of the embodiment without the video DB 61, the MPEG video is simultaneously provided to the video information processing means 33. The picture or slice is provided to the video storage means 29 as it is.

An MPEG video is composed of one sequence header, a plurality of GOPs, and the last sequence end. User data or information can be added next to the sequence header, for example, in units of 8 bytes. GO
P is composed of a GOP header and a plurality of pictures,
Next to the GOP header, user data or information, for example, 8
Can be added in byte units.

A picture is one frame of data composed of a picture header and a plurality of slices. User data or information can be added next to the picture header, for example, in units of 8 bytes.

Next, the operation of processing the MPEG video in which the correlation information is added to the user data area by the correlation video processing means 33 will be described.

Upon receiving the MPEG video, the associated video processing means 33 performs processing corresponding to the sequence layer (for example, processing such as setting of resolution, pixel aspect ratio, picture ratio, quantization matrix, etc.) and processing corresponding to the GOP layer. (For example, time stamp processing), and processing corresponding to a picture layer (processing such as motion vector processing, image display order processing within a GOP, and picture encoding). When performing data analysis for performing these processes, user data is extracted, and the extracted user data is provided to the video separating unit 37.

The video separating means 37 extracts the association information from the user data and gives it to the association information processing 31.

The associating information processing 31 creates a processing procedure for the video and measurement information processing means 33 and 34 in accordance with the associating information input here. At this time, when the video information and the measurement information are synchronized and, for example, the values of the system diagram and the trend graph are changed and displayed in synchronization with the reproduction of the image, the timing information for updating the system diagram and the trend graph is displayed. Is created as a processing procedure by the subject connection synchronization means 38 shown in FIG.

For example, the synchronization means 38 shown in FIG. 23 looks at the playback direction of the video, that is, the time information sent from the video, and if the playback is in the reverse direction, displays a trend graph or a system diagram. A processing procedure for displaying data in the opposite direction to the information processing means 34 is created.

Therefore, according to the present embodiment, it is possible to add the association information to the online information such as the video information and accumulate the information in the database while searching it. For this reason, it is possible to monitor the plant in real time, search for information on plant accidents and abnormalities later, and synchronize the video information and the measurement information to display the related information on the multimedia display means 4. In addition, it is possible to reproduce and analyze plant accidents and abnormalities or similar accidents.

FIG. 29 is a block diagram showing the overall configuration of a plant monitoring device L according to the twelfth embodiment of the present invention. This plant monitoring device L is a storage-type plant monitoring device that adds association information to sound information and measurement information,
24, the video input device 13, the video input unit 14, the video monitoring unit 23, the video addition unit 27, the video storage unit 29, the video DB 61, the video search unit 53, the video separation unit 37, and the associated video processing in the plant monitoring apparatus K shown in FIG. Means 3
3. The video display means 42 includes the sound information input device 17, the sound information input means 18, the sound information monitoring means 25, and the sound information storage means 2.
8d, a sound information adding unit 27b, a sound information DB 62, a sound information searching unit 55, a sound information separating unit 3a, an associated sound information processing unit 35, and a sound information output unit 44.

Therefore, according to the plant monitoring apparatus L, the sound information and the measurement information can be associated with the information, and the information can be stored in the database while being searched. For this reason, it is possible to monitor the plant in real time, search for information on plant accidents and abnormalities, etc. later, synchronize the sound information and the measurement information, and display the related information on the Mamelchi media display means 41. Can be.

FIG. 30 is a block diagram showing the overall configuration of a plant monitoring device M according to the thirteenth embodiment of the present invention. The plant monitoring device M has a function of associating the plant monitoring device A according to the first embodiment shown in FIG. 1 with offline information such as facility management information of a plant, documents, design drawings, and maintenance information and online information. The feature is that a function of displaying the offline information is provided.

That is, the plant monitoring device M is provided with the plant monitoring device A shown in FIG. 1 and maintenance information such as a design drawing of a plant device, a manufacturing date, a rated value, and maintenance inspection information.
Off-line DB 7 for storing off-line information such as documents such as accident histories and instruction manuals, and association calculating means for calculating which on-line information is to be associated with which off-line information according to preset conditions 22m; an offline information associating means 2f for searching the offline DB 7 for information to be associated with the offline information; an associating offline information processing means 3m for analyzing the associated information to create display data for displaying the offline information; Offline information display means 47 for displaying offline information from the associated offline information processing means 3m is provided.

Next, the operation of the plant monitoring device M will be described.

The plant online information input from the plant information related input means 1 is transmitted to the online information monitoring means 2.
1 and is monitored here, and when a state change or abnormality of the plant is detected, the monitoring result is provided as an event to the association means 22m.

In the association calculating means 22m, the association is calculated according to a preset condition as to which online information is associated with which offline information and at what time, and the association information is obtained. The offline information associated with this association information is obtained by searching the offline DB 7 by the offline information association means 2f, and is associated with the online information by a plant equipment name or the like.

The associated information is analyzed by the association information processing means 31 and a processing procedure for displaying it on the multimedia display means 4 is required. When displaying the offline information, this processing procedure is given to the associated offline information processing means 3m. Here, the offline DB 7 is searched according to this processing procedure, and related offline display data is created. The information is given to the information display means 47 and displayed.

Therefore, according to the plant monitoring apparatus M, since the offline information can be associated with the online information, the related offline information can be retrieved from the offline DB 7 at high speed in accordance with the online information, and the multimedia display means 4 can be used. Can be displayed.

FIG. 31 is a block diagram showing the entire configuration of a plant monitoring device N according to a fourteenth embodiment of the present invention. In this plant monitoring device N, the plant information input unit 1 of the plant monitoring device A according to the first embodiment shown in FIG. 1 is configured by a video input device 13, a video input unit 13, and a video input device control unit 19, and The plant associating means 2 comprises a video monitoring means 23, an association calculating means 22n, and an image input control means 2g, and is characterized in that the multimedia display means 4 includes an image input changing means 49.

FIG. 32 is a block diagram showing the structure of the video input control means 2g. The video input control means 2g includes a video input change request receiving means 2g1 for receiving a video input change request from the video input change means 49 of the multimedia display means 4, a video input change analysis means 2g2, a video input source information input means 2g3, and a video. Input changing means 2g4, video input source information changing means 2g5, video input device changing means 2g
6. Event analysis means 2g7.

Next, in this plant monitoring device N,
An operation in a case where an operator changes, for example, a video input of the online information input to the plant information input means 1 will be described.

The operator operates the online information display means 4
1 while watching the display or the like being displayed on the display unit 1.
To input a request to change the image by panning, tilting, or zooming the camera that is capturing the image being displayed.

The video input change request is given to the video input control means 2g and analyzed. That is, in the video input control means 2g, the video input change request from the video input change means 49 is accepted by the video input change accepting means 2g1, and the video input change analysis means 2g2 further inputs the video input change request by the video input source information input means 2g3. By inputting video input source information by searching for information, selection of a camera corresponding to the video input change request and calculation of image quality are calculated. The calculation result is provided to the video input changing means 2g4, where the video input source information changing means 2g5 prepares a request for updating the video input source information and is provided to the video information monitoring means 23, and the video input device changing means 2g6 To transmit image input control information (operation information such as pan, tilde, and zoom of the image input device) to the image input device control means 19.

The video input device control means 19 controls the video input device 13 (changes the direction and zoom of the camera, etc.) and controls the video input means 14 (controls the selection of the video input signal and the resolution, etc.). Make input changes.

Next, the operation in the case where it is necessary to automatically switch the input image when the image monitoring means 23 detects a plant abnormality will be described.

When the video monitoring means 23 discovers a plant abnormality or the like, the event information from the video monitoring means 23 is received by the event analysis means 2g7 of the video input control means 2g, where the event contents are analyzed and the plant abnormality is detected. The video input change analysis means 2g2 is given a request to display, for example, high-resolution and high-resolution equipment or apparatus in which is found.

For example, when the event analysis means 2g7 receives the event of "abnormal appearance of the insulator of the circuit breaker", the event analysis means 2g7 analyzes the image input change analysis request for "projecting the insulator of the circuit breaker with high quality". Give to means 2g2. The video input change analysis means 2g2 searches the video input source information input means 2g3 for camera information showing the insulator of the circuit breaker or information about a camera which can show the insulator, and the search result Provides camera switching information to the video input changing means 2g4.
In the video input changing means 2g4, the video input source information changing means 2g5 updates the video input source DB 232 and transmits control information for switching to information from the camera that has obtained the video to the video input device control means 19, and transmits the control information to the video input device control means 19. The following control is performed for the video input device 13.

Therefore, according to the plant monitoring device N, the image of the plant input to the image input device 11 or the image input means 14 can be changed by the image input change request from the operator. It can be changed automatically by the event from 23.

FIG. 33 is a block diagram showing the overall configuration of a plant monitoring apparatus O according to the fifteenth embodiment of the present invention. This plant monitoring apparatus O is characterized in that it is configured to monitor a plurality of remote plants at one control station.

That is, when each of the plant monitoring apparatuses A to N obtains monitoring information necessary for remotely monitoring a plant from a control station, the plant monitoring apparatus O uses a known distributed network processing means. There is a characteristic in that it is performed. That is, the plant monitoring apparatus O provides the plant information input unit 1, the plant information association unit 2, and the output-side distributed network processing unit 9a on the plant side where the plant is installed, and inputs the control information to the control station that remotely monitors the plant. Side distributed network processing means 9
b, it is characterized in that the associated plant information processing means 3 and the multimedia display means 4 are provided.

The two distributed network processing means 9a, 9
b includes a name conversion means 91 and a distributed access means 92, respectively. The access request of a plant to be accessed from the distributed access means 92 of the input-side distributed network processing means 9b on the control center side is sent to the name conversion means 91 by the name conversion means 91. And sends it to the output-side distributed network processing means 9a on the plant side. Then, the output-side distributed network processing means 9a on the plant side obtains information necessary for remote monitoring from a database (not shown) in accordance with the access request, and transmits the information to the input-side distributed network processing means 9b on the control center side. In the input-side distributed network processing means 9b on the control station side, the information input here is given to the associating plant information processing means 4, and display data to be displayed on the multimedia 4 is created. The information (online information) and the association information are displayed by the multimedia display means 4 and presented to the operator.

FIG. 34 is a block diagram showing an overall configuration of a plant monitoring apparatus P according to a sixteenth embodiment of the present invention. The plant monitoring apparatus P changes the associated plant information processing means 3 from the control station to the plant side in the plant monitoring apparatus O, and the control station side mainly displays the plant information by the multimedia display means 4, and the control station side displays the plant information. The feature is that only the man-machine control for indicating information to the operator is performed.

FIG. 35 shows the structure of the associating plant information processing means 3 of the plant monitoring devices O and P, which is associated with the associating online information processing means 32 shown in FIG.
The association information processing means 31 is provided with an association synchronization means 38 shown in FIG. According to the plant monitoring device O, a plurality of remote plants can be monitored by one control station. Also, since you can access plant information by name,
It is possible to hide information on where the plant information is, where it should be obtained, and where it needs to be sent. For this reason, each module can perform processing independent of the distribution mode. In the above embodiments, the suffixes a to n of the codes of the association calculation means 22a to 22n are changed according to the type of online information to be handled, for example, video, measurement sound information, and the like. They are common in the basic function of seeking information.

[0182]

As described above, according to the present invention,
Since the plant information indicating the status of the plant to be remotely monitored can be associated with each other online, it is possible to quickly search and display information necessary for plant monitoring, reproduce the status, and the like.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an overall configuration of a plant monitoring device according to a first embodiment of the present invention.

FIG. 2 is a block diagram showing a configuration of an association calculating unit shown in FIG.

FIG. 3 is a diagram showing a configuration of association information output from an association calculation unit shown in FIG. 1;

FIG. 4 is a partial information definition DB of the association information shown in FIG.
The figure which shows a part of data of FIG.

FIG. 5 is a block diagram showing an overall configuration of a plant monitoring device according to a second embodiment of the present invention.

FIG. 6 is a block diagram showing a configuration of a video monitoring unit shown in FIG. 5;

FIG. 7 is a block diagram showing a configuration of an association information processing unit shown in FIG. 5;

FIG. 8 is a diagram showing an example of a configuration of a processing procedure given to an associated video processing unit from the association information processing unit shown in FIG. 5;

FIG. 9 is a block diagram showing a configuration of an associative video processing unit shown in FIG. 5;

FIG. 10 is a block diagram showing an overall configuration of a plant monitoring device according to a third embodiment of the present invention.

FIG. 11 is a block diagram showing an overall configuration of a plant monitoring device according to a fourth embodiment of the present invention.

FIG. 12 is a block diagram showing an overall configuration of a plant monitoring device according to a fifth embodiment of the present invention.

FIG. 13 is a block diagram showing an overall configuration of a plant monitoring device according to a sixth embodiment of the present invention.

FIG. 14 is a block diagram showing an overall configuration of a plant monitoring device according to a seventh embodiment of the present invention.

FIG. 15 is a block diagram illustrating a configuration of a video storage unit illustrated in FIG. 14;

FIG. 16 is a block diagram showing a configuration of a video storage pre-processing unit shown in FIG. 14;

FIG. 17 is a diagram showing a configuration of a video DB shown in FIG. 14;

FIG. 18 is a diagram showing a configuration of a video management element shown in FIG.

FIG. 19 is a diagram showing the configuration of the time-series video element shown in FIG.

FIG. 20 is a block diagram showing the configuration of the video search means shown in FIG.

FIG. 21 is a block diagram showing an overall configuration of a plant monitoring device according to an eighth embodiment of the present invention.

FIG. 22 is a block diagram showing an overall configuration of a plant monitoring device according to a ninth embodiment of the present invention.

FIG. 23 is a block diagram showing an overall configuration of a plant monitoring device according to a tenth embodiment of the present invention.

FIG. 24 is a block diagram showing an overall configuration of a plant monitoring device according to an eleventh embodiment of the present invention.

FIG. 25 is a block diagram showing a configuration of a video adding unit shown in FIG. 24;

26 is an MPEG bit stream configuration diagram of video information used by the video adding unit shown in FIG. 24.

FIG. 27 is a view showing the configuration of the MPEG video DB shown in FIG. 24.

FIG. 28 is a flowchart of a processing program of a video adding unit shown in FIG. 24;

FIG. 29 is a block diagram showing an overall configuration of a plant monitoring device according to a twelfth embodiment of the present invention.

FIG. 30 is a block diagram showing an overall configuration of a plant monitoring device according to a thirteenth embodiment of the present invention.

FIG. 31 is a block diagram showing an overall configuration of a plant monitoring device according to a fourteenth embodiment of the present invention.

FIG. 32 is a block diagram showing the configuration of the video input control means shown in FIG. 31.

FIG. 33 is a block diagram showing an overall configuration of a plant monitoring device according to a fifteenth embodiment of the present invention.

FIG. 34 is a block diagram showing an overall configuration of a plant monitoring device according to a sixteenth embodiment of the present invention.

FIG. 35 is a block diagram showing the configuration of the association plant information processing means shown in FIG. 33 or FIG.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 Plant information input means 2 Plant information associating means 2g Video input control means 2g1 Video input change request receiving means 2g2 Video input change analysis means 2g3 Video input source information input means 2g4 Video input change means 2g5 Video input source information change means 2g6 Video input Device changing means 3 Association plant information processing means 3a Sound information separation means 3b Association offline information processing means 4 Multimedia display means 5 Plant information search means 6 Online DB 7 Offline DB 8 Association DB 9a, 9b Input / output side distributed network processing means 11 Online information input device 12 Online information input means 13 Video input device 14 Video input means 15 Measurement device 16 Measurement information input means 17 Sound information input device 18 Sound information input means 19 Video input device control means 21 Online IN information monitoring means 22a, 22b, 22c, 22d, 22e, 22f, 2
2g, 22h, 22i, 22j, 22k, 221, 22
m, 22n Association calculation means 23 Video monitoring means 24 Measurement information monitoring means 25 Sound information monitoring means 26 Online information addition means 27 Video addition means 27a, 27c Measurement information addition means 27b Sound information addition means 28a Online information storage means 28b Association storage means 28c Measurement information storage means 28d Sound information storage means 29 Video storage means 31 Association information processing means 32 Association online information processing means 33 Association video processing means 34 Association measurement information processing means 35 Association sound information processing means 36 Online information separation means 37 Video separation Means 38 Association synchronization means 39 Measurement information separation means 41 Online information display means 42 Video display means 43 Measurement information display means 44 Sound information display means 47 Offline information display means 51 Information search means 52 ON In information search means 53 Video search means 54 Measurement information search means 55 Sound information search means 58 Search condition input means 59 Video input change means 61 Video DB 62 Measurement information DB 63 Sound information DB 91 Name conversion means 92 Distributed access means 221 Event input Means 222 Event analysis means 223 Association information calculation means 224 Information definition DB 225 Association information creation means 226 Association information transmission means 231 Video creation means 232 Video input source DB 233 Video change detection means 234 Image processing means 271 MPEG video determination means 272 Sequence header User data setting means 273 GOP header user data setting means 274 picture header user data setting means 291 video storage preprocessing means 292 video DB storage processing means 293 video information addition means 311 Association information analysis means 312 Association information separation means 313 Processing procedure creation means 314 Related processing execution means 331 Video reception means 332 Video holding means 333 Video processing procedure analysis execution means 334 Display control means 531 Video search condition analysis means 532 Video DB search means 533 Video composition / editing means 611 Video management set 612 Video set A, B, C, D, E, F, G, H, I, J, K, L,
M, N, O, P Plant monitoring device

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Ryuji Wakizono 1 Toshiba-cho, Fuchu-shi, Tokyo Inside the Toshiba Fuchu factory (72) Inventor Takehiko 1 Toshiba-cho, Fuchu-shi, Tokyo Inside the Fuchu factory, Toshiba (72) Inventor Ryuji Tanaka 1 Toshiba-cho, Fuchu-shi, Tokyo Inside the Fuchu plant, Toshiba Corporation (72) Inventor Kuniaki Suzuki 1-1-1, Shibaura, Minato-ku, Tokyo Inside the Toshiba head office (72) Invention Person Junichi Shinohara 1 Toshiba-cho, Fuchu-shi, Tokyo F-term in the Fuchu Plant of Toshiba Corporation 5H223 AA02 DD03 DD07 DD09 EE06 FF03

Claims (14)

[Claims] 1. An online information input device for inputting plant information on a plant online, an online information input device having online information input device for inputting online information from the online information input device, and online information from the online information input device -Information monitoring means for monitoring abnormalities and status changes of a plant by monitoring data and plant information associating means having associative calculating means for associating information for associating online information related to a monitoring result from the on-line information monitoring means And an associating information processing means for creating a processing procedure for displaying or outputting the monitoring result and related information related to the monitoring result from the associating information from the associating calculating means, and a processing procedure from the associating information processing means. Executing the above-mentioned monitoring result and the related information thereof. The associating plant information processing means having an associating online information processing means for creating display data for displaying or outputting the related information; and displaying the display data from the associating online information processing means. A plant monitoring device, comprising: multimedia display output means having online information display means for displaying or outputting. 2. An on-line information input device for inputting plant information on a plant online, an on-line information input device having on-line information input device for inputting on-line information from the on-line information input device, and on-line information from the on-line information input device Information monitoring means for monitoring abnormalities and status changes of the plant by monitoring the information, association calculating means for obtaining association information for associating the monitoring result from the online information monitoring means with the online information, and information associated with the online information A plant information associating means having an online information adding means for adding online information and online information separating means for separating online information and associated information from the additional information from the online information adding means; An association information processing means for creating a processing procedure for displaying or outputting the monitoring result and related information related to the result from the association information separated by the line information separation means, and a processing procedure from the association information processing means. An associating plant information processing means having an associating online information processing means for executing and creating display data for associating and displaying or outputting the relevant information; and displaying or outputting display or output data from the associating plant information means. A plant monitoring device, comprising: multimedia display means having online information display means. 3. The plant monitoring apparatus according to claim 1, wherein: an online database for storing online information; and an online information storage unit for storing the monitoring result from the online information monitoring unit and the online information in the online database. An association information database for accumulating association information; an association storage means for accumulating association information from an association calculation means in the association information database; and a search condition for retrieving information from each of the above-mentioned databases. A search condition input unit, a plant information search unit that searches information that matches the search condition input to the search condition input unit from each of the databases, and provides the search information to an associated plant information processing unit that includes the search information in display data; Equipped with A plant monitoring device characterized by the above-mentioned. 4. The plant monitoring apparatus according to claim 1, wherein an off-line database for storing information on the plant off-line and a processing procedure from the association information processing means are executed to search for the off-line information from the off-line database. A plant monitoring system comprising: an associated offline information processing means for creating display data for displaying or outputting offline information; and an offline information display means for displaying offline related information from the offline information processing means. apparatus. 5. A video input device for capturing an image of a plant, a video input device for capturing video information from the video input device, a measurement device for measuring a plant, and a measurement information input device for capturing measurement information from the measurement device. A plant information input unit, a video monitoring unit that monitors the video information from the video input unit to detect a plant abnormality or a state change, and monitors the measurement information from the measurement information input unit to detect a plant abnormality or status. Plant information associating means having measurement information monitoring means for detecting a change, and these images, association calculating means for associating information for associating measurement information with video information related to each monitoring result from the measurement information monitoring means; From the association information from the association calculation means, the above monitoring result and the relation Association information processing means for creating a video information processing procedure and a measurement information processing procedure for displaying video information and related measurement information, and displaying the monitoring result and its related video information by executing the video information processing procedure Associated plant information having associated image processing means for creating image display data and associated measurement information processing means for executing measurement information processing procedure and creating measurement information display data for displaying the monitoring result and its associated measurement information Processing means; and video display means for displaying the video information display data from the association online information processing means, and multimedia display means having measurement information display means for displaying the measurement information display data. And plant monitoring equipment. 6. The plant monitoring apparatus according to claim 5, wherein: video addition means for adding video information from the video information monitoring means to the association information from the association calculation means; and video information from the additional information from the video addition means. And a video separating unit that separates the association information from the association information and provides the association information to the association video processing unit. 7. The plant monitoring apparatus according to claim 6, wherein: a video database for storing video information; a video storage means for storing the monitoring result and video information from the video monitoring means in the video database; A measurement information database to be accumulated; a measurement information accumulation means for accumulating monitoring results and measurement information from the measurement information monitoring means in the measurement information database; and a search condition for retrieving information from each of the above databases. Search condition input means for searching, and information matching the search condition input to the search condition input means, from each of the databases, and plant information search means for providing the search information to the associated plant information processing means to include the search information in display data And a plant monitoring device. 8. An image input device for inputting an image of a plant, an image input device for inputting image information from the image input device, a measuring device for measuring the plant, and a measurement information input device for inputting measurement information from the measuring device. Plant information input means having; a video monitoring means for monitoring video information from the video input means to detect a plant abnormality or status change; and a plant abnormality or status by monitoring measurement information from the measurement information input means. Measurement information monitoring means for detecting a change, and association calculation means for obtaining association information for associating video information, measurement information, or video information with measurement information from monitoring results from each of these monitoring means, and this association calculation Video adding means for adding the association information from the means to the area of the video information which can be set by the user Measurement information adding means for adding the association information from the additional information from the image addition means and the image information to the image database, and adding the association information from the association calculation means to a user-settable area of the measurement information and the measurement information A plant information associating means having a measurement information storage means for accumulating the measurement information with the association information of the additional information from the information adding means, and a search condition for searching information from each of the databases. A search condition input means for inputting, and a plant which searches information corresponding to the search condition input to the search condition input means from each of the databases, and includes the search information in display data, and provides the search information to the associated plant information processing means. Information retrieval means, and additional information from the video adding means. Separation means for separating the association information and the video information from the report, the association information processing means for creating a processing procedure for displaying the video information and the measurement information respectively from the association information separated by the video separation means, and the video information Associated video processing means for creating video display data for displaying video information by executing a processing procedure and associated measurement information processing means for creating measurement information display data for displaying measurement information by executing the above measurement information processing procedure Having a relation plant information processing means, a video information display means for displaying video information display data from the relation video processing means, and a measurement information display means for displaying measurement information display data from the correlation measurement information processing means. A plan comprising media display means. Monitoring device. 9. The plant monitoring device according to claim 1, wherein the image input device controls the image input device so as to control the image input of the plant input thereto. Video input control means for controlling video input by the plant information input means including the video input device control means based on at least one of the monitoring result from the video monitoring means and the association information from the association information processing means. A plant monitoring device characterized by the above-mentioned. 10. A sound information input device for taking in the sound of a plant, a sound information input means for taking in sound information from the sound information input device, a measuring device for measuring a plant, and measurement information for taking in measurement information from the measuring device. A plant information input means having an input means, a sound information monitoring means for monitoring the sound information from the sound information input means to detect a plant abnormality or a state change, and a measurement information from the measurement information input means. Measurement information monitoring means for detecting abnormalities and state changes of the plant, and associated calculation means for obtaining association information for associating measurement information with sound information related to each monitoring result from the measurement information monitoring means. Plant information associating means, and the monitoring result and the result obtained from the associating information from the associating calculating means. An associative information processing means for creating a sound information processing procedure and a measurement information processing procedure for respectively outputting the related sound information and the related measurement information, and executing the sound information processing procedure from the associating information processing means to perform the monitoring. Associated sound information processing means for generating sound information output data for outputting a result and its related sound information, and a measurement information display for displaying the monitoring result and its related measurement information by executing the measurement information processing procedure Associating plant information processing means having associated measurement information processing means for creating data; sound information output means for outputting the sound information output data; and multimedia display means having measurement information display means for displaying the measurement information display data. , A plant monitoring device. 11. The plant monitoring apparatus according to claim 10, wherein: a sound information database for storing sound information; and a sound information storage means for storing monitoring results from the sound information monitoring means and sound information in the sound information database. A measurement information database that stores measurement information; a measurement information storage unit that stores monitoring results from the measurement information monitoring unit and measurement information in the measurement information database; an association information database that stores association information; An association accumulating unit for accumulating association information between the sound information and the measurement information from the association calculation unit; a search condition input unit for setting and inputting search conditions for searching information from each of the databases; From the above databases, information that matches the search conditions entered in the search condition input means And search extract, plant monitoring apparatus comprising: the plant information retrieval means for providing association plant information processing means for including the search information to the display data. 12. The plant monitoring apparatus according to claim 11, wherein the sound information adding unit adds sound information from the sound information monitoring unit to the association information from the association calculating unit; A measurement information adding unit that adds measurement information from the measurement information monitoring unit; a sound information separation unit that separates sound information and association information from the additional information from the measurement information addition unit; and an addition from the sound information addition unit. A measurement information separating unit for separating measurement information and association information from the information; a sound information monitoring result from the association information separated by the sound information separation unit; and a related sound information related to the result and the measurement information. The sound information processing procedure is created, and the measurement information monitoring result and the measurement information monitoring result are obtained from the association information separated by the measurement information separation means. Associated information processing means for creating a measurement information processing procedure for displaying related measurement information related to the result and sound information, and creating output data for outputting the sound information by executing the sound information processing procedure A plant monitoring apparatus comprising: an association sound information processing unit; and an association measurement information processing unit that executes the measurement information processing procedure to create display data for displaying measurement information. 13. The plant monitoring apparatus according to claim 1, wherein plant information of a plant that matches the search request from a plurality of plants is named from the plant information associating means or the associating plant information processing means. Output network processing means having distributed access means and name conversion means for converting the name obtained by the above, and plant information related by receiving the information of the plant from the output distributed network processing means and associating plant information processing means An input-side decentralized network processing means for causing the multimedia display means to display or output them in association with each other. 14. The plant monitoring apparatus according to claim 1, wherein a plurality of pieces of related information including video, sound, and measurement information are synchronized with each other to be displayed or output on multimedia display means. A plant monitoring device comprising: a synchronization unit.