JP2019087156A - Measurement value reading system, measurement value reading device and measurement value reading method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To propose an inexpensive measured value reading system, a measured value reading device and a measured value reading method capable of accurately reading the measured value indicated by a pointer of a state indicator made of an analog meter. SOLUTION: At least two markers are arranged around a status display made of an analog meter, and the markers and the status display are based on each marker in a captured image based on a captured signal obtained by photographing the marker and the status indicator. The image of the status indicator in the captured image is converted into an image captured from the front by correcting the three-dimensional tilt, and the status indicator in the captured image corrected for the three-dimensional tilt. Based on the image, the numerical value indicated by the pointer of the status indicator was read. [Selection diagram] Fig. 8

Description

  The present invention relates to a measured value reading system, a measured value reading device and a measured value reading method, and a state indicator for displaying measured values and states of plant equipment such as current, voltage or electric energy with a pointer The present invention is suitably applied to a measurement value reading device for reading the measurement value of a status indicator comprising a meter.

  Conventionally, in a large scale facility such as a factory or a thermal power plant, a status indicator for displaying the status of the plant facility is photographed by a photographing device such as a video camera, and the plant facility is displayed based on the photographed condition indicator. Methods for monitoring the state are widely used.

  In relation to such a monitoring method, for example, Patent Document 1 discloses a method of arranging a marker around a state indicator, and extracting a display area of the state indicator in a photographed image based on the marker. It is done.

  Further, Non-Patent Document 2 discloses a method of installing a dedicated fixed camera for each facility, setting and fixing a shooting environment, shooting at the same angle, and converting an analog indicator value into a digital value. ing.

Japanese Patent Application Laid-Open No. 2002-056387

“FUJITSU Software Imagepower Analog Meter Recognizer V2 (V02L02)”, [online], Fujitsu Ltd. [searched on October 30, 2017], Internet <https://www.fujitsu.com/jp/Images/AnalogMeterRecognizerV2. pdf>

  By the way, in Patent Document 1, no consideration is given to the case where the state indicator is in a three-dimensionally inclined state with respect to the photographing device. However, when the state indicator is in a three-dimensionally inclined state with respect to the imaging device, there is a problem that the measurement value indicated by the pointer of the state indicator in the photographed image can not be accurately read.

  Further, according to the invention disclosed in Non-Patent Document 1, it is necessary to install a fixed camera for each status indicator, and there is a problem that a large number of installation needs are required.

  The present invention has been made in consideration of the above points, and provides an inexpensive measurement value reading system, a measurement value reading device, and a measurement value reading method capable of accurately reading the measurement value indicated by the pointer of the status indicator comprising an analog meter. I will try to propose.

  In order to solve such problems, in the present invention, at least two markers disposed around the state indicator in a measurement value reading system for reading the value of the measurement value indicated by the pointer of the state indicator comprising an analog meter; A portable measurement value reading device, the measurement value reading device including a camera unit for photographing the marker and the state indicator, and a photographed image based on a photographing signal output from the camera unit; An image conversion unit configured to correct an image of the state indicator in the captured image based on each of the markers and convert the state indicator into a photographed image from straight front by correcting a three-dimensional inclination; A measurement value reading unit for reading a numerical value indicated by a pointer of the status display based on the image of the status display in the photographed image in which the three-dimensional inclination has been corrected by the It was to prepare for the.

  Further, in the present invention, in the measurement value reading device for reading the value of the measurement value indicated by the pointer of the status indicator comprising an analog meter, at least two markers are arranged around the status indicator, the marker and the status indicator Three-dimensionally tilt the image of the state indicator in the photographed image based on the camera unit for photographing the camera and each of the markers in the photographed image based on the photographing signal output from the camera unit An image conversion unit that corrects the state indicator into an image photographed directly from the front, and an image of the state indicator in the photographed image in which the three-dimensional inclination has been corrected by the image converter And a measurement value reading unit for reading the numerical value indicated by the pointer of the status indicator.

  Further, according to the present invention, there is provided a measurement value reading method carried out in a measurement value reading device for reading the value of a measurement value indicated by a pointer of a status indicator consisting of an analog meter, comprising at least two markers around the status indicator. Are arranged, and based on each of the markers in the captured image based on the marker and the captured signal obtained by capturing the status indicator, the image of the status display in the captured image is three-dimensionally The first step of correcting any tilt and converting the status display into an image shot straight ahead, and the image of the status display in the captured image with the three-dimensional tilt corrected. The second step of reading the numerical value indicated by the pointer of the status indicator is provided.

  According to the present measurement value reading system, the measurement value reading device, and the measurement value reading method, it is not necessary to prepare the present reading device for each status indicator, and the three-dimensional inclination of the status indicator with respect to the photographing direction is corrected. Since the numerical value indicated by the pointer of the status indicator is read above, the numerical value can be accurately read.

  According to the present invention, it is possible to realize an inexpensive measurement value reading system, a measurement value reading device, and a measurement value reading method that can accurately read the measurement value indicated by the pointer of the status indicator.

It is a block diagram which shows the simple hardware constitutions of the measurement value reader by this Embodiment. It is a front view provided for explanation of a status indicator and a marker. It is a block diagram showing the logical composition of the measured value reading device by this embodiment. FIG. 6 is a schematic diagram serving to explain a first character. (A) and (B) are the perspective view and front view which are used for description of the three-dimensional inclination of a picked-up image. (A) is a front view for explaining the second and third characters, and (B) is a front view for explaining a modified example. (A) is xy coordinates which serve to explain the normal range overlapping part, (B) is a chart showing a normal range management table. It is a front view which shows the example of a display of a synthetic | combination image. (A) is xy coordinates for explaining the measurement value reading unit, and (B) is a chart showing a reading standard management table. (A) and (B) are a conceptual diagram and xy coordinates which serve to explain the photographing position calculation unit. It is a flowchart which shows the process sequence of an image conversion process. FIG. 8 is a front view for describing the processing content of the image conversion processing. FIG. 8 is a front view for describing the processing content of the image conversion processing.

  An embodiment of the present invention will now be described in detail with reference to the drawings.

(1) Configuration of Measured Value Reading Device According to Present Embodiment In FIG. 1, 1 indicates the measured value reading device according to the present embodiment as a whole. The measurement value reader 1 is a device used by an operator to read a measurement value indicated by a pointer of a status indicator installed in a plant facility, and is, for example, a portable type having a photographing function such as a tablet or a smartphone. It consists of a computer device.

  The measurement value reading device 1 includes hardware such as a CPU (Central Processing Unit) 2, a memory 3, a camera module 4, an input device 5, and a display device 6. The CPU 2 is a processor that controls the operation of the entire measurement value reading device 1. The memory 3 is formed of, for example, a non-volatile semiconductor memory, and is used to hold various programs and various data. The CPU 2 executes the program stored in the memory 3 to execute various processes as a whole of the measurement value reading device 1 as described later.

  The camera module 4 is a module in which a lens (not shown) and an optical sensor such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor are integrated. The projection image of the subject input to the surface is converted into an electrical signal, which is output as a photographing signal.

  The input device 5 includes, for example, a touch panel, a button, and the like, and is used by the user to input various operations. The display device 6 includes, for example, a liquid crystal panel or an organic EL (Electro-Luminescence) panel, and is used to display a moving image or a still image or necessary information based on a shooting signal output from the camera module 4 Be done.

(2) Measured Value Reading Function Next, the measured value reading function installed in the measured value reading device 1 will be described. In the following, it is assumed that the target status indicator is a pointer rotary analog meter, and the external shape of the status indicator viewed from the front is circular.

  The measurement value reading function takes a status indicator installed in a plant facility etc. by the operator using the measurement value reading device 1 and captures a measurement value indicated by the pointer of the condition indicator as a digital value by image processing. It is a function of acquiring and displaying the digital value on the display device 6 and storing the digital value in the memory 3 in association with the state indicator. In addition, although the image which an operator image | photographs at this time may be any of a moving image and a still image, it demonstrates as a moving image below.

  Here, in order to accurately acquire the measurement value indicated by the pointer of the status display, it is necessary to position the main measurement reading device 1 so as to face the front of the status display and then perform imaging. .

  However, the present measurement value reading device 1 is used so that a worker holds a hand and performs imaging. For this reason, depending on the worker's habit and surrounding conditions, it is not possible to shoot while the status indicator faces directly from the front, and the shooting direction of the present measurement value reader 1 (central axis of lens of camera module 4 In some cases, imaging may be performed with the status indicator three-dimensionally inclined with respect to the direction. In such a case, the measurement value reader 1 can not acquire an accurate measurement value indicated by the pointer of the status indicator.

  Therefore, in the measurement value reading device 1 according to the present embodiment, the three-dimensional inclination of the photographed image of the state indicator photographed by the operator is corrected, and the photographed image is photographed as if the state indicator was photographed from the front. A correction function is implemented as part of such a measurement reading function.

  As a means for realizing such a measurement value reading function, in the case of the present embodiment, as shown in FIG. 2, each target state indicator 10 is a square plate (hereinafter referred to as a template). Is fixed in a predetermined state.

  Specifically, since the size of the status indicator 10 is determined according to the standard for each type, an opening (not shown) having the same size and shape as the outer dimensions of the status indicator 10 is provided at the center of the template 11 The state indicator 10 is fitted and fixed in a state in which the vertical and horizontal directions of the template 11, the vertical and horizontal directions thereof, and the normal direction of the template 11 and the normal direction thereof coincide with each other with high accuracy. It is done.

  In the upper left end and the lower right end of the template 11, a QR code (registered trademark) obtained by converting the identification number of the state display 10 fixed to the template 11 into a QR code (registered trademark) is disposed as the marker 12 ing. In this case, as a method of arranging the marker 12, a method of directly printing the marker 12 on the template 11, a method of sticking a seal on which the marker 12 is printed, or the like can be applied.

  The size of each of the markers 12 is selected so that the ratio of the length of one side of the marker 12 to the diameter of the state indicator 10 is 1: 3. However, the ratio of the length of one side of the marker 12 to the diameter of the status indicator 10 may be a ratio other than 1: 3. Also in this case, calculation of the size of the marker 12 with respect to the state indicator 10 can be facilitated by setting the ratio of the length of one side of the marker 12 to the diameter of the state indicator 10 as an integer ratio.

  Furthermore, below the marker 12 at the upper left end of the template 11 and above the marker 12 at the lower right end, the identification number of the state display 10 fixed to the template 11 on which the marker 12 is arranged (marker 12 The identification number (the same number as the identification number recorded in the QR code (registered trademark)) 13 is displayed by printing or sticking the sticker on which the identification number 13 is printed. As a result, a worker or the like can visually identify the status indicator 10 based on the identification number 13.

  On the other hand, FIG. 3 shows the logical configuration of the measurement value reading device 1 according to the present embodiment. As shown in FIG. 3, in addition to the camera module 4 and the display device 6, the main measurement value reading device 1 measures a frame superimposing unit 20, an image converting unit 21, a normal range overlapping unit 22, an image combining unit 23, and The value reading unit 24 and the photographing position calculating unit 25 are provided.

  In the following, the frame superimposing unit 20, the image conversion unit 21, the normal range overlapping unit 22, the image combining unit 23, the measurement value reading unit 24, and the photographing position calculation unit 25 are stored in the memory 3 (FIG. 1). The corresponding program (not shown) will be described as a functional unit embodied by the CPU 2 executing the program. The frame superimposing unit 20, the image conversion unit 21, the normal range overlapping unit 22, and the image synthesis The unit 23, the measurement value reading unit 24, and the photographing position calculation unit 25 may be configured as hardware.

  As shown in FIG. 4, the frame superimposing unit 20 is a position where the image of the status display 10 should be displayed on the captured image on the captured image based on the captured signal output from the camera module 4 (the status display 10 A first display frame 31 for displaying the shooting position of the camera, and two marker frames 32 for displaying the positions (the shooting positions of the Is a functional unit having a function of performing signal processing for displaying the character 30 of

  In practice, the frame superimposing unit 20 superimposes the character signal for superimposing the first character 30 on the photographed image based on the photographed signal, on the photographed signal output from the camera module 4. The photographing signal (hereinafter referred to as a frame superimposed photographing signal) on which the character signal thus obtained is superimposed is transmitted to the image combining unit 23.

  In addition, in the case of the main measurement value reading device 1, a photographed image based on the frame superimposed photographing signal is displayed on the display device 6 as described later. As a result, in the present measurement value reading apparatus 1, as shown on the right side of FIG. 4, the operator in the photographed image, an area in the state indicator frame 31 (hereinafter referred to as a state indicator area) By photographing the state display 10 so that the state display 10 is positioned at each of the regions and each of the markers 12 corresponding to the area in each marker frame 32 (hereinafter referred to as a marker area) is positioned, The status indicator 10 can always be photographed in a constant state.

  Further, in the case of the present measurement value reading device 1, the frame superimposing unit 20 displays the first character 30 in red at the initial time, but as described above, the state display is made in the state indicator area in the state indicator frame 31. At the stage where the photographing position of the state display 10 is positioned on the photographed image so that the marker 10 is positioned and the markers 12 respectively corresponding to the marker areas in the marker frame 32 are positioned. Change the 30 display colors from red to green. As a result, it is possible for a worker who shoots the status display 10 to determine whether the shooting status of the status display 10 is appropriate based on the display color of the first character 30.

  When each image of the status indicator 10 and the marker 12 in the captured image is three-dimensionally inclined as shown in FIG. 5A, the image conversion unit 21 performs the entire captured image as shown in FIG. 5B. , And has an image conversion function of converting the status display 10 into an image taken so as to face the front from the front. The specific processing contents of such an image conversion unit 21 will be described later. Then, the image conversion unit 21 outputs the image data of the photographed image after the image conversion processing obtained in this manner to the normal range superposition unit 22 and the photographing position calculation unit 25 as a converted photographing signal.

  The normal range superimposing unit 22 corresponds to the second and third characters 33, as shown in FIG. 6A, corresponding to the state indicator 10 in the photographed image based on the converted photographed signal supplied from the image converting unit 21. A character signal for displaying 34 is generated.

  Here, the second character 33 is an arc shape that represents the variation range of the pointer 10A when the measurement value of the measurement object (current value, voltage value, pressure or temperature, etc.) corresponding to the state indicator 10 is normal. It has a shape and is displayed along the periphery of the status indicator 10 with a length corresponding to the corresponding position. The third character 34 is a semi-transparent fan indicating the variation range of the pointer when the measurement target of the status display 10 in the photographed image is in an abnormal state, and is fan-shaped having the same radius as the status display 10 It is superimposed on the status indicator 10 and displayed.

For this reason, as shown in FIG. 7A, the normal range superposition section 22 has a variation range of the pointer 10A when the measured value of the state indicator 10 is normal as shown in FIG. 7A. Are respectively given in advance as a range of angles (θ _{1 to} θ ₂ ) based on the positive direction of the x axis (horizontal direction) on the xy plane. Then, the normal range superimposing unit 22 registers and manages the angle range for each of the status indicators 10 in the normal range management table 26 shown in FIG. 7B stored in the memory 3 (FIG. 1).

  Then, when the converted imaging signal is given, the normal range overlapping unit 22 reads and reads the identification number recorded in the marker 12 (QR code (registered trademark)) in the captured image based on the converted imaging signal. A second character signal for reading out the normal angle range set for the identification number from the normal range management table 26, and displaying the second and third characters 33 and 34 according to the read angle range Generate Then, the normal range superposition unit 22 superimposes the generated second character signal on the converted photographing signal, and cuts out only the portion of the state indicator 10 in the converted photographing signal on which the second character signal is superimposed, and The image data is transmitted to the image combining unit 23 as a normal range superposition conversion shooting signal.

  The image combining unit 23 generates a combined image obtained by combining the image based on the frame superimposing imaging signal given from the frame superimposing unit 20 and the image based on the normal range superposition conversion imaging signal given from the normal range superposing unit 22. It is a functional unit having a function.

  In practice, as shown in FIG. 8, the image combining unit 23 is a first captured image obtained based on the frame superimposed image capturing signal (image in which the first character 30 (FIG. 4) is displayed superimposed on the captured image) Is placed on the left side of the screen, and a composite image 40 is placed on the right side of the screen with a second captured image (a captured image taken as if the status indicator 10 was faced straight from the front) obtained based on the normal range superposition conversion shooting signal. Generate Then, the image combining unit 23 transmits the image data of the combined image 40 generated in this manner to the display device 6. Thus, the composite image 40 is displayed on the display device 6 based on the image data.

  Note that the image combining unit 23 stores the image data of the second captured image based on the normal range superposition conversion shooting signal at a constant time interval (for example, every 0.5 seconds), as shown in FIG. 6A. Instead of the image of the display 10, the images of the state display 10 as shown in FIG. 6 (B) in which all the images of the state display 10 based on each image data of the stored second captured image are superimposed are synthesized It may be displayed on the right side of the image. By doing so, even if the pointer 10A of the status indicator 10 is violently shaken, it can be easily checked whether the measured value of the status indicator 10 is within the normal range.

  On the other hand, based on the position of the pointer 10A of the status display 10 in the captured image based on the converted captured signal supplied from the image conversion section 21, the measured value reading section 24 measures the measured value of the measurement target. It is a functional unit having a function of reading a value and digitizing it.

For this reason, as shown in FIG. 9A, the measurement value reading unit 24 of the pointer 10A in the case where the measurement value of the status indicator 10 is "0" as shown in FIG. 9A. and x-axis angle theta ₃ relative to the normal direction (horizontal direction) on the xy plane, the angle (hereinafter referred to as the reference angle) when the theta ₃ from pointer 10A is 1 ° rotated counterclockwise The amount of fluctuation (the amount of fluctuation per + 1 °) of the measurement value to be measured in the above is given in advance. The measurement value reading unit 24 registers and manages these pieces of information in the reading reference management table 27 shown in FIG. 9B stored in the memory 3 (FIG. 1).

Then, when the converted imaging signal is given, the measurement value reading unit 24 reads and reads the identification number recorded in the marker 12 (QR code (registered trademark)) in the captured image based on the converted imaging signal. a reference angle theta _3, which is set for an identification number, reads the variation of the measurement values of the measurement object when the pointer 10A is 1 ° rotated counterclockwise from read reference management table 27.

  Further, based on the read out information, the measurement value reading unit 24 calculates by image processing how many times the pointer 10A of the state indicator 10 is inclined in the counterclockwise direction from the reference angle, Based on the measurement value of the object to be measured by the status indicator 10 is acquired as a digital value. Then, the measured value reading unit 24 associates the digital value acquired in this manner with the identification number of the state display 10 and stores it in the measured result management table 28 (FIG. 3) stored in the memory 3 (FIG. 1). Store.

On the other hand, the shooting position calculation unit 25 is a functional unit having a function of estimating the position of the operator who is performing the shooting with respect to the status display 10 being shot at that time. Actually, in the case of the present embodiment, as shown in FIG. 10A, in the photographing position calculation unit 25, as described above, the image conversion unit 21 corrects the photographed image and the status indicator 10 from the front. calculated upon execution of the captured image conversion processing for converting the image as against the slope angle of the operator at this time is from the normal n ₁ shooting direction of the status indicator 10 taken its status indicator 10 θ ₄ is given to the photographing position calculation unit 25. The photographing position calculation unit 25 also receives a photographing signal output from the camera module 4 (FIG. 3).

As shown in FIG. 10B, the photographing position calculation unit 25 performs photographing based on the size of the state indicator 10 included in the photographed image based on the photographing signal from the camera module 4. The center of the display surface of the state indicator 10 is calculated based on the calculated distance and the inclination angle θ ₄ given by the image conversion unit, while calculating the distance L ₁ from the state indicator 10 of the worker. The photographing position ((x ₁ , y ₁ ) of FIG. 10B) of the operator on the xy plane which is the origin O is calculated. Then, the photographing position calculation unit 25 stores the photographing position of the worker thus calculated in association with the identification number of the state display 10 in the measurement result management table 28 (FIG. 3).

(3) Processing of Image Conversion Unit FIG. 11 shows the flow of image conversion processing performed by the image conversion unit 21 (FIG. 3) described above. In this case, the image conversion unit 21 first causes the status display unit 10 to be positioned in the status display area within the status display frame 31 (FIG. 4) when the operator photographs the status display 10, and each marker When the imaging direction of the measurement value reading device 1 is positioned so that the markers 12 respectively corresponding to the marker areas in the frame 32 (FIG. 4) are positioned, a known method such as affine method or projection method is used Then, the photographed image of each of the markers 12 respectively displayed in the two marker areas is converted into an image of the markers 12 viewed from the front (S1).

Specifically, as shown in FIG. 12, the image conversion unit 21 displays cutout symbols (finders displayed at three corners of each of the markers 12 displayed in the two marker frame bodies 32 described above, respectively). utilizing the pattern) 12A - 12C, it becomes the upper right and upper left of each cut symbol 12A, the length _{L 2} between 12B, the upper left and lower left of each cut symbol 12B, the length _{L 3} and the same length between 12C as such, and the upper right and upper left of each cut symbol 12A, a virtual line K1 connecting the 12B, the upper left and lower left of each cut symbol 12B, the angle formed with virtual line K ₂ is connecting the 12C theta _The captured image based on the imaging signal is corrected so that ₁₀ is at right angles.

As a result, as shown in FIG. 13A, the photographed image of each of the markers 12 displayed in each of the marker areas in each of the marker frame bodies 32 becomes an imaging direction D ₁ (camera from a state where the central axis direction) with respect to the direction of the normal line n ₂ of the lens module 4 is inclined three-dimensionally as shown in FIG. 13 (B), the photographing direction D where the direction of such normal n ₂ is applied It is converted to an image corrected to be parallel to ₁ .

  Although the image conversion unit 21 can not recognize the marker frame 32 superimposed and displayed on the captured image, the state indicator 10 is displayed in the state indicator area in the state indicator frame 31 (FIG. 4). When the imaging direction of the measurement value reader 1 is positioned such that the image of the marker 12 is positioned so that the image of the marker 12 is positioned and the image of the marker 12 respectively corresponding to the marker area in each marker frame 32 (FIG. 4) It is given and recognized in advance at which position in the screen the above-mentioned two marker frames 32 are displayed. Further, in the image conversion unit 21, the marker display color switching signal to that effect is the frame weight at the timing when the display color of the status display frame 31 and the two marker frames 32 is switched from red to green as described above. It is given from the folding unit 20 (see FIG. 3).

  Thus, the image conversion unit 21 receives the image information of each area (each marker area) where each marker frame 32 in the captured image will be displayed at the timing when the marker display color switching signal is given. The image conversion processing as described above is performed based on the three extracted symbols 12A to 12C for each of the extracted markers 12 which respectively acquire and extract three extracted symbols 12A to 12C for each marker 12 based on the acquired image information Run.

  Subsequently, the image conversion unit 21 reads the recorded contents of each marker 12 which would be displayed in each marker frame 32 in the photographed video converted as described above (S2). It is determined whether the contents of the two markers 12 are the same (S3).

  When the image conversion unit 21 obtains a negative result in this determination, it instructs the image combining unit 23 (FIG. 3) to generate a predetermined error message (hereinafter referred to as an error message display instruction). (S4). Thus, the image combining unit 23 to which the error message display instruction is given displays the error message at a predetermined position on the combined image 40 described above with reference to FIG. Then, the image conversion unit 21 ends this image conversion processing.

On the other hand, when the image conversion unit 21 obtains a positive result in the determination of step S3, the surface of the two markers 12 present in the captured image and the display surface of the state indicator 10 (the pointer 10A Photographing displayed in an area (hereinafter referred to as a state indicator area) in the state indicator frame 31 in which the image of the state indicator 10 is displayed based on the positional relationship with the rotating surface) A three-dimensional reconstruction process of the image is executed (S5). Specifically, as shown in FIG. 13B, the image conversion unit 21 normals n ₂ of the surface of the two markers 12 corrected in step S ₁ and normal n ₁ of the display surface of the state indicator 10 The photographed image in the state indicator area is corrected so that X is parallel (S5). Then, the image conversion unit 21 ends this image conversion processing.

(4) Effects of the Present Embodiment As described above, the present measurement value reading device 1 corrects the three-dimensional inclination of the state indicator 10 included in the captured image, and then the pointer 10A of the state indicator 10 is corrected. Read the indicated measurement value. Therefore, according to the present measurement value reading device 1, it is possible to accurately read the measurement value indicated by the pointer 10A of the status display 10. Further, since the present measurement value reading device 1 is configured to be portable, it is not necessary to prepare the present measurement value reading device 1 for each state indicator 10, and accordingly, such measurement values can be read inexpensively. .

  Therefore, according to the present measurement value reading device 1, it is possible to realize a measurement value reading device which can accurately and inexpensively read the measurement value indicated by the pointer 10A of the state indicator 10.

(5) Other Embodiments In the above-described embodiment, the case where the template 11 (FIG. 2) to which the status indicator 10 is fixed is configured in a square shape has been described, but the present invention is not limited thereto. However, the template 11 may be configured in a rectangular shape.

  In the above embodiment, the case where two markers 12 are arranged in the template 11 has been described, but the present invention is not limited to this and three or more markers 12 may be arranged in the template 11 May be

  Furthermore, in the above-mentioned embodiment, although the case where QR Code (registered trademark) was applied as marker 12 was described, the present invention is not limited to this, in short, the cutout symbol of QR Code (registered trademark) Various other forms of markers can be widely applied as such a marker 12 as long as it has a form having at least three or more reference marks corresponding to.

  Furthermore, in the above embodiment, the case where the identification number of the corresponding status indicator 10 is recorded in the marker 12 has been described, but the present invention is not limited to this, and the identification number of the status indicator 10 may be used. Alternatively or additionally, other information may be recorded on the marker 12.

  Furthermore, in the above-described embodiment, while the first character 30 (FIG. 4) is displayed in red at the initial time, the display color is displayed when the imaging position of the state indicator 10 in the photographed image is positioned in a predetermined state. However, the present invention is not limited to this, and the display color and the display form other than this may be widely applied as the display color and the display form of the first character 30. Can.

  The present invention can be applied to a measurement value reading apparatus for reading the measurement values of a status indicator consisting of a pointer-rotating analog meter.

  DESCRIPTION OF SYMBOLS 1 ...... Measurement value reading device, 2 ...... CPU, 3 ...... Memory, 4 ...... Camera module, 6 ...... Display device, 10 ...... Status indicator, 10A ...... pointer, 11 ...... Template, 12 ...... Marker 13 13 identification number 20 frame superimposing portion 21 image converting portion 22 normal range overlapping portion 23 image combining portion 24 measurement value reading portion 25 photographing Position calculation unit, 30 ... 1st character, 31 ... Frame for status indicator, 32 ... Frame for marker, 33 ... 2nd character, 34 ... 3rd character, 40 ... Composite image .

Claims (9)

In a measurement value reading system for reading the value of the measurement value indicated by the pointer of the status indicator consisting of an analog meter,
At least two markers disposed around the status indicator;
A portable measurement reading device, and
The measurement reading device
A camera unit for photographing the marker and the status indicator;
Based on each of the markers in the captured image based on the captured signal output from the camera unit, the image of the status display in the captured image is three-dimensionally corrected to make the status display face straight An image conversion unit that converts the image taken from the
Providing a measurement value reading unit for reading a numerical value indicated by a pointer of the state indicator based on the image of the state indicator in the photographed image in which the three-dimensional inclination is corrected by the image conversion unit; Characteristic reading system. The markers are each provided with at least three fiducial marks,
The image conversion unit
The measurement value reading system according to claim 1, wherein the three-dimensional inclination of the image of the state indicator in the photographed image is corrected based on each reference mark of each of the markers. The measurement value reading system according to claim 2, wherein each of the markers is a QR code. The measurement reading device
A composite image is generated by combining the photographed image based on the photographing signal output from the camera unit and the image of the state indicator whose three-dimensional inclination has been corrected by the image conversion unit into two screens. An image synthesis unit,
The measurement value reading system according to claim 1, further comprising: a display device that displays the composite image. A first character having a first frame representing a shooting position of the status indicator, and a plurality of second frames respectively provided corresponding to the markers and representing the shooting positions of the markers. A frame superimposing unit that superimposes the image on the captured image;
The image combining unit
The combined image is generated by combining the photographed image on which the first character is superimposed and the image of the state indicator whose three-dimensional inclination has been corrected by the image conversion unit on two screens. The measurement value reading system according to claim 4. In the vicinity of the state indicator in the image of the state indicator in which the three-dimensional inclination is corrected by the image conversion unit, the variation of the pointer of the state indicator when the measurement target of the state indicator is normal A normal range overlapping unit for overlapping a second character representing the range;
The image combining unit
The photographed image based on the photographed signal output from the camera unit, and the image of the state indicator on which the three-dimensional inclination is corrected by the image conversion unit and the second character is superimposed The measurement value reading system according to claim 4, wherein the synthesized image synthesized on a screen is generated. The normal range overlapping unit is
The variation range of the pointer of the state indicator when the measurement target of the state indicator is abnormal on the state indicator in the image of the state indicator whose three-dimensional inclination is corrected by the image conversion unit Superimpose a translucent third character representing
The image combining unit
An image of the state display on which the three-dimensional tilt is corrected by the image conversion unit and the second and third characters are superimposed by the captured image based on the imaging signal output from the camera unit The measurement value reading system according to claim 6, characterized in that the composite image is generated by combining and into two screens. In a measurement value reading apparatus for reading the value of the measurement value indicated by the pointer of the status indicator comprising an analog meter,
At least two markers are arranged around the status indicator,
A camera unit for photographing the marker and the status indicator;
Based on each of the markers in the captured image based on the captured signal output from the camera unit, the image of the status display in the captured image is three-dimensionally corrected to make the status display face straight An image conversion unit that converts the image taken from the
And a measurement value reading unit for reading a numerical value indicated by a pointer of the state indicator based on the image of the state indicator in the photographed image on which the three-dimensional inclination has been corrected by the image conversion unit. A measurement value reading device characterized by A measurement value reading method executed in a measurement value reading apparatus for reading the value of a measurement value indicated by a pointer of a status indicator comprising an analog meter, comprising:
At least two markers are arranged around the status indicator,
Based on each marker in the captured image based on the marker and the captured signal obtained by capturing the status display, the image of the status display in the captured image is corrected for three-dimensional inclination A first step of converting the status indicator into an image taken directly from the front,
Reading the numerical value indicated by the pointer of the state indicator based on the image of the state indicator in the photographed image in which the three-dimensional inclination has been corrected; and reading the measured value Method.