JP2022077942A - Reading method of indicated value of measurement device and management server, reading system of indicated value of measurement device, and program - Google Patents

Abstract

An object of the present invention is to provide a method for reading a meter indication value that can improve reading accuracy even in situations where the meter indication value is difficult to read normally due to the installation angle of the meter or outdoors. [Solution] A step of setting a flight path along which the flying object moves, a step of moving the flying object to a predetermined photographing point based on the flight path, and a step of setting a plurality of different photographing angles for a plurality of instruments at the predetermined photographing point. and a step of continuously photographing at the shooting position to obtain a plurality of instrument images; a step of selecting an instrument image from which the indicated value of each instrument can be read from the plurality of instrument images; Analyzing the instrument identification information from the affixed two-dimensional code and reading the indicated value of each instrument; and a reading result generation unit associating the analyzed instrument identification information with the read instrument's indicated value, respectively. and generating a reading result of each meter. [Selection diagram] Figure 6

Description

The present invention relates to an instrument reading method and a management server, an instrument reading system, and a program.

Conventionally, research and development have been conducted on a technique for capturing an analog display type instrument such as a control panel or a meter, reading the measured value from the captured image, and digitizing the measured value. However, there may be cases where the captured image is not the captured result from an angle at which the measured value of the instrument can be easily read due to external factors or the like. As a technique corresponding to this, for example, Patent Document 1 discloses a technique for correcting a reading value based on the shape of a marker shown in a captured image.

Japanese Unexamined Patent Publication No. 2019-204238

However, in the disclosed technique of Patent Document 1, it is premised that a plurality of instruments are arranged side by side with the same direction as the front, but in an actual site, the plurality of instruments are close to each other with the different directions as the front. May be located in. Therefore, it may not be possible to deal with it only by the markers shown in the captured image.

Furthermore, in the case of outdoors, the measured value is read even from the same set position due to external factors (for example, sunlight reflected on the glass plate of the instrument, dust flying by the wind, insects, etc.). It can be difficult.

In recent years, flying objects (hereinafter collectively referred to as "flying objects") such as drones and unmanned aerial vehicles (UAVs) have begun to be used in industry for reading instruments using the flying objects. The optimum system for this is desired.

The present invention has been made in view of such a background, and it is possible to improve the reading accuracy even in a situation where it is difficult to read the indicated value of the instrument normally due to the installation angle of the instrument or an external factor such as outdoors. It is an object of the present invention to provide an instrument reading method, a management server, an instrument reading system, and a program.

The main invention of the present invention for solving the above-mentioned problems is an instrument reading method for reading readings of readings of a plurality of instruments using a flying object, and a flight path in which the flying object moves by a flight path setting unit. A step of moving the flying object to a predetermined shooting point based on the flight path by the flight path movement control unit, and a step of moving the flying object to a predetermined shooting point by the flight path movement control unit, and the shooting operation control unit for the plurality of instruments at the predetermined shooting point. A step of continuously shooting at a plurality of different shooting angles and shooting positions to acquire a plurality of instrument images, and a step of selecting an instrument image capable of reading the indicated value of each instrument from the plurality of instrument images by the image filtering unit. The image reading unit analyzes the instrument identification information from the two-dimensional code attached to each instrument in the selected instrument image, and the reading result generation unit performs the step of reading the indicated value of each instrument. It is an instrument instruction reading method, comprising the step of associating the analyzed identification information of an instrument with the reading of the read instrument and generating it as a reading result of each instrument.

According to the present invention, an instrument reading method and a management server that can improve reading accuracy even in a situation where it is difficult to read the reading of the measuring instrument normally due to an external factor such as the installation angle of the measuring instrument or outdoors. , Instrument reading reading system, can be provided.

It is a figure which shows the structure of the management system which concerns on embodiment of this invention. It is a block diagram which shows the hardware configuration of the management server of FIG. It is a block diagram which shows the hardware composition of the user terminal of FIG. It is a block diagram which shows the hardware composition of the flying object of FIG. It is a block diagram which shows the function of the management server of FIG. It is a flowchart of the instrument reading value reading method which concerns on embodiment of this invention. It is a figure which shows an example of the flight path which concerns on embodiment of this invention. It is a figure which shows an example of the imaging point which concerns on embodiment of this invention. It is a figure which shows an example of the photographing method which concerns on embodiment of this invention. It is a figure which shows another example of the photographing method which concerns on embodiment of this invention. It is a figure which shows an example of the instrument image by continuous photographing which concerns on embodiment of this invention. It is a figure which shows an example of the selective instrument image which concerns on embodiment of this invention.

The contents of the embodiments of the present invention will be described in a list. The instrument reading method, management server, instrument reading system, and program according to the embodiment of the present invention have the following configurations.
[Item 1]
It is an instrument reading method that reads the readings of multiple instruments using an air vehicle.
The step of setting the flight path to which the flying object moves by the flight path setting unit, and
A step of moving the flying object to a predetermined shooting point based on the flight path by the flight path movement control unit, and
A step of continuously shooting a plurality of instruments at a plurality of different shooting angles and shooting positions at the predetermined shooting point by the shooting operation control unit and acquiring a plurality of instrument images.
A step of selecting an instrument image capable of reading the indicated value of each instrument from the plurality of instrument images by the image filtering unit, and
The image reading unit analyzes the instrument identification information from the two-dimensional code attached to each instrument in the selected instrument image, and reads the indicated value of each instrument.
The reading result generation unit includes a step of associating the identified information of the analyzed instrument with the indicated value of the read instrument and generating the reading result of each instrument.
An instrument indication reading method characterized by this.
[Item 2]
The instrument instruction reading method according to item 1.
The two-dimensional code is an ArUco code.
An instrument indication reading method characterized by this.
[Item 3]
The instrument instruction reading method according to any one of items 1 or 2.
The step of acquiring the plurality of images is
Take each instrument so that it is included in at least two instrument images,
An instrument indication reading method characterized by this.
[Item 4]
The instrument instruction reading method according to any one of items 1 to 3.
The step generated as the reading result is
According to a predetermined association rule, one instrument identification information and an indication value indicated by an instrument based on a plurality of indication values are associated with each other.
An instrument indication reading method characterized by this.
[Item 5]
The instrument instruction reading method according to any one of items 1 to 4.
If multiple instrument images contain the first instrument
The predetermined association rule defines two-dimensional coordinates for each instrument image including the first instrument, and the first instrument image in which the position of the first instrument in the instrument image is close to the center coordinates. It is a rule that the value indicated by one instrument is associated with the indicated value of the first instrument.
An instrument indication reading method characterized by this.
[Item 6]
The instrument instruction reading method according to any one of items 1 to 4.
If multiple instrument images contain a second instrument
As the predetermined association rule, shape correction is performed on the second instrument in each instrument image including the second instrument, and a value indicated by the second instrument having a small correction amount of the shape correction is used. It is a rule to associate as the indicated value of the second instrument.
An instrument indication reading method characterized by this.
[Item 7]
A management server that uses an aircraft to read readings from multiple instruments.
A flight path setting unit that sets a flight path for the flying object to move, and a flight path setting unit.
A flight path movement control unit that moves the flying object to a predetermined shooting point based on the flight path,
A shooting operation control unit that continuously shoots a plurality of instruments at a plurality of different shooting angles and positions at the predetermined shooting point and acquires a plurality of instrument images.
An image filtering unit that selects an instrument image that can read the indicated value of each instrument from the plurality of instrument images, and an image filtering unit.
An image reading unit that analyzes the instrument identification information from the two-dimensional code attached to each instrument in the selected instrument image and reads the indicated value of each instrument.
It includes a reading result generation unit that associates the identified information of the analyzed instrument with the indicated value of the read instrument and generates the reading result of each instrument.
A management server that features that.
[Item 8]
An instrument reading system that uses an aircraft to read readings from multiple instruments.
A flight path setting unit that sets a flight path for the flying object to move, and a flight path setting unit.
A flight path movement control unit that moves the flying object to a predetermined shooting point based on the flight path,
A shooting operation control unit that continuously shoots a plurality of instruments at a plurality of different shooting angles and positions at the predetermined shooting point and acquires a plurality of instrument images.
An image filtering unit that selects an instrument image that can read the indicated value of each instrument from the plurality of instrument images, and an image filtering unit.
An image reading unit that analyzes the instrument identification information from the two-dimensional code attached to each instrument in the selected instrument image and reads the indicated value of each instrument.
It includes a reading result generation unit that associates the identified information of the analyzed instrument with the indicated value of the read instrument and generates the reading result of each instrument.
An instrument reading system characterized by this.
[Item 9]
A program that causes a computer to execute an instrument reading method that reads readings of multiple instruments using an aircraft.
The method for reading the indicated value of the instrument is
The step of setting the flight path to which the flying object moves by the flight path setting unit, and
A step of moving the flying object to a predetermined shooting point based on the flight path by the flight path movement control unit, and
A step of continuously shooting a plurality of instruments at a plurality of different shooting angles and shooting positions at the predetermined shooting point by the shooting operation control unit and acquiring a plurality of instrument images.
A step of selecting an instrument image capable of reading the indicated value of each instrument from the plurality of instrument images by the image filtering unit, and
The image reading unit analyzes the instrument identification information from the two-dimensional code attached to each instrument in the selected instrument image, and reads the indicated value of each instrument.
The reading result generation unit includes a step of associating the identified information of the analyzed instrument with the indicated value of the read instrument and generating the reading result of each instrument.
A program characterized by that.

<Details of the embodiment>
Hereinafter, embodiments of the instrument reading value reading method, management server, instrument reading system, and program according to the embodiment of the present invention will be described. In the accompanying drawings, the same or similar elements are designated by the same or similar reference numerals and names, and duplicate description of the same or similar elements may be omitted in the description of each embodiment. In addition, the features shown in each embodiment can be applied to other embodiments as long as they do not contradict each other.

<Structure>
As shown in FIG. 1, the management system in the present embodiment includes a management server 1, one or more user terminals 2, and one or more flying objects 4. The management server 1, the user terminal 2, and the flying object 4 are connected to each other so as to be able to communicate with each other via a network.

<Management server 1>
FIG. 2 is a diagram showing a hardware configuration of the management server 1. The configuration shown in the figure is an example, and may have other configurations.

As shown in the figure, the management server 1 is connected to the user terminal 2 and the flying object 4 to form a part of the system. The management server 1 may be a general-purpose computer such as a workstation or a personal computer, or may be logically realized by cloud computing.

The management server 1 includes at least a processor 10, a memory 11, a storage 12, a transmission / reception unit 13, an input / output unit 14, and the like, and these are electrically connected to each other through a bus 15.

The processor 10 is an arithmetic unit that controls the operation of the entire management server 1, controls the transmission and reception of data between each element, and performs information processing necessary for application execution and authentication processing. For example, the processor 10 is a CPU (Central Processing Unit) and / or a GPU (Graphics Processing Unit), and executes each information processing by executing a program or the like for the system stored in the storage 12 and expanded in the memory 11. ..

The memory 11 includes a main storage configured by a volatile storage device such as a DRAM (Dynamic Random Access Memory) and an auxiliary storage configured by a non-volatile storage device such as a flash memory or an HDD (Hard Disk Drive). .. The memory 11 is used as a work area of the processor 10, and also stores a BIOS (Basic Input / Output System), a UEFI (Unified Extensible Firmware Interface), various setting information, and the like, which are executed when the management server 1 is started.

The storage 12 stores various programs such as application programs. A database storing data used for each process may be built in the storage 12.

The transmission / reception unit 13 connects the management server 1 to the network and the blockchain network. The transmission / reception unit 13 may be provided with a short-range communication interface of Bluetooth (registered trademark) and BLE (Bluetooth Low Energy).

The input / output unit 14 is an information input device such as a keyboard and a mouse, and an output device such as a display.

The bus 15 is commonly connected to each of the above elements and transmits, for example, an address signal, a data signal, and various control signals.

<User terminal 2>
The user terminal 2 shown in FIG. 3 also includes a processor 20, a memory 21, a storage 22, a transmission / reception unit 23, an input / output unit 24, and the like, which are electrically connected to each other through a bus 25. Since the functions of each element can be configured in the same manner as the management server 1 described above, detailed description of each element will be omitted.

<Flight 4>
FIG. 4 is a block diagram showing a hardware configuration of the flying object 4. The flight controller 41 can have one or more processors such as a programmable processor (eg, central processing unit (CPU)).

Further, the flight controller 41 has a memory 411 and can access the memory. Memory 411 stores logic, code, and / or program instructions that the flight controller can execute to perform one or more steps. Further, the flight controller 41 may include sensors 412 such as an inertial sensor (accelerometer, gyro sensor), GPS sensor, proximity sensor (for example, rider) and the like.

Memory 411 may include, for example, a separable medium such as an SD card or random access memory (RAM) or an external storage device. The data acquired from the cameras / sensors 42 may be directly transmitted and stored in the memory 411. For example, still image / moving image data taken by a camera or the like may be recorded in the built-in memory or an external memory, but the present invention is not limited to this, and at least the management server 1 or the management server 1 may be recorded from the camera / sensor 42 or the built-in memory via the network NW. It may be recorded in any of the user terminals 2. The camera 42 is installed on the flying object 4 via the gimbal 43.

The flight controller 41 includes a control module (not shown) configured to control the state of the flying object. For example, the control module may adjust the spatial placement, velocity, and / or acceleration of an air vehicle with 6 degrees of freedom (translation x, y and z, and rotational motion θ _x , θ _y and θ _z ). , ESC44 (Electric Speed Controller) to control the propulsion mechanism (motor 45, etc.) of the flying object. The propeller 46 is rotated by the motor 45 supplied from the battery 48 to generate lift of the flying object. The control module can control one or more of the states of the mounting unit and the sensors.

The flight controller 41 is configured to transmit and / or receive data from one or more external devices (eg, a transceiver (propo) 49, a terminal, a display device, or another remote control). It is possible to communicate with the unit 47. The transceiver 49 can use any suitable communication means such as wired communication or wireless communication.

For example, the transmission / reception unit 47 uses one or more of a local area network (LAN), a wide area network (WAN), infrared rays, wireless, WiFi, a point-to-point (P2P) network, a telecommunications network, cloud communication, and the like. can do.

The transmission / reception unit 47 transmits and / or receives one or more of data acquired by the sensors 42, a processing result generated by the flight controller 41, predetermined control data, a user command from a terminal or a remote controller, and the like. be able to.

Sensors 42 according to this embodiment may include inertial sensors (acceleration sensors, gyro sensors), GPS sensors, proximity sensors (eg, riders), or vision / image sensors (eg, cameras).

<Management server function>
FIG. 5 is a block diagram illustrating the functions implemented in the management server 1. In the present embodiment, the management server 1 includes a communication unit 110, a flight path setting unit 120, a flight path movement control unit 130, a shooting operation control unit 140, an image filtering unit 150, a storage unit 160, an image reading unit 170, and a reading unit. It includes a result generation unit 180 and a reading result output unit 190. Each functional unit of the processor 10 can be realized by the CPU or the like executing a program stored in the memory. Further, the storage unit 160 may correspond to the storage 12, for example, and includes a flight information storage unit 162, a flight path storage unit 164, a shooting information storage unit 166, a reading result storage unit 168, and the like. The storage unit 160 may further have a storage unit that stores information necessary for performing imaging, for example, information on flight conditions (for example, flight speed, waypoint interval, etc.), and a shooting target. A memory that stores information about objects (for example, position coordinates and height information, the number of instruments placed at each shooting point, etc.) and information about the surrounding environment of the shooting object (for example, information about terrain and surrounding structures). Each unit (not shown) may be provided.

The communication unit 110 communicates with the user terminal 2 and the flying object 4. The communication unit 110 also functions as a reception unit that receives a shooting request from the user terminal 2.

The flight path setting unit 120 sets the flight path for the flight body 4 based on at least one of the flight information stored in the flight information storage unit 162 and the flight information received together with the shooting request from the user terminal 2. The flight information is, for example, information including at least shooting point information (so-called waypoint, including latitude / longitude information and flight altitude information), shooting direction information, and shooting time information. The flight path may be set by a known method. For example, the flight body 4 may be manually controlled to determine the shooting point and the shooting direction, and the shooting point information or the like may be sequentially registered or the user terminal. 2. The shooting point information or the like may be set manually or automatically based on, for example, information on the shooting object and information on the surrounding environment of the shooting target (for example, two-dimensional or three-dimensional map information). .. Further, the flight route setting unit 120 may store the flight route generated in the past in the flight route storage unit 164 and select it on the user terminal 2, or may perform a predetermined flight at a designated time. The route information may be read out.

The flight path movement control unit 130 moves and controls the flight body 4 based on the set flight path information. For example, based on the set flight path information, the flying object 4 is moved from the start point SP to the first shooting point WP, and after the shooting control described later, it is sequentially moved to the next shooting point, and finally the goal point GP. You may move to and finish. The start point SP and the goal point GP may be the same, or the goal point GP may be the start point SP of the next different flight path.

The shooting operation control unit 140 shoots an object to be shot at each shooting point based on the shooting information stored in the shooting information storage unit 166. The shooting information is, for example, in the present invention, since the shooting target is continuously shot, the shooting number information at each shooting point, the shooting order information of each shooting, the shooting angle of view information associated with the shooting order information, and the shooting angle information. Information such as shooting angle information (shooting angle of the camera or turning / tilting angle of the aircraft), shooting condition information including shooting position information. Although the details will be described later, instead of the shooting position information, the shooting interval information and the shooting route information of continuous shooting may be used as the shooting condition information.

The image filtering unit 150 selects an instrument image capable of reading the indicated value of each instrument, which is the main object of the present invention, from a plurality of instrument images continuously photographed at each imaging point by the imaging operation control unit 140. .. For example, using an instrument image learning model that trains images that can read the indicated values of various instruments taken from an easy-to-read angle as teacher data, the shape, focus, and noise of the instrument (for example, the sun reflected on the glass plate of the instrument). The AI may be used to select an appropriate instrument image in consideration of the presence or absence of light, dust, insects, etc. that have flown by the wind.

The image reading unit 170 analyzes the instrument identification information from the instrument image selected by the image filtering unit 150 from the two-dimensional code (for example, ArUco code, QR code, etc.) attached to the instrument, and indicates the indicated value of each instrument. To read. Known techniques may be used for reading the readings of the instrument. That is, a method in which the instrument reads, for example, an indicated value corresponding to an angle formed by the indicator needle, for example, a pressure gauge with a single needle and the indicator needle at a reference line (for example, a position indicating 0). May be.

The reading result generation unit 180 associates the identification information of the instrument analyzed by the image reading unit 170 with the indicated value of the read instrument, and generates the reading result of each instrument. Here, as a result of instrument image selection by the image filtering unit 150, if one indicated value is obtained for one instrument identification information in the image reading unit 170, it can be associated as it is, but one instrument identification can be performed. When a plurality of indicated values are obtained for the information (for example, when the same instrument is shown in a plurality of instrument images), it may be necessary to perform the association according to a predetermined association rule.

The predetermined association rule may be, for example, a rule in which a plurality of indicated values are compared with each other and the indicated value indicating the maximum value or the indicated value indicating the minimum value is associated as the indicated value indicated by the instrument. .. In addition, for example, a rule may be used in which the average value of a plurality of indicated values is associated as the indicated value indicated by the instrument.

Further, as a predetermined association rule, for example, when the instrument A is shown in a plurality of instrument images, two-dimensional coordinates are defined for each instrument image, and the position where the instrument A is shown in the instrument image is the center. The rule may be that the value indicated by the instrument A in the instrument image close to the coordinates is associated as the indicated value of the instrument A. The position of the instrument in the instrument image may be determined by, for example, using a known image analysis technique to determine the range of the instrument with a frame such as a rectangle, and the center coordinate of the frame may be the center coordinate of the instrument.

In addition, as a predetermined association rule, for example, when the instrument B appears in a plurality of instrument images, the shape correction is performed for the instrument B of each instrument image (for example, when the instrument has a round shape, a known perfect circle correction). Etc.), and the value indicated by the instrument B having a small correction amount may be associated with the indicated value of the instrument B.

The reading result output unit 190 outputs the reading result generated by the reading result generation unit 180 in a format that is easy for the user to see. The output format of the reading result may be any format, and for example, the above-mentioned instrument image may be included, and the instrument identification information and the indicated value may be superimposed on each instrument image. Another aspect of the reading result may be a tabular result in which at least the instrument identification information and the indicated value are described in association with each other. The output reading result may be stored in the reading result storage unit 168.

<Example of imaging method>
A method of reading the indicated value of the instrument according to the present embodiment will be described with reference to FIGS. 6-12. FIG. 6 illustrates a flowchart of a method for reading an indicated value of an instrument according to the present embodiment, and FIG. 7 illustrates an example of a flight path according to the present embodiment.

First, the flight path is set by the flight path setting unit 120 (SQ101). For example, a flight path registered in advance may be read from the flight path storage unit 164 and set.

Next, the flight path movement control unit 130 moves the flight object 4 from the start point SP to the first shooting point WP1 (SQ102). For example, as shown in FIG. 8, the instrument K1 of the object to be measured T1 is composed of a plurality of instruments, and a two-dimensional code is attached to each instrument. Here, in an actual field, there are many instruments such as the instrument K11 that are installed with the front facing a direction different from other instruments, and the conventional method of reading the indicated value of the instrument is that of the instrument K11. It was not considered to read the readings normally. However, there is no point in automation using the flying object 4 if the worker must visit the site after all because one instrument cannot be read. In addition, this may not be read due to not only the installation angle of the instrument but also the positional deviation of the shooting point due to the GPS error and external factors (for example, sunlight, dust, insects, etc.).

Therefore, next, the shooting operation control unit 140 continuously shoots the instrument K1 at the shooting point WP1 (SQ103). In the present invention, for example, as shown in FIG. 9, continuous shooting is performed at a plurality of different shooting angles and shooting positions based on the shooting condition information at each shooting point. That is, in continuous shooting, for example, as shown in FIG. 9, a shooting angle corresponding to each shooting position (for example, shooting in the pan direction of the camera) is performed while changing the shooting position in the horizontal direction a predetermined number of times based on the shooting condition information. It may be executed by changing to an angle or a turning angle in the yaw direction of the aircraft, or while changing the shooting position in the vertical direction a predetermined number of times, the shooting angle according to each shooting position (for example, the tilt direction of the camera). It may be executed by changing to the shooting angle of the camera or the tilt angle in the pitch direction of the aircraft), or it may be executed by combining both, or by appropriately combining the control of the roll direction of the camera, in particular, the roll of the camera. By adding directional control, it is possible to handle cases where the instrument is not installed perpendicular to the ground. Further, continuous shooting may be configured to shoot at predetermined shooting intervals while flying in a shooting path that draws an arc, based on shooting condition information, for example, as shown in FIG. ..

The format for continuous shooting may be the same for all shooting point WPs, or may be set individually for each shooting point WP, for example, according to the state of the instrument K and the shooting environment. Further, at that time, depending on the arrangement of the instruments K, as a modification of the configuration of FIG. 10, a configuration may be made so that shooting is performed at predetermined shooting intervals while flying in a linear shooting path.

Thereby, for example, as shown in FIG. 11, a total of 6 instrument images may be taken by combining three angles in the horizontal direction and two angles in the vertical direction. The number of shots and the shooting angle in the horizontal direction and the vertical direction are not limited to this, and may be set to any value, but more preferably, for example, when each instrument is taken so as to be included in at least two or more instrument images, it is read. Accuracy is improved.

Next, the flight path movement control unit 130 determines whether the current shooting point is the last shooting point WP5 (SQ104). If it is not the last shooting point WP5, the flight path movement control unit 130 moves to the next shooting point WP2 and continuously shoots step SQ103 (SQ105).

Next, in step SQ104, when the flight path movement control unit 130 determines that the last shooting point is WP5, the image filtering unit 150 takes an instrument from among a plurality of instrument images taken at each shooting point. Select an instrument image that can read the indicated value of (SQ106). For example, in FIG. 11, only a part of the instrument is shown as shown in the images G1 and G2, the shooting angle is bad (the shape of the instrument is not appropriate) as shown in the image G2, and the image G5. If the indicated value cannot be read due to an external factor (for example, reflection by sunlight) as shown in, or if the instrument is not shown as shown in image G6, it is not suitable for reading the instrument. Is determined. As a result, for example, FIG. 12 shows that images G1-G4 are selected.

Next, from the instrument image selected by the image filtering unit 150, the instrument identification information and the indicated value of each instrument are read by the image reading unit 170 (step SQ107).

Next, the reading result generation unit 180 associates the identification information of the instrument analyzed by the image reading unit 170 with the indicated value of the read instrument, and generates the reading result of each instrument.

Next, the reading result output unit 190 outputs the reading result generated by the reading result generation unit 180 in a format that is easy for the user to see (SQ108).

In this way, it is possible to improve the reading accuracy even in a situation where it is difficult to read the indicated value of the instrument normally due to the installation angle of the instrument or an external factor such as outdoors.

The embodiments described above are merely examples for facilitating the understanding of the present invention, and are not intended to limit the interpretation of the present invention. It goes without saying that the present invention can be modified and improved without departing from the spirit thereof, and the present invention includes its equivalents.

1 Management server 2 User terminal 4 Flying object

Claims (9)

It is an instrument reading method that reads the readings of multiple instruments using an air vehicle.
The step of setting the flight path to which the flying object moves by the flight path setting unit, and
A step of moving the flying object to a predetermined shooting point based on the flight path by the flight path movement control unit, and
A step of continuously shooting a plurality of instruments at a plurality of different shooting angles and shooting positions at the predetermined shooting point by the shooting operation control unit and acquiring a plurality of instrument images.
A step of selecting an instrument image capable of reading the indicated value of each instrument from the plurality of instrument images by the image filtering unit, and
The image reading unit analyzes the instrument identification information from the two-dimensional code attached to each instrument in the selected instrument image, and reads the indicated value of each instrument.
The reading result generation unit includes a step of associating the identified information of the analyzed instrument with the indicated value of the read instrument and generating the reading result of each instrument.
An instrument indication reading method characterized by this. The method for reading an instrument instruction according to claim 1.
The two-dimensional code is an ArUco code.
An instrument indication reading method characterized by this. The instrument instruction reading method according to claim 1 or 2.
The step of acquiring the plurality of images is
Take each instrument so that it is included in at least two instrument images,
An instrument indication reading method characterized by this. The method for reading an instrument instruction according to any one of claims 1 to 3.
The step generated as the reading result is
According to a predetermined association rule, one instrument identification information and an indication value indicated by an instrument based on a plurality of indication values are associated with each other.
An instrument indication reading method characterized by this. The method for reading an instrument instruction according to any one of claims 1 to 4.
If multiple instrument images contain the first instrument
The predetermined association rule defines two-dimensional coordinates for each instrument image including the first instrument, and the first instrument image in which the position of the first instrument in the instrument image is close to the center coordinates. It is a rule that the value indicated by one instrument is associated with the indicated value of the first instrument.
An instrument indication reading method characterized by this. The method for reading an instrument instruction according to any one of claims 1 to 4.
If multiple instrument images contain a second instrument
As the predetermined association rule, shape correction is performed on the second instrument in each instrument image including the second instrument, and a value indicated by the second instrument having a small correction amount of the shape correction is used. It is a rule to associate as the indicated value of the second instrument.
An instrument indication reading method characterized by this. A management server that uses an aircraft to read readings from multiple instruments.
A flight path setting unit that sets a flight path for the flying object to move, and a flight path setting unit.
A flight path movement control unit that moves the flying object to a predetermined shooting point based on the flight path,
A shooting operation control unit that continuously shoots a plurality of instruments at a plurality of different shooting angles and positions at the predetermined shooting point and acquires a plurality of instrument images.
An image filtering unit that selects an instrument image that can read the indicated value of each instrument from the plurality of instrument images, and an image filtering unit.
An image reading unit that analyzes the instrument identification information from the two-dimensional code attached to each instrument in the selected instrument image and reads the indicated value of each instrument.
It includes a reading result generation unit that associates the identified information of the analyzed instrument with the indicated value of the read instrument and generates the reading result of each instrument.
A management server that features that. An instrument reading system that uses an aircraft to read readings from multiple instruments.
A flight path setting unit that sets a flight path for the flying object to move, and a flight path setting unit.
A flight path movement control unit that moves the flying object to a predetermined shooting point based on the flight path,
A shooting operation control unit that continuously shoots a plurality of instruments at a plurality of different shooting angles and positions at the predetermined shooting point and acquires a plurality of instrument images.
An image filtering unit that selects an instrument image that can read the indicated value of each instrument from the plurality of instrument images, and an image filtering unit.
An image reading unit that analyzes the instrument identification information from the two-dimensional code attached to each instrument in the selected instrument image and reads the indicated value of each instrument.
It includes a reading result generation unit that associates the identified information of the analyzed instrument with the indicated value of the read instrument and generates the reading result of each instrument.
An instrument reading system characterized by this. A program that causes a computer to execute an instrument reading method that reads readings of multiple instruments using an aircraft.
The method for reading the indicated value of the instrument is
The step of setting the flight path to which the flying object moves by the flight path setting unit, and
A step of moving the flying object to a predetermined shooting point based on the flight path by the flight path movement control unit, and
A step of continuously shooting a plurality of instruments at a plurality of different shooting angles and shooting positions at the predetermined shooting point by the shooting operation control unit and acquiring a plurality of instrument images.
A step of selecting an instrument image capable of reading the indicated value of each instrument from the plurality of instrument images by the image filtering unit, and
The image reading unit analyzes the instrument identification information from the two-dimensional code attached to each instrument in the selected instrument image, and reads the indicated value of each instrument.
The reading result generation unit includes a step of associating the identified information of the analyzed instrument with the indicated value of the read instrument and generating the reading result of each instrument.
A program characterized by that.

Images