CN107007997B - Image processing device, measurement device, image processing system, image processing method, and recording medium - Google Patents

Abstract

The present invention provides image processing apparatus, measurement device, image processing system and image processing method.Without wireless transmitter implement receiving or sending for data.Image processing apparatus has acquisition unit and communication unit.Acquisition unit obtains the dynamic image information of the image comprising visible light signal and measure object, which has the measurement information of the measure object measured by the measurement device for being mounted on measure object, and is transmitted messages by measurement device.Communication unit visible light signal contained in the dynamic image information obtained as acquisition unit obtains measurement information.

Description

Image processing device, measuring device, image processing system, image processing method, and recording medium

This application is based on and asserts prior Japanese Patent Application No. 2015-256148 (filing date December 28, 2015) and prior Japanese Patent Application No. 2016-136253 (filing date July 8, 2016), reference will Their contents are incorporated here.

technical field

The present invention relates to an image processing device, a measurement device, an image processing system, an image processing method, and a recording medium.

Background technique

In order to analyze sports such as sports and dancing, and provide guidance, a camera is used to capture moving images of measurement objects. The use of moving images has the advantages of being able to easily grasp the movement even if the specialist knowledge is insufficient, and making it easy to know the surrounding conditions of the measuring object. On the other hand, there is also a disadvantage that only rough movements visible to the eyes can be grasped, and quantitative evaluation is difficult.

In addition, similar to the imaging device, wearable sensors are also used. The use of wearable sensors has the advantage of enabling easy acquisition of information invisible to the eyes and quantitative evaluation of motion. On the other hand, there are disadvantages that specialized knowledge is required for data analysis, and it is difficult to grasp the surrounding conditions of the measurement object.

In this way, the imaging device and the wearable sensor can complement each other's weaknesses, and effective motion analysis and guidance can be realized by using them in combination. In JP-A-2009-106323, the following device is described: the subject is equipped with an acceleration sensor, and a dynamic image showing the swing of the subject is taken with a digital camera, and the dynamic image is combined with the acceleration detected by the acceleration sensor. The image of the time waveform's maximum peak mark marker is displayed on the display together.

In the device disclosed in JP-A-2009-106323, an imaging device and a wearable sensor are combined to perform image processing and display. In the device disclosed in JP-A-2009-106323, there is a problem that the image processing device must use a wireless transmitter to receive data acquired by the wearable sensor.

Contents of the invention

The present invention was made in view of the related problems, and an object of the present invention is to provide an image processing device, a measurement device, an image processing system, an image processing method, and a recording medium capable of receiving or transmitting data without using a wireless transmitter.

One aspect of the image processing device according to the present invention includes: an acquisition unit that acquires dynamic image information including a visible light signal and an image of a measurement object, wherein the visible light signal has the information measured by the measurement device mounted on the measurement object. measurement information of the measurement target, which is transmitted by the measurement device; and an acquisition unit that acquires the measurement information from the visible light signal included in the moving image information obtained by the acquisition unit.

In addition, one aspect of the measurement device according to the present invention includes: a measurement unit that is attached to a measurement object to measure measurement information of the measurement object; measuring the visible light signal of the information, the measurement unit measures geomagnetism to obtain the angular displacement of the measurement object, the light emitting unit sends the visible light signal when the angular displacement does not exceed a threshold, and sends the visible light signal when the angular displacement exceeds a threshold value. In the case of the threshold, the visible light signal is not sent.

In addition, an aspect of the image processing system according to the present invention includes: a measurement device that is attached to a measurement object, measures measurement information of the measurement object, and transmits a visible light signal including the measured measurement information; and an image A processing device comprising an acquisition unit that acquires moving image information including the visible light signal and an image of the measurement object, and the visible light signal included in the moving image information obtained by the acquisition unit. An acquisition unit that acquires the measurement information.

In addition, one aspect of the image processing method according to the present invention includes the step of obtaining dynamic image information including a visible light signal having a value measured by a measurement device mounted on the measurement object and an image of the measurement object. The measurement information of the measurement object is sent by the measurement device; the measurement information is obtained from the visible light signal contained in the obtained dynamic image information.

In addition, one aspect of the recording medium according to the present invention is a computer-readable recording medium recording a program for causing a computer to realize image processing executed by an image processing device, which causes the calculation to execute the following process:

an acquisition process of acquiring dynamic image information including a visible light signal having measurement information of the measurement object measured by a measurement device attached to the measurement object and transmitting from the measurement device, and an image of a measurement object ;and

and an acquisition process of acquiring the measurement information from the visible light signal included in the acquired moving image information.

According to the present invention, data can be received or transmitted without using a wireless transmitter.

Additional objects and advantages of the invention will be set forth in the accompanying description, some of which will be obvious from the description, or acquired by practice of the invention. The objects and advantages of the invention can be understood and obtained by means of the instrumentalities and combinations particularly pointed out hereinafter.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate embodiments of the invention and, together with the general description given above and the detailed description given below, serve to explain the principles of the invention.

FIG. 1 is a schematic diagram showing the configuration of an image processing system according to Embodiment 1. As shown in FIG.

FIG. 2 is a block diagram showing the configuration of the image processing system according to the first embodiment.

FIG. 3A is a diagram illustrating a method of acquiring a unit search signal according to Embodiment 1. FIG.

FIG. 3B is a diagram illustrating a method of an acquisition unit specifying a signal according to Embodiment 1. FIG.

FIG. 4 is a diagram showing the configuration of a visible light signal according to Embodiment 1. FIG.

FIG. 5 is a diagram illustrating time synchronization performed by an acquisition unit according to Embodiment 1. FIG.

FIG. 6 is a flowchart showing synchronization processing according to Embodiment 1. FIG.

FIG. 7 is a diagram showing a screen displayed on a display unit according to Embodiment 1. FIG.

8A is a diagram showing an example of selecting a measurement target on a screen displayed on the display unit according to Embodiment 1. FIG.

8B is a diagram showing an example of displaying evaluation values on a screen displayed on the display unit according to Embodiment 1. FIG.

9A is a diagram showing an example of selecting a measurement target on a screen displayed on the display unit according to Embodiment 1. FIG.

9B is a diagram showing an example of data displayed on a screen displayed on the display unit according to Embodiment 1. FIG.

FIG. 10A is a diagram illustrating an example at the start of measurement in the image processing system according to Embodiment 2. FIG.

10B is a diagram illustrating an example in which an angular displacement exceeds a threshold in the image processing system according to the second embodiment.

FIG. 11 is a schematic diagram showing the configuration of an image processing system according to a modified example.

Detailed ways

(Embodiment 1)

The image processing system 1 according to Embodiment 1 of the present invention will be described below with reference to the drawings. In addition, the same code|symbol is attached|subjected to the same or equivalent part in a figure.

FIG. 1 is a schematic diagram showing the configuration of an image processing system 1 according to Embodiment 1 of the present invention, and FIG. 2 is a block diagram showing the configuration of the image processing system 1 . As shown in FIGS. 1 and 2 , the image processing system 1 includes a measurement device 100 , an imaging device 200 , and an image processing device 300 .

The measurement device 100 is a wearable sensor attached to a measurement object. The measurement device 100 includes a control unit 101 , a sensor unit 102 , an analysis unit 103 , an encoding unit 104 , a storage unit 105 , a light emitting unit 106 , and a communication unit 107 .

The control unit 101 is a processing device that controls the measurement device 100 by executing a program. The control unit 101 can include a CPU (Central Processing Unit, central processing unit).

The sensor unit 102 is a sensor that measures motion information or biological information of a measurement target, or environmental information around the measurement target, and acquires data (measurement information). The sensor unit 102 can include a speed sensor, an acceleration sensor, an angular velocity sensor, a heart rate sensor, a blood pressure sensor, and an air pressure sensor. The sensor unit 102 functions as a measurement unit.

The analysis unit 103 analyzes the data acquired by the sensor unit 102, and calculates an evaluation value for evaluating the motion information or biological information of the measurement object, or the environmental information around the measurement object (the evaluation value of the motion information, the evaluation value of the biological information). evaluation value, evaluation value of environmental information). The analysis unit 103 can include a CPU. The evaluation value of the exercise information calculated by the analysis unit 103 can include: the amount of activity (energy) calculated from the speed of the measurement object, the weight of the measurement object, and the speed; the calorie consumption calculated from the amount of activity; Spend.

The encoding unit 104 encodes information to generate a signal. The encoding unit 104 can include a CPU. The visible light signal 400 generated by encoding by the encoding unit includes the time measured by the measurement device 100 and the sensor unit 102 , and the evaluation value calculated by the analysis unit 103 , which will be described in detail later.

The storage unit 105 is a storage device that stores data acquired by the sensor unit 102 , evaluation values calculated by the analysis unit 103 , and signals generated by the encoding unit 104 . In addition, the storage unit 105 also functions as a storage area when the control unit 101 executes processing. The storage unit 105 can include RAM (Random Access Memory, random access memory), flash memory, and magnetic disk.

The light emitting unit 106 is a visible light light emitting device serving as a transmitter of visible light communication. The light emitting unit 106 transmits the visible light signal 400 encoded by the encoding unit 104 using, for example, a blink pattern in which visible light is repeatedly turned on and off. The light emitting unit 106 can include an LED (Light Emitting Diode, light emitting diode). In addition, the light emitting unit 106 may also use a plurality of LEDs that emit light at different wavelengths to transmit the visible light signal 400 encoded by the encoding unit 104 . By using multiple LEDs that emit light at different wavelengths, the amount of information transmitted can be increased.

The communication unit 107 is a communication device that performs wireless communication with the image processing device 300 . The communication unit 107 transmits a signal including data measured by the sensor unit 102 , which has a large capacity and is difficult to transmit in visible light communication via the light emitting unit 106 . The communication unit 107 can include a Bluetooth (registered trademark) module, a wireless LAN (Local Area Network, local area network) module, and a control circuit for controlling them.

The imaging device 200 is an imaging device that captures a measurement object and stores moving image information. The dynamic image information includes a visible light signal 400 and an image of the measurement object, wherein the visible light signal 400 has measurement information of the measurement object measured by the measurement device 100 and is reported by the measurement device 100 . The imaging device 200 includes a control unit 201 , an imaging unit 202 , a storage unit 203 , and a communication unit 204 . The imaging device 200 can include a digital video camera and a mobile phone with a camera.

The control unit 201 controls the imaging device 200 by executing a program. The control unit 201 can include a CPU.

The imaging unit 202 acquires moving image information by imaging a measurement object. The imaging unit 202 can include a lens, a CMOS (Complementary Metal Oxide Semiconductor, Complementary Metal Oxide Semiconductor) image sensor, a CCD (Charge-Coupled Device, Charge-Coupled Device) image sensor, an A/D (Analog/Digital, analog/digital) conversion device. In this specification, as an example, the number of frames per second (fps) of the moving image information captured by the imaging unit 202 will be described as 30 fps. The imaging unit 202 functions as an acquisition unit.

The storage unit 203 is a storage device that stores data including moving image information acquired by the imaging unit 202 . In addition, the storage unit 203 also functions as a storage area when the control unit 201 executes processing. The storage unit 203 can include a RAM, a flash memory, and a magnetic disk.

The communication unit 204 is a communication device that performs wireless communication with the image processing device 300 . The communication unit 204 transmits data including moving image information acquired by the imaging unit 202 and stored in the storage unit 203 . The communication unit 204 can include a Bluetooth (registered trademark) module, a wireless LAN module, and a control circuit for controlling them.

The image processing device 300 is a device that time-synchronizes and displays the moving image information of the captured measurement object and the measured data. The image processing device 300 includes a control unit 301 , a communication unit 302 , an acquisition unit 303 , a storage unit 304 , a display unit 305 , and a reception unit 306 . The image processing device 300 can include a server, a personal computer, and a smartphone.

The control unit 301 is a processing device that controls the image processing device 300 by executing a program. The control unit 301 can include a CPU.

The communication unit 302 is a communication device that performs wireless communication with the measurement device 100 and the imaging device 200 . The communication unit 302 receives a signal transmitted from the communication unit 107 of the measurement device 100 or the communication unit 204 of the imaging device 200 . The communication unit 302 can include a Bluetooth (registered trademark) module, a wireless LAN module, and a control circuit for controlling them. The communication unit 302 functions as an acquisition unit or a reception unit.

The acquisition unit 303 decodes the visible light communication signal recorded in the video information to acquire information. In addition, the acquisition unit 303 performs time synchronization. The acquisition unit 303 can include a CPU. The acquisition unit 303 specifies the light emission pattern of the light emission unit 106 of the measurement device 100 from the moving image information captured by the imaging device 200 and sent to the image processing device 300 , and decodes the light emission pattern to obtain data. Furthermore, the acquisition unit 303 performs time synchronization by a method described later.

A method for specifying the signal transmitted by the light emitting unit 106 from the video information by the acquiring unit 303 will be described. 3A and 3B are diagrams illustrating a method for specifying a signal by the acquisition unit 303 . As shown in FIG. 3A , the acquiring unit 303 searches (scans) the color corresponding to the light emitted by the light emitting unit 106 from the entire image of one frame of moving image information. The wavelength of light emitted by the light emitting unit 106 and the white balance and sensitivity of the imaging device 200 are known, and the color corresponding to the light emitted by the light emitting unit 106 is uniquely determined from these pieces of information.

When a color corresponding to the light emitted by the light emitting unit 106 is found, as shown in FIG. 3B , the acquisition unit 303 determines that the position where the color is found is the position of the measuring device 100 , and tracks all the determined positions of the measuring device 100 . Thereafter, the presence or absence of light emission at each position of the measurement device 100 is acquired for each frame of moving image information, and the acquired light emission pattern is determined as a signal transmitted from the light emitting unit 106 of the measurement device 100 .

As described above, in order to obtain the presence or absence of light emission of the light emitting unit 106 for each frame of moving image information, ideally, one frame of moving image information corresponds to 1 bit of the signal. Therefore, the communication speed (bps) of the visible light communication performed by the image processing system 1 ideally matches the number of frames per second (fps) of the moving image information captured by the imaging device 200 . In the example of this specification, since moving image information is 30 fps, the communication speed of visible light communication is 30 bps.

The storage unit 304 is a storage device that stores moving image information and data received by the communication unit 302 and data decoded by the acquisition unit 303 . In addition, the storage unit 304 also functions as a storage area when the control unit 301 executes processing. The storage unit 304 can include RAM and flash memory.

The display unit 305 is a display device for displaying video information and data to the user. The display unit 305 displays the moving image information recorded by the communication unit 302 in which the movement of the measurement object is recorded. In addition, the display unit 305 displays data received by the communication unit 302 or decoded by the acquisition unit 303 . Furthermore, the display unit 305 can perform highlighted display on the screen where a specific measurement device 100 is located. The display unit 305 can include a liquid crystal display or a Brownian tube display. The screen display performed by the display unit 305 will be described later.

The accepting unit 306 functions as a user interface and is accepting means for accepting instructions from the user. The user inputs an instruction to select a specific measurement device 100 on the screen via the accepting unit 306 . The receiving unit 306 can include a mouse, a touchpad, and a touch panel.

The visible light signal 400 encoded by the encoding unit 104 and transmitted by the light emitting unit 106 will be described with reference to the accompanying drawings.

FIG. 4 is a diagram showing the configuration of a visible light signal 400 . As shown in FIG. 4 , the visible light signal 400 includes a head mark 401 , a measurement time 402 , a sensor ID 403 , analysis data 404 , and a warning mark 405 .

The head mark 401 is a 32-bit signal indicating the beginning of the visible light signal 400 . The head mark 401 is included at the head of the visible light signal 400 , and the acquisition unit 303 recognizes the start of the visible light signal 400 based on the presence of the head mark 401 .

The measurement time 402 is a 32-bit signal (measurement signal) indicating the elapsed time from the start of measurement by the measurement device 100 transmitting the visible light signal 400 . More specifically, the measurement time 402 indicates the elapsed time from when the measurement device 100 starts measurement to when the first mark 401 emits light.

FIG. 5 is a diagram illustrating synchronization performed by the acquisition unit 303 . The acquisition unit 303 performs time synchronization of the data measured by the measurement device 100 and the video information captured by the imaging device 200 based on the frame in which the light-emitting video information is recorded and the time indicated by the measurement time 402 .

The acquisition unit 303 acquires the measurement time 402 . In the example of FIG. 5 , the elapsed time represented by the measurement time 402 is T seconds. Determine the moment (T2) at which the elapsed time T seconds represented by the measurement time 402 has been traced back from the shooting time (T1) of the frame in which the first luminous moving image information of the head mark 401 of the visible light signal 400 including the measurement time 402 was recorded (T2). ). This time is the time when the measurement device 100 starts measurement, and time synchronization is performed by specifying the frame captured at this time.

Returning to FIG. 4 , the sensor ID 403 is a 16-bit signal unique to the measurement device 100 that transmits the visible light signal 400 , and is an identification signal for identifying the measurement device 100 . Even when a plurality of measurement devices 100 are respectively equipped on the measurement target, the acquisition unit 303 specifies the measurement device 100 that transmits the visible light signal 400 based on the sensor ID 403 .

The analysis data 404 is a 16-bit signal (evaluation signal) indicating an evaluation value obtained by analyzing the data by the analysis unit 103 of the measurement device 100 . A plurality of analysis data 404 are included in the visible light signal 400 , and three pieces of analysis data 404A, 404B, and 404C are included in the example of FIG. 4 .

The warning flag 405 is a 32-bit signal (warning signal) indicating a flag output when the evaluation value analyzed by the analysis unit 103 of the measurement device 100 exceeds a threshold value. The warning mark 405 also contains information indicating which of the plurality of evaluation values exceeds the threshold value.

The visible light signal 400 is a 160-bit signal as a whole, and the communication is completed within 5.3 seconds at the communication speed of 30 bps in this embodiment.

FIG. 6 is a flowchart showing synchronization processing as image processing. Synchronization processing performed by the image processing system 1 is described with reference to the flowchart of FIG. 6 .

The operation of the measurement device 100 will be described. When the start of measurement is instructed by the control unit 101, the sensor unit 102 starts the measurement of the measurement target (step S101). The measured data is stored in the storage unit 105 .

After the measurement of the data is started, the analysis unit 103 analyzes the data to calculate an evaluation value (step S102 ). The calculated evaluation value is stored in the storage unit 105 .

After the evaluation value is calculated, the encoding unit 104 encodes information to start generation of the visible light signal 400 (step S103 ). The generated visible light signal 400 is stored in the storage unit 105 .

After the visible light signal 400 is generated, the light emitting unit 106 blinks to send the visible light signal 400 (step S104 ).

After the visible light signal 400 is sent, the communication unit 107 sends the data measured by the sensor unit 102 to the image processing device 300 (step S105 ). In addition, the position of performing step S105 is arbitrary, and it can be performed before step S101, or can be performed in parallel with steps S101 to S104.

After steps S101 to S105 are completed, the measurement device 100 ends its operation.

The operation of the imaging device 200 will be described. After the start of shooting is instructed by the control unit 201, the shooting unit 202 takes a picture of the measurement object and acquires moving image information (step 8201). The visible light signal 400 transmitted by the light emitting unit 106 of the measurement device 100 is also photographed simultaneously. The obtained video information is stored in the storage unit 203 . In addition, step S201 does not need to be performed after step S104 in which the light emitting unit 106 transmits the visible light signal 400, and the transmission of the visible light signal 400 (step S104 ).

After acquiring the moving image information, the communication unit 204 transmits the moving image information acquired by the imaging unit 202 to the image processing device 300 (step S202).

After steps S201 to S202 are completed, the photographing device 200 ends its operation.

The operation of the image processing device 300 will be described. After the data is transmitted in step S105, the communication unit 302 receives the transmitted data (step S301). The received data is stored in the storage unit 304 .

After the moving image is transmitted in step S202, the communication unit 302 receives the transmitted moving image information (step S302). The received video is stored in the storage unit 304 .

After receiving the moving image, the acquisition unit 303 specifies the visible light signal 400 recorded in the moving image and performs decoding (step S303). The information obtained by decoding is stored in the storage unit 304 . In addition, step S302 and step S303 may be performed prior to step S301, or may be performed in parallel with step S301.

After receiving the data and dynamic image information and decoding the visible light signal 400 to obtain the information, the acquisition unit 303 performs time synchronization between the dynamic image information and the data or evaluation value (step S304). The time synchronization is performed based on the measured time 402 and the frame in which the moving image information of the signal representing the measured time 402 is recorded. The synchronized video information is stored in the storage unit 304 in association with data or evaluation values.

After step S301 to step S304 are completed, the image processing device 300 ends the operation.

After the measurement device 100 , the imaging device 200 , and the image processing device 300 end their operations, the image processing system 1 ends the synchronization process.

The screen display performed by the display unit 305 will be described in detail.

7 , 8A, 8B, 9A, and 9B are diagrams showing screens displayed on the display unit 305 . As shown in FIG. 7 , when the visible light signal 400 transmitted from the measurement device 100 includes a warning sign 405 , the display unit 305 highlights the portion where the measurement device 100 is located on the screen. Emphasis is displayed by enclosing the portion where the measurement device 100 is located with an ellipse. Emphasis display using an ellipse is an example, and it can be performed by various methods such as displaying with an arrow or changing brightness.

If the threshold is set so that when the motion information of the measurement object exceeds an appropriate range, when the biological information of the measurement object exceeds an appropriate range, or when the environmental information around the measurement object exceeds an appropriate range, If the evaluation value exceeds the threshold, when the motion information of the measurement object is inappropriate, the biological information of the measurement object is inappropriate, or the environmental information around the measurement object is inappropriate, the measurement is highlighted. The measurement device 100 equipped on the subject. In this way, it is possible to clearly indicate to the user which measurement object to focus on among a plurality of measurement objects, and to provide efficient guidance.

As shown in FIGS. 8A and 8B , the display unit 305 simultaneously displays the evaluation value included in the analysis data 404 transmitted from the measurement device 100 and the moving image information transmitted from the imaging device 200 on the screen in a superimposed manner or side by side. As shown in FIG. 8A , when the user selects the measurement device 100 on the screen or the measurement object equipped with the measurement device 100 via the receiving unit 306, the acquisition unit 303 acquires elapsed time information from the measurement time 402 sent by the measurement device 100, and obtains the elapsed time information from the measurement device 100. Analysis data 404 acquires evaluation values. After performing the synchronization process, the control unit 301 controls the display unit 305 to display the evaluation value and the moving image information simultaneously on the screen as shown in FIG. 8B by superimposing or juxtaposing them.

For example, the evaluation value of exercise information is an index that makes it easier for the user to understand the effect of exercise than the data itself, and efficient guidance can be given to the user by calculating the evaluation value. In addition, since the analysis data 404 can be obtained from the measurement device 100 on the screen, it is easy to associate the measurement device 100 with the evaluation value. In addition, evaluation values can be displayed only by visible light communication, and since wireless communication via communication unit 107 and communication unit 302 is unnecessary, data management becomes easy.

As shown in FIGS. 9A and 9B , the display unit 305 simultaneously displays the data transmitted by the measurement device 100 via the communication unit 107 and the moving image transmitted by the imaging device 200 via the communication unit 204 on a screen overlapping or side by side. As shown in FIG. 9A , when the user selects the measurement device 100 on the screen or the measurement object equipped with the measurement device 100 via the acceptance unit 306 , the acquisition unit 303 acquires elapsed time information from the measurement time 402 transmitted from the measurement device 100 , Information identifying the measurement device 100 is obtained from the sensor ID 403 . The control unit 301 acquires the data transmitted from the measurement device 100 via the communication unit 107 from the storage unit 304, and after performing synchronization processing, controls the display unit 305 to simultaneously display the data and the data on the screen as shown in FIG. 9B by overlapping or side by side. Dynamic image information. The time on the data corresponding to the time on the displayed video information is indicated by the line L. FIG.

By performing wireless communication via the communication unit 107 and the communication unit 302 , it is possible to perform more detailed evaluation of the motion of the measurement object using a large volume of data that is difficult to receive or transmit under visible light communication.

As described above, according to the image processing system 1 according to this embodiment, the image processing device 300 can acquire measurement information (motion information, organism information or environmental information). Since measurement information can be obtained by receiving moving image information, reception or transmission of actual data can be performed without using a wireless transmitter.

According to the image processing system 1, the data measured by the measurement device 100 and the moving image information captured by the imaging device 200 can be time-synchronized in units of one frame. By performing time synchronization in units of one frame, the user can accurately grasp the relationship between the motion of the measurement target and the data (measurement information). An example of a module that can perform accurate time synchronization is GPS (Global Positioning System, Global Positioning System), but this not only has the problem of increasing the size of the device and increasing the cost, but also the GPS cannot obtain the current time indoors, and cannot The subject of time synchronization. According to the image processing system 1, accurate time synchronization can be performed indoors.

According to the image processing system 1, moving images and data or evaluation values can be simultaneously displayed on the screen in an overlapping or side-by-side manner in a time-synchronized manner. Simultaneously superimposing or side-by-side display of dynamic image information and data or evaluation values enables the user to simultaneously see the body movement of the measurement object based on the dynamic image information and the measurement data obtained from the measurement object, enabling the user to perform measurement easily Evaluation and instruction of target exercise.

According to the image processing system 1 , when a plurality of measurement devices 100 are used, each measurement device 100 can be identified by the sensor ID 403 included in the visible light signal 400 . This makes it possible to easily identify from which measurement object the data was obtained even when, for example, multiple people are equipped with the measurement devices 100 and exercise separately, and it is possible to easily guide the exercise of multiple people.

(Embodiment 2)

The image processing system 1 according to Embodiment 2 of the present invention will be described below with reference to the drawings. In addition, the same code|symbol is attached|subjected to the same or equivalent part in a figure.

The sensor unit 102 of the measurement device 100 includes a geomagnetic sensor. The sensor unit 102 measures geomagnetism, and the measured data is stored in the storage unit 105 .

10A and 10B are diagrams illustrating the operation of the image processing system 1 according to the second embodiment. As shown in FIG. 10A , after the sensor unit 102 starts measurement, the analysis unit 103 analyzes the measured geomagnetism and the geomagnetism at the start of the measurement to calculate the angular displacement of the measurement object. The control unit 101 judges whether or not the calculated angular displacement exceeds a threshold. In this embodiment, the threshold of angular displacement is ±60 degrees.

When it is determined that the angular displacement of the measurement object does not exceed the threshold value, the transmission of the visible light signal 400 by the light emitting unit 106 is continued. When it is determined that the threshold is exceeded as in the measurement object X in FIG. 10B , the control unit 101 controls the light emitting unit 106 to stop the transmission of the visible light signal 400 . In addition, when it is determined again that the threshold value is not exceeded after it is determined that the threshold value is exceeded, the control unit 101 controls the light emitting unit 106 to restart the stopped transmission of the visible light signal 400 .

When the angular displacement of the measurement device 100 becomes larger, it becomes difficult for the light emission of the light emitting unit 106 to be captured by the imaging device 200 . In such a case, the light emission of the light emitting unit 106 becomes useless, resulting in wasted energy and shortened lifetime. In addition, if the visible light signal 400 sent from the measurement device 100 is not captured by the imaging device 200 , the data will be lost.

The image processing system 1 according to this embodiment can prevent unnecessary light emission by stopping the transmission when the angular displacement of the measurement device 100 exceeds a threshold value, thereby preventing waste of energy and shortening of life. In addition, it can prevent data loss caused by the visible light signal 400 not being photographed by the photographing device 200 .

(Modification)

Several embodiments of the present invention have been described above, but Embodiment 1 and Embodiment 2 are examples, and the scope of application of the present invention is not limited thereto. That is, the embodiments of the present invention can be applied in various ways, and all the embodiments are included in the scope of the present invention.

The image processing system 1 includes the measurement device 100 , the imaging device 200 , and the image processing device 300 , but is not limited thereto. FIG. 11 is a schematic diagram showing the configuration of an image processing system according to a modified example. As shown in FIG. 11 , the image processing system 1 may not include the imaging device 200 , the image processing device 300 may include the imaging unit 202 , and the image processing device 300 may have the function of the imaging device 200 . In addition, the image processing system 1 may not include the image processing device 300 , and the imaging device 200 may have the function of the image processing device 300 .

The light emitting unit 106 is assumed to be a visible light light emitting device, but is not limited thereto. As long as the generated electromagnetic wave can be captured by the imaging device 200, it may be an infrared ray generating device, for example. Likewise, this specification describes visible light communication or visible light signal, but is not limited to the use of visible light.

The communication unit 107 is assumed to be a communication device that performs wireless communication, but is not limited thereto. For example, it may be a communication device including a USB (Universal Serial Bus) module and performing wired communication. In addition, it is also possible to store data in a detachable storage device and have other devices read in and exchange data. The same applies to the communication unit 204 and the communication unit 302 . In this case, moving picture information is obtained from a detachable storage device.

In addition, the measurement device 100 does not need to include the communication unit 107 . Even if the communication unit 107 is not provided, the measurement information can be displayed by the imaging unit 202 of the imaging device 200 by transmitting the measurement information via the light emitting unit 106 to display moving image information and measurement information.

In visible light communication, one frame of video information corresponds to one bit of a signal, but the present invention is not limited thereto. For example, it is also possible to set the blinking time so that 2 frames of moving image information become 1 bit of the signal. With this setting, although the communication speed is halved, it is possible to prevent flickering and loss of frames not recorded in moving image information.

The visible light signal 400 includes a head mark 401 , a measurement time 402 , a sensor ID 403 , analysis data 404 and a warning mark 405 , but is not limited thereto. For example, the visible light signal 400 may only include the top mark 401 and the measurement time 402 . In addition, the measurement time 402 may not be included, and at least any one of the sensor ID 403 , the analysis data 404 , and the warning mark 405 may be included. As long as the measurement time 402 is included in at least one of the visible light signals 400 transmitted multiple times, the image processing system 1 can synchronize the time of the moving image information and the measurement data.

The analysis data 404 represents an evaluation value obtained by analyzing the data by the analysis unit 103 of the measurement device 100 , but is not limited thereto. For example, the analysis data 404 may include the data itself measured by the sensor unit 102 of the measurement device 100 as measurement information.

Visible light signal 400 may also include an end marker at the end of the signal. The end flag is a 32-bit signal indicating the end of the visible light signal 400 . The acquisition unit 303 recognizes the end of the visible light signal 400 by the existence of the end flag.

The image processing system 1 performs synchronous processing as image processing, but is not limited thereto. For example, the visible light signal 400 may not include the measurement time 402, and image processing without time synchronization may be performed. As long as the analysis data 404 is included in the visible light signal 400, the visible light signal 400 can be photographed to receive moving image information to display measurement information and moving image information.

In the image processing system 1 according to Embodiment 2, when the end marker is included in the visible light signal 400 , the light emitting unit 106 resumes the stopped transmission of the visible light signal 400 from the first marker 401 . By restarting the transmission from the top marker 401 , the acquisition unit 303 can reliably recognize the visible light signal 400 . The acquisition unit 303 determines that the transmission is interrupted when the visible light signal 400 is not received for a predetermined time (for example, 1 second) or longer even if the end flag is not received, and prepares for retransmission of the visible light signal 400 .

In addition, it is needless to say that it can be provided as an image processing system provided with a configuration for realizing the functions according to the present invention in advance, and it is also possible to use an existing information processing device or the like as the image processing system according to the present invention by operating the program. function. That is, by using a program for realizing each functional configuration of the image processing system 1 exemplified in Embodiment 1 and Embodiment 2, it can be executed by a CPU or the like that controls an existing information processing device, etc. The image processing system functions. In addition, the image processing method according to the present invention can be implemented using an image processing system.

In addition, the operating method of such a program is arbitrary. The program can be stored in a computer-readable storage medium such as a floppy disk, a CD (Compact Disc)-ROM, a DVD (Digital Versatile Disc)-ROM, or a memory card. Furthermore, it is also possible to superimpose the program on a carrier wave and operate it via a communication medium such as the Internet. For example, a bulletin board (BBS: Bulletin Board System) announcement release program on a communication network. In addition, the above-described processing may be executed by starting the program and executing it in the same manner as other application programs under the control of an OS (Operating System).

Preferred embodiments of the present invention have been described above, but the present invention is not limited to the relevant specific embodiments, and the present invention includes the inventions described in the claims and their equivalents.

Claims (17)

1. a kind of image processing apparatus, has:

Acquisition unit obtains the dynamic image information of the image comprising visible light signal and measure object, the visible light signal The measurement information of the measure object with the measurement device measurement by being mounted on the measure object, and filled by the measurement It sets and transmits messages；With

Acquisition unit, the visible light signal contained in the dynamic image information obtained as the acquisition unit obtain institute Measurement information is stated,

The acquisition unit obtains the institute of the minute of the measurement comprising also carrying out the measurement information with the measurement device The dynamic image information of visible light signal is stated,

Acquisition unit visible light signal contained in the dynamic image information obtained as the acquisition unit obtains The minute, based on the minute of acquirement come by the measurement information and the dynamic image information in time It is synchronous.

2. image processing apparatus according to claim 1, wherein

The acquisition unit is the shoot part for shooting the dynamic image information.

3. image processing apparatus according to claim 1, wherein

The acquisition unit is that the reception of the dynamic image information is received from the filming apparatus for having taken the dynamic image information Portion.

4. image processing apparatus according to claim 1, wherein

Described image processing unit is also equipped with:

Display unit shows institute acquired by the acquisition unit dynamic image information obtained and the acquisition unit simultaneously State measurement information.

5. image processing apparatus according to claim 1, wherein

The acquisition unit is obtained comprising also having the described of the visible light signal for the identification information for identifying the measurement device Dynamic image information,

Acquisition unit visible light signal contained in the dynamic image information obtained as the acquisition unit obtains The identification information.

6. image processing apparatus according to claim 1, wherein

The acquisition unit obtains the described of the evaluation of estimate calculated comprising also parsing the measurement information with the measurement device The dynamic image information of visible light signal.

7. image processing apparatus according to claim 4, wherein

The acquisition unit is obtained comprising also having the evaluation of estimate for indicating that the measurement device parses the measurement information and calculates super The dynamic image information of the visible light signal of the warning label of threshold value is crossed,

Acquisition unit visible light signal contained in the dynamic image information obtained as the acquisition unit obtains The warning label,

The display unit is highlighted the dynamic image information in the case where the acquisition unit achieves the warning label On the part comprising the measurement device.

8. image processing apparatus according to claim 4, wherein

Described image processing unit is also equipped with:

Receiving portion receives the instruction for selecting the specific measurement device in multiple measurement devices,

The display unit shows the measurement information for being mounted with the measure object of the selected measurement device simultaneously With the dynamic image information.

9. image processing apparatus according to claim 1, wherein

The measurement information includes the motion information that the measurement device is obtained from the measure object moved.

10. image processing apparatus according to claim 1, wherein

The measurement information includes the Biont information that the measurement device is obtained from the measure object.

11. image processing apparatus according to claim 1, wherein

The measurement information includes the environmental information that the measurement device is obtained from the environment around the measure object.

12. image processing apparatus according to claim 1, wherein

The visible light signal includes the flashing pattern of visible light.

13. image processing apparatus according to claim 1, wherein

The visible light signal includes the different multiple visible lights of wavelength.

14. a kind of measurement device, has:

Determination part is mounted on measure object and measures the measurement information of the measure object；With

Illumination region, the visible light signal for the measurement information determined with the determination part of transmitting messages,

Determination part measurement earth magnetism obtains the angle displacement of the measure object,

The illumination region is transmitted messages the visible light signal in the case where the angle displacement is less than threshold value, in the angle position It moves more than the visible light signal of not transmitting messages in the case where the threshold value.

15. a kind of image processing system, has:

Measurement device is mounted on measure object to measure the measurement information of the measure object, transmits messages with the institute determined State the visible light signal of measurement information；With

Image processing apparatus has the dynamic image letter for obtaining the image comprising the visible light signal and the measure object The acquisition unit of breath and the visible light signal contained in the dynamic image information obtained as the acquisition unit obtain institute The acquisition unit of measurement information is stated,

The acquisition unit obtains the institute of the minute of the measurement comprising also carrying out the measurement information with the measurement device The dynamic image information of visible light signal is stated,

Acquisition unit visible light signal contained in the dynamic image information obtained as the acquisition unit obtains The minute, based on the minute of acquirement come by the measurement information and the dynamic image information in time It is synchronous.

16. a kind of image processing method, comprises the following steps:

The dynamic image information of the image comprising visible light signal and measure object is obtained, the visible light signal has by installing In the measurement information for the measure object that the measurement device of the measure object measures, and transmitted messages by the measurement device；

The visible light signal contained in the dynamic image information obtained obtains the measurement information,

Obtain the visible light letter of the minute of the measurement comprising also carrying out the measurement information with the measurement device Number the dynamic image information,

The visible light signal contained in the dynamic image information obtained obtains the minute, based on acquirement The minute is synchronous in time by the measurement information and the dynamic image information.

17. a kind of recording medium is that record has the image procossing executed in image processing apparatus for realizing computer The computer-readable recording medium of program makes the calculating execute following processing:

Acquisition processing obtains the dynamic image information of the image comprising visible light signal and measure object, the visible light letter Number there is the measurement information of the measure object measured by the measurement device for being mounted on measure object, and by the measurement device It transmits messages；With

Acquirement processing, the visible light signal contained in the dynamic image information obtained obtain the measurement and believe Breath,

The minute for obtaining measurement of the processing acquisition comprising also carrying out the measurement information with the measurement device The dynamic image information of the visible light signal,

The acquirement processing handles the visible light signal contained in the dynamic image information obtained from as the acquisition Obtain the minute, based on the minute of acquirement come by the measurement information and the dynamic image information when Between upper synchronize.