WO2016184152A1

WO2016184152A1 - Measuring method and apparatus, mobile terminal and storage medium

Info

Publication number: WO2016184152A1
Application number: PCT/CN2016/071191
Authority: WO
Inventors: 赵占雄
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-10-23
Filing date: 2016-01-18
Publication date: 2016-11-24
Also published as: CN106610270A

Abstract

A measuring method, comprising: performing image collection on a measured object, and determining the size of a collected objective image of the measured object (101); and determining, according to the size of the objective image of the measured object, a position of the objective image and a distance between the measured object and an image collection device, a first actual length and/or a second actual length of the measured object (102). An image measuring apparatus, a mobile terminal and a storage medium.

Description

Measurement method, device, mobile terminal and storage medium

Technical field

The present invention relates to measurement technology, and in particular, to a measurement method, apparatus, mobile terminal and storage medium for performing measurement by an image acquisition device.

Background technique

People often encounter the problem of measuring the length, width and height in daily life, but as an ordinary mobile terminal user, it is impossible to carry measurement tools such as rulers with them. At present, in the method of measuring with a camera, it is necessary to use a plurality of cameras, computers, distance measuring tools, etc., and sometimes it is necessary to set a reference object, take a plurality of photos, and then use the image calculation of the computer to analyze the reference objects of the plurality of photos. At the same time, combined with the distance measured by the distance measuring tool and the difference in shooting distance of multiple photos, the target object is measured comprehensively.

Although the existing measurement methods have the advantage of measuring long distances and large objects, they are very inconvenient to use, and many additional devices are required to realize the measurement, such as ranging tools, computers, multiple cameras, etc., and high requirements for measurement operations. .

Summary of the invention

In view of this, embodiments of the present invention are directed to providing a measurement method, apparatus, mobile terminal, and storage medium, which are capable of measuring object length, width/height by an image acquisition device in an intelligent mobile terminal.

To achieve the above objective, the technical solution of the embodiment of the present invention is implemented as follows:

An embodiment of the present invention provides a measurement method, where the method includes:

Perform image acquisition on the measured object to determine the size of the collected object image;

According to the size of the object image of the object to be measured, the position of the object image, and the object to be measured and the image collection device The prepared distance determines a first actual length and/or a second actual length of the measured object.

In the above solution, the first actual length is the length of the image collection surface of the object to be measured, and the second actual length is the width/height of the image collection surface of the object to be measured.

In the above solution, the determining the size of the collected object image includes: determining the number of pixels occupied by the object image, the conversion rate of the lens of the image capturing device, and the size of a single photosensitive device of the image capturing device. The size of the collected object image of the measured object.

In the above solution, the position of the object image is the distance between the object image and the lens of the image capturing device, and the distance between the object to be measured and the image capturing device is the distance between the object to be measured and the lens of the image capturing device.

In the above solution, the method further includes: determining a position of the object image, comprising: determining a position of the object image according to one or more of the following parameters:

The starting point of the lens, the moving distance of the single-step lens, the number of single-step lens movements, and the maximum number of movements of the single-step lens.

In the above solution, the method further includes: determining a distance between the measured object and the image capturing device, including: determining a distance between the measured object and the image capturing device according to the position of the object image and the focal length of the lens of the image capturing device.

The embodiment of the invention further provides a measuring device, the device comprising: an image collecting module, an object size determining module, a length determining module, wherein

The image acquisition module is configured to perform image collection on the object to be tested;

The object size determining module is configured to determine a size of the collected object image of the measured object;

The length determining module is configured to determine, according to the size of the object image of the object to be measured, the position of the object image, and the distance between the object to be measured and the image capturing device, the first actual length of the object to be tested and/or the second actual length.

In the above solution, the object size determining module is configured to: according to the number of pixels occupied by the object image, the conversion rate of the lens of the image capturing device, and the large size of a single photosensitive device of the image capturing device. Small, determine the size of the object image of the measured object.

In the above solution, the apparatus further includes a first distance determining module configured to determine the position of the object image according to one or more of the following parameters:

In the above solution, the device further includes a second distance determining module configured to determine a distance between the measured object and the image capturing device according to the position of the object image and the focal length of the lens of the image capturing device.

The embodiment of the invention further provides a mobile terminal, wherein the mobile terminal comprises the above measuring device.

The embodiment of the invention further provides a computer storage medium storing a computer program for performing the measurement method of the embodiment of the invention.

The measurement method, the device, the mobile terminal and the storage medium provided by the embodiments of the present invention first perform image collection on the measured object, determine the size of the collected object image of the measured object, and then according to the size of the object image of the measured object. And determining a first actual length and/or a second actual length of the object to be measured, and a distance between the object and the image capturing device. In this way, the measurement of the length and width/height of the object can be achieved by the image acquisition device of the smart mobile terminal.

DRAWINGS

1 is a schematic flow chart of a measurement method according to an embodiment of the present invention;

2 is a schematic diagram of an image acquisition principle according to an embodiment of the present invention;

3 is a schematic diagram of a measurement range according to an embodiment of the present invention;

4 is a schematic structural flow chart of a measuring device according to an embodiment of the present invention.

detailed description

In the embodiment of the present invention, image acquisition is performed on the object to be measured, and the size of the object image of the measured object is determined; and then according to the size of the object image of the object to be measured, the position of the object image, and the measured pair The first actual length and/or the second actual length of the measured object is determined as the distance from the image acquisition device.

The first actual length is the length of the image collection surface of the object to be measured, and the second actual length is the width/height of the image collection surface of the object to be measured. That is, when the image collection surface of the measured object is perpendicular to the horizontal plane, the first actual length is the length of the image collection surface of the measured object, and the second actual length is the image collection surface of the measured object. a height, when the image collection surface of the object to be measured is parallel to a horizontal plane, the first actual length is a length of the image collection surface of the object to be measured, and the second actual length is an image collection surface of the object to be measured The width.

The implementation of the technical solution of the embodiment of the present invention is described in detail below with reference to the accompanying drawings and embodiments. FIG. 1 is a schematic flowchart of a measurement method according to an embodiment of the present invention. As shown in FIG. 1 , the measurement method in this embodiment includes the following steps:

Step 101: Perform image acquisition on the measured object to determine the size of the collected object image of the measured object.

In the embodiment of the present invention, when starting image acquisition, the basic data and calibration data of the current image acquisition device module are first read. If the image acquisition device is an auto focus module, the basic reading can be directly performed. The data and calibration data include: horizontal resolution w0, vertical resolution h0, size p of a single photosensitive spot, distance e of hyperfocal distance, single-step lens moving distance d0, lens shift and object distance correspondence table u, lens starting point v0, The focal length f of the lens, the maximum number of movements n, the refractive index r, and the like. Then, the read information is saved, and the module is calibrated so that the lens of the image acquisition device can move linearly, thereby ensuring that the focal length can be calculated by using the moving distance. If the image capturing device adopts a fixed focus module, the basic data and calibration data that can be directly read include: horizontal resolution w, vertical resolution h, size p of a single photosensitive spot, starting point of the lens v0, lens The focal length f and so on. The fixed focus module does not involve lens movement and does not require module calibration.

In the embodiment of the present invention, for the autofocus group mode, it is also required to follow the focus command of the platform. Line focusing operation. In an embodiment, the focus is triggered according to the sharpness of the current picture, and the control module moves the lens to cause the image capture device to present a clear picture. In the embodiment of the present invention, the number of single moving steps can also be configured according to the performance requirement. The more the single moving step, the faster the focusing speed is, and the faster the measurement is completed, but the accuracy may be reduced because the single moving step is larger. Indicates that the image distance changes more clearly.

In the embodiment of the present invention, the method further includes: reading a maximum size supported by the image collection device, and setting a preview mode. The maximum size supported by the image acquisition device can be considered as an image acquisition device that outputs a pixel corresponding to a single photosensor. If the image capture device supports the maximum size preview, set the preview to the maximum size. If the maximum size preview is not supported, you can configure the preview to be 1/2, 1/4, etc., but you need to record the conversion ratio. The conversion ratio is one pixel for several sensory devices, for example, when configured as a 1/4 size preview, that is, four photosensitive devices correspond to one pixel. Configure the focus function to start while opening the preview for the preview size. After the focus function is activated, the image capture device adjusts the camera in real time according to the currently previewed screen to make the preview image clear.

2 is a schematic diagram of an image acquisition principle according to an embodiment of the present invention. In the embodiment of the present invention, determining the size of the collected object image includes: a number of pixels occupied by the object image, and a lens of the image acquisition device. The conversion rate and the size of a single photosensitive device of the image acquisition device determine the size of the image of the object to be measured.

In an embodiment, after the image collecting device collects the image of the measured object, if the terminal device has the function of object recognition, the edge of the automatically acquired object may be used to achieve the effect of the automatically configured measuring range; By manually configuring, the user can determine the measurement range by dragging the cursor on the screen according to the position of the object to be measured in the image, so that the measured object is within the measurement range, and the measurement configuration is completed. The final determined measurement range is shown in FIG. Show, arrow

For cursors, dashed boxes

For the measurement range.

The size of the object includes the image height in the horizontal direction and the image height in the vertical direction. The imaging height above the optical device, as shown by m in Fig. 2, can be calculated according to the number of imaging occupied pixels, that is, the horizontal measurement range w and the vertical measurement range h. In Fig. 2, the imaging height m is equal to the number of pixels (horizontal measurement) The range/vertical measurement range is multiplied by the conversion ratio r and multiplied by the size p of a single photosensitive device. which is:

horizontal direction:

Vertical direction:

Step 102: Determine a first actual length and/or a second actual length of the object to be tested according to the size of the object image of the object to be measured, the position of the object image, and the distance between the object to be measured and the image capturing device.

The first actual length is the length of the image collection surface of the object to be measured, and the second actual length is the width/height of the image collection surface of the object to be measured.

The position of the object image is the distance between the object image and the lens of the image capturing device, and the distance between the object to be measured and the image capturing device is the distance between the object to be measured and the lens of the image capturing device.

In the embodiment of the present invention, before determining the first actual length and/or the second actual length of the measured object, the method further includes: determining a position of the object image, including: according to one or more of the following parameters Kind, determine the position of the object image: the starting point of the lens, the moving distance of the single-step lens, the number of single-step lens movements, and the maximum number of movements of the single-step lens.

As shown in FIG. 2, when the image capturing device adopts a fixed focus mode, the position of the object image and the distance v between the object image and the lens of the image capturing device are the starting point v0 of the lens, namely:

v=v0;

When the image capturing device adopts an autofocus group mode, and the distance between the measured object and the image capturing device is within a hyperfocal range, the distance v between the object image and the lens of the image capturing device is the starting point of the lens v0 and the single step lens The sum of the product of the moving distance d0 and the number of movements c, namely:

v=v0+c×d0;

When the image capturing device adopts an autofocus group mode, and the measured object and the image collecting device When the distance is outside the range of the hyperfocal distance, the distance v between the object image and the lens of the image capturing device is the sum of the product of the starting point v0 of the lens and the moving distance d0 of the single step lens and the maximum number of movements n, namely:

v=v0+n×d0;

In the embodiment of the present invention, before determining the first actual length and/or the second actual length of the measured object, the method further includes: determining a distance between the measured object and the image capturing device, including: according to the object image The position and the focal length of the lens of the image acquisition device determine the distance between the object under test and the image acquisition device.

As shown in FIG. 2, when the image capturing device adopts a focusing module and the distance between the measured object and the image capturing device is within a hyperfocal range, the object to be measured and the image capturing device can be directly queried from the calibration table. Distance u;

When the distance between the measured object and the image capturing device is outside the hyperfocal range, or when the image capturing device adopts the fixed focus mode, the object to be measured is determined according to the position v of the object image and the focal length f of the lens of the image capturing device. Distance u from the image acquisition device:

because:

and so:

Finally, the first actual length and/or the second actual length of the measured object is determined according to the size of the object image of the object to be measured, the position of the object image, and the distance between the object to be measured and the image capturing device.

As shown in FIG. 2, the second actual length x of the measured pair is determined as an example. According to the geometric principle, it can be known that:

then

Finally, the measurement results are output through the display.

The measurement method according to the embodiment of the present invention will be described below with reference to examples.

Using existing mobile terminal equipment, equipped with Qualcomm 8939 platform and Android 4.4 system, integrated autofocus algorithm on Qualcomm platform, image acquisition equipment using Sony 13M camera.

First, the code to extend the Qualcomm kernel part includes: reading and storing the camera OTP information; providing an IO interface for the HAL to read data.

Then, the interface of the Qualcomm HAL layer is extended, including: reading the camera OTP information initialized by the kernel; and packaging the Param for the upper layer application to read the data.

Finally, the measurement range configuration and measurement results are displayed at the application layer.

In the actual implementation process:

The Qualcomm platform supports 13M full-size preview, so this example uses Sony's full-size preview. According to the information provided by Sony, it can be determined:

W0=4208;

H0=3120;

Other camera information also includes:

p=1.12 μm;

f=3.81;

D0 = 2.24 μm;

e=2m;

V0=1.2mm;

n=60;

r=1;

The size of the measurement area obtained from the measurement configuration is:

w = width of the user configuration;

h=The height of the user configuration.

The embodiment of the present invention further provides a measuring device, which is located in a mobile terminal. FIG. 4 is a schematic structural diagram of a measuring device according to an embodiment of the present invention. As shown in FIG. 4, the device includes an image capturing module 41 and an object size determining module. 42. A length determining module 43, wherein

The image acquisition module 41 is configured to perform image collection on the measured object;

In the embodiment of the present invention, the device further includes a calibration module 44 configured to first read basic data and calibration data of the current image acquisition device module before starting image acquisition, if the image acquisition device is automatically The focus module, the basic data and calibration data that can be directly read include: horizontal resolution w0, vertical resolution h0, size p of a single photosensitive spot, distance e of hyperfocal distance, single-step lens moving distance d0, lens movement and The object distance correspondence table u, the starting point v0 of the lens, the focal length f of the lens, the maximum number of movements n, the refractive index r, and the like. Then, the read information is saved, and the module is calibrated, so that the camera of the image acquisition device can move linearly, thereby ensuring that the focal length can be calculated by using the moving distance. If the image capturing device adopts a fixed focus module, the basic data and calibration data that can be directly read include: horizontal resolution w, vertical resolution h, size p of a single photosensitive spot, starting point of the lens v0, lens The focal length f and so on. The fixed focus module does not involve lens movement and does not require module calibration.

In the embodiment of the present invention, the device further includes a focusing module 45 configured to perform a focusing operation on the AF group mode according to a focus instruction of the platform. In an embodiment, the focus is triggered according to the sharpness of the current picture, and the control module moves the lens to cause the image capture device to present a clear picture. In the embodiment of the present invention, the number of single moving steps can also be configured according to the performance requirement. The more the single moving step, the faster the focusing speed is, and the faster the measurement is completed, but the accuracy may be reduced because the single moving step is larger. Indicates that the image distance changes more clearly.

In the embodiment of the present invention, the device further includes a control module 46 configured to read the maximum size supported by the image collection device and set a preview mode. The maximum size supported by the image acquisition device can be considered as an image acquisition device that outputs a pixel corresponding to a single photosensor. If the image capture device supports the maximum size preview, set the preview to the maximum size. If the maximum size preview is not supported, you can configure the preview to be 1/2, 1/4, etc., but you need to record the conversion ratio. The conversion ratio is corresponding to one pixel of several photosensitive devices. For example, when configured as a 1/4 size preview, four photosensitive devices correspond to one pixel. Configure the focus function to start while opening the preview for the preview size. After the focus function is activated, the image capture device will be based on the current Preview the picture and adjust the camera in real time to make the preview picture clear.

The object size determining module 42 is configured to determine the size of the collected object image of the measured object;

In the embodiment of the present invention, the object size determining module 42 is configured to determine the collected image according to the number of pixels occupied by the object image, the conversion rate of the lens of the image capturing device, and the size of a single photosensitive device of the image capturing device. The size of the object image of the object.

In an embodiment, after the image acquisition module 41 acquires the image of the object under test, if the terminal device has the function of object recognition, the object size determination module 42 can achieve the automatically configured measurement range by automatically acquiring the edge of the object. The image size determining module 42 can also be manually configured. The user can determine the measuring range by dragging the cursor on the screen according to the position of the measured object in the image, so that the measured object is within the measuring range, and the measurement configuration is completed. .

The size of the object image includes the image height in the horizontal direction and the image height in the vertical direction. The image height is the imaging height of the object above the photosensitive device. As shown by m in Fig. 2, the height can be measured according to the number of pixels occupied by the image, that is, the horizontal measurement range w and The vertical measurement range h is calculated. In Fig. 2, the imaging height m is equal to the number of pixels (horizontal measurement range/vertical measurement range) multiplied by the conversion ratio r and multiplied by the size p of a single photosensitive device. which is:

horizontal direction:

Vertical direction:

The length determining module 43 is configured to determine a first actual length and/or a second of the measured object according to the size of the object image of the object to be measured, the position of the object image, and the distance between the object to be measured and the image capturing device. Actual length.

In the embodiment of the present invention, the device further includes a first distance determining module 47 configured to determine the position of the object image according to one or more of the following parameters: a starting point of the lens, a single-step lens moving distance, and a single-step lens The number of moves, the maximum number of moves for a single-step lens.

v=v0;

v=v0+c×d0;

When the image capturing device adopts an autofocus group mode and the distance between the measured object and the image capturing device is outside the hyperfocal range, the distance v between the object image and the lens of the image capturing device is the starting point of the lens v0 and the single step lens The sum of the product of the moving distance d0 and the maximum number of movements n, namely:

v=v0+n×d0;

In the embodiment of the present invention, the device further includes a second distance determining module 48 configured to determine a distance between the measured object and the image capturing device. In an embodiment, according to the position of the object image and the focal length of the lens of the image capturing device, Determine the distance between the measured object and the image acquisition device.

because:

and so:

In the embodiment of the present invention, the length determining module 43 determines the first actual length of the measured object according to the size of the object image of the object to be measured, the position of the object image, and the distance between the object to be measured and the image capturing device. Or the second actual length of the process is:

For example, to determine the second actual length x of the measured pair of symmetry, according to the geometric principle:

then

In the embodiment of the present invention, the device further includes an output module 47 configured to output the measurement result through the display.

The measurement method and device according to the embodiment of the invention can realize the measurement function without additional hardware, has good implementability, and significantly improves the user experience.

The embodiment of the invention further provides a mobile terminal, which comprises the measuring device of FIG.

Each module in the measurement device provided in the embodiment of the present invention may be implemented by a processor, and may also be implemented by a specific logic circuit; wherein the processor may be a processor on a mobile terminal or a server, in practical applications. The processor may be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP), or a field programmable gate array (FPGA).

In the embodiment of the present invention, if the foregoing method for supporting multiple wireless network access is implemented in the form of a software function module and sold or used as a standalone product, it may also be stored in a computer readable storage medium. Based on such understanding, the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product stored in a storage medium, including a plurality of instructions. Make a calculation The device (which may be a personal computer, server, or network device, etc.) performs all or part of the methods described in various embodiments of the present invention. The foregoing storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read only memory (ROM), a magnetic disk, or an optical disk. Thus, embodiments of the invention are not limited to any specific combination of hardware and software.

Correspondingly, the embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores a computer program for performing the above measurement method of the embodiment of the present invention.

The above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention.

Claims

A method of measurement, the method comprising:

Perform image acquisition on the measured object to determine the size of the collected object image;

The first actual length and/or the second actual length of the object to be measured is determined according to the size of the object image of the object to be measured, the position of the object image, and the distance of the object to be measured from the image capturing device.
The method according to claim 1, wherein said first actual length is a length of an image collection surface of the object to be measured, and said second actual length is a width/height of an image collection surface of said object to be measured.
The method according to claim 1, wherein the determining the size of the collected object image includes: a number of pixels occupied by the object image, a conversion rate of a lens of the image capturing device, and a single image capturing device. The size of the photosensitive device determines the size of the image of the object to be measured.
The method according to claim 1, wherein the position of the object image is the distance between the object image and the lens of the image capturing device, and the distance between the object to be measured and the image capturing device is the distance between the object to be measured and the lens of the image capturing device.
The method according to claim 1 or 4, wherein the method further comprises: determining the position of the object image, comprising: determining the position of the object image according to one or more of the following parameters:

The starting point of the lens, the moving distance of the single-step lens, the number of single-step lens movements, and the maximum number of movements of the single-step lens.
The method according to claim 1 or 4, wherein the method further comprises: determining a distance between the measured object and the image capturing device, comprising: determining the measured object and the image according to the position of the object image and the focal length of the lens of the image capturing device; The distance from the collection device.
A measuring device, comprising: an image collecting module, an object size determining module, a length determining module, wherein

The image acquisition module is configured to perform image collection on the object to be tested;

The object size determining module is configured to determine a size of the collected object image of the measured object;

The length determining module is configured to determine, according to the size of the object image of the object to be measured, the position of the object image, and the distance between the object to be measured and the image capturing device, the first actual length of the object to be tested and/or the second actual length.
The apparatus according to claim 7, wherein the object size determining module is configured to determine the acquisition according to the number of pixels occupied by the object image, the conversion rate of the lens of the image capturing device, and the size of a single photosensitive device of the image capturing device. The size of the object image of the object to be measured.
The apparatus of claim 7 wherein said apparatus further comprises a first distance determination module configured to determine the location of the object image based on one or more of the following parameters:

The starting point of the lens, the moving distance of the single-step lens, the number of single-step lens movements, and the maximum number of movements of the single-step lens.
The apparatus of claim 7, wherein said apparatus further comprises a second distance determining module configured to determine a distance of the object to be measured from the image capture device based on the position of the object image and the focal length of the lens of the image capture device.
A mobile terminal comprising the measuring device according to any one of claims 7 to 10.
A computer storage medium having stored therein computer executable instructions for performing the measurement method of any one of claims 1 to 6.