[go: up one dir, main page]

CN111698413A - Object image acquisition method and device and electronic equipment - Google Patents

Object image acquisition method and device and electronic equipment Download PDF

Info

Publication number
CN111698413A
CN111698413A CN201910188882.1A CN201910188882A CN111698413A CN 111698413 A CN111698413 A CN 111698413A CN 201910188882 A CN201910188882 A CN 201910188882A CN 111698413 A CN111698413 A CN 111698413A
Authority
CN
China
Prior art keywords
image
magnification
target
image acquisition
position information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910188882.1A
Other languages
Chinese (zh)
Other versions
CN111698413B (en
Inventor
蒋赵贵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Priority to CN201910188882.1A priority Critical patent/CN111698413B/en
Publication of CN111698413A publication Critical patent/CN111698413A/en
Application granted granted Critical
Publication of CN111698413B publication Critical patent/CN111698413B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/69Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The embodiment of the invention provides an object image acquisition method, an object image acquisition device and electronic equipment, wherein the method comprises the following steps: obtaining first position information of an object identified from a panoramic image; performing the following steps based on the first position information of each identified object to obtain a close-up image of each identified object from the panoramic image; adjusting the position and the magnification of the image acquisition equipment at least twice based on the first position information of the target object and a preset magnification adjustment strategy to enable the magnification of the image acquisition equipment to reach the target magnification, adjusting the position of the image acquisition equipment before adjusting the magnification of the image acquisition equipment each time to enable the target object to be in a target acquisition area of the image acquisition equipment, wherein the target object is as follows: one of the objects identified from the panoramic image; and obtaining a close-up image of the target object to acquire the close-up image of the target object more accurately, and reducing the probability of the situation that the close-up image of the target object cannot be acquired due to the fact that the magnification is adjusted.

Description

Object image acquisition method and device and electronic equipment
Technical Field
The present invention relates to the field of monitoring technologies, and in particular, to a method and an apparatus for acquiring an image of an object, and an electronic device.
Background
In some scenes, position information of an object existing in a target area is recognized from a panoramic image obtained by panoramic shooting of an image acquisition device for the target area, and then, based on the recognized position information of each object, the position of the image acquisition device is adjusted, so that the object is located at the center position of the acquisition area of the image acquisition device, and then the magnification of the image acquisition device is adjusted, so that the image acquisition device can acquire an image capable of effectively recognizing detail information of the object based on the adjusted position and magnification, and the image capable of effectively recognizing the detail information of the object can be called as: a close-up image of the subject; subsequently, detailed information of the object can be identified from the close-up image. Wherein, the detail information of the object may include: the specific content of the object and/or characteristic information of the object.
However, in the related art, in adjusting the magnification of the image pickup apparatus, the magnification of the image pickup apparatus is directly adjusted up to a target magnification at which a close-up image of the subject can be obtained. In the process of adjusting the magnification, when the orientation of the object in the target area is relatively inclined with respect to the shooting direction of the image capturing device, that is, an included angle between the orientation of the object in the target area and the shooting direction of the image capturing device is a preset angle, for example, an angle smaller than 175 degrees, when the magnification of the image capturing device is directly increased to a target magnification at which a close-up image of the object can be obtained, due to the increase of the magnification of the image capturing device, the included angle between the orientation of the object in the target area and the shooting direction of the image capturing device may be enlarged, an image capturing error may be caused, at this time, a situation that the object to be captured overflows the capturing area of the image capturing device may occur, at this time, a situation that the close-up image of the object cannot be captured may be caused, and a poor use experience may be brought.
Disclosure of Invention
The embodiment of the invention aims to provide an object image acquisition method, an object image acquisition device and electronic equipment, so that a close-up image of an object can be acquired more accurately, and the probability of the situation that the close-up image of the object cannot be acquired due to the fact that the magnification is adjusted is reduced. The specific technical scheme is as follows:
in one aspect, an embodiment of the present invention provides an image acquisition method for an object, where the method includes:
obtaining first position information of an object identified from a panoramic image, wherein the panoramic image is: the image acquisition equipment carries out panoramic shooting on a target area to obtain an image;
performing the following steps based on the first position information of each identified object from the panoramic image to obtain a close-up image of each identified object;
adjusting the position and the magnification of the image acquisition equipment at least twice based on first position information of a target object and a preset magnification adjustment strategy to enable the magnification of the image acquisition equipment to reach a target magnification, wherein the position of the image acquisition equipment is adjusted to enable the target object to be located in a target acquisition area of the image acquisition equipment before the magnification of the image acquisition equipment is adjusted each time, and the target object is: one of the objects identified from the panoramic image;
obtaining a close-up image of the target object, wherein the close-up image is: the image acquisition equipment is positioned at a target position and is based on an image acquired by the target magnification, and the target position is as follows: and the position corresponding to the target magnification.
Optionally, the step of adjusting the position and the magnification of the image capturing device at least twice based on the first position information of the target object and a preset magnification adjustment policy, so that the magnification of the image capturing device reaches a target magnification includes:
controlling the image acquisition equipment to rotate to a new current position of a target acquisition area of the image acquisition equipment based on first position information of a target object;
increasing the magnification of the image acquisition equipment from the current magnification to a first magnification as a new current magnification of the image acquisition equipment, wherein the first magnification is smaller than a target magnification;
obtaining new first position information of the target object identified from a first image, wherein the first image is: the image acquisition device is located at the new current position and acquires an image based on the new current magnification;
controlling the image acquisition device to rotate to a new current position of a target acquisition area of the image acquisition device based on the new first position information of the target object;
and increasing the magnification of the image acquisition equipment from the new current magnification to the target magnification.
Optionally, before the step of increasing the magnification of the image capturing apparatus from the new current magnification to the target magnification, the method further includes:
judging whether a multiplying power to be adjusted which is larger than the new current multiplying power and smaller than the target multiplying power exists or not;
and if the magnification to be adjusted which is larger than the new current magnification and smaller than the target magnification does not exist, executing the step of increasing the magnification of the image acquisition equipment from the new current magnification to the target magnification.
Optionally, the method further comprises:
if the magnification to be adjusted which is larger than the new current magnification and smaller than the target magnification is judged to exist, the magnification of the image acquisition equipment is increased from the new current magnification to the current minimum magnification in the magnification to be adjusted, and the current magnification of the image acquisition equipment is used as the new current magnification of the image acquisition equipment;
obtaining new first position information of the target object identified from a new first image, wherein the new first image is: the image acquisition device is located at the new current position and acquires an image based on the new current magnification;
controlling the image acquisition device to rotate to a new current position of a target acquisition area of the image acquisition device based on new first position information of the target object identified from the new first image;
and executing the step of judging whether the multiplying power to be adjusted is larger than the new current multiplying power and smaller than the target multiplying power.
Optionally, the target acquisition area corresponds to a central position of an image acquired by the image acquisition device;
the step of obtaining new first position information of the target object identified from the first image includes:
obtaining a first image;
identifying new first position information of each object from the first image;
and determining new first position information of the target object from the identified new first position information of each object based on the central position of the first image.
Optionally, the step of determining new first position information of the target object from the new first position information of the identified objects based on the center position of the first image includes:
and determining new first position information with the minimum distance between the corresponding position and the central position of the first image from the identified new first position information of each object as the new first position information of the target object based on the central position of the first image.
Optionally, the target area is an area where a shelf is located, and the object is a price tag of a product displayed on the shelf.
Optionally, after the step of obtaining a close-up image of the target object, the method further comprises:
and identifying and obtaining detail information of the target object from the close-up image.
In another aspect, an embodiment of the present invention provides an apparatus for acquiring an image of an object, where the apparatus includes:
an obtaining module, configured to obtain first position information of an object identified from a panoramic image, where the panoramic image is: the image acquisition equipment carries out panoramic shooting on a target area to obtain an image;
an execution module for performing the following steps based on the first position information of each object identified from the panoramic image to obtain a close-up image of each object identified; wherein the execution module comprises:
the adjusting sub-module is configured to adjust the position and the magnification of the image capturing device at least twice based on first position information of a target object and a preset magnification adjusting policy, so that the magnification of the image capturing device reaches a target magnification, wherein the position of the image capturing device is adjusted before the magnification of the image capturing device is adjusted each time, so that the target object is located in a target capturing area of the image capturing device, and the target object is: one of the objects identified from the panoramic image;
an obtaining sub-module for obtaining a close-up image of the target object, wherein the close-up image is: the image acquisition equipment is positioned at a target position and is based on an image acquired by the target magnification, and the target position is as follows: and the position corresponding to the target magnification.
Optionally, the adjusting sub-module includes:
the first control unit is used for controlling the image acquisition equipment to rotate to a new current position of a target acquisition area of the image acquisition equipment on the basis of first position information of a target object;
the first magnification adjusting unit is used for adjusting the magnification of the image acquisition equipment from the current magnification to a first magnification as a new current magnification of the image acquisition equipment, wherein the first magnification is smaller than a target magnification;
a first obtaining unit, configured to obtain new first position information of the target object identified from a first image, where the first image is: the image acquisition device is located at the new current position and acquires an image based on the new current magnification;
a second control unit, configured to control the image capturing device to rotate to a new current position where the target object is located in a target capturing area of the image capturing device based on the new first position information of the target object;
and the second enlarging unit is used for enlarging the multiplying power of the image acquisition equipment from the new current multiplying power to the target multiplying power.
Optionally, the adjusting sub-module further includes:
a judging unit, configured to judge whether there is a magnification to be adjusted that is greater than the new current magnification and less than the target magnification before the magnification of the image capturing apparatus is increased from the new current magnification to the target magnification;
and if the magnification to be adjusted which is larger than the new current magnification and smaller than the target magnification does not exist, triggering the second enlarging unit.
Optionally, the adjusting sub-module further includes:
a third enlarging unit, configured to, if it is determined that there is a magnification to be adjusted that is greater than the new current magnification and smaller than the target magnification, enlarge the magnification of the image capturing device from the new current magnification to a current minimum magnification among the magnifications to be adjusted, and use the enlarged magnification as a new current magnification of the image capturing device;
a second obtaining unit configured to obtain new first position information of the target object identified from a new first image, where the new first image is: the image acquisition device is located at the new current position and acquires an image based on the new current magnification;
a third control unit, configured to control the image capturing device to rotate to a new current position where the target object is located in a target capturing area of the image capturing device, based on new first position information of the target object identified from the new first image; and triggering the judging unit.
Optionally, the target acquisition area corresponds to a central position of an image acquired by the image acquisition device;
the first obtaining unit includes:
an obtaining subunit configured to obtain a first image;
an identifying subunit, configured to identify new first location information of each object from the first image;
a determining subunit, configured to determine, based on the center position of the first image, new first position information of the target object from the new first position information of the identified objects.
Optionally, the determining subunit is specifically configured to
And determining new first position information with the minimum distance between the corresponding position and the central position of the first image from the identified new first position information of each object as the new first position information of the target object based on the central position of the first image.
Optionally, the target area is an area where a shelf is located, and the object is a price tag of a product displayed on the shelf.
Optionally, the apparatus further comprises:
an identification module for identifying detail information of the target object from the close-up image after the obtaining of the close-up image of the target object.
On the other hand, the embodiment of the invention provides electronic equipment, which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;
a memory for storing a computer program;
the processor is configured to implement the steps of the image obtaining method for the object according to any one of the above embodiments of the present invention when executing the computer program stored in the memory.
In another aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the image obtaining method for an object according to any one of the above-mentioned embodiments are implemented.
In the technical solution provided in the embodiment of the present invention, first position information of an object identified from a panoramic image is obtained, where the panoramic image is: the image acquisition equipment carries out panoramic shooting on a target area to obtain an image; performing the following steps based on the first position information of each identified object in the panoramic image to obtain a close-up image of each identified object; based on the first position information of the target object and a preset magnification adjusting strategy, adjusting the position and the magnification of the image acquisition equipment at least twice to enable the magnification of the image acquisition equipment to reach the target magnification, wherein before the magnification of the image acquisition equipment is adjusted each time, the position of the image acquisition equipment is adjusted to enable the target object to be located in a target acquisition area of the image acquisition equipment, and the target object is: one of the objects identified from the panoramic image; obtaining a close-up image of the target object, wherein the close-up image is: the image acquisition equipment is located the image that the target position and gather based on the target magnification, and the target position is: and the position corresponding to the target magnification.
In the embodiment of the invention, when the close-up image of the object is acquired, the position and the magnification of the image acquisition equipment are adjusted at least twice, so that the magnification of the image acquisition equipment reaches the target magnification, and before the magnification of the image acquisition equipment is adjusted each time, the position of the image acquisition equipment is adjusted firstly, so that the object is in the target acquisition area of the image acquisition equipment. In the process of adjusting the magnification of the image acquisition equipment for multiple times, the position of the object in the acquisition area of the image acquisition equipment is corrected for multiple times, the occurrence of the situation that the object overflows the acquisition area of the image acquisition equipment is reduced, the object can be acquired more accurately to obtain a close-up image, and the probability that the situation that the close-up image of the object cannot be acquired due to the fact that the magnification is adjusted is reduced. Of course, it is not necessary for any product or method of practicing the invention to achieve all of the above-described advantages at the same time.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of an image obtaining method of an object according to an embodiment of the present invention;
FIG. 2 is a diagram showing the relative relationship between the orientation of an object in a target area and the shooting direction of an image capturing device;
fig. 3 is a schematic flowchart of a process of adjusting the position and magnification of an image capturing device according to an embodiment of the present invention;
fig. 4 is another schematic flowchart of a process of adjusting the position and magnification of an image capturing device according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of an apparatus for acquiring an image of an object according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention provides an image acquisition method and device for an object and electronic equipment, which are used for accurately acquiring a close-up image of the object and reducing the probability of incapability of acquiring the close-up image of the object caused by adjusting the magnification.
As shown in fig. 1, an embodiment of the present invention provides an image acquiring method of an object, which may include the following steps:
s101: obtaining first position information of an object identified from a panoramic image;
wherein, the panoramic image is: the image acquisition equipment carries out panoramic shooting on a target area to obtain an image;
it is understood that the image acquisition method of the object provided by the embodiment of the invention can be applied to any type of electronic equipment. In one case, the electronic device may be an image capturing device, in which case the image capturing device may control itself to achieve the acquisition of the image of the object. In another case, the electronic device may be a device other than the image capturing device, and in this case, the electronic device may be connected to the image capturing device, so that the image capturing device may be controlled to obtain the image of the object.
In one case, the image capturing device is a steerable image capturing device, i.e., a rotatable image capturing device, such as a ball camera and a pan/tilt camera.
In one implementation, after the image capturing device performs panoramic shooting on the target area to obtain a panoramic image, the image capturing device may directly identify each object and first location information of each object from the panoramic image, and then send the identified first location information of each object to the electronic device, and the electronic device obtains the first location information of the object identified from the panoramic image.
In another implementation manner, after the image acquisition device performs panoramic shooting on the target area to obtain a panoramic image, the panoramic image is directly sent to the electronic device, and the electronic device identifies each object and the first position information of each object from the panoramic image.
The process of identifying each object and the first position information of each object from the panoramic image may be: identifying each object and first position information of each object from the panoramic image based on a preset target identification model, wherein the preset target identification model is as follows: the resulting model is trained in advance based on a plurality of sample images, which are images containing the object. The preset target recognition model may be: based on a machine learning algorithm such as a convolutional neural network or a deep neural network, a model obtained by training a plurality of sample images is used for identifying the contained objects and the position information of each object from the images.
In one case, the process of training to obtain the preset target recognition model may include the following steps:
the electronic device may first obtain an initial target recognition model, and obtain a sample image required for training, where the sample image includes an object, and the object included in the sample image may be referred to as a sample object. Furthermore, each sample image is calibrated, that is, calibration position information of the sample object contained in the sample image is identified from the sample image, wherein the sample object in the sample image can be identified by using a rectangular frame to identify the calibration position information of the sample object. The calibration process can be manual calibration by an operator, or can be calibration of the electronic device through a specific program.
Subsequently, the electronic equipment inputs a sample image into the initial target recognition model, the initial target recognition model extracts sample image features of the sample image, classifies the sample image features, outputs predicted position information aiming at a sample object in the sample image, and calculates a difference value between the output predicted position information and corresponding calibrated position information by using a preset loss function; and when the difference value is larger than a preset value, adjusting parameters of an initial target recognition model based on the obtained difference value, further circularly inputting the sample image into the initial target recognition model, and representing convergence of the initial target recognition model after the difference value is smaller than the preset value, namely finishing training of the initial target recognition model to obtain the preset target recognition model. Subsequently, each object and first position information of each object are identified from the panoramic image based on the obtained preset target identification model.
In one case, the obtained first position information of the object identified from the panoramic image may include one or more, and when one is included, a subsequent image acquisition process of the object may be performed directly based on the first position information of the object identified from the panoramic image; when a plurality of objects are included, a subsequent image acquisition process of the objects may be performed directly based on the first position information of each object identified from the panoramic image.
S102: performing the following steps based on the first position information of each identified object in the panoramic image to obtain a close-up image of each identified object;
s1021: adjusting the position and the magnification of the image acquisition equipment at least twice based on the first position information of the target object and a preset magnification adjustment strategy, so that the magnification of the image acquisition equipment reaches the target magnification, wherein the position of the image acquisition equipment is adjusted before the magnification of the image acquisition equipment is adjusted each time, so that the target object is in a target acquisition area of the image acquisition equipment, and the target object is: one of the objects identified from the panoramic image;
wherein, the target multiplying power is as follows: the image capturing apparatus captures a magnification required to obtain a close-up image of a target object in a target region. The magnification required for the image capture device to capture a close-up image of each object in the target region may be the same.
In one case, the target area is determined, and the position and magnification at which the image capture device is able to capture a panoramic image of the target area are determined, the target magnification required for the image capture device to capture a close-up image of each object in the target area can be determined. In the embodiment of the present invention, the local or connected storage device of the electronic device may store in advance a target magnification required by the image capturing device to capture a close-up image of each object in the target area.
The preset magnification adjustment strategy may be: and the strategy is used for limiting the adjustment times and the adjustment mode for adjusting the position and the magnification of the image acquisition equipment.
In one implementation, the preset magnification adjustment policy may include a magnification to be adjusted, where the magnification to be adjusted is: the set magnification to which the image acquisition device needs to be adjusted. The magnification to be adjusted at least comprises the target magnification, and the target magnification is the magnification with the largest value in the magnification to be adjusted. When the magnification to be adjusted is two, the position and the magnification of the image acquisition equipment which needs to be adjusted twice can be represented, and when the magnification to be adjusted is three, the position and the magnification of the image acquisition equipment which needs to be adjusted three times can be represented, and the like.
The process of adjusting the position and the magnification of the image capturing device at least twice based on the first position information of the target object and the preset magnification adjustment policy to make the magnification of the image capturing device reach the target magnification may be: gradually adjusting the magnification of the image acquisition equipment from the current magnification to each magnification to be adjusted until the magnification is adjusted to the target magnification, namely the maximum magnification to be adjusted; before adjusting to each magnification to be adjusted, adjusting the position of the image acquisition equipment so that the target object can be in the target acquisition area of the image acquisition equipment. In the process of sequentially adjusting the magnification of the image acquisition device from the current magnification to each magnification to be adjusted, the magnification of the image acquisition device needs to be sequentially adjusted from the current magnification to each magnification to be adjusted according to the size of each magnification to be adjusted. The current magnification is the magnification when the panoramic image is acquired by the image acquisition equipment.
In another implementation manner, the preset magnification adjustment policy may include an adjustment number, and the process of adjusting the position and the magnification of the image capturing device at least twice based on the first position information of the target object and the preset magnification adjustment policy to make the magnification of the image capturing device reach the target magnification may be: determining the adjusting times of the multiplying power to be adjusted directly based on the adjusting times, the target multiplying power and the multiplying power of the panoramic image acquired by the image acquisition equipment, wherein the maximum multiplying power contained in the multiplying power to be adjusted is the target multiplying power; then, gradually adjusting the magnification of the image acquisition equipment from the current magnification to each magnification to be adjusted until the magnification is adjusted to the target magnification, namely the maximum magnification to be adjusted; before adjusting to each magnification to be adjusted, adjusting the position of the image acquisition equipment so that the target object can be in the target acquisition area of the image acquisition equipment.
The adjusting times and the magnifications to be adjusted are determined based on the adjusting times, the target magnifications and the magnifications obtained by the image acquisition equipment when the panoramic image is acquired, and the adjusting times and the magnifications to be adjusted are determined based on the target magnifications and the magnifications obtained by the image acquisition equipment when the panoramic image is acquired. For example: when the current magnification is 1, the target magnification is 4, and the adjustment times are 2, the determined magnification to be adjusted may be: 2.5 and 4.
In one case, in order to better ensure that a close-up image of the target object is acquired, the target acquisition area of the image acquisition device is: the central area of the acquisition area of the image acquisition equipment, when the target object is in the central area of the acquisition area of the image acquisition equipment, the target object is positioned at the central position of the image in the image acquired by the image acquisition equipment. The target object is located in a central area of an acquisition area of the image acquisition device, and may refer to: the distance between the center of the target object and the center of the acquisition area of the image acquisition device does not exceed a preset distance threshold.
S1022: obtaining a close-up image of the target object, wherein the close-up image is: the image acquisition equipment is located at a target position and is based on an image acquired by a target multiplying power, and the target position is as follows: and the position corresponding to the target magnification.
It can be understood that, before the magnification of the image acquisition device is adjusted each time, the position of the image acquisition device needs to be adjusted first, and in the adjustment process, a one-to-one correspondence relationship exists between the position of the image acquisition device and the magnification. After the magnification of the image acquisition device is adjusted to the target magnification, the position of the image acquisition device is the target position corresponding to the target magnification, the image acquisition device is located at the target position and can acquire and obtain a close-up image of the target object based on the target magnification, and then the close-up image of the target object is sent to the electronic device, and the electronic device obtains the close-up image of the target object.
In one implementation, after the electronic device obtains a close-up image of the target object, the close-up image may be stored directly in a local or connected storage device for review by a worker.
In one implementation, when the obtained first position information of the object identified from the panoramic image is plural, after the close-up image of the target object is obtained, the magnification of the image capture device may be controlled to return to the magnification when the panoramic image is captured, so that the image capture device may be controlled to capture an image containing other objects, wherein the other objects are objects not captured close-up images.
In one case, the position of the image capturing device can be continuously controlled to return to the position when the panoramic image is captured, and then the position and the magnification of the image capturing device can be adjusted at least twice based on the first position information of other objects as target objects and a preset magnification adjustment strategy, so that the magnification of the image capturing device reaches the target magnification, and then close-up images of other objects as target objects captured by the image capturing device can be obtained.
In another case, the position of the image capturing device may not be continuously controlled to return to the position when the panoramic image is captured, and the position and the magnification of the image capturing device may be adjusted at least twice based on the first position information of the next object as the target object and the preset magnification adjustment policy, so that the magnification of the image capturing device reaches the target magnification, so as to obtain a close-up image of the next object as the target object. At this time, the adjustment of the position of the image pickup apparatus, that is, the rotation angle may be first controlled based on the relative positional relationship between the position at which the image pickup apparatus picks up the close-up image of the target object and the position at which the next object as the target object is caused to be in the target pickup area of the image pickup apparatus. The relative position relationship between the position at which the image capturing device captures the close-up image of the current target object and the position at which the next target object is located in the target capturing area of the image capturing device may be determined in a related position relationship determining manner, and the determination is performed by using the first position information of the current target object, the first position information of the next target object and the position information of the position at which the image capturing device captures the panoramic image, which is not described herein again.
In the embodiment of the invention, the image which can effectively identify and obtain the detail information of the object is called a close-up image of the object. The detail information of the object may include: specific content of the object and/or characteristic information of the object. In one case, the close-up image may include all the detail information of the corresponding object, or may include the detail information of a part of the corresponding object.
In one case, the target area may be an area where a shelf is located, the shelf is used for displaying goods, the object may be a goods price tag displayed on the shelf, the goods price tag corresponds to the goods, the goods price tag may include, but is not limited to, a goods two-dimensional code, and the goods two-dimensional code may include, but is not limited to, information describing trust related to price, name and the like of the corresponding goods. In one case, the object may be a commodity placed on a shelf or the like. Alternatively, the target area may be an area where a window of a building is located, and the object may be a person or any specified object.
The description will be given taking as an example a product price tag in which the target area is the area where the shelf is located and the object is displayed on the shelf. It can be understood that when the image acquisition equipment carries out panorama shooting to the goods shelves, the panorama image of gathering probably makes the commodity two-dimensional code in each commodity price tag in the panorama image can't be by fine discernment, at this moment, can be based on the first positional information of each commodity price tag of discernment, adjust the shooting direction of image acquisition equipment, and then adjust image acquisition equipment's multiplying power for can gather and obtain clear commodity price tag image, make the commodity two-dimensional code in this commodity price tag image can be by fine discernment. The magnification of the image acquisition equipment is increased, the size of the image acquired by the image acquisition equipment by the target can be enlarged, namely, the ratio of the number of pixel points occupied by the target in the image to the total number of all pixel points of the image is increased, and the definition of the acquired image can be controlled. Furthermore, after the multiplying power of the image acquisition equipment is increased, the image acquisition equipment can acquire a clear commodity price tag image, so that a commodity two-dimensional code in the commodity price tag image can be well identified.
In one case, as shown in fig. 2, a diagram showing the relative relationship between the orientation of the object displayed on the shelf and the shooting direction of the image capturing device is shown. The angle C may represent a shooting range of the image acquisition device, and may be considered that a shooting direction of the image acquisition device is directly opposite to the shadow plane shown in fig. 2, the point B is a midpoint of the rearmost plane, the point a is a midpoint of the foremost plane, when the shelf is backed by the shadow plane, the orientation of the shelf is a direction in which the image acquisition device is located, that is, the orientation of the commodity price tag displayed in the shelf is a direction in which the image acquisition device is located, it may be considered that the orientation of the commodity price tag displayed in the shelf is not inclined with the shooting direction of the image acquisition device, and an included angle between the orientation of the commodity price tag displayed in the shelf and the shooting direction of the image acquisition device is 180 degrees; when the shelf backrest is a plane on which the point B is located and faces the direction on which the point a is located, that is, the orientation of the commodity price tag displayed on the shelf is the direction on which the point a is located, it can be considered that the orientation of the commodity price tag displayed on the shelf is inclined to the shooting direction of the image acquisition device, and an included angle between the orientation of the commodity price tag displayed on the shelf and the shooting direction of the image acquisition device is 90 degrees.
When the orientation of the commodity price tag displayed in the shelf is inclined to the shooting direction of the image acquisition equipment, in the process of increasing the magnification and the position of the image acquisition equipment to acquire a close-up image of the target commodity price tag, the magnification of the image acquisition equipment is increased, an included angle between the orientation of the commodity price tag in the target area and the shooting direction of the image acquisition equipment can be enlarged to a certain extent, and the condition that the commodity price tag to be acquired overflows the acquisition area of the image acquisition equipment occurs, wherein the larger the increased magnification is, the larger the image acquisition error is caused by the increased magnification. At this time, in order to better and more accurately acquire a close-up image of the price tag of the target commodity, the position and the magnification of the image acquisition device may be adjusted at least twice based on the first position information of the price tag of the target commodity and a preset magnification adjustment strategy, so that the magnification of the image acquisition device reaches a target magnification, wherein the position of the image acquisition device is adjusted before the magnification of the image acquisition device is adjusted each time, so that the target object is located in a target acquisition area of the image acquisition device. In one case, to better ensure that the magnification is increased, the target merchandise price label can be present within the capture area of the image capture device, which can be the central area of the image capture area.
In one case, the visual area of the image capturing device may cover the areas where the plurality of shelves are located, in an embodiment of the present invention, before obtaining the first position information of the object identified from the panoramic image, the electronic device may first control the image capturing device to rotate to a position where the areas where the shelves are located, that is, the shelves, can be panned, and the position is taken as the current position where the image capturing device panzes the areas where the shelves are located. Furthermore, the image acquisition process of the object provided by the embodiment of the invention is executed.
It is understood that the electronic device, locally or in a connected storage device, may be configured with a correspondence between each shelf and a preset point location. Furthermore, when the electronic device detects that the period of image acquisition of the object comes, or receives an image acquisition instruction of the object, the electronic device may control the image capturing device to rotate to a preset point position corresponding to the shelf based on the above-mentioned correspondence configured in advance, so as to obtain a panoramic image of the image capturing device for performing panoramic shooting on the area where the shelf is located.
In the embodiment of the invention, when the close-up image of the object is acquired, the position and the magnification of the image acquisition equipment are adjusted at least twice, so that the magnification of the image acquisition equipment reaches the target magnification, and before the magnification of the image acquisition equipment is adjusted each time, the position of the image acquisition equipment is adjusted firstly, so that the object is in the target acquisition area of the image acquisition equipment. In the process of adjusting the magnification of the image acquisition equipment for multiple times, the position of the object in the acquisition area of the image acquisition equipment is corrected for multiple times, the occurrence of the situation that the object overflows the acquisition area of the image acquisition equipment is reduced, the object can be acquired more accurately to obtain a close-up image, and the probability that the situation that the close-up image of the object cannot be acquired due to the fact that the magnification is adjusted is reduced.
In one implementation, as shown in fig. 3, the S1021 may include:
s301: controlling the image acquisition equipment to rotate to a new current position of a target object in a target acquisition area of the image acquisition equipment based on the first position information of the target object;
s302: the method comprises the steps of increasing the multiplying power of the image acquisition equipment from the current multiplying power to a first multiplying power as a new current multiplying power of the image acquisition equipment;
wherein the first multiplying power is smaller than the target multiplying power; the current multiplying power is the multiplying power when the panoramic image is acquired by the image acquisition equipment.
S303: obtaining new first position information of the target object identified from the first image;
wherein the first image is: the image acquisition device is positioned at a new current position and acquires an image based on a new current magnification;
s304: controlling the image acquisition equipment to rotate to a new current position of a target object in a target acquisition area of the image acquisition equipment based on the new first position information of the target object;
s305: and increasing the multiplying power of the image acquisition equipment from the new current multiplying power to the target multiplying power.
In this implementation manner, the preset magnification adjustment policy may be: and limiting and adjusting the magnification and the position of the image acquisition device twice, wherein the preset magnification adjustment strategy can comprise: and two multiplying powers to be adjusted, wherein one is a first multiplying power and the other is the target multiplying power. Further, the image capture device may be in the final adjusted target position and capture a close-up image of the target object based on the final adjusted target magnification.
The process of adjusting the position and the magnification of the image acquisition device based on the first position information of the target object and the preset magnification adjustment strategy may be:
firstly, controlling the image acquisition equipment based on first position information of a target object, and rotating to a new current position of the target object in a target acquisition area of the image acquisition equipment; calculating to obtain an angle required for the image acquisition equipment to rotate from the current position to a new current position, which enables the target object to be located in a target acquisition area of the image acquisition equipment, based on first position information of the target object and current position information corresponding to the current position when the panoramic image is acquired by the image acquisition equipment; and further controlling the image acquisition equipment to rotate to the new current position of the target object in the target acquisition area of the image acquisition equipment based on the calculated required rotation angle, namely controlling the image acquisition equipment to rotate by the calculated required rotation angle.
Then, the multiplying power of the image acquisition equipment is increased from the current multiplying power to a first multiplying power smaller than the target multiplying power to serve as a new current multiplying power of the image acquisition equipment; in one case, when the preset magnification adjustment policy defines that the magnification and the position of the image capturing apparatus are adjusted twice, the first magnification may be an intermediate magnification between a current magnification of the image capturing apparatus and a target magnification, that is, the first magnification may be equal to one-half of a difference between the target magnification and the current magnification.
The method comprises the steps that image acquisition equipment acquires a first image and sends the first image to electronic equipment, and the electronic equipment obtains new first position information of a target object identified from the first image; further, controlling the image acquisition device to rotate to a new current position of the target object in a target acquisition area of the image acquisition device based on the new first position information of the target object; calculating to obtain the angle that the image acquisition device needs to rotate from the new current position to a new current position (namely, a target position) of a target acquisition area of the image acquisition device based on the new first position information of the target object and the position information corresponding to the new current position of the image acquisition device, namely the position information corresponding to the position when the first image is acquired; and controlling the image acquisition equipment to rotate the newly calculated required rotation angle.
And increasing the multiplying power of the image acquisition equipment from the new current multiplying power to the target multiplying power. The image capture device may then be at the target location and capture a close-up image of the target object based on the target magnification. And further sending the image to the electronic equipment, so that the electronic equipment obtains a close-up image of the target object.
In an implementation manner, the preset magnification adjustment policy may limit at least two times of adjusting the position and the magnification of the image capturing device, and the preset magnification adjustment policy may include at least two magnifications to be adjusted, so as to limit the times of adjusting the position and the magnification of the image capturing device. As shown in fig. 4, the S1021 may include:
s401: controlling the image acquisition equipment to rotate to a new current position of a target object in a target acquisition area of the image acquisition equipment based on the first position information of the target object;
s402: the method comprises the steps of increasing the multiplying power of the image acquisition equipment from the current multiplying power to a first multiplying power as a new current multiplying power of the image acquisition equipment;
wherein the first multiplying power is smaller than the target multiplying power; the current multiplying power is the multiplying power when the panoramic image is acquired by the image acquisition equipment.
S403: obtaining new first position information of the target object identified from the first image;
wherein the first image is: the image acquisition device is positioned at a new current position and acquires an image based on a new current magnification;
s404: controlling the image acquisition equipment to rotate to a new current position of a target object in a target acquisition area of the image acquisition equipment based on the new first position information of the target object;
s405: judging whether a multiplying power to be adjusted which is larger than the new current multiplying power and smaller than the target multiplying power exists or not; if the magnification to be adjusted which is larger than the new current magnification and smaller than the target magnification does not exist, executing S406;
s406: and increasing the multiplying power of the image acquisition equipment from the new current multiplying power to the target multiplying power.
Wherein S401 is the same as S301 shown in fig. 3, S402 is the same as S302 shown in fig. 3, S403 is the same as S303 shown in fig. 3, S404 is the same as S304 shown in fig. 3, and S406 is the same as S305 shown in fig. 3.
In this implementation, the electronic device may determine whether the magnification of the image capturing device needs to be adjusted again from the new current magnification to another magnification before the magnification of the image capturing device is increased from the new current magnification to the target magnification by determining whether there is a magnification to be adjusted that is greater than the new current magnification and less than the target magnification, where the other magnification is the magnification to be adjusted that is greater than the latest current magnification of the image capturing device and less than the target magnification. If the magnification to be adjusted which is larger than the new current magnification and smaller than the target magnification does not exist, the fact that the magnification of the image acquisition equipment can be directly adjusted from the new current magnification to the target magnification can be determined, and then the close-up image of the target object is acquired.
In another implementation mode, if the magnification to be adjusted which is larger than the new current magnification and smaller than the target magnification is judged to exist, before the magnification of the image acquisition equipment is increased from the new current magnification to the target magnification, the magnification of the image acquisition equipment is increased from the new current magnification to other existing magnifications again; then, the image acquisition equipment is positioned at a position corresponding to the adjusted multiplying power, and a new image is acquired based on the adjusted multiplying power; the electronic device can obtain a new image acquired by the image acquisition device, determine new first position information of the target object in the new image, and further control the image acquisition device to rotate to a new current position where the target object is in a target acquisition area of the image acquisition device again based on the new first position information of the target object in the new image, and further judge whether a magnification to be adjusted which is larger than a new current magnification (a magnification when the image acquisition device acquires the new image) and smaller than a target magnification exists again; and increasing the magnification of the image acquisition equipment from the new current magnification to the target magnification until judging that the magnification to be adjusted which is larger than the new current magnification and smaller than the target magnification does not exist, or continuing to increase the magnification of the image acquisition equipment from the new current magnification to other existing magnifications. In the process that the multiplying power of the image acquisition equipment is increased from the new current multiplying power to other existing multiplying powers, the image acquisition equipment is sequentially controlled to be increased to other existing multiplying powers according to the sequence from small to large.
As shown in fig. 4, the S1021 may further include:
s407: if the magnification to be adjusted which is larger than the new current magnification and smaller than the target magnification is judged to exist, the magnification of the image acquisition equipment is increased from the new current magnification to the current minimum magnification in the magnification to be adjusted, and the current magnification is used as the new current magnification of the image acquisition equipment;
s408: obtaining new first position information of the target object identified from the new first image;
wherein the new first image is: the image acquisition device is positioned at a new current position and acquires an image based on a new current magnification;
s409: controlling the image acquisition device to rotate to a new current position of the target object in a target acquisition area of the image acquisition device based on new first position information of the target object identified from the new first image; execution returns to S405.
In one implementation, the target acquisition area corresponds to a central position of an image acquired by an image acquisition device;
the step of obtaining new first position information of the target object identified from the first image may include:
obtaining a first image;
identifying new first position information of each object from the first image;
and determining new first position information of the target object from the identified new first position information of each object based on the central position of the first image.
It can be understood that, in the process of adjusting the magnification and position of the image capturing apparatus, after the position and magnification of the image capturing apparatus are adjusted for the first time, there is inevitably a case where a plurality of objects are still contained in the image captured by the image capturing apparatus. In this case, the electronic device may identify new first position information of each object from the first image after obtaining the first image; further, new first position information of the target object is specified from the new first position information of the recognized objects based on the center position of the first image.
The first image is an image acquired by the image acquisition device at a position where the target object is located in a target acquisition area of the image acquisition device, and based on the first magnification, the target acquisition area is an area corresponding to a center position of the image acquired by the image acquisition device, that is, the target acquisition area is: a central region of an acquisition region of the image acquisition device. Theoretically, the position of the target object in the first image is not too far from the center position of the first image, i.e., the target object is located around the center position of the first image. In view of this, it is possible to determine the target object and determine new first position information of the target object by traversing each object in the first image from the central position of the first image, and to save the time for determining the new first position information of the target object to a certain extent.
In one case, different marks exist in different objects in the target area, and the first image is traversed from the central position of the first image, so that new first position information of the target object can be determined through the marks of the target object.
In another case, the target acquisition area is an area corresponding to a center position of an image acquired by the image acquisition device, that is, the target acquisition area is: when the center area of the acquisition area of the image acquisition device is the closest to the center position of the first image, the step of determining new first position information of the target object from the new first position information of each identified object based on the center position of the first image may include:
and based on the central position of the first image, determining new first position information with the minimum distance between the corresponding position and the central position of the first image from the identified new first position information of each object as the new first position information of the target object.
In this implementation, position information of the center position of the first image may be determined first, and as the center position information, the distance between the center position information and the new first position information of each identified object is calculated in sequence, and the new first position information with the smallest corresponding distance is determined as the new first position information of the target object.
In one implementation, after the step of obtaining a close-up image of the target object, the method may further comprise:
and identifying and obtaining the detail information of the target object from the close-up image.
In the implementation manner, after the electronic equipment obtains the close-up image of the target object, the electronic equipment can identify the detail information of the object in the close-up image and store the detail information and the close-up image for the staff to check. Alternatively, other tasks may follow the detailed information of the identified object. For example: the target area is the area where the goods shelf is located, the object is a commodity price tag, and the detail information of the object comprises the following components: the commodity two-dimensional code of commodity price tag, after the commodity two-dimensional code of this commodity price tag was obtained in the electronic equipment discernment, can discern the commodity information that this commodity two-dimensional code represents based on predetermined two-dimensional code recognition algorithm, wherein, the commodity information that this commodity two-dimensional code represented can include: the commodity tag is a commodity identification of the corresponding commodity. Furthermore, after the electronic device obtains the commodity identification corresponding to the commodity price tag, a subsequent series of tasks can be executed according to the commodity identification.
In one implementation, the electronic device may continue to determine, based on the position of the product price tag in the shelf and the product identifier corresponding to the product price tag, a full-empty condition of the product corresponding to the product identifier corresponding to the product price tag displayed in the shelf. Specifically, the electronic device may determine, based on the position of the product price tag in the shelf and the product identifier of the product corresponding to the product price tag, a product display area in the shelf for displaying the product corresponding to the product price tag, and further determine, based on a preset full-empty condition calculation manner, a full-empty condition of the product display area of the product corresponding to the product price tag.
Wherein, the position of the commodity price tag in the goods shelf is as follows: and identifying the position represented by the first position information of the commodity price tag in the panoramic image.
The process of determining the full-empty condition of the product display area of the product corresponding to the product price label based on the preset full-empty condition calculation mode may be:
identifying whether a product is displayed in a product display area corresponding to the product price tag from the panoramic image;
if the commodity display area corresponding to the commodity price tag is identified to have no commodity displayed, determining that the full-empty condition of the commodity corresponding to the commodity identification corresponding to the commodity price tag is empty;
if the commodity display area corresponding to the commodity price tag is identified to display the commodity, determining the area of the area displaying the commodity in the commodity display area corresponding to the commodity price tag;
determining a full-empty condition of the product display area corresponding to the product price label as a full-empty condition of the product corresponding to the product identification corresponding to the product price label based on the area of the product display area corresponding to the product price label and the area of the product display area displayed in the product display area corresponding to the product price label, wherein, if the ratio between the area of the product display region corresponding to the product price label and the area of the product display region corresponding to the product price label is smaller than a first threshold value, and determining that the full-empty condition of the commodity corresponding to the commodity identification corresponding to the commodity price label is half full, and if the ratio of the area of the commodity display area corresponding to the commodity price label to the area of the commodity display area corresponding to the commodity price label is not less than a first threshold value, determining that the full-empty condition of the commodity corresponding to the commodity identification corresponding to the commodity price label is full.
In another implementation, the electronic device may continue to determine whether the placement of the item price tag is incorrect based on the location of the item price tag in the shelf and the item identification corresponding to the item price tag. Specifically, the electronic device may obtain expected location information required to be placed on the commodity price tag from the pre-stored expected location information required to be placed on each commodity price tag based on the commodity identifier of the commodity corresponding to the commodity price tag. And matching the obtained expected position information of the commodity price tag required to be placed with the corresponding first position information of the commodity price tag identified from the panoramic image, if the first position information of the commodity price tag is not matched with the expected position information, indicating that the commodity price tag is misplaced, and reminding a user of the misplaced commodity price tag so that the user can adjust the commodity price tag and the display position of the commodity corresponding to the commodity price tag.
In one case, the above-mentioned process of matching the obtained expected position information of the commodity price tag required to be placed with the corresponding first position information of the commodity price tag identified from the panoramic image may be: determining expected position information required to be placed on the commodity price tag, wherein the expected position information and the first position information of the commodity price tag are characterized in the same layer of a shelf or not, if the expected position information is characterized in the same layer of the shelf, the expected position information required to be placed on the commodity price tag can be determined and is matched with the corresponding first position information of the commodity price tag identified from the panoramic image; otherwise, there is no match.
It can also be: determining expected position information required to be placed on the commodity price tag, wherein whether the expected position information and the first position information of the commodity price tag are characterized in the same shelf or not, if the expected position information and the first position information of the commodity price tag are characterized in the same shelf, the expected position information required to be placed on the commodity price tag can be determined and is matched with the corresponding first position information of the commodity price tag identified from the panoramic image; otherwise, there is no match.
It can also be: determining whether the expected location information required to place the item price tag and the first location information of the item price tag are characterized as being on the same side of the same layer of the same shelf, such as left side or right side or middle; if so, determining expected position information of the commodity price tag required to be placed, and matching the expected position information with the corresponding first position information of the commodity price tag identified from the panoramic image; otherwise, there is no match.
In another implementation, the electronic device may continue to determine whether any item price tags fall off the shelf based on the locations of all item price tags in the shelf and the item identifications corresponding to the item price tags. Specifically, the electronic device may obtain, based on the identifier of the shelf, the number of pre-stored commodity price tags that the shelf needs to display, and determine whether the number of commodity price tags that the shelf needs to display is the same as the number of first position information of the commodity price tags identified from the panoramic image; if the number of the commodity price tags required to be displayed on the shelf is larger than the number of the first position information of the commodity price tags identified from the panoramic image, the shelf can be determined to have the commodity price tags fallen. Furthermore, the specific commodity price tags can be determined to fall off based on the pre-stored expected position information required to be placed on each commodity price tag, the commodity identification corresponding to the commodity price tag and the first position information of the commodity price tag.
Corresponding to the above method embodiment, an embodiment of the present invention provides an apparatus for acquiring an image of an object, as shown in fig. 5, the apparatus including:
an obtaining module 510, configured to obtain first position information of an object identified from a panoramic image, where the panoramic image is: the image acquisition equipment carries out panoramic shooting on a target area to obtain an image;
an execution module 520, configured to perform the following steps based on the first position information of each identified object from the panoramic image, to obtain a close-up image of each identified object; wherein the executing module 520 comprises:
an adjusting submodule 521, configured to adjust the position and the magnification of the image capturing apparatus at least twice based on first position information of a target object and a preset magnification adjusting policy, so that the magnification of the image capturing apparatus reaches a target magnification, where before adjusting the magnification of the image capturing apparatus each time, the position of the image capturing apparatus is adjusted, so that the target object is located in a target capturing area of the image capturing apparatus, and the target object is: one of the objects identified from the panoramic image;
an obtaining sub-module 522 for obtaining a close-up image of the target object, wherein the close-up image is: the image acquisition equipment is positioned at a target position and is based on an image acquired by the target magnification, and the target position is as follows: and the position corresponding to the target magnification.
In the embodiment of the invention, when the close-up image of the object is acquired, the position and the magnification of the image acquisition equipment are adjusted at least twice, so that the magnification of the image acquisition equipment reaches the target magnification, and before the magnification of the image acquisition equipment is adjusted each time, the position of the image acquisition equipment is adjusted firstly, so that the object is in the target acquisition area of the image acquisition equipment. In the process of adjusting the magnification of the image acquisition equipment for multiple times, the position of the object in the acquisition area of the image acquisition equipment is corrected for multiple times, the occurrence of the situation that the object overflows the acquisition area of the image acquisition equipment is reduced, the object can be acquired more accurately to obtain a close-up image, and the probability that the situation that the close-up image of the object cannot be acquired due to the fact that the magnification is adjusted is reduced.
In an optional implementation manner, the adjusting sub-module 521 includes:
the first control unit is used for controlling the image acquisition equipment to rotate to a new current position of a target acquisition area of the image acquisition equipment on the basis of first position information of a target object;
the first magnification adjusting unit is used for adjusting the magnification of the image acquisition equipment from the current magnification to a first magnification as a new current magnification of the image acquisition equipment, wherein the first magnification is smaller than a target magnification;
a first obtaining unit, configured to obtain new first position information of the target object identified from a first image, where the first image is: the image acquisition device is located at the new current position and acquires an image based on the new current magnification;
a second control unit, configured to control the image capturing device to rotate to a new current position where the target object is located in a target capturing area of the image capturing device based on the new first position information of the target object;
and the second enlarging unit is used for enlarging the multiplying power of the image acquisition equipment from the new current multiplying power to the target multiplying power.
In an optional implementation manner, the adjusting sub-module 521 further includes:
a judging unit, configured to judge whether there is a magnification to be adjusted that is greater than the new current magnification and less than the target magnification before the magnification of the image capturing apparatus is increased from the new current magnification to the target magnification;
and if the magnification to be adjusted which is larger than the new current magnification and smaller than the target magnification does not exist, triggering the second enlarging unit.
In an optional implementation manner, the adjusting sub-module 521 further includes:
a third enlarging unit, configured to, if it is determined that there is a magnification to be adjusted that is greater than the new current magnification and smaller than the target magnification, enlarge the magnification of the image capturing device from the new current magnification to a current minimum magnification among the magnifications to be adjusted, and use the enlarged magnification as a new current magnification of the image capturing device;
a second obtaining unit configured to obtain new first position information of the target object identified from a new first image, where the new first image is: the image acquisition device is located at the new current position and acquires an image based on the new current magnification;
a third control unit, configured to control the image capturing device to rotate to a new current position where the target object is located in a target capturing area of the image capturing device, based on new first position information of the target object identified from the new first image; and triggering the judging unit.
In an optional implementation manner, the target acquisition area corresponds to a central position of an image acquired by the image acquisition device;
the first obtaining unit includes:
an obtaining subunit configured to obtain a first image;
an identifying subunit, configured to identify new first location information of each object from the first image;
a determining subunit, configured to determine, based on the center position of the first image, new first position information of the target object from the new first position information of the identified objects.
In an optional implementation manner, the determining subunit is specifically configured to
And determining new first position information with the minimum distance between the corresponding position and the central position of the first image from the identified new first position information of each object as the new first position information of the target object based on the central position of the first image.
In an optional implementation manner, the target area is an area where a shelf is located, and the object is a price tag of a commodity displayed on the shelf.
In an optional implementation, the apparatus further comprises:
an identification module for identifying detail information of the target object from the close-up image after the obtaining of the close-up image of the target object.
Corresponding to the above method embodiment, an electronic device according to an embodiment of the present invention is further provided, as shown in fig. 6, and includes a processor 610, a communication interface 620, a memory 630, and a communication bus 640, where the processor 610, the communication interface 620, and the memory 630 complete communication with each other through the communication bus 640,
a memory 630 for storing computer programs;
the processor 610 is configured to, when executing the computer program stored in the memory 630, implement the steps of the image obtaining method for the object according to any one of the above embodiments of the present invention.
In the embodiment of the invention, when the close-up image of the object is acquired, the position and the magnification of the image acquisition equipment are adjusted at least twice, so that the magnification of the image acquisition equipment reaches the target magnification, and before the magnification of the image acquisition equipment is adjusted each time, the position of the image acquisition equipment is adjusted firstly, so that the object is in the target acquisition area of the image acquisition equipment. In the process of adjusting the magnification of the image acquisition equipment for multiple times, the position of the object in the acquisition area of the image acquisition equipment is corrected for multiple times, the occurrence of the situation that the object overflows the acquisition area of the image acquisition equipment is reduced, the object can be acquired more accurately to obtain a close-up image, and the probability that the situation that the close-up image of the object cannot be acquired due to the fact that the magnification is adjusted is reduced.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component.
Corresponding to the above method embodiment, an embodiment of the present invention further provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements any of the above steps of the image acquisition method for an object provided by the embodiment of the present invention.
In the embodiment of the invention, when the close-up image of the object is acquired, the position and the magnification of the image acquisition equipment are adjusted at least twice, so that the magnification of the image acquisition equipment reaches the target magnification, and before the magnification of the image acquisition equipment is adjusted each time, the position of the image acquisition equipment is adjusted firstly, so that the object is in the target acquisition area of the image acquisition equipment. In the process of adjusting the magnification of the image acquisition equipment for multiple times, the position of the object in the acquisition area of the image acquisition equipment is corrected for multiple times, the occurrence of the situation that the object overflows the acquisition area of the image acquisition equipment is reduced, the object can be acquired more accurately to obtain a close-up image, and the probability that the situation that the close-up image of the object cannot be acquired due to the fact that the magnification is adjusted is reduced.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims (10)

1. A method of image acquisition of an object, the method comprising:
obtaining first position information of an object identified from a panoramic image, wherein the panoramic image is: the image acquisition equipment carries out panoramic shooting on a target area to obtain an image;
performing the following steps based on the first position information of each identified object from the panoramic image to obtain a close-up image of each identified object;
adjusting the position and the magnification of the image acquisition equipment at least twice based on first position information of a target object and a preset magnification adjustment strategy to enable the magnification of the image acquisition equipment to reach a target magnification, wherein the position of the image acquisition equipment is adjusted to enable the target object to be located in a target acquisition area of the image acquisition equipment before the magnification of the image acquisition equipment is adjusted each time, and the target object is: one of the objects identified from the panoramic image;
obtaining a close-up image of the target object, wherein the close-up image is: the image acquisition equipment is positioned at a target position and is based on an image acquired by the target magnification, and the target position is as follows: and the position corresponding to the target magnification.
2. The method according to claim 1, wherein the step of adjusting the position and the magnification of the image capturing device at least twice based on the first position information of the target object and a preset magnification adjustment policy so that the magnification of the image capturing device reaches a target magnification comprises:
controlling the image acquisition equipment to rotate to a new current position of a target acquisition area of the image acquisition equipment based on first position information of a target object;
increasing the magnification of the image acquisition equipment from the current magnification to a first magnification as a new current magnification of the image acquisition equipment, wherein the first magnification is smaller than a target magnification;
obtaining new first position information of the target object identified from a first image, wherein the first image is: the image acquisition device is located at the new current position and acquires an image based on the new current magnification;
controlling the image acquisition device to rotate to a new current position of a target acquisition area of the image acquisition device based on the new first position information of the target object;
and increasing the magnification of the image acquisition equipment from the new current magnification to the target magnification.
3. The method according to claim 2, wherein prior to the step of adjusting the magnification of the image capture device from the new current magnification to the target magnification, the method further comprises:
judging whether a multiplying power to be adjusted which is larger than the new current multiplying power and smaller than the target multiplying power exists or not;
and if the magnification to be adjusted which is larger than the new current magnification and smaller than the target magnification does not exist, executing the step of increasing the magnification of the image acquisition equipment from the new current magnification to the target magnification.
4. The method of claim 3, further comprising:
if the magnification to be adjusted which is larger than the new current magnification and smaller than the target magnification is judged to exist, the magnification of the image acquisition equipment is increased from the new current magnification to the current minimum magnification in the magnification to be adjusted, and the current magnification of the image acquisition equipment is used as the new current magnification of the image acquisition equipment;
obtaining new first position information of the target object identified from a new first image, wherein the new first image is: the image acquisition device is located at the new current position and acquires an image based on the new current magnification;
controlling the image acquisition device to rotate to a new current position of a target acquisition area of the image acquisition device based on new first position information of the target object identified from the new first image;
and executing the step of judging whether the multiplying power to be adjusted is larger than the new current multiplying power and smaller than the target multiplying power.
5. The method of claim 2, wherein the target acquisition area corresponds to a center position of an image acquired by the image acquisition device;
the step of obtaining new first position information of the target object identified from the first image includes:
obtaining a first image;
identifying new first position information of each object from the first image;
and determining new first position information of the target object from the identified new first position information of each object based on the central position of the first image.
6. The method according to claim 5, wherein the step of determining new first position information of the target object from the new first position information of the recognized objects based on the center position of the first image comprises:
and determining new first position information with the minimum distance between the corresponding position and the central position of the first image from the identified new first position information of each object as the new first position information of the target object based on the central position of the first image.
7. The method of any one of claims 1-6, wherein the target area is an area where a shelf is located, and the object is a price tag for a product displayed on the shelf.
8. An apparatus for acquiring an image of an object, the apparatus comprising:
an obtaining module, configured to obtain first position information of an object identified from a panoramic image, where the panoramic image is: the image acquisition equipment carries out panoramic shooting on a target area to obtain an image;
an execution module for performing the following steps based on the first position information of each object identified from the panoramic image to obtain a close-up image of each object identified; wherein the execution module comprises:
the adjusting sub-module is configured to adjust the position and the magnification of the image capturing device at least twice based on first position information of a target object and a preset magnification adjusting policy, so that the magnification of the image capturing device reaches a target magnification, wherein the position of the image capturing device is adjusted before the magnification of the image capturing device is adjusted each time, so that the target object is located in a target capturing area of the image capturing device, and the target object is: one of the objects identified from the panoramic image;
an obtaining sub-module for obtaining a close-up image of the target object, wherein the close-up image is: the image acquisition equipment is positioned at a target position and is based on an image acquired by the target magnification, and the target position is as follows: and the position corresponding to the target magnification.
9. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the steps of the method for obtaining an image of an object according to any one of claims 1 to 7 when executing a computer program stored in a memory.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method steps of the image acquisition method of an object according to any one of claims 1 to 7.
CN201910188882.1A 2019-03-13 2019-03-13 Object image acquisition method and device and electronic equipment Active CN111698413B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910188882.1A CN111698413B (en) 2019-03-13 2019-03-13 Object image acquisition method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910188882.1A CN111698413B (en) 2019-03-13 2019-03-13 Object image acquisition method and device and electronic equipment

Publications (2)

Publication Number Publication Date
CN111698413A true CN111698413A (en) 2020-09-22
CN111698413B CN111698413B (en) 2021-05-14

Family

ID=72474975

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910188882.1A Active CN111698413B (en) 2019-03-13 2019-03-13 Object image acquisition method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN111698413B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114827466A (en) * 2022-04-20 2022-07-29 武汉三江中电科技有限责任公司 Human eye-imitated equipment image acquisition device and image acquisition method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104394356A (en) * 2014-11-03 2015-03-04 杭州普维光电技术有限公司 A method for controlling automatic zooming by an association of a camera with a PTZ
CN205693770U (en) * 2016-05-25 2016-11-16 中国民用航空总局第二研究所 A kind of high-low-position ganged monitoring system based on panoramic video
US9521321B1 (en) * 2015-02-11 2016-12-13 360 Lab Llc. Enabling manually triggered multiple field of view image capture within a surround image mode for multi-lens mobile devices
US20180288322A1 (en) * 2017-03-30 2018-10-04 Canon Kabushiki Kaisha Image-capturing apparatus and image-capturing control method
CN109151295A (en) * 2017-06-16 2019-01-04 杭州海康威视数字技术股份有限公司 A kind of target object grasp shoot method, device and video monitoring equipment
CN109151375A (en) * 2017-06-16 2019-01-04 杭州海康威视数字技术股份有限公司 A kind of target object grasp shoot method, device and video monitoring equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104394356A (en) * 2014-11-03 2015-03-04 杭州普维光电技术有限公司 A method for controlling automatic zooming by an association of a camera with a PTZ
US9521321B1 (en) * 2015-02-11 2016-12-13 360 Lab Llc. Enabling manually triggered multiple field of view image capture within a surround image mode for multi-lens mobile devices
CN205693770U (en) * 2016-05-25 2016-11-16 中国民用航空总局第二研究所 A kind of high-low-position ganged monitoring system based on panoramic video
US20180288322A1 (en) * 2017-03-30 2018-10-04 Canon Kabushiki Kaisha Image-capturing apparatus and image-capturing control method
CN109151295A (en) * 2017-06-16 2019-01-04 杭州海康威视数字技术股份有限公司 A kind of target object grasp shoot method, device and video monitoring equipment
CN109151375A (en) * 2017-06-16 2019-01-04 杭州海康威视数字技术股份有限公司 A kind of target object grasp shoot method, device and video monitoring equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114827466A (en) * 2022-04-20 2022-07-29 武汉三江中电科技有限责任公司 Human eye-imitated equipment image acquisition device and image acquisition method
CN114827466B (en) * 2022-04-20 2023-07-04 武汉三江中电科技有限责任公司 Human eye-like equipment image acquisition device and image acquisition method

Also Published As

Publication number Publication date
CN111698413B (en) 2021-05-14

Similar Documents

Publication Publication Date Title
US11107246B2 (en) Method and device for capturing target object and video monitoring device
CN109151375B (en) Target object snapshot method and device and video monitoring equipment
CN111274845B (en) Method, device and system for identifying display condition of store shelf and electronic equipment
JP6871416B2 (en) Methods and devices for determining facial image quality, electronics and computer storage media
CN110570454B (en) Method and device for detecting foreign matter invasion
CN111787232B (en) Image processing method, device and storage medium based on pan-tilt-zoom camera
US9477891B2 (en) Surveillance system and method based on accumulated feature of object
CN110476056A (en) A kind of visible detection method, detection device and robot
CN112883955A (en) Shelf layout detection method and device and computer readable storage medium
CN110536074B (en) Intelligent inspection system and inspection method
CN110059666B (en) Attention detection method and device
US11244159B2 (en) Article recognition system and article recognition method
JP6444283B2 (en) Posture determination device
CN115797876B (en) Equipment monitoring processing method and system
CN111401239B (en) Video analysis method, device, system, equipment and storage medium
US20210042576A1 (en) Image processing system
CN113051978A (en) Face recognition method, electronic device and readable medium
CN113177941B (en) Steel coil edge crack identification method, system, medium and terminal
CN112819889B (en) Method and device for determining position information, storage medium and electronic device
CN111698413B (en) Object image acquisition method and device and electronic equipment
CN113673319B (en) Abnormal gesture detection method, device, electronic device and storage medium
CN117011684B (en) Object detection method and device, storage medium and electronic device
CN113691777B (en) Zoom tracking method and device for ball machine, storage medium and electronic device
CN112529956B (en) Blackbody position detection method, electronic device and computer readable storage medium
CN110580707A (en) object tracking method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant