CN109299484A - Image display method and device - Google Patents

Abstract

A kind of image display method and equipment are provided, described image display methods includes: the image for showing object of reference, and extracts the display parameters of the object of reference；Obtain the image of target object；The imaging size of the target object is determined based on the display parameters of the object of reference；The image of the target object is shown according to the imaging size of the target object on the image of the object of reference.Using the described image display methods and equipment of exemplary embodiment of the present, the intelligent collocation of different dummy objects in the same space can be realized, and arranging effect figure of the dummy object in reality is presented to user.

Description

Image display method and device

technical field

The present invention generally relates to the field of electronic terminals, and more particularly, to an image display method and device.

Background technique

At present, electronic terminals have become indispensable personal items for daily travel, and users hope that electronic terminals can bring convenience to real life to the greatest extent. Similarly, online shopping is also a well-known and increasingly popular shopping method, but the problem is that many items that are optimistic about online are not satisfied with the size or style, which is also a major problem for the majority of online shoppers. The reason is that the items purchased online cannot be well matched with the physical objects, and can only rely on human estimation, which often has large errors.

In addition, when decorating, the purchase of various furniture should consider both the size and the style. When you find your favorite furniture in the furniture city, you will not only worry about whether the size of the furniture is appropriate, but also consider whether it will be placed in your home. Matching the overall decoration style or other furniture styles, such large items are more difficult to match.

SUMMARY OF THE INVENTION

The purpose of the exemplary embodiments of the present invention is to provide an image display method and device, so as to solve the technical problem in the prior art that the matching effect of a virtual target object in a real environment cannot be provided.

According to an aspect of an exemplary embodiment of the present invention, there is provided an image display method, the image display method comprising: displaying an image of a reference object, and extracting display parameters of the reference object; acquiring an image of a target object; The display parameter of the reference object determines the imaging size of the target object; the image of the target object is displayed on the image of the reference object according to the imaging size of the target object.

Optionally, the display parameter of the reference object may include a display scale coefficient of the reference object, and the display scale coefficient may represent a ratio of the actual size of the reference object to the imaged size of the reference object.

Optionally, the step of determining the imaging size of the target object based on the display scale factor of the reference object may include: determining the actual size of the target object; The actual size determines the imaging size of the target object.

Optionally, the imaging size of the target object may be the quotient of the actual size of the target object and the display scale coefficient of the reference object.

Optionally, the step of determining the actual size of the target object may include: obtaining the actual size of the target object based on shooting parameters of the target object by taking an image of the target object; or obtaining according to user input The actual size of the target object.

Optionally, by photographing an image of the target object, the step of obtaining the actual size of the target object based on the photographing parameters of the target object may include: displaying the photographed image of the target object; responding to a user's operation , marking the area related to the target object on the captured image displayed on the screen; determining the actual size of the part of the target object corresponding to the marked area based on the number of pixels occupied by the marked area.

Optionally, the step of determining the actual size of the portion of the target object corresponding to the marked area based on the number of pixels occupied by the marked area may include: based on the image distance and object distance when the image was captured, the marked area The number of occupied pixels and the corresponding relationship between the size of the imaging area of the imaging sensor and the resolution of the area where the captured image is displayed on the screen determine the actual size of the portion of the target object corresponding to the marked area.

Optionally, the marked area may be a line with a predetermined width, wherein the step of determining the actual size of the portion of the target object corresponding to the marked area based on the number of pixels occupied by the marked area may include: based on the captured image image distance and object distance, the number of pixels occupied by the lines of the predetermined width, the number of pixels corresponding to the predetermined width, the length of the imaging area of the imaging sensor and the area where the screen displays the captured image The proportional relationship between the number of pixel points in a column, calculate the actual size of the part of the target object corresponding to the marked line.

Optionally, the display parameters of the reference object may further include a display angle of the reference object, and the display angle may represent the actual shooting angle when the image of the reference object is captured, wherein the step of acquiring the image of the target object may include: determining the display angle of the target object; taking the display angle of the reference object as a reference, selecting an image whose display angle of the target object matches the display angle of the reference object as the image of the target object .

Optionally, the step of determining the display angle of the target object may include: marking the central arc corresponding to the measured angle of the target object as a first line with a predetermined width on the captured image displayed on the screen, The radius corresponding to the central arc is marked as a second line with a predetermined width, and the target object is determined based on the proportional relationship between the number of pixels occupied by the first line and the number of pixels occupied by the second line The actual angle of the measured angle is used as the display angle of the target object.

Optionally, an image of the reference object and display parameters of the reference object may be acquired by photographing the reference object.

According to another aspect of an exemplary embodiment of the present invention, there is provided an image display device, the image display device comprising: a display unit that displays an image of a reference object; a parameter extraction unit that extracts display parameters of the reference object; image acquisition a unit for acquiring an image of a target object; a size determining unit for determining an imaging size of the target object based on a display parameter of the reference object, wherein the display unit displays the image of the reference object according to the imaging size of the target object image of the target object.

Optionally, the display parameter of the reference object may include a display scale coefficient of the reference object, and the display scale coefficient may represent a ratio of the actual size of the reference object to the imaged size of the reference object.

Optionally, the size determination unit may determine the actual size of the target object, and determine the imaging size of the target object according to the display scale coefficient of the reference object and the actual size of the target object.

Optionally, the imaging size of the target object may be the quotient of the actual size of the target object and the display scale coefficient of the reference object.

Optionally, the size determination unit may obtain the actual size of the target object based on the shooting parameters when shooting the target object; or the size determination unit may obtain the actual size of the target object according to user input.

Optionally, the size determination unit may, in response to a user's operation, mark an area about the target object on the captured image of the target object displayed on the screen, and determine the area based on the number of pixels occupied by the marked area. The actual size of the portion of the target object that corresponds to the marked area.

Optionally, the size determination unit may be based on the image distance and object distance when the image is captured, the number of pixels occupied by the marked area, and the ratio between the size of the imaging area of the imaging sensor and the resolution of the area where the captured image is displayed on the screen. The corresponding relationship between them is determined, and the actual size of the part of the target object corresponding to the marked area is determined.

Optionally, the marked area may be a line of a predetermined width, wherein the size determination unit may be based on the image distance and the object distance when the image is captured, the number of pixels occupied by the line of the predetermined width, and the corresponding width of the predetermined width. and the proportional relationship between the length of the imaging area of the imaging sensor and the number of pixels in one column of the area where the captured image is displayed on the screen, calculate the actual size of the portion of the target object corresponding to the marked line .

Optionally, the display parameters of the reference object may further include a display angle of the reference object, and the display angle may represent an actual shooting angle when the image of the reference object is captured, wherein the image display device may further It includes: an angle determination unit, which determines the display angle of the target object, and the image acquisition unit can use the display angle of the reference object as a reference, and selects an image whose display angle of the target object matches the display angle of the reference object as a reference. image of the target object.

Optionally, the angle determination unit may mark the central arc corresponding to the measured angle of the target object as a first line with a predetermined width on the captured image displayed on the screen, and mark the radius corresponding to the central arc. is a second line with a predetermined width, and based on the proportional relationship between the number of pixels occupied by the first line and the number of pixels occupied by the second line, determine the actual angle of the measured angle of the target object as the The display angle of the target object.

Optionally, the image display device may further include: a reference object image acquisition unit, which acquires an image of the reference object and display parameters of the reference object by photographing the reference object.

According to yet another aspect of an exemplary embodiment of the present invention, there is provided a computing device including: a processor; and a memory for storing program instructions that, when executed by the processor, cause the processor to execute the image display method as described above.

According to yet another aspect of an exemplary embodiment of the present invention, there is provided a computer-readable storage medium storing program instructions that, when executed by a processor, cause the processor to execute the image display method as described above.

By using the image display method and device according to the exemplary embodiments of the present invention, intelligent collocation between different virtual objects can be realized, so as to present the collocation effect diagram of the virtual objects in reality to the user.

Description of drawings

The above and other objects, features and advantages of the exemplary embodiments of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings which exemplarily illustrate the embodiments, wherein:

1 shows a flowchart of an image display method according to an exemplary embodiment of the present invention;

FIG. 2 shows a flowchart of steps of acquiring the actual size of a target object by shooting according to an exemplary embodiment of the present invention;

FIG. 3 to FIG. 5 illustrate exemplary diagrams of acquiring the actual size of the target object by photographing the target object at an electronic terminal according to an exemplary embodiment of the present invention;

6 to 10 illustrate exemplary diagrams of matching a reference object with a target object at an electronic terminal according to an exemplary embodiment of the present invention;

FIG. 11 shows a block diagram of an image display apparatus according to an exemplary embodiment of the present invention.

Detailed ways

Various example embodiments will now be described more fully with reference to the accompanying drawings, in which some example embodiments are shown.

FIG. 1 shows a flowchart of an image display method according to an exemplary embodiment of the present invention.

Referring to FIG. 1, in step S10, an image of a reference object is displayed, and display parameters of the reference object are extracted.

In one case, the display parameters of the reference object can be extracted from the image of the reference object.

In one example, an image of the reference object and display parameters of the reference object are acquired by photographing the reference object, and the display parameters of the reference object are inserted into the image of the reference object. For example, the display parameters of the reference object can be generated based on the shooting parameters when the reference object is shot, that is, the display parameters carried by the image of the reference object can be determined based on the shooting parameters when the reference object is shot. Therefore, after acquiring and displaying the image of the reference object in step S10, the display parameters of the reference object can be extracted from the image of the reference object.

For example, the shooting parameters of the reference object may include the object distance and image distance when shooting the reference object, and the imaging size of the reference object, the display parameters of the reference object may include the display scale coefficient of the reference object, and the display scale coefficient may represent the actual size of the reference object The ratio of the imaged size of the reference object. Here, the actual size of the reference object can be determined based on the shooting parameters of the reference object, and then the ratio of the actual size of the reference object to the imaging size of the reference object is calculated to obtain the display scale coefficient of the reference object.

Here, preferably, the step of determining the actual size of the reference object is the same as the subsequent step of determining the actual size of the target object, and the present invention will be described in detail when the step of determining the actual size of the target object is introduced later.

In another example, display parameters of the reference object input by the user may be received, and the received display parameters may be inserted into the image of the reference object. That is, the display parameters carried by the image of the reference object can be determined according to the user's input. Therefore, in step S10, after the image of the reference object is acquired and displayed, the display parameters of the reference object are extracted from the image of the reference object.

In another case, the actual size of the reference object input by the user may be received, and the display parameters of the reference object may be determined based on the actual size of the reference object and the imaged size of the reference object.

Preferably, the display parameter of the reference object may be a display scale coefficient of the reference object, for example, the imaging size of the reference object may be acquired based on the image of the reference object, the actual size of the reference object input by the user is received, and the actual size of the reference object is calculated The ratio of the imaging size of the reference object to obtain the display scale factor of the reference object. Here, various existing methods can be used to obtain the imaging size of the reference object based on the image of the reference object, and the present invention will not describe this part of the content again.

In step S20, an image of the target object is acquired.

Optionally, the step of acquiring the image of the target object may include: marking an area related to the target object on the original image, intercepting the image of the area, and using the intercepted image of the area as the image of the target object. That is, the background part is removed from the original image, leaving only the area of the target object. Here, the original image may be an image obtained by photographing the target object or an image about the target object obtained from a network (or locally in an electronic terminal). Correspondingly, the image of the reference object may refer to an image in which the background part is removed and only the region of the reference object remains, or may be an original image of the reference object.

Preferably, the display parameters of the reference object may further include a display angle of the reference object, and the display angle of the reference object may represent an actual shooting angle when an image of the reference object is captured. In order to obtain a better matching effect between the reference object and the target object, the reference object and the target object can be kept consistent in size and display angle. In this case, the step of acquiring the image of the target object may include: determining the display angle of the target object; taking the display angle of the reference object as a reference, selecting the image whose display angle of the target object matches the display angle of the reference object as the reference object. The image of the target object.

For example, the display angle of the reference object may be displayed at the same time as the image of the reference object, the display angle of the target object may also be displayed after the display angle of the target object is determined, and the images of all the target objects may be displayed (according to the user's selection operation) The image in which the display angle of the target object is closest to (ie, matches) the display angle of the reference object is determined as the image of the target object.

Here, the display angle of the reference object can be extracted from the image of the reference object and displayed. It should be understood that the steps of determining the display angle of the reference object may be the same as the steps of determining the display angle of the target object. The following takes the target object as an example to introduce the steps of determining the display angle of the target object.

Specifically, the step of determining the display angle of the target object may include: marking the central arc corresponding to the measured angle of the target object as a first line with a predetermined width on the image of the target object displayed on the screen (eg, a captured image) , and mark the radius corresponding to the central arc as a second line of predetermined width, based on the proportional relationship between the number of pixels occupied by the first line and the number of pixels occupied by the second line, determine the The actual angle of the measured angle of the target object is used as the display angle of the target object.

As an example, a user's operation may be received to mark an area about the measured object on the image of the target object displayed on the screen, and the user operation may be to make one end point of a line segment of a predetermined length at the vertex position of the measured angle of the measured object and The line segment is located on one side of the measured angle, and then, taking the vertex as the center and the predetermined length as the radius, an arc is drawn from the other end point of the line segment, so as to mark the image on the captured image displayed on the screen. are a first line of predetermined width along the arc and a second line of predetermined width along the line segment. It should be understood that other suitable ways of marking the first line and the second line may also be used.

For example, the actual angle of the measured angle of the measured object can be calculated by the following equation

In formula (1), l indicates the number of pixels occupied by the first line, and r indicates the number of pixels occupied by the second line.

It should be understood that the above method for calculating the display angle of the target object is only an example, and the present invention is not limited thereto, and various existing methods can be used to determine the display angle of the reference object or the target object.

In step S30, the imaging size of the target object is determined based on the display parameters of the reference object. When the display parameter of the reference object includes the display scale coefficient of the reference object, the imaging size of the target object may be determined based on the display scale coefficient of the reference object.

Specifically, the step of determining the imaging size of the target object based on the display scale coefficient of the reference object may include: determining the actual size of the target object, and determining the size of the target object according to the display scale coefficient of the reference object and the actual size of the target object. Image size. For example, the imaging size of the target object is the quotient of the actual size of the target object and the display scale coefficient of the reference object.

In one example, the actual size of the target object may be obtained from user input.

For example, after acquiring the image of the target object, an area related to the target object may be marked on the image of the target object displayed on the screen according to the user's operation, and the actual size of the area of the target object (that is, the actual size of the area of the target object) input by the user is received. Actual size).

In another example, the actual size of the target object may be obtained based on photographing parameters of the target object by photographing an image of the target object.

The steps of acquiring the actual size of the target object by photographing the target object will be described in detail below with reference to FIG. 2 .

FIG. 2 shows a flowchart of the steps of acquiring the actual size of the target object by photographing the target object according to an exemplary embodiment of the present invention.

Referring to FIG. 2 , in step S201 , a photographed image of a target object is displayed. For example, an image capturing device (eg, a camera) on the electronic terminal may be used to capture the target object, so as to generate a corresponding clear image, and then display the captured image. Preferably, the subject can be focused to capture an image of the target subject.

In step S202, in response to the user's operation, an area related to the target object is marked on the captured image displayed on the screen. In other words, the user marks the area corresponding to the portion of the target object he wants to obtain on the captured image displayed on the screen.

As an example, the marked area may be a line of a predetermined width, or may be an area of any shape. Here, the line of the predetermined width may be at least one of the following shapes: a straight line, a curved line, and a broken line. The predetermined width can be set to M pixels. The M value can be set by the user, or can be set according to the resolution of the screen.

For example, the user operation in step S202 may be to use a touch object (for example, a stylus or a finger, etc.) to click on a point on the captured image displayed on the screen, and start sliding from this point, thereby marking the captured image displayed on the screen. is a line of predetermined width along the sliding track.

For example, the user operation in step S202 may also be to use a touch object to click multiple points on the captured image displayed on the screen in sequence, so that the captured image displayed on the screen is marked to connect the multiple points in the sequence of the clicks. A polyline of predetermined width.

In step S203, the actual size of the portion of the target object corresponding to the marked area is determined based on the number of pixels occupied by the marked area.

The step of determining the actual size of the portion of the target object corresponding to the marked area based on the number of pixels occupied by the marked area includes:

Determine the said The actual size of the portion of the target object that corresponds to the marked area.

Here, the resolution of the area where the screen displays the captured image refers to the number of pixels in the area where the screen displays the captured image. For example, if the resolution of the area in which the captured image is displayed on the screen is 240*320, it means that the number of pixels in one row of the area is 240 and the number of pixels in one column is 320.

The object distance when the image is captured can be obtained according to various suitable methods. For example, the distance sensor of the electronic terminal can be used to measure the object distance when the image is captured, or the time when the image is captured can be calculated based on the focal length and image distance when the image is captured. object distance.

As an example, the marked area may be a line with a predetermined width. In step S203, the image distance and the object distance when the image is captured, the number of pixels occupied by the line with the predetermined width, and the pixels corresponding to the predetermined width may be used. Calculate the actual length of the measured object corresponding to the marked line . In addition, it may also be based on the image distance and object distance when the image is captured, the number of pixels occupied by the lines of the predetermined width, the number of pixels corresponding to the predetermined width, and the imaging area of the imaging sensor of the electronic terminal. The proportional relationship between the width of the screen and the number of pixels in a line in the width direction of the area where the captured image is displayed on the screen, calculate the actual length of the portion of the measured object corresponding to the marked line.

For example, the actual size (ie, the actual length) L of the portion of the measured object corresponding to the marked line can be calculated by the following equation (2):

In formula (2), u and v respectively indicate the object distance and image distance when capturing an image, L _sensor indicates the length of the imaging area of the imaging sensor of the electronic terminal, and L _pixel indicates the length of the area where the screen displays the captured image. The number of pixels in a column, n indicates the number of pixels occupied by lines of the predetermined width, and M indicates the number of pixels corresponding to the predetermined width.

In addition, the actual size (ie, actual length) L of the portion of the measured object corresponding to the marked line can also be calculated by the following equation (3):

In formula (3), u and v respectively indicate the object distance and the image distance when capturing an image, W _sensor indicates the width of the imaging area of the imaging sensor of the electronic terminal, and W _pixel indicates the width of the area in which the captured image is displayed on the screen. The number of pixels in a line, n indicates the number of pixels occupied by the line of the predetermined width, and M indicates the number of pixels corresponding to the predetermined width.

It should be understood that the above method for calculating the actual size of the target object is only an example, and the present invention is not limited thereto, and various existing methods can be used to determine the actual size of the reference object or the target object. In addition, the actual size (or display angle) of the target object can also be inserted into the image of the target object in advance, so that the actual size (or display angle) of the target object can be extracted from the image of the target object.

Returning to FIG. 1 , in step S40 , the image of the target object is displayed on the image of the reference object according to the imaging size of the target object.

Preferably, the image display method according to an exemplary embodiment of the present invention may further include: in response to a drag operation on the image of the target object, changing a display position of the image of the target object on the image of the reference object. For example, after determining the display position of the image of the target object on the image of the reference object, a composite effect image of the target object and the reference object can be output for the user's reference.

It should be understood that the above-mentioned image display method according to the exemplary embodiment of the present invention may be executed in an electronic terminal, as an example, the electronic terminal may be a mobile communication terminal (eg, a smart phone), a tablet computer, a personal digital assistant, a digital multimedia Players, cameras, and other electronic devices that have a display screen.

FIG. 3 to FIG. 5 illustrate exemplary diagrams of acquiring the actual size of a target object by photographing at an electronic terminal according to an exemplary embodiment of the present invention.

FIG. 3 shows a photographing interface of an electronic terminal according to an exemplary embodiment of the present invention. In the photographing interface, an “AR identification object” option can be added. When a user’s selection operation of the “AR identification object” option is received, a photograph is taken. , insert the shooting parameters and/or the display parameters (and/or the actual size of the subject) of the subject (which may refer to the target object/reference object, as shown in the figure) (and/or the actual size of the subject) at the time of shooting the image into the subject stored with the image. That is, the image captured based on the "AR object recognition" function is an image that carries the shooting parameters and/or the display parameters of the subject (and/or the actual size of the subject).

Preferably, the subject can be photographed from multiple angles (as shown in FIG. 4 ), which facilitates finding an image of the target object that is consistent with the display angle of the reference object. In addition, after multi-angle shooting of the subject, the shooting parameters of the subject corresponding to different shooting angles can be determined respectively, and the actual size of the subject at each shooting angle and the different shooting parameters can be determined based on the shooting parameters. Display parameters of the subject obtained from the shooting angle (eg, display scale factor/display angle).

As an example, various existing optimization algorithms (eg, least squares method, root mean square method, etc.) can be used to obtain an optimal display scale coefficient based on the display scale coefficients of multiple subjects, and based on multi-angle shooting The image to determine the actual size of the subject (as shown in Figure 5, determine the length, width and height of the sofa). At this time, the optimal display scale coefficient is used as the display scale coefficient of the subject, that is, the display scale coefficients of the subject obtained from different shooting angles are all the optimal display scale coefficients.

FIG. 6 to FIG. 10 show exemplary diagrams of collocating a reference object with a target object at an electronic terminal according to an exemplary embodiment of the present invention. In this example, the reference object is a room and the target object is a sofa.

Here, a reference object (ie, a room) may be photographed using the procedures shown in FIGS. 3 to 5 . For example, first enter the shooting interface of the electronic terminal, select the AR object recognition mode, shoot images from various angles of the room multiple times to obtain the precise size of the room, and finally determine the size of each wall through an optimization algorithm and save the image of the room. At this time, the image of the room includes information such as shooting parameters and a display scale factor of the room. Take the size of one wall as an example. For example, the main wall (reference object) in the living room is 5 meters long and 2.7 meters high. In the displayed image of the room, a wall with a length of 5 meters can be scaled to 5 centimeters for display, and at this time, the display scale coefficient η can be 5 meters/5 centimeters=100.

In addition, the actual size of the sofa can be automatically determined by photographing the sofa in the furniture store, or the image and actual size of the sofa can be obtained from an online shopping platform, and then the actual size of the sofa can be manually input in the subsequent image synthesis process, preferably, the sofa The actual size of the sofa can be stored in the image of , and the actual size of the sofa can be extracted from the image of the sofa during the image synthesis process.

The image of the room (reference object) is displayed on the screen of the electronic terminal, and based on the selection operation of the “Add AR ID” option in the shortcut menu of the displayed image of the room (as shown in FIG. 6 ), the user enters the object for selecting the object. The interface of the image of the object (as shown in FIG. 7 ) can be displayed according to the user’s operation (such as the selection operation of the “Album” option) from the interface (at this time, the thumbnail of the image stored in the album of the electronic terminal is displayed in the interface). ), select an image as the image of the target object (such as a sofa), and can also control the electronic terminal to enter the shooting interface according to the user's operation (such as the selection operation of the "camera" option) to shoot the image of the target object. After acquiring the original image of the target object (for example, the image of the captured target object/the image of the target object selected from the album), the electronic terminal can be controlled to enter the editing interface of the image of the target object, on the editing interface according to the user operation to mark the area about the target object (as shown in Figure 8), take the captured image of the area as the image of the target object, and determine the imaging size of the sofa based on the display scale factor of the room (as shown in Figure 9, through Calculate the size of the sofa in the room should be length: 2.35m/100=2.35cm, width: 1.1m/100=1.1cm, height 0.9m/100=0.9cm), and determine the imaging on the image of the room size to display the image of the sofa. At this time, the user can manually rotate and adjust the position, direction, etc. of the sofa in the room, and present the composite effect diagram of the room and the sofa (as shown in Figure 10). The user can intuitively see that the furniture is bought and placed at home Then you can judge in advance whether the furniture conforms to the decoration style of your own home.

The image imaging method according to the exemplary embodiment of the present invention can obtain the effect diagram of the real matching of different virtual objects in reality, and make the reference object and the target object have a uniform proportion relative to the actual size, and achieve the effect of one-to-one matching of real objects.

FIG. 11 shows a block diagram of an image display apparatus according to an exemplary embodiment of the present invention.

As shown in FIG. 11 , an image display apparatus according to an exemplary embodiment of the present invention includes a parameter extraction unit 10 , an image acquisition unit 20 , a size determination unit 30 , and a display unit 40 .

Specifically, the display unit 40 displays an image of the reference object, and the parameter extraction unit 10 extracts display parameters of the reference object.

In one case, the parameter extraction unit 10 may extract the display parameters of the reference object from the image of the reference object.

In one example, the display parameters carried by the image of the reference object may be determined based on the shooting parameters when the reference object is shot.

For example, an image display apparatus according to an exemplary embodiment of the present invention may further include a reference object image acquisition unit that acquires an image of the reference object and display parameters of the reference object by photographing the reference object, and inserts the display parameters of the reference object into to the image of the reference object for storage. For example, the reference object image acquisition unit may generate display parameters of the reference object based on the shooting parameters of the reference object, so that the parameter extraction unit 10 may extract the display parameters of the reference object from the image of the reference object.

In another example, the display parameters carried by the image of the reference object may be determined according to the user's input. For example, the display parameters of the reference object input by the user may be received, and the received display parameters may be inserted into the image of the reference object, so that the parameter extraction unit 10 may extract the display parameters of the reference object from the image of the reference object.

In another case, the actual size of the reference object input by the user may be received, and the display parameters of the reference object may be determined based on the actual size of the reference object and the imaged size of the reference object.

Preferably, the display parameter of the reference object may be a display scale coefficient of the reference object. For example, the parameter extraction unit 10 may obtain the imaging size of the reference object based on the image of the reference object, and the display unit 40 may receive the actual size of the reference object input by the user. size, the parameter extraction unit 10 calculates the ratio of the actual size of the reference object to the imaged size of the reference object to obtain the display scale coefficient of the reference object.

Since the process of extracting the display parameters of the reference object by the parameter extracting unit 10 has been described in detail in step S10, the present invention will not repeat them.

The image acquisition unit 20 acquires an image of the target object.

As an example, the display parameter of the reference object may further include a display angle of the reference object, and the display angle represents the actual shooting angle when the image of the reference object is shot.

Optionally, the image display device according to the exemplary embodiment of the present invention may further include: an angle determination unit, which determines the display angle of the target object, and the image acquisition unit 20 uses the display angle of the reference object as a reference to select An image whose display angle of the target object matches the display angle of the reference object is used as the image of the target object.

For example, the angle determination unit marks the central arc corresponding to the measured angle of the target object as a first line with a predetermined width on the captured image displayed on the screen, and marks the radius corresponding to the central arc as the predetermined width The second line, based on the proportional relationship between the number of pixels occupied by the first line and the number of pixels occupied by the second line, determine the actual angle of the measured angle of the target object as the target object's actual angle. Display angle.

Since the process of acquiring the image of the target object by the image acquiring unit 20 has been described in detail in step S20, the present invention will not repeat it.

The size determination unit 30 determines the imaging size of the target object based on the display parameters of the reference object. When the display parameter of the reference object includes the display scale coefficient of the reference object, the size determination unit 30 may determine the imaging size of the target object based on the display scale coefficient of the reference object.

For example, the size determination unit 30 may determine the actual size of the target object, and determine the imaging size of the target object according to the display scale coefficient of the reference object and the actual size of the target object. For example, the imaging size of the target object may be the quotient of the actual size of the target object and the display scale coefficient of the reference object.

In one example, the size determination unit 30 may obtain the actual size of the target object according to the user input.

In another example, the size determination unit 30 obtains the actual size of the target object based on the shooting parameters when shooting the target object.

For example, in response to the user's operation, the size determination unit 30 marks an area related to the target object on the captured image of the target object displayed on the screen, and determines the target object based on the number of pixels occupied by the marked area The actual size of the part corresponding to the marked area.

Specifically, the size determination unit 30 is based on the image distance and object distance when the image is captured, the number of pixels occupied by the marked area, and the difference between the size of the imaging area of the imaging sensor and the resolution of the area where the captured image is displayed on the screen The corresponding relationship is determined, and the actual size of the part of the target object corresponding to the marked area is determined.

As an example, the marked area is a line with a predetermined width, and the size determination unit 30 may be based on the image distance and the object distance when the image is captured, the number of pixels occupied by the line with the predetermined width, and the pixels corresponding to the predetermined width. The actual size of the portion of the target object corresponding to the marked line is calculated from the number of dots, and the proportional relationship between the length of the imaging area of the imaging sensor and the number of pixels in a column of the area where the captured image is displayed on the screen.

The display unit 40 displays the image of the target object on the image of the reference object according to the imaging size of the target object. The display unit 40 may also output a composite effect image of the target object and the reference object for the user's reference.

A computing device is also provided according to an exemplary embodiment of the present invention. The computing device includes a processor and memory. Memory is used to store program instructions. The program instructions are executed by the processor to cause the processor to execute the program instructions of the image display method as described above.

Exemplary embodiments according to the present invention also provide a computer-readable storage medium. The computer-readable storage medium stores program instructions that, when executed by the processor, cause the processor to perform the above-described image display method. The computer-readable recording medium is any data storage device that can store data read by a computer system. Examples of the computer-readable recording medium include read-only memory, random-access memory, optical disks, magnetic tapes, floppy disks, optical data storage devices, and carrier waves (such as data transmission through the Internet via wired or wireless transmission paths). The computer-readable recording medium can also be distributed over network coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion. In addition, functional programs, codes and code segments for accomplishing the present invention can be easily construed by programmers of ordinary skill in the art to which the present invention pertains within the scope of the present invention.

Using the image display method and device according to the exemplary embodiments of the present invention can realize the intelligent collocation of different virtual objects in the same space, so as to present the collocation effect diagram of the virtual objects in reality to the user.

In addition, using the image display method and device according to the exemplary embodiment of the present invention, a series of parameters generated when taking pictures are used to realize the optimal zooming of the objects in the photographed real or virtual pictures, so that the real pictures can be intelligently matched.

Also, the image display method according to the exemplary embodiment of the present invention can be implemented as computer codes in a computer-readable recording medium. Those skilled in the art can implement the computer code according to the description of the above method. The above-described method of the present invention is implemented when the computer code is executed in a computer.

Although the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those skilled in the art that form and detail may be made therein without departing from the spirit and scope of the invention as defined in the claims various changes on.

Claims (14)

1. a kind of image display method, described image display methods include:

It shows the image of object of reference, and extracts the display parameters of the object of reference；

Obtain the image of target object；

The imaging size of the target object is determined based on the display parameters of the object of reference；

The image of the target object is shown according to the imaging size of the target object on the image of the object of reference.

2. image display method as described in claim 1, wherein the display parameters of the object of reference include the object of reference Display scale coefficient, the display scale coefficient indicate the actual size of the object of reference and the imaging size of the object of reference Ratio.

3. image display method as claimed in claim 2, wherein described in the display scale coefficient determination based on the object of reference The step of imaging size of target object includes:

Determine the actual size of the target object；

According to the actual size of the display scale coefficient of the object of reference and the target object determine the target object at As size.

4. image display method as claimed in claim 3, wherein the imaging size of the target object is the target object Actual size and the object of reference display scale coefficient quotient.

5. image display method as claimed in claim 3, wherein the step of determining the actual size of target object packet It includes:

By shooting the image of the target object, the target object is obtained based on the acquisition parameters of the target object Actual size；Or

The actual size of the target object is obtained according to user's input.

6. image display method as claimed in claim 5, wherein by shooting the image of the target object, based on described The step of actual size of the acquisition parameters of target object to obtain the target object includes:

Show the image of the target object of shooting；

In response to the operation of user, region of the label about the target object on the image for the shooting that screen is shown；

The quantity of pixel shared by region based on label determines the part corresponding with the region of label of the target object Actual size.

7. image display method as claimed in claim 6, wherein the quantity of pixel shared by the region based on label determines The step of actual size of the part corresponding with the region of label of the target object includes:

Image distance and object distance when based on shooting image, the quantity and imaging sensor of pixel shared by the region of label Corresponding relationship between the resolution ratio in the region of the image of size and screen the display shooting of imaging region, determines the target pair The actual size of the part corresponding with the region of label of elephant.

8. image display method as claimed in claim 7, wherein the region of label is the lines of preset width,

Wherein, the quantity of pixel shared by the region based on label determines the corresponding with the region of label of the target object The step of partial actual size includes:

It is image distance and object distance when based on shooting image, the quantity of pixel shared by the lines of the preset width, described predetermined The image of length and screen the display shooting of the imaging region of the quantity and imaging sensor of pixel corresponding to width Proportionate relationship between the quantity of the one column pixel in region calculates the part corresponding with the lines of label of the target object Actual size.

9. image display method as described in claim 1, wherein the display parameters of the object of reference further include the object of reference Angles of display, the angles of display indicates actual photographed angle when shooting the image of the object of reference,

Wherein, the step of obtaining the image of target object include:

Determine the angles of display of the target object；

Using the angles of display of the object of reference as reference, the angles of display of the target object and the display of the object of reference are chosen Image of the image that angle matches as the target object.

10. image display method as claimed in claim 9, wherein the step of determining the angles of display of target object packet It includes:

Center of circle arc label corresponding to the measured angle of the target object is denoted as pre- fixed width on the image for the shooting that screen is shown Degree the first lines, and by radius corresponding with the center of circle arc be labeled as preset width the second lines,

Proportionate relationship between the quantity of pixel shared by quantity and the second lines based on pixel shared by the first lines, Determine angles of display of the actual angle of the target object measured angle as the target object.

11. image display method as described in claim 1, wherein obtained by being shot to the object of reference described The display parameters of the image of object of reference and the object of reference.

12. a kind of image display, described image shows that equipment includes:

Display unit shows the image of object of reference；

Parameter extraction unit extracts the display parameters of the object of reference；

Image acquisition unit obtains the image of target object；

Size determination unit determines the imaging size of the target object based on the display parameters of the object of reference,

Wherein, display unit shows the target pair according to the imaging size of the target object on the image of the object of reference The image of elephant.

13. a kind of computing device, comprising:

Processor；

Memory is executed by processor for storing to work as so that processor is executed such as any one institute in claim 1 to 11 The program instruction for the image display method stated.

14. a kind of computer readable storage medium is stored with and processor is made to execute such as claim when being executed by a processor The program instruction of image display method described in any one in 1-11.