CN114463212A - Image processing method and device, electronic device and storage medium - Google Patents

Abstract

The method determines a first mask image and a second mask image of a face image, and the first mask image and the second mask image are respectively used for representing a first part area and a second part area in the face image, and the second part area is in the first part area. And lip processing information including area information and beautification parameter information is acquired, and the range of a second part area in the second mask image is adjusted according to the area information and the first mask image. And beautifying the face image according to the beautifying parameter information and the adjusted second mask image to obtain a target image with the color of the second part region adjusted.

Description

Image processing method and device, electronic device and storage medium

technical field

The present disclosure relates to the field of computer technologies, and in particular, to an image processing method and apparatus, an electronic device, and a storage medium.

Background technique

At present, the beautification of the human face mainly focuses on the whitening of the whole face, the repair of blemishes, the shape adjustment of local organs, and the superposition of makeup effects.

SUMMARY OF THE INVENTION

According to a first aspect of the present disclosure, an image processing method is provided, comprising:

Determine a first mask image and a second mask image of the face image, the first mask image is used to characterize the first part region of the face image, and the second mask image is used to characterize the a second part area of the face image, the second part area is at least partially different from the first part area;

Acquire lip processing information, where the lip processing information includes area information and beautification parameter information, the area information is used to indicate the range of the second part area, and the beautification parameter information is used to indicate the second part The beautification parameters of the area;

Adjust the range of the second part region in the second mask image according to the region information and the first mask image;

The face image is beautified according to the beautification parameter information and the adjusted second mask image, to obtain a target image in which the color of the second part region is adjusted.

In a possible implementation manner, the adjusting the range of the second part region in the second mask image according to the region information and the first mask image includes:

According to the area information and the first mask image, an image erosion operation is performed on the second mask image to adjust the range of the second part area; during the image erosion process, the second part The area coincides with at least a part of the first part area.

In a possible implementation manner, performing an image erosion operation on the second mask image according to the region information and the first mask image, and adjusting the range of the second part region includes:

According to the first mask image, image erosion is performed from the first edge of the second part region in the second mask image to the second edge until the adjustment condition corresponding to the region information is satisfied.

In a possible implementation manner, the adjustment condition corresponding to the area information is that the ratio of the current second part area to the original second part area is the value of the area information.

In a possible implementation manner, the performing image erosion from the first edge to the second edge of the second part region in the second mask image according to the first mask image includes:

Determining target pixels sequentially from the first edge of the second part region to the second edge;

Determine the target area according to the position of the target pixel in the second mask image;

Determine the reference pixel in the second mask image according to the pixel value of each pixel in the target area of the first mask image;

The pixel value of the target pixel is updated according to the pixel value in the reference pixel in the second mask image.

In a possible implementation manner, the determining the reference pixel in the second mask image according to the pixel value of each pixel of the first mask image in the target area includes:

obtaining the pixel value of each pixel of the first mask image in the target area;

A reference pixel is determined in the second mask image according to the position of the pixel whose pixel value is greater than a pixel threshold in the first mask image.

In a possible implementation manner, the determining the first mask image of the face image includes:

determining a first reference mask image, the first reference mask image being used to characterize the predicted shape of the first part region;

Identify the first part region in the face image;

A first mask image is generated according to the first part region and the first reference mask image.

In a possible implementation manner, the determining the second mask image of the face image includes:

determining a second reference mask image, the second reference mask image being used to characterize the edge prediction shape of the first part region;

Identify the first part region in the face image;

A second mask image is generated according to the first part region and the second reference mask image.

In a possible implementation manner, the acquiring lip processing information includes:

Displays a lip editing page including area adjustment controls and color adjustment controls;

In response to the user triggering the area adjustment control and the color adjustment control, corresponding area information and beautification parameter information are generated respectively;

Lip treatment information is determined according to the area information and the beautification parameter information.

In a possible implementation manner, the color editing is performed on the face image according to the beautification parameter information and the adjusted second mask image, so as to obtain a target whose color of the second part region is adjusted Images include:

Generate a beautification image according to the beautification parameter information and the adjusted second mask image, where the beautification image is an image filled with the beautification parameter information to represent a color in the second part area;

Perform image fusion on the beautified image and the face image to obtain a target image in which the color of the second part region is adjusted.

In a possible implementation manner, the image processing method is used to add a lip line beautification effect to the face image, the first part region is a lip region, and the second part region is a lip line region.

According to a second aspect of the present disclosure, there is provided an image processing apparatus, comprising:

an image determination module, configured to determine a first mask image and a second mask image of the face image, the first mask image is used to represent the first part region of the face image, the second mask image the image is used to represent a second part region of the face image, and the second part region is at least partially different from the first part region;

an information acquisition module for acquiring lip processing information, where the lip processing information includes area information and beautification parameter information;

a range adjustment module, configured to adjust the range of the second part region in the second mask image according to the region information and the first mask image;

The color adjustment module is configured to perform color editing on the face image according to the beautification parameter information and the adjusted second mask image, so as to obtain a target image in which the color of the second part region is adjusted.

In a possible implementation, the range adjustment module includes:

an image erosion sub-module, configured to perform an image erosion operation on the second mask image according to the region information and the first mask image, and adjust the range of the second part region; during the image erosion process wherein, the second part region overlaps with at least part of the first part region.

In a possible implementation manner, the image erosion sub-module includes:

an image erosion unit, configured to perform image erosion from the first edge of the second part region in the second mask image to the second edge according to the first mask image, until the adjustment conditions corresponding to the region information are satisfied .

In a possible implementation manner, the adjustment condition corresponding to the area information is that the ratio of the current second part area to the original second part area is the value of the area information.

In a possible implementation manner, the image erosion unit includes:

a target pixel determination subunit, configured to sequentially determine target pixels from the first edge of the second part region to the second edge;

an area determination subunit, configured to determine a target area according to the position of the target pixel in the second mask image;

a reference pixel determination subunit, configured to determine a reference pixel in the second mask image according to the pixel value of each pixel of the first mask image in the target area;

A pixel value updating subunit, configured to update the pixel value of the target pixel according to the pixel value in the reference pixel in the second mask image.

In a possible implementation manner, the reference pixel determination subunit includes:

a pixel value acquisition subunit, used for acquiring the pixel value of each pixel of the first mask image in the target area;

A reference pixel screening subunit, configured to determine a reference pixel in the second mask image according to the position of the pixel whose pixel value is greater than a pixel threshold in the first mask image.

In a possible implementation, the image determination module includes:

a first reference image determination submodule, configured to determine a first reference mask image, where the first reference mask image is used to characterize the predicted shape of the first part region;

a first region identification submodule, used for identifying the first part region in the face image;

The first image generation sub-module is configured to generate a first mask image according to the first part region and the first reference mask image.

In a possible implementation, the image determination module includes:

A second reference image determination submodule, configured to determine a second reference mask image, where the second reference mask image is used to characterize the edge prediction shape of the first part region;

The second area identification submodule is used to identify the first part area in the face image;

A second image generation sub-module, configured to generate a second mask image according to the first part region and the second reference mask image.

In a possible implementation, the information acquisition module includes:

The page display submodule is used to display the lip editing page including the area adjustment control and the color adjustment control;

an information determination submodule for generating corresponding area information and beautification parameter information respectively in response to the user triggering the area adjustment control and the color adjustment control;

An information generation sub-module, configured to determine lip processing information according to the area information and the beautification parameter information.

In a possible implementation, the color adjustment module includes:

A beautification image generation sub-module, configured to generate a beautification image according to the beautification parameter information and the adjusted second mask image, and the beautification image is to fill the beautification parameter information in the second part area to represent a color Image;

The image fusion sub-module is used for image fusion of the beautified image and the face image to obtain the target image with the color of the second part region adjusted.

In a possible implementation manner, the image processing method is used to add a lip line beautification effect to the face image, the first part region is a lip region, and the second part region is a lip line region.

According to a third aspect of the present disclosure, there is provided an electronic device, comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to invoke the instructions stored in the memory to execute the above method.

According to a fourth aspect of the present disclosure, there is provided a computer-readable storage medium having computer program instructions stored thereon, the computer program instructions implementing the above method when executed by a processor.

In the embodiment of the present disclosure, the first part region and the second part region of the face image can be identified, and the second part region can be adjusted based on the region information specified by the user and the first part region to obtain the region that needs to be beautified and edited. Beautify. Further, the beautification processing process can be used to add a lip line beautification effect to the face image, so as to achieve the effect of accurately beautifying the specific area of the lips of the face image.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the accompanying drawings.

Description of drawings

The accompanying drawings, which are incorporated into and constitute a part of this specification, illustrate embodiments consistent with the present disclosure, and together with the description, serve to explain the technical solutions of the present disclosure.

FIG. 1 shows a flowchart of an image processing method according to an embodiment of the present disclosure;

FIG. 2 shows a schematic diagram of a first mask image according to an embodiment of the present disclosure;

3 shows a schematic diagram of a second mask image according to an embodiment of the present disclosure;

FIG. 4 shows a schematic diagram of a lip editing page according to an embodiment of the present disclosure;

FIG. 5 shows a schematic diagram of adjusting the second part area according to an embodiment of the present disclosure;

FIG. 6 shows a schematic diagram of an image processing apparatus according to an embodiment of the present disclosure;

FIG. 7 shows a schematic diagram of an electronic device according to an embodiment of the present disclosure;

FIG. 8 shows a schematic diagram of an electronic device according to an embodiment of the present disclosure.

Detailed ways

Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numbers in the figures denote elements that have the same or similar functions. While various aspects of the embodiments are shown in the drawings, the drawings are not necessarily drawn to scale unless otherwise indicated.

The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration." Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

The term "and/or" in this article is only an association relationship to describe the associated objects, indicating that there can be three kinds of relationships, for example, A and/or B, it can mean that A exists alone, A and B exist at the same time, and A and B exist independently B these three cases. In addition, the term "at least one" herein refers to any combination of any one of the plurality or at least two of the plurality, for example, including at least one of A, B, and C, and may mean including from A, B, and C. Any one or more elements selected from the set of B and C.

In addition, in order to better illustrate the present disclosure, numerous specific details are set forth in the following detailed description. It will be understood by those skilled in the art that the present disclosure may be practiced without certain specific details. In some instances, methods, means, components and circuits well known to those skilled in the art have not been described in detail so as not to obscure the subject matter of the present disclosure.

In a possible implementation manner, the image processing method in the embodiment of the present disclosure may be executed by an electronic device such as a terminal device or a server. Wherein, the terminal device may be User Equipment (UE), mobile device, user terminal, terminal, cellular phone, cordless phone, Personal Digital Assistant (PDA), handheld device, computing device, in-vehicle device, mobile phone, etc. Any fixed or mobile terminal such as wearable devices. The server can be a single server or a server cluster composed of multiple servers. Any electronic device can implement the image processing method of the embodiments of the present disclosure by invoking the computer-readable instructions stored in the memory by the processor.

FIG. 1 shows a flowchart of an image processing method according to an embodiment of the present disclosure. As shown in FIG. 1 , the image processing method in the embodiment of the present disclosure may include the following steps S10-S40.

Step S10: Determine the first mask image and the second mask image of the face image.

In a possible implementation manner, the face image is an image to be beautified, including the face to be processed. The electronic device can acquire a face image through a built-in or connected image acquisition device, or acquire it through other electronic devices and transmit it to the electronic device currently executing the image processing method for image processing. The electronic device determines the first mask image and the second mask image of the face image after acquiring the face image. The first mask image is used to represent the first part region of the face image, and the second mask image is used to represent the second part region of the face image. Optionally, the second site region is at least partially different from the first site region, eg may be within the first site region. The outer edge of the second part region may also coincide with the outer edge of the first part region. For example, the first part area may be the area where all the lips of the face to be processed are located in the face image, and the second part area may be the edge area of the area where all the lips of the to-be-processed face are located in the face image.

Optionally, the first mask image and the second mask image may be binary images, the pixel value in the first part region and the second part region is 1, and the pixel value in other regions is 0. In order to further perform image processing on each pixel value in the first part region and the second part region through different processing intensities, the image processing effect is improved. Each pixel value in the first mask image and the second mask image can also be a value between 0 and 1, which is used to distinguish the first part region or the second part region and other regions, and to characterize the subsequent image processing process. processing intensity. In the embodiment of the present disclosure, the processing intensity represents the corresponding beautification intensity. For example, when the beautification parameter used for image processing is N, the pixel value can be beautified by the product of each pixel value and the beautification parameter N, for example, the pixel value with the pixel value of 1 is processed by the beautification parameter 0.5 times N handles pixel values with a pixel value of 0.5. The electronic device may determine the first part region and the second part region by the pixel value of each pixel and the preset pixel threshold. The description is given by taking the preset pixel threshold value of 0.5 as an example. In the first mask image, the positions of the pixels whose pixel values are not less than 0.5 are located in the first part region, and the positions of the pixels whose pixel values are less than 0.5 are located in other regions than the first part region. In the second mask image, the positions of pixel values not less than 0.5 are located in the second part region, and the positions of pixel values less than 0.5 are located in other regions than the second part region.

FIG. 2 shows a schematic diagram of a first mask image according to an embodiment of the present disclosure. As shown in FIG. 2 , the first mask image 20 has the same size as the acquired face image, and includes a first area 21 composed of pixels whose pixel values are not less than the pixel threshold, and includes pixels whose pixel values are less than the pixel threshold. the second area 22. Wherein, the first area 21 corresponds to the position of the lips in the face image, that is, the position representing the lips of the face in the face image. The second area 22 corresponds to other positions in the face image than the position of the lips, and represents other positions in the face image except for the position of the lips of the face. That is to say, the first area 21 is the first part area represented by the first mask image.

FIG. 3 shows a schematic diagram of a second mask image according to an embodiment of the present disclosure. As shown in FIG. 3 , the second mask image 30 has the same size as the acquired face image, and includes a third area 31 composed of pixels whose pixel value is not less than the pixel threshold, and a third region 31 composed of pixels whose pixel value is less than the pixel threshold. the fourth area 32. Wherein, the third area 31 corresponds to the edge position of the lips in the face image, that is, the position where lip lines need to be drawn to represent the lips of the face in the face image. The fourth area 32 corresponds to positions other than the lip edge position in the face image, and represents the position in the face image where lip lines do not need to be drawn. That is to say, the third area 31 is the second part area represented by the second mask image. Optionally, the second site region has an inner edge 33 and an outer edge 34 .

In a possible implementation manner, the first mask image and the second mask image may be determined according to predetermined standard materials. For example, the process of determining the first mask image may be to determine the first reference mask image first, the first reference mask image is used to represent the predicted shape of the first part region, and then identify the first part region in the face image, according to The first part region and the first reference mask image generate a first mask image. The process of determining the second mask image can be as follows: first determine the second reference mask image, the second reference mask image is used to represent the edge prediction shape of the first part region, and then identify the first part region in the face image, according to The first part region and the second reference mask image generate a second mask image. The first reference mask image and/or the second reference mask image may be mask image materials preset according to the simulated human face, or mask image materials uploaded by the user according to their own needs. In the case where the image processing method of the embodiment of the present disclosure is used to add a lip line beautification effect to a face image, the first part area is the lip area, and the second part area is the lip line area, the first reference mask image may be the user The image uploaded or generated by the electronic device represents the shape of the lip, and the second reference mask image may be the image uploaded by the user or generated by the electronic device to represent the shape of the lip line.

Optionally, the method of recognizing the face image to obtain the first part area is key point recognition, and the obtained first part area includes a plurality of key position points, such as the position of the corner of the mouth, the position of the upper edge, the position of the lower edge and the lip beads. location etc. The determined first reference mask image and the second reference mask image also include multiple key position points, and the first mask can be determined by performing key position point mapping between the first reference mask image and the first part region The second mask image is determined by performing key point mapping between the second reference mask image and the first part region. Based on the key point mapping, the first mask image and the second mask image determined in the above manner can accurately locate the positions of the first part region and the second part region in the face image.

Step S20, acquiring lip processing information.

In a possible implementation, the lip processing information may include area information and beautification parameter information, the area information is used to indicate the range of the second part area to be beautified in the face image, and the beautification parameter information is used to indicate the face image The beautification parameters of the second part area to be beautified. The beautification parameters may include any parameters for beautifying the lips, such as color, brightness, contrast, and transparency. Optionally, the lip treatment information may be acquired in any manner, for example, directly receiving lip treatment information sent by other electronic devices, or determining it through human-computer interaction with the user.

Exemplarily, in an application scenario where the lip processing information is determined by man-machine interaction with the user, the electronic device may display a lip editing page including a region adjustment control and a color adjustment control. And in response to the user triggering the area adjustment control and the color adjustment control, corresponding area information and beautification parameter information are respectively generated. The lip processing information is determined according to the area information and the beautification parameter information.

FIG. 4 shows a schematic diagram of a lip editing page 40 according to an embodiment of the present disclosure. When the electronic device is a terminal device, the lip editing page 40 can be displayed by a display device built in or connected to the electronic device. When the electronic device is a server, the lip editing page 40 can be sent to the terminal device through the server, and displayed on the display device of the terminal device. As shown in FIG. 4 , the lip editing page 40 includes a color adjustment control 41 and an area adjustment control 42 .

Optionally, the color adjustment control 41 may include a preset color control that can directly select a preset color by the user through human-computer interaction, and can be determined by the user by dragging or inputting a color value through human-computer interaction. Custom color controls for colors (R, G, B). In the process of human-computer interaction, the electronic device may receive a preset color in the preset color control color 1-color 6 that is directly selected by the user by clicking. Alternatively, it is also possible to receive an RGB value within 0-255 determined by the user by inputting or dragging to obtain the desired color. Further, the color adjustment control 41 also includes an intensity adjustment control (L), which is used to represent the intensity of the color to be adjusted, and the selected value can be between 0 and 1. The beautification parameter information can be determined according to the color and color intensity that the user determines or selects through human-computer interaction.

Further, the area adjustment control 42 may include a drag bar that the user can drag to determine the adjustment ratio of the width through human-computer interaction, and an input box that can input the expected adjustment ratio of the width. Optionally, the adjusted width ratio determined by the user may be a numerical value, which is used to represent the ratio of the required width of the second part region to the current second part region. The electronic device may generate the area information according to the adjusted width ratio determined by the user through human-computer interaction. Optionally, after the user triggers the color adjustment control 41 to generate the beautification parameter information, and triggers the area adjustment control 42 to generate the area information, the electronic device may generate the lip treatment information including the area information and the beautification parameter information.

In a possible implementation manner, the lip editing page 40 can also be used to display the face image 43 (with partial area occlusion processing), and the second part area 44 in the face image 43, which is determined by the electronic device. After the lip processing information, the image is beautified according to the lip processing information and displayed to the user in real time. The user can re-determine new lip treatment information through human-computer interaction in case of dissatisfaction.

Step S30: Adjust the range of the second part region in the second mask image according to the region information and the first mask image.

In a possible implementation manner, the second mask image may be adjusted based on the first mask image and the region information determined by the user, so as to modify the range of the second part region represented in the second mask image. Optionally, before and after the adjustment, the position of the second part region represented by the second mask image is in the first part region represented by the first mask image. The adjustment process of the second mask image can be achieved by image erosion, which is used to shrink or refine objects in the image. For example, an image erosion operation may be performed on the second mask image according to the region information and the first mask image, so as to adjust the range of the second part region. During the image erosion process, the second site region may coincide with at least a partial region of the first site region.

During the image erosion process, both the region information and the first mask image are used to define the image erosion range. The area information may be used to define the adjusted width of the second part area. Optionally, the second part region is a continuous region including the first edge and the second edge, and the direction of image erosion may be erosion from the first edge to the second edge. That is, according to the first mask image, image erosion can be performed from the first edge of the second part region in the second mask image to the second edge until the adjustment conditions corresponding to the region information are satisfied. As shown in FIG. 3 , the first edge of the second part region 31 is the inner edge 33 located on the inner side, and the second edge of the second part region 32 is the outer edge 34 located on the outer side. Optionally, when the area information is a numerical value, the adjustment condition corresponding to the area information may be that the ratio of the current second part area to the original second part area is the value of the area information. That is to say, the preset lip edge area can be reduced by adjusting the area information. For example, when the preset area width of the second part is 5 mm and the area information is 0.3, the width of the second part area obtained after the image is corroded is 1.5 mm.

Further, in the image erosion process, the first mask image is used to filter out reference pixels used for image erosion in the second mask image, and then the image erosion process is implemented according to the filtered reference pixels. Therefore, according to the first mask image, the process of performing image erosion from the first edge to the second edge of the second part region in the second mask image may include: starting from the first edge of the second part region to the second edge The target pixels are determined in turn. The target area is determined according to the position of the target pixel in the second mask image. The reference pixel in the second mask image is determined according to the pixel value of each pixel in the target area of the first mask image. The pixel value of the target pixel is updated according to the pixel value in the reference pixel in the second mask image. For example, the minimum pixel value in each reference pixel may be compared to replace the pixel value of the target pixel by the minimum pixel value in each reference pixel in the second mask image.

In a possible implementation manner, the selection of the target pixel may be determined sequentially from the first edge of the second part region position to outward. After each replacement of the target pixel, a new target pixel can be re-determined in the second part area, and image erosion is performed again until the image erosion process is completed. The size of the target area may be a predetermined preset size. After each target pixel is determined, an area with the target pixel as the center and the size of the preset size is determined as the corresponding target area. For example, when the preset size is 3×3 and the coordinates of the target pixel are (2,4), the target area consists of pixels (1,3), (1,4), (1,5), (2,3 ), (2,4), (2,5), (3,3), (3,4) and (3,5).

Further, after the target area is determined, the reference pixels are obtained by screening according to the pixel value of each pixel in the target area of the first mask image. Optionally, the screening method can be implemented based on a preset pixel threshold. For example, the pixel value of each pixel in the target area of the first mask image is obtained, and the pixel value is determined in the second mask image according to the position of the pixel whose pixel value is greater than the pixel threshold in the first mask image. The target area is 3×3, and the pixel coordinates included are (1,3), (1,4), (1,5), (2,3), (2,4), (2,5) , (3,3), (3,4) and (3,5) as examples. When the coordinates in the first mask image are (1,3), (1,4), (1,5), (2,3), (2,4), (2,5), (3,3) , (3,4) and (3,5) have pixel values of 1, 1, 0.7, 1, 0.8, 0.1, 0.9, 0.2, and 0, respectively, and the preset pixel threshold is 0.5. The coordinates of the reference pixels are (1,3), (1,4), (1,5), (2,3), (2,4) and (3,3), respectively. When the pixel values in the above reference pixels (1,3), (1,4), (1,5), (2,3), (2,4) and (3,3) in the second mask image When they are 0.1, 0.2, 1, 0.7, 0.8, 0, and 0.9, respectively, obtain the minimum value of 0 to replace the pixel value 0.8 in the target pixel (2, 4).

FIG. 5 shows a schematic diagram of adjusting the second part region according to an embodiment of the present disclosure. As shown in FIG. 2 , after determining the target area 50 centered on the current target pixel in the second mask image, a target area 51 at the position of the target area in the first mask image is also acquired. A reference pixel is obtained by filtering the pixel value of each pixel in the target area 51 in the first mask image, and an image corrosion area 52 composed of a plurality of reference pixels in the target area 50 in the second mask image is obtained. Further, the pixel value in the target pixel is replaced by the minimum value 0 in the image erosion area 52 .

After completing the image erosion according to the region information and the first mask image, a second mask image after adjusting the second part region represented therein is obtained.

Step S40 , performing color editing on the face image according to the beautification parameter information and the adjusted second mask image, to obtain a target image in which the color of the second part region is adjusted.

In a possible implementation manner, after adjusting the second mask image according to the region information and the first mask image, according to the beautification parameter information in the color editing information and the adjusted second mask image to the face image The second part area of is color-edited to obtain the target image.

Optionally, the adjustment process of the face image may firstly generate a beautification image according to the beautification parameter information and the adjusted second mask image, and the beautification image is an image in which the beautification parameter information is filled to represent the color in the second part region. Further, the beautification image may be an image of the same size as the face image, wherein only the second part area is filled with the color represented by the beautification parameter information according to the intensity of each pixel representing the second part area in the second mask image, and other areas are filled with the color represented by the beautification parameter information. Set to transparent, that is, the pixel value is set to 0. After the beautified image is obtained, image fusion is performed on the beautified image and the face image to obtain a target image in which the color of the second part region is adjusted. Optionally, the image fusion method can be any fusion method, such as multiplication and transparency fusion. Wherein, the process of multiplication is to superimpose the position of the second part region in the beautified image on the position of the second part region in the face image in the form of a slideshow.

The image processing method in the embodiment of the present disclosure can be used to beautify the lips of a human face in a human face image. For example, a face image can be obtained through an electronic device, and the lip region of the face can be obtained by performing feature point recognition on the face in the face image. According to the preset or user-uploaded first reference mask image and the lip region, a first mask image representing the position of the face lip region in the face image is obtained, and according to the preset or user-uploaded second reference mask image The mask image and the lip region obtain a second mask image representing the position of the lip edge of the face in the face image. Further, the electronic device determines the area information indicating that the user wishes to increase the lip line effect area, and the beautification parameter information for indicating the lip line color, intensity and brightness that the user wishes to increase by means of human-computer interaction with the user. Adjust the second mask image according to the area information and the first mask image to determine the area where the lip line effect needs to be added finally, and obtain the beautification parameter information and the adjusted second mask image for beautifying the lip line effect that needs to be added. The beautified image of the area, and the beautified image and the face image are multiplied to obtain the face image with the beautified lip line effect.

The embodiments of the present disclosure can identify the first part region and the second part region of the face image, and adjust the second part region based on the region information specified by the user and the first part region, so as to obtain the region that needs to be color edited for color editing. It achieves the effect of precise beautification of the specific area of the lips of the face image.

It can be understood that the above-mentioned method embodiments mentioned in the present disclosure can be combined with each other to form a combined embodiment without violating the principle and logic. Those skilled in the art can understand that, in the above method of the specific embodiment, the specific execution order of each step should be determined by its function and possible internal logic.

In addition, the present disclosure also provides an image processing apparatus, an electronic device, a computer-readable storage medium, and a program, all of which can be used to implement any image processing method provided by the present disclosure. Corresponding records will not be repeated.

FIG. 6 shows a schematic diagram of an image processing apparatus according to an embodiment of the present disclosure. As shown in FIG. 6 , the image processing apparatus according to the embodiment of the present disclosure includes an image determination module 60 , an information acquisition module 61 , a range adjustment module 62 and a color adjustment module 63 .

The image determination module 60 is configured to determine a first mask image and a second mask image of the face image, where the first mask image is used to represent the first part region of the face image, and the second mask image is used to represent the first part region of the face image. The code image is used to represent a second part area of the face image, and the second part area is at least partially different from the first part area;

The information acquisition module 61 is used for acquiring lip processing information, the lip processing information includes area information and beautification parameter information;

a range adjustment module 62, configured to adjust the range of the second part region in the second mask image according to the region information and the first mask image;

The color adjustment module 63 is configured to perform color editing on the face image according to the beautification parameter information and the adjusted second mask image, so as to obtain a target image in which the color of the second part region is adjusted.

In a possible implementation manner, the range adjustment module 62 includes:

an image erosion sub-module, configured to perform an image erosion operation on the second mask image according to the region information and the first mask image, and adjust the range of the second part region; during the image erosion process wherein, the second part region overlaps with at least part of the first part region.

In a possible implementation manner, the image erosion sub-module includes:

an image erosion unit, configured to perform image erosion from the first edge of the second part region in the second mask image to the second edge according to the first mask image, until the adjustment conditions corresponding to the region information are satisfied .

In a possible implementation manner, the adjustment condition corresponding to the area information is that the ratio of the current second part area to the original second part area is the value of the area information.

In a possible implementation manner, the image erosion unit includes:

a target pixel determination subunit, configured to sequentially determine target pixels from the first edge of the second part region to the second edge;

an area determination subunit, configured to determine a target area according to the position of the target pixel in the second mask image;

a reference pixel determination subunit, configured to determine a reference pixel in the second mask image according to the pixel value of each pixel of the first mask image in the target area;

A pixel value updating subunit, configured to update the pixel value of the target pixel according to the pixel value in the reference pixel in the second mask image.

In a possible implementation manner, the reference pixel determination subunit includes:

a pixel value acquisition subunit, used for acquiring the pixel value of each pixel of the first mask image in the target area;

A reference pixel screening subunit, configured to determine a reference pixel in the second mask image according to the position of the pixel whose pixel value is greater than a pixel threshold in the first mask image.

In a possible implementation manner, the image determination module 60 includes:

a first reference image determination submodule, configured to determine a first reference mask image, where the first reference mask image is used to characterize the predicted shape of the first part region;

a first region identification submodule, used for identifying the first part region in the face image;

The first image generation sub-module is configured to generate a first mask image according to the first part region and the first reference mask image.

In a possible implementation manner, the image determination module 60 includes:

A second reference image determination submodule, configured to determine a second reference mask image, where the second reference mask image is used to characterize the edge prediction shape of the first part region;

The second area identification submodule is used to identify the first part area in the face image;

A second image generation sub-module, configured to generate a second mask image according to the first part region and the second reference mask image.

In a possible implementation manner, the information acquisition module 61 includes:

The page display submodule is used to display the lip editing page including the area adjustment control and the color adjustment control;

an information determination submodule for generating corresponding area information and beautification parameter information respectively in response to the user triggering the area adjustment control and the color adjustment control;

An information generation sub-module, configured to determine lip processing information according to the area information and the beautification parameter information.

In a possible implementation manner, the color adjustment module 63 includes:

A beautification image generation sub-module, configured to generate a beautification image according to the beautification parameter information and the adjusted second mask image, the beautification image is to fill the beautification parameter information in the second part area to represent a color Image;

The image fusion sub-module is used for image fusion of the beautified image and the face image to obtain the target image with the color of the second part region adjusted.

In a possible implementation manner, the image processing method is used to add a lip line beautification effect to the face image, the first part region is a lip region, and the second part region is a lip line region.

In some embodiments, the functions or modules included in the apparatuses provided in the embodiments of the present disclosure may be used to execute the methods described in the above method embodiments. For specific implementation, reference may be made to the descriptions of the above method embodiments. For brevity, here No longer.

Embodiments of the present disclosure further provide a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the foregoing method is implemented. Computer-readable storage media can be volatile or non-volatile computer-readable storage media.

An embodiment of the present disclosure further provides an electronic device, including: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to invoke the instructions stored in the memory to execute the above method.

Embodiments of the present disclosure also provide a computer program product, including computer-readable codes, or a non-volatile computer-readable storage medium carrying computer-readable codes, when the computer-readable codes are stored in a processor of an electronic device When running in the electronic device, the processor in the electronic device executes the above method.

The electronic device may be provided as a terminal, server or other form of device.

FIG. 7 shows a schematic diagram of an electronic device 800 according to an embodiment of the present disclosure. For example, electronic device 800 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, fitness device, personal digital assistant, etc. terminal.

7, an electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, and communication component 816.

The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 can include one or more processors 820 to execute instructions to perform all or some of the steps of the methods described above. Additionally, processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

Memory 804 is configured to store various types of data to support operation at electronic device 800 . Examples of such data include instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, videos, and the like. Memory 804 may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.

Power supply assembly 806 provides power to various components of electronic device 800 . Power supply components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800 .

Multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action. In some embodiments, the multimedia component 808 includes a front-facing camera and/or a rear-facing camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each of the front and rear cameras can be a fixed optical lens system or have focal length and optical zoom capability.

Audio component 810 is configured to output and/or input audio signals. For example, audio component 810 includes a microphone (MIC) that is configured to receive external audio signals when electronic device 800 is in operating modes, such as calling mode, recording mode, and voice recognition mode. The received audio signal may be further stored in memory 804 or transmitted via communication component 816 . In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to: home button, volume buttons, start button, and lock button.

Sensor assembly 814 includes one or more sensors for providing status assessment of various aspects of electronic device 800 . For example, the sensor assembly 814 can detect the on/off state of the electronic device 800, the relative positioning of the components, such as the display and the keypad of the electronic device 800, the sensor assembly 814 can also detect the electronic device 800 or one of the electronic device 800 Changes in the position of components, presence or absence of user contact with the electronic device 800 , orientation or acceleration/deceleration of the electronic device 800 and changes in the temperature of the electronic device 800 . Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. Sensor assembly 814 may also include a light sensor, such as a complementary metal oxide semiconductor (CMOS) or charge coupled device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices. The electronic device 800 may access a wireless network based on a communication standard, such as wireless network (WiFi), second generation mobile communication technology (2G) or third generation mobile communication technology (3G), or a combination thereof. In one exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, electronic device 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmed gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform the above method.

In an exemplary embodiment, a non-volatile computer-readable storage medium, such as a memory 804 comprising computer program instructions executable by the processor 820 of the electronic device 800 to perform the above method is also provided.

The present disclosure relates to the field of augmented reality. By acquiring image information of a target object in a real environment, various visual correlation algorithms are used to detect or identify the relevant features, states, and attributes of the target object, so as to obtain an image matching the specific application. AR effect that combines virtual and reality. Exemplarily, the target object may involve faces, limbs, gestures, movements, etc. related to the human body, or objects, markers, or sandboxes, display areas, or display items related to venues or venues. Vision-related algorithms may involve visual localization, SLAM, 3D reconstruction, image registration, background segmentation, object keypoint extraction and tracking, object pose or depth detection, etc. The specific application can not only involve interactive scenes such as navigation, navigation, explanation, reconstruction, and virtual effect overlay display related to real scenes or items, but also special effects processing related to people, such as makeup beautification, body beautification, special effects display, virtual Model display and other interactive scenarios. The relevant features, states and attributes of the target object can be detected or recognized through the convolutional neural network. The above convolutional neural network is a network model obtained by model training based on a deep learning framework.

FIG. 8 shows a schematic diagram of an electronic device 1900 according to an embodiment of the present disclosure. For example, the electronic device 1900 may be provided as a server. 8, electronic device 1900 includes processing component 1922, which further includes one or more processors, and a memory resource represented by memory 1932 for storing instructions executable by processing component 1922, such as applications. An application program stored in memory 1932 may include one or more modules, each corresponding to a set of instructions. Additionally, the processing component 1922 is configured to execute instructions to perform the above-described methods.

The electronic device 1900 may also include a power supply assembly 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input output (I/O) interface 1958 . The electronic device 1900 can operate based on an operating system stored in the memory 1932, such as a Microsoft server operating system (Windows Server ^™ ), a graphical user interface-based operating system (Mac OSX ^™ ) introduced by Apple, a multi-user multi-process computer operating system ( Unix ^™ ), Free and Open Source Unix-like Operating System (Linux ^™ ), Open Source Unix-like Operating System (FreeBSD ^™ ) or the like.

In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as memory 1932 comprising computer program instructions executable by processing component 1922 of electronic device 1900 to perform the above-described method.

The present disclosure may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the present disclosure.

A computer-readable storage medium may be a tangible device that can hold and store instructions for use by the instruction execution device. The computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (non-exhaustive list) of computer readable storage media include: portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM) or flash memory), static random access memory (SRAM), portable compact disk read only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically coded devices, such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above. Computer-readable storage media, as used herein, are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (eg, light pulses through fiber optic cables), or through electrical wires transmitted electrical signals.

The computer readable program instructions described herein may be downloaded to various computing/processing devices from a computer readable storage medium, or to an external computer or external storage device over a network such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer-readable program instructions from a network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .

The computer program instructions for carrying out the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or instructions in one or more programming languages. Source or object code written in any combination, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as the "C" language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through the Internet connect). In some embodiments, custom electronic circuits, such as programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), can be personalized by utilizing state information of computer readable program instructions. Computer readable program instructions are executed to implement various aspects of the present disclosure.

Aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.

These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus to produce a machine that causes the instructions when executed by the processor of the computer or other programmable data processing apparatus , resulting in means for implementing the functions/acts specified in one or more blocks of the flowchart and/or block diagrams. These computer readable program instructions can also be stored in a computer readable storage medium, these instructions cause a computer, programmable data processing apparatus and/or other equipment to operate in a specific manner, so that the computer readable medium storing the instructions includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.

Computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other equipment to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other equipment to produce a computer-implemented process , thereby causing instructions executing on a computer, other programmable data processing apparatus, or other device to implement the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more functions for implementing the specified logical function(s) executable instructions. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions.

The computer program product can be specifically implemented by hardware, software or a combination thereof. In an optional embodiment, the computer program product is embodied as a computer storage medium, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK), etc. Wait.

The above descriptions of the various embodiments tend to emphasize the differences between the various embodiments, and the similarities or similarities can be referred to each other. For the sake of brevity, details are not repeated herein.

Those skilled in the art can understand that in the above method of the specific implementation, the writing order of each step does not mean a strict execution order but constitutes any limitation on the implementation process, and the specific execution order of each step should be based on its function and possible Internal logic is determined.

If the technical solution of this application involves personal information, the product applying the technical solution of this application has clearly informed the personal information processing rules and obtained the individual's voluntary consent before processing personal information. If the technical solution of the present application involves sensitive personal information, the product applying the technical solution of the present application has obtained the individual's individual consent before processing sensitive personal information, and at the same time satisfies the requirement of "express consent". For example, at the personal information collection device such as a camera, a clear and conspicuous sign is set to inform that the personal information has entered the collection range, and the personal information will be collected. If the individual voluntarily enters the collection range, it is deemed to agree to the collection of their personal information; or On the personal information processing device, if the personal information processing rules are informed by obvious signs/information, the personal authorization can be obtained by means of pop-up information or asking individuals to upload their personal information; among them, the personal information processing rules may include personal information Information processor, purpose of processing personal information, method of processing, and types of personal information processed.

Various embodiments of the present disclosure have been described above, and the foregoing descriptions are exemplary, not exhaustive, and not limiting of the disclosed embodiments. Numerous modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the various embodiments, the practical application or improvement over the technology in the marketplace, or to enable others of ordinary skill in the art to understand the various embodiments disclosed herein.

Claims (14)

1. An image processing method, characterized in that the method comprises:

determining a first mask image and a second mask image of a face image, wherein the first mask image is used for representing a first part area of the face image, the second mask image is used for representing a second part area of the face image, and the second part area is at least partially different from the first part area;

obtaining lip processing information, wherein the lip processing information comprises area information and beautification parameter information, the area information is used for indicating the range of the second part area, and the beautification parameter information is used for indicating beautification parameters of the second part area;

adjusting the range of a second position region in the second mask image according to the region information and the first mask image;

and beautifying the face image according to the beautifying parameter information and the adjusted second mask image to obtain a target image with the color of the second part region adjusted.

2. The method of claim 1, wherein the adjusting the extent of the second location area in the second mask image based on the area information and the first mask image comprises:

according to the region information and the first mask image, performing image corrosion operation on the second mask image, and adjusting the range of the second part region; during the image erosion process, the second region coincides with at least a partial region of the first region.

3. The method of claim 2, wherein the performing an image erosion operation on the second mask image based on the region information and the first mask image, and wherein adjusting the extent of the second region comprises:

and according to the first mask image, carrying out image corrosion from the first edge to the second edge of the second position region in the second mask image until the adjustment condition corresponding to the region information is met.

4. The method according to claim 3, wherein the adjustment condition corresponding to the region information is that a ratio of the current second region to the original second region is a value of the region information.

5. The method according to claim 3 or 4, wherein said image eroding from the first edge to the second edge of the second region in the second mask image according to the first mask image comprises:

sequentially determining target pixels from a first edge to a second edge of the second part area;

determining a target area according to the position of the target pixel in the second mask image;

determining a reference pixel in the second mask image according to a pixel value of each pixel in the target region of the first mask image;

updating the pixel value of the target pixel according to the pixel value in the reference pixel in the second mask image.

6. The method of claim 5, wherein determining the reference pixel in the second mask image based on the pixel value of each pixel in the target region of the first mask image comprises:

acquiring a pixel value of each pixel of the first mask image in the target area;

and determining a reference pixel in the second mask image according to the position of the pixel with the pixel value larger than the pixel threshold value in the first mask image.

7. The method according to any one of claims 1-6, wherein determining the first mask image of the face image comprises:

determining a first reference mask image, the first reference mask image being used to characterize the first location area prediction shape;

identifying a first part area in the face image;

and generating a first mask image according to the first position area and the first reference mask image.

8. The method according to any one of claims 1-7, wherein determining the second mask image of the face image comprises:

determining a second reference mask image, the second reference mask image being used to characterize an edge predicted shape of the first region area;

identifying a first part area in the face image;

and generating a second mask image according to the first position area and the second reference mask image.

9. The method according to any one of claims 1-8, wherein the obtaining lip treatment information comprises:

displaying a lip editing page comprising a region adjustment control and a color adjustment control;

responding to the triggering of the area adjusting control and the color adjusting control by the user, and respectively generating corresponding area information and beautifying parameter information;

and determining lip processing information according to the area information and the beautification parameter information.

10. The method according to any one of claims 1 to 9, wherein the performing color editing on the face image according to the beautification parameter information and the adjusted second mask image to obtain the target image with the color of the second region area adjusted includes:

generating a beautification image according to the beautification parameter information and the adjusted second mask image, wherein the beautification image is an image with the beautification parameter information representing colors filled in the second part area;

and carrying out image fusion on the beautified image and the face image to obtain a target image with the color of the second part area adjusted.

11. The method according to any one of claims 1 to 10, wherein the image processing method is configured to add a lip line beautification effect to the face image, and the first region is a lip region and the second region is a lip line region.

12. An image processing apparatus, characterized in that the apparatus comprises:

the image determining module is used for determining a first mask image and a second mask image of a face image, wherein the first mask image is used for representing a first part area of the face image, the second mask image is used for representing a second part area of the face image, and the second part area is at least partially different from the first part area;

the information acquisition module is used for acquiring lip processing information, wherein the lip processing information comprises area information and beautification parameter information;

a range adjusting module, configured to adjust a range of a second location area in the second mask image according to the area information and the first mask image;

and the color adjusting module is used for carrying out color editing on the face image according to the beautifying parameter information and the adjusted second mask image to obtain a target image with the color of the second part area adjusted.

13. An electronic device, comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to invoke the memory-stored instructions to perform the method of any of claims 1 to 11.

14. A computer readable storage medium having computer program instructions stored thereon, which when executed by a processor implement the method of any one of claims 1 to 11.

Images