JP7041342B2 - Image processing equipment, image processing methods, and programs - Google Patents

Description

This technology allows the user to intuitively recognize which function is the basic function in relation to the image processing device , the image processing method, and the program, especially when a plurality of functions are used. It relates to the image processing apparatus , the image processing method, and the program.

Conventionally, a photo sticker making device is known. The photo sticker creating device photographs a user, causes the user to edit the photographed image, and prints the edited image on a sticker paper to provide the photographed image. Photo sticker making devices are installed in play facilities and the like.

The flow of one game provided by the photo sticker creation device is usually that after shooting a user in the shooting space as a subject, the user is moved to the editing space and the image is displayed according to the operation performed in the editing space. It will be edited and the edited image will be printed on the sticker paper.

By the way, there is a model in which the photographed image is retouched after moving to the editing space and before editing.

Editing is image processing that synthesizes images for compositing such as pen images and stamp images, while retouching performed before that is the adjustment of eye size and skin brightness of specific parts. This is image processing for adjusting the image. Editing is performed by selecting target captured images one by one, but retouching is usually performed on all captured images.

In Patent Document 1, the desired eye size is selected using the three eye size selection buttons, and then the desired skin brightness is selected using the five brightness selection buttons displayed on the same screen. The technique for advancing retouching by selecting is described. Each eye size selection button displays different eye size samples, and each brightness selection button displays different skin brightness samples.

Japanese Unexamined Patent Publication No. 2017-108410

On the retouch screen described in Patent Document 1, the user selects each function in parallel. In other words, users can select multiple different types of functions, such as the eye size adjustment function and the skin brightness adjustment function, using the same operation using buttons on one screen. Don't be aware of basic and ancillary functions.

This technology was made in view of such a situation, and when using multiple functions, it enables the user to intuitively recognize which function is the basic function. It is a thing.

The image processing device to which this technology is applied displays a plurality of information with different operation methods on the same screen as a display used for selection operations related to multiple types of image processing targeting different parts of the user appearing as a subject in the captured image. It is provided with a display control unit for simultaneously displaying images, and an image processing unit for performing the image processing of each type on a plurality of captured images according to the selection operation .

In this technology, as a display used for selection operations related to multiple types of image processing targeting different parts of users appearing as subjects in captured images, multiple information with different operation methods are displayed simultaneously on the same screen. ..

According to this technology, when using a plurality of functions, the user can intuitively recognize which function is the basic function.

It is a perspective view which shows the structural example of the appearance of the photograph sticker making apparatus of this technique. It is a perspective view which looked at the appearance of the photograph sticker making apparatus from another angle. It is a figure explaining the movement of a user. It is a figure which shows the structural example of the preselection part. It is a figure which shows the structural example of the photographing part. It is a figure which shows the structural example of the background part. It is a perspective view which shows the floor material. It is a figure which shows the configuration example of the front of an editing unit. It is a figure which shows the structural example of the side surface of an editing unit. It is a figure which shows the example of the sticker paper. It is a figure which shows the example of the layer composition of an edited image. It is a block diagram which shows the configuration example of the photograph sticker making apparatus. It is a block diagram which shows the functional composition example of the photograph sticker making apparatus. It is a block diagram which shows the structural example of the editing processing part of FIG. It is a figure which shows the example of the function of the retouching course. It is a flowchart explaining the photo sticker making game process. It is a flowchart explaining the shooting process performed in step S3 of FIG. It is a figure which shows the example of the retouching course selection screen. It is a figure which shows the example of the live view screen. It is a figure which shows the example of the generation of a close-up image and a coordinated image. It is a flowchart explaining the editing process performed in step S4 of FIG. It is a figure which shows the example of the retouching screen at the time of selecting a pupil fill course. It is a figure which shows the example of the selection area in each eye dikara level. It is a figure which shows the example of the retouching screen for adjusting the brightness of the skin at the time of selecting a pupil fill course. It is a figure which shows the example of the retouching screen at the time of selecting a course with white skin. It is a figure which shows the example of the selection area at each white skin level. It is a figure which shows the example of the retouching screen for adjusting the size of eyes at the time of selecting a white-skinned course. It is a figure which shows the example of an edit screen. It is a figure which shows the display example of the retouch screen using the pop-up display. It is a figure which shows the display example of the retouch screen using the pop-up display. It is a figure which shows the other display example of the retouching screen. It is a figure which shows the other display example of the retouching screen. It is a figure which shows the other display example of the retouching screen.

<< Example 1 >>
<Appearance of photo sticker making device>
1 and 2 are perspective views showing a configuration example of the appearance of the photo sticker creating device 1.

The photo sticker creating device 1 is a game machine that provides a photographed image and an edited image. The photo sticker creating device 1 provides an image to a user by printing the image on a sticker paper or making the image viewable on the user's mobile terminal. The photo sticker creating device 1 is installed in an amusement facility such as a game center or a store.

The users of the photo sticker making device 1 are mainly high school girls and young women. In the photo sticker creating device 1, a plurality of users, such as mainly two or three people, can enjoy the game per set. Of course, in the photo sticker creating device 1, one user can enjoy the game.

In the photo sticker creating device 1, the user takes a picture by himself / herself as a subject. By editing, the user synthesizes a composite image such as handwritten characters or a stamp image with an image selected from the captured images obtained by shooting. As a result, the captured image is edited into a colorful image. The user receives a sticker paper on which the edited image, which is an edited image, is printed, and ends the series of games.

The photo sticker creation device 1 can be said to be a photo creation game machine that provides a photo creation game.

As shown in FIG. 1, the photo sticker creating device 1 is basically configured by being installed in a state where the photographing unit 11 and the editing unit 12 are in contact with each other. The photographing unit 11 and the editing unit 12 are electrically connected.

The photographing unit 11 has a box-shaped housing having a size large enough for a person to enter, and is composed of a preselection unit 20, a photographing unit 21, and a background unit 22. The preselection unit 20 is installed on the side surface of the photographing unit 21. The space in front of the preselection unit 20 is the preselection space in which the preselection process is performed. Further, the photographing unit 21 and the background unit 22 are installed at a predetermined distance from each other. The space formed between the photographing unit 21 and the background unit 22 is the photographing space in which the photographing process is performed.

As the preselection process, the preselection unit 20 provides guidance for introducing the game provided by the photo sticker creating device 1, and makes various settings in the photography process performed in the photography space. The preselection unit 20 is provided with a coin slot for the user to insert the price, a touch panel monitor used for various operations, and the like. The preselection unit 20 appropriately guides the user in the preselection space to the shooting space according to the availability of the shooting space.

The photographing unit 21 is a device for photographing a user as a subject. The photographing unit 21 is located in front of the user who has entered the photographing space. A camera, a touch panel monitor used for various operations, and the like are provided in front of the photographing unit 21 facing the photographing space.

Assuming that the left side surface is the left side surface and the right side surface is the right side surface when viewed from the user facing the front in the shooting space, the left side surface of the photographing unit 21 is composed of the side panel 41A and the right side surface is composed of the side panel 41B. Will be done. Further, the front surface of the photographing unit 21 is composed of the front panel 42. The preselection unit 20 described above is installed on the side panel 41A. The preselection unit 20 may be installed on the side panel 41B.

The background portion 22 is composed of a back panel 51, a side panel 52A, and a side panel 52B. The back panel 51 is a plate-shaped member located on the back side of the user facing the front. The side panel 52A is a plate-shaped member attached to the left end of the back panel 51 and having a narrower width than the side panel 41A. The side panel 52B is a plate-shaped member attached to the right end of the back panel 51 and having a width narrower than that of the side panel 41B.

The side panel 41A and the side panel 52A are provided on substantially the same plane. The upper portions of the side panel 41A and the side panel 52A are connected by a connecting portion 23A which is a plate-shaped member. The lower portions of the side panel 41A and the side panel 52A are connected by, for example, a connecting portion 23A'which is a metal member provided on the floor surface. Similarly, the side panel 41B and the side panel 52B are provided on substantially the same plane. The upper portions of the side panel 41B and the side panel 52B are connected by the connecting portion 23B. The lower portions of the side panel 41B and the side panel 52B are connected by a connecting portion 23B'.

A flooring material 27, which is a plate-shaped member, is laid on the floor of the photographing space.

For example, a green chroma key sheet is attached to the surface of the back panel 51 on the shooting space side. The photo sticker creating device 1 takes a picture with a sheet for chroma key as a background, and performs chroma key composition in a shooting process and an editing process. As a result, the desired background image is combined with the background portion of the user in which the sheet is shown.

An opening formed by being surrounded by the side panel 41A, the connecting portion 23A, and the side panel 52A serves as an entrance / exit of the photographing space. Further, the opening formed by being surrounded by the side panel 41B, the connecting portion 23B, and the side panel 52B also serves as an entrance / exit of the photographing space.

Above the photographing space, a ceiling surrounded by the front surface of the photographing unit 21, the connecting portion 23A, and the connecting portion 23B is formed. A ceiling strobe unit 24 is provided in a part of the ceiling. One end of the ceiling strobe unit 24 is fixed to the connecting portion 23A, and the other end is fixed to the connecting portion 23B.

The ceiling strobe unit 24 has a built-in strobe that irradiates light into the shooting space in accordance with shooting. Inside the ceiling strobe unit 24, a fluorescent lamp is provided in addition to the strobe. As a result, the ceiling strobe unit 24 also functions as lighting for the shooting space.

The editing unit 12 is a device for editing a captured image. The editing unit 12 is connected to the photographing unit 11 so that one side surface is in contact with the front panel 42 of the photographing unit 21.

Assuming that the configuration of the editing unit 12 shown in FIG. 1 is the configuration on the front side, the configuration used for the editing work is provided on each of the front side and the back side of the editing unit 12. With this configuration, two sets of users can perform editing work at the same time.

The front side of the editing unit 12 is composed of a surface 61 and a slope 62 formed above the surface 61. The surface 61 is perpendicular to the floor surface and substantially parallel to the side panel 41A of the photographing unit 21. A monitor with a built-in tablet and a stylus are provided on the slope 62 as a configuration used for editing work. On the left side of the slope 62, a columnar support portion 63A that supports one end of the lighting device 64 is provided. On the right side of the slope 62, a columnar support portion 63B that supports the other end of the lighting device 64 is provided. A support portion 65 for supporting the curtain rod 26 is provided on the upper surface of the support portion 63A.

A curtain rod 26 is attached above the editing unit 12. The curtain rail 26 is composed of a combination of three rails 26A to 26C. The three rails 26A to 26C are combined so that the shape when viewed from above is U-shaped. One ends of the rail 26A and the rail 26B provided in parallel are fixed to the connecting portion 23A and the connecting portion 23B, respectively, and the other ends of the rail 26A and the rail 26B are joined to both ends of the rail 26C, respectively.

A curtain is attached to the curtain rail 26 so that the space in front of the front and the space in front of the back of the editing unit 12 cannot be seen from the outside. The space in front of the front and the space behind the back of the editing unit 12 surrounded by the curtain are the editing spaces in which the user performs editing work.

As will be described later, the left side surface of the editing unit 12 is provided with a discharge port from which the printed sticker paper is discharged. The space in front of the left side of the editing unit 12 is a printing waiting space for the user to wait for the printed sticker paper to be ejected.

<About the movement of users>
Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described.

FIG. 3 is a plan view of the photo sticker creating device 1 as viewed from above.

The user inserts the price into the coin slot in the preselection space A0, which is the space in front of the preselection unit 20. Next, the user makes various settings according to the screen displayed on the touch panel monitor. For example, the user performs preselection work such as selection of a course related to shooting performed in the shooting space.

As shown by the white arrow # 1, the user who has completed the preselection work has a shooting space A1 formed between the shooting unit 21 and the background unit 22 from the entrance / exit G1 between the side panel 41A and the side panel 52A. to go into. The user performs shooting work by using a camera or a touch panel monitor provided in the shooting unit 21.

The user who has completed the shooting work can either leave the shooting space A1 from the entrance / exit G1 and move to the editing space A2-1 as shown by the white arrow # 2, or move to the editing space A2-1 as indicated by the white arrow # 3. Exit the shooting space A1 and move to the editing space A2-2.

The editing space A2-1 is an editing space on the front side of the editing unit 12. On the other hand, the editing space A2-2 is an editing space on the back side of the editing unit 12. Whether the user moves to the editing space A2-1 or the editing space A2-2 is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the vacant one of the two editing spaces is guided as the destination. The user who has moved to the editing space A2-1 or the editing space A2-2 starts the editing work. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing work at the same time.

After the editing work is completed, printing of the edited image is started. When printing is started, the user who has completed the editing work in the editing space A2-1 moves from the editing space A2-1 to the printing waiting space A3 as indicated by the white arrow # 4. Further, the user who has completed the editing work in the editing space A2-2 moves from the editing space A2-2 to the print waiting space A3 as indicated by the white arrow # 5.

The user who has moved to the print waiting space A3 waits for printing to finish. When printing is completed, the user receives the sticker paper discharged from the discharge port provided on the right side surface of the editing unit 12, and ends a series of photo sticker creation games.

Next, the configuration of each device will be described.

<Structure of preselection unit>
FIG. 4 is a diagram showing a configuration example of the preselection unit 20.

A touch panel monitor 71 is provided on the upper side of the preselection unit 20. The touch panel monitor 71 is composed of a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated on the monitor. The touch panel monitor 71 has a function of displaying various GUIs (Graphical User Interfaces) and accepting a user's selection operation. The touch panel monitor 71 displays a screen used for selecting the number of users.

A speaker 72 is provided below the touch panel monitor 71. The speaker 72 outputs a guidance voice for preselection processing, BGM (Back Ground Music), a sound effect, and the like. A coin insertion / return port 73 for inserting coins by the user is provided adjacent to the speaker 72.

<Structure of shooting unit>
FIG. 5 is a diagram showing a configuration example of the front surface of the photographing unit 21. The photographing unit 21 is configured to be surrounded by the side panel 41A, the side panel 41B, and the front panel 42.

A camera unit 81 is provided slightly above the center of the front panel 42. A camera 91, a touch panel monitor 92, and a front strobe 93 are provided on the front surface of the camera unit 81.

The camera 91 is, for example, a single-lens reflex camera, and is mounted inside the camera unit 81 so that the lens is exposed. The camera 91 has an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and photographs a user in the photographing space A1. The camera 91 functions as a shooting unit that shoots with the user as a subject.

The moving image captured by the camera 91 (hereinafter, also referred to as a live view image) is displayed on the touch panel monitor 92 in real time. A still image captured by the camera 91 at a predetermined timing such as when shooting is instructed is saved as a shooting image.

The touch panel monitor 92 is provided below the camera 91. The touch panel monitor 92 is composed of a monitor such as an LCD and a touch panel laminated on the monitor. The touch panel monitor 92 has a function as a live view monitor that displays a moving image captured by the camera 91, and a function that displays various GUIs and accepts a user's selection operation.

The front strobe 93 is provided above the camera 91. The front strobe 93 has a crescent-shaped light emitting surface made of a milky white acrylic plate. The front strobe 93 emits light in accordance with the shooting by the camera 91 to illuminate the vicinity of the user's face as a subject from the front.

Above the camera unit 81, an upper strobe unit 82 with a curved light emitting surface facing the user is installed. The upper strobe unit 82 irradiates the user's face and upper body with light from above the front of the user.

Below the camera unit 81, a foot strobe unit 83 that irradiates the lower body and feet of the user with light is provided.

The upper strobe unit 82 and the foot strobe unit 83 are composed of a fluorescent lamp and a lighting device capable of emitting strobe light. The upper strobe unit 82 and the foot strobe unit 83 brighten the shooting space, constantly illuminate the shooting space in order to ensure user operability and safety, and improve the image quality of the shot image. The strobe emits light at the shooting timing to illuminate the user who is the subject.

A box-shaped portion 84 is provided between the foot strobe unit 83 and the side panel 41A. Further, a box-shaped portion 85 is provided between the foot strobe unit 83 and the side panel 41B. The upper surfaces of the box-shaped portions 84 and 85 form a surface substantially horizontal to the installation surface of the photo sticker making device 1, and are used as a luggage storage place for a user who performs photography work to put baggage and the like.

Although not shown, a speaker is provided near the ceiling of the front panel 42, for example. The speaker outputs guidance voice, BGM, sound effect, etc. for shooting processing.

<Structure of background part>
FIG. 6 is a diagram showing a configuration example of the background portion 22 on the photographing space A1 side.

A strobe 101 on the back surface is installed above the back panel 51. The strobe 101 on the back surface irradiates the user with light from above the back surface.

In the figure, the rear left strobe 102 is installed on the left side of the rear panel 51. The rear left strobe 102 irradiates the user from the rear right side. In the figure, the rear right strobe 103 is installed on the right side of the rear panel 51. The rear right strobe 103 irradiates the user from the rear left side.

Further, the chroma key sheet 121 is attached to the surface of the back panel 51 on the shooting space A1 side (front side in the drawing). The color of the chroma key sheet 121 is, for example, green.

Although not shown, the chroma key sheet is also attached to the lower side (floor surface side) of the surface of the side panels 52A and 52B on the photographing space A1 side in the same manner as the chroma key sheet 121.

FIG. 7 is a perspective view showing the floor material 27. For convenience of explanation, illustrations of the photographing unit 21, the side panel 41A, and the like are omitted.

A horizontally long rectangular floor sheet 27A is attached to a position near the rear of the floor material 27 so that its long side is substantially parallel to the back panel 51. In FIG. 7, the direction in which the back panel 51 is located is behind the photographing space A1, and the direction in which the photographing unit 21 is indicated by the white arrow is in front of the photographing space A1.

Mark figures 28-1 to 28-4 are printed side by side on the front side of the floor sheet 27A, and mark figures 28-5 to 28-8 are printed side by side behind the mark figures 28-1 to 28-4. The marker figures 28-1 to 28-8 arranged in 2 rows × 4 columns are visually different figures, and the whole is filled with black, for example.

The mark figure 28-1 on the first line is a diamond-shaped mark, and the mark figure 28-2 is a heart-shaped mark. The mark figure 28-3 is a four-leaf clover-shaped mark, and the mark figure 28-4 is a square mark.

Further, the mark figure 28-5 on the second line is a flower-shaped mark composed of four petals, and the mark figure 28-6 is a star-shaped mark. The mark figure 28-7 is a circular mark, and the mark figure 28-8 is a tulip petal-shaped mark.

Each mark figure has a size that fits within a range of approximately 30 cm × 30 cm so that one user can put both feet on it. Each size may be different.

The mark figures 28-1 to 28-8 are used as marks for guiding each user to the standing position at the time of shooting.

For example, when the number of users is two and an image showing a large upper body is taken, the four-leaf cloverleaf marker figure 28-is set as the standing position of the user standing on the right side of the camera 91. 3 is designated, and the heart-shaped marker figure 28-2 is designated as the standing position of the user standing on the left side.

The marker figures 28-1 to 28-8 are printed at positions where the optimum standing position can be specified according to the number of users, the angle of view (range) of the image to be captured, and the like. .. The optimum standing position means a position where the light from the strobe is sufficiently applied to the subject, a position where the camera 91 does not deviate from the shooting range, a position where the balance between the background and the size of the face is improved, and the like.

As the mark figure, a figure with a color other than black, a figure with a predetermined pattern, or a figure with a color and a pattern may be used. It is also possible to change at least one of the shape, size, pattern, and color for each marker figure. The mark figures 28-1 to 28-8 shown in FIG. 7 have the same color as black, but have different shapes.

<Structure of editing unit>
FIG. 8 is a diagram showing a configuration example of the front side (editing space A2-1 side) of the editing unit 12.

A monitor with a built-in tablet 131 is provided at substantially the center of the slope 62. A touch pen 132A is provided on the left side of the tablet built-in monitor 131. A stylus 132B is provided on the right side of the tablet built-in monitor 131.

The tablet built-in monitor 131 is configured by stacking a tablet and a display. The tablet enables operation input using the touch pen 132A or the touch pen 132B. The tablet built-in monitor 131 displays, for example, an editing screen used for editing work. When two users edit at the same time, the touch pen 132A is used by the user on the left side of the tablet built-in monitor 131, and the touch pen 132B is used by the user on the right side of the tablet built-in monitor 131. ..

The operation using the touch pen 132A and the operation using the touch pen 132B are distinguished. As appropriate, only the operation using the touch pen 132A is possible for the display on the left side of the tablet built-in monitor 131, and only the operation using the touch pen 132B is possible for the display on the right side. Hereinafter, when it is not necessary to distinguish between the touch pen 132A and the touch pen 132B as appropriate, they are collectively referred to as the touch pen 132.

FIG. 9 is a diagram showing a configuration example of the left side surface of the editing unit 12.

A sticker paper discharge port 161 is provided on the lower side of the left side surface of the editing unit 12. A printer is provided inside the editing unit 12. The printer prints an image of the user of the editing space A2-1 or an image of the user of the editing space A2-2 on the sticker paper in a predetermined layout and discharges the image from the sticker paper ejection port 161.

<Example of sticker paper>
FIG. 10 is a diagram showing an example of a sticker paper produced by the photo sticker creating device 1.

When there are two users, for example, two stickers with photographs (edited images) printed in the layout shown in FIG. 10 are created and provided to the users. The layout shown in FIG. 10 is one of a plurality of types of layouts, and the user can select a desired layout.

An edited image printing area 181A having a size of a business card and a horizontally long strip-shaped extra image printing area 181B are formed on one sticker paper. The edited image 191-1 is printed in a large size on the substantially left half of the edited image print area 181A, and four edited images 191-2 to 191-5 are printed on the right side of the edited image 191-1 in two lines with a size smaller than that of the edited image 191-1. × Printed side by side in 2 columns.

The edited images 191-1 to 191-5 are images generated by editing the close-up image, which is an image in which the face and upper body of the subject are largely captured. Actually, a background image which is an image of a predetermined color or pattern is combined with the background of the user as appropriate, and a foreground image such as a handwritten character or a stamp image is combined with the foreground of the user.

In the shooting process, in addition to the close-up image, an image showing a wide range from above the head to near the knee is also shot. This image is used, for example, to preserve the coordination of clothes. Hereinafter, an image having a wider shooting range than the close-up image, which is used to keep the coordination of clothes as appropriate, is referred to as a coordinated image.

The aspect ratio of the close-up image and the coordinated image are different. For example, the ratio of the horizontal length to the vertical length of the close-up image is 1: 1.2, and the ratio of the horizontal length to the vertical length of the coordinated image is 1: 1.5. In this example, the coordinated image is not printed on the sticker paper. The coordinated image may be printed on the sticker paper.

In the bonus image printing area 181B, photographed images 192-1 to 192-5 trimmed into a simple shape similar to the marker figures 28-1 to 28-8 printed on the floor sheet 27A are printed side by side. To. The image printed in the bonus image print area 181B is used by cutting it with scissors, for example.

Instead of the image before editing, the edited image (the same image as the edited images 191-1 to 191-5) may be trimmed and printed as captured images 192-1 to 192-5.

Bonus A sticker ID or the like is printed in the margin of the image print area 181B. The sticker ID is used when viewing an image transmitted from the photo sticker creation device 1 to the server on a mobile terminal such as a smartphone.

The image is transmitted to the mobile terminal via a server that manages an image acquisition site, which is a website for importing (storing) the image transmitted from the photo sticker creation device 1 into the mobile terminal. The user can post the image captured on the mobile terminal to SNS or set it as wallpaper. Hereinafter, the server that manages the image acquisition site is referred to as an image acquisition site management server as appropriate.

FIG. 11 is a diagram showing an example of the layer structure of the edited image.

The leftmost edited image P1 is an image generated by editing. The edited image P1 is composed of images of each layer of the background image P11, the person image P12, and the foreground image P13.

In the example of FIG. 11, the background image P11 is an image of the pattern of the wall surface on which bricks are stacked. The foreground image P13 is an image including an image of handwritten characters of "Love my friend" and a heart-shaped image. The handwritten image of "Love my friend" is a pen image input by the user using the pen tool. The heart-shaped image is a stamp image input by the user using the stamp tool.

As described above, the edited image P1 is generated by superimposing the person image P12, which is an image of the area of the person extracted from the captured image by chroma key processing, on the background image P11, and superimposing the foreground image P13 on the background image P11. It is also possible to input a pen image or a stamp image on the background image P11 and display it on the background of the subject. Foreground images and background images may be combined with the captured image, and even after editing, they may not be combined depending on the user's operation.

<Internal configuration of photo sticker making device>
FIG. 12 is a block diagram showing a configuration example of the photo sticker creating device 1. In FIG. 12, the same components as those described above are designated by the same reference numerals. Duplicate explanations will be omitted as appropriate.

As shown in FIG. 12, in the photo sticker creating device 1, the preselection unit 302, the photographing unit 304, the editing units 305A and 305B, and the printing unit 306 are external input / output interfaces 303 with respect to the PC (Personal Computer) unit 301. It is configured by being connected via. The PC unit 301, which is an information processing unit, is mounted inside the housing of the editing unit 12, for example.

The CPU (Central Processing Unit) 311, ROM (Read Only Memory) 312, and RAM (Random Access Memory) 313 constituting the PC unit 301 are connected to each other by a bus 314.

The CPU 311 executes a predetermined program and controls the overall operation of the photo sticker creating device 1. The ROM 312 stores programs and data executed by the CPU 311. The RAM 312 temporarily stores data and programs processed by the CPU 311.

An input / output interface 315 is further connected to the bus 314. A storage unit 316, a communication unit 317, and a drive 318 are connected to the input / output interface 315.

The storage unit 316 is a non-volatile storage medium such as a hard disk or a flash memory. The storage unit 316 stores various setting information and the like supplied from the CPU 311. The information stored in the storage unit 316 is appropriately read out by the CPU 311.

The communication unit 317 is an interface of a network such as the Internet. The communication unit 317 communicates with an external device according to the control by the CPU 311. The communication unit 317 transmits the image selected by the user to, for example, an image acquisition site management server managed by the manufacturer of the photo sticker creation device 1. The image transmitted from the communication unit 317 is allocated and stored in a predetermined storage area, and is displayed on a mobile terminal that has accessed the image acquisition site management server, or downloaded to the mobile terminal.

A removable media 319 made of an optical disk, a semiconductor memory, or the like is appropriately mounted on the drive 318. The programs and data read from the removable media 319 by the drive 318 are supplied to the CPU 311 and stored or installed in the storage unit 316.

An external input / output interface 303 is connected to the input / output interface 315. The control of each unit by the PC unit 301 is performed via the external input / output interface 303.

The preselection unit 302 realizes the preselection process for the user in the preselection space A0. The preselection unit 302 includes a touch panel monitor 71, a speaker 72, and a coin processing unit 321.

The touch panel monitor 71 displays various selection screens according to the control by the PC unit 301, and accepts the user's operation on the selection screen. An input signal representing the content of the user's operation is supplied to the PC unit 301, and various settings are made.

The coin processing unit 321 detects the insertion of coins into the coin insertion / return port 73. When the coin processing unit 321 detects that a predetermined amount of coins has been inserted, the coin processing unit 321 outputs an activation signal instructing the start of the game to the PC unit 301.

The shooting unit 304 realizes shooting processing for the user in the shooting space A1. The photographing unit 304 includes a lighting device 331, a camera 91, a touch panel monitor 92, and a speaker 332.

The lighting device 331 is each strobe unit in the shooting space A1 and emits light according to a lighting control signal supplied from the PC unit 301.

The camera 91 shoots according to the shutter control by the PC unit 301, and outputs the captured image (image data) obtained by the shooting to the PC unit 301.

The editorial unit 305A realizes an editing process for a user in the editing space A2-1. The editorial unit 305A includes a tablet built-in monitor 131, touch pens 132A and 132B, and a speaker 341. The editorial unit 305B realizes an editing process for a user in the editing space A2-2, and has the same configuration as the editorial unit 305A. Hereinafter, when the editorial units 305A and 305B are not particularly distinguished, they are simply referred to as the editorial unit 305.

The tablet built-in monitor 131 displays the edit screen according to the control by the PC unit 301, and accepts the user's operation on the edit screen. An input signal representing the content of the user's operation is supplied to the PC unit 301, and the captured image to be edited is edited.

The printing unit 306 is configured to include a printer 351. A sticker paper unit 352 is attached to the printer 351.

The printer 351 drives the built-in head 361 and prints an image on the roll-shaped sticker paper 363 stored in the sticker paper unit 352 based on the print data supplied from the PC unit 301. Further, the printer 351 cuts the sticker paper 363 on which the image is printed at a predetermined cut position by the cutter 362, and discharges the sticker paper 361 to the sticker paper discharge port 161.

<Example of functional configuration of photo sticker creation device>
FIG. 13 is a block diagram showing a functional configuration example of the photo sticker creating device 1. At least a part of the functional units shown in FIG. 13 is realized by executing a predetermined program by the CPU 311.

In the photo sticker creating device 1, a preselection processing unit 401, a shooting processing unit 402, an editing processing unit 403, and a printing processing unit 404 are realized.

The preselection processing unit 401 executes the preselection processing by controlling each unit of the preselection unit 302. By the pre-selection process, the number of users is selected, the background image is selected, and the like. Information indicating the content selected by the user is supplied to the photographing processing unit 402.

The photographing processing unit 402 performs imaging processing by controlling each unit of the photographing unit 304. The shooting processing unit 402 outputs the data of the shot image obtained by performing the shooting processing to the editing processing unit 403. Data of a plurality of captured images obtained by performing imaging a plurality of times is supplied from the photographing processing unit 402 to the editing processing unit 403.

The editing processing unit 403 performs editing processing by controlling each unit of the editing unit 305. The editing process includes image processing for adjusting the size of the user's eyes and the brightness of the skin in the captured image, image processing for editing the captured image, and the like.

After finishing editing of the captured image, the editing processing unit 403 generates print data by arranging the edited image in a predetermined layout and outputs the print data to the print processing unit 404.

The print processing unit 404 outputs print data to the printer 351 and prints the edited image.

<Detailed configuration of the editing processing unit>
FIG. 14 is a block diagram showing a configuration example of the editing processing unit 403.

The editing processing unit 403 includes a selection receiving unit 431, a retouching processing unit 432, an editing control unit 433, a display control unit 434, a print data generation unit 435, and a communication control unit 436.

The selection reception unit 431 accepts the user's selection operation for the screen displayed on the tablet built-in monitor 131 during the editing process. The selection reception unit 431 outputs information representing the user's selection contents to the retouch processing unit 432 and the editing control unit 433.

Based on the information output from the selection reception unit 431, the retouching processing unit 432 performs retouching processing on each of the five close-up images and one coordinated image, which are the captured images output from the photographing processing unit 402. Give. The retouching process is an image process for a specific part of the user in the captured image, such as adjusting the size of the eyes and adjusting the brightness of the skin. The retouching processing unit 432 functions as an image processing unit that performs image processing on a plurality of captured images.

FIG. 15 is a diagram showing an example of the function of the retouching course.

There are two retouching courses, "Eye-filled course" and "White skin-filled course". The "Eye-filled course" is a retouching course that focuses on the eye part including the eyes of the user's face in the photographed image, and the "White skin-filled course" is the user's skin part reflected in the photographed image. This is a retouching course that we paid attention to. As will be described later, the retouching course is selected at a timing before the start of the editing process, such as during the shooting process.

Main functions and sub-functions are set for each course.

In the example of FIG. 15, the main function of the "pupil swelling course" is the adjustment of the eye level. Using the function of adjusting the eye color level, the user can adjust the size of the eyes and the darkness of the eyes.

In addition, the sub-function of the "pupil swelling course" is to turn on / off the image processing for the tear bag portion. Using the image processing function for the tear bag portion, the user can select whether or not to perform image processing for emphasizing the tear bag portion under the eyes.

On the other hand, the main function of the "white skin swelling course" is to adjust the white skin level. The user can adjust the brightness of the skin by using the function of adjusting the white skin level.

In addition, the sub-function of the "white skin filling course" is to turn on / off the skin-beautifying filter. Using the function of the skin-beautifying filter, the user can select whether or not to perform the blurring process to make the skin look smooth. The image processing by the skin-beautifying filter may be applied to the entire captured image or may be applied to the skin portion.

In this way, a plurality of main functions and sub-functions are set for each retouching course. The main function is a basic function among the retouching functions, and is the function most desired to be used by the user from the viewpoint of the manufacturer of the photo sticker creating device 1. The sub-function is an auxiliary function of the main function and is a function for providing a more complete sticker paper.

As will be described later, the main function and the sub function can be used from the same retouch screen. Since the main function and the sub function can be used without switching the display screen, it is possible to provide the user with an easy-to-use retouch screen.

In this example, one main function and one sub function are set for each retouching course, but the number of each of the main function and the sub function is arbitrary. That is, one main function and a plurality of sub-functions may be set in each retouching course, or a plurality of main functions and a plurality of sub-functions may be set in each retouching course.

The retouching processing unit 432 outputs the captured image that has undergone the retouching processing, which is an image processing using such a plurality of functions, to the editing control unit 433 and the display control unit 434. The captured image after the retouching process will be used as the editing target.

The editing control unit 433 edits the captured image that has been retouched by the retouching processing unit 432 based on the information output from the selection receiving unit 431. Editing is an image process of synthesizing a composite image such as handwritten characters or a stamp image with a captured image to be edited.

Whereas the above-mentioned retouching process is a process of collectively performing image processing according to a user's selection content on each of a plurality of captured images, editing is a process of performing image processing according to the user's selection content. At that time, it is a process applied to one photographed image to be edited.

When images with different angles of view (shooting range) are taken, such as a close-up image and a coordinated image, the retouching process may be performed for each image having the same angle of view. In this case, the retouching process for the plurality of close-up images is collectively performed according to the user's selection content, and the retouching process for the coordinated image is performed according to another user's selection content. When the coordinated images are taken a plurality of times, the retouching process for the plurality of coordinated images is performed at once.

A retouch screen for the close-up image and a retouch screen for the coordinated image may be displayed, and the respective screens may be used to make a selection for the retouching process for the close-up image and a selection for the retouching process for the coordinated image. ..

The editing control unit 433 outputs information representing the editing result to the display control unit 434 and reflects it on the display of the editing screen.

Further, the editing control unit 433 appropriately generates an image for mobile transmission, which is a dedicated image to be transmitted to the mobile terminal, according to the operation of the user. The edit screen has buttons that are operated when creating an image for mobile transmission.

An image for mobile transmission is an image generated by trimming a predetermined area with respect to a captured image or synthesizing a foreground frame or a background frame. The image for mobile transmission is transmitted to the user's mobile terminal via the image acquisition site management server, and is not printed on the sticker paper 363.

When the editing is completed, the editing control unit 433 outputs the edited image, which is a captured image obtained by editing, to the print data generation unit 435 and the communication control unit 436. An image for mobile transmission is also supplied from the editing control unit 433 to the communication control unit 436.

The display control unit 434 controls the display of the tablet built-in monitor 131. For example, the display control unit 434 causes the tablet built-in monitor 131 to display the retouch screen used for retouching the captured image and the editing screen used for editing the captured image. The display control unit 434 is supplied with a photographed image output from the photographing processing unit 402, a photographed image output from the retouching processing unit 432 that has undergone retouching processing, and an edited image output from the editing control unit 433.

The print data generation unit 435 arranges the edited image supplied from the editing control unit 433 in the editing image printing area 181A (FIG. 10) in a predetermined layout, and prints the captured image trimmed to a predetermined shape as an extra image. It is arranged in the area 181B and print data is generated. The print data generation unit 435 outputs the print data to the print processing unit 404 and causes the sticker paper 363 to print the print data.

The communication control unit 436 controls the communication unit 317 and transmits the edited image and the image for mobile transmission supplied from the edit control unit 433 to the image acquisition site management server.

<Operation of photo sticker making device>
Here, the operation of the photo sticker creation device 1 that provides the photo sticker creation game will be described with reference to the flowchart of FIG. In this example, it is assumed that there are two users.

In step S1, the preselection processing unit 401 determines whether or not a predetermined amount of coins has been inserted based on the activation signal supplied from the coin processing unit 321 and waits until it is determined that coins have been inserted. .. If it is determined in step S1 that the coin has been inserted, the process proceeds to step S2.

In step S2, the preselection processing unit 401 performs the preselection processing by controlling the preselection unit 302. By the preselection process, for example, the number of users is selected, the background image to be combined with the captured image is selected, and the like. Both selections are made using the screen displayed on the touch panel monitor 71.

In step S3, the photographing processing unit 402 performs the photographing process by controlling the photographing unit 304.

For example, the shooting processing unit 402 displays the live view screen on the touch panel monitor 92 based on the moving image captured by the camera 91, and shoots with the user in the shooting space A1 as the subject. For example, before the start of shooting, the shooting processing unit 402 causes the user to select a retouching course to be performed during the editing process. The details of the shooting process will be described later with reference to the flowchart of FIG.

In step S4, the editing processing unit 403 controls the editing unit 305 corresponding to the editing space of the editing space A2-1 and the editing space A2-2, which is the destination of the user who has completed the shooting process. Then, edit it.

For example, the editing processing unit 403 causes the tablet built-in monitor 131 to display the editing screen, and causes the user to perform editing work on the captured image obtained by the photographing process. On the edit screen, along with the captured image to be edited, buttons and the like that are operated when selecting a composite image to be combined with the captured image are displayed. The editing processing unit 403 edits the captured image by synthesizing the composite image according to the operation of the user, and generates the edited image.

After editing the captured image, the editing processing unit 403 displays various screens such as a screen used for selecting the number of divisions and a screen used for selecting an image to be transmitted to the image acquisition site management server on the tablet built-in monitor 131. The editing processing unit 403 performs various processing according to the user's operation on each screen. The details of the editing process will be described later with reference to the flowchart of FIG.

In step S5, the print processing unit 404 performs printing processing by controlling the printer 351. The print processing unit 404 outputs the print data generated by the editing processing unit 403 to the printer 351 and prints it on the sticker paper 363.

When printing is completed, in step S6, the printer 351 discharges the sticker paper 363 separated by the cutter 362 to the sticker paper discharge port 161.

For each group of users of the photo sticker creation device 1, a photo creation game including the above series of processes is provided. When a user of one group and a user of another group start using the photo sticker creation device 1, the photo creation game of the user who started using the photo sticker creation device 1 first, and the photo creation game of the user who started using the photo sticker creation device 1 later. The user's photo creation game will be played in parallel as appropriate. As appropriate, a photo sticker creation game is also simply referred to as a game.

<Shooting process>
Next, the photographing process performed in step S3 of FIG. 16 will be described with reference to the flowchart of FIG.

In step S11, the photographing processing unit 402 displays the retouching course selection screen on the touch panel monitor 92.

FIG. 18 is a diagram showing an example of a retouching course selection screen.

In the center of the retouching course selection screen, the message "Which one would you like to enjoy today?" Is displayed vertically. On the left side of the message, the image image 501 when the "pupil swelling course" is selected is displayed, and on the right side of the message, the image image 502 when the "white skin swelling course" is selected is displayed.

The user can select a favorite retouching course by pressing the image image 501 or the image image 502. The image image 501 and the image image 502 function as buttons pressed to select a retouching course.

Information representing the retouching course selected using such a retouching course selection screen is supplied to the editing processing unit 403.

The selection of the retouching course may be performed at the time of the preselection process instead of the shooting process.

In step S12, the photographing processing unit 402 displays a guidance screen on the touch panel monitor 92 and guides the standing position of each user by designating a predetermined mark figure. Here, guidance of the standing position for taking a close-up image is performed.

After guiding the standing position, in step S13, the imaging processing unit 402 performs authentication imaging. The photographing processing unit 402 recognizes the user's face reflected in the image by analyzing the image obtained by the authentication photographing. Face recognition identifies the position of a person's face, the position of each part of the face, and the like.

In addition, the photographing processing unit 402 authenticates the user's face reflected in the image obtained by the authentication photographing. Face authentication identifies who the face is. By performing face authentication, even if the standing positions of the two users are switched between the first captured image and the second captured image, the faces of each user are identified. Will be possible.

That is, recognition means identifying and confirming something. Face recognition means searching for and finding a face in an image taken by the camera 91.

In addition, certification means comparing and collating with something and recognizing it as correct. Face recognition means that the face found is compared with the acquired information to determine whether it is the same or different. By performing authentication, if a face is printed on the clothes worn by the user, the face can be excluded from the target of image processing.

The retouching described later is appropriately performed using the face recognition result and the authentication result.

In step S14, the shooting processing unit 402 starts displaying the live view screen. That is, the camera 91 is controlled, and the acquisition of the moving image is started. The moving image captured by the camera 91 is used for displaying the live view screen.

FIG. 19 is a diagram showing a display example of the live view screen.

The live view display area 521 is arranged in the substantially center of the live view screen. In the live view display area 521, the moving image captured by the camera 91 is displayed as a live view image.

In the example of FIG. 19, a live view image showing the faces and upper body of two users whose standing positions have been adjusted is displayed. On the right side of the live view display area 521, a number indicating a countdown to shooting is displayed.

The user can check the pose by looking at the live view image displayed in this way before the shooting is performed.

When it is time to shoot, in step S15, the shooting processing unit 402 shoots a close-up image. That is, the photographing processing unit 402 cuts out an image in a predetermined range from the image obtained by photographing by trimming, and generates a close-up image. A background image is appropriately combined with respect to the close-up image generated by the photographing processing unit 402.

In step S16, the photographing processing unit 402 determines whether or not the close-up image has been photographed five times. The process returns to step S15, the live view screen is displayed for a predetermined time, and then the close-up image is repeatedly taken until it is determined that the close-up image has been taken five times.

On the other hand, if it is determined in step S16 that the close-up image has been taken five times, the process proceeds to step S17.

In step S17, the photographing processing unit 402 displays the guidance screen on the touch panel monitor 92 and guides the user to the standing position for the coordinated image.

After guiding the standing position, in step S18, the photographing processing unit 402 starts displaying the live view screen. The configuration of the live view screen is the same as the configuration described with reference to FIG. In the live view display area 521, a live view image showing the area from above the user's head to near the knee is displayed.

When it is time to shoot, in step S19, the shooting processing unit 402 shoots the coordinated image. That is, the photographing processing unit 402 extracts an image in a predetermined range from the image obtained by photographing by trimming, and generates a coordinated image. For the coordinated image, the background image is appropriately combined.

FIG. 20 is a diagram showing an example of generation of a close-up image and a coordinated image.

The image shown in FIG. 20 is a still image taken with a focal length of 24 mm. The rectangular area shown by the frame F1 is an area cut out by trimming when the close-up image is taken. The photographing processing unit 402 cuts out the rectangular area indicated by the frame F1 by trimming, and generates a close-up image.

Further, the rectangular area shown by the frame F2 is an area cut out by trimming when the coordinated image is taken. The photographing processing unit 402 cuts out the rectangular area indicated by the frame F2 by trimming, and generates a coordinated image.

For the display of the live view image before shooting the close-up image and the coordinated image, the image obtained by cutting out the range shown by the frame F1 and the frame F2 in FIG. 20 from each frame of the moving image taken by the camera 91 is used. It will be done.

It is possible to take a full-body image in which the whole body of the user is captured, which has a wider shooting range than the coordinated image. In this case, for example, the focal length of the lens of the camera 91 may be changed to 10 mm so that a vertically longer image than the close-up image can be obtained.

When the shooting of the coordinated image is finished, in step S20, the shooting processing unit 402 guides the user who has finished shooting to move to the editing space A2 by displaying the guidance screen on the touch panel monitor 92.

After that, the process returns to step S3 in FIG. 16 and the subsequent processing is performed. The six captured images obtained by the photographing process are supplied to the editing processing unit 403.

<Editing process>
Next, the editing process performed in step S4 of FIG. 16 will be described with reference to the flowchart of FIG.

The processes of steps S31 to S35 are processes performed when the "pupil swelling course" is selected during the shooting process, and the processes of steps S36 to S40 are performed when the "white skin swelling course" is selected. Is.

When the "eye-filling course" is selected by the user, in step S31, the display control unit 434 (FIG. 14) of the editing processing unit 403 displays a function explanation screen on the tablet built-in monitor 131, and the like. Outputs guidance for pupil retouching, which is a retouch that focuses on the part of.

After the guidance explaining the function of the pupil retouching is output, in step S32, the display control unit 434 displays the pupil retouching screen on the tablet built-in monitor 131.

FIG. 22 is a diagram showing an example of a retouching screen for pupils displayed when the “pupil fill course” is selected.

At the top center of the retouch screen, the message "Choose your favorite eye size and tear bag" is displayed. Below the message, a sample image 531 is displayed. For example, the first close-up image of the five captured close-up images is displayed as the sample image 531.

In this way, the photographed image in which the user himself / herself is photographed is displayed as a sample image, not the image in which the person of the model is captured. As will be described later, the display of the sample image reflects the selected content each time the selection operation using the retouch screen is performed. By using an image in which the user himself / herself appears, it is possible to easily convey to the user what kind of image processing is to be performed.

Further, by displaying only one sample image, it is possible to display the sample image larger than when displaying a plurality of images. This also makes it easier for the user to know what kind of image processing is to be performed.

After shooting, each shot image is subjected to image processing such as brightness adjustment, so it takes time to be ready for display. By using the first captured image captured first, it becomes possible to present the sample image immediately after the start of the editing process. The user can check the sample image without waiting.

On the right side of the sample image 531 is an OK button 534 that is pressed when the retouching work is completed.

Below the sample image 531 are a horizontally long rectangular selection area 532 used for adjusting the eye size level and a horizontally long rectangular selection area 533 used for selecting on / off of image processing for the tear bag portion on the left and right. Formed side by side. A wider area than the selection area 533 is allocated to the selection area 532.

In the upper center of the selection area 532 used for selecting the main function, the characters "Eye Jikara Level" are displayed, and to the right of it, the selected Eye Jikara Level (eye size and pupil density) is displayed. The numerical value is displayed.

In the substantially center of the selection area 532, a horizontally long slide bar 541 representing a range of 90% to 120% of the eye size level is displayed. Below the slide bar 541, the numerical values of 90%, 100%, 110%, and 120% are displayed at equal intervals in order from the left end. Further, on the left and right sides of the slide bar 541, an illustration of small eyes and an illustration of large eyes are displayed, respectively.

A pointer 541A is displayed at a predetermined position on the slide bar 541. The position of the pointer 541A is switched according to the selection by the user. In the default state shown in FIG. 22, the pointer 541A is displayed at a position pointing to the 100% eye level, which is the recommended level.

The user can select a favorite eye color level by designating a predetermined position on the slide bar 541 with the touch pen 132.

For example, when a position near the left end where a value of 90% is displayed below is specified, 90% is set as the eye mark level, and as shown in FIG. 23A, the pointer 541A is located at 90% of the slide bar 541. Is displayed.

In addition, when the position on the right side of the center where the numerical value of 110% is displayed below is specified, 110% is set as the eye color level, and as shown in FIG. 23B, the pointer is at the position of 110% of the slide bar 541. 541A is displayed.

When the position near the right end where the numerical value of 120% is displayed below is specified, 120% is set as the eye mark level, and the pointer 541A is displayed at the position of 120% of the slide bar 541 as shown in FIG. 23C. To.

In this example, it is possible to select a favorite eye level from four levels of 90%, 100%, 110%, and 120%.

The content of the selection operation using the display of the selection area 532 is reflected in the display of the sample image 531 in real time. That is, image processing is performed on the eye portions of the two users shown in the sample image 531 to switch the size and darkness of the eyes.

At the lower left of the selection area 532, a button 542 that is operated to give a natural impression to the eyes is displayed. The characters "Supernatural" are displayed on the button 542.

On the left side of the selection area 533 used for selecting the sub-function, an image image 551 that enlarges the vicinity of the tear bag of the model person, which is a sample of image processing by the sub-function, is displayed, and on the right side, "tears". The characters "Bukuro" are displayed.

Below the word "tear bag", a message about the introduction of the function is displayed, and below that, the on button 5521 operated when the image processing for the tear bag part is set to on, and the tear bag. The off button 552-2, which is operated when the image processing for the portion is set to off, is displayed.

The on button 5521 and the off button 552-2 are exclusively in a state in which one of them is pressed. In the default state shown in FIG. 22, the on button 5521 is pressed.

The content of the selection operation using the display of the selection area 533 is also reflected in the display of the sample image 531 in real time. That is, when the on button 5521 is pressed, the tear bag portion of the two users shown in the sample image 531 is subjected to image processing, and the tear bag portion is emphasized. Further, when the off button 552-2 is pressed, the sample image 531 in a state where the image processing for the tear bag portion is not performed is displayed.

Instead of turning on / off the image processing for the tear bag portion, the strength of the degree of image processing may be selected by using the display of the selection area 533.

In this way, on the pupil retouching screen displayed when the "eye-filling course" is selected, attention is paid to the eye portion of the user's face, and retouching is performed using a plurality of types of functions.

Since the adjustment of the eye color level and the on / off of the image processing for the tear bag portion can be selected from one retouch screen, the user can easily perform retouching using a plurality of types of functions.

In addition, since the operation method differs for each function, such as adjusting the eye consciousness level using the slide bar and selecting on / off of image processing for the tear bag part using the button, the user. Can perform retouching focusing on the eye part while being aware of the main function and sub function.

Returning to the description of FIG. 21, in step S33, the retouching processing unit 432 performs retouching on the eyes according to the user's selection on the retouching screen for the pupil.

That is, the retouching processing unit 432 sets the parameters that define the size and darkness of the eyes, and the display of the selection area 532 is used to set the eye size level of each user in the captured image. Adjust the size and darkness of the eyes.

Further, when the retouching processing unit 432 is selected to turn on the image processing for the tear bag portion by using the display of the selection area 533, the retouch processing unit 432 sets a parameter that defines the color and shape of the tear bag portion. , Image processing is performed on the tear bag portion of each user reflected in the photographed image so that the tear bag portion is emphasized.

The retouching processing unit 432 performs such image processing on each of the five close-up images and one full-body image. Image processing for each of the five close-up images and one full-body image is performed when the OK button 534 is pressed and the content of the image processing of the eye portion is confirmed.

After the image processing focusing on the eye portion is performed, in step S34, the display control unit 434 causes the tablet built-in monitor 131 to display the retouch screen for adjusting the brightness of the skin.

FIG. 24 is a diagram showing an example of a retouching screen for adjusting the brightness of the skin displayed when the “eye-filling course” is selected.

At the top center of the retouch screen, the message "Choose your favorite brightness!" Is displayed. Below the message, sample images 561-1 to 561-6 are displayed. The sample images 561-1 to 561-6 are, for example, retouched images in which the eye portion is retouched.

In this example, six sample images representing six captured images are displayed, but as in the retouch screen of FIG. 22, only the first captured image is displayed as a sample image. You may do it.

To the right of the sample image 561-6, an OK button 562 that is pressed when the adjustment of the skin brightness is completed is displayed.

Below the sample images 561-1 to 561-6, brightness adjustment buttons 563-1 to 563-5, which are buttons for selecting a predetermined brightness from five types of skin brightness, are displayed. To. In the default state shown in FIG. 24, the brightness corresponding to the brightness adjustment button 563-3 is displayed in the selected state.

The user can set the desired brightness of the skin by pressing the brightness adjustment button corresponding to the predetermined brightness using the touch pen 132.

The content of the selection operation using the brightness adjustment buttons 563-1 to 563-5 is reflected in real time on the display of the sample images 561-1 to 561-6. That is, the image processing is applied to the skin portion of the person shown in the sample images 561-1 to 561-6, and the brightness of the skin is switched.

In step S35, the retouching processing unit 432 performs retouching on the skin according to the user's selection on the retouching screen.

In this way, it is possible to adjust the brightness of the skin after retouching focusing on the eye portion even when the "eye-filling course" is selected. When the OK button 562 is pressed, the retouching work of the "eye-filling course" is completed.

On the other hand, when the "white skin filling course" is selected by the user, in step S36, the display control unit 434 of the editing processing unit 403 displays the function explanation screen on the tablet built-in monitor 131, and the skin portion. Outputs guidance for skin retouching, which is a retouching that focuses on.

After the guidance explaining the skin retouching function is output, in step S37, the display control unit 434 causes the tablet built-in monitor 131 to display the skin retouching screen.

FIG. 25 is a diagram showing an example of a retouching screen for skin displayed when the “white skin filling course” is selected.

Of the configurations shown in FIG. 25, the configurations described with reference to FIGS. 22 and the like are designated by the same reference numerals. Duplicate explanations will be omitted as appropriate. The same applies to the figures described later.

At the top center of the retouch screen, the message "Choose a white skin level and a soft skin filter" is displayed. Below the message is a sample image 531.

On the right side of the sample image 531 is an OK button 534 that is pressed when the retouching work is completed.

Under the sample image 531 a horizontally long rectangular selection area 581 used for adjusting the white skin level and a horizontally long rectangular selection area 582 used for selecting on / off of the skin beautifying filter are formed side by side. An area wider than the selection area 582 is allocated to the selection area 581.

The characters "white skin level" are displayed in the upper center of the selection area 581 used for selecting the main function, and a numerical value indicating the selected white skin level (brightness of the skin) is displayed to the right of the characters. ..

Approximately in the center of the selection area 581, a horizontally long slide bar 591 representing a range of 80% to 120% of the white skin level is displayed. Below the slide bar 591, a numerical value of 80% is displayed at the left end and a numerical value of 120% is displayed at the right end.

A pointer 591A is displayed at a predetermined position on the slide bar 591. The position of the pointer 591A is switched according to the selection by the user. In the default state shown in FIG. 25, the pointer 591A is displayed at a position indicating a 100% white skin level, which is a recommended level.

The user can select a desired white skin level by designating a predetermined position on the slide bar 591 with the touch pen 132.

For example, when a position near the left end where a numerical value of 80% is displayed below is specified, 80% is set as the white skin level, and as shown in FIG. 26A, the pointer 591A is displayed at the position of 80% of the slide bar 591. Will be done.

Further, when the position between the left end and the center is specified, 90% is set as the white skin level, and the pointer 591A is displayed at the 90% position of the slide bar 591 as shown in FIG. 26B.

When the position between the right edge and the center is specified, 110% is set as the white skin level, and the pointer 591A is displayed at the position of 110% of the slide bar 591 as shown in FIG. 26C.

In this example, it is possible to select a favorite white skin level from five levels of 80%, 90%, 100%, 110%, and 120%. Since more levels are available as selectable levels, finer adjustments are possible than the eye-catching level.

The content of the selection operation using the display of the selection area 581 is reflected in the display of the sample image 531 in real time. That is, image processing is applied to the skin portions of the two users shown in the sample image 531 to switch the brightness of the skin.

On the left side of the selection area 582 used for selecting the sub-function, an image image 601 showing an enlarged image of the model person's face, which is a sample of image processing by the sub-function, is displayed, and on the right side, a "skin-beautifying filter" is displayed. Character is displayed.

Below the word "Beautiful skin filter", a message about the introduction of the function is displayed, and below that, the on button 602-1 that is operated when the beautiful skin filter is set to on, and the beautiful skin filter is set to off. The off button 602-2 operated in case is displayed.

One of the on button 602-1 and the off button 602-2 is exclusively pressed. In the default state shown in FIG. 25, the on button 602-1 is pressed.

The content of the selection operation using the display of the selection area 582 is also reflected in the display of the sample image 531 in real time. That is, when the on button 602-1 is pressed, image processing using a filter is applied to the first captured image, and a sample image 531 with a fluffy skin impression (blurred impression) is displayed. .. Further, when the off button 602-2 is pressed, the sample image 531 in a state where the image processing using the filter is not performed is displayed.

Instead of turning on / off the image processing for the skin portion or the entire image, the strength of the image processing may be selected by using the display of the selection area 582.

In this way, on the skin retouching screen displayed when the "white skin filling course" is selected, the user's skin portion is focused on and retouching is performed using a plurality of types of functions.

Since the adjustment of the white skin level and the on / off of the image processing using the skin-beautifying filter can be selected from one retouch screen, the user can easily perform the retouching using a plurality of types of functions.

In addition, since the operation method differs for each function, such as adjusting the white skin level using the slide bar and selecting on / off of image processing using the skin beautification filter using the button, the user can use it. It is possible to perform retouching focusing on the skin part while being aware of the main function and sub function.

Returning to the description of FIG. 21, in step S38, the retouching processing unit 432 performs retouching on the skin according to the user's selection on the skin retouching screen.

That is, the retouching processing unit 432 sets a parameter that defines the brightness of the skin, and each user reflected in the captured image so as to have the white skin level (brightness) set by using the display of the selection area 581. Adjust the brightness of your skin.

Further, when the retouching processing unit 432 selects to turn on the image processing using the skin-beautifying filter by using the display of the selection area 582, the retouching processing unit 432 performs a filtering process or the like to give an impression that the skin portion is fluffy. Therefore, image processing is performed on the skin portion of each user reflected in the captured image.

The retouching processing unit 432 performs such image processing on each of the five close-up images and one full-body image. Image processing for each of the five close-up images and one full-body image is performed when the OK button 534 is pressed and the content of the image processing of the skin portion is confirmed.

After the image processing focusing on the skin portion is performed, in step S39, the display control unit 434 causes the tablet built-in monitor 131 to display the retouch screen for adjusting the size of the eyes.

FIG. 27 is a diagram showing an example of a retouching screen for adjusting the size of eyes displayed when the “white skin filling course” is selected.

The message "Choose your favorite eye size!" Is displayed in the upper center of the retouch screen. Below the message, sample images 561-1 to 561-6 are displayed. The sample images 561-1 to 561-6 are, for example, retouched images in which the skin portion is retouched.

To the right of the sample image 561-6, an OK button 562 that is pressed when the adjustment of the eye size is completed is displayed.

Below the sample images 561-1 to 561-6, size adjustment buttons 611-1 to 611-4, which are buttons for selecting a predetermined size from four types of eye sizes, are displayed. To. In the default state shown in FIG. 27, the size corresponding to the size adjustment button 611-3 is displayed in the selected state.

The user can set the desired eye size by pressing the size adjustment button corresponding to the predetermined size using the touch pen 132.

The content of the selection operation using the size adjustment buttons 611-1 to 611-4 is reflected in real time on the display of the sample images 561-1 to 561-6. That is, image processing is performed on the eye portion of the person shown in the sample images 561-1 to 561-6, and the size of the eye is switched.

Of the size adjustment buttons 611-1 to 611-4, the size adjustment button 611-1 is displayed smaller than the size adjustment buttons 611-2 to 611-4. By providing a difference in the size of the buttons, it is possible to induce the user to press the size adjustment buttons 611-2 to 611-4, which are displayed in large size.

In step S40, the retouching processing unit 432 performs retouching on the eyes according to the user's selection on the retouching screen.

In this way, even when the "white skin filling course" is selected, it is possible to adjust the size of the eyes after retouching focusing on the skin portion. When the OK button 562 is pressed, the retouching work of the "white skin filling course" is completed.

When the retouching work of the "pupil swelling course" or the "white skin swelling course" is completed, in step S41, the display control unit 434 displays the editing screen on the tablet built-in monitor 131.

The edit screen is a screen used for editing a photographed image to be edited. On the editing screen, the captured image to be edited and various editing tools (composite images) such as stamp images and pen images used for editing are displayed.

FIG. 28 is a diagram showing an example of an editing screen displayed on the tablet built-in monitor 131.

The edit screen is basically configured by providing the main configurations symmetrically. The left half area is an area used by the user on the left side of the tablet built-in monitor 131. The right half area is an area used by the user on the right side of the tablet built-in monitor 131. With such an editing screen configuration, mainly two users can perform editing work at the same time. The broken line surrounding each area on the editing screen shown in FIG. 28 is not actually displayed on the screen.

A thumbnail display area 711L is provided above the center of the left half area of the editing screen. The thumbnail display area 711L is a display area for a thumbnail image representing a captured image. The thumbnail image is generated, for example, by reducing the captured image in which the background image is combined. The user (the user on the left side of the tablet built-in monitor 131) selects the captured image to be edited by selecting the thumbnail image displayed in the thumbnail display area 711L.

In the example of FIG. 28, the thumbnail images P51 to P55 of the five close-up images and the thumbnail images P56 of one coordinated image are displayed side by side in the thumbnail display area 711L.

An editing area 712L is provided in the substantially center of the left half area. The editing area 712L is a display area of a captured image to be edited selected using the thumbnail image. The user can select an editing tool using the touch pen 132A and edit the captured image displayed in the editing area 712L.

Below the editing area 712L, the editing palette 713L, which is a horizontally long rectangular area, is displayed. The editing palette 713L includes buttons used to select various editing tools (compositing images) such as a pen tool (pen image) and a stamp tool (stamp image) that are combined with the captured image displayed in the editing area 712L. The area to be displayed.

Above the editing palette 713L, five types of tabs used to select the category of the editing tool are displayed. To the right of the editing palette 713L, six types of tabs used to select the type of editing tool are displayed. The user can switch the type and category of the editing tool displayed on the editing palette 713L by using these tabs.

The makeup tool area 714L is displayed on the left side of the editing area 712L. In the makeup tool area 714L, buttons operated when adjusting the color of the user's lips appearing in the captured image to be edited are displayed.

A correction tool selection area 715L is formed on the right side of the editing area 712L. The correction tool selection area 715L is an area in which buttons used for selecting the eraser tool, a "back" button, a "forward" button, a "from the beginning" button, and the like are displayed vertically side by side.

The eraser tool is a tool used to erase a synthesized editing tool. The "Back" button and "Forward" button are buttons that are operated when the selection operation of the editing tool is returned or advanced by one, and the "From the beginning" button cancels all the selection operations of the editing tool. However, it is a button that is operated when returning to the state where none of the edits have been made. In addition, a "1 set back" button is also displayed in the correction tool selection area 715L. By pressing the "1 set back" button, you can erase all the editing tools that were combined during the specified time.

To the right of the correction tool selection area 715L, a creation button 716L operated when creating an image for mobile transmission is displayed. The characters of "mobile phone bonus" displayed on the editing screen of FIG. 28 represent images for mobile transmission. When the create button 716L is pressed, the image creation screen for mobile transmission is superimposed on the edit screen.

Above the correction tool selection area 715L, an end button 717L operated when the editing process is ended is displayed.

In the right half area used by the user on the right side of the tablet built-in monitor 131, the same configuration as the above-mentioned left half area configuration is arranged symmetrically in position. Editing of the captured image is performed using such an editing screen.

In step S42 of FIG. 21, the editing control unit 433 edits the captured image to be edited according to the operation of the user. The edited image generated by the editing is supplied to the print data generation unit 435.

When editing is completed due to an operation of the end button or the like, in step S43, the display control unit 434 causes the tablet built-in monitor 131 to display the division number selection screen.

The division number selection screen is a screen used for selecting the seal layout. The sticker layout is a layout (arrangement pattern) that determines the number, position, and size of edited images arranged on one photo sticker. An edited image arranged according to the sticker layout selected by the user here is printed on the sticker paper 363.

The print data generation unit 435 generates print data by arranging the edited images in the layout selected by the user. The generated print data is supplied to the print processing unit 404 and used for printing the edited image (step S5 in FIG. 16).

In step S44, the display control unit 434 causes the tablet built-in monitor 131 to display the selection screen for mobile transmission.

The user needs to register as a member in order to use the image acquisition site, and the members include paid members and free members. Paid members can download all the images sent to the image acquisition site management server to their mobile terminal, while free members can download only one image to their mobile terminal. .. The mobile transmission selection screen is a screen used by a free member to select an image to be downloaded to his / her mobile terminal.

In step S45, the communication control unit 436 transmits the edited image (five close-up images and one coordinated image) and the image for mobile transmission to the image acquisition site management server. The device ID of the photo sticker creation device 1, the shooting date and time, information indicating which image is selected from the transmission image selection screen, and the like are also transmitted to the image acquisition site management server.

In step S46, the display control unit 434 guides the user who has finished the editing work to move to the print waiting space A3 by displaying the guidance screen on the tablet built-in monitor 131. Guidance for moving to the print waiting space A3 is also performed by outputting voice from the speaker 341. After that, the process returns to step S5 in FIG. 16 and the subsequent processing is performed.

By the above processing, the photo sticker creating device 1 performs on / off of a plurality of types of image processing applied to the photographed image (image processing for the eye color level / tear bag portion when the "pupil swelling course" is selected, or "white skin swelling". Each selection operation of white skin level / on / off of the beautiful skin filter when "Course" is selected can be accepted on one screen.

By performing image processing focusing on the part corresponding to the course selected by the user, it is possible to provide an image with high satisfaction to the user. Further, by limiting the target of image processing to the portion to be focused on by the user, it becomes possible to efficiently perform the selection operation for image processing on that portion.

In a photo sticker machine, being able to become the "face you want to be" for each user (being able to select the content of image processing as you like) is a very important factor. Most of the users who use the photo sticker machine are teenage girls (junior high school girls and high school girls), and most of them do not wear makeup because they play games on their way home from school.

Therefore, in general, in a photo sticker machine, as the needs of users are subdivided, how to provide a highly satisfying image of a "face that wants to be" to a user who does not have makeup. In order to realize the above, it is designed to provide a retouch screen and an edit screen which are easy to operate and in which changes in images are easy to understand.

For example, if the user fails to operate on the retouch screen, measures such as synthesizing stamp images to hide one's face in the captured image are taken, and such an image results in such an image. The image will be of low value to the user. In this case, it is evaluated that such a photo sticker machine cannot be a "face to be", and the profitability of the photo sticker machine itself is lowered.

As mentioned above, the main function and sub-functions are intuitively easy to understand, and by preparing a retouch screen that allows you to use multiple functions from one screen, you can provide the "face you want to be". It becomes possible to increase the profitability of the photo sticker creating device 1.

Further, it is possible to provide a tab for retouching on the editing palette 713L of the editing screen (FIG. 28) so that the retouching can be performed on the editing screen, but as described above, the screen dedicated to retouching should be presented before the start of editing. This allows all users to perform retouching.

If you select a tab and perform retouching, some users may not be aware of the retouching function, but it is possible to prevent such a situation.

<Example 1-1>
In the above, the function that allows fine adjustment of parameters is the main function, and the function that has two parameters (on / off) is the sub function, but on the contrary, the function that allows fine adjustment of parameters is the sub function. , The function with two parameters may be the main function.

The main function and the sub function can be distinguished from each other from the following viewpoints.
(1) Difference in operation method (2) Difference in size of selection area (3) Difference in position of selection area

・ (1) Differences in operation methods The main function is operated using the slide bar, and the sub function is operated using buttons, but other operations are also possible. be.

For example, the operation of the main function may be an operation using the slide bar, and the operation of the sub function may be an operation other than the operation using the slide bar.

Further, the operation of the main function may be an operation using a button, and the operation of the sub function may be an operation other than the operation using the button.

Physical members for operation such as knobs, cross keys, numeric keys, and buttons are prepared in the editing space A2, and the main function and the sub function may be operated using these members.

In this case, for example, the operation of the main function is an operation using a knob, and fine adjustment is possible in the same manner as an operation using a slide bar. The operation of the sub function is an operation using a button.

Further, the members for operating the main function and the sub function may not be physically prepared, but may be virtually prepared by screen display.

For example, display for operation such as a numeric keypad, a button, a slide bar, and a check box may be displayed on the retouch screen, and the main function and the sub function may be operated using these displays.

In this case, for example, the operation of the main function is an operation using the numeric keypad, the button, and the slide bar, and fine adjustment is possible. The operation of the sub function is an operation using a check box.

When the operation is performed using the screen display, the explanation of the operation method may be output. At this time, the explanation of the operation method of the main function and the explanation of the operation method of the sub function may be distinguished. When explaining the operation method, the area other than the selected area may be grayed out and displayed. Further, the selection area used for selecting the main function and the selection area used for selecting the sub function may be displayed in different colors.

The operation of the main function may be performed by a swipe operation, and the image processing parameters may be changed according to the amount of the swipe operation. In this case, the operation of the sub function is performed by a touch operation. Image processing parameters are changed depending on whether or not to touch.

In this way, it is possible to adopt various operations as the operation of the main function and the operation of the sub function.

(2) Difference in size of selection area The selection area used for the operation of the main function (selection area 532 in FIG. 22 and the selection area 581 in FIG. 25) and the selection area used for the operation of the sub function (FIG. 22). The size of the selection area 533 and the selection area 582) in FIG. 25 may be changed more clearly.

For example, by increasing the selection area used for operating the main function and reducing the selection area used for operating the sub function, visibility by the user can be improved.

Further, in the examples of FIGS. 22 and 25, the shapes of the selection area used for the operation of the main function and the selection area used for the operation of the sub function are assumed to be a horizontally long rectangular shape, but each has another shape. May be good.

For example, the selection area used for the operation of the main function may be a circular area, and the selection area used for the operation of the sub function may be a rectangular or triangular area other than the circular shape. This also makes it possible to improve the visibility by the user.

Not only the size of the selection area but also the shape may be changed. This makes it possible for the user to be more clearly aware of the difference between the main function and the sub function.

For example, the selection area used for the operation of the main function is formed to be large in a circular shape, and the selection area used for the operation of the sub function is formed to be small in a shape other than the circular shape. It is possible to improve the visibility due to the above.

(3) Difference in position of selection area It is also possible to change the arrangement of the selection area used for the operation of the main function and the selection area used for the operation of the sub function.

For example, the selection area used for the operation of the main function may be arranged above the retouch screen, and the selection area used for the operation of the sub function may be arranged below the retouch screen. In general, a person's line of sight moves from top to bottom, so that visibility by the user can be improved.

Either the selection area used for the operation of the main function or the selection area used for the operation of the sub function may be displayed in a pop-up (superimposed display).

29 and 30 are diagrams showing a display example of a retouch screen using a pop-up display.

The retouching screen shown in FIG. 29 is basically the same as the retouching screen at the time of selecting the “pupil fill course” shown in FIG. 22, except that the selection area 533 is not included. The selection region 532 used for adjusting the eye color level is formed directly below the sample image 531.

The adjustment of the eye color level as the main function performed by using the display of the selection area 532 is performed by the operation using the slide bar 541 in the same manner as the operation described with reference to FIG. 22.

When the eye color level is adjusted by the operation using the slide bar 541 and the OK button 534 is pressed, the selection screen 751 is popped up and displayed in the substantially center of the retouch screen as shown in FIG.

The selection screen 751, which is a so-called pop-up window, is a screen used for selecting on / off of image processing for the tear bag portion as a sub function, and the same contents as the contents of the selection area 533 of FIG. 22 are displayed. The selection of on / off of the image processing for the tear bag portion performed by using the display of the selection screen 751 uses the on button 5521 and the off button 552-2 in the same manner as the operation described with reference to FIG. 22. It is done.

The retouch screens shown in FIGS. 29 and 30 can be said to be the same screen because there is no transition of the entire screen.

<Example 1-2>
In the retouch screen of FIG. 22 displayed when the "eye-filled course" is selected and the retouch screen of FIG. 25 displayed when the "white skin-filled course" is selected, the first captured image is displayed as a sample image 531. However, it is possible to adopt various displays for the display of the sample image.

For example, the second and subsequent captured images may be displayed as sample images.

Further, the face of the user appearing in each captured image may be authenticated, and the captured image to be displayed as a sample image may be selected based on the number of authenticated faces. For example, if the number of faces that can be authenticated in the first close-up image is one and the number of faces that can be authenticated in the second to fifth close-up images is two, the number of faces that can be authenticated is A large number of second close-up images are selected and displayed as sample images.

The fact that the face has been authenticated can be assumed to mean that the face is facing the front (camera 91). For example, if you are facing sideways, you may not succeed in authenticating that face.

By selecting a captured image with a large number of authenticated faces, it becomes possible for many users to display the captured image facing the front as a sample image.

Further, the user may be made to select one of the close-up images by displaying the 1st to 5th close-up images, and the close-up image selected by the user may be displayed as the sample image 531.

Further, for example, a close-up image randomly selected by the photo sticker creation device 1 may be displayed as a sample image 531.

The number of sample images displayed on the retouch screen is not limited to one, and may be multiple.

FIG. 31 is a diagram showing another display example of the retouch screen.

The retouching screen shown in FIG. 31 is different from the retouching screen shown in FIG. 22 in that sample images 561-1 to 561-6 representing all six captured images are arranged.

In this way, a plurality of sample images may be displayed on the screen where the retouching using the main function and the sub function is performed. Since the content of the user's selection operation is reflected in the display of each sample image, the user can confirm the result of image processing for all the captured images.

Only the sample image of the close-up image may be displayed instead of the sample image representing all the captured images. In this way, it is possible to display only the captured images having the same angle of view (shooting range) as sample images. Further, the sample image of the close-up image and the sample image of the coordinated image may be displayed one by one.

<Example 1-3>
The display method of the retouch screen is not limited to that shown in FIGS. 22 and 25.

FIG. 32 is a diagram showing another display example of the retouch screen.

The retouching screen shown in FIG. 32 is different from the retouching screen shown in FIG. 25 in that the selection area 581 is formed on the right side and the selection area 582 is formed on the left side of the sample image 531. In the selection area 581 of FIG. 32, the slide bar 591 is displayed in the vertical direction. The person of the model of the image image 601 displayed in the selection area 582 of FIG. 32 is a person different from the person shown in FIG.

The adjustment of the white skin level as the main function performed by using the display of the selection area 581 is performed by the operation using the slide bar 591 in the same manner as the operation described with reference to FIG. 25.

The on / off selection of image processing using the skin-beautifying filter as a sub-function performed using the display of the selection area 582 is the same as the operation described with reference to FIG. 25, the on button 602-1 and the off button 602. It is performed by the operation using -2.

In this way, the positions of the selection area of the main function and the selection area of the sub function can be set to arbitrary positions.

<Example 1-4>
FIG. 33 is a diagram showing another display example of the retouch screen.

The retouching screen shown in FIG. 33 is different from the retouching screen shown in FIG. 32 in that the slide bar 591 displayed in the selection area 582 is elongated in the horizontal direction.

As described above, the direction of the slide bar may be horizontal or vertical.

<< Example 2 >>
In the above, the retouching course of the "eye-filling course" and the "white-skin-filling course" has been described as an example, but a retouching course focusing on other parts may be prepared.

<Example 2-1>
(1) When a "hair filling course" is prepared For example, the "hair filling course" is a retouching course that focuses on the part of the user's hair that appears in the photographed image. For example, a hair gloss adjustment function is provided as a main function, and a hair color selection function is provided as a sub function.

On the retouch screen of the "hair filling course", a selection area for adjusting the glossiness of the hair and a selection area for selecting the hair color are formed.

When an operation for adjusting the glossiness of the hair is performed, the hair portion of the user is specified by analyzing the captured image, and a mask having a predetermined shape is synthesized for the hair portion. This mask is a mask having bright brightness, and when the mask is synthesized with respect to the hair portion, the hair portion is brightened and image processing is performed so as to increase the glossiness.

On the other hand, when the operation for selecting the hair color is performed, a mask having a predetermined shape is synthesized for the hair portion of the user. This mask is a mask having a predetermined color, and when the mask is synthesized with respect to the hair portion, image processing for changing the hair color is performed.

For example, the operation for adjusting the glossiness of the hair and the operation for selecting the hair color are different methods of operation.

(2) When a "nose-filling course" is prepared For example, the "nose-filling course" is a retouching course that focuses on the user's nose in the photographed image. For example, a function for adjusting the height of the nose is provided.

A selection area for adjusting the height of the nasal muscles is formed on the retouch screen of the "nose filling course".

When an operation is performed to adjust the height of the nose muscle, the part of the user's nose is identified by analyzing the captured image, and it is estimated that the midpoint of the nose is the highest part of the nose. .. Image processing that changes the height of the nose by moving the midpoint of the nose is applied to the captured image.

(3) When a "lip filling course" is prepared For example, the "lips filling course" is a retouching course that focuses on the part of the user's lips that appears in the photographed image. For example, a function for adjusting the thickness of the lips is provided as a main function, and a function for selecting a three-dimensional effect of the lips is provided as a sub function.

On the retouch screen of the "lip filling course", a selection area for adjusting the thickness of the lips and a selection area for selecting the three-dimensional effect of the lips are formed.

When an operation to adjust the thickness of the lips is performed, the part of the user's lips is identified by analyzing the captured image, and the position of the lips is moved to change the thickness of the lips. Image processing is applied. The thicker the lips, the more "plump" the lips will look.

On the other hand, when an operation for selecting the three-dimensional effect of the lips is performed, the part of the user's lips is identified by analyzing the captured image, and it is estimated that the midpoint of the lips is the highest part of the lips. Will be done. Image processing is applied to the captured image to change the height of the lips by moving the midpoint of the lips. If you get a three-dimensional effect, your lips will look "plump".

(4) When a "face-filling course" is prepared For example, the "face-filling course" is a retouching course that focuses on the entire face of the user in the photographed image. A function to adjust the shape of the face is prepared.

On the retouch screen of the "face filling course", a selection area for selecting the shape of the face from a plurality of types is formed.

When an operation to select the shape of the face is performed, the user's face is identified by analyzing the captured image, and the contour of the face is deformed into an egg shape or the shape of the chin is reduced. Image processing is applied to the captured image.

In this way, by preparing a course focusing on parts other than the eyes and skin and letting the user select it, it is possible to provide an image with high satisfaction to the user.

<Example 2-2>
The shooting method may be changed depending on the part of interest (the part to which image processing is performed for filling).

(1) When the live view screen is displayed, the animation may be displayed on the part of interest. For example, when paying attention to the eyes, a glittering animation is displayed for the part of the user's eyes reflected in the live view image.

In this case, the display of the live view screen at the time of shooting is changed according to the portion of interest.

(2) For example, when paying attention to the eyes, the position of the strobe to emit light and the amount of light of the strobe are changed, so that the so-called catch light is conspicuous.

In this case, the optical specifications at the time of shooting are changed according to the portion of interest.

(3) For example, when paying attention to the hair, the user is guided to a position where the light of the strobe is applied to the hair more beautifully.

In this case, the standing position at the time of shooting is changed according to the portion of interest. When paying attention to a part other than the hair, the standing position to be guided is determined in consideration of the size of the face and the background.

(4) For example, when paying attention to the eyes, the angle of the camera 91 is set downward (downward from the horizontal) from other courses so that the image is taken from a more bird's-eye view. May be good. By setting it downward from other courses, the direction of the line of sight becomes more upward and the eye part is emphasized.

In this case, the angle of the camera 91 at the time of shooting is changed according to the portion of interest.

<Example 2-3>
The editing method may be changed according to the part of interest.

(1) For example, when paying attention to the skin, a filter for performing image processing that makes the skin look beautiful is prepared by default on the editing screen as an editing tool. In addition, a filter for applying blurring processing is prepared as an editing tool.

In this case, the filter that can be used at the time of editing is changed according to the part of interest.

(2) For example, when paying attention to the eyes, the content synthesized in the eyes is prepared as an editing tool on the editing screen by default. The content is, for example, a composite image for applying make-up. The content synthesized in the eye part may be prepared by default on the edit screen more than the content synthesized in other parts.

In this case, the content that can be used at the time of editing is changed according to the part of interest.

(3) For example, when paying attention to the skin, a white background image in which the skin part is clearly reflected is combined with the captured image and displayed as the captured image to be edited by default on the editing screen.

In this case, the background image combined with the captured image is changed according to the portion of interest.

When paying attention to the skin, the background color prepared in the shooting space A1 may be changed so that a white background curtain is selected.

<< Other variants >>
The series of processes described above can be executed by hardware or software. When a series of processes are executed by software, the programs constituting the software are installed on a computer embedded in dedicated hardware, a general-purpose personal computer, or the like.

The installed program is provided by recording on a removable media 319 shown in FIG. 12, which comprises an optical disk (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.), a semiconductor memory, or the like. It may also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting. The program can be pre-installed in the ROM 312 or the storage unit 316.

The program executed by the computer may be a program in which processing is performed in chronological order according to the order described in the present specification, in parallel, or at a necessary timing such as when a call is made. It may be a program in which processing is performed.

1 Photo sticker creation device, 91 camera, 92 touch panel monitor, 131 tablet built-in monitor, 402 shooting processing unit, 403 editing processing unit, 431 selection reception unit, 432 retouching processing unit, 433 editing control unit, 434 display control unit, 435 printing Data generation unit, 436 communication control unit

Claims (10)

As a display used for selection operations related to multiple types of image processing targeting different parts of the user appearing as a subject in the captured image, a display control unit that simultaneously displays multiple pieces of information with different operation methods on the same screen.
An image processing apparatus including an image processing unit that performs each type of image processing on a plurality of captured images according to the selection operation . The display control unit has a display area for information used for the selection operation related to the image processing targeting a specific part, and a display area for information used for the selection operation related to the image processing targeting another part. The screen provided with and is displayed as an adjustment screen for the image of the captured image.
The image processing apparatus according to claim 1. The selection operation related to the image processing targeting the specific part is an operation using the slide bar displayed on the adjustment screen.
The image processing apparatus according to claim 2, wherein the selection operation relating to the image processing for the other part is an operation using another display displayed on the adjustment screen. The selection operation related to the image processing targeting the specific part is an operation using a button displayed on the adjustment screen.
The image processing apparatus according to claim 2, wherein the selection operation relating to the image processing for the other part is an operation using another display displayed on the adjustment screen. The selection operation related to the image processing targeting the specific part is an operation using the slide bar displayed on the adjustment screen.
The image processing apparatus according to claim 2, wherein the selection operation relating to the image processing for the other portion is an operation using a button displayed on the adjustment screen. The display control unit displays one captured image as a sample image on the adjustment screen, and each time the user performs the selection operation, the content of the selection operation is reflected in the display of the sample image. Item 2. The image processing apparatus according to any one of Items 2 to 5. 2. 6. The display control unit displays an image of the specific portion and an image of the other portion, which are samples of the image processing, in an information display area used for each of the selection operations . The image processing apparatus according to any one. When one button operated when confirming the selection operation is operated, it further includes a selection unit that accepts the selection operation for a plurality of types of the image processing.
The image processing apparatus according to any one of claims 1 to 7 . The image processing device
As a display used for selection operations related to multiple types of image processing targeting different parts of the user appearing as a subject in the captured image, multiple information with different operation methods are displayed simultaneously on the same screen .
Each type of image processing is applied to a plurality of captured images according to the selection operation.
Image processing method. For the computer installed in the image processing device
As a display used for selection operations related to multiple types of image processing targeting different parts of the user appearing as a subject in the captured image, multiple information with different operation methods are displayed simultaneously on the same screen .
Each type of image processing is applied to a plurality of captured images according to the selection operation.
A program that executes processing.

Images