JP7587110B2 - Image processing device, image processing method, and program - Google Patents

Description

Article 30, paragraph 2 of the Patent Act will be applied. On display at the "girls mignon" Shinsaibashi GATE store on July 11, 2020.

The present technology relates to an image processing device , an image processing method , and a program , and more particularly to an image processing device , an image processing method , and a program that enable editing of a captured image using an editing screen according to a purpose.

Photo sticker creation devices are known in the art. Photo sticker creation devices photograph a user, allow the user to edit the photographed image, and print the edited image on sticker paper for provision. Photo sticker creation devices are installed in amusement facilities, etc.

The flow of one game provided by the photo sticker creation device typically involves taking a photo of the user in the shooting space as the subject, then moving the user to the editing space, editing the image according to the operations performed in the editing space, and printing the edited image on sticker paper.

After moving from the shooting space to the editing space, the images obtained by shooting are edited using an editing screen displayed on a display provided in the editing space. The editing screen displays the image to be edited, as well as buttons used to select various editing tools.

Patent Document 1 discloses a technology that takes two types of photographs: a photographed image called a pre-image that is the subject of editing including a process of combining an image to be combined, and a passport photograph, and displays an editing screen corresponding to each photograph.

JP 2015-165253 A

When editing is done using separate editing screens for the photographed image and for the ID photo, it is believed that the editing results can be improved if the user can edit while imagining each purpose.

This technology was developed in light of these circumstances, and allows users to edit captured images using an editing screen suited to the purpose.

An image processing device according to one aspect of the present technology includes a display control unit that displays, as editing screens used for editing a captured image, a first editing screen used for editing the captured image dedicated to printing, in which the captured image to be edited is displayed in an editing input area together with an edge image representing the edge of a print medium , and a second editing screen used for editing the captured image dedicated to sending to an external device, in which the captured image to be edited is displayed in an editing input area without the edge image .

In one aspect of the present technology, the editing screens used for editing the captured image include a first editing screen used for editing the captured image that is dedicated to printing, in which the captured image to be edited is displayed in an editing input area together with an edge image representing the edge of the print medium, and a second editing screen used for editing the captured image that is dedicated to sending to an external device, in which the captured image to be edited is displayed in an editing input area without the edge image .

With this technology, users can edit captured images using an editing screen suited to their needs.

1 is a perspective view showing an example of the external configuration of a photo sticker creation device according to the present technology; FIG. 2 is a perspective view of the photo sticker creating device as seen from another angle. FIG. 1 is a diagram illustrating the movement of a user. FIG. 13 illustrates an example of the configuration of a pre-selection unit; FIG. 2 is a diagram illustrating an example of the configuration of an imaging unit. FIG. 2 is a diagram showing an example of the configuration of the front side of the editing unit. 1 is a block diagram showing an example of the configuration of a photo sticker creating device; 2 is a block diagram showing an example of a functional configuration of the photo sticker creating device; 13 is a flowchart illustrating a photo sticker creation game providing process. 10 is a flowchart illustrating the editing process performed in step S4 of FIG. 9. FIG. 13 is a diagram showing a display example of a sticker doodle image selection screen. FIG. 13 is a diagram showing a display example of a sticker-only doodling screen. FIG. 13 is a diagram showing an example of a display when a tool tab is pressed. FIG. 13 is an enlarged view of a graffiti input area; FIG. 13 is a diagram showing an example of input of graffiti. FIG. 13 is a diagram showing an example of a sticker layout selection screen. FIG. 13 is a diagram showing a state at the start of display of the mobile-only graffiti screen. FIG. 13 is a diagram showing a display example of a mobile-only graffiti screen. FIG. 13 is a diagram showing an example of a sticker sheet on which a sticker-specific image is printed. FIG. 11 is a diagram showing an example of information uploaded from the photo sticker creating device.

<<About the photo sticker creation game>>
<Appearance of the photo sticker creation device>
1 and 2 are perspective views showing an example of the external configuration of a photo sticker creating device 1. FIG.

The photo sticker creation device 1 is a photo creation game machine that provides images in which the user appears. The photo sticker creation device 1 provides images to the user by printing the images on sticker paper or by making the images viewable on the user's mobile device. The photo sticker creation device 1 is installed in amusement facilities such as game arcades and in stores.

The users of the photo sticker creation device 1 are mainly high school girls and young women. With the photo sticker creation device 1, multiple users, usually two or three people per group, can enjoy the game.

In the photo sticker creation device 1, the user takes a photo of themselves as the subject. Through editing, the user selects an image from the images obtained by shooting and combines it with a composite image such as handwritten text or a stamp image. In this way, the captured image is edited into a colorful image. The user receives sticker paper on which the edited image is printed, completing the series of games.

The photo sticker creation device 1 can be said to be a photo creation game machine that provides a photo creation game.

As shown in FIG. 1, the photo sticker creation device 1 is basically configured by installing a photographing unit 11 and an editing unit 12 in contact with each other. The photographing unit 11 and the editing unit 12 are electrically connected.

The photographing unit 11 has a box-shaped housing large enough for a person to enter, and is composed of a pre-selection section 20, a photographing section 21, and a background section 22. The pre-selection section 20 is installed on the side of the photographing section 21. The space in front of the pre-selection section 20 becomes the pre-selection space where the pre-selection processing is carried out. The photographing section 21 and the background section 22 are installed a predetermined distance apart. The space formed between the photographing section 21 and the background section 22 becomes the photographing space where the photographing processing is carried out.

As part of the pre-selection process, the pre-selection unit 20 provides guidance to introduce the games provided by the photo sticker creation device 1 and performs various settings for the photography process that takes place in the photography space. The pre-selection unit 20 is provided with a coin slot through which the user inserts money, a touch panel monitor used for various operations, and the like.

The photographing unit 21 is a device for photographing the user as a subject. The photographing unit 21 is located in front of the user who has entered the photographing space. A camera and a touch panel monitor used for various operations are provided in front of the photographing unit 21 facing the photographing space.

When viewed from a user facing forward in the shooting space, the left side is the left side and the right side is the right side. The left side of the shooting unit 21 is made up of side panel 41A, and the right side is made up of side panel 41B. Furthermore, the front of the shooting unit 21 is made up of front panel 42. The above-mentioned pre-selection unit 20 is installed on side panel 41A.

The background section 22 is composed of a rear panel 51, a side panel 52A, and a side panel 52B. The rear panel 51 is a plate-shaped member that is located behind a user facing forward. The side panel 52A is attached to the left end of the rear panel 51. The side panel 52B is attached to the right end of the rear panel 51.

The upper parts of side panels 41A and 52A are connected by connecting part 23A, which is a plate-shaped member, and the upper parts of side panels 41B and 52B are connected by connecting part 23B.

The opening formed by being surrounded by side panel 41A, connecting portion 23A, and side panel 52A serves as an entrance/exit to the photography space. The opening formed by being surrounded by side panel 41B, connecting portion 23B, and side panel 52B also serves as an entrance/exit to the photography space.

Above the shooting space, a ceiling is formed, surrounded by the front of the shooting unit 21, the connecting unit 23A, and the connecting unit 23B. A ceiling strobe unit 24 is provided in part of the ceiling. One end of the ceiling strobe unit 24 is fixed to the connecting unit 23A, and the other end is fixed to the connecting unit 23B.

The ceiling strobe unit 24 has a built-in strobe that emits light into the shooting space in accordance with the shooting. In addition to the strobe, a fluorescent lamp is also provided inside the ceiling strobe unit 24. The ceiling strobe unit 24 also functions as lighting for the shooting space by emitting light from the fluorescent lamp.

The editing unit 12 is a device for editing captured images. The editing unit 12 is connected to the photographing unit 11 with one side in contact with the front panel 42 of the photographing section 21.

If the configuration of the editing unit 12 shown in FIG. 1 is the configuration on the front side, components used for editing work are provided on both the front side and the back side of the editing unit 12. With this configuration, two groups of users can perform editing work at the same time.

The front side of the editing unit 12 is composed of a vertical surface 61 and an inclined surface 62 formed above the vertical surface 61. A tablet built-in monitor and a touch pen are provided on the inclined surface 62 as components used for editing work. A columnar support 63A that supports one end of the lighting device 64 is provided on the left side of the inclined surface 62. A columnar support 63B that supports the other end of the lighting device 64 is provided on the right side of the inclined surface 62. A support 65 that supports the curtain rail 25 is provided on the upper surface of the support 63A.

A curtain rail 25 is attached above the editing unit 12. The curtain rail 25 is composed of three rails 25A to 25C combined together. One end of rails 25A and 25B, which are arranged in parallel, is fixed to connecting parts 23A and 23B, respectively, and the other ends of rails 25A and 25B are joined to both ends of rail 25C, respectively.

A curtain is attached to the curtain rail 25 so that the space in front of the front and the space in front of the rear of the editing unit 12 cannot be seen from the outside. The space in front of the front and the space behind the rear of the editing unit 12 surrounded by the curtain become the editing space where the user performs editing work.

<About user movement>
Here, the flow of the photo sticker creation game and the accompanying movement of the user will be described.

Figure 3 is a plan view of the photo sticker creation device 1.

The user inserts coins into the coin slot in the pre-selection space A0, which is the space in front of the pre-selection unit 20. Next, the user makes various settings according to the screen displayed on the touch panel monitor. For example, the user makes a pre-selection such as choosing a course for photography to be carried out in the photography space.

After completing the pre-selection, the user enters the shooting space A1 through the doorway G1 between side panel 41A and side panel 52A, as indicated by the outlined arrow #1. The user takes pictures using the camera and touch panel monitor installed in the shooting unit 21.

When the user has finished shooting, they can either leave the shooting space A1 through the entrance G1 and move to the editing space A2-1, as shown by the white arrow #2, or leave the shooting space A1 through the entrance G2 and move to the editing space A2-2, as shown by the white arrow #3.

Editing space A2-1 is the editing space on the front side of the editing unit 12. On the other hand, editing space A2-2 is the editing space on the rear side of the editing unit 12. The user is guided as to whether to move to editing space A2-1 or editing space A2-2 by a screen display on the touch panel monitor of the imaging unit 21, for example. For example, the more empty of the two editing spaces is guided as the destination. Once the user moves to editing space A2-1 or editing space A2-2, they can start editing.

Printing of the image begins at a specific timing during editing. In the photo sticker creation device 1, the image is printed while the user is editing. When the image printing is finished, the sticker paper with the image printed on it is discharged from the discharge port.

A user who has completed editing work in editing space A2-1 and received sticker paper leaves editing space A2-1 as indicated by arrow #4, and ends their use of photo sticker creation device 1. Similarly, a user who has completed editing work in editing space A2-2 and received sticker paper leaves editing space A2-2 as indicated by arrow #5, and ends their use of photo sticker creation device 1.

<<Configuration of each device>>
Next, the configuration of each device will be described.

<Configuration of pre-selection section>
FIG. 4 is a diagram showing an example of the configuration of the pre-selection unit 20. As shown in FIG.

A touch panel monitor 71 is provided above the pre-selection unit 20. The touch panel monitor 71 is composed of a monitor such as an LCD (Liquid Crystal Display) and a touch panel layered on it. The touch panel monitor 71 has the function of displaying various GUIs (Graphical User Interfaces) and accepting selection operations by the user. A screen used to select the number of users, etc. is displayed on the touch panel monitor 71.

A speaker 72 is provided below the touch panel monitor 71. The speaker 72 outputs voice guidance for the pre-selection process, background music, sound effects, etc. A coin slot 73 into which the user can insert coins is provided adjacent to the speaker 72.

<Composition of the shooting department>
5 is a diagram showing an example of the configuration of the front side of the imaging unit 21. The imaging unit 21 is configured to be surrounded by a side panel 41A, a side panel 41B, and a front panel .

A camera unit 81 is provided slightly above the center of the front panel 42. A camera 91 and a touch panel monitor 92 are provided in front of the camera unit 81.

The camera 91 is, for example, a single-lens reflex camera, and is attached inside the camera unit 81 so that the lens is exposed. The camera 91 has an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and captures images of users in the shooting space A1. The camera 91 functions as a shooting unit that captures images of the users as subjects.

The moving image (hereinafter also referred to as a live view image) captured by the camera 91 is displayed in real time on the touch panel monitor 92. A still image captured by the camera 91 at a specified timing, such as when a shooting command is issued, is saved as a captured image.

The touch panel monitor 92 is provided below the camera 91. The touch panel monitor 92 is composed of a monitor such as an LCD and a touch panel stacked on it. The touch panel monitor 92 has a function as a live view monitor that displays moving images captured by the camera 91, and a function that displays various GUIs and accepts selection operations by the user.

An upper strobe unit 82 is installed above the camera unit 81, with its curved light-emitting surface facing the user. The upper strobe unit 82 shines light onto the user's face and upper body from above and in front of the user.

Below the camera unit 81 is a foot strobe unit 83 that shines light onto the user's lower body and feet.

Fluorescent lamps and light-emitting tubes capable of strobe emission are provided inside the upper strobe unit 82 and the foot strobe unit 83. The upper strobe unit 82 and the foot strobe unit 83 constantly illuminate the shooting space with fluorescent lamps, and emit light from the light-emitting tubes at the timing of shooting, irradiating the user, who is the subject, with strobe light.

A box-shaped portion 84 is provided between the foot strobe unit 83 and the side panel 41A. A box-shaped portion 85 is provided between the foot strobe unit 83 and the side panel 41B. The top surfaces of the box-shaped portions 84 and 85 are approximately horizontal with the installation surface of the photo sticker creation device 1, and are used as a luggage storage area for users performing photography work to place their baggage, etc.

A speaker is provided near the ceiling of the front panel 42. The speaker outputs voice guidance for the shooting process, background music, sound effects, etc.

<Editing Unit Composition>
FIG. 6 is a diagram showing an example of the configuration of the front side (editing space A2-1 side) of the editing unit 12. As shown in FIG.

A tablet-built-in monitor 131 is provided approximately in the center of the inclined surface 62. A touch pen 132A is provided to the left of the tablet-built-in monitor 131. A touch pen 132B is provided to the right of the tablet-built-in monitor 131.

The tablet-built-in monitor 131 is constructed by stacking a tablet and a display. The tablet allows operation input using touch pens 132A and 132B. For example, a screen used for editing work is displayed on the tablet-built-in monitor 131. When two users are performing editing work, the touch pen 132A is used by the user on the left side as viewed from the tablet-built-in monitor 131, and the touch pen 132B is used by the user on the right side as viewed from the tablet-built-in monitor 131. Hereinafter, when there is no need to distinguish between the touch pens 132A and 132B, they will be collectively referred to as touch pens 132.

A sticker paper outlet 133 is provided at the bottom left of the tablet built-in monitor 131. A printer is provided inside the editing unit 12. Sticker paper on which an image of a user of the editing space A2-1 is printed is discharged from the sticker paper outlet 133.

<<Internal configuration of the photo sticker creation device>>
<Hardware Configuration>
Fig. 7 is a block diagram showing an example of the configuration of the photo sticker creating device 1. In Fig. 7, the same components as those described above are given the same reference numerals, and duplicated explanations will be omitted as appropriate.

As shown in FIG. 7, the photo sticker creation device 1 is configured by connecting a pre-selection unit 302, a photographing unit 304, editing units 305A and 305B, and a printing unit 306 to a PC (Personal Computer) unit 301 via an external input/output interface 303. The PC unit 301 is housed, for example, inside the housing of the editing unit 12.

The CPU (Central Processing Unit) 311, ROM (Read Only Memory) 312, and RAM (Random Access Memory) 313 that make up the PC section 301 are interconnected by a bus 314.

The CPU 311 executes a predetermined program and controls the overall operation of the photo sticker creation device 1. The ROM 312 stores the programs and data executed by the CPU 311. The RAM 312 temporarily stores the data and programs processed by the CPU 311.

The input/output interface 315 connected to the bus 314 is connected to a memory unit 316, a communication unit 317, and a drive 318.

The storage unit 316 is a non-volatile storage medium such as a hard disk or a flash memory. The storage unit 316 stores various setting information and the like supplied from the CPU 311. The information stored in the storage unit 316 is read out by the CPU 311 as appropriate.

The communication unit 317 is an interface for a network such as the Internet. The communication unit 317 communicates with external devices under the control of the CPU 311. The communication unit 317 transmits images created by the user during the game to, for example, an image management server managed by the manufacturer of the photo sticker creation device 1. The images transmitted from the communication unit 317 are allocated a specified memory area and stored, and are displayed on or downloaded to a mobile terminal that has accessed the image management server.

Removable media 319, such as an optical disk or semiconductor memory, is appropriately attached to drive 318. Programs and data read from removable media 319 are supplied to CPU 311, and are stored in storage unit 316 or installed.

The external input/output interface 303 is connected to the input/output interface 315. The PC unit 301 controls each unit via the external input/output interface 303.

The pre-selection unit 302 performs pre-selection processing for users in the pre-selection space A0. The pre-selection unit 302 is composed of a touch panel monitor 71, a speaker 72, and a coin processing unit 321.

The touch panel monitor 71 displays various selection screens under the control of the PC unit 301 and accepts operations by the user on the selection screens. An input signal representing the content of the user's operation is supplied to the PC unit 301, and various settings are made.

The coin processing unit 321 detects the insertion of coins into the coin slot 73. When the coin processing unit 321 detects that a predetermined amount of coins has been inserted, it outputs a start signal to the PC unit 301 to instruct the start of the game.

The image capturing unit 304 performs image capturing processing on the user in the image capturing space A1. The image capturing unit 304 is composed of a lighting device 331, a camera 91, a touch panel monitor 92, and a speaker 332.

The lighting devices 331 are strobe units within the shooting space A1, and emit light according to lighting control signals supplied from the PC unit 301.

The camera 91 captures images according to shutter control by the PC unit 301, and outputs the captured image (image data) obtained by the capture to the PC unit 301.

Editing unit 305A realizes editing processing targeted at a user in editing space A2-1. Editing unit 305A is composed of tablet built-in monitor 131, touch pens 132A and 132B, and speaker 341. Editing unit 305B realizes editing processing targeted at a user in editing space A2-2, and has the same configuration as editing unit 305A. In the following, when there is no particular distinction between editing units 305A and 305B, they will simply be referred to as editing unit 305.

The tablet built-in monitor 131 displays an editing screen according to the control of the PC unit 301 and accepts operations on the editing screen by the user. An input signal representing the content of the user's operation is supplied to the PC unit 301, and the captured image to be edited is edited.

The printing section 306 is configured to include a printer 351. A sticker paper unit 352 is attached to the printer 351.

The printer 351 drives the built-in head 361 and prints an image on a roll of sticker paper 363 stored in the sticker paper unit 352 based on the print data supplied from the PC section 301. The printer 351 also cuts the sticker paper 363 with the image printed thereon at a predetermined cutting position using a cutter 362, and discharges it to a sticker paper outlet. As a printing medium, various media other than sticker paper that can be used on which photographs can be printed can be used.

<Functional configuration example>
Fig. 8 is a block diagram showing an example of a functional configuration of the photo sticker creating device 1. At least a part of the functional units shown in Fig. 8 is realized by the CPU 311 executing a predetermined program.

The control unit 401 is realized in the photo sticker creation device 1. The control unit 401 is composed of a pre-selection processing unit 411, a photography processing unit 412, an editing processing unit 413, a printing processing unit 414, and a transmission processing unit 415.

The pre-selection processing unit 411 executes pre-selection processing by controlling each unit of the pre-selection unit 302. The pre-selection processing selects the number of users, the photography course, and the like. Information indicating the selection made by the user is supplied to the photography processing unit 412.

The photography processing unit 412 performs photography processing by controlling each part of the photography unit 304. In the photography processing, for example, the photography course is changed and multiple photographed images, such as six photographed images, are taken. By changing the photography parameters and the parameters of the flash light during photography for each photography course, photographed images with different impressions are taken according to the photography course.

The shooting processing unit 412 outputs data of multiple captured images obtained by performing shooting processing to the editing processing unit 413. The captured image data output from the shooting processing unit 412 is supplied to each unit of the editing processing unit 413.

The editing processing unit 413 is composed of a display control unit 421, a sticker-only image generation unit 422, and a mobile-only image generation unit 423.

The editing processing unit 413 performs editing processing by controlling each part of the editing unit 305. The editing processing includes editing of captured images, printing of images on sticker paper, and sending of images to an external device, an image management server.

The editing process for a captured image is a process in which image processing corresponding to editing work performed using a tool selected by the user from pre-prepared tools, such as a pen tool or stamp tool, is applied to the captured image to be edited. By using the pen tool or stamp tool, a pen image or stamp image as an image to be combined is combined with the captured image to be edited.

Tools available for use in editing include not only tools for applying image processing to a portion of the captured image to be edited, but also filter tools for applying image processing to the entire captured image to be edited. The user selects the tool of their choice and selects the position on the captured image to be edited where the image processing will be applied, and then proceeds with the editing of the captured image.

In this way, the user edits the captured image using the touch pen 132 as if doodling on the captured image. Hereinafter, the editing process will be referred to as "doodle" where appropriate.

Two types of doodles are provided as doodles realized by the editing processing unit 413: doodles for stickers only and doodles for mobile phones only.

Sticker-only graffiti is graffiti used to create images to be printed on sticker paper. Images doodled with sticker-only graffiti are used to print on sticker paper. In other words, images doodled with sticker-only graffiti are images intended for printing only.

On the other hand, mobile-only graffiti is graffiti used to create images to be sent to the image management server. Images that have been doodled using mobile-only graffiti are used to send to the image management server. In other words, images that have been doodled using mobile-only graffiti are images that are only intended for sending.

Note that "print only" indicates that the image is intended for printing, out of the two possible uses, printing and sending. "Send only" indicates that the image is intended for printing, out of the two possible uses, printing and sending. Images intended for printing only are not used to send to an image server, and images intended for sending only are not used to print on sticker paper. In other words, images intended for printing only and images intended for sending only may be used for purposes other than printing and sending, such as for display on the screen of the tablet's built-in monitor 131.

As described above, the images sent to the image management server can be viewed or downloaded by the user on a mobile device such as a smartphone after the user has finished playing the game on the photo sticker creation device 1.

Such graffiti for stickers and graffiti for mobile phones are done using different graffiti screens, the graffiti screen for stickers and the graffiti screen for mobile phones, respectively. Details of each graffiti screen will be explained later.

The display control unit 421 of the editing processing unit 413 displays various screens, including a sticker-only graffiti screen and a mobile-only graffiti screen, on the tablet built-in monitor 131. The display control unit 421 controls the display of the screen in response to the user's operation.

The sticker-only image generating unit 422 applies image processing to the captured image of the doodle target in response to user operations on the sticker-only graffiti screen, to generate a sticker-only image. The sticker-only image is an image that has been doodled with sticker-only graffiti and is intended for printing only. The sticker-only image generating unit 422 outputs the sticker-only image generated by applying image processing to the print processing unit 414.

The mobile phone-only image generating unit 423 applies image processing to the captured image of the graffiti target in response to a user's operation on the mobile phone-only graffiti screen, to generate a mobile phone-only image. The mobile phone-only image is an image that has been graffitied with mobile phone-only graffiti and is intended for transmission only. The mobile phone-only image generating unit 423 outputs the mobile phone-only image generated by applying image processing to the transmission processing unit 415.

The print processing unit 414 outputs the print data to the printer 351 and prints the sticker-specific image on the sticker paper.

The transmission processing unit 415 controls the communication unit 317 to communicate with the image management server and transmit (upload) the mobile-only images to the image management server.

<<Operation of the photo sticker creation device>>
<Photo sticker creation game>
Here, the operation of the photograph sticker creating device 1 that provides the photograph sticker creating game will be described with reference to the flow chart of FIG.

In step S1, the pre-selection processing unit 411 determines whether a predetermined amount of coins has been inserted, and waits until it determines that coins have been inserted.

If it is determined in step S1 that a coin has been inserted, in step S2, the pre-selection processing unit 411 performs pre-selection processing, including selection of the number of users and selection of the photography course.

In step S3, the image capture processing unit 412 controls the image capture unit 304 to perform image capture processing. Specifically, the image capture processing unit 412 displays the moving image captured by the camera 91 on the touch panel monitor 92 in a live view. The image capture processing unit 412 also captures the user in the image capture space A1 as a subject and generates a captured image.

For example, a close-up image showing the user's face and upper body, and a full-body image showing the entire body are captured. When multiple captured images including close-up images and full-body images have been captured, the capture process ends.

In step S4, the editing processing unit 413 performs editing processing by controlling the editing unit 305 corresponding to either the editing space A2-1 or the editing space A2-2, whichever is the destination of the user who has completed the shooting process.

<Editing process details>
Next, the editing process performed in step S4 in FIG. 9 will be described with reference to the flowchart in FIG.

In step S11, the display control unit 421 of the editing processing unit 413 displays the address input screen on the tablet built-in monitor 131.

The address input screen is a screen used to input the user's email address. The address input screen displays a software keyboard and other items, and is used to input the email address.

The email address entered here is uploaded to the image management server together with the mobile-only image, and is used to notify the user by email from the image management server of the URL where the mobile-only image is saved. For example, the user can display the mobile-only image created in the game on the photo sticker creation device 1 on the screen of their mobile device by tapping the URL notified by email.

In step S12, the display control unit 421 displays a sticker graffiti image selection screen on the tablet built-in monitor 131. The sticker graffiti image is a captured image to be used for sticker-specific graffiti.

By using the image selection screen for sticker graffiti, a predetermined number of captured images are selected as images for sticker graffiti from among the multiple captured images obtained by the photographing process.

Figure 11 shows an example of the image selection screen for sticker doodles.

On the sticker doodling image selection screen, photographed images P1 to P6, which represent six photographed images obtained by the photographing process, are displayed side by side. The two people appearing in photographed images P1 to P6 are the two users playing the game using the photo sticker creation device 1.

A message is displayed above the captured images P1 to P6, instructing the user to select two captured images as images for sticker doodles. In this example, it is possible to select two captured images from the six captured images as images for sticker doodles.

The captured images P1 to P6 are each displayed with a border of an edge image P11, which is an image of a predetermined design that includes text such as the model name of the photo sticker creation device 1. The sticker-specific image created by the sticker-specific graffiti includes an edge image. The combination of the captured images P1 to P6 and the edge image P11 represents the image of the sticker paper that the user can ultimately obtain.

The user presses a specific image using the touch pen 132 to select an image for sticker doodles. In the example of FIG. 11, photographed image P3 is selected by a user standing on the left side of the tablet's built-in monitor 131, and photographed image P5 is selected by a user standing on the right side. Photographed images P3 and P5 are displayed grayed out along with their respective border images P11. For example, when two users have selected one photographed image each and the confirm button is pressed, the selection of images for sticker doodles is completed.

When the selection of the image for the sticker graffiti is completed, in step S13 of FIG. 10, the display control unit 421 displays a sticker-only graffiti screen on the tablet built-in monitor 131. That is, in this example, of the two types of graffiti, sticker-only graffiti and mobile-only graffiti, the sticker-only graffiti is performed first.

Figure 12 shows an example of the sticker-only doodling screen.

A flow display showing the progress of the game is provided at the top of the sticker-only graffiti screen. In the example of Figure 12, the words "sticker graffiti" are highlighted with an underline and symbols, indicating that the current situation is a sticker-only graffiti situation. The flow display allows the user to understand the flow of the game during the editing process and the current situation.

A graffiti input area 511L is formed on the left side of the sticker-only graffiti screen, and a graffiti input area 511R is formed on the right side. The graffiti input areas 511L and 511R are areas where the captured image selected as the image for sticker graffiti is displayed as the target for graffiti.

In the example of FIG. 12, a captured image P3 selected by a user standing on the left side as an image for sticker graffiti is displayed in the graffiti input area 511L. Also, a captured image P5 selected by a user standing on the right side as an image for sticker graffiti is displayed in the graffiti input area 511R.

A user standing on the left side will doodle on captured image P3 displayed in doodle input area 511L, and a user standing on the right side will doodle on captured image P5 displayed in doodle input area 511R.

To the right of the graffiti input area 511L is a tool area 512L in which a button to be pressed to select the eraser tool, a button to be pressed to reset (initialize) the graffiti, and the like are arranged.

To the left of the graffiti input area 511L, semicircular tool tabs 513-1L to 513-5L are displayed along the left edge of the screen, which can be pressed to select various tools (doodle tools).

Tool tab 513-1L is a tab that is pressed when selecting a filter tool, and tool tab 513-2L is a tab that is pressed when selecting a pen tool. Tool tab 513-3L is a tab that is pressed when selecting a stamp tool, and tool tab 513-4L is a tab that is pressed when selecting a texture tool. Tool tab 513-5L is a tab that is pressed when selecting a sticker color tool. For example, the sticker color tool is used when selecting a design for an edge image.

On the other hand, to the left of the doodle input area 511R, there is provided a tool area 512R in which the same buttons as those displayed in the tool area 512L are lined up. Also, to the right of the doodle input area 511R, along the right edge of the screen, semicircular tool tabs 513-1R to 513-5R, which have the same functions as the tool tabs 513-1L to 513-5L, are lined up.

On the sticker-only doodling screen, at least tool tabs 513-1L to 513-5L and tool tabs 513-1R to 513-5R, which can be pressed as buttons to select various tools, are displayed symmetrically on the left and right edges of the screen.

For example, if a user standing on the left side presses tool tab 513-3L and a user standing on the right side presses tool tab 513-2R, the respective tabs will be displayed extending toward the center of the screen, as shown in FIG. 13.

A horizontally long, strip-shaped tool tab 513-3L is displayed over the graffiti input area 511L, and displays a number of buttons, each representing a different stamp image. When a specific button is pressed from among the buttons displayed on the tool tab 513-3L, the stamp tool is selected, and the display of the tool tab 513-3L returns to the state shown in FIG. 12.

On the other hand, multiple buttons each representing a different pen image are displayed side by side on tool tab 513-2R, which is a horizontal strip displayed over doodle input area 511R. When a specific button is pressed from among the buttons displayed on tool tab 513-2R, the pen tool is selected, and the display of tool tab 513-2R returns to the state shown in FIG. 12.

Similarly, when another tab is pressed, the pressed tab will extend towards the center of the screen and multiple buttons will be displayed on the extended tab.

In this way, by making the buttons used to select tools appear only when a tab is pressed, the display control unit 421 is able to display the graffiti input areas 511L and 511R in a larger size.

By displaying the graffiti input areas 511L, 511R large, each user can carefully doodle on the one captured image that they have selected as the image for sticker doodles, paying attention to even the smallest details. Also, because there is only one image for sticker doodles, the user can concentrate on that one image when doodling.

A plurality of captured images may be selected as images for doodling on stickers. In this case, similar to the mobile phone-only doodling screen described later with reference to FIG. 18 etc., thumbnail images used to select the captured images to doodling on are displayed, for example, in the center of the sticker-only screen. In response to the selection of a thumbnail image, the captured images to doodling on are switched.

Figure 14 shows an enlarged view of the graffiti input area 511L.

In the graffiti input area 511L, the photographed image P3 selected as the image for the sticker graffiti is displayed bordered with an edge image P11, which is an image of a predetermined design including characters such as the model name of the photo sticker creation device 1. As described with reference to FIG. 11, the sticker-specific image created by the sticker-specific graffiti also includes an edge image that represents the design of the edge of the sticker paper.

In this way, the photographed image P3 is displayed in the graffiti input area 511L, which is the input destination for sticker-specific graffiti, along with an edge image P11 that represents the edge design of the sticker paper, which is the print medium. Because the photographed image is displayed as printed on the sticker paper, the user can doodle while imagining the finished product. The display in the graffiti input area 511R is similar, except that the photographed image that is the subject of the doodle is different.

Figure 15 shows an example of graffiti input.

For example, when the stamp tool is selected as described with reference to FIG. 13 etc. and an input position is specified in the graffiti input area 511L, a stamp image is superimposed on the captured image displayed in the graffiti input area 511L as shown in FIG. 15.

In the example of FIG. 15, stamp image 521 is superimposed on the user appearing on the left side, and stamp image 522 is superimposed on the user appearing on the right side. In addition, stamp image 523 with a heart pattern is superimposed so as to straddle photographed image P3 and border image P11.

In this way, the entire graffiti input area 511L is the target for inputting graffiti. The user can input graffiti not only on the photographed image P3 on which the graffiti is to be drawn, but also on the border image P11 displayed around the photographed image P3. Using this display, graffiti can be created specifically for stickers.

In step S14 of FIG. 10, the sticker-specific image generation unit 422 performs image processing on the captured image of the graffiti target in response to an operation by the user, and generates a sticker-specific image. For example, when a preset time limit has elapsed, the sticker-specific graffiti ends.

When the sticker-specific doodling is finished, in step S15, the display control unit 421 causes the tablet built-in monitor 131 to display a sticker layout selection screen.

The sticker layout selection screen is a screen used to select a sticker layout. A sticker layout is a layout (arrangement pattern) that specifies the position and size of the captured image to be placed on the sticker sheet, as well as the overall design of the sticker sheet.

Figure 16 shows an example of the sticker layout selection screen.

Images P101 and P102, which represent doodled images, are displayed on the left side of the sticker layout selection screen. Images P101 and P102 are images that represent sticker-specific images created using sticker-specific doodle. Images P101 and P102 also display stamp images that have been input using sticker-specific doodle.

On the right side of the sticker layout selection screen, images P111 to P114 are displayed, which show two photographed images selected as images for sticker doodling arranged in a specified layout. For example, image P111 is a layout in which two photographed images selected as images for sticker doodling are printed on one piece of sticker paper. Note that the photographed images that make up images P111 to P114 do not reflect the doodling input using sticker-only doodling.

In the example of FIG. 16, two sticker layouts to be actually printed can be selected from six sticker layouts. For example, if two users each select one sticker layout and then press the confirm button, the sticker layout selection is complete.

When the sticker layout selection is complete, in step S16 of FIG. 10, the print processing unit 414 starts printing the sticker-specific image.

After printing of the sticker-specific image has started, in step S17, the display control unit 421 displays the mobile phone-specific graffiti screen on the tablet built-in monitor 131. That is, while printing of the sticker-specific image is being performed, the user starts mobile phone-specific graffiti.

Note that the selection of the captured image to be doodled on, as is the case with sticker-only doodling, is not performed before cell phone-only doodling. Cell phone-only doodling is performed with all six captured images obtained by the photography process as the subject of doodling.

Figure 17 shows the state when the mobile-only graffiti screen starts to be displayed.

In the flow display at the top of the mobile phone-only graffiti screen, the words "Mobile phone graffiti" are highlighted, indicating that the current situation is a mobile phone-only graffiti situation.

When the mobile-only graffiti screen starts to be displayed, the graffiti input area 551L formed on the left side of the screen and the graffiti input area 551R formed on the right side of the screen each display a photographed image on which graffiti has been applied using the sticker-only graffiti function. In the example of FIG. 17, photographed image P3 and photographed image P5, which have been selected as images for sticker graffiti and on which graffiti has been applied, are displayed.

In addition, a button used to select whether to turn sticker graffiti on or off is displayed in speech bubble 561L on the left side of graffiti input area 551L. Similarly, a button used to select whether to turn sticker graffiti on or off is displayed in speech bubble 561R on the right side of graffiti input area 551R. A message is displayed in speech bubbles 561L and 561R, guiding the user to select whether or not to keep sticker-only graffiti.

In other words, the contents of the sticker-only graffiti can be reflected in the mobile-only graffiti. When sticker graffiti on is selected, mobile-only graffiti is started with graffiti of the same content as the sticker-only graffiti entered into the same captured image as the captured image used for the sticker-only graffiti. The mobile-only image generation unit 423 applies image processing to one of the six captured images to be graffitied, which was used for the sticker-only graffiti, to generate a mobile-only image with graffiti of the same content as the sticker-only graffiti.

As described above, in sticker-only graffiti, it is possible to input graffiti over the entire area of the captured image and border image displayed in the graffiti input area. When sticker graffiti on is selected, for example, only graffiti of the captured image and border image that has the same content as the graffiti input on the captured image is reflected. The content of the graffiti input on the border image may also be reflected.

After sticker graffiti on/off is selected, the display of the mobile-only graffiti screen will switch to the display shown in Figure 18.

As shown in FIG. 18, the mobile-only graffiti screen is basically configured with each display being symmetrically arranged on either side of the central thumbnail display area 553. The left area is used by a user standing on the left side of the tablet-built-in monitor 131. The right area is used by a user standing on the right side of the tablet-built-in monitor 131.

Note that the dashed rectangular lines surrounding each area on the mobile-only graffiti screen shown in Figure 18 are not actually displayed on the screen.

The thumbnail display area 553 located in the center of the mobile-only graffiti screen is a display area for thumbnail images that represent captured images. The user uses the thumbnail images displayed in the thumbnail display area 553 to select the captured image on which to doodle.

Thumbnail images representing six captured images are displayed side by side in the thumbnail display area 553. In the example of FIG. 18, the top left thumbnail image is selected by a user standing on the left, and the top right thumbnail image is selected by a user standing on the right. The top left thumbnail image represents the first captured image P1, and the top right thumbnail image represents the fourth captured image P4.

A doodle input area 551L is provided approximately in the center of the left-hand area. The doodle input area 551L is a display area for the captured image that is selected using the thumbnail image and is to be doodled on. The user can select a tool using the touch pen 132A and edit the captured image P1 displayed in the doodle input area 551L.

As shown in FIG. 18, only the photographed image of the subject to be doodled is displayed in the doodle input area 551L of the mobile-only doodle screen. In other words, unlike the sticker-only doodle screen, the photographed image of the subject to be doodled is displayed without any border image.

To the right of the graffiti input area 551L is a tool area 552L containing an array of buttons, such as a button to be pressed to select the eraser tool and a button to be pressed to reset the graffiti.

A palette area 554L is provided below the graffiti input area 551L. The palette area 554L is an area that displays buttons and the like used to select various tools to be combined with the captured image displayed in the graffiti input area 551L.

To the right of palette area 554L is tab area 555, an area in which tabs used to select tool categories are displayed. The user can use these tabs to switch between tools displayed in palette area 554L.

To the left of the doodle input area 551L, a status image 556L is displayed that indicates the printing status of the sticker-specific image. The display of the status image 556L changes, for example, depending on the printing status of the sticker-specific image, so that the sticker-specific image gradually appears.

On the status image 556L, information such as "xx%" is displayed, which indicates the progress of printing the sticker-specific image. For example, when printing of the sticker-specific image is completed, the progress is displayed as 100%.

Figure 19 shows an example of sticker paper with a sticker-specific image printed on it.

When printing of the sticker-specific image is complete, sticker paper s1 and sticker paper s2 with the sticker-specific image printed thereon as shown in FIG. 19 are discharged to sticker paper outlet 133 (FIG. 6). The image printed on sticker paper s1 is an image generated as a sticker-specific image by combining doodled captured image P3 and border image P11. The image printed on sticker paper s2 is an image generated as a sticker-specific image by combining doodled captured image P5 and border image P11.

The user can then remove these sticker sheets s1 and s2 from the sticker sheet outlet 133 and continue doodling on their mobile device.

Returning to the explanation of FIG. 18, the user uses a mobile phone-only doodle screen, which has a different screen configuration from the sticker-only doodle screen described above, to perform mobile phone-only doodles on each of the six captured images. At least some of the tools provided on the sticker-only doodle screen and those provided on the mobile phone-only doodle screen are different.

In addition, in the right-hand area used by a user standing on the right side of the tablet built-in monitor 131, the same configuration as the left-hand area described above is arranged in a symmetrical position.

In step S18 of FIG. 10, the mobile phone-only image generation unit 423 performs image processing on the captured image of the graffiti target in response to an operation by the user, and generates a mobile phone-only image. For example, when a preset time limit has elapsed, the mobile phone-only graffiti ends. Because there are a large number of captured images to be graffitied, the time limit for the mobile phone-only graffiti is set to be longer than the time limit for the sticker-only graffiti.

When the mobile phone-only graffiti is finished, in step S19, the display control unit 421 displays an image selection screen on the tablet built-in monitor 131. The image selection screen displayed here is a screen used to select one mobile phone-only image from the six mobile phone-only images that have been doodled with the mobile phone-only graffiti.

Of the six mobile-only images uploaded to the image management server, one selected using the image selection screen is provided to the user who is a free member. The image provision service provided by the image management server is a membership-based service that allows users to view images on their mobile terminals and download images to their mobile terminals.

A free member can view one mobile-only image. On the other hand, a paid member can view all mobile-only images.

When the selection of the mobile-only image is completed, in step S20, the transmission processing unit 415 transmits the mobile-only image to the image management server.

Figure 20 shows an example of information uploaded from the photo sticker creation device 1.

As shown in FIG. 20, management information is added to the image files of the six mobile-only images before they are uploaded. The management information is generated in the photo sticker creation device 1 to manage the uploaded images, and is transmitted to the image management server 601. In the image management server 601, the uploaded images are managed in association with each piece of information included in the management information.

The management information includes the sticker ID, image selection flag, and email address.

The sticker ID is an ID issued by the photo sticker creation device 1 in accordance with predetermined rules for each game. For example, the sticker ID is notified to the user by being printed on the edge of sticker paper on which a sticker-specific image is printed. When a user of a mobile terminal who has logged in to the image providing service (a user who has played a game on the photo sticker creation device 1) looks at the edge of the sticker paper and enters the sticker ID, the image management server 601 identifies the image the user created in the game. In this way, the sticker ID is used to identify images created by each user.

The image selection flag is a flag that indicates the mobile-only image selected by the user during the game using the image selection screen.

The email address is the email address entered by the user during the game.

A photo creation game consisting of the above-mentioned series of processes is provided to each group of users of the photo sticker creation device 1.

Through this series of processes, users can use different graffiti screens to perform graffiti for stickers and for mobile phones, and create graffitied images suited to each purpose.

By providing a separate doodling screen for each purpose, users can intuitively understand what they should do using each doodling screen, enabling them to doodling efficiently.

If it were possible to doodle for images for mobile phones on a sticker-only doodle screen, the structure of the doodle screen would become complicated and the operation would become unintuitive, but it is possible to prevent this from happening.

<<Modifications>>
Of the two types of graffiti, the sticker-only graffiti and the mobile phone-only graffiti, the sticker-only graffiti is performed first in the above embodiment, but the mobile phone-only graffiti may be performed first.

Although the number of captured images to be used for graffiti only on mobile phones is set to be greater than the number of captured images to be used for graffiti only on stickers, the number of captured images to be used for graffiti only on stickers may be set to be greater. In this case, the time limit for graffiti only on stickers is set to be longer than the time limit for graffiti only on mobile phones.

The number of photographed images that are the subject of sticker-only graffiti and the number of photographed images that are the subject of mobile-only graffiti may be the same.

The above-mentioned series of processes can be executed by hardware or software. When executing the series of processes by software, the programs that make up the software are installed on a computer that is built into dedicated hardware, or on a general-purpose personal computer.

The program to be installed is provided by being recorded on removable media 319, such as an optical disk (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.) or semiconductor memory. It may also be provided via a wired or wireless transmission medium, such as a local area network, the Internet, or digital broadcasting. The program can be pre-installed in ROM 312 or storage unit 316.

The program executed by the computer may be a program in which processing is performed chronologically in the order described in this specification, or a program in which processing is performed in parallel or at the required timing, such as when called.

1 Photo sticker creation device, 131 Tablet built-in monitor, 301 PC section, 302 Pre-selection section, 304 Photography section, 305 Editing section, 306 Printing section, 401 Control section, 411 Pre-selection processing section, 412 Photography processing section, 413 Editing processing section, 414 Printing processing section, 415 Transmission processing section, 421 Display control section, 422 Sticker dedicated image generation section, 423 Mobile dedicated image generation section

Claims (10)

An image processing device comprising: a display control unit that displays, as editing screens used for editing a captured image, a first editing screen used for editing the captured image exclusively for printing, in which the captured image to be edited is displayed in an editing input area together with an edge image representing the edge of a print medium , and a second editing screen used for editing the captured image exclusively for sending to an external device, in which the captured image to be edited is displayed in the editing input area without the edge image, as editing screens used for editing the captured image exclusively for printing , The image processing apparatus according to claim 1 , further comprising a print-only image generating unit that edits the captured image to be edited in response to an input for the region of the border image, and generates the captured image exclusively for printing. The image processing device according to claim 1 , wherein the display control unit displays the first editing screen on which buttons having the same functions operated by a user are arranged symmetrically on the left and right. 4. The image processing device according to claim 1, 2 or 3, wherein the display control unit causes a layout selection screen used to select a layout of the captured image on a print medium to be displayed after editing has been performed using the first editing screen , and causes the display control unit to cause the second editing screen to be displayed after the layout selection has been performed. a print processing unit that prints the captured image that has been edited using the first editing screen on a print medium;
The image processing device according to claim 4 , wherein the display control unit displays the second editing screen in parallel with printing the captured image. The image processing device according to claim 4 or 5, wherein the display control unit causes an image representing an image to be printed to be displayed on the layout selection screen, the image being the same as the combination of the captured image and the border image displayed in the editing input area of the first editing screen. 3. The image processing device according to claim 2, further comprising a transmission-only image generation unit that applies editing to the captured image that is the same as the captured image that has been edited using the first editing screen in the same way as the editing performed using the first editing screen, and generates the captured image that is dedicated to transmission. The image processing device according to claim 7 , wherein the display control unit causes the second editing screen to display a button used for selecting whether or not to apply the same editing content to the captured image dedicated for transmission. The image processing device
An image processing method that displays, as editing screens for editing a captured image, a first editing screen that is used for editing the captured image for printing only, in which the captured image to be edited is displayed in an editing input area together with an edge image representing the edge of a print medium , and a second editing screen that is used for editing the captured image for transmission only to an external device , in which the captured image to be edited is displayed in an editing input area without the edge image . On the computer,
As editing screens used for editing the photographed image, a first editing screen is displayed, which is used for editing the photographed image dedicated to printing, and in which the photographed image to be edited is displayed in an editing input area together with an edge image representing the edge of a print medium, and a second editing screen is displayed, which is used for editing the photographed image dedicated to transmission to an external device, and in which the photographed image to be edited is displayed in an editing input area without the edge image.
A program for executing a process.

Images