JP2021137370A - Printing equipment, terminal equipment, printing systems, printing methods and programs - Google Patents

Abstract

[Problem] To provide a printing device, a terminal device, a printing system, a printing method, and a program that can print on nails with an imaged finish. [Solution] A printing system 100 includes an image capture control unit 312 as a nail image capture means that captures an image of the nail T, a nail shape detection unit 313 that detects the nail shape from the image of the nail T, a display control unit 812 that sets a focus frame F when capturing an image according to the nail shape, a display unit 72 that displays the focus frame F, an image capture unit 73 that captures an image with the focus frame F displayed on the display unit 72, an image processing unit 814 that crops the image captured by the image capture unit 73 to fit the focus frame F and generates a cropped image FI, and a printing unit 40 that performs printing on the nail T based on the cropped image FI. [Selected Figure] Figure 3

Description

The present invention relates to a printing device, a terminal device, a printing system, a printing method and a program.

Conventionally, a printing device (nail printing device) for printing a nail design on a nail or the like is known. With such a device, it is possible to express designs such as photographs and complicated patterns that are difficult to create by hand with nail art.

When printing on nails using a printing device (nail printing device), match the nail design you want to print to the shape of the nail, adjust so that the elemental part of the design fits within the area of the nail, and print. (See, for example, Patent Document 1).

For example, when printing a photo on a nail using a printing device (nail printing device), the print data is printed by reading the photo data in the printing device and then appropriately scaling the data according to the shape of the nail. Generate.

Japanese Unexamined Patent Publication No. 2016-10570

However, although the size and shape of the nail varies from person to person, it is difficult to accurately grasp the shape of the nail at the time of taking a photograph.
For this reason, the composition of the original photograph may not match the shape of the nail, and even if it is later adjusted to the shape of the nail, the desired design may not be obtained. In this case, there is a problem that it is necessary to change the composition of the photograph and take the picture again.

The present invention has been made in view of the above circumstances, and has an advantage of providing a printing device, a terminal device, a printing system, a printing method and a program capable of printing a finish as imagined on a nail. Is what you do.

In order to solve the above problems, the printing apparatus according to one aspect of the present invention is
Nail image acquisition means to acquire nail images and
A nail shape detecting means for detecting a nail shape from the image of the nail,
A transmission means for transmitting the claw shape to an external device,
A cutout image acquisition means for acquiring a cutout image corresponding to the nail shape from the external device,
A printing means for printing based on the cutout image and
It is characterized by having.

According to the present invention, there is an effect that the nail can be printed with a finish as imagined.

It is a perspective view which shows the main part structure of the printing system in this embodiment. It is a block diagram of a main part which showed the control structure of the printing system in this embodiment. It is a flowchart which shows the printing process which concerns on this Embodiment. It is a figure shown in one screen example of a nail shape selection screen. It is a figure which shows an example of a shooting screen. It is a figure which shows the image which fits the cut-out image to the nail. It is a figure which shows the example of the case where the cut-out image is printed on the nail. It is a figure which shows one transformation example of a shooting screen. It is a figure which shows one transformation example of a shooting screen. It is a figure which shows one transformation example of a shooting screen. It is a figure which shows one transformation example of a shooting screen. It is a flowchart which shows one modification of the printing process.

An embodiment of a printing device, a terminal device, and a printing system including these according to the present invention will be described with reference to FIGS. 1 to 7.
Although various technically preferable limitations for carrying out the present invention are attached to the embodiments described below, the scope of the present invention is not limited to the following embodiments and illustrated examples.
Further, in the following embodiment, a case where the printing device is a nail printing device that prints on the fingernail of the hand as a printing target will be described as an example, but the printing target of the printing device in the present invention is the fingernail of the hand. The printing target is not limited to nails, and for example, toenails and the like may be printed. In addition, nail-like objects other than human nails, such as the surface of nail tips and various accessories, may be printed.

FIG. 1 is a diagram showing a main part configuration of a printing system including a printing device and a terminal device according to the present embodiment, and FIG. 2 is a block diagram showing a main part control configuration of the printing system.
In the following embodiments, up / down, left / right, and front / back refer to the directions shown in FIG. Further, the X direction and the Y direction refer to the directions shown in FIG.
As shown in FIGS. 1 and 2, the printing system 100 in this embodiment includes a printing device 1 and a terminal device 7.

The printing device 1 of the present embodiment is a nail printing device that prints on the fingernail T.
As shown in FIG. 1, the printing apparatus 1 has, for example, a housing 2 formed in a substantially box shape and having an opening 22 on the front side of the apparatus.
An operation unit 12 of the printing device 1 is provided on the upper surface (top plate) of the housing 2. The operation unit 12 is, for example, an operation button (power switch button) for turning on / off the power of the printing device 1. When the operation unit 12 is operated, an operation signal is output to the control device 30, and the control device 30 controls according to the operation signal to operate each part of the printing device 1. For example, when the operation unit 12 is a power switch button, the power of the printing device 1 is turned ON / OFF according to the button operation.
Instead of the operation unit 12, each unit of the printing device 1 may operate according to an operation signal input from the operation unit 71 of the terminal device 7 described later.

The device main body 10 is housed inside the housing 2.
The apparatus main body 10 includes a base 11, a finger holding unit 6, a printing unit 40, a photographing unit 50, and the like attached to the base 11.
The finger holding portion 6 holds the finger U having the claw T to be printed in an area suitable for printing. A window portion 63 for exposing the nail to be printed is formed on the top surface of the finger holding portion 6.
The printing unit 40 is a printing means that prints on the nail T to be printed according to the print data generated by the image processing unit 814 (see FIG. 2) of the terminal device 7 described later.
The printing unit 40 includes a printing head 41 that performs a printing operation and a head moving mechanism 49 (see FIG. 2) for moving the printing head 41.

The printing head 41 of the present embodiment has an ink ejection surface (none of which is shown) having a plurality of nozzle ports for ejecting ink on the surface facing the claw surface, and atomizes the ink to eject the ink. This is an inkjet head of an inkjet type that prints by directly spraying ink from the surface onto the surface of the claw, which is the surface to be printed of the object to be printed (claw T). The configuration of the print head 41 is not particularly limited, but is, for example, a cartridge-integrated head in which an ejection mechanism such as an ink ejection surface and an ink cartridge (neither of them is shown) are integrated.
The print head 41 can eject, for example, yellow (Y; YELLOW), magenta (M; MAGENTA), and cyan (C; CYAN) inks. The type of ink provided in the print head 41 is not limited to this. The print head 41 of the present embodiment can print a detailed image such as a photograph on the nail.

The head moving mechanism 49 includes an X-direction moving motor 46 for moving the print head 41 in the left-right direction (X direction) of the device and a Y-direction moving motor for moving the print head 41 in the front-rear direction (Y direction) of the device. 48 is included, and the print head 41 is moved in the left-right direction (X direction) of the device and the front-rear direction (Y direction) of the device by appropriately driving the X-direction moving motor 46 and the Y-direction moving motor 48.

The operations of the X-direction moving motor 46, the Y-direction moving motor 48, and the print head 41 (the discharge mechanism portion of the print head 41) of the head moving mechanism 49 are controlled by the print control unit 314 (see FIG. 2) of the control device 30.

Further, a claw T (finger U including the claw T) placed on the finger holding portion 6 is photographed at a position above the finger holding portion 6 on the inside of the upper surface (top plate) of the housing 2. An imaging unit 50 for acquiring an image of the nail T (an image of a finger U including the nail T, hereinafter referred to as a “nail image”) is provided.
The photographing unit 50 includes, for example, a photographing device 51 such as a camera and a lighting device 52 composed of a white LED or the like that illuminates the nail T to be photographed (see FIG. 2).
The operation of the photographing unit 50 is controlled by the photographing control unit 312 (see FIG. 2) of the control device 30 described later.
The nail image captured by the imaging device 51 is acquired by the imaging control unit 312.
The image data of the image taken by the photographing unit 50 may be stored in the storage unit 32 described later.

The control device 30 is mounted on, for example, a substrate (not shown) arranged inside (lower surface side) of the upper surface (top plate) of the housing 2.
As shown in FIG. 2, the control device 30 is a storage unit composed of a control unit 31 composed of a processor such as a CPU (Central Processing Unit), a ROM 321 (Read Only Memory), a RAM 322 (Random Access Memory), and the like. It is a computer including 32.

Various data such as various programs for operating the printing device 1 and claw shape data are stored in the storage unit 32.
Specifically, various programs such as a print program for performing printing processing are stored in the storage unit 32, and the control unit 31 expands these programs into, for example, a work area of RAM, and the program controls them. By executing the operation in the unit 31, each unit of the printing apparatus 1 is controlled in an integrated manner.
Further, the storage unit 32 may store data such as a nail image acquired by the photographing unit 50.

From a functional point of view, the control unit 31 includes a communication control unit 311, an imaging control unit 312, a claw shape detection unit 313, a print control unit 314, and the like. The functions as the communication control unit 311, the imaging control unit 312, the claw shape detection unit 313, the print control unit 314, etc. are realized by the cooperation between the control unit 31 and the program stored in the ROM 321 of the storage unit 32. ..

The communication control unit 311 controls the operation of the communication unit 13.
The communication unit 13 includes a wireless communication module or the like capable of communicating with the communication unit 74 of the terminal device 7, and the communication control unit 311 transmits and receives various data and the like between the printing device 1 and the terminal device 7. At the time, the operation of the communication unit 13 is controlled.
The printing device 1 of the present embodiment prints a nail design in cooperation with a terminal device 7 described later. For example, when a nail image is acquired by the photographing unit 50 and the nail shape is detected by the nail shape detecting unit 313 described later, the nail image and the nail shape data are sent to the terminal device 7 via the communication unit 13.
Further, in the present embodiment, print data is generated in the image processing unit 814 on the terminal device 7 side as described later. The print data generated on the terminal device 7 side is sent to the printing device 1 via the communication unit 74 of the terminal device 7. The print data sent from the terminal device 7 side is received by the communication unit 13, and the communication control unit 311 appropriately controls the communication by the communication unit 13 to control the transmission and reception of such data.

Communication between the printing device 1 and the terminal device 7 may use a network line such as the Internet, or wirelessly based on a short-range wireless communication standard such as Bluetooth (registered trademark) or Wi-Fi. It may be one that communicates. When communicating via a network, any line may be used as the network used for communication. Further, the communication between the printing device 1 and the terminal device 7 is not limited to wireless, and various data may be transmitted / received between the two by a wired connection.
The communication unit 13 may be any as long as it can communicate with the terminal device 7, and a communication unit 13 that matches the communication standard of the communication unit 74 of the terminal device 7 is applied.

The photographing control unit 312 controls the photographing device 51 and the lighting device 52 of the photographing unit 50, and the image of the finger U (claw) including the image of the finger U's claw T placed on the finger holding unit 6 by the photographing device 51. Image) is taken.
The image (nail image) of the nail T acquired by the photographing unit 50 is sent to the photographing control unit 312. The photographing control unit 312 functions as a nail image acquisition means for acquiring such a nail image (data of an image of the nail T). The photographing control unit 312 may store the nail image in the storage unit 32.

The nail shape detecting unit 313 is a nail shape detecting means for detecting the nail shape from the image of the nail T (claw image). The nail shape is, for example, contour information that defines a nail region, and is represented by coordinates on the XY plane.
The method by which the claw shape detecting unit 313 detects the claw shape is not particularly limited. The nail shape detection unit 313 detects the nail shape by observing, for example, a color difference (including a difference in brightness, a difference in brightness, etc.) between the nail region and a region such as skin around the nail region.
Information such as the claw shape acquired by the claw shape detecting unit 313 is stored in the storage unit 32.

The information detected by the claw shape detection unit 313 is not limited to this.
The information detected by the claw shape detecting unit 313 may include, for example, the inclination angle of the surface of the claw T with respect to the XY plane (inclination angle of the claw T, claw curvature) and the like. Further, the height of the claw T (the position in the vertical direction of the claw T) may be detected from an image or the like taken by the photographing device 51.

The print control unit 314 controls the print unit 40 so as to print on the claw T according to the print data. In the present embodiment, the printing operation is performed according to the printing data generated by the image processing unit 814 of the terminal device 7.
Specifically, the print control unit 314 outputs a control signal to the print unit 40 based on the print data, and the X-direction moving motor of the print unit 40 prints according to the print data on the claw T. 46, Y-direction moving motor 48, print head 41, etc. are controlled.

Further, as described above, the printing device 1 of the present embodiment prints on the nail T in cooperation with the terminal device 7.
The terminal device 7 is a mobile terminal device having a photographing function, such as a smartphone. The terminal device 7 is not limited to a smartphone. For example, a tablet-type personal computer (hereinafter referred to as "PC"), a terminal device for games, and a camera having a communication function and capable of communicating with the printing device 1 (for example, a compact digital camera or a digital single-lens reflex camera). ) Etc. may be used.
As shown in FIG. 2, the terminal device 7 includes an operation unit 71, a display unit 72, a photographing unit 73, a communication unit 74, a control device 80, and the like.

The operation unit 71 can perform various inputs, settings, and the like according to the user's operation. For example, the operation unit 71 is a touch panel integrally provided on the surface of the display unit 72. When the operation unit 71 is operated, an input signal corresponding to the operation is transmitted to the control unit 81.
The touch panel configured on the display unit 72 displays various operation screens according to the control of the display control unit 812, which will be described later, and the user can perform various input / setting operations by touching the touch panel. ..
The operation unit 71 that performs operations such as various inputs and settings is not limited to the case of a touch panel. For example, various operation buttons, pointing devices, and the like may be provided as the operation unit 71.

In the present embodiment, the user can operate the shutter operation of the photographing unit 73 by operating the operation unit 71. The operation for performing the shutter operation may be performed by an operation button or by a touch operation on the touch panel.
Further, by operating the operation unit 71, various instructions such as starting printing may be output from the terminal device 7 to the printing device 1. In this case, the operation unit 71 of the terminal device 7 may output the printing device 1. It also functions as an operation unit.

The display unit 72 is composed of, for example, a liquid crystal display (LCD), an organic electroluminescence display, or a flat display.
As described above, a touch panel for performing various inputs may be integrally configured on the surface of the display unit 72. In this case, the touch panel functions as the operation unit 71.

In the present embodiment, the display unit 72 also functions as a monitor when the photographing unit 73 performs a photographing operation. In particular, in the present embodiment, during the shooting operation by the shooting unit 73, the focus frame (shooting auxiliary frame) F for indicating the portion to be focused at the time of shooting is displayed on the display screen of the display unit 72. It has become. The photographing unit 73 is adjusted so that the focus is optimized within the range of the focus frame F, and in the present embodiment, the focus frame F at the time of photographing is set according to the shape of the nail. (See Fig. 5 etc.).
The shape, size, and the like of the focus frame F are stored in a storage unit 82 (data storage area 822, etc.) of the control device 80, which will be described later, and are appropriately displayed on the display unit 72 under the control of the display control unit 812.
Further, as will be described later, the display unit 72 of the present embodiment changes the transparency of the area other than the focus frame F to make it easier to understand the position of the focus frame F in the entire image. It is possible to adjust the appearance of the image outside the focus frame F in the relationship.

The photographing unit 73 is a photographing means for taking a picture with the focus frame F displayed on the display unit 72, which is a display means, and includes a lens unit 731, an electronic imaging unit 732, and the like. The photographing unit 73 is controlled by the photographing control unit 813, which will be described later.

The lens unit 731 is composed of, for example, a plurality of lenses such as a zoom lens and a focus lens, an aperture for adjusting the amount of light passing through the lenses, and the like.
The electronic image pickup unit 732 is composed of, for example, an image sensor (imaging element) such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor). The electronic imaging unit 732 converts an optical image that has passed through various lenses of the lens unit 731 into a two-dimensional image signal.

The communication unit 74 is configured to be able to communicate with the communication unit 13 of the printing device 1.
As described above, the communication between the printing device 1 and the terminal device 7 may be either a wireless connection method or a wired connection method, and the specific method is not limited. The communication unit 74 may be any one capable of communicating with the printing device 1, and the communication unit 74 that matches the communication standard of the communication unit 13 of the printing device 1 is applied.
The communication unit 13 is controlled by the communication control unit 811 (see FIG. 2) of the control device 80 described later.

As shown in FIG. 2, the control device 80 of the terminal device 7 of the present embodiment includes a control unit 81 composed of a processor such as a CPU (Central Processing Unit) (not shown), and a ROM (Read Only Memory) and a RAM (not shown). It is a computer including a storage unit 82 composed of (Random Access Memory) and the like.

The storage unit 82 is provided with a program storage area 821 in which various programs for operating each unit of the terminal device 7 are stored.
In the present embodiment, the control unit 81 develops various programs stored in the program storage area 821, for example, in the work area of the RAM, and the programs are executed in the control unit 81, whereby each unit of the terminal device 7 is controlled. It is designed to be controlled.

Further, the storage unit 82 includes a data storage area 822 for storing and storing various types of data.
In the present embodiment, in particular, the focus frame F is set based on the claw shape data transmitted from the printing device 1, and the data of the focus frame F corresponding to each claw shape data is the data storage area 822. It is saved in.
The nail shape data is detected for each finger in the printing device 1, and each nail shape data and the corresponding focus frame F are stored in association with the finger type in the data storage area 822.
The size and shape of the focus frame F are, for example, the number of vertical and horizontal pixels in the area that can be imaged when a part of the entire image is zoomed in at a predetermined zoom magnification by digital zoom or optical zoom, and the size and shape of the entire image. It is preferable that the focus frame F is defined according to the relative ratio of each of the vertical and horizontal directions to the number of pixels in each of the vertical and horizontal directions.

In addition, various other information may be stored in the data storage area 822 of the storage unit 82.
For example, it is preferable that the resolution, screen size, and the like of the display unit 72 are stored in the data storage area 822.
When the resolution, screen size, etc. of the display unit 72 are stored, it is possible to calculate the vertical and horizontal "actual size" of one pixel of the display unit 72. In this case, the display image of the focus frame F can be converted by dividing the distance per pixel of the display unit 72 and displayed on the display unit 72.
Therefore, for example, when the operation unit 71 or the like is selected to display the actual size, the focus frame F in the shape of the claw T displayed on the display unit 72 can be displayed in the same size as the actual size of the claw T. This makes it easier to grasp the image at the time of printing.

From a functional point of view, the control unit 81 of the terminal device 7 includes a communication control unit 811, a display control unit 812, a shooting control unit 813, an image processing unit 814, and the like. The functions as the communication control unit 811, the display control unit 812, the shooting control unit 813, the image processing unit 814, and the like are realized by the cooperation between the CPU of the control unit 81 and the program stored in the ROM of the storage unit 82. .. The function provided by the control unit 81 of the terminal device 7 is not limited to this, and various other functional units may be provided. In the present embodiment, the control unit 81 of the terminal device 7 also functions as a claw shape acquisition means for acquiring the claw shape (claw shape data) of the claw T from the printing device 1.

The communication control unit 811 controls the operation of the communication unit 74.

The display control unit 812 controls the display operation of the display unit 72.
In the present embodiment, the focus frame F is displayed on the display unit 72 as described above, and the display control unit 812 displays the focus frame F at the time of shooting according to the nail shape (claw shape data). Functions as a focus frame setting means for setting on the display screen of the display unit 72.
More specifically, the display control unit 812 of the present embodiment sequentially captures a plurality of frame images related to the entire image sequentially captured by the photographing unit 73 at a predetermined reproduction frame rate in the still image or moving image shooting mode. While updating, it is displayed on the display unit 72 as a live view image.
At this time, the display control unit 812 causes the focus frame F to be displayed in the entire image sequentially displayed on the display unit 72 as a live view image. As a result, the focus frame F can be recognized by the user.
That is, until the shutter operation is performed by the user, images (overall images) within the range that can be photographed by the photographing unit 73 are sequentially displayed as live view images on the display unit 72. The display control unit 812 displays the focus frame F in the entire image displayed in the live view state, so that the focus frame F is identifiable in the entire image.

Further, although FIG. 5 shows an example in which the image is similarly transparent and displayed inside and outside the focus frame F, the display mode may be changed inside and outside the focus frame F.
For example, the display control unit 812 corresponds to the focus frame F by masking an area other than the focus frame F in the entire image sequentially displayed on the display unit 72 until the shutter operation is performed by the user. It is preferable to display the image (corresponding to the cutout image FI) in a predetermined display mode so that the image in the region other than the focus frame F is relatively inconspicuous.
As a result of masking the area other than the focus frame F in the entire image, the display mode in which the image is displayed can be appropriately set. For example, the image in the area other than the focus frame F may be covered so that it cannot be seen (see, for example, FIG. 8). Further, the masked area other than the focus frame F may be displayed in a semi-transparent display state (see, for example, FIGS. 9 and 11).
It should be noted that the predetermined display mode in which the image in the area other than the focus frame F is relatively inconspicuous is an example, and is not limited to this, and can be arbitrarily changed as appropriate. .. For example, the display control unit 812 may change the brightness, saturation, hue, etc. of the image in the area other than the focus frame F, or may perform mosaic processing or blurring processing on the image in the area other than the focus frame F. good. For example, the display control unit 812 may be configured to realize all or a part of the display modes shown here, and the user may arbitrarily select a display mode that is easy for the user to see.

The shooting control unit 813 controls the shooting operation of the shooting unit 73.
Specifically, the operation of the zoom lens, focus lens, aperture, and the like of the lens unit 731 of the photographing unit 73 is controlled, and in particular, the image in the focus frame F is adjusted to be in focus. Further, the electronic photographing unit 732 is controlled to convert the optical image acquired through the lens unit 731 into a two-dimensional image signal.
For example, the photographing control unit 813 scans and drives the electronic imaging unit 732 by a timing generator or driver (not shown), and the electronic imaging unit 732 converts the optical image that has passed through the lens unit 731 into a two-dimensional image signal at predetermined intervals. The image is converted, and an image for each screen is read out from the imaging area of the electronic imaging unit 732 and output.
The image signal output from the electronic image pickup unit 732 undergoes various image signal processing and is stored as a digital image signal in the data storage area 822 or the like of the storage unit 82.
The photographing control unit 813 may perform adjustment control of various conditions when photographing a subject, such as AF (automatic focusing processing), AE (automatic exposure processing), and AWB (automatic white balance).

The image processing unit 814 performs various processes on the image captured by the photographing unit 73.
Each part of the image processing unit 814 is composed of, for example, a predetermined logic circuit, but the specific configuration is not particularly limited.
In the present embodiment, the image processing unit 814 functions as a cutout image generation means for cutting out the image (whole image) taken by the shooting unit 73 in accordance with the focus frame F and generating the cutout image FI. As a result, a cutout image FI that matches the shape of the user's nail T is generated.
Then, the image processing unit 814 generates print data for printing the cutout image FI on the nail T to be printed based on the cutout image FI. That is, the image processing unit 814 also functions as a print data generation means. In the present embodiment, the focus frame F matches the shape of the user's nail T, and the cutout image FI is cut out corresponding to the focus frame F. Therefore, an image to be printed when generating print data is desired. It is possible to save time and effort such as scaling the claw T according to the size and shape of the claw T.
If the claw shape detection unit 313 acquires the curvature of the claw T and the information is also transmitted from the printing device 1 to the terminal device 7 side together with the claw image and the claw shape data, the image processing unit 814 May generate print data by appropriately correcting the curved surface based on the curvature of the claw T or the like. When the curved surface is corrected, it is possible to generate print data that more closely matches the shape of the claw T.
The print data generated by the image processing unit 814 is transmitted to the printing device 1 via the communication unit 74.

Next, the printing method of this embodiment will be described.
In the printing system 100 of the present embodiment, when performing nail printing using the printing device 1, the user first operates the operation unit 12 (operation button) of the printing device 1 to turn on the power and start the operation.
Then, the finger holding unit 6 holds the finger U, the finger U in the held state is photographed by the photographing unit 50, and a nail image is acquired (step S1).
If the terminal device 7 stores an application program for performing nail printing in cooperation with the printing device 1, and the terminal device 7 can also give various instructions to the printing device 1, the display unit of the terminal device 7 is used. The display unit 72 may display an instruction screen or the like prompting the finger U of the nail T to be printed to be set on the finger holding unit 6.

When the nail image is acquired, the nail shape detection unit 313 detects the nail shape and generates the nail shape data (step S2).
Since it is preferable to generate the nail shape data for the nails T of all the fingers U to be printed and register them, the control unit 31 controls all the fingers U scheduled to be printed (for example, all 10 fingers U on the left and right). It is determined whether or not the acquisition of the nail image and the generation of the nail shape data have been completed for the finger U) (step S3).
When there is a finger U whose processing has not been completed (step S3; NO), the process is repeated by returning to step S1, and when the processing of all finger U has been completed (step S3; YES), the process is repeated. , The claw shape data is transmitted to the terminal device 7 via the communication unit 13 (step S4). The nail shape data is transmitted in association with the type of each finger U.
Further, the nail shape data may be stored in the storage unit 32 or the like in a state associated with the type of each finger U.
When the claw shape data associated with the type of each finger U is stored in the storage unit 32 of the printing device 1, the storage unit 82 of the terminal device 7 to which the data is transmitted, or the like, from the next time onward, the relevant data is stored. The following processing may be performed using the stored nail shape data.

Upon receiving the nail shape data from the printing device 1, the terminal device 7 activates the photographing unit 73 (step S5).
Then, the nail shape data to be applied as the focus frame at the time of shooting is selected (step S6).
Specifically, for example, as shown in FIG. 4, a focus frame F (frame shape) corresponding to the claw shape data acquired for each of the fingers U of both the left and right hands is displayed on the display unit 72, and which focus frame F is used. Let the user select which finger U wants to use at the time of shooting (that is, which finger U's nail T wants to shoot the image to be printed).
When the user selects one of the focus frames F by a touch operation or the like, the instruction signal is output to the control unit 81, and the focus frame F applied to shooting is selected.
For example, FIG. 4 illustrates a case where the focus frame F corresponding to the shape of the nail of the middle finger of the left hand is selected.

When the claw shape data is selected, the focus frame F corresponding to the claw shape data is displayed on the display unit 72 (step S7). Then, shooting is started with the focus frame F displayed on the display unit 72 (step S8).
During shooting, the control unit 81 of the terminal device 7 receives various operation instructions and performs processing according to the various operation instructions (step S9). The operation instructions referred to here are general camera functions such as exposure adjustment and white balance adjustment.
In the present embodiment, in addition to these general operation instructions, an instruction to change the size of the focus frame F is also accepted, and the control unit 81 determines at any time whether or not there is an instruction to change the size (step S10). .. Then, when there is an instruction to change the size of the focus frame F (step S10; YES), the size of the focus frame F is changed according to the instruction (step S11). On the other hand, when there is no particular change instruction (step S10; NO), the control unit 81 determines at any time whether or not there is a shooting instruction (that is, a shutter operation in which the user releases the shutter) (step S12). Then, the process returns to step S9 and the process is repeated until there is a shooting instruction.

The user performs the shutter operation so that the subject to be printed on the nail T fits within the focus frame F. For example, FIG. 5 shows an example in which the focus frame F is aligned with the central cat in which a plurality of cats are lined up as the subject to be printed on the claw T, and the shutter operation is performed.
When there is a shooting instruction (that is, when there is a shutter operation by the user, step S12; YES), the image in the focus frame F from the shot image (overall image) is adjusted to the size and shape of the focus frame F. The cut-out image FI is generated and stored in the data storage area 822 of the storage unit 82 (step S13). FIG. 6 schematically shows the relationship between the cut-out image FI and the nail T of the finger U to which the cut-out image FI is to be printed. Since the cut-out image FI is cut out from the focus frame F corresponding to the nail shape, the size and shape of the cut-out image FI almost match the nail shape.

The control unit 81 determines whether or not the shooting is completed (step S14), and when the shooting is not finished yet, that is, when the image shooting for nail printing is continued (step S14; NO). , The process returns to step S6 and the process is repeated.
On the other hand, when the shooting is completed (step S14; YES), the control unit 81 of the terminal device 7 generates print data based on the cutout image FI (step S15), and this is transmitted via the communication unit 74. Is transmitted to the printing device 1 side (step S16).

When the printing device 1 receives the print data, the finger U corresponding to the print data is held by the finger holding unit 6, which is photographed by the photographing unit 50 to acquire a nail image (step S17).
Then, the position of the nail T on the XY plane is detected from the nail image (step S18), and the detected position is subjected to a printing process according to the print data corresponding to the nail T of the finger U (step S19). ).
As a result, by taking a picture so that the subject to be printed on the nail T is within the focus frame F, a cutout image FI that substantially matches the shape of the nail T is generated, and printing is performed based on the cutout image FI. By performing the above, as shown in FIG. 7, the cutout image FI having the composition as the user's image can be printed on the nail T.

As described above, according to the printing system 100 of the present embodiment, the printing device 1 acquires an image of the nail T, detects the nail shape from the nail image, and the terminal device 7 takes a picture according to the nail shape. Shooting is performed with the focus frame F set, and print data is generated based on the cutout image FI cut out corresponding to the focus frame F. Then, based on this print data, the printing unit 40 of the printing apparatus 1 prints on the nail T.
As a result, the composition can be determined according to the shape of the nail T at the time of shooting, and the image as the image can be printed on the nail T.
Further, since the print data is generated based on the cut-out image FI obtained by cutting out the image in the focus frame F, it is not necessary to perform adjustment, scaling, etc. at the stage of generating the print data, and the print data can be easily obtained. Can be generated.
Further, since the image is taken so that the object to be printed fits within the focus frame F, it is possible to acquire a sharp image of a desired pattern (object) without blurring. Therefore, a high-definition finish can be realized even when printing is performed on the nail T.

Further, in the present embodiment, the nail image and the nail shape data are acquired for each type of finger U, and the focus frame F is set for each type of finger U accordingly.
The shape and size of the claw T are different for each finger U even for the same user.
In this respect, by setting the focus frame F according to the claw T of each finger U, the cutout image FI cut out along the shape of the focus frame F can also be made into a shape suitable for printing on each claw T. It is possible to print with a beautiful finish.

Although the embodiments of the present invention have been described above, it goes without saying that the present invention is not limited to such embodiments and can be variously modified without departing from the gist thereof.

For example, in the present embodiment, when shooting is performed by the shooting unit 73 of the terminal device 7, as shown in FIG. 5, a case where only the focus frame F is displayed on the display unit 72 is illustrated, but the display at the time of shooting is illustrated. Not limited to this.
For example, the captured image (nail image) itself captured by the printing device 1 is displayed on the display unit 72 of the terminal device 7, and the subject is displayed only in the portion of the captured image corresponding to the nail T (that is, the nail-shaped region). The focus frame F may be displayed in a state where the image is transparent, and shooting may be performed.
For example, FIG. 8 shows an example in which an image of a finger U held by the finger holding unit 6 (an image of the nail T including the finger U and the like) is displayed on the display unit 72.
In this way, by displaying not only the focus frame F in the shape of the nail T but also the image including the image of the finger U, what kind of impression will be obtained when actually printing on the nail T is determined in advance. It makes it easier to grasp the image.

In this case, the image of the finger U, the finger holding portion 6, or the like covers the portion other than the focus frame F, and it becomes difficult to confirm what kind of object or landscape is reflected around the focus frame F.
Therefore, when displaying the photographed image of the finger U including the claw T on the display unit 72, for example, as shown in FIG. 9, it is possible to display the image in a state where the transparency of the portion outside the focus frame F is also increased. preferable. By doing so, it becomes easy to grasp the position of the portion to be cut out as the image to be printed on the nail T in the entire image, and it becomes easy for the user to decide the composition.
The transparency of the portion outside the focus frame F may be set to a desired level in advance, or may be appropriately adjusted by operating the touch panel or the like while shooting, for example.

Further, for example, as shown in FIG. 10, an illustration of the finger U is displayed on the display unit 72 of the terminal device 7, and the subject is transmitted only to the portion of the illustration corresponding to the nail T (that is, the nail-shaped region). The focus frame F may be displayed in such a state that the image is taken.
In this way, by displaying not only the focus frame F corresponding to the nail shape but also the illustration of the finger U, an image can be grasped in advance to see what kind of impression it will have when actually printed on the nail T. It will be easier.

Also in this case, the display may be performed in a state where the transparency of the portion outside the focus frame F is also increased.
For example, as shown in FIG. 11, by expressing the illustration of the finger U only by the outline, it is easy to imagine the state of being printed on the fingernail T, and the portion to be cut out as an image to be printed on the fingernail T. It becomes easier to grasp the position of the image in the entire image, and it becomes easier for the user to decide the composition.

Further, in the present embodiment, the case where the image processing unit 814 on the terminal device 7 side generates print data and sends the print data to the printing device 1 for printing is illustrated. For example, the terminal device 7 to the printing device 1 is used. On the other hand, image data such as a cutout image FI may be transmitted, and print data may be generated on the printing device 1 side.
In this case, the printing device 1 may have data other than the claw shape data for setting the focus frame F (for example, data such as the claw curvature for curved surface correction when performing curved surface correction). , There is no need to send to the terminal device 7 side.

Further, in the present embodiment, a case where the nail image is acquired on the printing device 1 side, the nail shape data is generated from the nail image, and then the nail shape data is transmitted to the terminal device 7, but the nail shape data is It is not limited to the case where it is generated on the printing device 1 side.
For example, after the nail image is acquired on the printing device 1, the data of the nail image may be transmitted to the terminal device 7, and the control unit 81 of the terminal device 7 may generate the nail shape data.
In this case, since it is sufficient to provide the printing device 1 with a photographing unit 50 (camera), a printing unit 40, and means for controlling them, the configuration of the printing device 1 can be simplified and simplified.

Further, all operations other than the printing operation of printing on the claw T may be performed on the terminal device 7 side.
The processing in this case will be described with reference to FIG.
As shown in FIG. 12, in this case, first, the photographing unit 73 of the terminal device 7 is activated (step S21), and the control unit 81 sequentially photographs the finger U to be printed and acquires a nail image. (Step S22).
In this case, it is preferable that all the fingers to be printed are shot under the same conditions as possible (for example, various shooting conditions such as brightness, distance between the nail T and the lens of the shooting unit 73, shooting direction and angle). ..

Then, when the nail image is acquired, the nail shape data is generated and saved from the nail image (step S23).
The control unit 81 determines whether or not the acquisition of the nail image and the generation of the nail shape data have been completed for all the fingers U scheduled to be printed (for example, all 10 fingers U on the left and right) (step S24), and still If there is a finger U for which the process has not been completed (step S24; NO), the process returns to step S22 and the process is repeated. On the other hand, when the processing of all the fingers U is completed (step S24; YES), the screen as shown in FIG. 4 is displayed on the display unit 72, and the nail shape data to be applied as the focus frame F is used by the user. (Step S25).

Since steps S25 to S34 are the same as those described in steps S6 to S15 in FIG. 3, the description thereof will be omitted.

When the print data of the cutout image FI is generated in the terminal device 7 (step S34), the terminal device transmits the print data and the claw shape data to the print device 1 (step S35). The nail image data and the like may also be transmitted to the printing device 1, but the transmitted data becomes heavier by that amount. Therefore, the data to be transmitted to the printing device 1 is preferably print data and nail shape data.

When the data is received from the terminal device 7, the printing device causes the finger holding unit 6 to hold the finger U corresponding to the print data, and the photographing unit 50 photographs the finger U to acquire the nail image (step S36).
Then, the position of the nail T on the XY plane and the shape of the nail (nail region) are detected from the nail image (step S37), and the scale of the print data is appropriately corrected based on the detection result and the like (step S38).
Then, according to the corrected data, the claw T of the finger U is printed (step S39).

As described above, when the acquisition of the nail image is also performed on the terminal device 7 side, the photographing unit 50 of the printing device 1 has sufficient accuracy to confirm the printing position (position in the XY direction at the time of printing). Since it is sufficient to have the printing device 1 and the image processing is simple, the printing device 1 can be configured more simply and inexpensively.

Further, in the present embodiment, the case where the photographed image (photograph) acquired by the terminal device 7 is printed on the claw T has been described, but the design that can be printed by the printing device 1 and the printing system 100 in the present embodiment is limited to the photograph. Not done.
For example, nail design data such as various illustrations may be stored in the storage unit of the printing device 1 or the terminal device 7, and these may be selected as the data to be printed on the nail T.

Further, in the present embodiment, the focus frame F is intended to show a portion to be focused when shooting, but it can also be used as a shooting auxiliary frame for simply showing a cutout portion to assist shooting regardless of the focus. good.

Although some embodiments of the present invention have been described above, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and the equivalent scope thereof. ..
The inventions described in the claims originally attached to the application of this application are added below. The claims in the appendix are as specified in the claims originally attached to the application for this application.
[Additional Notes]
<Claim 1>
Nail image acquisition means to acquire nail images and
A nail shape detecting means for detecting a nail shape from the image of the nail,
A transmission means for transmitting the claw shape to an external device,
A cutout image acquisition means for acquiring a cutout image corresponding to the nail shape from the external device,
A printing means for printing based on the cutout image and
A printing device characterized by being equipped with.
<Claim 2>
The nail image acquisition means acquires an image of the nail for each type of finger.
The printing apparatus according to claim 1, wherein the nail shape is set for each type of finger.
<Claim 3>
Nail shape acquisition means for acquiring the nail shape of the nail,
A cut-out image generation means that cuts out an image taken by the shooting means according to the shape of the nail and generates a cut-out image.
A communication means for transmitting information based on the cutout image to an external device,
A terminal device characterized by being equipped with.
<Claim 4>
Moreover,
A shooting auxiliary frame setting means for setting a shooting auxiliary frame for assisting shooting at the time of shooting according to the nail shape, and a shooting auxiliary frame setting means.
A display means for displaying the shooting auxiliary frame and
The terminal device according to claim 3, wherein the terminal device is provided with.
<Claim 5>
4. The display means is capable of displaying a photographed image of a finger including the nail, and displays the photographing auxiliary frame in a state where the subject is transmitted through a portion of the photographed image corresponding to the nail. The terminal device described in.
<Claim 6>
The terminal device according to claim 4, wherein the display means can display an illustration of a finger, and displays the shooting auxiliary frame in a state where the subject is transmitted through a portion corresponding to the nail of the illustration.
<Claim 7>
5. or 6. The terminal device described in.
<Claim 8>
The terminal device according to any one of claims 4 to 7, wherein the photographing auxiliary frame is set for each type of finger.
<Claim 9>
The terminal device according to any one of claims 4 to 8, wherein the photographing auxiliary frame is a focus frame indicating a portion to be focused at the time of photographing.
<Claim 10>
A printing system including a printing device and a terminal device.
The printing device and the terminal device have communication means capable of transmitting and receiving data to and from each other.
Nail image acquisition means to acquire nail images and
A nail shape detecting means for detecting a nail shape from the image of the nail,
A shooting auxiliary frame setting means for setting a shooting auxiliary frame at the time of shooting according to the nail shape, and a shooting auxiliary frame setting means.
A display means for displaying the shooting auxiliary frame and
A shooting means for shooting with the shooting auxiliary frame displayed on the display means, and a shooting means.
A cut-out image generation means that cuts out an image taken by the shooting means according to the shooting auxiliary frame and generates a cut-out image.
A printing means for printing on the nail based on the cutout image,
A printing system characterized by being equipped with.
<Claim 11>
A printing method performed using a printing device and a terminal device.
The printing device and the terminal device have communication means capable of transmitting and receiving data to and from each other.
Nail image acquisition process to acquire nail image and
A nail shape detection step that detects the nail shape from the nail image, and
A shooting auxiliary frame setting process for setting a shooting auxiliary frame for shooting according to the nail shape, and a shooting auxiliary frame setting step.
A display process for displaying the shooting auxiliary frame and
In the display step, a shooting step in which shooting is performed with the shooting auxiliary frame displayed, and a shooting step.
A cutout image generation step of cutting out an image taken in the shooting step according to the shooting auxiliary frame to generate a cutout image, and a cutout image generation step.
A printing process for printing on the nail based on the cutout image,
A printing method characterized by containing.
<Claim 12>
On the computer
With the nail shape acquisition function to acquire the nail shape of the nail,
A shooting auxiliary frame setting function that sets a shooting auxiliary frame when shooting according to the nail shape, and a shooting auxiliary frame setting function.
A display function that displays the shooting auxiliary frame and
A shooting function that shoots with the shooting auxiliary frame displayed by the display function, and a shooting function.
An image generation function that cuts out an image taken by the shooting function according to the shooting auxiliary frame and generates a cutout image, and a cutout image generation function.
A communication function that transmits information based on the cutout image to an external device,
A program characterized by realizing.

1 Printing device 7 Terminal device 31 Control unit 32 Storage unit 40 Printing unit 41 Printing head 313 Claw shape detection unit 314 Printing control unit 72 Display unit 73 Imaging unit 81 Control unit 82 Storage unit 812 Display control unit 813 Imaging control unit 814 Image processing Part F Focus frame (shooting auxiliary frame)
FI cutout image T nail U finger

Claims (12)

Nail image acquisition means to acquire nail images and
A nail shape detecting means for detecting a nail shape from the image of the nail,
A transmission means for transmitting the claw shape to an external device,
A cutout image acquisition means for acquiring a cutout image corresponding to the nail shape from the external device,
A printing means for printing based on the cutout image and
A printing device characterized by being equipped with. The nail image acquisition means acquires an image of the nail for each type of finger.
The printing apparatus according to claim 1, wherein the nail shape is set for each type of finger. Nail shape acquisition means for acquiring the nail shape of the nail,
A cut-out image generation means that cuts out an image taken by the shooting means according to the shape of the nail and generates a cut-out image.
A communication means for transmitting information based on the cutout image to an external device,
A terminal device characterized by being equipped with. Moreover,
A shooting auxiliary frame setting means for setting a shooting auxiliary frame for assisting shooting at the time of shooting according to the nail shape, and a shooting auxiliary frame setting means.
A display means for displaying the shooting auxiliary frame and
The terminal device according to claim 3, wherein the terminal device is provided with. 4. The display means is capable of displaying a photographed image of a finger including the nail, and displays the photographing auxiliary frame in a state where the subject is transmitted through a portion of the photographed image corresponding to the nail. The terminal device described in. The terminal device according to claim 4, wherein the display means can display an illustration of a finger, and displays the shooting auxiliary frame in a state where the subject is transmitted through a portion corresponding to the nail of the illustration. 5. or 6. The terminal device described in. The terminal device according to any one of claims 4 to 7, wherein the photographing auxiliary frame is set for each type of finger. The terminal device according to any one of claims 4 to 8, wherein the photographing auxiliary frame is a focus frame indicating a portion to be focused at the time of photographing. A printing system including a printing device and a terminal device.
The printing device and the terminal device have communication means capable of transmitting and receiving data to and from each other.
Nail image acquisition means to acquire nail images and
A nail shape detecting means for detecting a nail shape from the image of the nail,
A shooting auxiliary frame setting means for setting a shooting auxiliary frame at the time of shooting according to the nail shape, and a shooting auxiliary frame setting means.
A display means for displaying the shooting auxiliary frame and
A shooting means for shooting with the shooting auxiliary frame displayed on the display means, and a shooting means.
A cut-out image generation means that cuts out an image taken by the shooting means according to the shooting auxiliary frame and generates a cut-out image.
A printing means for printing on the nail based on the cutout image,
A printing system characterized by being equipped with. A printing method performed using a printing device and a terminal device.
The printing device and the terminal device have communication means capable of transmitting and receiving data to and from each other.
Nail image acquisition process to acquire nail image and
A nail shape detection step that detects the nail shape from the nail image, and
A shooting auxiliary frame setting process for setting a shooting auxiliary frame for shooting according to the nail shape, and a shooting auxiliary frame setting step.
A display process for displaying the shooting auxiliary frame and
In the display step, a shooting step in which shooting is performed with the shooting auxiliary frame displayed, and a shooting step.
A cutout image generation step of cutting out an image taken in the shooting step according to the shooting auxiliary frame to generate a cutout image, and a cutout image generation step.
A printing process for printing on the nail based on the cutout image,
A printing method characterized by containing. On the computer
With the nail shape acquisition function to acquire the nail shape of the nail,
A shooting auxiliary frame setting function that sets a shooting auxiliary frame when shooting according to the nail shape, and a shooting auxiliary frame setting function.
A display function that displays the shooting auxiliary frame and
A shooting function that shoots with the shooting auxiliary frame displayed by the display function, and a shooting function.
An image generation function that cuts out an image taken by the shooting function according to the shooting auxiliary frame and generates a cutout image, and a cutout image generation function.
A communication function that transmits information based on the cutout image to an external device,
A program characterized by realizing.

Images