JP2021039415A - Imaging system - Google Patents

Abstract

To provide an imaging system that photographs smoothly even when there are many users.SOLUTION: An imaging system includes an imaging apparatus 1 that photographs a photographed person and a server 3. The server 3 includes a reservation reception unit that receives a use reservation of the imaging apparatus 1 from a first user terminal 2, a reservation code issuance unit that issues a reservation code to the use reservation, a check unit that checks whether the reservation code received from the imaging apparatus 1 matches the reservation code issuance unit issued by the reservation code issuance unit and transmits a check result to the imaging apparatus 1, a composite unit that, when matching the reservation codes, composites a photographed image including a first user received from the imaging apparatus 1 and a photographed image including a second user received from a second user terminal 4 to generate a composite image, and an image transmission unit that transmits the composite image to the imaging apparatus 1.SELECTED DRAWING: Figure 1

Description

The present invention relates to a photographing system.

In recent years, image printing devices (for example, Purikura (registered trademark)) that take a picture of a user, print it on a medium such as a special photographic paper or a sticker, and output it have been installed in a game center, an event facility, or the like. In a conventional image printing device, a person who poses in a shooting box is photographed with a camera, the background is deleted from the obtained image, and only the photographed person is extracted, and prepared as image data in advance. A character image such as a background image or a mascot is combined with an extracted person image and output as a print.

If it can be combined with a popular character, the number of users will increase and the waiting time for shooting will become longer, making it impossible to shoot smoothly. At present, in such cases, security and guidance by event staff are required.

Japanese Unexamined Patent Publication No. 2013-22234

An object of the present invention is to provide a photographing system capable of smoothly photographing even when there are many users.

The photographing system of the present invention is a photographing system including a photographing device for photographing a photographed person and a server communicatively connected to the photographing device, and the server is the photographing device from a first user terminal. The reservation reception unit that accepts the usage reservation, the reservation code issuing unit that issues the reservation code for the usage reservation and transmits the reservation code to the first user terminal, and the reservation code received from the photographing device. When the matching unit that collates whether or not it matches the reservation code issued by the reservation code issuing unit and transmits the collation result to the photographing device and the reservation code match, the first user received from the photographing device is used. It has a compositing unit that synthesizes a captured image including the captured image and a captured image including the second user received from the second user terminal to generate a composite image, and an image transmitting unit that transmits the composite image to the photographing device. Then, the photographing device transmits the reservation code input unit that accepts the input of the reservation code from the first user and the input reservation code to the server, and the first one is based on the collation result received from the server. The authentication unit that authenticates the user, the photographing unit that shoots the first user after the authentication by the authentication unit, and the photographed image including the first user are transmitted to the server, and the composite image is received from the server. It has a communication unit for displaying the composite image and a display unit for displaying the composite image.

In one aspect of the present invention, the server further includes a storage unit that stores reservation information including the schedule of the second user and the reservation status of the photographing device, and the reservation reception unit is based on the reservation information. The usage reservation of the photographing device is accepted from the first user terminal, and after the usage reservation is accepted, the reservation information is updated.

In one aspect of the present invention, the reservation information includes appointments of a plurality of second users, and the reservation reception unit accepts selections of a second user from the first user terminal and schedules of the selected second user. Accepts reservations for use of the photographing apparatus based on the above.

In one aspect of the present invention, the photographing apparatus further includes a chroma key processing unit that cuts out a person image from the photographed image generated by the photographing unit, and the communication unit transmits the person image to the server.

In one aspect of the present invention, the photographing device reproduces and outputs the microphone that collects the sound of the first user and the sound data that the communication unit receives from the second user terminal via the server. The communication unit further includes a speaker, and the communication unit transmits the voice data collected by the microphone to the second user terminal via the server.

According to the present invention, shooting can be performed smoothly even when there are many users.

It is the schematic of the photographing system which concerns on embodiment of this invention. (A) to (d) are diagrams showing an example of a reservation screen of a photographing device. (A) and (b) are diagrams showing an example of a photographed image, and (c) is a diagram showing an example of a composite image. It is a schematic block diagram of a photographing apparatus. It is a functional block diagram realized by executing a remote shooting program. It is a functional block diagram of a server. It is a flowchart explaining the reservation method of the photographing apparatus. It is a flowchart explaining the remote shooting method.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a configuration diagram of a photographing system according to the present embodiment. As shown in FIG. 1, the photographing system includes a photographing device 1 and a server 3 that are communicably connected via a network such as the Internet. Although FIG. 1 shows one photographing device 1, there may be a plurality of photographing devices 1, and they are installed at a distant place or in the same facility.

This shooting system provides a remote shooting service as if a user P1 (first user) and a user P2 (second user) in a remote place talk with each other and shoot together at the same place. To do. For example, the user P1 is an ordinary person, and the user P2 is an idol, a musician, an athlete, or the like. The user P1 uses the photographing device 1, and the user P2 uses a user terminal (second user terminal 4) such as a smartphone or a tablet terminal. In the present embodiment, an example in which a general user P1 takes a picture with an idle user P2 will be described.

First, the user P1 makes a reservation for using the photographing device 1 by using a user terminal (first user terminal 2) such as a smartphone or a tablet terminal. When a plurality of idols who can shoot together in the remote shooting service are registered, the user P1 selects an idol who shoots together. When the user P1 uses the first user terminal 2 to access the shooting reservation site provided by the server 3, the idle selection screen as shown in FIG. 2A is displayed.

When the user P1 selects an idle, the first user terminal 2 displays a screen for selecting a date and time and a place for shooting as shown in FIG. 2B. The selectable date and time and place are determined based on the idle schedule and the reservation status of the photographing device 1.

When the user P1 selects the date and time and the place, the reservation frame selection screen as shown in FIG. 2C is displayed on the first user terminal 2. For example, in the example shown in FIG. 2C, the photographing device 1 installed in the XX idol shop on April 1 can reserve a frame of 14:15 and a frame of 14:30. Reservations are not possible for slots from 14:00 to 14:00 and slots from 14:45. The frames from 14:00 to 14:00 and the frames from 14:45 are either filled with idle schedules, or the shooting device 1 installed in the XX idol shop has already been reserved for use by another user. ..

When the user P1 selects the reservation frame, the confirmation screen as shown in FIG. 2D is displayed on the first user terminal 2. When the user P1 presses the confirm button, the server 3 issues a reservation code and notifies the first user terminal 2. The reservation code may be a two-dimensional code or a multi-digit alphanumeric character. The user P1 saves the reservation code display screen in the first user terminal 2.

The user P1 goes to the photographing device 1 at the reserved date and time and inputs the reservation code. For example, the reservation code is manually input to the touch panel of the photographing device 1, or the two-dimensional code is held over the reading unit. The photographing device 1 transmits the input reservation code to the server 3. The server 3 collates the reservation code received from the photographing device 1 with the reservation code issued for the usage reservation of the photographing device 1 on that date and time.

When the reservation codes match, the server 3 notifies the second user terminal 4 used by the photographing device 1 and the user P2 (hereinafter, referred to as an idle P2) of the start of the remote photographing service. The photographing device 1 photographs the user P1, performs chroma key processing on the captured image, cuts out the person image, and transmits the person image to the server 3. For example, the photographing device 1 transmits a person image as shown in FIG. 3A to the server 3. The wallpaper on the back side of the user P1 is a color suitable for chroma key composition, for example, blue or yellow-green.

The second user terminal 4 shoots the idle P2, performs chroma key processing on the shot image, cuts out the person image, and transmits the person image to the server 3. For example, the second user terminal 4 transmits a person image as shown in FIG. 3B to the server 3. On the back side of the idle P2, a color suitable for chroma key composition, such as a blue or yellow-green screen, is installed.

The server 3 synthesizes the person image received from the photographing device 1 and the person image received from the second user terminal 4 to generate a composite image as shown in FIG. 3C. The server 3 transmits the composite image to the photographing device 1 and the second user terminal 4. A composite image is displayed on the photographing device 1 and the second user terminal 4. A plurality of background data may be prepared in advance in the server 3, and the user P1 or the idle P2 may select the background data at the start of the remote shooting service or the like. The server 3 synthesizes the person image received from the photographing device 1, the person image received from the second user terminal 4, and the selected background image to generate a composite image.

The user P1 and the idle P2 are continuously photographed at predetermined time intervals, and a person image is cut out from each photographed image. The shooting interval (frame rate) is set according to the processing performance of the shooting device 1, the processing performance of the second user terminal 4, the bandwidth of the communication network connecting the shooting device 1, the server 3, and the second user terminal 4, and the like. To.

Since the composite image is generated and displayed according to the shooting interval, a moving image is displayed on the display screens of the shooting device 1 and the second user terminal 4.

The photographing device 1 and the second user terminal 4 are provided with microphones and speakers, respectively, and audio data is transmitted and received via the server 3. The user P1 can decide the standing position and the pose while talking with the idol P2.

When the user P1 or the idle P2 presses the shooting instruction button on the display screen, the shooting device 1 and the second user terminal 4 take a picture at a predetermined timing after pressing the button, and the composite image is displayed as a still image on the display screen. To. User P1 and idle P2 can perform editing operations such as adding frames, stamps, and characters. The edited content is transmitted to the server 3 and reflected in the composite image displayed on the photographing device 1 and the second user terminal 4. The user P1 can perform an editing operation while having a conversation with the idle P2.

When a predetermined time elapses from the start of the remote shooting service or a predetermined time comes, the server 3 stops the transmission / reception of image and audio data between the shooting device 1 and the second user terminal 4, and remotely. End the shooting service. The photographing device 1 prints out the edited composite image.

In this way, the user P1 who uses the photographing device 1 can acquire a printed matter of an image as if the image was taken together with the same device while enjoying a conversation with the idle P2 in another place.

In the present embodiment, since the use reservation of the photographing device 1 is made in advance, there is almost no waiting time for photographing, and the photographing can be performed smoothly. In addition, since it is not necessary to line up to wait for the use of the photographing device 1, it is not necessary to allocate staff for security, guidance, and the like.

In the above example, the printout of the still image taken with the idol P2 is provided to the user P1, but the image data of the still image and the moving image data having a conversation with the idol P2 may be provided to the user P1. Good. When providing data, for example, the server 3 transmits the URL and passcode of the download site to the photographing device 1, and the photographing device 1 prints out the URL and passcode. The user P1 accesses the download site using the first user terminal 2, inputs a passcode, and downloads still image data and moving image data.

Next, the configuration of the photographing apparatus 1 will be described. As shown in FIG. 4, the photographing device 1 includes a photographing unit 12 that photographs a user (user P1) and generates photographed image data, an arithmetic control device 11 that performs image processing on the photographed image data, and the like. A printer 14 for printing a printed image (photograph), a microphone 15 for collecting the sound of the user P1, a speaker 16 for outputting the sound, and a communication unit 17 for communicating with the server 3 are provided. When the reservation code is a two-dimensional code, the photographing apparatus 1 may be provided with a reading unit for reading the two-dimensional code.

Further, the photographing device 1 includes a touch panel 13 (display unit) that receives various instructions from the user P1 and displays a moving image of a composite image. The wallpaper on the back side of the user P1 in the photographing device 1 is a color suitable for chroma key compositing, for example, blue or yellow-green.

The photographing unit 12 is, for example, a digital video camera, and includes a lens, a shutter, a CMOS sensor, an A / D converter, and the like. The photographing unit 12 shoots at a predetermined frame rate and outputs the captured image data to the arithmetic control device 11.

The communication unit 17 communicates with the server 3. The communication unit 17 transmits the person image data generated by the image processing described later to the server 3 and receives the composite image data from the server 3.

When an editing operation such as adding a frame, a stamp, or a character is performed, the communication unit 17 transmits the edited content to the server 3.

Further, the communication unit 17 transmits the voice data of the user P1 collected by the microphone 15 to the server 3 and receives the voice data from the second user terminal 4 via the server 3.

The speaker 16 reproduces and outputs the voice data received by the communication unit 17. As a result, the user P1 who uses the photographing device 1 and the idle P2 on the second user terminal 4 side can have a conversation.

The arithmetic control device 11 is connected to a photographing unit 12, a touch panel 13, a printer 14, a microphone 15, a speaker 16, and a communication unit 17, and controls each unit and transfers data. The arithmetic control device 11 is a computer having a CPU (central processing unit) and a memory, and when the CPU executes a remote shooting program stored in the memory, the reservation code input unit 101 as shown in FIG. 5 The functions of the authentication unit 102, the photographing processing unit 103, the chroma key processing unit 104, the display processing unit 105, the editing processing unit 106, and the print processing unit 107 are realized. The processing of each part will be described later.

FIG. 6 shows the functional configuration of the server 3. The server 3 has event information including the names of idols participating in the remote shooting service, the date and time when each idol performs the remote shooting service, and reservation information including the reservation status of each idol in the remote shooting service and the reservation status of the shooting device 1. A storage unit 30 for storing and is provided. The reservation information includes a reservation code issued for the reservation frame of the photographing device 1. The storage unit 30 may store a plurality of background data (still images or moving images).

Further, the remote shooting service execution program is stored in the storage unit 30, and the CPU of the server 3 executes the remote shooting service execution program to execute the event information transmission unit 31, the reservation reception unit 32, and the reservation code issuing unit. The functions of 33, the collating unit 34, the image receiving unit 35, the compositing unit 36, and the image transmitting unit 37 are realized. The processing of each part will be described later.

Next, the reservation method of the photographing apparatus 1 will be described with reference to the flowchart shown in FIG.

The event information transmission unit 31 of the server 3 provides a shooting reservation site in which the idol who performs the remote shooting service and the event information including the date and time thereof are posted, and the user P1 makes a shooting reservation using the first user terminal 2. Access the site and select an event (idle to shoot) on the selection screen as shown in FIG. 2A (steps S1 and S2). The first user terminal 2 notifies the server 3 of the selected event (idle) (step S3).

The reservation reception unit 32 of the server 3 refers to the reservation information, and based on the idle schedule and the reservation status of the photographing device 1, the first user displays the selection screen as shown in FIGS. 2 (b) and 2 (c). It transmits to the terminal 2 and accepts the date and time when the remote shooting service is used and the selection of the shooting device 1 to be used (steps S4, S5, S6).

When the reservation frame is confirmed on the confirmation screen as shown in FIG. 2D, the reservation reception unit 32 updates the idle schedule and the reservation status of the photographing device 1 included in the reservation information (step S7). When a plurality of photographing devices 1 are installed, the reservation status of the reserved photographing device 1 is updated.

The reservation code issuing unit 33 issues a reservation code for the reservation frame and notifies the first user terminal 2 (steps S8 and S9). The user P1 saves the reservation code, and the reservation process of the photographing device 1 is completed.

Next, a method of performing remote photographing will be described with reference to the flowchart shown in FIG.

The user P1 goes to the photographing device 1 at the reserved date and time, and inputs the reservation code received in step S9 into the photographing device 1 (step S11). The reservation code may be input by operating the touch panel 13, or may be read by holding the two-dimensional code over the reading unit. The reservation code input unit 101 of the photographing device 1 accepts the input of the reservation code.

The authentication unit 102 of the photographing device 1 transmits the input reservation code to the server 3 (step S12). The collation unit 34 of the server 3 collates the reservation code stored in the storage unit 30 with the reservation code received from the photographing device 1 and notifies the photographing device 1 of the collation result (steps S13 and S14). Further, when the reservation codes match, the collation unit 34 notifies the second user terminal 4 of the start of remote shooting (step S15).

When the authentication unit 102 of the photographing device 1 receives the verification result that the reservation codes match from the server 3, the user P1 is authenticated, and the photographing processing unit 103 starts photographing the user P1 by the photographing unit 12 (step). S16). The chroma key processing unit 104 performs chroma key processing on the photographed image generated by the photographing unit 12, cuts out the person image, and transmits the person image to the server 3 (step S17). User P1 or idle P2 may select background data before or during shooting. The background data may be changeable during shooting.

Similarly, the second user terminal 4 shoots the idle P2 with the built-in camera, performs chroma key processing on the shot image, cuts out the person image, and transmits the person image to the server 3 (steps S18 and S19).

The image receiving unit 35 of the server 3 receives a person image from the photographing device 1 and the second user terminal 4. The compositing unit 36 synthesizes the person image received from the photographing device 1 and the person image received from the second user terminal 4 to generate a composite image (step S20). When the background is selected, the compositing unit 36 also synthesizes the background image with the person image. The image transmission unit 37 transmits the composite image to the photographing device 1 and the second user terminal 4 (steps S21 and S22).

The display processing unit 105 of the photographing device 1 displays the composite image received from the server 3 on the touch panel 13 (step S23). The second user terminal 4 displays the composite image on the touch panel (not shown) (step S24). The shooting of the user P1 and the idle P2 is continuously performed at predetermined time intervals, and the composite image is generated and displayed according to the shooting interval. Therefore, a moving image is displayed on the display screens of the photographing device 1 and the second user terminal 4.

The server 3 receives the voice data collected by the microphone 15 of the shooting device 1 from the shooting device 1, and transmits the voice data to the second user terminal 4 together with the composite image. The second user terminal 4 displays a composite image and outputs sound from a speaker (not shown). Further, the server 3 receives the voice data collected by the microphone (not shown) of the second user terminal 4 from the photographing device 1, and transmits the voice data to the photographing device 1 together with the composite image. The photographing device 1 displays a composite image and outputs sound from the speaker 16. The user P1 can decide the standing position and the pose while talking with the idol P2.

When the user P1 operates the touch panel 13 and presses the shooting instruction button, the second user terminal 4 is notified of the shooting instruction via the server 3, and after pressing the button, the shooting device 1 and the second user terminal 4 have a predetermined timing. The composite image is displayed on the display screen as a still image (steps S25 and S26). You may be able to shoot multiple times.

The user P1 performs an editing operation such as adding a frame, a stamp, and a character to the composite image displayed as a still image on the touch panel 13 (step S27). The editing processing unit 106 of the photographing apparatus 1 transmits the edited contents to the server 3 (step S28).

Similarly, the idle P2 performs an editing operation such as adding a frame, a stamp, and a character to the composite image displayed as a still image on the touch panel of the second user terminal 4 (step S29). The second user terminal 4 transmits the edited content to the server 3 (step S30).

The server 3 reflects the edited contents received from the photographing device 1 and the second user terminal 4 in the composite image, and transmits the edited composite image to the photographing device 1 and the second user terminal 4. A composite image reflecting the editing by the user P1 and the idle P2 is displayed on the photographing device 1 and the second user terminal 4. The user P1 can perform an editing operation while having a conversation with the idle P2.

When a predetermined time elapses from the start of the remote shooting service or a predetermined time comes, the server 3 stops the transmission / reception of image and audio data between the shooting device 1 and the second user terminal 4, and remotely. End the shooting service. The print processing unit 107 of the photographing device 1 controls the printer 14 and prints out the edited composite image (step S31).

As described above, according to the present embodiment, since the use reservation of the photographing device 1 is made in advance, even if the idol P2 who can shoot together is a popular idol, there is no waiting time for shooting and the shooting can be performed smoothly. It can be carried out. In addition, since it is not necessary to line up to wait for the use of the photographing device 1, it is not necessary to allocate staff for security, guidance, and the like. The user P1 who uses the photographing device 1 can acquire a printed matter of an image as if the image was taken together with the same device while enjoying a conversation with the idol P2 in another place.

The second user terminal 4 is not limited to a smartphone or a tablet terminal, and may be a personal computer connected to a digital camera, a display, a speaker, or the like. In the above embodiment, the idle P2 uses the second user terminal 4, but the photographing device 1 may be installed at a place where the idle P2 is present.

In the above embodiment, data is transmitted / received via the server 3, but after confirming the reservation code and starting the service, the photographing device 1 and the second user terminal 4 do not go through the server 3. Data may be sent and received between. Each of the photographing device 1 and the second user terminal 4 cuts out a person image from the photographed image and transmits it to another device. A composite image is generated by synthesizing a person image received from another device and a person image cut out by the own device.

In the above embodiment, the example in which the second user terminal 4 cuts out the person image from the captured image has been described, but the chroma key processing in the second user terminal 4 may be omitted and the captured image may be transmitted to the server 3. The server 3 may use the captured image received from the second user terminal 4 as the background image, and superimpose and synthesize the person image received from the photographing device 1.

The present invention is not limited to the above-described embodiment as it is, and at the implementation stage, the components can be modified and embodied within a range that does not deviate from the gist thereof. In addition, various inventions can be formed by an appropriate combination of the plurality of components disclosed in the above-described embodiment. For example, some components may be removed from all the components shown in the embodiments. In addition, components across different embodiments may be combined as appropriate.

1 Shooting device 2 1st user terminal 3 Server 4 2nd user terminal 11 Arithmetic control device 12 Shooting unit 13 Touch panel 14 Printer 15 Microphone 16 Speaker 17 Communication unit

Claims (5)

A photographing system including a photographing device for photographing a photographed person and a server communicatively connected to the photographing device.
The server
A reservation reception unit that accepts reservations for the use of the photographing device from the first user terminal, and
A reservation code issuing unit that issues a reservation code for the usage reservation and transmits the reservation code to the first user terminal.
A collation unit that collates whether or not the reservation code received from the photographing device matches the reservation code issued by the reservation code issuing unit, and transmits the collation result to the photographing device.
When the reservation codes match, a compositing unit that synthesizes a captured image including the first user received from the photographing device and a captured image including the second user received from the second user terminal to generate a composite image. ,
An image transmission unit that transmits the composite image to the photographing apparatus, and
Have,
The photographing device is
A reservation code input unit that accepts the input of a reservation code from the first user,
An authentication unit that transmits the input reservation code to the server and authenticates the first user based on the collation result received from the server.
After the authentication by the authentication unit, the photographing unit that photographs the first user and the photographing unit
A communication unit that transmits a captured image including the first user to the server and receives the composite image from the server.
A display unit that displays the composite image and
A photography system characterized by having. The server further includes a storage unit that stores reservation information including the schedule of the second user and the reservation status of the photographing device.
The first aspect of claim 1, wherein the reservation receiving unit receives a usage reservation of the photographing device from the first user terminal based on the reservation information, and updates the reservation information after receiving the usage reservation. Shooting system. The reservation information includes appointments of a plurality of second users.
The second aspect of the present invention, wherein the reservation receiving unit accepts the selection of the second user from the first user terminal and accepts the usage reservation of the photographing device based on the schedule of the selected second user. Shooting system. The photographing apparatus further includes a chroma key processing unit that cuts out a person image from a photographed image generated by the photographing unit, and the communication unit transmits the person image to the server. The shooting system described in either. The photographing device is
A microphone that collects the voice of the first user,
A speaker in which the communication unit reproduces and outputs audio data received from the second user terminal via the server.
With more
The imaging system according to any one of claims 1 to 4, wherein the communication unit transmits voice data collected by the microphone to the second user terminal via the server.

Images