JP6804968B2 - Information distribution device, information distribution method and information distribution program - Google Patents

Description

The present invention relates to an information distribution device, an information distribution method, and an information distribution program.

In recent years, with the rapid spread of the Internet, information distribution via the Internet has been actively carried out. As an example of such information distribution, there is known a technique of displaying information such as an advertisement in a predetermined area provided in advance on a web content or a screen.

Japanese Unexamined Patent Publication No. 2014-049095

However, it may not be possible to say that the conventional technology can effectively deliver information such as advertisements.

For example, in the prior art, an advertisement is merely displayed in a predetermined area provided in advance on a web content or a screen. As a result, the user's impression of the advertisement may be deteriorated as a result of hindering the user from viewing the web content.

In addition, in the prior art, information such as advertisements continues to be displayed together with web contents, which may increase advertising costs. As a result, for example, there is a risk that advertisements for sole proprietors and the like, who have a relatively small budget, cannot be properly displayed.

The present application has been made in view of the above, and an object of the present application is to effectively distribute information such as advertisements.

The information distribution device according to the present application includes a specific unit that specifies an area in which a predetermined subject is captured, a selection unit that selects content to be displayed in the area specified by the specific unit, and the above. The region specified by the specific unit is characterized by having a generation unit that generates an image obtained by synthesizing the contents selected by the selection unit, and a distribution unit that distributes the image generated by the generation unit.

According to one aspect of the embodiment, there is an effect that information such as an advertisement can be effectively distributed.

FIG. 1 is a diagram showing an example of processing executed by the information distribution device according to the embodiment. FIG. 2 is a diagram showing an example of a functional configuration of the information distribution device according to the embodiment. FIG. 3 is a diagram showing an example of information registered in the content database according to the embodiment. FIG. 4 is a diagram showing an example of information registered in the moving image database according to the embodiment. FIG. 5 is a diagram illustrating an example of a process in which the information distribution device according to the embodiment synthesizes a plurality of images on a continuous subject. FIG. 6 is a diagram showing an example of a process in which the information distribution device according to the embodiment displays a composite moving image on the windshield of the vehicle. FIG. 7 is a flowchart showing an example of a flow of information distribution processing executed by the information distribution device according to the embodiment. FIG. 8 is a diagram showing an example of a hardware configuration.

Hereinafter, the information distribution device, the information distribution method, and the mode for implementing the information distribution program according to the present application (hereinafter, referred to as “the embodiment”) will be described in detail with reference to the drawings. The information distribution device, information distribution method, and information distribution program according to the present application are not limited by this embodiment. Further, in each of the following embodiments, the same parts are designated by the same reference numerals, and duplicate description is omitted.

[1. An example of information distribution processing]
First, an example of an information distribution device will be described with reference to FIG. FIG. 1 is a diagram showing an example of processing executed by the information distribution device according to the embodiment. In FIG. 1, as an example of the processing executed by the information distribution device 10, a user who synthesizes a predetermined content with a moving image captured by a mobile terminal 200 installed in the drone D01 or the drone D02 and uses the user U01. An example of the process of delivering to the terminal 100 has been described.

In the following description, the information distribution device 10 describes an example of a process of synthesizing content related to an advertisement as predetermined content, but the advertisement referred to here is not limited to a so-called commercial advertisement. For example, the advertisement synthesized by the information distribution device 10 may be not only a commercial or non-profit advertisement, but also a volunteer recruitment, a public service announcement, a public service announcement, or the like. In addition, the advertisement synthesized by the information distribution device 10 can deliver an advertisement that encourages the installation of an application, content that sells, advertises, or notifies products or services, or any content such as a web page or a game. ..

Further, the advertisement synthesized by the information distribution device 10 can be applied to content including a web page, a still image, a moving image, characters, figures, symbols, hyperlinks, and other arbitrary information. That is, if the content is intended to generate interest to the user, the information distribution device 10 can be used for any service related to various services via the Internet, such as web pages, games, emails, tweets, and blog articles. The content may be combined with the moving image as predetermined content. Further, the information distribution device 10 may synthesize arbitrary contents into a moving image in addition to the contents serving as advertisements.

In the example shown in FIG. 1, the information distribution device 10 is a user terminal 100 used by the user U01, a mobile terminal 200 installed on the drone D01 or the drone D02, and a predetermined network N such as the Internet (for example, FIG. It is an information processing device capable of communicating via (see 2), and is realized by, for example, a server device or a cloud system.

The user terminal 100 is an information processing device used by the user U01, and is used by the user U01 to browse contents such as news and columns. To give a specific example, the user terminal 100 is a mobile terminal such as a smartphone, a tablet terminal, a PDA (Personal Digital Assistant), a desktop PC (Personal Computer), a notebook PC, or the like.

The drones D01 and D02 are mobile objects such as UAVs (Unmanned Aerial Vehicles) that can be remotely controlled, and are so-called drones. More specifically, the drones D01 and D02 are flying objects that perform a race operated by different users, that is, a drone race. Here, the drone D01 is equipped with a camera DC01 capable of capturing a moving image. Further, the drone D02 is equipped with a camera DC02 capable of capturing a moving image. Further, each drone D01 and D02 is provided with a mobile terminal 200 capable of communicating with the information distribution device 10 via a wireless network, and the moving image captured by the cameras DC01 and DC02 is transmitted to the information distribution device 10. However, it can be transmitted.

The mobile terminal 200 does not need to be installed on the drones D01 and D02. For example, the drones D01 and D02 capture moving images using the cameras DC01 and DC02. Then, the drones D01 and D02 are connected to the mobile terminal 200 by wire or wirelessly at a predetermined timing to transfer the moving image captured by the cameras DC01 and DC02 to the mobile terminal 200. Then, the mobile terminal 200 may transmit the moving image received from the drones D01 and D02 to the information distribution device 10 via a network such as the Internet.

[1-1. Processing executed by the information distribution device]
Hereinafter, the information management process executed by the information distribution device 10 will be described. For example, the drones D01 and D02 take a moving image by using the cameras DC01 and DC02 installed in the main body of the drones D01 and D02 in a drone race or the like (step S1). Here, in the drone race of the embodiment, a predetermined subject is arranged on the course in order to display contents such as advertisements.

For example, even if a signboard with a predetermined color, a triangular post, a goal post, a tape indicating the course, a gate, a flag, a pole, a sign, a tree, a stone, etc. are installed as a predetermined subject on the course. Good. Further, on the course, a flexible object such as a cloth or paper having a predetermined color may be arranged on a tree, a stone, or the like as a predetermined subject. It should be noted that trees and stones on the course, places having a predetermined color and shape, and the like can also be applied to a predetermined subject. That is, any subject can be adopted as long as the predetermined subject on the course of the drone race is a subject such as an object or a place that can be distinguished from other subjects by the image analysis technique. In the following description, on the course of the drone race, a white signboard having a predetermined shape and a two-dimensional bar code indicating that it is an area for synthesizing content is arranged as a predetermined subject. It is assumed that a signboard is installed.

When such a predetermined subject is installed on the course, the predetermined subject is captured in the moving image captured by the drones D01 and D02. The predetermined subject may be arranged so as to be intentionally imaged, and various operations may be performed so that the cameras DC01 and DC02 intentionally image the predetermined subject. Then, the information distribution device 10 acquires the moving images captured by the drones D01 and D02 via the mobile terminal 200 (step S2). That is, the information distribution device 10 acquires a moving image captured by an imaging device installed on a predetermined moving body.

Here, the information distribution device 10 generates an edited moving image, which is a moving image obtained by editing the moving images captured by the drones D01 and D02. That is, the information distribution device 10 generates an edited moving image generated from a moving image captured by imaging devices installed on a plurality of moving bodies. For example, the information distribution device 10 generates an edited moving image in which various edits such as switching of moving images captured by drones D01 and D02, addition of commentary subtitles, and addition of live audio are performed. Such an edited moving image can be realized, for example, by accepting an operation by a predetermined editor.

Then, the information distribution device 10 stores the generated edited moving image as a moving image related to the drone race. Then, the information distribution device 10 distributes the edited moving image in response to the request from the user U01. That is, the information distribution device 10 provides a service of distributing the moving images captured by the drones D01 and D02 to the user U01 in the drone race.

For example, the information distribution device 10 receives a moving image distribution request from the user terminal 100 used by the user U01 (step S3). To give a more specific example, the information distribution device 10 has various information (for each drone race, such as a thumbnail of an edited moving image, a date and time when the drone race was performed, a place where the drone race was performed, a participant, etc. Hereinafter, it will be collectively referred to as "drone race information"). In such a case, the user terminal 100 displays the drone race information for which the distribution has been accepted, and accepts the selection from the user U01. Then, when the user U01 selects the drone race information, the user terminal 100 transmits a distribution request for the edited moving image corresponding to the selected drone race information to the information distribution device 10.

Here, by arranging the advertisement on the course of the drone race, an advertisement distribution method such that the user U01 can view the advertisement can be considered. However, when the advertisement is placed on the course in this way, the advertisement cost may be relatively high, and it is difficult to place the advertisement of the sole proprietor who has a relatively small budget. Further, when the advertisement is placed on the course of the drone race, it is difficult to switch the advertisement according to the attribute of the user U01 who views the moving image, and the advertisement effect may not be good.

Therefore, the information distribution device 10 executes the following information distribution processing. First, the information distribution device 10 identifies a region in which a predetermined subject is captured in the moving images acquired from the drones D01 and D02. Further, the information distribution device 10 selects the content to be displayed in the specified area. Then, the information distribution device 10 generates a moving image in which the selected contents are synthesized in the specified area, and distributes the generated moving image to the user terminal 100.

A specific example of the information distribution process will be described below. First, the information distribution device 10 analyzes an edited moving image to be distributed and identifies a region in which a predetermined subject is captured (step S4). For example, in the example shown in FIG. 1, the information distribution device 10 detects a two-dimensional bar code from the edited moving image C10, and a predetermined subject to which the detected two-dimensional bar code is attached, that is, a white signboard is imaged. Identify region AR10. For the identification of such a region AR10, any image identification technique such as deep learning or pattern recognition can be adopted.

Subsequently, the information distribution device 10 selects the content to be displayed in the specified area AR10 (step S5). For example, the information distribution device 10 has "content information" which is data of the content to be displayed, "target information" which is information indicating a user who displays the content, and "composite information" which indicates an area for synthesizing the content. The content database 31 associated with the above is stored. In such a case, the information distribution device 10 selects the content to be synthesized in the area AR 10 according to the attributes of the specified area AR 10 and the user U01 to which the moving image is distributed.

For example, the two-dimensional bar code attached to the white signboard contains information indicating that the white signboard is the area AR10. In such a case, the information distribution device 10 refers to the content database 31 and searches for the content whose synthetic information indicates the area AR10. Then, when the composite information "region # 1" indicates the region AR10, the information distribution device 10 selects the content information "content # 1" as a candidate for the synthesis target.

Subsequently, in the information distribution device 10, whether the target information "attribute # 1" associated with the content information "content # 1" matches or has a predetermined relationship with the demographic attribute and the psychographic attribute of the user U01. Judge whether or not. Then, when the target information "attribute # 1" matches or has a predetermined relationship with the demographic attribute and the psychographic attribute of the user U01, the information distribution device 10 sets the content information "content # 1" as a synthesis target. select.

Then, the information distribution device 10 synthesizes the selected content into the specified area (step S6). For example, in the example shown in FIG. 1, when the content information "content # 1" is an image including text such as "advertisement # 1", the information distribution device 10 includes text such as "advertisement # 1" in the area AR10. Image AD10 is synthesized. As a result, the information distribution device 10 will generate a composite moving image C11 in which a white signboard on which an image including a text such as "advertisement # 1" is arranged is installed on the course.

Further, the information distribution device 10 distributes the composite moving image C11 in which the contents are synthesized to the user terminal 100 (step S7). Then, the user terminal 100 reproduces the composite moving image C11 in which the contents are combined (step S8). As a result, the information distribution device 10 can deliver the composite moving image C11 as if the advertisement selected according to the attribute of the user U01 is installed on the course, so that the advertisement effect can be improved. Can be done.

[1-2. About moving images]
Here, the information distribution device 10 may synthesize the content in the region where an arbitrary subject is imaged. For example, the information distribution device 10 can provide not only the various subjects described above such as a signboard with a predetermined color, but also an arbitrary subject such as a drone housing and a person captured in a moving image. .. Further, the information distribution device 10 may generate a composite moving image by synthesizing the content with the moving image captured by the drones D01 and D02 instead of the editing moving image.

[1-3. About synthesis mode]
Here, the information distribution device 10 may synthesize the content by using an arbitrary synthesis technique when synthesizing the content with a predetermined subject. For example, the information distribution device 10 specifies the shape and orientation of a predetermined subject by using an image analysis technique or the like, and synthesizes the content into the region AR10 in which the predetermined subject is imaged according to the specified shape and orientation. You may. More specifically, the information distribution device 10 may synthesize content whose shape has been changed, such as trimming, enlargement, or reduction, according to the shape and orientation of a predetermined subject. That is, the information distribution device 10 may synthesize the contents as if the signboard with the content such as an advertisement is installed on the course instead of the white signboard.

Further, when a plurality of predetermined subjects are captured in the moving image captured by the drone or the edited moving image, the information distribution device 10 may select the content to be combined for each predetermined subject. .. That is, the information distribution device 10 may arrange different contents for each subject, or may arrange the same contents.

Further, the information distribution device 10 may synthesize different contents into the region AR10 in which a predetermined subject is imaged each time the image is taken. For example, an image analysis technique is used to specify the number of times the course has been lapped. Then, the information distribution device 10 synthesizes the first content in the region where the predetermined subject is imaged in the first week, and the second content in the region where the same subject is imaged in the second week, for example. You may synthesize the contents of.

Here, when synthesizing the content, the content may be superimposed on the front surface of the specified area AR10, the area AR10 is set as a transparent area, and the content arranged on the back surface of the moving image or the edited moving image is displayed. You may. That is, the information distribution device 10 may use any synthesis technique.

Further, for example, when the content includes audio, the information distribution device 10 may generate a composite moving image in which the edited audio is combined according to the orientation and position of the subject. For example, in the moving image or the editing moving image, when the white signboard passes on the right side of the traveling direction of the drones DC01 and DC02, the information distribution device 10 makes a composite moving image as if the signboard to which the content is added passes by the above-mentioned composition. Along with generating the image, the sound contained in the content may be gradually increased, and the sound gradually reduced after the white sign has passed may be combined on the right side of the stereo sound. That is, the information distribution device 10 may generate a composite moving image as if a signboard to which the content is attached passes by, and may synthesize a sound as if the sound is flowing from the signboard.

Further, the information distribution device 10 may generate an edited composite moving image according to the composition of the contents. For example, the information distribution device 10 is a moving image in which the selected content is synthesized in the specified area AR10, and the reproduction speed while the area in which the content is synthesized is displayed is slower than a predetermined reproduction speed. A composite moving image may be generated. That is, the information distribution device 10 may generate a composite moving image that is slow-played while the region AR10 in which the content is synthesized is captured.

[1-4. About selection and synthesis]
In the above example, the information distribution device 10 selects the content to be displayed in the specified area AR10 based on a predetermined subject. For example, when the information distribution device 10 indicates that the two-dimensional bar code attached to the subject is the area AR10, the information distribution device 10 synthesizes the content corresponding to the area AR10 into the area AR10. Further, in the above-described example, the information distribution device 10 selects the content to be displayed in the specified area AR10 based on the user U01 to which the composite moving image is distributed. More specifically, the information distribution device 10 selects the content according to the attribute of the user U01.

However, the embodiments are not limited to this. For example, when the two-dimensional bar code attached to the subject indicates the content to be synthesized, the information distribution device 10 may select the content indicated by the two-dimensional bar code as the synthesis target. Further, when the two-dimensional bar code attached to the subject indicates the condition of the content to be synthesized, the information distribution device 10 may select the content satisfying the condition as the synthesis target.

Further, when the information distribution device 10 shows various synthesis modes such as the size and shape of the two-dimensional bar code as the area AR10, the information distribution device 10 may synthesize the selected contents in the synthesis mode indicated by the two-dimensional bar code. Good. Further, the information distribution device 10 corresponds to the composite information and the composite information identifier when the two-dimensional bar code indicates the composite information identifier that identifies the composite information such as the content to be synthesized, the condition of the content, the synthesis mode, and the like. The content may be selected or synthesized according to the composite information associated with the composite information identifier indicated by the two-dimensional bar code by referring to the attached database.

The information distribution device 10 does not need to select the content by using the two-dimensional bar code attached to the predetermined subject as a key. For example, the information distribution device 10 may specify what the subject is from the shape, color, arrangement position, and the like of a predetermined subject, and select the content according to the specific content. To give a more specific example, the information distribution device 10 may specify a signboard from its shape and select content to be synthesized with the signboard according to the color of the specified signboard. Further, for example, the information distribution device 10 may perform processing such as synthesizing the first content on the signboard closest to the start position and synthesizing the second content on the signboard closest to the second.

When identifying a subject from the shape, color, placement position, etc. of the subject, a two-dimensional bar code indicating information such as what the subject is, where the subject is, and what to synthesize for the specified subject. May be attached, and information other than the two-dimensional bar code may be attached. Further, the predetermined subject may not be provided with information indicating various information such as a two-dimensional bar code.

Further, the information distribution device 10 selects the content to be displayed in the specified area AR10 based on the position of the user U01 to which the composite moving image is distributed or the position where the predetermined moving body captures the moving image. You may. For example, the information distribution device 10 identifies the location of the user U01 based on GPS (Global Positioning System) and demographic attributes. Then, the information distribution device 10 selects an advertisement for a restaurant located near the location of the specified user U01, an advertisement for a delivery company that delivers food to the location of the user U01, and synthesizes the selected advertisement. You may. Further, the information distribution device 10 may select, for example, an advertisement of a store near the venue of the drone race.

Further, the information distribution device 10 may select the content to be synthesized based on the distribution history of each content. For example, in content such as advertisements, the reward amount may change depending on the number of seconds displayed, or the number of seconds displayed may be guaranteed with respect to the reward amount. Therefore, the information distribution device 10 may select the content to be displayed in the area AR 10 based on the cumulative time during which each content is displayed during the reproduction of the composite moving image distributed so far.

To give a more specific example, when the content is synthesized with the moving image, the information distribution device 10 stores the number of seconds in which the content is displayed when the synthesized moving image is reproduced as the number of distribution seconds. Therefore, when the information distribution device 10 newly distributes the composite moving image, the relationship between the distribution seconds of the content and the preset reward amount for the content, the distribution seconds of the content and the display are guaranteed. The content to be synthesized may be selected based on the relationship with the number of seconds. For example, in the information distribution device 10, when the number of seconds for delivering the content does not reach the number of seconds that can be displayed with the preset reward amount for the content, or the number of seconds for delivering the content is guaranteed to be displayed. If the number of seconds is not reached, the content may be selected for compositing.

The information distribution device 10 may select the content to be synthesized according to the number of times the content is synthesized. For example, the information distribution device 10 stores the number of times of combining with a moving image for each content. Then, when the information distribution device 10 newly distributes the composite moving image, the number of times each content is distributed, the amount of reward set in advance for each content, the number of times guaranteed as the number of times the content is distributed, and the like are set. Depending on the situation, the content to be synthesized may be selected. Further, the information distribution device 10 may select the content to be synthesized according to the bid amount preset for the content.

In this way, when selecting the content to be synthesized based on the content distribution history, an impression-guaranteed advertisement distribution method or a bid-type advertisement distribution method can be used at any time. In addition, the information distribution device 10 may automatically optimize the selection of content based on the number of distribution seconds and the number of distributions by any method.

Further, the information distribution device 10 may select a content to be synthesized by combining a plurality of elements in the content distribution history. For example, the information distribution device 10 may calculate the product of the number of seconds for delivering the content and the number of users to whom the content is delivered as a score, and select the content according to the calculated score. More specifically, the information distribution device 10 can allow more users to browse each content for a longer period of time by selecting the content having the lowest calculated score.

The information distribution device 10 may use the product of the number of seconds for distribution of the content and the number of distributions as a score, and select the content according to the score. Further, the information distribution device 10 acquires the reproduction history of the composite moving image distributed from the user terminal 100 and the operation contents at the time of reproduction as a log, and the user U01 does not fast-forward or the like based on the acquired log. Identify the replayed range. Then, the information distribution device 10 may collect the number of seconds in which each content is displayed as the number of distribution seconds in the specified range.

Further, the information distribution device 10 may generate a composite moving image in which the synthesized content can be selected. For example, the information distribution device 10 may set a predetermined link in the specified area when synthesizing the content in the specified area. As a result, the information distribution device 10 can display the web content corresponding to the content by selecting the region in which the content is synthesized from the reproduced composite moving image. Regarding the selection of such contents, not only the selection method such as tapping the screen of the smart device or clicking with the cursor, but also, for example, the wearable device detects the line of sight of the user U01 and keeps staring at the contents. In the case of blinking, it may be realized by a technique such as determining that the content has been selected.

[1-5. About content]
Here, the information distribution device 10 can synthesize any content. For example, the information distribution device 10 may select not only still images but also contents including moving images as the contents to be displayed in the area AR10. For example, the information distribution device 10 may generate a composite moving image in such a manner that a subject such as a signboard on a course or a cloth installed on a tree is displaying a moving image. Further, the information distribution device 10 may synthesize contents whose contents change in real time according to the attributes and states of the user U01. For example, the information distribution device 10 may generate a composite moving image in which an advertisement for calling the user U01 is synthesized together with the name of the user U01.

Further, when a plurality of subjects are continuously arranged at equal intervals, the information distribution device 10 may display contents using a so-called zoetrope technique. For example, the information distribution device 10 identifies a region in which a plurality of continuously arranged subjects are captured in the edited moving image. In such a case, the information distribution device 10 selects a plurality of images constituting a predetermined moving image as contents. Then, the information distribution device 10 synthesizes a plurality of selected images into each of the specified regions.

A more specific example will be described. For example, on a drone racing course, a plurality of white signboards are continuously arranged at equal intervals. In such a case, the information distribution device 10 identifies a plurality of white signs arranged continuously. Then, the information distribution device 10 sequentially synthesizes a plurality of still images constituting the moving image in the order in which the white signboards are displayed. Here, when the drones D01 and D02 move beside the white signboard at a predetermined speed, it is considered that the white signboard displayed on the composite moving image is switched at any time. When a plurality of still images constituting a moving image are sequentially combined with such a plurality of white signboards, the information distribution device 10 has an aspect as if the moving image is displayed by the same principle as the zoetrope. A composite moving image can be generated.

[1-6. About mobiles]
Here, the information distribution device 10 may generate a composite moving image from a moving image captured by an arbitrary moving body. For example, the information distribution device 10 may synthesize contents with a moving image captured by an image pickup device installed in each automobile in an automobile race. Further, the information distribution device 10 may synthesize content not only with an edited moving image obtained by synthesizing moving images captured by a plurality of moving bodies but also with a moving image captured by one moving body. For example, the information distribution device 10 may synthesize content with a moving image captured by a photographing device installed in a drone for photographing a drone race, that is, a moving image captured by one moving body. Good.

[1-7. About delivery destination]
Here, the information distribution device 10 does not need to distribute the composite moving image to the user terminal 100 such as a smart device, and may deliver the composite moving image to the user terminal 100 of any type. Further, the information distribution device 10 may distribute a composite moving image to any terminal device other than the user terminal 100 used by the user U01.

Further, the information distribution device 10 may distribute the composite moving image to a predetermined moving body and display it on the display device of the predetermined moving body. For example, the information distribution device 10 synthesizes the content in real time with the moving image captured by the camera DC01 of the drone D01, and distributes the synthesized moving image obtained by synthesizing the content to the drone D01 in real time. Then, the information distribution device 10 may display the distributed composite moving image on the display device of the mobile terminal 200 installed in the drone D01. Further, the information distribution device 10 may distribute a composite moving image in which the contents are synthesized to a predetermined monitor or the like arranged in the race track in real time. Even when such processing is performed, different contents may be combined for each display device such as a monitor.

Further, for example, the information distribution device 10 acquires a moving image captured by an image pickup device installed in a vehicle driven by the user U01. In such a case, the information distribution device 10 identifies a predetermined subject such as a building, a bridge, a signboard, a road, a roadside tree, a curb, etc. from the acquired moving image. Then, the information distribution device 10 selects the content to be combined with the subject based on the position and attributes of the user U01, and generates a composite moving image in which the selected content is combined. Further, the information distribution device 10 may distribute the generated composite moving image to the vehicle driven by the user U01 and project it on the windshield of the vehicle or the like.

Here, when the composite moving image is projected on the windshield of the vehicle, the composite moving image for projection may be generated. For example, the information distribution device 10 identifies the position of a predetermined subject visually recognized by the user U01 through the windshield of the vehicle from the moving image captured by the vehicle by the image analysis technology, and the content is set at the position of the specified subject. Generates a composite moving image in which Such a composite moving image does not include various subjects captured by the vehicle, and only the content is displayed when the playback is performed. Then, the information distribution device 10 displays the composite moving image on the windshield of the vehicle to display to the user U01 via the windshield of the vehicle as if the content is given to a predetermined subject. Can be provided.

[2. Information distribution device configuration]
Next, an example of the configuration of the information distribution device 10 will be described with reference to FIG. FIG. 2 is a diagram showing an example of a functional configuration of the information distribution device according to the embodiment. As shown in FIG. 2, the information distribution device 10 includes a communication unit 20, a storage unit 30, and a control unit 40.

The communication unit 20 is realized by, for example, a NIC (Network Interface Card) or the like. Then, the communication unit 20 is connected to the network N by wire or wirelessly, and transmits / receives information to / from the user terminal 100 and the mobile terminal 200.

The storage unit 30 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a storage device such as a hard disk or an optical disk. In addition, the storage unit 30 stores the content database 31 and the moving image database 32.

The content to be synthesized is registered in the content database 31. For example, FIG. 3 is a diagram showing an example of information registered in the content database according to the embodiment. For example, information having items such as "content ID (Identifier)", "content information", "target information", "synthesis information", and "delivery history" is registered in the content database 31.

Here, the "content ID" is an identifier that identifies the content. Further, the "content information" is data of the content to be displayed, and is data such as a still image or a moving image. Further, the "target information" is information indicating the display destination of the content such as various attributes of the user U01 displaying the content. Further, the "composite information" is information indicating an area or a subject to synthesize the content. Further, the "delivery history" is various histories related to the synthesis of the associated content information such as the number of delivery seconds and the number of deliveries.

The target information indicates not only the attributes of the user but also the type of the user terminal 100 (for example, whether it is a smart device or a vehicle) as the content display destination. Information may be included. For example, the target information is the content to be synthesized when the associated content information is generated when the composite moving image displayed on the smart device is generated, or when the composite moving image projected on the windshield of the vehicle is generated. It may include information indicating whether or not the content is synthesized in. In addition, the target information may include information indicating to which position the user is associated with the content to be provided.

For example, in the example shown in FIG. 3, the content ID "content ID # 1", the content information "content # 1", the target information "attribute # 1", the synthetic information "area # 1", and the distribution are stored in the content database 31. The history "delivery history # 1" is registered in association with each other. In such information, the content data indicated by the content ID "content ID # 1" is the content information "content # 1", and the target information "attribute # 1" is used as the delivery destination of the content information "content # 1". Indicates that the user to be shown is set, and the composite information "region # 1" is set as the region for synthesizing the content information "content # 1". Further, such information indicates that the number of distribution seconds and the number of distributions of the content information "content # 1" are the distribution history "distribution history # 1".

In the example shown in FIG. 3, conceptual values such as "content ID # 1", "content # 1", "attribute # 1", "area # 1", and "delivery history # 1" are described. In reality, various numerical values and data will be registered. In addition to the information shown in FIG. 3, various information related to content distribution may be registered in the content database 31. For example, information such as CTR (Click Through Rate) and CPM (Cost Per Mille), which is an index of content distribution, may be further registered in the content database 31. The information distribution device 10 may select the content to be synthesized in consideration of the information that is an index of such content distribution.

Returning to FIG. 2, the explanation will be continued. The moving image acquired from the mobile terminal 200 is registered in the moving image database 32. More specifically, in the moving image database 32, moving images to be combined with contents, that is, edited moving images are registered.

For example, FIG. 4 is a diagram showing an example of information registered in the moving image database according to the embodiment. For example, in the moving image database 32, information having items such as "moving image ID", "moving image data", "date and time", "place", and "meeting name" is registered.

Here, the "moving image ID" is an identifier that identifies the edited moving image. Further, the "moving image data" is the data of the edited moving image to be displayed. Further, the "date and time" is information indicating the date and time when the associated moving image was acquired, that is, the date and time when the drone race was performed. The "place" is information indicating the place where the drone race was held. The "tournament name" is the name given to the drone race.

For example, in the example shown in FIG. 4, the moving image database 32 has the moving image ID “moving image ID # 1”, the moving image data “moving image data # 1”, the date and time “date and time # 1”, and the place “place # 1”. , And the tournament name "Tournament name # 1" are registered in association with each other. As for such information, the data of the edited moving image indicated by the moving image ID "moving image ID # 1" is the moving image data "moving image data # 1", and the moving image that is the source of the edited moving image is captured. The date and time, that is, the date and time when the drone race was held is the date and time "date and time # 1", the place where the drone race was held is the place "place # 1", and the name of the drone race is the tournament name "meeting name # 1". It indicates that it is.

In the example shown in FIG. 4, conceptual values such as "moving image ID # 1", "moving image data # 1", "date and time # 1", "place # 1", and "meeting name # 1" are described. However, in reality, various numerical values and data will be registered.

Returning to FIG. 2, the explanation will be continued. The control unit 40 is a controller, and for example, various programs stored in a storage device inside the information distribution device 10 by a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) are stored in a RAM or the like. Is realized by executing as a work area. Further, the control unit 40 is a controller, and may be realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). In the example shown in FIG. 4, the control unit 40 includes an acquisition unit 41, a specific unit 42, a selection unit 43, a generation unit 44, and a distribution unit 45.

The acquisition unit 41 acquires a moving image captured by an imaging device installed on a predetermined moving body. For example, the acquisition unit 41 acquires moving images captured by the cameras DC01 and DC02 installed on the drones D01 and D02, respectively, via the mobile terminal 200. In such a case, the acquisition unit 41 presents each acquired moving image to a predetermined editor, and accepts an operation related to editing the moving image to acquire the edited moving image combined into one moving image. Then, the acquisition unit 41 registers the edited video with the video database 32 in association with the date and time, place, tournament name, etc. of the drone race.

The identification unit 42 identifies a region in which a predetermined subject is captured, that is, a region in which the content is synthesized, in the acquired moving image. For example, the specific unit 42 uses a specific image analysis technique such as pattern analysis or deep learning to specify a region in which a predetermined subject is captured among the subjects captured in the edited moving image. It should be noted that the specifying unit 42 specifies, in the edited moving image, the regions in which a plurality of continuously arranged subjects are captured.

As for what kind of region the specific unit 42 specifies, any technique included in the above description or any known technique can be applied. Further, in the following description, each time the editing moving image is acquired, the specifying unit 42 identifies an area in which a predetermined subject is imaged, and associates the area information indicating the specified area with the editing moving image. It shall be registered in the moving image database 32.

The selection unit 43 selects the content to be displayed in the specified area. For example, when the selection unit 43 receives the moving image distribution request from the user terminal 100, the selection unit 43 reads out the edited moving image to be distributed and the area information from the moving image database 32. Then, the selection unit 43 selects the content to be synthesized in the area indicated by the area information from the content database 31 among the edited moving images.

For example, the selection unit 43 selects the content to be displayed in the specified area based on a predetermined subject. To give a specific example, the selection unit 43 may select the content associated with the composite information indicating the subject captured in the region indicated by the region information from the composite information registered in the content database 31. Good.

Further, for example, the selection unit 43 selects the content to be displayed in the specified area based on the user U01 to which the composite moving image is delivered. To give a specific example, the selection unit 43 may select the content associated with the target information that matches the attribute of the user U01 from the target information registered in the content database 31. Note that the selection unit 43 may select not only the attributes of the user U01 but also the content associated with the target information matching the type of the user terminal 100 from the target information registered in the content database 31. Good.

Further, for example, the selection unit 43 selects the content to be displayed in the specified area based on the position of the user U01 to which the composite moving image is delivered or the position where the predetermined moving body captures the moving image. To do. To give a specific example, the selection unit 43 selects the content associated with the target information that matches the position of the user U01 or the user terminal 100 from the target information registered in the content database 31. May be good.

Further, for example, the selection unit 43 selects the content to be displayed in the specified area based on the cumulative time during which each content is displayed during the reproduction of the distributed composite moving image. To give a specific example, the selection unit 43 refers to the distribution history of the content selected based on the various elements described above, and is a synthesis target based on the number of distribution seconds and the number of distributions included in the distribution history. Select the content to be.

In addition, when a plurality of predetermined subjects arranged continuously are imaged, the selection unit 43 may select a plurality of images constituting a predetermined moving image as contents. The selection unit 43 may select content including a moving image or a still image as the content to be displayed in the specified area.

The generation unit 44 generates a composite moving image in which the selected content is synthesized in the specified area. For example, the generation unit 44 generates a moving image in which the content selected by the selection unit 43 is synthesized with respect to the area indicated by the area information in the editing moving image as a composite moving image. The generation unit 44 is a composite moving image in which the selected content is synthesized in the specified area, and the playback speed while the area in which the content is synthesized is displayed is slower than the predetermined playback speed. An image may be generated.

In addition, when a plurality of predetermined subjects arranged continuously are imaged, the generation unit 44 may synthesize a plurality of images selected as contents into each specified region. As a result of such synthesis, the information distribution device 10 can generate a composite moving image in a manner as if the moving image is displayed by the same principle as the zoetrope.

Further, when the generated composite moving image is generated by synthesizing the contents, the generation unit 44 counts the number of seconds in which each content is displayed when the generated composite moving image is reproduced. Then, the generation unit 44 reflects the number of distribution seconds of the synthesized content among the number of distribution seconds registered as the distribution history in the content database 31. The generation unit 44 may add 1 to the number of distributions of the synthesized content among the number of distributions registered as the distribution history in the content database 31.

The distribution unit 45 distributes the generated composite moving image. For example, the distribution unit 45 can distribute the composite moving image to the user terminal 100 to provide the user U01 with a moving image in which the content selected according to the user U01, the subject, or the like is displayed. it can. The distribution unit 45 may distribute the composite moving image to a predetermined moving body and display it on the display device of the predetermined moving body. By performing such processing, the information distribution device 10 can, for example, project a scene in which the contents are synthesized on the windshield of the vehicle.

[3. Variations in display mode]
Here, an example in which a plurality of images constituting a moving image are combined with a continuously arranged subject will be described with reference to FIG. FIG. 5 is a diagram illustrating an example of a process in which the information distribution device according to the embodiment synthesizes a plurality of images on a continuous subject. For example, in the example shown in FIG. 5 (A), a plurality of white signboards to which a two-dimensional bar code is attached are installed at equal intervals, and the drone D01 passes in front of them. In such a case, the information distribution device 10 specifies the position where each white signboard is imaged as AR11 to AR15, respectively.

In such a case, as shown in FIG. 5B, the information distribution device 10 arranges a plurality of images C21 to C25 constituting the moving image in order in each of the regions AR11 to AR15. To generate. As a result, the information distribution device 10 generates a composite moving image as if the white signboard displaying the moving image is moving according to the movement of the drone D01 by the principle of the zoetrope as the moving image captured by the drone D01. Can be done. In the example shown in FIG. 5, the region and the image to be synthesized conceptually specified by the information distribution device 10 are described, not the mode in which the region and the image specified in the actually captured moving image are combined.

Next, an example of the process of projecting the composite moving image onto the windshield of the vehicle will be described with reference to FIG. FIG. 6 is a diagram showing an example of a process in which the information distribution device according to the embodiment displays a composite moving image on the windshield of the vehicle. For example, in the example shown in FIG. 6, the vehicle terminal CD100 having a moving image imaging function is installed in the vehicle driven by the user U01 as one aspect of the mobile terminal. Such a vehicle terminal CD100 captures a moving image C20 in the traveling direction of the vehicle (step S11).

On the other hand, the information distribution device 10 acquires the moving image C20 captured by the vehicle terminal CD100 (step S12). In such a case, the information distribution device 10 identifies a region in the moving image C20 in which a predetermined subject is captured, and generates a composite moving image in which the content is synthesized in the specified region, as in the information distribution processing described above. (Step S13). For example, the information distribution device 10 identifies the walls of the building imaged on the left and right in the traveling direction as the area where the predetermined subject is imaged, and generates a composite moving image in which the advertisement A and the advertisement B are arranged in the specified area. .. Then, the information distribution device 10 distributes the generated composite moving image to the vehicle (step S14).

In such a case, the vehicle driven by the user U01 displays a composite moving image in which the advertisement A and the advertisement B are combined on the windshield as shown in FIG. 5 (A) (step S15). As a result, the information distribution device 10 can provide the user U01 with a scene in which the advertisement A and the advertisement B are arranged on the walls of the buildings on the left and right in the vehicle traveling direction. The advertisement A and the advertisement B may be contents whose contents change in real time according to the attributes of the user U01 and the like.

[4. An example of information management processing]
Next, an example of the information distribution process executed by the information distribution device 10 according to the embodiment will be described with reference to FIG. 7. FIG. 7 is a flowchart showing an example of a flow of information distribution processing executed by the information distribution device according to the embodiment.

For example, the information distribution device 10 acquires a moving image captured by the moving body (step S101). Subsequently, the information distribution device 10 identifies a region in which a predetermined subject is captured from the acquired moving image (step S102). Then, the information distribution device 10 determines whether or not the distribution request has been accepted (step S103), and if not (step S103: No), waits until it is accepted. On the other hand, when the information distribution device 10 receives the distribution request (step S103: Yes), the information distribution device 10 selects the content to be displayed in the specified area (step S104), and synthesizes the selected content in the specified area. Is generated (step S105). Then, the information distribution device 10 distributes the composite moving image (step S106), and ends the process.

[5. Modification example]
The information distribution device 10 according to the above-described embodiment may be implemented in various different forms other than the above-described embodiment. Therefore, in the following, another embodiment of the above-mentioned information distribution device 10 will be described.

[5-1. Device configuration〕
The information distribution device 10 may realize the above-mentioned information distribution process by the front-end server and the back-end server operating in cooperation with each other. For example, the back-end server acquires a moving image from a predetermined moving body and identifies a region in which a predetermined subject is captured from the acquired moving image. On the other hand, when the front-end server receives the distribution request, it selects the content to be synthesized in the specified area according to the attributes of the user U01, etc., and generates and generates a composite moving image in which the selected content is synthesized. A composite moving image may be delivered. Further, for example, various types of information stored in the storage unit 30 shown in FIG. 2 may be stored in, for example, a storage server external to the information distribution device 10.

[5-2. Others]
In addition to the moving image captured by the mobile terminal 200, the information distribution device 10 identifies, for example, a region in which a predetermined subject is captured in the still image captured by the mobile terminal 200. You may select the content to be synthesized in the selected area, generate a composite still image obtained by synthesizing the selected content, and distribute the generated composite still image. Further, the information distribution device 10 generates a moving image from one or a plurality of still images captured by the mobile terminal 200, and synthesizes the content in the region where a predetermined subject is captured in the generated moving image. You may. That is, the information distribution device 10 may use a still image as a composite image and synthesize a moving image as long as it generates a composite image in which selected contents are combined with an arbitrary image captured by the mobile terminal 200. It may be an image.

Further, among the processes described in the above-described embodiment, all or a part of the processes described as being automatically performed can be manually performed, or the processes described as being manually performed can be performed. All or part of it can be done automatically by a known method. In addition, the processing procedure, specific name, and information including various data and parameters shown in the above document and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the illustrated information.

Further, each component of each of the illustrated devices is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of the device is functionally or physically distributed / physically in any unit according to various loads and usage conditions. It can be integrated and configured. In addition, the above-described embodiments can be appropriately combined as long as the processing contents do not contradict each other.

[6. Hardware configuration]
Further, the information distribution device 10 according to the above-described embodiment is realized by, for example, a computer 1000 having a configuration as shown in FIG. FIG. 8 is a diagram showing an example of a hardware configuration. The computer 1000 is connected to the output device 1010 and the input device 1020, and the arithmetic unit 1030, the primary storage device 1040, the secondary storage device 1050, the output IF (Interface) 1060, the input IF 1070, and the network IF 1080 are connected by the bus 1090. Has.

The arithmetic unit 1030 operates based on a program stored in the primary storage device 1040 or the secondary storage device 1050, a program read from the input device 1020, or the like, and executes various processes. The primary storage device 1040 is a memory device that temporarily stores data used by the arithmetic unit 1030 for various calculations, such as a RAM. Further, the secondary storage device 1050 is a storage device in which data used by the calculation device 1030 for various calculations and various databases are registered, such as a ROM (Read Only Memory), an HDD (Hard Disk Drive), and a flash memory. Is realized by.

The output IF 1060 is an interface for transmitting information to be output to an output device 1010 that outputs various information such as a monitor and a printer. For example, USB (Universal Serial Bus), DVI (Digital Visual Interface), and the like. It is realized by a connector of a standard such as HDMI (registered trademark) (High Definition Multimedia Interface). Further, the input IF 1070 is an interface for receiving information from various input devices 1020 such as a mouse, a keyboard, and a scanner, and is realized by, for example, USB.

The input device 1020 is, for example, an optical recording medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), a PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), or a tape. It may be a device that reads information from a medium, a magnetic recording medium, a semiconductor memory, or the like. Further, the input device 1020 may be an external storage medium such as a USB memory.

The network IF1080 receives data from another device via the network N and sends it to the arithmetic unit 1030, and also transmits the data generated by the arithmetic unit 1030 to the other device via the network N.

The arithmetic unit 1030 controls the output device 1010 and the input device 1020 via the output IF 1060 and the input IF 1070. For example, the arithmetic unit 1030 loads a program from the input device 1020 or the secondary storage device 1050 onto the primary storage device 1040, and executes the loaded program.

For example, when the computer 1000 functions as the information distribution device 10, the arithmetic unit 1030 of the computer 1000 realizes the function of the control unit 40 by executing the program loaded on the primary storage device 1040.

[7. effect〕
As described above, the information distribution device 10 identifies a region in which a predetermined subject is captured in the acquired images such as still images and moving images. Further, the information distribution device 10 selects the content to be displayed in the specified area. Further, the information distribution device 10 generates a composite image obtained by synthesizing the selected contents in the specified area, and distributes the generated composite image.

In this way, the information distribution device 10 distributes the composite moving image in which the content is synthesized in the region where the predetermined subject is captured in the acquired moving image. Therefore, the information distribution device 10 flexibly selects various contents such as advertisements according to the user's attributes and subjects, and distributes a composite moving image in which the selected contents are synthesized, so that the contents are effective. Can be delivered to. Further, the information distribution device 10 does not need to fix the advertisement on the drone race course or the like, so that as a result of reducing the advertisement cost, the advertisement of the sole proprietor or the like is displayed on the drone race course. realizable.

In addition, the information distribution device 10 acquires an image captured by an image pickup device installed on a predetermined mobile body. For example, the information distribution device 10 acquires a moving image captured by an imaging device such as cameras DC01 and DC02 installed in the drone as a predetermined moving body. Therefore, the information distribution device 10 can flexibly display various contents on the course of the drone race.

Further, the information distribution device 10 distributes the generated composite image to a predetermined mobile body and displays it on a display device included in the predetermined mobile body. Therefore, for example, the information distribution device 10 can display a landscape or the like in which the content is synthesized on the windshield or the like of the vehicle.

Further, the information distribution device 10 selects the content to be displayed in the specified area based on a predetermined subject. Further, the information distribution device 10 selects the content to be displayed in the specified area based on the user U01 to which the composite image is distributed. Further, the information distribution device 10 selects the content to be displayed in the specified area based on the position of the user U01 to which the composite image is distributed or the position where the predetermined moving body captures the image. In addition, the information distribution device 10 selects the content to be displayed in the specified area based on the cumulative time during which each content is displayed during the reproduction of the distributed composite image. Therefore, the information distribution device 10 can flexibly select the content to be combined with the composite image based on various information.

In addition, the information distribution device 10 identifies, in the image, a region in which a plurality of continuously arranged subjects are captured. In such a case, the information distribution device 10 selects a plurality of images constituting a predetermined moving image as contents. Then, the information distribution device 10 synthesizes a plurality of images selected as contents into each of the specified areas. As a result, the information distribution device 10 can generate a composite moving image in a manner as if the subject on which the moving image is displayed is moving side by side with the imaging device by the same principle as the zoetrope.

Further, the information distribution device 10 selects content including a moving image or a still image as the content to be displayed in the specified area. Therefore, the information distribution device 10 can distribute a composite moving image obtained by synthesizing a moving image or a still image.

Further, the information distribution device 10 is an image obtained by synthesizing the content selected in the specified area, and the reproduction speed while the area in which the content is synthesized is displayed is slower than the predetermined reproduction speed. Is generated as a composite moving image. Therefore, the information distribution device 10 can improve the visibility of the selected content.

Although some of the embodiments of the present application have been described in detail with reference to the drawings, these are examples, and various modifications are made based on the knowledge of those skilled in the art, including the embodiments described in the disclosure column of the invention. It is possible to practice the present invention in other improved forms.

In addition, the above-mentioned "section, module, unit" can be read as "means" or "circuit". For example, the distribution unit can be read as a distribution means or a distribution circuit.

10 Information distribution device 20 Communication unit 30 Storage unit 31 Content database 32 Video database 40 Control unit 41 Acquisition unit 42 Specific unit 43 Selection unit 44 Generation unit 45 Distribution unit 100 User terminal 200 Mobile terminal

Claims (12)

Of the acquired images, a specific part that identifies the area in which a predetermined subject arranged continuously is captured, and
As the content to be displayed in the area specified by the specific unit, a selection unit that selects a plurality of images constituting a predetermined moving image and a selection unit.
A generation unit that generates an image in which different images from a plurality of images selected as the content by the selection unit are combined with each region specified by the specific unit.
An information distribution device including a distribution unit that distributes an image generated by the generation unit. The information distribution device according to claim 1, further comprising an acquisition unit that acquires an image captured by an image pickup device installed in a predetermined moving body. The information distribution device according to claim 2 , wherein the acquisition unit acquires an image captured by an imaging device installed in the drone as the predetermined moving body. The information distribution according to claim 2 or 3 , wherein the distribution unit distributes an image generated by the generation unit to the predetermined mobile body and displays it on a display device included in the predetermined mobile body. apparatus. The information distribution device according to any one of claims 1 to 4 , wherein the selection unit selects content to be displayed in an area specified by the specific unit based on the predetermined subject. .. The selection unit is one of claims 1 to 5 , characterized in that the selection unit selects the content to be displayed in the area specified by the specific unit based on the user to whom the image is distributed. The information distribution device described. The selection unit selects the content to be displayed in the area specified by the specific unit based on the position of the user to whom the image is delivered or the position where the predetermined moving body captures the image. The information distribution device according to any one of claims 1 to 6 , wherein the information distribution device is characterized. Claims 1 to 7 are characterized in that the selection unit selects the content to be displayed in the area specified by the specific unit based on the accumulation of time for each content to be displayed when the delivered image is reproduced. The information distribution device according to any one of them. The information distribution device according to any one of claims 1 to 8 , wherein the selection unit selects content including a moving image or a still image as the content to be displayed in the specified area. The generation unit is a moving image in which the content selected by the selection unit is synthesized in the region specified by the specific unit, and the reproduction speed during which the region in which the content is synthesized is displayed is a predetermined reproduction. The information distribution device according to any one of claims 1 to 9 , wherein a moving image slower than the speed is generated. It is an information distribution method executed by the information distribution device.
Among the acquired images, a specific step of specifying each region in which a predetermined subject arranged continuously is captured, and
A selection step of selecting a plurality of images constituting a predetermined moving image as contents to be displayed in the area specified by the specific step, and a selection step.
A generation step of generating an image in which different images from a plurality of images selected as the contents by the selection step are combined in each region specified by the specific step.
An information distribution method including a distribution step of distributing an image generated by the generation step. On the computer
Of the acquired images, a specific procedure for identifying the areas in which predetermined subjects arranged continuously are captured, and
A selection procedure for selecting a plurality of images constituting a predetermined moving image as contents to be displayed in the area specified by the specific procedure, and a selection procedure.
A generation procedure for generating an image in which different images from a plurality of images selected as the content by the selection procedure are combined in each area specified by the specific procedure, and a generation procedure.
An information distribution program for executing a distribution procedure for distributing an image generated by the generation procedure.

Images