JP5557325B2 - Information transmission display system - Google Patents

Description

  The present invention relates to an information transmission display system, and in particular, visual data defined by a digital code by displaying a digital code superimposed on a video in a first information display terminal and photographing the display screen by a second information display terminal. The present invention relates to an information transmission display system capable of reproducing additional information of audio data.

An information display device and an information acquisition device using a digital code such as a QR code (registered trademark) are known. If such a device is used, visual data defined by the digital code can be acquired from inside or outside the device and displayed by photographing the displayed digital code. Recently, advertising businesses using widgets and gadgets have appeared and are developing in the United States, etc., and are expected to develop in Japan in the future.

  Patent Document 1 discloses a terminal that detects additional information by reading a digital code (QR code) attached to an object using a camera or a code reader, and displays the additional information superimposed on a captured image of the object. Have been described. In this terminal, for example, when a person image is photographed with a camera, a frame image or a person name defined by a digital code assigned to the person image can be displayed superimposed on the photographing screen (person image).

  Patent Document 2 discloses information communication in which an image of a QR code is read, an image / sound is acquired from an image distribution source or an intermediary system via a network based on the QR code information, and the image is displayed on a mobile terminal. The method is described. According to this information communication method, for example, by capturing a QR code embedded in a TV advertisement with a camera of a mobile terminal, information related to the TV advertisement can be acquired via a network and displayed on the mobile terminal. it can.

  Patent Document 3 stores a bulletin image displayed on a bulletin board and additional information corresponding to the bulletin image, and a composite image in which additional information is added to the bulletin image when a photographed image including the bulletin image is received. An image processing apparatus that generates an image and transmits it to a mobile terminal is described. In this image processing apparatus, for example, a digital code is displayed as additional information on a digital signage (electronic signboard) in a town. When the display is photographed with a portable terminal and the photographed image is transmitted from the portable terminal to the image processing apparatus, the image processing apparatus generates a composite image in which computer graphics as visual data is superimposed on the peripheral part of the digital signage, and Send. In the portable terminal, the composite image can be viewed on the display unit.

  In Non-Patent Documents 1 and 2, a digital code (such as a QR code) on a first information display terminal (such as a TV screen) is photographed using a second information display terminal (such as a portable terminal), and the digital code recognition result Describes a system for superimposing additional information based on the captured image on the second information display terminal. Here, the digital code selected by the dedicated information transmission terminal is distributed over the network together with the video (advertisement) to the first information display terminal. The personal information of the mobile terminal can be integrated into the digital code.

JP 2008-193640 A JP 2006-295898 A JP 2008-46806 A

2010 Handout of KDDI R & D Lab at NAB: “Personalizataion TV” -Interactive TV Interface with Augmented Reality- KDDI R & D Co., Ltd. Press Release 2010/4/9: "Development of TV / mobile phone linkage technology using AR technology"-Intuitive operation of virtual interface on TV screen with mobile phone touch screen-

  In conventional information display devices and information acquisition devices using digital codes such as QR codes, visual data added by photographing digital codes added to portraits or TV advertisements is uniquely determined by digital codes. It is about the frame image, the explanatory text of the image and the URL on the Internet.

  In addition, in the systems described in Non-Patent Documents 1 and 2, since all additional information is distributed as a digital code from a dedicated information transmission terminal, it is necessary to determine the content of the additional information at the time of distribution. There is a problem that the additional information cannot be changed according to the usage history such as the situation. Further, the additional information is obtained by controlling visual data included as a digital code with personal information of the second information display terminal, and it is not assumed that the contents of other servers are referred to via the network.

  The present invention provides an information transmission display system in which a digital code is superimposed and displayed on a first information display terminal, and additional information defined by the digital code can be reproduced by photographing the display screen on the second information display terminal. It is an object of the present invention to make it possible to reproduce additional information adapted to viewer attributes and preferences with good performance.

In order to solve the above problems, the present invention includes an information transmission terminal, a first information display terminal, and a second information display terminal, and the information transmission terminal includes a video input transmission unit, a digital code transmission unit, and a profile creation unit. The video input sending unit includes means for receiving video from an external video content server, means for specifying a business ID associated with the received video, means for sending a business ID to the digital code sending unit, And means for sending the received video to the first information display terminal, wherein the digital code sending part is means for receiving a business ID from the video input sending part, a digital code linked to the business ID, and Means for obtaining a digital code ID, means for sending a digital code, a digital code ID and a business ID to the profile creation unit; and Means for sending a digital code to the first information display terminal, wherein the profile creating section receives means for receiving a digital code, a digital code ID and a business ID from the digital code sending section, and means for obtaining viewer information , Means for obtaining product information based on the provider ID and digital code ID, means for obtaining the display object and display object ID associated with the digital code and digital code ID, viewer information, product information, digital code, digital code Based on the ID and the display object ID, means for creating a profile that is specialized for each of the second information display terminals or a plurality of second information display terminals and associates the digital code with the display object, and the created profile and sends it to the second information display terminal And the first information display terminal includes means for receiving a video and a digital code from the information transmission terminal, and means for displaying the digital code superimposed on a display screen of the received video. The information display terminal has means for receiving a profile for the terminal from the information sending terminal, means for interpreting the received profile, means for obtaining a display object of the display object ID of the profile, and a digital code corresponding to the digital code ID. Means for obtaining, photographing means for photographing the display screen of the first information display terminal, referring to the profile , obtaining a display object associated with the digital code in the photographed display screen , and adding the display object The basic feature is that it has a means to superimpose and display information on the display screen. .

  According to the present invention, the information transmission terminal acquires viewer information and product information, creates a profile that associates a digital code with a display object based on the information, and transmits the profile to the second information display terminal. Therefore, the additional information adapted to each viewer can be displayed on the second information display terminal only by using a simple digital code.

  In addition, since the information transmission terminal is provided, various information acquired via the network can be used, so that it can be adapted to various services.

  In addition, even if the digital code is not changed, the display object for the digital code can be changed simply by changing the profile information, so that the cost of service operation can be reduced.

  Further, even if the same digital code is used, different profile information can be displayed for each of a plurality of viewers by changing the profile information.

  Further, the load of the additional information creation process is distributed between the information transmission terminal and the second information display terminal, or the viewer information of the plurality of second information display terminals is collected and analyzed by the information transmission terminal to obtain individual first information. Since it is possible to create additional information for two information display terminals, it is possible to construct a system that distributes additional information adapted to the attributes and preferences of viewers with good performance.

It is a block diagram which shows roughly the structure of the information transmission display system which concerns on this invention. It is a block diagram which shows the structure of an information transmission terminal in detail. It is a figure which shows the example of the profile information with respect to one digital code. It is a block diagram which shows embodiment at the time of applying this invention to a shirt stock information provision service. It is a block diagram which shows embodiment at the time of applying this invention to a hotel reservation information service. It is a block diagram which shows embodiment at the time of applying this invention to the navigation information provision service to a restaurant. It is a figure which shows the example of the display screen on which the digital code was superimposed and displayed on the advertisement image | video containing the map information of a restaurant in a 1st information display terminal. The block diagram which shows embodiment at the time of applying this invention to the service which analyzes the reference | history of the advertisement video in a some 2nd information display terminal, and provides merchandise information to each viewer according to the analysis result is there.

  The present invention will be described below with reference to the drawings. In the following, a case where additional information adapted to the viewer's attributes and preferences is displayed as an example for the advertisement video will be described as an example, but the present invention is not limited to the advertisement video, but other video (for example, a TV program or Internet video). It can also be applied to the case where other additional information such as the content is displayed.

  FIG. 1 is a block diagram schematically showing the configuration of an information transmission / display system according to the present invention. The information transmission display system of the present invention includes an information transmission terminal 1, a first information display terminal 2 such as a television, a personal computer or a digital signage (electronic signage), and a second information display terminal 3 such as a mobile phone or a smartphone.

  Here, one set of the first information display terminal 2 and the second information display terminal 3 is illustrated, but actually there are a plurality of sets of the first information display terminal 2 and the second information display terminal 3, Each second information display terminal 3 has a different viewer.

  The information transmission terminal 1 receives the advertisement video from the external video content server 4 such as a broadcast station, a relay station, or a video transmission server via a broadcast wave or a network, specifies a business ID associated with the advertisement video, Further, the digital code and the digital code ID associated with the business operator ID are acquired from the digital code DB 5, and the digital code is sent to the first information display terminal 2 together with the advertisement video.

  Since the digital code only needs to instruct the product information providing service of the business operator, the digital code may be a simple graphic such as a logo and may not include specific information. In addition, the digital code is not limited to visible but may be invisible. The visible digital code may be transmitted to the first information display terminal 2 together with the advertisement video by multiplexing the digital code image or the application for displaying the image into the advertisement video stream. Alternatively, it may be embedded in the advertisement video itself or superimposed on the advertisement video using a mechanism such as data broadcasting. On the other hand, the invisible digital code may be sent to the first information display terminal 2 by being embedded as an electronic watermark in an advertisement video, for example.

  Further, the information transmission terminal 1 generates a display object and a display object ID associated with the business operator ID and the digital code ID, and accumulates them in the display object DB8. If the display object and the display object ID have already been accumulated, it may be acquired. Furthermore, the information transmission terminal 1 creates a profile that associates the digital code with the display object.

  The profile is based on the display object obtained from the display object DB8 using the digital code ID, the viewer information stored in the viewer information DB6, the product information stored in the product information DB7, and the digital code ID. Created. A profile associates a digital code with a display object in common for each second information display terminal or for a plurality of second information display terminals. A profile for associating a digital code with a display object for each second information display terminal is a profile specific to each viewer, and a profile for associating a digital code with a display object for a plurality of second information display terminals is a plurality of viewing profiles. Profile common to all users.

  The viewer information can be obtained from the second information display terminal 3 or the server of the carrier (carrier) at the time of user registration, declaration, or timely. The viewer information includes viewer fixed information, viewer history information, and viewer current information (for example, dynamic information such as viewer current position information acquired by GPS). However, processing using dynamic viewer information such as the current viewer position can be performed in the second information display terminal 3. The viewer information may be acquired by the second information display terminal 3 by the push method or the pull method at a timing considering the update of the viewer information.

  The advertisement video and the digital code are transmitted to the first information display terminal 2 via a broadcast wave or a network, and the profile is transmitted to the second information display terminal 3 via the network. The profile is sent to the second information display terminal 3 by a push method or a pull method at a timing in consideration of profile update. A digital code is sent from the information sending terminal 1 to the second information display terminal 3.

  In FIG. 1, the digital code DB5, the viewer information DB6, the product information DB7, and the display object DB8 are all connected to the information transmission terminal 1 via the network, but some or all of them are information transmission. It may be built in the terminal 1.

  The first information display terminal 2 receives the advertisement video and the digital code from the information transmission terminal 1, and superimposes and displays the digital code on the display screen of the advertisement video. FIG. 1 shows a case where two digital codes are superimposed and displayed on an advertisement video.

  The second information display terminal 3 receives and interprets the profile from the information transmission terminal 1 and stores the display object with the display object ID described in the profile from the display object DB 8 through the information transmission terminal 1 or directly. . In addition, a display object may be acquired in advance. Thereby, the display object according to the product information and the viewer information related to the advertisement video, that is, the display object specialized for the viewer can be stored. The second information display terminal 3 may receive the profile by the push method or the pull method at a timing considering the profile update. Further, the second information display terminal 3 acquires a digital code corresponding to the digital code ID from the information transmission terminal 1.

  The second information display terminal 3 includes photographing means. Here, when the digital code superimposed on the display screen of the first information display terminal 2 is photographed, the second information display terminal 3 refers to the profile to obtain a display object corresponding to the digital code, and displays the display. The object is superimposed and displayed near the digital code on the shooting screen as additional information related to the advertisement video. Since this display object is specialized for the viewer according to the product information and the viewer information related to the advertisement video, it can be adapted to the attributes and preferences of the viewer.

  FIG. 2 is a block diagram showing in detail the configuration of the information transmission terminal. In addition, the same code | symbol is attached | subjected to the same or equivalent part as FIG. As shown in FIG. 2, the information transmission terminal 1 includes a video input transmission unit 11, a digital code transmission unit 12, and a profile creation unit 13.

  The video input / transmission unit 11 receives and analyzes the advertising video from the external video content server 4, and specifies the business operator ID associated with the advertising video. The video input / transmission unit 11 may acquire the advertisement video by the push method or the pull method at a timing in consideration of the contents of the video distribution service including the external video content server 4 and the request from the first information display terminal 2. For example, the company ID has a correspondence table of a company name, a product name, a trademark, and the company ID obtained by analyzing the advertisement video inside or outside the video input transmission unit 12 or the information transmission terminal 1. Can be specified. The video input / sending unit 11 sends the advertisement video to the first information display terminal 2 and sends the business ID to the digital code sending unit 12.

  The digital code sending unit 12 receives the business ID from the video input sending unit 11, searches the digital code DB 5 using the business ID, and acquires the digital code and the digital code ID. The digital code sending unit 12 sends the digital code to the first information display terminal 2, and sends the digital code and the digital code ID together with the business operator ID to the profile creating unit 13. The profile creation unit 13 receives the digital code, the digital code ID, and the business ID from the digital code transmission unit 12, generates a display object and a display object ID associated with the business ID and the digital code ID, and stores them in the display object DB8. accumulate. If the display object and the display object ID associated with the provider ID and the digital code ID are already stored in the display object DB 8, generation thereof is unnecessary.

  Further, the profile creation unit 13 acquires the viewer information from the viewer information DB 6 using the viewer ID, acquires the product information from the product information DB 7 using the provider ID and the digital code ID, and sets the digital code ID. The display object and the display object ID are acquired from the display object DB 8 and a profile for associating the digital code ID with the display object is created and sent to the second information display terminal 3. The profile creation unit 13 may create a profile by acquiring a display object and a display object ID by a push method or a pull method at a timing in consideration of updating of viewer information and product information.

  In the profile, a digital code (intermediate file name) and a display object ID, a display position and size, a display color, a display time, and the like may be described using the digital code ID as a key. If the viewer information is acquired in advance from the second information display terminal 3 or the server of the carrier (carrier) and stored in the viewer information DB 5, it can be acquired from the viewer information DB 5 using the viewer ID. The viewer information may be fixed or dynamic. In the case of dynamic viewer information, the viewer information may be acquired by a push method or a pull method at a timing that considers updating of the viewer information. However, it is preferable to perform processing for viewer information that changes from moment to moment, such as viewer position information, in the second information display terminal 3 as described later.

  The merchandise information is stored in advance in the merchandise information DB 7, and is acquired using the business operator ID and the digital code ID. The merchandise information stored in the merchandise information DB 7 may be acquired by the push method or the pull method at a timing that takes into account the merchandise information or profile update.

  Since the display object ID is specialized for each second information display terminal or a plurality of second information display terminals, the profile is common to each second information display terminal or a plurality of second information display terminals. Associate additional information with the digital code.

  As described above, the first information display terminal 2 displays the digital code superimposed on the display screen as a single screen. The digital code in the first information display terminal 2 may be superimposed and displayed without notice. For example, the first information display terminal 2 first displays a display permission inquiry screen or a message, and is displayed by the viewer. If superimposed display is performed through a procedure of waiting for a permission operation on the first information display terminal 2, the digital code can be superimposed and displayed only when necessary.

  As described above, the second information display terminal 3 receives and interprets the profile from the information sending terminal 1, and displays the display object with the display object ID described in the profile from the display object DB 8 through the information sending terminal 1 or directly. Acquire and memorize. Further, the second information display terminal 3 acquires a digital code corresponding to the digital code ID from the information transmission terminal 1. Here, when the digital code superimposed on the first information display terminal 2 is photographed, the display object corresponding to the digital code is displayed on the photographing screen of the second information display terminal 3 as a display object related to the advertisement video. It is displayed superimposed. The display object can be displayed in a superimposed manner by being synthesized on the shooting screen according to the profile.

  FIG. 3 is a diagram illustrating an example of profile information for one digital code. The intermediate file name of value [0] indicates a digital code ID, and the metasequoia file name of value [1] indicates a display object ID when a 3D image is superimposed on the digital code. The caption of value [3] indicates a display object ID when superimposing character information. Digital codes and display objects themselves are called by file designation. value [2], [4], and [5] indicate the display mode. In addition, value [6] indicates the address information (URL, e-mail address, telephone number, etc.) of the operator, and allows viewers to connect to the operator's website as necessary for product purchases. . If a music file name, its playback time, volume, repeat count, etc. are described in the profile, not only the image display but also only the music can be displayed (played back) as an additional information separately from the image display.

  Below, the specific example to which this invention is applied is demonstrated.

  FIG. 4 is a block diagram showing an embodiment when the present invention is applied to a shirt stock information providing service. According to this embodiment, shirt stock information of a size suitable for the viewer can be provided by referring to shirt stock information of the shirt manufacturer and the size of the viewer.

  Since this embodiment provides shirt stock information of a size suitable for the viewer, it can be connected to the shirt stock information management DB 9 of the shirt manufacturer. Other configurations are the same as those in FIG. Although the product information DB 7 is provided separately from the shirt manufacturer's shirt stock information management DB 9 here, the shirt stock information management DB 9 may also be used as the product information DB.

  The viewer sends fixed viewer information such as name, gender, and viewer ID to the information sending terminal 1 from the second information display terminal 3 at the time of user registration, and the shirt size only at the time of user registration or declaration. The viewer information is transmitted together with the viewer ID from the second information display terminal 3 to the information transmission terminal 1 (S11). The viewer information and the viewer ID are stored in the viewer information DB 6 (S12). Since the shirt size is almost fixed, it is stored in the viewer information DB 6 only at the time of user registration or declaration.

  The information transmission terminal 1 receives and analyzes the advertisement video from the external video content server 4 via the network (S13). Here, when the advertisement video is analyzed as an advertisement of a shirt manufacturer, a shirt manufacturer ID (operator ID) is acquired, and the digital code DB5 is searched using the shirt manufacturer ID (S14). Is acquired (S15). The digital code and the digital code ID indicate a shirt stock information providing service of the shirt manufacturer.

  Next, the information transmission terminal 1 searches the shirt manufacturer's shirt inventory information management DB 9 using the digital code ID (S16), and acquires shirt inventory information (shirt type, size, inventory quantity) (S17). The shirt stock information is accumulated in the product information DB 7 (S18). The shirt stock information accumulated in the product information DB 7 is updated every time shirt stock information is acquired from the shirt stock information management DB 9, for example, once / week.

  Further, the information sending terminal 1 acquires the viewer information from the viewer information DB 6 (S19), acquires the shirt inventory information from the product information DB 7 (S20), and uses the digital code ID to display the display object and the display object DB 8 from the display object DB 8. The display object ID is acquired (S21), and a profile that associates the digital code with the display object is created (S22).

  For example, if there is a shirt stock of the viewer's size, the profile and the display object are displayed as additional information such as “currently on sale” in the specified character color and character size, and “sold out” if the viewer's shirt stock is not available. Such additional information is created so as to be displayed in the designated character color and character size. As the shirt stock information is updated, the profile is updated, and the additional information changes accordingly.

  The information transmission terminal 1 transmits the advertisement video and the digital code to the first information display terminal 2 via the network (S23), and the profile is transmitted to the second information display terminal via the network, for example, once / week. Send to 3 (S24).

  The first information display terminal 2 receives the advertisement video and the digital code from the information transmission terminal 1, and superimposes and displays the digital code on the display screen of the advertisement video.

  The second information display terminal 3 receives and interprets the profile from the information transmission terminal 1 and stores the display object with the display object ID described in the profile from the display object DB 8 through the information transmission terminal 1 or directly. (S24). Thus, display objects corresponding to the viewer information and shirt stock information, that is, display objects of shirt stock information specialized for the viewer are accumulated. Further, the second information display terminal 3 acquires a digital code corresponding to the digital code ID from the information transmission terminal 1.

  When the digital code superimposed on the display screen of the first information display terminal 2 is photographed by the photographing means of the second information display terminal 3 (S25), the second information display terminal 3 refers to the profile and the digital code The display object corresponding to is called, and the display object is superimposed and displayed on the shooting screen as additional information related to the advertisement video. When the superimposed display object is tapped on the touch screen, it can be linked to the business destination information described in the profile.

  FIG. 5 is a block diagram showing an embodiment when the present invention is applied to a hotel booking information service. According to this embodiment, with reference to the hotel reservation information and the viewer's schedule, it is possible to provide recommendation information regarding the reservation to each viewer.

  Since the present embodiment provides hotel reservation information to the viewer, it can be connected to the hotel reservation information management DB 10. Other configurations are the same as those in FIG. Here, the product information DB 7 is provided separately from the hotel reservation information management DB 10, but the hotel reservation information management DB 10 may also be used as the product information DB.

  The viewer sends the fixed viewer information together with the viewer ID from the second information display terminal 3 to the information sending terminal 1 at the time of user registration, and also views the personal schedule within a certain period, for example, once / week. Is sent to the information sending terminal 1 as user information (S26). The viewer information and the viewer ID are stored in the viewer information DB 6 (S27).

  The information transmission terminal 1 receives and analyzes the advertisement video from the external video content server 4 via the network (S28). Here, when the advertisement video is analyzed as a hotel advertisement, the hotel ID is acquired, the digital code DB5 is searched using the hotel ID (S29), and the digital code and the digital code ID are acquired (S30). The digital code and the digital code ID indicate the reservation information providing service of the hotel.

  Next, the information transmission terminal 1 searches the hotel reservation information management DB 10 using the digital code ID (S31), and acquires hotel reservation information within a certain period (S32). The hotel reservation information is accumulated in the product information DB 7 (S33). The hotel reservation information stored in the product information DB 7 is updated, for example, once every week, when the hotel reservation information is acquired from the hotel reservation information management DB 10.

  Further, the information sending terminal 1 acquires the viewer information from the viewer information DB 6 (S34), acquires the hotel reservation information from the product information DB 7 (S35), and uses the digital code ID to display the display object and the display object from the display object DB 8. The display object ID is acquired (S36), and a profile for associating the digital code with the display object is created (S37).

  Profiles and display objects are displayed when, for example, a hotel has a vacancy on a viewer's unscheduled date, additional information such as “Reservation OK” is displayed in the specified character color and character size, and the hotel has no vacancy. Is created so that additional information, such as “It is full”, is displayed in the specified font color and font size. As the hotel reservation information is updated, the profile is updated, and the additional information changes accordingly.

  The information transmission terminal 1 transmits the advertisement video and the digital code to the first information display terminal 2 via the network (S38), and the profile is transmitted to the second information display terminal via the network, for example, once / week. Send to 3 (S39).

  The first information display terminal 2 receives the advertisement video and the digital code from the information transmission terminal 1, and superimposes and displays the digital code on the display screen of the advertisement video.

  The second information display terminal 3 receives and interprets the profile from the information transmission terminal 1 and stores the display object with the display object ID described in the profile from the display object DB 8 through the information transmission terminal 1 or directly. (S39). Thereby, display objects corresponding to the viewer information and hotel reservation information, that is, display objects of hotel reservation information specialized for the viewer are accumulated. Further, the second information display terminal 3 acquires a digital code corresponding to the digital code ID from the information transmission terminal 1.

  When the digital code superimposed on the display screen of the first information display terminal 2 is photographed by the photographing means of the second information display terminal 3 (S40), the second information display terminal 3 refers to the profile and the digital code The display object corresponding to is called, and the display object is superimposed and displayed on the shooting screen as additional information related to the advertisement video. As mentioned above, if the carrier's destination information (URL) is included in the profile, it is possible to connect to the hotel reservation site by selecting the caption when the additional information of “Reservation OK” is displayed superimposed. Become.

  FIG. 6 is a block diagram showing an embodiment when the present invention is applied to a navigation information providing service to restaurants (stores). According to this embodiment, it is possible to provide navigation information from the viewer's current location to the restaurant related to the advertisement video.

  Since the present embodiment provides navigation information to the viewer, it can be connected to the map information DB 14. Other configurations are the same as those in FIG. Although the product information DB 7 is provided separately from the map information DB 14 here, the map information DB 14 may be used as the product information DB.

  The viewer sends the fixed viewer information together with the viewer ID from the second information display terminal 3 to the information sending terminal 1 at the time of user registration (S41). This viewer information and viewer ID are stored in the viewer information DB 6 (S42). In the viewer information DB 6, for example, a category of a restaurant (Japanese food, Western food, Chinese food,...) Preferred by the viewer is stored as the viewer information.

  The information transmission terminal 1 receives and analyzes the advertisement video from the external video content server 4 via the network (S43). Here, when the advertisement video is analyzed, for example, as a restaurant advertisement, the restaurant ID is obtained, the digital code DB5 is searched using the restaurant ID (S44), and the digital code and the digital code ID are obtained (S45). ). The digital code and the digital code ID indicate the navigation information providing service of the restaurant.

  The information transmission terminal 1 searches the map information DB 14 by specifying the restaurant and region (latitude (min, max), longitude (min, max)) (S46), and acquires map information (product information) near the restaurant Then, the acquired map information is stored in the product information DB 7 (S48). The area ID can be used as a key for searching map information from the map information DB 14. In the product information DB 7, the map information (latitude (min, max), longitude (min, max)) and scale as well as the restaurant information (restaurant ID, GPS information (latitude, longitude), category ( Japanese food, Western food, Chinese food, ...), popularity, etc.) are accumulated. The map information stored in the product information DB 7 is updated, for example, once / month each time map information is acquired from the map information DB 14. Therefore, the map information stored in the product information DB 7 is updated to new information even if the restaurant address is changed.

  Further, the information sending terminal 1 acquires the viewer information stored in the viewer information DB 6 (S49), acquires the map information from the product information DB 7 (S50), and uses the digital code ID from the display object DB 8 The display object and the display object ID are acquired (S51), and a profile that associates the digital code with the display object is created (S52).

  The profile and display object display the additional information of the caption in the specified character color and size, and display the map near the restaurant with respect to the digital code, the position of the restaurant, and the additional information according to the viewer information. Created. The additional information of the caption is, for example, “Your current position”, and viewer information such as age and gender is used in creating a profile in order to change the character size, font, and the like. The profile is updated as the map information stored in the product information DB 7 is updated.

  The information transmission terminal 1 transmits the advertisement video and the digital code to the first information display terminal 2 via the network (S53), and the profile is transmitted to the second information display terminal via the network, for example, once / month. Send to 3 (S54).

  The first information display terminal 2 receives the advertisement video and the digital code from the information transmission terminal 1, and superimposes and displays the digital code on the display screen of the advertisement video.

  The second information display terminal 3 receives and interprets the profile from the information transmission terminal 1, and displays the display object with the display object ID described in the profile from the product information DB 7 and the display object DB 8 through the information transmission terminal 1 or directly. Acquire and accumulate (S54). As a result, the display object corresponding to the viewer information, that is, the additional information of the map specialized for the viewer is accumulated. Further, the second information display terminal 3 acquires a digital code corresponding to the digital code ID from the information transmission terminal 1.

  When the digital information superimposed on the display screen of the first information display terminal 2 is photographed by the photographing means of the second information display terminal 3 (S55), the second information display terminal 3 refers to the profile, and the digital code The display object corresponding to is called, and the display object is superimposed and displayed on the shooting screen as additional information related to the advertisement video.

  In addition, the second information display terminal 3 acquires the viewer's current position information (latitude and longitude) from time to time using the GPS provided in the terminal itself, and a 3D figure arrow heading from the viewer's current position to the restaurant position on the map And the arrow is displayed in real time according to the specified scale value. In this way, by causing the second information display terminal 3 to bear additional information generation processing for dynamically acquired viewer information, the processing load is distributed to the information transmission terminal 1 and the second information display terminal 3. Can do. Further, as described above, if the restaurant destination information (URL) is included in the profile, it is possible to connect to the restaurant site by the caption selection operation when the navigation information is displayed in a superimposed manner.

  FIG. 7 is a diagram illustrating an example of a display screen on the first information display terminal 2 in which a digital code is superimposed and displayed on an advertisement video including map information of a restaurant. If this digital code is photographed by the second information display terminal 3, the restaurant information on the map and the navigation information (3D arrow figure) from the current viewer position to the restaurant are displayed on the screen of the second information display terminal 3. Will be displayed. As shown in FIG. 7, when the advertisement video includes a map near the restaurant, the map information acquired from the map information DB 14 may correspond to it.

  As described above, in the present invention, information is acquired from various DBs in a timely manner, and display objects are displayed based on the information, so that not only fixed information but also dynamic information that changes over time (such as product and map information). (Information) can also display accurate display objects. Further, since the display object is displayed in consideration of the viewer information, additional information adapted to each viewer can be presented.

  In the present invention, an information transmission terminal that processes information acquired from various DBs and displays a display object adapted to each viewer is provided, so that the reference history of advertisement video at a plurality of second information display terminals at this information transmission terminal. And a display object for each second information display terminal can be generated according to the result of the aggregation.

  FIG. 8 shows an embodiment in which the present invention is applied to a service that analyzes reference histories of advertisement video on a plurality of second information display terminals and provides product information to each viewer according to the analysis result. FIG.

  In this embodiment, since supermarket product information is provided with priority given to viewers, it can be connected to a product information management DB 15 managed by the supermarket. Other configurations are the same as those in FIG. Here, the product information DB 7 is provided separately from the product information management DB 15, but the product information management DB 15 may be used as the product information DB.

  Each viewer sends the fixed viewer information together with the viewer ID from the second information display terminals 3-1, 3-2, 3-3,... To the information sending terminal 1 at the time of user registration, For example, once per week, the viewer information of the reference history of the advertisement video at each of the second information display terminals 3-1, 3-2, 3-3,... Is sent to the information sending terminal 1 (S56). . The viewer information and the viewer ID including the reference history are accumulated in the viewer information DB 6 (S57).

  The information transmission terminal 1 counts the number of times of reference for each product based on the reference history from the second information display terminals 3-1, 3-2, 3-3,.

  Further, the information transmission terminal 1 receives and analyzes the advertisement video from the external video content server 4 via the network (S58). Here, when the advertisement video is analyzed as a super advertisement, a super ID (operator ID) is obtained, the digital code DB5 is searched using the super ID (S59), and a digital code and a digital code ID are obtained. (S60). The digital code and the digital code ID indicate the product information providing service of the super.

  Next, the information transmission terminal 1 searches the product information DB 15 managed by the supermarket using the digital code ID (S61) and obtains bargain information (product ID, bargain period, discount amount) (S62). The bargain information is accumulated in the product information DB 7 (S63). The bargain information stored in the merchandise information DB 7 is updated, for example, once / week, every time bargain information is acquired from the merchandise information DB 15.

  Further, the information sending terminal 1 acquires the reference history at the second information display terminals 3-1, 3-2, 3-3,... From the viewer information DB 6 (S64), and the bargain information from the product information DB 7. (S65), the display object and the display object ID are acquired from the display object DB8 using the digital code ID (S66), and the second information display terminal 3 is further obtained based on the total result of the digital code ID and the reference history. A profile for associating a digital code with a display object is created for each of -1,3-2,3-3,... (S67).

  For profiles and display objects, the priority of services is determined based on the number of times of reference on the second information display terminals 3-1, 3-2, 3-3,... It is created to be displayed in character color and character size, and additional information such as “10% discount” or “20% discount” is added to the viewer with a high reference count in the specified character color and character size. Created to be displayed. The profile is updated with the update of the bargain information, and the display information changes accordingly.

  The information transmission terminal 1 transmits the advertisement video and the digital code to the first information display terminal 2 via the network (S68), and the profile is transmitted to the second information display terminal via the network, for example, once / week. Send to 3 (S69).

  The first information display terminal 2 receives the advertisement video and the digital code from the information transmission terminal 1, and superimposes and displays the digital code on the display screen of the advertisement video.

  The second information display terminal 3 receives and interprets the profile from the information transmission terminal 1 and stores the display object with the display object ID described in the profile from the display object DB 8 through the information transmission terminal 1 or directly. (S69). Thus, display objects corresponding to the viewer's reference history, that is, display objects for services specialized for the viewer are accumulated. Further, the second information display terminal 3 acquires a digital code corresponding to the digital code ID from the information transmission terminal 1.

  When the digital code superimposed on the display screen of the first information display terminal 2 is photographed by the photographing means of the second information display terminal 3 (S70), the second information display terminal 3 refers to the profile and the digital code The display object corresponding to is called, and the display object is superimposed and displayed on the shooting screen as additional information related to the advertisement video.

  Although the embodiment has been described above, the present invention is not limited to the above embodiment, and can be variously modified. For example, in the above embodiment, the second information display terminal 3 acquires a digital code together with the profile from the information transmission terminal 1, but the digital information is displayed on the screen of the first information display device by the second information display terminal 3. Since it is necessary for acquiring a display object after being photographed, it may be acquired from another timing, or from another DB. For example, the information may be acquired directly through the information transmission terminal 1 or from another DB at the timing when the digital code is transmitted by the information transmission terminal 1 or when the second information display terminal 3 requires the digital code. In this case, only the operator ID and the digital code ID need be transmitted from the digital code transmission unit 12 to the profile creation unit 13. Further, the number of digital codes to be superimposed and displayed on the advertisement video in the first information display terminal 2 is not limited to one or two, but is arbitrary. For example, display objects having different product information can be associated with each digital code. In addition, the advertisement video from the information transmission terminal 1 may be sent when requested like a VOD (pull method), or may be broadcast all together like a broadcast (push method). . Also, the route and medium through which the advertisement video is transmitted is arbitrary.

  Furthermore, the video input transmission unit 11, the digital code transmission unit 12, and the profile creation unit 13 may be configured as individual devices or as an arbitrary combination of devices. That is, it is arbitrary what unit the elements constituting the information transmission terminal 1 are configured as.

  The information transmission and display system according to the present invention can be applied to targeted advertisement distribution with a high visual effect to a television, a set top box, a digital signage, or the like.

1 ... information transmission terminal, 2 ... first information display terminal, 3,3-1,3-2,3-3 ... second information display terminal, 4 ... external video content server, 5 ... Digital code DB, 6 ... Viewer information DB, 7 ... Product information DB, 8 ... Display object DB, 9 ... Shirt inventory management DB, 10 ... Hotel reservation information management DB 11 ... Video input sending unit, 12 ... Digital code sending unit, 13 ... File creation unit, 14 ... Map information DB, 15 ... Product information management DB managed by super

Claims (30)

An information transmission terminal, a first information display terminal and a second information display terminal;
The information transmission terminal includes a video input transmission unit, a digital code transmission unit, and a profile creation unit,
The video input / transmission unit includes means for receiving video from an external video content server, means for specifying a business ID associated with the received video, means for transmitting the business ID to the digital code transmission unit, and reception Means for sending the recorded video to the first information display terminal,
The digital code sending unit is a means for receiving a business ID from the video input sending unit, a means for obtaining a digital code and a digital code ID associated with the business ID, and creating the profile with the digital code ID and the business ID. Means for sending to the unit, and means for sending the digital code to the first information display terminal,
The profile creation unit includes means for receiving a digital code ID and a business ID from the digital code sending unit, means for obtaining viewer information, means for obtaining product information based on the business ID and digital code ID, digital Based on the display object and display object ID associated with the code ID, viewer information, product information, digital code ID and display object ID, each second information display terminal or a plurality of second information display terminals Means for creating a profile that is specialized in common and associates a digital code with a display object, and means for sending the created profile to the second information display terminal;
The first information display terminal includes means for receiving a video and a digital code from the information transmission terminal, and means for displaying the digital code superimposed on a display screen of the received video.
The second information display terminal corresponds to means for receiving a profile for the terminal from the information sending terminal, means for interpreting the received profile, means for obtaining a display object of the display object ID of the profile, and digital code ID Means for obtaining a digital code, photographing means for photographing the display screen of the first information display terminal, referring to the profile , obtaining a display object associated with the digital code in the photographed display screen , and displaying the display object An information sending / displaying system comprising means for displaying an object superimposed on a display screen as additional information. The information according to claim 1, wherein the digital code sending unit further sends a digital code to the profile creating unit, and the profile creating unit sends the digital code to the second information display terminal. Delivery display system.   2. The information transmission / display system according to claim 1, wherein the digital code transmission unit transmits the digital code as a visible marker image, and the first information display terminal displays the digital code visually.   2. The information according to claim 1, wherein the digital code sending unit sends the digital code embedded in a video as an invisible marker image of a digital watermark, and the first information display terminal displays the digital code invisible. Delivery display system.   The information transmission / display system according to claim 1, wherein the video input transmission unit, the digital code transmission unit, and the profile creation unit are configured as individual devices or arbitrarily combined.   The information transmission / display system according to claim 1, wherein the viewer information is viewer fixed information, viewer history information, or viewer current information.   The information transmission / display system according to claim 1, wherein the video input / transmission unit receives a video from an external video content server by a push method or a pull method at a timing in consideration of updating of viewer information and a profile. .   The information transmission / display system according to claim 1, wherein the profile creation unit acquires viewer information from the second information display terminal or a viewer information database.   The information transmission / display system according to claim 1, wherein the viewer information includes fixed information and dynamic information.   7. The information transmission / display system according to claim 6, wherein the profile creation unit acquires the viewer information by a push method or a pull method at a timing considering updating of the viewer information.   2. The information transmission / display system according to claim 1, wherein the profile creation unit acquires product information from a product information database in the information transmission terminal or outside using the company ID and the digital code ID.   10. The information transmission / display system according to claim 9, wherein the profile creation unit acquires product information by a push method or a pull method at a timing in consideration of product information and profile update.   The information transmission display system according to claim 1, wherein the profile creation unit acquires a display object and a display object ID from a display information database in the information transmission terminal or outside using the digital code ID.   12. The information transmission and display system according to claim 11, wherein the profile creation unit acquires a display object and a display object ID by a push method or a pull method at a timing in consideration of profile update.   2. The information transmission display system according to claim 1, wherein the profile creation unit creates a profile in which a display object when the digital code is recognized is described by using the digital code ID as a key.   2. The information transmission / display system according to claim 1, wherein the profile creation unit creates a profile indicating one or both of a superimposed figure and reproduced sound corresponding to a digital code.   The profile creating unit creates a profile that indicates a superimposed graphic corresponding to a digital code, and further indicates at least one of an effect including a display position and a display size of the superimposed graphic and a link destination URL. 1. The information transmission display system according to 1.   The profile creation unit associates display objects with a plurality of viewer information acquired from the plurality of second information display terminals when creating a profile specialized for the plurality of second information display terminals in common. 14. The information transmission / display system according to claim 13, wherein a profile is created.   The profile creation unit creates a profile in which a display object is associated with each viewer information acquired from each second information display terminal when creating a profile specialized for each second information display terminal. The information transmission display system according to claim 13.   14. The information transmission / display system according to claim 13, wherein the profile creating unit associates a display object with dynamic viewer information acquired from the second information display terminal.   The profile creation unit aggregates and analyzes the history information of the second information display terminal, and in accordance with the analysis result, a profile in which a display object of a preferential service is associated with a viewer who frequently accesses the specific product. 14. The information transmission display system according to claim 13, wherein the information transmission display system is created.   The information transmission / display system according to claim 1, wherein the profile creation unit creates a profile at a timing in consideration of updating of viewer information and product information.   12. The information transmission / display system according to claim 11, wherein the profile creation unit transmits a profile to the second information display terminal by a push method or a pull method at a timing in consideration of profile update.   The information transmission display system according to claim 1, wherein the second information display terminal receives the profile by a push method or a pull method at a timing in consideration of profile update.   2. The information transmission / display system according to claim 1, wherein the second information display terminal acquires the viewer information by a push method or a pull method at a timing considering updating of the viewer information.   The information transmission display system according to claim 1, wherein the second information display terminal includes means for acquiring the current position of the terminal as viewer information. The second information display terminal, the first information display by taking a screen including a digital code that is displayed on the terminal recognizes the digital code, the display object that is correlated to the digital code by referring to the profile information delivery display system according to claim 1, acquired, characterized in that it is superimposed as additional information in the vicinity digital code in the photographed screen the display object.   15. The information transmission display according to claim 14, wherein when the profile indicates both a superimposed figure corresponding to a digital code and a reproduced voice, the second information display terminal displays the superimposed figure and reproduces the voice. system. The second information display terminal, information delivery display system according to claim 1, characterized in that to obtain a display object of the display object ID of the profile from the database of the external. 30. The information transmission / display system according to claim 29 , wherein the external database is an internal database or an external database.

Images