KR102705894B1 - System and method for controlling the output of advertisements in a vehicle - Google Patents

Abstract

A vehicle advertisement output control system and method according to some embodiments of the present invention are provided. A vehicle advertisement output control system according to some embodiments includes: a sensing module configured to sense a surrounding environment of a vehicle having at least one display configured to generate surrounding environment information; an object identification module including a product information generation unit configured to analyze the surrounding environment information to generate product information related to an identified object; and an advertisement output module configured to determine a main product based on the product information, generate advertisement content related to the determined main product, and output the generated advertisement content to the at least one display.

Description

{System and method for controlling the output of advertisements in a vehicle}

The present invention relates to a system and method for controlling the output of advertisements output from a vehicle. Specifically, the present invention relates to a system and method for controlling the output of advertisements displayed on a display placed in a vehicle based on information sensed from the environment surrounding the vehicle.

The material described in this section merely provides background information for the present embodiment and does not constitute prior art.

With the 4th industrial revolution, there is a conceptual change in vehicles (mobility), especially from “owning” a vehicle to “using” or “sharing” a vehicle, and the related market and related services are experiencing explosive growth.

In particular, since multiple users may use shared vehicles for various purposes, the development of purpose-built vehicles (PBVs) is actively underway to meet the diverse mobility purposes and diverse needs of users.

PBV can be placed inside and outside the vehicle with various types and features of displays (PDLC, flexible display, transparent display, projector, etc.). Compared to conventional analog information display, PBV can be controlled to provide more diverse information according to the driving purpose and situation. This versatility of PBV has brought about technological advancements that can provide more diverse advertising content according to the surrounding situation or user needs.

Accordingly, the applicant of the present invention proposed a system that can generate and provide advertisements based on information related to PBV, thereby delivering effective advertisements to objects around a vehicle and increasing the effectiveness of the advertisements.

The object of the present invention is to provide a system and method for controlling the output of advertisements displayed on a display placed in a vehicle based on information sensed from the environment surrounding the vehicle.

The purposes of the present invention are not limited to the purposes mentioned above, and other purposes and advantages of the present invention which are not mentioned can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. In addition, it will be easily understood that the purposes and advantages of the present invention can be realized by the means and combinations thereof indicated in the claims.

A vehicle advertisement output control system according to some embodiments of the present invention includes: a sensing module configured to sense a surrounding environment of a vehicle having at least one display configured to generate surrounding environment information; an object identification module including a product information generation unit configured to analyze the surrounding environment information to generate product information related to an identified object; and an advertisement output module configured to determine a main product based on the product information and generate advertisement content related to the determined main product and output it to the at least one display.

In addition, the product information generation unit may include an artificial intelligence-based product information generation model that is learned in advance to analyze the surrounding environment information and generate product information including at least the type and name of the product.

In addition, the advertisement output module may further include an advertisement target selection unit that counts the number of times a product according to the product information is identified during a preset period, and determines a product for which the counted number of times exceeds a preset threshold as the main product.

In addition, a data collection module configured to collect product content related to a product from an external server; and a database in which product content is stored for each of a plurality of product accounts, wherein the product content includes a product image, a product video, a product description, and a conventional product advertisement, and the database includes a template library including a plurality of templates for generating advertisement content, and the data collection module updates the product content by storing the collected product content in a corresponding product account of the database, and the data collection module can create a product account and store the product content if a product account corresponding to the collected product content is not confirmed in the database.

In addition, the advertisement output module may further include an advertisement copy planning unit that determines advertisement copy for the main product; a template determination unit that determines a template corresponding to the main product; and an advertisement generation unit that generates advertisement content based on the advertisement copy, the template, and product content corresponding to the main product.

In addition, the surrounding environment information includes image information that captures the surrounding environment of the vehicle, and the object identification module may further include a building information generation unit that generates surrounding building information of the vehicle based on a building object identified in the image information; a weather information generation unit that generates weather information of the surrounding vehicle based on a natural object identified in the image information; and a location information generation unit that generates location information of the vehicle based on the surrounding building information.

In addition, the advertisement copy planning unit may plan the advertisement copy by further considering at least one of the location information of the vehicle, the information on surrounding buildings of the vehicle, and the weather information of the vehicle, the template determining unit may determine the template by further considering at least one of the location information of the vehicle, the information on surrounding buildings of the vehicle, and the weather information of the vehicle, and the advertisement generating unit may generate the advertisement content by further considering at least one of the location information of the vehicle, the information on surrounding buildings of the vehicle, and the weather information of the vehicle.

In addition, the at least one display is disposed outside the vehicle and further includes a gaze tracking module that tracks the gaze of an outsider to the at least one display, and the gaze tracking module can determine a main product included in the advertising content as a product of interest when the gaze of the outsider remains on the at least one display for a reference time period.

In addition, the advertisement output module can render the product of interest as a three-dimensional graphic object to configure the product of interest as a three-dimensional product of interest, and display the configured three-dimensional product of interest together on the advertisement content.

In addition, the gaze tracking module may be further configured to recognize a gesture of the outsider with respect to the three-dimensional object of interest, and the advertisement output module may be further configured to provide at least one of enlargement, rotation, and additional information of the three-dimensional object of interest according to the gesture of the outsider.

A method for controlling advertisement output of a vehicle according to some embodiments of the present invention is a method for controlling advertisement output of a vehicle performed in an advertisement output control system of a vehicle, comprising: a step of sensing a surrounding environment of a vehicle having at least one display configured therein to generate surrounding environment information; a step of analyzing the surrounding environment information to generate product information related to an identified object; a step of determining a main product based on the product information; and a step of generating advertisement content related to the determined main product and outputting the advertisement content to the at least one display.

A method and system for controlling advertisement output of a vehicle according to some embodiments of the present invention can identify major products located around a vehicle and provide advertisement content related thereto to people around the vehicle, thereby helping to further enhance the advertising and promotional effect of the relevant products.

In addition, the method and system for controlling advertisement output of a vehicle according to the embodiment analyzes information about other objects around the vehicle, and reflects such object information in advertisement content to provide advertisement content reflecting information about the current surrounding situation to people around the vehicle, thereby helping people around the vehicle focus more attention on the advertisement content.

In addition, the method and system for controlling advertisement output of a vehicle according to the embodiment can track the gaze of an outsider on the advertisement content being output, and if it is determined that the outsider is interested, implement a main object of the advertisement content as a three-dimensional stereoscopic model and output it, thereby supporting further interaction between the outsider and the main object implemented as a three-dimensional stereoscopic model.

In addition, the vehicle advertisement output control method and system according to the embodiment can recognize an outsider's gesture for a key object implemented as a three-dimensional stereoscopic model, change the three-dimensional stereoscopic model in response to the gesture, and output it, thereby supporting providing an outsider with more diverse information related to the product.

In addition, the advertisement output control system and method according to the embodiment can collect product keywords searched in the relevant area from the web, search platforms, SNS, etc. by considering the location information of the vehicle, and can determine major products based on the keywords and generate advertisements. In other words, it can support generating advertisements for products of interest among online users.

In addition to the above-described contents, the specific effects of the present invention are described together with the specific matters for carrying out the invention below.

FIG. 1 is an exemplary diagram illustrating the configuration of an advertisement output control system for a vehicle according to some embodiments of the present invention.
FIG. 2 is an exemplary diagram illustrating a process of generating surrounding environment information and generating advertising content based on the generated surrounding environment information in some embodiments of the present invention.
FIG. 3 is an exemplary diagram illustrating the operation of a product information generation model, a building information generation model, and a location information generation model according to some embodiments of the present invention.
FIG. 4 is an exemplary diagram for explaining the operation and function of an advertisement target selection unit according to some embodiments of the present invention.
FIG. 5 is an exemplary diagram illustrating the operation and function of a data collection module according to some embodiments of the present invention.
FIG. 6a is an exemplary diagram illustrating a process for generating advertising content for a main product in some embodiments of the present invention.
FIG. 6b is an exemplary diagram illustrating a process for generating advertising content by considering main products, building information, location information, and weather information in some embodiments of the present invention.
FIG. 7 is an exemplary diagram illustrating a relationship between an external pedestrian interacting with advertising content output from a display of a vehicle, in some embodiments of the present invention.
FIG. 8 is an exemplary diagram for explaining a process of controlling advertising content output based on the gaze of an external pedestrian in some embodiments of the present invention.
FIG. 9 is an exemplary diagram for explaining a state in which a three-dimensional object of interest is provided in some embodiments of the present invention.
FIG. 10 is an exemplary diagram illustrating a process of controlling a three-dimensional object of interest based on a gesture of an external pedestrian, in some embodiments of the present invention.
FIG. 11 is an exemplary diagram illustrating a state in which a three-dimensional object of interest is controlled in response to a gesture of an external pedestrian in some embodiments of the present invention.
FIG. 12 is an exemplary diagram for explaining a process of collecting information according to location information online and generating advertising content based on the information, in some embodiments of the present invention.

The terms or words used in this specification and the claims should not be interpreted as limited to their general or dictionary meanings. In accordance with the principle that the inventor can define the concept of a term or word in order to best explain his or her invention, they should be interpreted as meanings and concepts that are consistent with the technical idea of the present invention. In addition, the embodiments described in this specification and the configurations illustrated in the drawings are only one embodiment in which the present invention is realized, and do not represent the entire technical idea of the present invention, so it should be understood that there may be various equivalents, modifications, and applicable examples that can replace them at the time of this application.

The terms first, second, A, B, etc., used in this specification and claims may be used to describe various components, but the components should not be limited by the terms. The terms are used only to distinguish one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term "and/or" includes any combination of a plurality of related listed items or any item among a plurality of related listed items.

The terms used in this specification and claims are used only to describe specific embodiments and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. It should be understood that the terms "comprise" or "have" in this application do not exclude in advance the possibility of the presence or addition of features, numbers, steps, operations, components, parts or combinations thereof described in the specification.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and will not be interpreted in an idealized or overly formal sense unless expressly defined in this application.

In addition, each configuration, process, procedure or method included in each embodiment of the present invention may be shared within a scope that is not technically contradictory to each other.

Hereinafter, with reference to FIGS. 1 to 12, a vehicle advertisement output control system according to some embodiments of the present invention will be described.

FIG. 1 is an exemplary diagram for explaining the configuration of an advertisement output control system for a vehicle according to some embodiments of the present invention. FIG. 2 is an exemplary diagram for explaining a process of generating surrounding environment information and generating advertisement content based on the generated surrounding environment information in some embodiments of the present invention. FIG. 3 is an exemplary diagram for explaining the operation of a product information generation model, a building information generation model, and a location information generation model according to some embodiments of the present invention. FIG. 4 is an exemplary diagram for explaining the operation and function of an advertisement target selection unit according to some embodiments of the present invention. FIG. 5 is an exemplary diagram for explaining the operation and function of a data collection module according to some embodiments of the present invention. FIG. 6a is an exemplary diagram for explaining a process of generating advertisement content for a major product according to some embodiments of the present invention. FIG. 6b is an exemplary diagram for explaining a process of generating advertisement content by considering a major product, building information, location information, and weather information according to some embodiments of the present invention. FIG. 7 is an exemplary diagram for explaining a relationship between advertisement content output on a display of a vehicle and an external pedestrian interacting with it according to some embodiments of the present invention. FIG. 8 is an exemplary diagram for explaining a process of controlling advertisement content output based on the gaze of an external pedestrian according to some embodiments of the present invention. FIG. 9 is an exemplary diagram for explaining a state in which a three-dimensional object of interest is provided in some embodiments of the present invention. FIG. 10 is an exemplary diagram for explaining a process of controlling a three-dimensional object of interest based on a gesture of an external pedestrian in some embodiments of the present invention. FIG. 11 is an exemplary diagram for explaining a state in which a three-dimensional object of interest is controlled in response to a gesture of an external pedestrian in some embodiments of the present invention. FIG. 12 is an exemplary diagram for explaining a process of collecting information according to location information online and generating advertising content based on the information in some embodiments of the present invention.

Referring to FIG. 1, a vehicle advertisement output control system (10) includes a vehicle (100), a sensing module (110), an object identification module (120), an advertisement output module (130), an eye tracking module (140), a data collection module (150), a database (160), and a display unit (170).

In some embodiments, the vehicle advertisement output control system (10) can dynamically provide advertisement content to passengers of the vehicle (100) or pedestrians outside the vehicle (100). The vehicle advertisement output control system (10) can provide advertisement content related to a specific product selected according to a request (command) of a passenger or pedestrian of the vehicle (100) through a display (170) positioned inside or outside the vehicle. In addition, the vehicle advertisement output control system (10) can select an advertisement target product based on the environment surrounding the vehicle, newly generate and configure advertisement content based on information about the environment surrounding the vehicle, and provide such advertisement content through the display (170).

The vehicle (100) refers to a multipurpose vehicle, a purpose-based vehicle (PBV), which can provide functions corresponding to the user's purpose and needs. In addition, the vehicle (100) may refer to a multipurpose vehicle (MPV) that can be utilized for various purposes, and may be flexibly changed to provide various services or be utilized for various purposes through the configuration described below. That is, the vehicle (100) may provide services that suit various purposes along with the driving function, which is the basic function of the vehicle. The internal configuration of the vehicle (100) may be freely changed to provide such multipurpose services. Various configurations (seats, storage devices, electronic devices, etc.) may be arranged in the internal interior space (cabin) of the vehicle (100), and these configurations may be provided differently depending on the service. The display (170) may be arranged in at least one of the interior and exterior of the vehicle (100), and may provide information related to a multipurpose service or output advertising content.

For example, the display (170) may be arranged on at least one of the front, left side, right side, and rear side of the vehicle (100), and may be configured to output information or content according to each location. For example, the display arranged on the left side of the vehicle (100) may output information for providing to a vehicle driving in an opposite lane or a left lane, and the display arranged on the right side of the vehicle (100) may output information for a vehicle driving in a right lane or a pedestrian. In addition, the display arranged on the rear side of the vehicle (100) may output information to a following vehicle, and the front side may output information to a vehicle driving in an opposite lane. In an exemplary embodiment, at least one of the output status and content of the displayed content may be controlled to be automatically changed according to the location and external surface of the vehicle (100) on which the display (170) is arranged. For example, the display displayed toward an opposite vehicle may be controlled to output image content rather than video content.

The sensing module (110) may be a sensing device for driving the vehicle (100). Here, the vehicle (100) may be an autonomous vehicle that operates autonomously. That is, autonomous driving of the vehicle (100) may be performed based on information collected through the sensing module (110). In addition, the sensing module (110) may recognize changes in the speed of the vehicle (100) and changes in the main components of the vehicle (100). In addition, the sensing module (110) may be configured to include at least one of a vision sensor, a lidar sensor, a radar sensor, and an infrared sensor. The sensing module (110) may detect the surrounding environment using various sensors and generate surrounding environment information including information related to a plurality of objects located in the surrounding environment. In some embodiments, the sensing module (110) may include a vision sensor and may generate surrounding environment information corresponding to an image captured to include a plurality of objects located in the surrounding of the vehicle (100).

The object identification module (120) can analyze the surrounding environment information provided by the sensing module (110) to identify and analyze objects located in the environment around the vehicle. The object identification module (120) can include a product information generation unit (121), a location information generation unit (122), a building information generation unit (123), and a weather information generation unit (124).

The product information generation unit (121) can identify products existing around the vehicle based on the surrounding environment information and generate information on the identified products. The location information generation unit (122) can generate location information of the vehicle based on the surrounding environment information. The building information generation unit (123) can generate building information around the vehicle based on the surrounding environment information. The weather information generation unit (124) can generate weather information around the vehicle based on the surrounding environment information.

Referring to FIG. 2, it can be seen that a plurality of objects are located in the surrounding environment of the vehicle (100). The plurality of objects may include a pedestrian (P) walking on the sidewalk surrounding the vehicle (100), a product (O1) carried by the pedestrian, a building (O2) located around the vehicle (100), and a natural object (O3) around the vehicle (100). The sensing module (110) may generate surrounding environment information to include information related to the plurality of objects existing around the vehicle (100).

The product information generation unit (121) may include a product information generation model (OD1). The product information generation model (OD1) may be an artificial intelligence learning model that has been trained in advance to identify a product included in the surrounding environment information and to configure product information related to the identified product.

Referring to (a) of FIG. 3, the surrounding environment information may be an image captured around the vehicle (100), and the product information generation model (OD1) may be an identification model learned to analyze the surrounding environment information (image). The product information generation model (OD1) may identify a product from the input image. The product may be a product possessed by a user around the vehicle (100), but is not limited thereto. The product may be a product placed or displayed in a building around the vehicle (100) or a product output from an advertisement board of a building around the vehicle (100). In addition, the product may be a product derived from a signboard placed in a building around the vehicle (100). For example, a chicken restaurant may be located in a building around the vehicle (100), and chicken may be identified as a product by looking at the signboard of the chicken restaurant.

The product information generation model (OD1) can identify a product in an image, determine the type and name of the product, and compile the determined information to configure product information. The type of the product may mean a general name, such as a bag, a watch, a hat, etc., and the name of the product may mean a brand of the product. In some embodiments, the name of the product may include brand information and a defined product item name for distinguishing products from the same brand. For example, the product information may be configured as “Product type: Bag - Product name: (LX Company - Alma DD)”. In addition, the name of the product may include brand information and a detailed type of the product. For example, the product information may be configured as “Product type: Bag - Product name: (LX Company - Tote Bag)”.

As illustrated in FIG. 2, the product information generation unit (121) can provide the generated product information to the advertisement output module (130), and the advertisement output module (130) can output advertisement content related to the identified product. If the advertisement content corresponding to the identified product is prepared in advance, the advertisement output module (130) can output the corresponding advertisement content. However, if the advertisement content corresponding to the identified product is not prepared, the advertisement output module (130) can newly generate advertisement content corresponding to the identified product and output the generated advertisement content through the display (170). The process of generating advertisement content will be described in more detail later.

Again, referring to FIG. 3, the building information generation unit (123) may include a building information generation model (OD2), the location information generation unit (122) may include a location information generation model (OD3), and the weather information generation unit (124) may include a weather information generation model (OD4).

The building information generation model (OD2) may be an artificial intelligence learning model that is trained in advance to identify a building included in the surrounding environment information and to configure building information related to the identified building. Referring to (b) of FIG. 3, the surrounding environment information may be an image captured around the vehicle (100), and the building information generation model (OD2) may be an identification model that is trained to analyze the surrounding environment information (image). The building information generation model (OD2) may identify a building in an input image, determine the type of the building and the name of the building, and configure building information by collecting the determined information. In an embodiment, the type of the building may be defined according to the size of the building or the purpose of the building, and the name of the building may be a general name, but is not limited thereto, and may include a unique name of the building. For example, the identified building may be the Trade Tower near Samseong Station, and the type of the building may be determined as a large building and the name of the building may be determined as Trade Tower.

The location information generation model (OD3) may be an artificial intelligence learning model that has been previously trained to generate location information based on building information. Referring to (c) of Fig. 3, the location information generation model (OD3) may receive building information, determine location information of the building based on the input building information, and generate current location information of the vehicle (100) based on the determined location of the building and the distance difference between the building and the vehicle.

The weather information generation model (OD4) may be an artificial intelligence learning model that is learned in advance to identify natural objects included in the surrounding environment information and to configure weather information based on the identified natural objects. Referring to (d) of FIG. 3, the surrounding environment information may be an image captured around the vehicle (100), and the weather information generation model (OD4) may be an identification model that is learned to analyze the surrounding environment information (image). The weather information generation model (OD4) may identify natural objects in the input image, determine the weather condition and the degree of the weather, and compile the determined information to configure weather information. In the embodiment, the weather condition may indicate one of clear, cloudy, overcast, snow, thunder, lightning, or rain, and the natural object may mean the sun, cloudy, rain, etc. that may determine the weather condition. In addition, the degree of the weather may mean the degree of the weather in the determined state.

The advertisement output module (130) can identify a main product among the identified products and can newly generate advertisement content corresponding to the main product. Here, the advertisement output module (130) can newly generate advertisement content by using at least one of the location information determined by the location information generation unit (122), the building information determined by the building information generation unit (123), and the weather information determined by the weather information generation unit (124), and can output the generated advertisement content through the display (170).

The advertisement output module (130) may include an advertisement target selection unit (131), an advertisement copy planning unit (132), a template determination unit (133), and an advertisement creation unit (134).

The advertising target selection unit (131) counts the number of times a product is identified according to product information during a preset period, and can determine a product whose counting number exceeds a preset threshold as a main product.

Referring to FIG. 4, the product information generation unit (121) of the object identification module (120) can generate a plurality of product information, first to nth product information. Here, n is a natural number greater than or equal to 2. The first to nth product information may be product information collected for a preset time or a preset distance. The advertisement target selection unit (131) can receive the first to nth product information and count the number of times a product according to the product information is identified for a preset period. In the example of FIG. 4, the advertisement target selection unit (131) classifies products according to product information and counts the number of times they are identified. The advertisement target selection unit (131) can determine a product whose counting number exceeds a preset threshold as a main product.

In some embodiments, the main product may refer to a product that is frequently identified in the surrounding environment of the vehicle (100), and may be a product that both passengers of the vehicle (100) and pedestrians in the surrounding area may be interested in. Accordingly, as advertisements for the product are provided through the vehicle (100), the promotional effect for the product may be further enhanced.

In the example of Fig. 4, the advertisement target selection unit (131) can select a product corresponding to the product name (LX) and product type (bag) as the main product. The advertisement copy planning unit (132), template determination unit (133), and advertisement creation unit (134) create advertisement content corresponding to the selected main product.

The creation of advertising content corresponding to a main product can be created based on product content collected from an external server (180) through a data collection module (150).

Referring to FIG. 5, the data collection module (150) can collect and crawl product content corresponding to a product from an external server (180). The external server (180) may refer to a server that provides an online environment in which multiple users can use and exchange information with each other. The collection activity of the data collection module (150) may be performed in response to a preset cycle or a command of the advertisement output module (130). The product input to the data collection module (150) may be a keyword for the product, but is not limited thereto, and may be an image of the product. That is, the data collection module (150) may collect product content corresponding to the product keyword from the external server (180), or product content corresponding to the product image from the external server (180). The external server (180) may be a server of a brand company related to the product, a portal server that allows free searches related to the product, or an SNS server where multiple users share information related to the product, but is not limited thereto.

In addition, in some embodiments, the external server (180) may request an advertisement for a specific product from the system (10) of the present invention, or may be a server of a product seller affiliated with the system (10) of the present invention. That is, the product seller may request an advertisement for a specific product from the system (10) of the present invention, or may have entered into an alliance for the advertisement, and may provide product content for this purpose, or may have permitted the data collection module (150) to crawl the product content.

The data collection module (150) can collect product images, product videos, and product descriptions corresponding to the product as product content from an external server (180). The data collection module (150) can collect product advertisements corresponding to the product from an external server (180). Here, the product advertisements can include advertisement videos, advertisement images, and advertisement text related to products that have been provided to the public in the past. Here, the product descriptions can include descriptions of the product itself and descriptions for evaluating the product.

The data collection module (150) can store the collected information in the product content storage unit (161) of the database (160). The product content storage unit (161) can store product content for each of a plurality of product accounts. In the example of FIG. 5, the first to kth product contents corresponding to the first to kth products can be stored in the product content storage unit (161). The data collection module (150) can collect product contents corresponding to products from an external server (180) in response to a preset cycle, and can store the collected product contents in the corresponding account. That is, the data collection module (150) can continuously collect product contents, and the product contents are continuously updated to the latest state.

In addition, the database (160) may further include a template library (162) including a plurality of templates for generating advertising content. The template may mean a format or form for generating advertising content. The template may include a plurality of preset areas, and each product content, product information, or advertising text is inserted into the corresponding area to generate advertising content. Such templates may be stored in advance in the database (160).

In some embodiments, the data collection module (150) may further perform a process of newly generating a template by referring to the collected product advertisements. That is, a process of analyzing advertisements previously provided in relation to a product and extracting a framework and format for generating other new advertisements may be performed. For example, the data collection module (150) may further include a template generation model based on artificial intelligence that is pre-learned to generate a template by analyzing previously provided product advertisements. The template generated through the template generation model is provided to the template library (162) and updated.

Referring to FIG. 6a, the advertisement target selection unit (131) can select the second product as the main product, and the advertisement copy planning unit (132) can plan an advertisement copy related to the second product. The advertisement copy can be text information for explaining or expressing the product information of the second product. The advertisement copy does not simply express the product information of the second product, but corresponds to text information for emphasizing the external features of the product, the value of the brand, or the effect of the product. The advertisement copy planning unit (132) can plan the advertisement copy based on the second product content corresponding to the second product. For example, the advertisement copy planning unit (132) can generate text information and advertisement copy that evaluate the external features of the product based on the second product image and the second product video. In addition, the advertisement copy planning unit (132) can generate text information and advertisement copy that express the image and value of the brand by considering the external evaluation and credibility of the brand based on the brand information according to the second product information. In addition, the advertising copy planning department (132) may generate advertising copy, which is text information that describes or expresses the second product, based on consumers' evaluations, reviews, etc. of the second product, taking into account the second product description of the second product content. In addition, the advertising copy planning department (132) may generate advertising copy by referring to the second product advertisement, which is a past advertising video related to the second product. In other words, the advertising copy planning department (132) may extract or modify the advertising copy of the previously provided advertising video to generate the advertising copy.

The template determination unit (133) can select a template suitable for at least one of the advertising text and the main product from the template library. The template stored in the template library can include attribute information corresponding to the type of the product. The template determination unit (133) can select a template having attribute information corresponding to the type of the main product from the template library. In addition, in the advertising text planning unit (132), the generated advertising text can have a set number of characters, and key words or key sentences for emphasizing the features and effects of the product can be set. The template determination unit (133) can select a template corresponding to the number of characters of the advertising text from the template library. In addition, the template can include a key area for emphasizing the key word or key sentence. The template determination unit (133) can select a template in which the key area is configured in a size and format corresponding to the key word or key sentence from the template library.

The advertisement generation unit (134) can generate advertisement content for the second product based on the advertisement text, the template, and the second product content. The template can include at least a product image area and an advertisement text area, and can further include a product video area. Here, the area of the template can mean a spatial area divided into sections, but can also mean a temporal area divided into sections. That is, a specific point of the template can display a video at the beginning of the advertisement, but can also display advertisement text over time. The advertisement generation unit (134) can configure the advertisement content by placing the determined advertisement text and the second product content in the corresponding area of the determined template. The advertisement generation unit (134) can further include an advertisement generation model for generating the advertisement content based on the advertisement text, the template, and the second product content.

In some embodiments, the advertisement generation model may include a generation model that generates advertisement content based on advertisement text, a template, and second product content, and a verification model that verifies the advertisement content generated from the generation model. The generation model may extract any one of the second product contents, and may generate the advertisement content by adding the advertisement text and the extracted content to the template. The verification model may perform rating on the advertisement content generated from the generation model. Here, the rating may be an evaluation score determined through comparative analysis with previously generated advertisement content. In addition, in some embodiments, when a product sales company has requested an advertisement, a standard advertisement content that serves as a reference may be set, and the verification model may calculate an evaluation score by comparatively analyzing the standard advertisement content and the generated advertisement content.

The verification model can calculate a score for evaluating the advertising content, and if the evaluation score of the generated advertising content satisfies the reference score, the advertising content can be output to the display (170). Conversely, if the evaluation score of the generated advertising content does not meet the reference score, the verification model can request the generation model to regenerate the advertising content along with feedback information. The generation model can generate the advertising content by extracting other content from the second product content by reflecting the feedback information.

In some embodiments, the advertisement output module (130) may generate advertisement content by further considering at least one of building information, location information, and weather information.

Referring to FIG. 6b, the advertisement copy planning unit (132) may plan the advertisement copy to further reflect at least one of the building information, the location information, and the weather information. For example, the advertisement copy “LX bag that guarantees comfortable and stable storage” may reflect the weather information (rain), and the advertisement copy may be planned to be “LX bag that guarantees comfortable and stable storage on rainy days.” The template determination unit (133) may determine the template by further reflecting at least one of the building information, the location information, and the weather information. For example, the template may be determined so that the building information or the location information may be further displayed. The advertisement generation unit (134) may generate the advertisement content by further reflecting at least one of the building information, the location information, and the weather information. That is, the content may be configured by further reflecting at least one of the building information, the location information, and the weather information. For example, the advertisement generation unit (134) may configure the advertisement content such that the building image/video of the building information or the location image/video is included in the location information. In another example, the advertisement generation unit (134) can adjust the overall color and mood of the advertisement content according to weather information. For example, in clear weather, the advertisement generation unit (134) can form the overall color and mood of the advertisement content bright, and in rainy weather, can form the overall color and mood of the advertisement content dark.

The vehicle advertisement output control system according to the embodiment analyzes information about other objects around the vehicle, and reflects such object information in advertisement content to provide advertisement content reflecting information about the current surrounding situation to people around the vehicle, thereby helping people around the vehicle focus more attention on the advertisement content.

Advertisement content generated in the advertisement output module (130) can be output through the display (170). As in the example of Fig. 7, the display (170) can be placed outside the vehicle (100) and can deliver advertisements and promotions for products to pedestrians (P) around the vehicle (100). However, it is not limited thereto, and the display (170) can be placed inside the vehicle (100) and can deliver advertisements and promotions for products to passengers boarding the vehicle (100).

In Fig. 7, the vehicle (100) may be stopped in front of a crosswalk, and pedestrians (P) and outsiders around the vehicle (100) may view advertising content (C) provided on the external display (170) of the vehicle (100).

The gaze tracking module (140) can track the gaze of an outsider (P) toward a display (170) placed outside of a vehicle (100). The advertisement output system (10) of the vehicle can provide additional information about the currently provided main advertisement content in response to the gaze of the outsider (P), thereby supporting further interaction between the outsider (P) and the advertisement content. In other words, by providing additional information about the advertisement product to the outsider (P), the outsider (P) can be supported to purchase the advertisement product, thereby further enhancing the advertisement effect.

Referring to FIG. 8, the gaze tracking module (140) can recognize the gaze and movement of an outsider (P) and track changes in the recognized gaze and movement (S210). The gaze tracking module (140) determines whether the gaze of the outsider (P) remains on the display (170), specifically, on the advertising content (C) provided on the display (170), for a reference time or longer (S212). That is, the gaze tracking module (140) can determine whether the outsider (P) looks at the advertising content (C) carefully and with interest. In step (S212), if the gaze of the outsider (P) remains on the display (170) for a reference time or shorter (No), the advertising content (C) is continuously output (S214). In step (S212), if an outsider's (P) gaze remains on the display (170) for a period of time exceeding the standard time (Yes), the main product included in the advertising content is determined to be a product of interest (S216).

If the main product is determined to be a product of interest, the advertisement output module (130) renders the product of interest as a three-dimensional graphic object to configure it as a three-dimensional product of interest (S218). The advertisement generation unit (134) of the advertisement output module (130) can generate a three-dimensional product of interest based on a plurality of images corresponding to the product of interest. The plurality of images may be images of the product of interest taken from a plurality of directions, and the three-dimensional graphic object may be configured by performing three-dimensional rendering on the plurality of images to generate a three-dimensional product of interest. The three-dimensional product of interest may be a three-dimensional element implemented on three-dimensional coordinates, and may be in a state where the state and appearance of the product can be observed from a plurality of directions. The advertisement generation unit (134) can display the configured three-dimensional product of interest together on the advertisement content (S220).

Fig. 9 illustrates an example of a state in which a 3D product of interest (D1) is displayed together with advertising content (C). The 3D product of interest (D1) may be output in an area where the product image of the advertising content (C) was not provided, but is not limited thereto. In some embodiments, the 3D product of interest (D1) may be displayed in an overlapping manner in an area where the product image was provided in the advertising content (C).

That is, the vehicle advertisement output control method and system according to the embodiment can track the gaze of an outsider on the output advertisement content, and if it is determined that the outsider is interested, output the main object of the advertisement content as a three-dimensional stereoscopic model, and support further interaction between the outsider and the main object implemented as a three-dimensional stereoscopic model.

The gaze tracking module (140) can recognize gestures and movement changes of an outsider (P) in a state where a 3D product of interest is implemented. Such gestures of an outsider (P) may be actions for interaction with an output 3D product of interest (D1).

Referring to FIG. 10, the gaze tracking module (140) can recognize a gesture of an outsider (P) (S222). The gaze tracking module (140) can recognize a change in the gaze or posture of an outsider (P) when a three-dimensional product of interest (D1) is output. The gaze tracking module (140) can generate analysis information on the recognized gesture (S224). That is, the gaze tracking module (140) can analyze a change in the direction of the gaze or posture of an outsider (P). For example, a change in the posture of an outsider (P) can change a three-dimensional position or angle at which a three-dimensional product of interest (D1) is displayed, or can be intended to enlarge or reduce the three-dimensional product of interest (D1).

The advertisement generation unit (134) of the advertisement output module (130) controls the 3D product of interest according to the gesture analysis information (S226). Specifically, the advertisement generation unit (134) can control the state, angle, or position at which the 3D product of interest is output in response to the gesture analysis information. In addition, the advertisement generation unit (134) of the advertisement output module (130) can provide additional information related to the 3D product of interest (S228). Here, the additional information may be information related to the purchase of the 3D product of interest. That is, the advertisement generation unit (134) can further provide information on stores where the 3D product of interest can currently be purchased and the sales price thereof as additional information.

Referring to FIG. 11, the gaze tracking module (140) can determine that the gesture of the outsider (P) of FIG. 9 is a motion of rotating a 3D product of interest, and can generate gesture analysis information accordingly. According to the gesture analysis information, the advertisement generation unit (134) can output the 3D product of interest by rotating it 180 degrees based on the currently provided vertical axis. That is, it can be confirmed in the example of FIG. 11 that the 3D product of interest (D') is controlled and output so that the back, not the front, is displayed to the outsider (P). In addition, it can be confirmed in the example of FIG. 11 that the advertisement content (C) is modified so that purchase information (D2) for the 3D product of interest is output.

Referring to FIG. 12, the location information generation unit (122) of the object identification module (120) can generate location information of the vehicle (100). The location information generation unit (122) can include a GPS location tracking device and can generate location information of the vehicle (100) by using the same. However, the present invention is not limited thereto, and the location information generation unit (122) can determine the location of an identified building through analysis of surrounding environment information, and can also generate location information of the vehicle (100) by considering the distance between the determined building location and the vehicle (100).

The data collection module (150) can define regional information according to location information. Here, the regional information may be an administrative district unit, for example, a minimum administrative district unit such as a town, a township, or a neighborhood, but is not limited thereto. The regional information may mean a minimum unit that can collect regional information from a public external server (180). The external server (180) may mean a search platform server, an SNS server, a public web server, etc. The external server (180) may mean a server that provides an online environment in which multiple users can use and exchange information with each other. In some embodiments, the external server (180) may provide a function for limiting and displaying information searched by region or filtering it. In another embodiment, the data collection module (150) may be configured to collect information to the external server (180) in a state filtered by region. The data collection module (150) may collect keywords of high interest among users of the external server (180) by considering regional information. That is, the data collection module (150) can collect keywords that users in the area where the vehicle (100) is located show high interest in on a search platform, web, or SNS. For example, the data collection module (150) can collect all related keywords based on a region unit for a specific period of time, count the number of searches for the collected keywords, and set and determine keywords with high interest.

The product information generation unit (121) can generate product information based on collected keywords. That is, the product information generation unit (121) can filter product keywords corresponding to products from keywords with high interest, and generate product information corresponding to the filtered product keywords. Based on the product information generated by the product information generation unit (121), the advertisement output module (130) determines the main product and generates an advertisement corresponding to the main product.

The advertisement output control system and method according to the present embodiment can collect product keywords searched in the corresponding area from the web, search platforms, SNS, etc., by considering the location information of the vehicle, and can determine major products and generate advertisements based on the collected product keywords. That is, the advertisement output control system and method according to the present embodiment can support generating advertisements for products of interest not only to offline users but also to online users. The advertisement output control method for a vehicle according to some embodiments of the present invention can be performed in the advertisement output control system for the vehicle according to the above-described embodiment. The advertisement output control method for a vehicle according to the embodiment includes the steps of: sensing the surrounding environment of a vehicle having at least one display configured to generate surrounding environment information; analyzing the surrounding environment information to generate product information related to an identified object; determining major products based on the product information; and generating advertisement content related to the determined major products and outputting the generated advertisement content to the at least one display.

In some embodiments, the step of generating the product information may be performed using an artificial intelligence-based product information generation model that is trained in advance to analyze the surrounding environment information and generate product information including at least the type of product and the name of the product.

In some embodiments, the step of generating advertising content and outputting it to the at least one display may include the step of counting the number of times a product according to the product information is identified during a preset period of time, and determining a product for which the counted number of times exceeds a pre-selected threshold as the main product.

In some embodiments, the method further comprises collecting product content related to a product from an external server, and storing the product content in a database for each of a plurality of product accounts, wherein the product content includes a product image, a product video, a product description, and a conventional product advertisement, and the database includes a template library including a plurality of templates for generating advertisement content, and the storing step may include storing the collected product content in a corresponding product account of the database to update the product content, and if a product account corresponding to the collected product content is not confirmed in the database, creating a product account to store the product content.

In some embodiments, the step of generating advertising content and outputting it to the at least one display may include the steps of determining advertising text for the main product; determining a template corresponding to the main product; and generating advertising content based on the advertising text, the template, and product content corresponding to the main product.

In some embodiments, the surrounding environment information may further include image information of the surrounding environment of the vehicle, and a step of generating surrounding building information of the vehicle based on a building object identified in the image information; a step of generating weather information of the surrounding vehicle based on a natural object identified in the image information; and a step of generating location information of the vehicle based on the surrounding building information.

In some embodiments, the step of determining the advertising text may plan the advertising text by further considering at least one of the location information of the vehicle, the information about buildings around the vehicle, and the weather information of the vehicle, the step of determining the template may determine the template by further considering at least one of the location information of the vehicle, the information about buildings around the vehicle, and the weather information of the vehicle, and the step of generating the advertising content may generate the advertising content by further considering at least one of the location information of the vehicle, the information about buildings around the vehicle, and the weather information of the vehicle.

In some embodiments, the at least one display may be disposed outside the vehicle, and the method may further include the step of tracking an outsider's gaze on the at least one display; and if the outsider's gaze remains on the at least one display for a reference period of time, the method may further include the step of determining a main product included in the advertising content as a product of interest.

In some embodiments, the method may further include the step of configuring the three-dimensional product of interest by rendering the product of interest as a three-dimensional graphic object; and the step of displaying the configured three-dimensional product of interest together with the advertising content.

In some embodiments, the method may further include recognizing a gesture of an outsider with respect to the 3D object of interest; and providing at least one of magnification, rotation, and additional information of the 3D object of interest according to the gesture of the outsider.

The above description is merely an illustrative description of the technical idea of the present embodiment, and those with ordinary skill in the art to which the present embodiment pertains may make various modifications and variations without departing from the essential characteristics of the present embodiment. Therefore, the present embodiments are not intended to limit the technical idea of the present embodiment but to explain it, and the scope of the technical idea of the present embodiment is not limited by these embodiments. The protection scope of the present embodiment should be interpreted by the following claims, and all technical ideas within a scope equivalent thereto should be interpreted as being included in the scope of the rights of the present embodiment.

Claims (10)

A sensing module for sensing the surrounding environment of a vehicle having at least one display configured therein and generating surrounding environment information;
An object identification module including a product information generation unit that generates product information by analyzing the above-mentioned surrounding environment information;
An advertisement output module configured to determine a main product based on the above product information, generate advertisement content related to the determined main product, and output the same to at least one display;
A data collection module configured to collect product content related to the product from an external server;
A database where product content is stored for each product account; and
A gaze tracking module is disposed outside the vehicle and includes a gaze tracking module that tracks the gaze of an outsider to at least one display.
The above product information generation unit,
It includes a pre-trained artificial intelligence-based product information generation model that analyzes the above-mentioned surrounding environment information to generate product information including at least the type and name of the product.
The above product content includes product images, product videos, product descriptions, and existing product advertisements.
The above database includes a template library including a plurality of templates that serve as the basis for generating the above advertising content,
The above advertising output module,
An advertising target selection unit that counts the number of times a product according to the above product information is identified during a preset period and determines a product whose count exceeds a preset threshold as the main product;
An advertising copy planning department that creates advertising copy corresponding to text information for describing or expressing product information of the above major products;
A template determination unit for determining a template corresponding to the above main product and the above advertising text; and
An advertisement generation unit including an advertisement generation model that generates the advertisement content based on the advertisement text, the template, and the product content corresponding to the main product,
The above advertising copy planning department creates advertising copy that emphasizes the external features of the main product, the value of the brand, or the effectiveness of the product based on the product content corresponding to the main product.
The above template determination unit selects a corresponding first template from the template library by considering the attribute information corresponding to the type of the main product and the number of characters in the advertising text.
The above advertisement generation model includes a generation model that generates the advertisement content based on the advertisement text, the first template, and product content corresponding to the main product, and a verification model that verifies the generated advertisement content.
The above generation model generates the advertising content by adding at least one image or video extracted from the advertising text and the product content to the first template,
The above verification model calculates an evaluation score for the generated advertising content by comparing the advertising content generated from the above generation model with the reference content,
The above verification model outputs the generated advertising content to the display if the evaluation score of the generated advertising content satisfies the reference score.
The verification model requests the generation model to regenerate the advertisement content together with feedback information when the evaluation score of the generated advertisement content does not meet the reference score, and the generation model extracts another image or video from the product content by reflecting the feedback information, and regenerates the advertisement content by adding the extracted other image or video and the advertisement text to the first template.
The above gaze tracking module determines the main product included in the advertising content as a product of interest when the gaze of the outsider remains on at least one display for a period of time exceeding a reference time,
The above advertisement output module renders the above product of interest as a three-dimensional graphic object to configure it as a three-dimensional product of interest, and displays the configured three-dimensional product of interest together on the advertisement content.
The above gaze tracking module is further configured to recognize a gesture of an outsider with respect to the above 3D product of interest,
The above advertisement output module is configured to provide rotation of the three-dimensional product of interest according to the gesture of the outsider.
Vehicle advertising output control system.
delete In the first paragraph,
The above data collection module updates the product content by storing the collected product content in the corresponding product account of the database.
The above data collection module creates a product account and stores the product content if a product account corresponding to the collected product content is not confirmed in the database.
Vehicle advertising output control system.
delete In the first paragraph,
The above surrounding environment information includes image information of the surrounding environment of the vehicle,
The above object identification module,
A building information generation unit that generates building information surrounding the vehicle based on a building object identified in the above image information;
A weather information generation unit that generates weather information around the vehicle based on natural objects identified in the above image information; and
Further comprising a location information generation unit that generates location information of the vehicle based on the surrounding building information,
The above advertising copy planning department plans the advertising copy by further considering at least one of the location information of the vehicle, information on buildings around the vehicle, and weather information of the vehicle.
The template determining unit determines the template by further considering at least one of the location information of the vehicle, information on buildings surrounding the vehicle, and weather information of the vehicle.
The above advertisement generation unit generates the advertisement content by further considering at least one of the location information of the vehicle, information on buildings around the vehicle, and weather information of the vehicle.
Vehicle advertising output control system.
In the first paragraph,
The above object identification module includes a location information generation unit that generates location information of the vehicle,
It further includes a data collection module that collects keywords from an external server based on regional information according to the above location information generation unit.
The above product information generation unit is characterized in that it generates product information by filtering product keywords corresponding to the product from the collected keywords.
Vehicle advertising output control system.
delete delete In the first paragraph,
The above advertisement output module is configured to provide at least one of an enlargement of the 3D product of interest and additional information according to the gesture of the outsider.
Vehicle advertising output control system.
A method for controlling advertising output of a vehicle, performed in a vehicle advertising output control system,
A step of collecting product content related to a product from an external server and storing the collected product content in a database for each of multiple product accounts;
A step of sensing the surrounding environment of a vehicle having at least one display configured to generate surrounding environment information;
A step of generating product information related to an identified object by analyzing the surrounding environment information using an artificial intelligence-based product information generation model that has been trained in advance to generate product information including at least the type and name of the product;
A step of determining the main product based on the above product information;
A step of generating advertising content related to the above-determined main product and outputting it to at least one display;
A step of tracking an outsider's gaze on at least one of the above displays;
A step of determining a main product included in the advertising content as a product of interest when the gaze of an outsider remains on at least one of the displays for a period of time exceeding a reference time;
A step of rendering the above product of interest into a three-dimensional graphic object to form a three-dimensional product of interest, and displaying the formed three-dimensional product of interest together on the advertising content; and
Including a step of recognizing a gesture of an outsider with respect to the above 3D product of interest and providing rotation of the above 3D product of interest according to the gesture of the outsider,
The above product content includes product images, product videos, product descriptions, and existing product advertisements.
The above database includes a template library including a plurality of templates that serve as the basis for generating the above advertising content,
The step of determining the main product based on the above product information includes counting the number of times a product according to the product information is identified during a preset period, and determining a product whose counting number exceeds a preset threshold as the main product.
The step of generating advertising content related to the above-determined main product and outputting it to at least one display is:
A step of generating an advertising text corresponding to text information for describing or expressing product information of the main product, the step including generating an advertising text that emphasizes the external characteristics of the main product, the value of the brand, or the effect of the product based on the product content corresponding to the main product;
A step for determining a template corresponding to the main product and the advertising text, comprising: a step for selecting a corresponding first template from the template library by considering attribute information corresponding to the type of the main product and the number of characters of the advertising text; and
A step of generating the advertising content based on the advertising text, the template, and the product content corresponding to the main product through an advertising generation model,
The above advertisement generation model includes a generation model that generates the advertisement content based on the advertisement text, the first template, and product content corresponding to the main product, and a verification model that verifies the generated advertisement content.
The above generation model generates the advertising content by adding at least one image or video extracted from the advertising text and the product content to the first template,
The above verification model calculates an evaluation score for the generated advertising content by comparing the advertising content generated from the above generation model with the reference content,
The above verification model outputs the generated advertising content to the display if the evaluation score of the generated advertising content satisfies the reference score.
The verification model requests the generation model to regenerate the advertisement content together with feedback information when the evaluation score of the generated advertisement content does not meet the reference score, and the generation model extracts another image or video from the product content by reflecting the feedback information, and regenerates the advertisement content by adding the extracted other image or video and the advertisement text to the first template.
Method for controlling advertising output from a vehicle.