TWI748857B - System of product promotion using image tracking and method of the same - Google Patents
System of product promotion using image tracking and method of the same Download PDFInfo
- Publication number
- TWI748857B TWI748857B TW110103384A TW110103384A TWI748857B TW I748857 B TWI748857 B TW I748857B TW 110103384 A TW110103384 A TW 110103384A TW 110103384 A TW110103384 A TW 110103384A TW I748857 B TWI748857 B TW I748857B
- Authority
- TW
- Taiwan
- Prior art keywords
- user
- reflected light
- display
- product promotion
- end server
- Prior art date
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Image Analysis (AREA)
Abstract
Description
本發明係關於一種基於影像追蹤的商品推廣系統以及方法,特別係關於一種對用戶進行影像追蹤的商品推廣系統以及方法。The present invention relates to a product promotion system and method based on image tracking, and more particularly to a product promotion system and method for user image tracking.
隨著各式傳播媒介的發展,商品宣傳的方法也日新月異,除了傳統的報章雜誌以及電視廣告之外,現今常見的廣告方法還包含在網路或社群媒體上依據用戶的使用習慣以演算法對用戶個別進行推銷,或是在像是銀行等金融機構的商業空間內設置廣告看板或電視牆,並在其上展示廣告內容,讓每個在該空間內的人都可以成為潛在購買該項商品的客戶,以更有效率的方式對在金融機構內要辦理金融事務的客戶宣傳產品。With the development of various communication media, the methods of product promotion are also changing with each passing day. In addition to traditional newspapers and magazines and TV advertisements, the common advertising methods nowadays also include algorithms on the Internet or social media based on user habits. Promote users individually, or set up advertising billboards or TV walls in commercial spaces such as banks and other financial institutions, and display advertising content on them, so that everyone in the space can become a potential purchaser Commodity customers promote products to customers who need to handle financial affairs in financial institutions in a more efficient manner.
上述在看板或電視牆上播放廣告的方法已是常見宣傳手段,雖然此方法可以同時對位在該金融機構內的多個客戶進行推銷,然而對客戶而言,若該廣告內容符合客戶的需求,但因行員未對客戶進行解說而導致客戶對該商品的了解不足,使得客戶的需求沒有被滿足到;同樣地,電視牆上播放的廣告不一定是客戶感興趣的內容,若客戶對該商品不感興趣,而行員又一一向客戶進行該廣告商品的推銷,反而會對客戶造成困擾。The above-mentioned method of playing advertisements on billboards or TV walls is already a common publicity method. Although this method can simultaneously promote sales to multiple customers in the financial institution, for customers, if the advertising content meets the needs of customers , But because the clerk did not explain the customer, the customer’s understanding of the product was insufficient, so that the customer’s needs were not met; similarly, the advertisements shown on the TV wall are not necessarily the content that customers are interested in. The product is not interested, and the clerk promotes the advertised product to the customer one by one, which will cause trouble to the customer.
鑒於上述,本發明提供一種以滿足上述需求的基於影像追蹤的商品推廣系統以及方法。In view of the above, the present invention provides a product promotion system and method based on image tracking to meet the above needs.
依據本發明一實施例的一種基於影像追蹤的商品推廣系統,用於追蹤一用戶並對該用戶推廣商品,包含:一追蹤裝置,用以偵測位在一追蹤區域的該用戶對一顯示器單一的一顯示內容持續注視的一注視時段及該用戶的一位置座標,其中該追蹤裝置更包含:一光發射器,用以發射一第一紅外線光束到該用戶的一眼球,以在該眼球的瞳孔上形成一第一光斑,以及在該眼球的角膜上形成一第二光斑;一攝影機,用以接收從該第一光斑反射的一第一反射光,以及從該第二光斑反射的一第二反射光;一影像處理器,電性連接該攝影機以偵測及記錄該第一反射光及該第二反射光,並依據該影像處理器記錄的該第一反射光及該第二反射光取得一眼球移動軌跡,以及依據該眼球移動軌跡取得該注視時段;以及一位置偵測器,用以發射一第二紅外線光束到該用戶,並偵測從該用戶反射的一第三反射光,並依據發出該第二紅外線光束及偵測到該第三反射光的一時間差計算出關聯於該用戶的該位置座標;一匹配裝置,通訊連接該追蹤裝置以接收該注視時段以及該位置座標,當該匹配裝置判斷該注視時段達到一預設時間,該匹配裝置依據該位置座標以及該顯示器的該顯示內容輸出包含一商品推廣信息的一匹配結果;以及一末端服務器,通訊連接該匹配裝置以接收該匹配結果並顯示該商品推廣信息,其中該末端服務器異於該顯示器,且該商品推廣信息關聯於該顯示器的該顯示內容,其中若該用戶位在鄰近該末端服務器的一預定區域,則該末端服務器顯示該商品推廣信息,若該用戶位在鄰近該末端服務器的該預定區域之外,則該末端服務器顯示該商品推廣信息及該位置座標。A product promotion system based on image tracking according to an embodiment of the present invention is used to track a user and promote products to the user, including: a tracking device for detecting that the user in a tracking area has a single display A gaze period of continuous gaze of the display content and a position coordinate of the user, wherein the tracking device further includes: a light emitter for emitting a first infrared beam to an eyeball of the user, so as to be in the eyeball of the user A first spot is formed on the pupil, and a second spot is formed on the cornea of the eyeball; a camera for receiving a first reflected light reflected from the first spot, and a first reflected light from the second spot Two reflected light; an image processor, electrically connected to the camera to detect and record the first reflected light and the second reflected light, and according to the first reflected light and the second reflected light recorded by the image processor Obtaining an eyeball movement track, and obtaining the gaze period according to the eyeball movement track; and a position detector for emitting a second infrared beam to the user and detecting a third reflected light from the user, And calculate the position coordinate associated with the user according to a time difference between emitting the second infrared beam and detecting the third reflected light; a matching device communicatively connected to the tracking device to receive the gaze period and the position coordinate, When the matching device determines that the gaze period reaches a preset time, the matching device outputs a matching result including a product promotion information according to the position coordinates and the display content of the display; and an end server, which is communicatively connected to the matching device to Receive the matching result and display the product promotion information, where the end server is different from the display, and the product promotion information is associated with the display content of the display, wherein if the user is located in a predetermined area adjacent to the end server, then The end server displays the product promotion information. If the user is outside the predetermined area adjacent to the end server, the end server displays the product promotion information and the location coordinates.
依據本發明一實施例的一種基於影像追蹤的商品推廣方法,用於對一用戶推廣商品,包含:發射一第一紅外線光束到該用戶的一眼球,以在該眼球的瞳孔上形成一第一光斑,以及在該眼球的角膜上形成一第二光斑;以一攝影機偵測從該第一光斑反射的一第一反射光,以及從該第二光斑反射的一第二反射光;以一影像處理器接收及記錄該第一反射光及該第二反射光,並依據該影像處理器記錄的該第一反射光及該第二反射光取得一眼球移動軌跡,以及依據該眼球移動軌跡取得一注視時段;當判斷該眼球移動軌跡係集中在一顯示器單一的一顯示內容時,比較該注視時段以及一預設時間;當該注視時段未達該預設時間時,重新偵測另一注視時段;當該注視時段達到該預設時間時,以一位置偵測器發射一第二紅外線光束到該用戶,並偵測從該用戶反射的一第三反射光,並依據發出該第二紅外線光束到偵測到該第三反射光之間的一時間差計算出關聯於該用戶的一位置座標;匹配該位置座標及該顯示器的該顯示內容並輸出包含一商品推廣信息的一匹配結果;顯示該商品推廣信息於該末端服務器,其中該末端服務器異於該顯示器,且該商品推廣信息關聯於該顯示器的該顯示內容;以及將該商品推廣信息及記錄於該末端服務器的該用戶的一身份資料相匹配並記錄於一銀行伺服器。A product promotion method based on image tracking according to an embodiment of the present invention is used to promote a product to a user, including: emitting a first infrared beam to an eyeball of the user to form a first eyeball on the pupil of the eyeball. A light spot, and a second light spot is formed on the cornea of the eyeball; a camera is used to detect a first reflected light reflected from the first light spot, and a second reflected light reflected from the second light spot; with an image The processor receives and records the first reflected light and the second reflected light, and obtains an eyeball movement track according to the first reflected light and the second reflected light recorded by the image processor, and obtains an eyeball movement track according to the eyeball movement track Gaze period; when it is determined that the eyeball movement track is concentrated on a single display of a display, compare the gaze period with a preset time; when the gaze period does not reach the preset time, re-detect another gaze period ; When the gaze period reaches the preset time, a position detector emits a second infrared beam to the user, and detects a third reflected light from the user, and emits the second infrared beam according to A time difference between detecting the third reflected light and calculating a position coordinate related to the user; matching the position coordinate and the display content of the display and outputting a matching result containing a product promotion information; displaying the The product promotion information is on the end server, where the end server is different from the display, and the product promotion information is associated with the display content of the display; and the product promotion information and an identity data of the user recorded on the end server Matches and records in a bank server.
依據本發明一實施例的一種基於影像追蹤的商品推廣方法,用於對一用戶推廣商品,包含:發射一第一紅外線光束到該用戶的一眼球,以在該眼球的瞳孔上形成一第一光斑,以及在該眼球的角膜上形成一第二光斑;以一攝影機偵測從該第一光斑反射的一第一反射光,以及從該第二光斑反射的一第二反射光;以一影像處理器接收及記錄該第一反射光及該第二反射光,並依據該影像處理器記錄的該第一反射光及該第二反射光取得一眼球移動軌跡,以及依據該眼球移動軌跡取得一注視時段;當判斷該眼球移動軌跡係集中在一顯示器單一的一顯示內容時,比較該注視時段以及一預設時間;當該注視時段未達該預設時間時,重新偵測另一注視時段;當該注視時段達到該預設時間時,以一位置偵測器發射一第二紅外線光束到該用戶,並偵測從該用戶反射的一第三反射光,並依據發出該第二紅外線光束到偵測到該第三反射光之間的一時間差計算出關聯於該用戶的一位置座標;匹配該位置座標及該顯示器的該顯示內容並輸出包含一商品推廣信息的一匹配結果;顯示該商品推廣信息於該末端服務器,其中該末端服務器異於該顯示器,且該商品推廣信息關聯於該顯示器的該顯示內容;以及對該用戶進行生物特徵辨識以取得一生物特徵辨識結果,依據該生物特徵辨識結果取得該用戶的一身份資料,將該商品推廣信息及該身份資料相匹配並記錄於一銀行伺服器。A product promotion method based on image tracking according to an embodiment of the present invention is used to promote a product to a user, including: emitting a first infrared beam to an eyeball of the user to form a first eyeball on the pupil of the eyeball. A light spot, and a second light spot is formed on the cornea of the eyeball; a camera is used to detect a first reflected light reflected from the first light spot, and a second reflected light reflected from the second light spot; with an image The processor receives and records the first reflected light and the second reflected light, and obtains an eyeball movement track according to the first reflected light and the second reflected light recorded by the image processor, and obtains an eyeball movement track according to the eyeball movement track Gaze period; when it is determined that the eyeball movement track is concentrated on a single display of a display, compare the gaze period with a preset time; when the gaze period does not reach the preset time, re-detect another gaze period ; When the gaze period reaches the preset time, a position detector emits a second infrared beam to the user, and detects a third reflected light from the user, and emits the second infrared beam according to A time difference between detecting the third reflected light and calculating a position coordinate related to the user; matching the position coordinate and the display content of the display and outputting a matching result containing a product promotion information; displaying the The product promotion information is on the end server, where the end server is different from the display, and the product promotion information is associated with the display content of the display; and biometric identification is performed on the user to obtain a biometric identification result, based on the biological feature The feature identification result obtains an identity data of the user, matches the product promotion information and the identity data, and records the result on a bank server.
依據本發明一實施例的一種基於影像追蹤的商品推廣方法,用於對一用戶推廣商品,包含:發射一第一紅外線光束到該用戶的一眼球,以在該眼球的瞳孔上形成一第一光斑,以及在該眼球的角膜上形成一第二光斑;以一攝影機偵測從該第一光斑反射的一第一反射光,以及從該第二光斑反射的一第二反射光;以一影像處理器接收及記錄該第一反射光及該第二反射光,並依據該影像處理器記錄的該第一反射光及該第二反射光取得一眼球移動軌跡,以及依據該眼球移動軌跡取得一注視時段;當判斷該眼球移動軌跡係集中在一顯示器單一的一顯示內容時,比較該注視時段以及一預設時間;當該注視時段未達該預設時間時,重新偵測另一注視時段;當該注視時段達到該預設時間時,以一位置偵測器發射一第二紅外線光束到該用戶,並偵測從該用戶反射的一第三反射光,並依據發出該第二紅外線光束到偵測到該第三反射光之間的一時間差計算出關聯於該用戶的一位置座標;匹配該位置座標及該顯示器的該顯示內容並輸出包含一商品推廣信息的一匹配結果;顯示該商品推廣信息於該末端服務器,其中該末端服務器異於該顯示器,且該商品推廣信息關聯於該顯示器的該顯示內容;以及將該商品推廣信息及記錄於該末端服務器的該用戶的一身份資料相匹配並記錄於一銀行伺服器,其中若該用戶位在鄰近該末端服務器的一預定區域,該商品推廣信息被輸出到鄰近該用戶的該末端服務器,若該用戶位在鄰近該末端服務器的該預定區域之外,則該末端服務器顯示該商品推廣信息及該位置座標。A product promotion method based on image tracking according to an embodiment of the present invention is used to promote a product to a user, including: emitting a first infrared beam to an eyeball of the user to form a first eyeball on the pupil of the eyeball. A light spot, and a second light spot is formed on the cornea of the eyeball; a camera is used to detect a first reflected light reflected from the first light spot, and a second reflected light reflected from the second light spot; with an image The processor receives and records the first reflected light and the second reflected light, and obtains an eyeball movement track according to the first reflected light and the second reflected light recorded by the image processor, and obtains an eyeball movement track according to the eyeball movement track Gaze period; when it is determined that the eyeball movement track is concentrated on a single display of a display, compare the gaze period with a preset time; when the gaze period does not reach the preset time, re-detect another gaze period ; When the gaze period reaches the preset time, a position detector emits a second infrared beam to the user, and detects a third reflected light from the user, and emits the second infrared beam according to A time difference between detecting the third reflected light and calculating a position coordinate related to the user; matching the position coordinate and the display content of the display and outputting a matching result containing a product promotion information; displaying the The product promotion information is on the end server, where the end server is different from the display, and the product promotion information is associated with the display content of the display; and the product promotion information and an identity data of the user recorded on the end server Match and record in a bank server, where if the user is located in a predetermined area adjacent to the end server, the product promotion information is output to the end server adjacent to the user, if the user is located adjacent to the end server Outside the predetermined area, the end server displays the product promotion information and the position coordinates.
依據本發明一實施例的一種基於影像追蹤的商品推廣方法,用於對一用戶推廣商品,包含:發射一第一紅外線光束到該用戶的一眼球,以在該眼球的瞳孔上形成一第一光斑,以及在該眼球的角膜上形成一第二光斑;以一攝影機偵測從該第一光斑反射的一第一反射光,以及從該第二光斑反射的一第二反射光;以一影像處理器接收及記錄該第一反射光及該第二反射光,並依據該影像處理器記錄的該第一反射光及該第二反射光取得一眼球移動軌跡,以及依據該眼球移動軌跡取得一注視時段;當判斷該眼球移動軌跡係集中在一顯示器單一的一顯示內容時,比較該注視時段以及一預設時間;當該注視時段未達該預設時間時,重新偵測另一注視時段;當該注視時段達到該預設時間時,以一位置偵測器發射一第二紅外線光束到該用戶,並偵測從該用戶反射的一第三反射光,並依據發出該第二紅外線光束到偵測到該第三反射光之間的一時間差計算出關聯於該用戶的一位置座標;匹配該位置座標及該顯示器的該顯示內容並輸出包含一商品推廣信息的一匹配結果;顯示該商品推廣信息於該末端服務器,其中該末端服務器異於該顯示器,且該商品推廣信息關聯於該顯示器的該顯示內容;以及對該用戶進行生物特徵辨識以取得一生物特徵辨識結果,依據該生物特徵辨識結果取得該用戶的一身份資料,將該商品推廣信息及該身份資料相匹配並記錄於一銀行伺服器,其中若該用戶位在鄰近該末端服務器的一預定區域,該商品推廣信息被輸出到鄰近該用戶的該末端服務器,若該用戶位在鄰近該末端服務器的該預定區域之外,則該末端服務器顯示該商品推廣信息及該位置座標。A product promotion method based on image tracking according to an embodiment of the present invention is used to promote a product to a user, including: emitting a first infrared beam to an eyeball of the user to form a first eyeball on the pupil of the eyeball. A light spot, and a second light spot is formed on the cornea of the eyeball; a camera is used to detect a first reflected light reflected from the first light spot, and a second reflected light reflected from the second light spot; with an image The processor receives and records the first reflected light and the second reflected light, and obtains an eyeball movement track according to the first reflected light and the second reflected light recorded by the image processor, and obtains an eyeball movement track according to the eyeball movement track Gaze period; when it is determined that the eyeball movement track is concentrated on a single display of a display, compare the gaze period with a preset time; when the gaze period does not reach the preset time, re-detect another gaze period ; When the gaze period reaches the preset time, a position detector emits a second infrared beam to the user, and detects a third reflected light from the user, and emits the second infrared beam according to A time difference between detecting the third reflected light and calculating a position coordinate related to the user; matching the position coordinate and the display content of the display and outputting a matching result containing a product promotion information; displaying the The product promotion information is on the end server, where the end server is different from the display, and the product promotion information is associated with the display content of the display; and biometric identification is performed on the user to obtain a biometric identification result, based on the biological feature The feature identification result obtains an identity data of the user, matches the product promotion information and the identity data, and records it on a bank server. If the user is located in a predetermined area adjacent to the end server, the product promotion information is Output to the end server adjacent to the user. If the user is outside the predetermined area adjacent to the end server, the end server displays the product promotion information and the location coordinates.
本發明的功效在於,銀行內的行員可以主動得知用戶對該廣告或商品的感興趣程度以及該用戶所在的位置,讓行員以更個人化的方式向用戶對該商品進行說明,不僅可以滿足客戶可能的消費需求,更可以避免對商品不感興趣的客戶仍被行員推銷產品。依據本發明的一或多個實施例,當用戶是位在櫃檯前的預定區域時,相關的商品訊息可以只被傳送到鄰近於該預定區域的末端服務器,以避免佔用匹配裝置與其他末端服務器的之間的頻寬。The effect of the present invention is that the clerk in the bank can actively know the user’s interest in the advertisement or product and the location of the user, so that the clerk can explain the product to the user in a more personal way, which not only satisfies The possible consumer needs of customers can also prevent customers who are not interested in products from being promoted by clerks. According to one or more embodiments of the present invention, when the user is in a predetermined area in front of the counter, the related product information can only be transmitted to the end server adjacent to the predetermined area to avoid occupying the matching device and other end servers. The bandwidth between the
以上之關於本揭露內容之說明及以下之實施方式之說明係用以示範與解釋本發明之精神與原理,並且提供本發明之專利申請範圍更進一步之解釋。The above description of the disclosure and the following description of the implementation manners are used to demonstrate and explain the spirit and principle of the present invention, and to provide a further explanation of the patent application scope of the present invention.
以下在實施方式中詳細敘述本發明之詳細特徵以及優點,其內容足以使任何熟習相關技藝者了解本發明之技術內容並據以實施,且根據本說明書所揭露之內容、申請專利範圍及圖式,任何熟習相關技藝者可輕易地理解本發明相關之目的及優點。以下之實施例係進一步詳細說明本發明之觀點,但非以任何觀點限制本發明之範疇。The detailed features and advantages of the present invention will be described in detail in the following embodiments. The content is sufficient to enable anyone familiar with the relevant art to understand the technical content of the present invention and implement it accordingly, and in accordance with the content disclosed in this specification, the scope of patent application and the drawings Anyone who is familiar with relevant skills can easily understand the purpose and advantages of the present invention. The following examples further illustrate the viewpoints of the present invention in detail, but do not limit the scope of the present invention by any viewpoint.
請參考圖1,圖1為依據本發明一實施例所繪示的基於影像追蹤的商品推廣系統的示意圖。本發明用於一基於影像追蹤的商品推廣系統的實施例包含一追蹤裝置1、一匹配裝置2以及一末端服務器3,適用於追蹤一用戶4並對用戶4推廣商品,其中追蹤裝置1通訊連接匹配裝置2,匹配裝置2通訊連接末端服務器3。Please refer to FIG. 1, which is a schematic diagram of a product promotion system based on image tracking according to an embodiment of the present invention. The embodiment of the present invention applied to a product promotion system based on image tracking includes a
請繼續參考圖1,追蹤裝置1係用以偵測在一追蹤區域A的用戶4對一顯示器10的單一的顯示內容持續注視的一注視時段及用戶4的一位置座標。更詳細來說,在追蹤區域A內,追蹤裝置1除了偵測用戶4的位置座標之外,亦偵測用戶4的目光,當用戶4觀看顯示器10的廣告內容持續一注視時段,且在注視時段內顯示器10播放的是同一個廣告內容,則追蹤裝置1輸出注視時段及位置座標到匹配裝置2。Please continue to refer to FIG. 1, the
請一併參考圖1以及圖2A,圖2A係依據本發明一實施例所繪示的基於影像追蹤的商品推廣系統的追蹤裝置的方塊圖。追蹤裝置1包含光發射器11、攝影機12、影像處理器13及位置偵測器14。Please refer to FIG. 1 and FIG. 2A together. FIG. 2A is a block diagram of a tracking device of a product promotion system based on image tracking according to an embodiment of the present invention. The
請繼續參考圖1、圖2A以及圖2B,圖2B係依據本發明一實施例所繪示的基於影像追蹤的商品推廣系統中偵測注視時段的示意圖。光發射器11會發射第一紅外線光束L1到用戶4的眼球E,並在瞳孔P上形成第一光斑以及在角膜C上形成第二光斑,攝影機12用以偵測從第一光斑反射的第一反射光R1以及從第二光斑反射的第二反射光R2。換句話說,光發射器11用以發射第一紅外線光束L1到眼球E,攝影機12則是用以接收瞳孔P反射第一紅外線光束L1的第一反射光R1及角膜C反射第一紅外線光束L1的第二反射光R2,其中第一光斑即瞳孔P反射第一反射光R1的位置,第二光斑即是角膜C反射第二反射光R2的位置。Please continue to refer to FIG. 1, FIG. 2A and FIG. 2B. FIG. 2B is a schematic diagram of detecting a gaze period in a product promotion system based on image tracking according to an embodiment of the present invention. The
請繼續參考圖2A及2B,當攝影機12偵測到第一反射光R1以及第二反射光R2後,電性連接於攝影機12的影像處理器13接收及記錄第一反射光R1以及第二反射光R2,並依據其所記錄的第一反射光R1以及第二反射光R2取得眼球移動軌跡,以及依據眼球移動軌跡取得注視時段。更詳細而言,影像處理器13每間隔一時距記錄第一反射光R1以及第二反射光R2的相位/角度偏移量以取得眼球移動軌跡,並且依據眼球移動軌跡取得眼球E對顯示器單一的顯示內容持續注視的注視時段。其中,追蹤裝置1包含的光發射器11、攝影機12及影像處理器13的集成例如是眼球追蹤裝置,亦可以是其他具有瞳孔中心-角膜反光(Pupil-Center Corneal Reflection,PCCR)技術的裝置,然本發明不以此為限。Please continue to refer to FIGS. 2A and 2B. After the
請一併參考圖1及圖2C,圖2C係依據本發明一實施例所繪示的基於影像追蹤的商品推廣系統中偵測用戶位置座標的示意圖。追蹤裝置1除了用以偵測在追蹤區域內A的用戶4對顯示器10的單一的顯示內容持續注視的注視時段之外,追蹤裝置1亦用以偵測用戶4在追蹤區域內A的位置座標。更詳細來說,追蹤裝置1包含位置偵測器14,位置偵測器14發射第二紅外線光束L2到用戶4,並偵測由用戶4反射的第三反射光R3,其中位置偵測器14從發射出第二紅外線光束L2到偵測到第三反射光R3之間有一時間差,位置偵測器14依據該時間差計算出位置偵測器14與用戶4之間的距離,以取得用戶4與追蹤裝置1間的一深度距離d。其中,位置偵測器14可以是深度攝影機,或是其他具有飛時測距(Time of Flight,ToF)的技術的攝影機,然本發明並不以此為限。Please refer to FIG. 1 and FIG. 2C together. FIG. 2C is a schematic diagram of detecting a user's location coordinates in a product promotion system based on image tracking according to an embodiment of the present invention. In addition to the
請繼續參考圖2C,當追蹤裝置1的位置偵測器14取得用戶4與追蹤裝置1間的深度距離d後,再將深度距離d分別投影到追蹤區域A的一邊界(X軸)及相鄰的另一邊界(Y軸)以得到關聯於用戶4的位置座標。Please continue to refer to FIG. 2C. After the
請繼續參考圖1,匹配裝置2接收追蹤裝置1輸出的注視時段後,匹配裝置2判斷注視時段是否達到一預設時間,若匹配裝置2判斷注視時段未達預設時間,則追蹤裝置1重新偵測用戶4的另一注視時段並更新用戶4的位置座標;若匹配裝置2判斷注視時段達到預設時間,則匹配裝置2依據用戶4的位置座標以及顯示器10的顯示內容輸出包含一商品推廣信息的一匹配結果。換句話說,若注視時段未達預設時間,匹配裝置2判斷用戶4對顯示器10顯示的廣告內容不感興趣,則追蹤裝置1重新偵測用戶4的另一注視時段以及更新其位置座標;若注視時段達到預設時間,匹配裝置2判斷用戶4對顯示器10顯示的廣告內容感興趣,則匹配裝置2輸出匹配結果到末端服務器3,其中匹配結果包含一商品推廣信息,此外匹配結果亦可以選擇性包含用戶4的位置座標,意即匹配裝置2匹配用戶4的位置座標及其感興趣的廣告內容並輸出匹配結果。其中,匹配裝置2可以是銀行內部的伺服器等,然本發明不以此為限。Please continue to refer to FIG. 1. After the
上述之匹配結果可以選擇性包含用戶4的位置座標,其係依據用戶4在追蹤區域A內的位置判斷。更詳細來說,若用戶4位在鄰近末端服務器3的一預定區域A’,則末端服務器3只顯示商品推廣信息,意即若用戶4是在靠近末端服務器3的預定區域A’內,表示用戶4已在服務櫃檯前辦理事務,則匹配裝置2只需輸出商品推廣信息到末端服務器3,以供在該櫃檯服務用戶4的行員對用戶4推廣商品。然而,若用戶4位在所有末端服務器3的預定區域A’之外,表示用戶4非位於服務櫃檯辦理事務,則匹配裝置2輸出商品推廣信息及用戶4的位置座標到至少一個末端服務器3,讓行員可以得知用戶4的位置及其感興趣的商品,以供行員主動前往用戶4的位置並向其推廣商品,或是待用戶4前往櫃檯辦理事務時向其推廣。其中,上述之末端服務器3可以是固定式電腦或可移動式電腦等具有顯示器的裝置,然本發明不以此為限。The aforementioned matching result may optionally include the location coordinates of the
請參考圖3,圖3係依據本發明一實施例所繪示的基於影像追蹤的商品推廣方法的流程圖。該商品推廣方法於步驟S01中以追蹤裝置1的光發射器11發射第一紅外線光束L1到用戶4的眼球E,以在眼球E的瞳孔P上形成第一光斑,以及在眼球E的角膜C上形成第二光斑。在光發射器11發射第一紅外線光束L1到眼球E後,追蹤裝置1的攝影機12於步驟S02中偵測從第一光斑反射的第一反射光R1以及從第二光斑反射的第二反射光R2。Please refer to FIG. 3, which is a flowchart of a product promotion method based on image tracking according to an embodiment of the present invention. In the product promotion method, in step S01, the
請繼續參考圖3,在攝影機12偵測到第一反射光R1及第二反射光R2後,電性連接於攝影機12的影像處理器13於步驟S03中接收及記錄第一反射光R1及第二反射光R2,並且接續於步驟S04中依據影像處理器13記錄的第一反射光R1及第二反射光R2取得眼球移動軌跡。更詳細而言,影像處理器13依據第一反射光R1及第二反射光R2的相位/角度的偏移量以取得眼球移動軌跡,並於步驟S05中依據眼球移動軌跡取得眼球E對顯示器單一的顯示內容持續注視的注視時段。Please continue to refer to FIG. 3, after the
請繼續參考圖3,當匹配裝置2接收步驟S05中追蹤裝置1偵測的注視時段後,匹配裝置2並於步驟S06比較注視時段與一預設時間,若注視時段達到預設時間,則追蹤裝置1的位置偵測器14於步驟S07發射第二紅外光束L2到用戶4,並偵測從用戶4反射回來的第三反射光R3,位置偵測器14更接續於步驟S08依據發出第二紅外線光束L2到偵測到第三反射光R3之間的時間差計算出關聯於用戶的位置座標;若注視時段未達預設時間,則追蹤裝置1重新執行步驟S01以重新發射第一紅外光L1到用戶4的眼球E以偵測另一第一反射光及另一第二反射光。換句話說,當注視時段達到預設時間,判斷用戶4對顯示器10顯示的廣告內容感興趣,則追蹤裝置1於步驟S07及步驟S08進一步偵測用戶4的位置座標;當注視時段未達預設時間,判斷用戶4對顯示器10顯示的廣告內容不感興趣,則追蹤裝置1重新執行步驟S01。Please continue to refer to FIG. 3, after the
請繼續參考圖3,在執行過步驟S08而以追蹤裝置2偵測到用戶4的位置座標後,匹配裝置2於步驟S09匹配用戶4的位置座標以及顯示器10的顯示內容,並在步驟S10輸出匹配結果。更詳細來說,當偵測到用戶4在追蹤區域A內的位置後,匹配裝置2將用戶4的位置座標及用戶4感興趣的廣告內容相匹配,並依據位置座標以及顯示器10的顯示內容輸出包含商品推廣信息的匹配結果。上述的匹配結果除了包含商品推廣信息更可以包含位置座標。Please continue to refer to FIG. 3, after step S08 is performed and the
請繼續參考圖3,在步驟S10輸出匹配結果後,末端服務器3接收匹配結果並在步驟S11顯示商品推廣信息,若用戶4位在鄰近末端服務器3的一預定區域A’,商品推廣信息被輸出到鄰近用戶4的末端服務器3。換句話說,在此情況下,用戶4已在服務櫃檯辦理事務,則匹配裝置2只需輸出商品推廣信息到末端服務器3,以供在該櫃檯服務用戶4的行員對用戶4推廣商品。然而,若用戶4位在鄰近末端服務器3的預定區域A’之外,則末端服務器3顯示商品推廣信息及位置座標,表示用戶4非位於服務櫃檯辦理事務,則匹配裝置2輸出商品推廣信息及用戶4的位置座標到末端服務器3,讓行員可以得知用戶4的位置及其感興趣的商品,以供行員主動前往用戶4的位置並向其推廣商品。在上述運作中,當設有多個末端服務器3時,若用戶4位在鄰近其中一末端服務器3的預定區域A’內,則商品推廣信息會被輸出到此末端服務器3;而若用戶4位在所有末端服務器3的預定區域A’之外,商品推廣信息及位置座標會被傳送至所有末端服務器3,或者傳送至最接近此座標位置的末端服務器3。Please continue to refer to Figure 3. After outputting the matching result in step S10, the
請參考圖4,圖4係依據本發明另一實施例所繪示的基於影像追蹤的商品推廣方法的流程圖。圖4之步驟S01-S11皆與圖3相同,故不再於此贅述,惟圖4與圖3的不同處在於步驟S11顯示商品推廣信息後,圖4的實施例流程圖更於步驟S12匹配商品推廣信息及身份資料。更詳細來說,末端服務器3接收到商品推廣信息後,末端服務器3更將商品推廣信息及用戶4的身份資料相匹配並記錄於銀行的伺服器,以供行員以手機簡訊、紙本信件或email等其他方式向用戶4推廣該商品。Please refer to FIG. 4, which is a flowchart of a product promotion method based on image tracking according to another embodiment of the present invention. Steps S01-S11 of FIG. 4 are the same as those of FIG. 3, so they will not be repeated here. However, the difference between FIG. 4 and FIG. 3 is that after step S11 displays the product promotion information, the flowchart of the embodiment of FIG. 4 is more matched with step S12 Commodity promotion information and identity information. In more detail, after the
進一步來說,上述之用戶4的身份資料可以是從末端服務器3的記錄取得,意即在辦理事務時輸入於末端服務器3的用戶4的身份資料。此外,本發明之商品推廣方法亦可以對用戶4進行生物特徵辨識以取得一生物特徵辨識結果,並依據用戶4的生物特徵辨識結果參照儲存於銀行伺服器或其他記憶裝置的用戶4資料以取得身份資料。其中,上述之生物特徵辨識結果可以是以臉部辨識、聲紋、指紋等生物特徵辨識方式取得。Furthermore, the aforementioned identity data of the
綜合上述,本發明所揭示的基於影像追蹤的商品推廣系統以及方法,藉由偵測用戶對顯示器的單一的顯示內容持續的注視時段以及用戶的位置座標,並藉由比較注視時段及預設時間來判斷客戶對顯示器的顯示內容是否感興趣,當判斷注視時段達到預設時間,意即判斷用戶可能對顯示內容感興趣,則匹配裝置將用戶的位置座標及顯示器的顯示內容進行匹配並輸出匹配結果,系統再發送包含商品推廣信息的匹配結果到末端服務器通知行員,以供行員進一步向客戶說明其感興趣的商品。依據本發明揭示的基於影像追蹤的商品推廣系統以及方法,除了可以判斷用戶是否對該廣告推廣的商品有興趣之外,更可以讓行員即時知道該用戶的位置以向用戶針對該向商品進行解說,且若客戶對該商品不感興趣,就不會被行員進行產品推銷。此外本發明揭示的基於影像追蹤的商品推廣系統以及方法亦可將客戶的身份資料及顯示器的顯示內容匹配並記錄於銀行伺服器,待日後再以手機簡訊、紙本信件或email等其他方式對客戶推廣該項廣告的商品。In summary, the product promotion system and method based on image tracking disclosed in the present invention detect the continuous gaze period of a single display content of the display by the user and the user's position coordinates, and compare the gaze period and the preset time To determine whether the customer is interested in the display content of the display, when the gaze period reaches the preset time, which means that the user may be interested in the display content, the matching device will match the user's position coordinates with the display content of the display and output the matching As a result, the system then sends the matching result containing the product promotion information to the end server to notify the clerk, so that the clerk can further explain the products that he is interested in to the customer. According to the product promotion system and method based on image tracking disclosed in the present invention, in addition to judging whether the user is interested in the product promoted by the advertisement, it can also let the traveller know the location of the user in real time to explain to the user about the product. , And if the customer is not interested in the product, it will not be promoted by the clerk. In addition, the product promotion system and method based on image tracking disclosed in the present invention can also match and record the customer's identity data and the display content of the display on the bank server, and then use other methods such as mobile phone text messages, paper letters or emails to check The customer promotes the advertised product.
本發明的功效在於,銀行內的行員可以主動得知用戶對該廣告或商品的感興趣程度以及該用戶所在的位置,讓行員以更個人化的方式向用戶對該商品進行說明,不僅可以滿足客戶可能的消費需求,更可以避免對商品不感興趣的客戶仍被行員推銷產品。The effect of the present invention is that the clerk in the bank can actively know the user’s interest in the advertisement or product and the location of the user, so that the clerk can explain the product to the user in a more personal way, which not only satisfies The possible consumer needs of customers can also prevent customers who are not interested in products from being promoted by clerks.
依據本發明的一或多個實施例,當用戶是位在櫃檯前的預定區域時,相關的商品訊息可以只被傳送到鄰近於該預定區域的末端服務器,以避免佔用匹配裝置與其他末端服務器的之間的頻寬。According to one or more embodiments of the present invention, when the user is in a predetermined area in front of the counter, the related product information can only be transmitted to the end server adjacent to the predetermined area to avoid occupying the matching device and other end servers. The bandwidth between the
本發明是以在銀行內的運作方式作為實施例,然本發明揭露的基於影像追蹤的商品推廣系統及方法亦可用於其他空間,像是超市、商場或百貨公司等具有顯示廣告的顯示器或廣告牆的商業空間內,本發明不以金融機構為限。The present invention takes the operating mode in the bank as an example. However, the product promotion system and method based on image tracking disclosed in the present invention can also be used in other spaces, such as supermarkets, shopping malls, or department stores that have displays or advertisements that display advertisements. In the commercial space of the wall, the present invention is not limited to financial institutions.
雖然本發明以前述之實施例揭露如上,然其並非用以限定本發明。在不脫離本發明之精神和範圍內,所為之更動與潤飾,均屬本發明之專利保護範圍。關於本發明所界定之保護範圍請參考所附之申請專利範圍。Although the present invention is disclosed as above in the foregoing embodiments, it is not intended to limit the present invention. All changes and modifications made without departing from the spirit and scope of the present invention fall within the scope of the patent protection of the present invention. For the scope of protection defined by the present invention, please refer to the attached patent scope.
1:追蹤裝置 2:匹配裝置 3:末端服務器 4:用戶 10:顯示器 11:光發射器 12:攝影機 13:影像處理器 14:位置偵測器 A:追蹤區域 A’:預定區域 d:深度距離 C:角膜 E:眼球 P:瞳孔 L1:第一紅外線光束 L2:第二紅外線光束 R1:第一反射光 R2:第二反射光 R3:第三反射光 X:X軸 Y:Y軸1: tracking device 2: matching device 3: End server 4: user 10: display 11: Light transmitter 12: Camera 13: image processor 14: position detector A: Tracking area A’: Reservation area d: depth distance C: cornea E: Eyeball P: pupil L1: First infrared beam L2: Second infrared beam R1: first reflected light R2: second reflected light R3: third reflected light X: X axis Y: Y axis
圖1係依據本發明一實施例所繪示的基於影像追蹤的商品推廣系統的示意圖。 圖2A係依據本發明一實施例所繪示的基於影像追蹤的商品推廣系統的追蹤裝置的方塊圖。 圖2B係依據本發明一實施例所繪示的基於影像追蹤的商品推廣系統中偵測注視時段的示意圖。 圖2C係依據本發明一實施例所繪示的基於影像追蹤的商品推廣系統中偵測用戶位置座標的示意圖。 圖3係依據本發明一實施例所繪示的基於影像追蹤的商品推廣方法的流程圖。 圖4係依據本發明另一實施例所繪示的基於影像追蹤的商品推廣方法的流程圖。FIG. 1 is a schematic diagram of a product promotion system based on image tracking according to an embodiment of the present invention. 2A is a block diagram of a tracking device of a commodity promotion system based on image tracking according to an embodiment of the present invention. FIG. 2B is a schematic diagram of detecting a gaze period in a commodity promotion system based on image tracking according to an embodiment of the present invention. 2C is a schematic diagram of detecting the location coordinates of a user in a product promotion system based on image tracking according to an embodiment of the present invention. FIG. 3 is a flowchart of a method for product promotion based on image tracking according to an embodiment of the present invention. FIG. 4 is a flow chart of a method for product promotion based on image tracking according to another embodiment of the present invention.
1:追蹤裝置 1: tracking device
2:匹配裝置 2: matching device
3:末端服務器 3: End server
4:用戶 4: user
10:顯示器 10: display
A:追蹤區域 A: Tracking area
A’:預定區域 A’: Reservation area
Claims (6)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW110103384A TWI748857B (en) | 2019-08-07 | 2019-08-07 | System of product promotion using image tracking and method of the same |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW110103384A TWI748857B (en) | 2019-08-07 | 2019-08-07 | System of product promotion using image tracking and method of the same |
Publications (2)
Publication Number | Publication Date |
---|---|
TW202121295A TW202121295A (en) | 2021-06-01 |
TWI748857B true TWI748857B (en) | 2021-12-01 |
Family
ID=77516760
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW110103384A TWI748857B (en) | 2019-08-07 | 2019-08-07 | System of product promotion using image tracking and method of the same |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI748857B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114052653A (en) * | 2021-11-19 | 2022-02-18 | 中国工商银行股份有限公司 | Desktop device, interest information acquisition method and acquisition system |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI489969B (en) * | 2012-07-31 | 2015-07-01 | Japan Science & Tech Agency | Point-of-gaze detection device, point-of-gaze detecting method, personal parameter calculating device, personal parameter calculating method, program, and computer-readable recording medium |
TWI515609B (en) * | 2014-12-31 | 2016-01-01 | 中原大學 | Eyeball locating method and system |
TWI521384B (en) * | 2014-10-31 | 2016-02-11 | 佳世達科技股份有限公司 | Electronic device with eyeball tracking function and control method thereof |
TWI524212B (en) * | 2013-12-05 | 2016-03-01 | 由田新技股份有限公司 | Interactive display method and electronic device therefore |
CN106132284A (en) * | 2013-11-09 | 2016-11-16 | 深圳市汇顶科技股份有限公司 | Optical eye is dynamic follows the trail of |
TWM588308U (en) * | 2019-08-07 | 2019-12-21 | 華南商業銀行股份有限公司 | System of product promotion using image tracking |
-
2019
- 2019-08-07 TW TW110103384A patent/TWI748857B/en active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI489969B (en) * | 2012-07-31 | 2015-07-01 | Japan Science & Tech Agency | Point-of-gaze detection device, point-of-gaze detecting method, personal parameter calculating device, personal parameter calculating method, program, and computer-readable recording medium |
CN106132284A (en) * | 2013-11-09 | 2016-11-16 | 深圳市汇顶科技股份有限公司 | Optical eye is dynamic follows the trail of |
TWI524212B (en) * | 2013-12-05 | 2016-03-01 | 由田新技股份有限公司 | Interactive display method and electronic device therefore |
TWI521384B (en) * | 2014-10-31 | 2016-02-11 | 佳世達科技股份有限公司 | Electronic device with eyeball tracking function and control method thereof |
TWI515609B (en) * | 2014-12-31 | 2016-01-01 | 中原大學 | Eyeball locating method and system |
TWM588308U (en) * | 2019-08-07 | 2019-12-21 | 華南商業銀行股份有限公司 | System of product promotion using image tracking |
Also Published As
Publication number | Publication date |
---|---|
TW202121295A (en) | 2021-06-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US12039550B2 (en) | Method for enhancing customer shopping experience in a retail store | |
JP5015926B2 (en) | Apparatus and method for monitoring individuals interested in property | |
US8376226B2 (en) | System and method for interactive marketing to consumers | |
US20180053226A1 (en) | Interactive signage and vending machine for change round-up | |
US20160203499A1 (en) | Customer behavior analysis system, customer behavior analysis method, non-transitory computer readable medium, and shelf system | |
US20230041374A1 (en) | Interactive signage and data gathering techniques | |
KR20240055127A (en) | Augmented reality devices, systems and methods for purchasing | |
JP5768010B2 (en) | Signage system and program | |
TWM588308U (en) | System of product promotion using image tracking | |
US20130293581A1 (en) | Back-to-Back Video Displays | |
US20100049624A1 (en) | Commodity marketing system | |
WO2019214441A1 (en) | Advertisement playing method and apparatus, and device and storage medium | |
US20210216951A1 (en) | System and Methods for Inventory Tracking | |
TWI748857B (en) | System of product promotion using image tracking and method of the same | |
US9536158B2 (en) | Biometric based demography tool | |
US20140089079A1 (en) | Method and system for determining a correlation between an advertisement and a person who interacted with a merchant | |
TWI748858B (en) | System of product promotion using image tracking and method of the same | |
TWI716959B (en) | System of product promotion using image tracking and method of the same | |
US20210241207A1 (en) | Method for notifying of expiry date of medicine and computer program recording medium therefor | |
TW201942836A (en) | Store system, article matching method and apparatus, and electronic device | |
CN112036865B (en) | Service providing method, device and equipment | |
JP7476881B2 (en) | Information processing device, information processing method, and program | |
US11995683B2 (en) | System and method for providing information | |
JP2017228921A (en) | Projection system, projection method, and projection program | |
US20170269683A1 (en) | Display control method and device |