[go: up one dir, main page]

CN106210909A - TV the display processing method of content, Apparatus and system - Google Patents

TV the display processing method of content, Apparatus and system Download PDF

Info

Publication number
CN106210909A
CN106210909A CN201610668792.9A CN201610668792A CN106210909A CN 106210909 A CN106210909 A CN 106210909A CN 201610668792 A CN201610668792 A CN 201610668792A CN 106210909 A CN106210909 A CN 106210909A
Authority
CN
China
Prior art keywords
display content
sample
processing
feature
television
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610668792.9A
Other languages
Chinese (zh)
Inventor
张春红
陈展园
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen TCL New Technology Co Ltd
Original Assignee
Shenzhen TCL New Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen TCL New Technology Co Ltd filed Critical Shenzhen TCL New Technology Co Ltd
Priority to CN201610668792.9A priority Critical patent/CN106210909A/en
Publication of CN106210909A publication Critical patent/CN106210909A/en
Priority to PCT/CN2016/112918 priority patent/WO2018032693A1/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H04N21/4725End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content using interactive regions of the image, e.g. hot spots
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/475End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8545Content authoring for generating interactive applications

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)

Abstract

本发明公开了一种电视显示内容的处理方法,包括:获取电视机的当前显示内容,并对所述显示内容进行解码,以提取所述显示内容中预先植入的特征码;查找本地特征样本库,以确定本地特征样本库中是否存在与所述特征码相对应的AR样本;若存在,则播放所述AR样本,并对所述AR样本进行增强现实处理。本发明还公开了一种电视显示内容的处理装置及系统。本发明能够满足电视用户对于增强现实的需求,进而提升用户观看或操作电视的使用体验。

The invention discloses a method for processing display content of a TV, comprising: obtaining the current display content of the TV set, and decoding the display content to extract a pre-implanted feature code in the display content; searching for a local feature sample library to determine whether there is an AR sample corresponding to the feature code in the local feature sample library; if it exists, play the AR sample and perform augmented reality processing on the AR sample. The invention also discloses a TV display content processing device and system. The invention can meet the needs of TV users for augmented reality, and further improve the user experience of watching or operating the TV.

Description

电视显示内容的处理方法、装置及系统Method, device and system for processing TV display content

技术领域technical field

本发明涉及电视显示控制技术领域,尤其涉及电视显示内容的处理方法、装置及系统。The invention relates to the technical field of television display control, in particular to a processing method, device and system for television display content.

背景技术Background technique

现有的智能电视作为用户最常用的家用设备,目前还没有导入任何与增强现实技术(Augmented Reality,简称AR)相关的功能,究其主要原因:一是由于电视屏幕大、距离用户较远,因而不易于与用户进行互动,二是由于现有的AR技术通常都需要使用摄像头来采集图像并通过图像识别算法解析特征码,而后再一一匹配特征码与AR样本的索引关系,但此类方式受摄像头分辨率的限制,因而识别率低且识别速度慢,因而现有技术无法满足电视用户对于增强现实的需求。As the most commonly used household equipment for users, existing smart TVs have not yet introduced any functions related to Augmented Reality (AR). Therefore, it is not easy to interact with users. The second is that the existing AR technology usually needs to use a camera to collect images and analyze the feature codes through image recognition algorithms, and then match the index relationship between the feature codes and AR samples one by one. The method is limited by the resolution of the camera, so the recognition rate is low and the recognition speed is slow, so the existing technology cannot meet the needs of TV users for augmented reality.

发明内容Contents of the invention

本发明的主要目的在于提供一种电视显示内容的处理方法、装置及系统,旨在解决现有技术无法满足电视用户对于增强现实的需求的技术问题。The main purpose of the present invention is to provide a method, device and system for processing content displayed on a TV, aiming at solving the technical problem that the prior art cannot meet the needs of TV users for augmented reality.

为实现上述目的,本发明提供一种电视显示内容的处理方法,所述电视显示内容的处理方法包括:In order to achieve the above object, the present invention provides a method for processing TV display content, the method for processing TV display content includes:

获取电视机的当前显示内容,并对所述显示内容进行解码,以提取所述显示内容中预先植入的特征码;Obtaining the current display content of the TV set, and decoding the display content to extract the pre-embedded feature code in the display content;

查找本地特征样本库,以确定本地特征样本库中是否存在与所述特征码相对应的AR样本;Searching the local feature sample library to determine whether there is an AR sample corresponding to the feature code in the local feature sample library;

若存在,则播放所述AR样本,并对所述AR样本进行增强现实处理。If it exists, the AR sample is played, and augmented reality processing is performed on the AR sample.

优选地,所述增强现实处理包括与所述AR样本中的虚拟对象进行互动,所述播放所述AR样本,并对所述AR样本进行增强现实处理之后包括:Preferably, the augmented reality processing includes interacting with virtual objects in the AR sample, and after playing the AR sample and performing augmented reality processing on the AR sample includes:

将所述增强现实处理的过程同步发送给所述电视机,以供在所述电视机上同步显示与所述AR样本中的虚拟对象所进行的互动,其中,所述互动至少包括与所述虚拟对象进行点击或触摸的接触互动、与所述虚拟对象进行语音或文字的交流互动。synchronously sending the process of the augmented reality processing to the television, so that the interaction with the virtual object in the AR sample can be synchronously displayed on the television, wherein the interaction at least includes the interaction with the virtual The object performs click or touch contact interaction, and performs voice or text communication interaction with the virtual object.

优选地,所述显示内容至少包括视频节目显示内容、电视屏幕上的非视频节目显示内容中的一种或多种,所述特征码的载体形式至少包括视频节目中的人物面部、人物肢体动作、节目场景以及电视屏幕上显示的二维码、三维码。Preferably, the display content includes at least one or more of video program display content and non-video program display content on the TV screen, and the carrier form of the feature code includes at least the character's face and body movements of the character in the video program , program scenes, and QR codes and three-dimensional codes displayed on the TV screen.

优选地,所述电视显示内容的处理方法还包括:Preferably, the processing method of the TV display content further includes:

当本地特征样本库中不存在与所述特征码相对应的AR样本时,向云端服务器发送特征样本库更新请求,并将云端服务器下发的最新的特征样本库更新到本地特征样本库中。When there is no AR sample corresponding to the feature code in the local feature sample library, a feature sample library update request is sent to the cloud server, and the latest feature sample library issued by the cloud server is updated to the local feature sample library.

进一步地,为实现上述目的,本发明还提供一种电视显示内容的处理装置,所述电视显示内容的处理装置包括:Further, in order to achieve the above purpose, the present invention also provides a processing device for displaying content on a TV, the device for processing displaying content on a TV includes:

解码模块,用于获取电视机的当前显示内容,并对所述显示内容进行解码,以提取所述显示内容中预先植入的特征码;The decoding module is used to obtain the current display content of the TV set, and decode the display content to extract the pre-embedded feature code in the display content;

查找模块,用于查找本地特征样本库,以确定本地特征样本库中是否存在与所述特征码相对应的AR样本;A search module, configured to search a local feature sample library, to determine whether there is an AR sample corresponding to the feature code in the local feature sample library;

增强现实处理模块,用于当本地特征样本库中存在与所述特征码相对应的AR样本时,播放所述AR样本,并对所述AR样本进行增强现实处理。An augmented reality processing module, configured to play the AR sample and perform augmented reality processing on the AR sample when there is an AR sample corresponding to the feature code in the local feature sample database.

优选地,所述增强现实处理包括与所述AR样本中的虚拟对象进行互动,所述电视显示内容的处理装置还包括:Preferably, the augmented reality processing includes interacting with virtual objects in the AR sample, and the processing device for displaying content on the TV further includes:

同步模块,用于将所述增强现实处理的过程同步发送给所述电视机,以供在所述电视机上同步显示与所述AR样本中的虚拟对象所进行的互动,其中,所述互动至少包括与所述虚拟对象进行点击或触摸的接触互动、与所述虚拟对象进行语音或文字的交流互动。A synchronization module, configured to synchronously send the process of augmented reality processing to the television, so that the interaction with the virtual object in the AR sample can be synchronously displayed on the television, wherein the interaction is at least It includes click or touch contact interaction with the virtual object, voice or text communication interaction with the virtual object.

优选地,所述显示内容至少包括视频节目显示内容、电视屏幕上的非视频节目显示内容中的一种或多种,所述特征码的载体形式至少包括视频节目中的人物面部、人物肢体动作、节目场景以及电视屏幕上显示的二维码、三维码。Preferably, the display content includes at least one or more of video program display content and non-video program display content on the TV screen, and the carrier form of the feature code includes at least the character's face and body movements of the character in the video program , program scenes, and QR codes and three-dimensional codes displayed on the TV screen.

优选地,所述电视显示内容的处理装置还包括:Preferably, the processing device for displaying content on the TV further includes:

更新模块,用于当本地特征样本库中不存在与所述特征码相对应的AR样本时,向云端服务器发送特征样本库更新请求,并将云端服务器下发的最新的特征样本库更新到本地特征样本库中。An update module, configured to send a feature sample library update request to the cloud server when there is no AR sample corresponding to the feature code in the local feature sample library, and update the latest feature sample library issued by the cloud server to the local In the feature sample library.

进一步地,为实现上述目的,本发明还提供一种电视显示内容的处理系统,包括电视机,所述电视显示内容的处理系统还包括上述任一项所述的电视显示内容的处理装置。Further, in order to achieve the above object, the present invention also provides a TV display content processing system, including a TV, and the TV display content processing system further includes the TV display content processing device described in any one of the above.

优选地,所述电视显示内容的处理系统还包括:Preferably, the processing system of the TV display content further includes:

第一云端服务器,用于向所述电视机发送植入有新的特征码的电视信号,并将该新的特征码同步发送给第二云端服务器中的特征样本库;The first cloud server is used to send a TV signal embedded with a new feature code to the TV set, and send the new feature code synchronously to the feature sample library in the second cloud server;

第二云端服务器,用于接收所述第一云端服务器所发送的新的特征码,并建立该新的特征码与特征样本库中相应AR样本之间的对应关系;以及当接收到所述电视显示内容的处理装置所发送的特征样本库更新请求时,将最新的特征样本库下发给所述电视显示内容的处理装置。The second cloud server is used to receive the new feature code sent by the first cloud server, and establish the corresponding relationship between the new feature code and the corresponding AR sample in the feature sample library; and when receiving the TV When the feature sample library update request sent by the display content processing device sends the latest feature sample library to the television display content processing device.

本发明中,将电视上显示的内容作为采集图像,同时,预先在电视显示内容所对应的电视信号中植入相应的特征码,从而通过采集电视显示内容即可直接解码获得该特征码,进而再根据该特征码即可获得对应的本地AR样本并进行AR样本的增强现实处理,从而实现在电视机的外部设备上进行增强现实处理,因此满足了电视用户对于增强现实的使用需求,增加了用户使用电视机的趣味性与娱乐性。In the present invention, the content displayed on the TV is used as the collected image, and at the same time, the corresponding feature code is embedded in the TV signal corresponding to the TV display content in advance, so that the feature code can be directly decoded by collecting the TV display content, and then According to the feature code, the corresponding local AR sample can be obtained and the augmented reality processing of the AR sample can be performed, so that the augmented reality processing can be performed on the external device of the TV, thus meeting the needs of the TV users for using augmented reality and increasing the The fun and entertainment of users using TV.

附图说明Description of drawings

图1为本发明电视显示内容的处理方法第一实施例的流程示意图;FIG. 1 is a schematic flowchart of a first embodiment of a method for processing television display content according to the present invention;

图2为本发明电视显示内容的处理方法第二实施例的流程示意图;FIG. 2 is a schematic flowchart of a second embodiment of a method for processing television display content according to the present invention;

图3为本发明电视显示内容的处理装置第一实施例的功能模块示意图;3 is a schematic diagram of the functional modules of the first embodiment of the device for processing television display content according to the present invention;

图4为本发明电视显示内容的处理装置第二实施例的功能模块示意图;4 is a schematic diagram of the functional modules of the second embodiment of the device for processing television display content according to the present invention;

图5为本发明电视显示内容的处理装置第三实施例的功能模块示意图;5 is a schematic diagram of functional modules of a third embodiment of a processing device for displaying content on a television according to the present invention;

图6为本发明电视显示内容的处理系统第一实施例的功能模块示意图;6 is a schematic diagram of functional modules of the first embodiment of the system for processing television display content according to the present invention;

图7为本发明电视显示内容的处理系统第二实施例的功能模块示意图。FIG. 7 is a schematic diagram of functional modules of a second embodiment of a system for processing content displayed on a television according to the present invention.

本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization of the purpose of the present invention, functional characteristics and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

具体实施方式detailed description

应当理解,此处所描述的具体实施例仅用以解释本发明,并不用于限定本发明。It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

参照图1,图1为本发明电视显示内容的处理方法第一实施例的流程示意图。本实施例中,所述电视显示内容的处理方法包括:Referring to FIG. 1 , FIG. 1 is a schematic flowchart of a first embodiment of a method for processing content displayed on a television according to the present invention. In this embodiment, the processing method of the TV display content includes:

步骤S10,获取电视机的当前显示内容,并对所述显示内容进行解码,以提取所述显示内容中预先植入的特征码;Step S10, acquiring the current display content of the TV set, and decoding the display content to extract the pre-embedded feature code in the display content;

本实施例中对于获取电视机显示内容的方式不限,比如通过摄像头的方式直接拍摄电视显示内容,或者通过扫描方式扫描电视内容等。In this embodiment, there is no limit to the method of acquiring the display content of the TV, for example, directly capturing the display content of the TV by means of a camera, or scanning the content of the TV by scanning.

此外,本实施例中,电视机播放的所有内容中都可以植入有特征码,或者只对电视播放的部分内容植入特征码,但该部分内容中需要进行相应标示,从而方便用户确定该部分内容中有特征码,比如,用户在观看电视节目时,若电视上标示出当前显示内容有特征码,则用户可以通过外部设备(比如智能AR眼睛、智能遥控器、智能手机等)扫描当前显示内容,从而获得电视机的当前显示内容,并进行解码。In addition, in this embodiment, the feature code can be embedded in all the content played by the TV, or only a part of the content played on the TV can be embedded with the feature code, but this part of the content needs to be marked accordingly, so that it is convenient for the user to determine the feature code. There are feature codes in some content. For example, when the user is watching a TV program, if the TV shows that the currently displayed content has a feature code, the user can scan the current display through external devices (such as smart AR eyes, smart remote control, smart phone, etc.). Display content, so as to obtain the current display content of the TV and decode it.

需要说明的是,本实施例中对于电视显示内容的解码方式不限,具体根据电视显示内容中,特征码所对应的载体形式而定,比如电视显示内容可以为视频、图片、文字等,因此对应可以作为特征码的载体形式也很多,比如视频人物的面部特征、肢体动作、视频场景中的建筑以及电视屏幕上显示的其他内容,比如滚动的图标、文字等。It should be noted that, in this embodiment, there is no limit to the decoding method of the TV display content, and it depends on the carrier form corresponding to the feature code in the TV display content. For example, the TV display content can be video, picture, text, etc., so Correspondingly, there are many carrier forms that can be used as feature codes, such as facial features, body movements of video characters, buildings in video scenes, and other content displayed on the TV screen, such as scrolling icons and text.

步骤S20,查找本地特征样本库,以确定本地特征样本库中是否存在与所述特征码相对应的AR样本;Step S20, searching the local feature sample library to determine whether there is an AR sample corresponding to the feature code in the local feature sample library;

本实施例中,本地特征样本库具体存储在电视机的外设上,比如智能AR眼睛、智能遥控器、智能手机等都可以作为电视机的外设。In this embodiment, the local feature sample library is specifically stored on peripherals of the TV, for example, smart AR eyes, smart remote controllers, smart phones, etc. can all be used as peripherals of the TV.

本实施例中,本地特征样本库保存有各种AR样本,为便于保存及区分各AR样本,因此可建立AR样本的标识,该标识即可作为特征码与AR样本的对应索引关系,比如AR样本的标识既可以与特征码相同,也可以不同。例如,AR样本1的标识AR001,则特征码既可以设置为AR001,也可以设置为其他编码或字符,具体根据实际需要进行设置。因此,以从电视显示内容中提取的特征码为查询条件,查找本地特征样本库,以获取与该特征码相对应的AR样本。In this embodiment, various AR samples are stored in the local feature sample library. In order to save and distinguish each AR sample, an identification of the AR sample can be established, and the identification can be used as the corresponding index relationship between the feature code and the AR sample, such as AR The identity of the sample can be the same as the signature, or it can be different. For example, if the ID of AR sample 1 is AR001, the feature code can be set to AR001, or other codes or characters, which are set according to actual needs. Therefore, using the feature code extracted from the TV display content as the query condition, search the local feature sample library to obtain the AR sample corresponding to the feature code.

本实施例中,对于特征码的编码规则不限,例如,特征码与AR样本的标识设为相同,且每个AR样本的标识由字母与数字组合,比如字母P代表图片,AR样本的标识编码为P001,P002,P003,…,这里001,002代表AR样本的数据地址;字母V代表video,V001,V002,V003,…,字母M代表音乐,M001,M002….等。In this embodiment, the coding rules for the feature code are not limited. For example, the feature code and the ID of the AR sample are set to be the same, and the ID of each AR sample is a combination of letters and numbers. For example, the letter P represents a picture, and the ID of the AR sample The codes are P001, P002, P003,..., where 001,002 represent the data address of the AR sample; the letter V represents video, V001, V002, V003,..., the letter M represents music, M001, M002...etc.

此外,需要说明的是,由于电视机播放显示的内容非常丰富,同时也为提升用户使用体验,因此,还可预先制作更多的AR样本并保存在云端,进而通过远程下载方式更新到本地特征样本库中。In addition, it should be noted that since the content displayed on the TV is very rich, and in order to improve the user experience, more AR samples can be pre-made and stored in the cloud, and then updated to the local features through remote downloading. in the sample library.

步骤S30,若存在,则播放所述AR样本,并对所述AR样本进行增强现实处理。Step S30, if it exists, play the AR sample, and perform augmented reality processing on the AR sample.

本实施例中,当本地特征样本库中存在与提取的特征码相对应的AR样本时,则播放该AR样本,同时对播放的该AR样本进行增强现实处理,比如与播放的AR样本中的虚拟对象进行互动,比如对话、触摸、合影等。此外,需要进一步说明的是,在播放AR样本的同时,还可以对播放的该AR样本进行暂停、快进等多种播放处理。In this embodiment, when there is an AR sample corresponding to the extracted feature code in the local feature sample library, the AR sample is played, and at the same time, augmented reality processing is performed on the played AR sample. Interact with virtual objects, such as dialogue, touch, group photo, etc. In addition, it needs to be further explained that while the AR sample is being played, various playback processes such as pause and fast forward can also be performed on the played AR sample.

本实施例中,将电视上显示的内容作为采集图像,同时,预先在电视显示内容所对应的电视信号中植入相应的特征码,从而通过采集电视显示内容即可直接解码获得该特征码,进而再根据该特征码即可获得对应的本地AR样本并进行AR样本展示,从而实现在电视机的外部设备上进行增强显示处理,因此满足了电视用户对于增强现实的使用需求,增加了用户使用电视机的趣味性与娱乐性。In this embodiment, the content displayed on the TV is used as the collected image, and at the same time, the corresponding feature code is embedded in the TV signal corresponding to the TV display content in advance, so that the feature code can be directly decoded by collecting the TV display content, Then, according to the feature code, the corresponding local AR samples can be obtained and AR samples can be displayed, so as to realize enhanced display processing on the external equipment of the TV, thus satisfying the needs of TV users for using augmented reality and increasing user usage. TV fun and entertainment.

参照图2,图2为本发明电视显示内容的处理方法第二实施例的流程示意图。基于上述方法第一实施例,本实施例中,所述增强现实处理包括与所述AR样本中的虚拟对象进行互动,上述步骤S30之后包括:Referring to FIG. 2 , FIG. 2 is a schematic flowchart of a second embodiment of a method for processing content displayed on a television according to the present invention. Based on the first embodiment of the above method, in this embodiment, the augmented reality processing includes interacting with the virtual objects in the AR sample, and after the above step S30 includes:

步骤S40,将所述增强现实处理的过程同步发送给所述电视机,以供在所述电视机上同步显示与所述AR样本中的虚拟对象所进行的互动,其中,所述互动至少包括与所述虚拟对象进行点击或触摸的接触互动、与所述虚拟对象进行语音或文字的交流互动。Step S40, synchronously sending the process of augmented reality processing to the television, so that the interaction with the virtual object in the AR sample can be synchronously displayed on the television, wherein the interaction at least includes The virtual object performs click or touch contact interaction, and performs voice or text communication interaction with the virtual object.

本实施例中,为进一步提升用户体验,因此可以将增强现实处理的过程同步发送给电视机,进而借助电视机的大屏幕同步显示用户与AR样本中的虚拟对象所进行的互动,比如对话、合影、K歌等等。此外,若电视机也支持播放AR样本的话,则也可将AR样本发送至电视机上进行播放。In this embodiment, in order to further improve the user experience, the process of augmented reality processing can be sent to the TV synchronously, and then the interaction between the user and the virtual objects in the AR samples can be synchronously displayed on the large screen of the TV, such as dialogue, Group photo, karaoke and so on. In addition, if the TV also supports playing the AR sample, the AR sample can also be sent to the TV for playback.

本实施例中,通过将外设上对AR样本的增强现实处理的过程同步发送给电视机,进而能够间接借助于电视机的大屏幕同步显示用户与AR样本中的虚拟对象所进行的互动,进而提升用户体验。In this embodiment, by synchronously sending the augmented reality processing process of the AR sample on the peripheral device to the TV, the interaction between the user and the virtual object in the AR sample can be displayed indirectly by means of the large screen of the TV synchronously, Thereby improving user experience.

进一步可选的,电视显示内容的处理方法一实施例中,所述显示内容至少包括视频节目显示内容、电视屏幕上的非视频节目显示内容中的一种或多种,所述特征码的载体形式至少包括视频节目中的人物面部、人物肢体动作、节目场景以及电视屏幕上显示的二维码、三维码。Further optionally, in an embodiment of the method for processing content displayed on a TV, the displayed content includes at least one or more of video program display content and non-video program display content on the TV screen, and the carrier of the feature code The form includes at least the face of the characters in the video program, the body movements of the characters, the scene of the program, and the two-dimensional codes and three-dimensional codes displayed on the TV screen.

本实施例中,需要预先将特征码植入电视信号中,进而在电视机解码该电视信号的同时,可以显示植入的特征码。通常,电视信号可以分为视频节目信号、音频节目信号以及其他可以显示的信号,比如电视屏幕上的滚动字幕、电视屏幕上显示的图标或者图片等。In this embodiment, the feature code needs to be embedded in the TV signal in advance, and then the embedded feature code can be displayed while the TV is decoding the TV signal. Generally, TV signals can be classified into video program signals, audio program signals, and other signals that can be displayed, such as scrolling subtitles on the TV screen, icons or pictures displayed on the TV screen, and the like.

因此,本实施例中,对于电视机播放的显示内容既可以是视频节目显示内容,也可以是电视屏幕上的非视频节目显示内容。因此,相应的,对于包含有特征码的显示内容即为特征码的载体形式,因此,本实施例中,特征码的载体形式至少包括视频节目中的人物面部、人物肢体动作、节目场景以及电视屏幕上显示的二维码、三维码等。Therefore, in this embodiment, the display content played by the TV set may be the display content of video programs, or the display content of non-video programs on the TV screen. Therefore, correspondingly, the display content containing the feature code is the carrier form of the feature code. Therefore, in this embodiment, the carrier form of the feature code at least includes the face of the character in the video program, the body movement of the character, the program scene and the TV program. QR codes, 3D codes, etc. displayed on the screen.

比如,电视节目播放孙悟空的视频节目,则可在孙悟空的面部上植入特征码,进而用户通过外设拍摄孙悟空的面部时,将解码获得植入的特征码;或者可以将特征码植入视频节目中的人物肢体动作当中,或者也可以将特征码植入节目场景中,比如植入建筑物中、植入风景中等。当然,除了植入视频节目内容中外,还可以植入屏幕上显示的其他内容中,比如植入滚动显示的字幕中,植入屏幕上显示的二维码、三维码中等。For example, if a TV program broadcasts Monkey King's video program, a feature code can be implanted on Monkey King's face, and then when the user takes a picture of Monkey King's face through a peripheral device, the embedded feature code will be decoded; or the feature code can be embedded in the video In the body movements of the characters in the program, or the feature code can also be implanted in the program scene, such as implanted in the building, implanted in the landscape and so on. Of course, in addition to embedding in video program content, it can also be embedded in other content displayed on the screen, such as embedding in scrolling subtitles, embedding in QR codes and three-dimensional codes displayed on the screen, etc.

进一步可选的,在本发明电视显示内容的处理方法另一实施例中,所述电视显示内容的处理方法还包括:Further optionally, in another embodiment of the method for processing television display content of the present invention, the method for processing television display content further includes:

当本地特征样本库中不存在与所述特征码相对应的AR样本时,向云端服务器发送特征样本库更新请求,并将云端服务器下发的最新的特征样本库更新到本地特征样本库中。When there is no AR sample corresponding to the feature code in the local feature sample library, a feature sample library update request is sent to the cloud server, and the latest feature sample library issued by the cloud server is updated to the local feature sample library.

本实施例中,由于电视机播放显示的内容非常丰富,同时也为提升用户使用体验,因此,还可预先制作更多的AR样本并保存在云端,进而通过远程下载方式更新到本地特征样本库中。In this embodiment, because the content displayed on the TV is very rich, and also to improve the user experience, more AR samples can also be pre-made and stored in the cloud, and then updated to the local feature sample library through remote downloading middle.

参照图3,图3为本发明电视显示内容的处理装置第一实施例的功能模块示意图。本实施例中,所述电视显示内容的处理装置包括:Referring to FIG. 3 , FIG. 3 is a schematic diagram of functional modules of a first embodiment of an apparatus for processing television display content according to the present invention. In this embodiment, the device for processing the content displayed on the TV includes:

解码模块10,用于获取电视机的当前显示内容,并对所述显示内容进行解码,以提取所述显示内容中预先植入的特征码;The decoding module 10 is used to obtain the current display content of the TV set, and decode the display content to extract the pre-embedded feature code in the display content;

本实施例中对于获取电视机显示内容的方式不限,比如通过摄像头的方式直接拍摄电视显示内容,或者通过扫描方式扫描电视内容等。In this embodiment, there is no limit to the method of acquiring the display content of the TV, for example, directly capturing the display content of the TV by means of a camera, or scanning the content of the TV by scanning.

此外,本实施例中,电视机播放的所有内容中都可以植入有特征码,或者只对电视播放的部分内容植入特征码,但该部分内容中需要进行相应标示,从而方便用户确定该部分内容中有特征码,比如,用户在观看电视节目时,若电视上标示出当前显示内容有特征码,则用户可以通过外部设备(比如智能AR眼睛、智能遥控器、智能手机等)扫描当前显示内容,从而获得电视机的当前显示内容,并进行解码。In addition, in this embodiment, the feature code can be embedded in all the content played by the TV, or only a part of the content played on the TV can be embedded with the feature code, but this part of the content needs to be marked accordingly, so that it is convenient for the user to determine the feature code. There are feature codes in some content. For example, when the user is watching a TV program, if the TV shows that the currently displayed content has a feature code, the user can scan the current display through external devices (such as smart AR eyes, smart remote control, smart phone, etc.). Display content, so as to obtain the current display content of the TV and decode it.

需要说明的是,本实施例中对于电视显示内容的解码方式不限,具体根据电视显示内容中,特征码所对应的载体形式而定,比如电视显示内容可以为视频、图片、文字等,因此对应可以作为特征码的载体形式也很多,比如视频人物的面部特征、肢体动作、视频场景中的建筑以及电视屏幕上显示的其他内容,比如滚动的图标、文字等。It should be noted that, in this embodiment, there is no limit to the decoding method of the TV display content, and it depends on the carrier form corresponding to the feature code in the TV display content. For example, the TV display content can be video, picture, text, etc., so Correspondingly, there are many carrier forms that can be used as feature codes, such as facial features, body movements of video characters, buildings in video scenes, and other content displayed on the TV screen, such as scrolling icons and text.

查找模块20,用于查找本地特征样本库,以确定本地特征样本库中是否存在与所述特征码相对应的AR样本;The search module 20 is used to search the local feature sample library to determine whether there is an AR sample corresponding to the feature code in the local feature sample library;

本实施例中,本地特征样本库具体存储在电视机的外设上,比如智能AR眼睛、智能遥控器、智能手机等都可以作为电视机的外设。In this embodiment, the local feature sample library is specifically stored on peripherals of the TV, for example, smart AR eyes, smart remote controllers, smart phones, etc. can all be used as peripherals of the TV.

本实施例中,本地特征样本库保存有各种AR样本,为便于保存及区分各AR样本,因此可建立AR样本的标识,该标识即可作为特征码与AR样本的对应索引关系,比如AR样本的标识既可以与特征码相同,也可以不同。例如,AR样本1的标识AR001,则特征码既可以设置为AR001,也可以设置为其他编码或字符,具体根据实际需要进行设置。因此,以从电视显示内容中提取的特征码为查询条件,查找本地特征样本库,以获取与该特征码相对应的AR样本。In this embodiment, various AR samples are stored in the local feature sample library. In order to save and distinguish each AR sample, an identification of the AR sample can be established, and the identification can be used as the corresponding index relationship between the feature code and the AR sample, such as AR The identity of the sample can be the same as the signature, or it can be different. For example, if the ID of AR sample 1 is AR001, the feature code can be set to AR001, or other codes or characters, which are set according to actual needs. Therefore, using the feature code extracted from the TV display content as the query condition, search the local feature sample library to obtain the AR sample corresponding to the feature code.

本实施例中,对于特征码的编码规则不限,例如,特征码与AR样本的标识设为相同,且每个AR样本的标识由字母与数字组合,比如字母P代表图片,AR样本的标识编码为P001,P002,P003,…,这里001,002代表AR样本的数据地址;字母V代表video,V001,V002,V003,…,字母M代表音乐,M001,M002….等。In this embodiment, the coding rules for the feature code are not limited. For example, the feature code and the ID of the AR sample are set to be the same, and the ID of each AR sample is a combination of letters and numbers. For example, the letter P represents a picture, and the ID of the AR sample The codes are P001, P002, P003,..., where 001,002 represent the data address of the AR sample; the letter V represents video, V001, V002, V003,..., the letter M represents music, M001, M002...etc.

此外,需要说明的是,由于电视机播放显示的内容非常丰富,同时也为提升用户使用体验,因此,还可预先制作更多的AR样本并保存在云端,进而通过远程下载方式更新到本地特征样本库中。In addition, it should be noted that since the content displayed on the TV is very rich, and in order to improve the user experience, more AR samples can be pre-made and stored in the cloud, and then updated to the local features through remote downloading. in the sample library.

增强现实处理模块30,用于当本地特征样本库中存在与所述特征码相对应的AR样本时,播放所述AR样本,并对所述AR样本进行增强现实处理。The augmented reality processing module 30 is configured to play the AR sample and perform augmented reality processing on the AR sample when there is an AR sample corresponding to the feature code in the local feature sample library.

本实施例中,当本地特征样本库中存在与提取的特征码相对应的AR样本时,则播放该AR样本,同时对播放的该AR样本进行增强现实处理,比如与播放的AR样本中的虚拟对象进行互动,比如对话、触摸、合影等。此外,需要进一步说明的是,在播放AR样本的同时,还可以对播放的该AR样本进行暂停、快进等多种播放处理。In this embodiment, when there is an AR sample corresponding to the extracted feature code in the local feature sample library, the AR sample is played, and at the same time, augmented reality processing is performed on the played AR sample. Interact with virtual objects, such as dialogue, touch, group photo, etc. In addition, it needs to be further explained that while the AR sample is being played, various playback processes such as pause and fast forward can also be performed on the played AR sample.

本实施例中,将电视上显示的内容作为采集图像,同时,预先在电视显示内容所对应的电视信号中植入相应的特征码,从而通过采集电视显示内容即可直接解码获得该特征码,进而再根据该特征码即可获得对应的本地AR样本并进行AR样本展示,从而实现在电视机的外部设备上进行增强显示处理,因此满足了电视用户对于增强现实的使用需求,增加了用户使用电视机的趣味性与娱乐性。In this embodiment, the content displayed on the TV is used as the collected image, and at the same time, the corresponding feature code is embedded in the TV signal corresponding to the TV display content in advance, so that the feature code can be directly decoded by collecting the TV display content, Then, according to the feature code, the corresponding local AR samples can be obtained and AR samples can be displayed, so as to realize enhanced display processing on the external equipment of the TV, thus satisfying the needs of TV users for using augmented reality and increasing user usage. TV fun and entertainment.

参照图4,图4为本发明电视显示内容的处理装置第二实施例的功能模块示意图。基于上述装置第一实施例,本实施例中,所述增强现实处理包括与所述AR样本中的虚拟对象进行互动,所述电视显示内容的处理装置还包括:Referring to FIG. 4 , FIG. 4 is a schematic diagram of functional modules of a second embodiment of an apparatus for processing television display content according to the present invention. Based on the first embodiment of the device above, in this embodiment, the augmented reality processing includes interacting with the virtual objects in the AR sample, and the device for processing the content displayed on the TV further includes:

同步模块40,用于将所述增强现实处理的过程同步发送给所述电视机,以供在所述电视机上同步显示与所述AR样本中的虚拟对象所进行的互动,其中,所述互动至少包括与所述虚拟对象进行点击或触摸的接触互动、与所述虚拟对象进行语音或文字的交流互动。A synchronization module 40, configured to synchronously send the process of augmented reality processing to the television, so that the interaction with the virtual object in the AR sample can be synchronously displayed on the television, wherein the interaction At least including click or touch contact interaction with the virtual object, voice or text communication interaction with the virtual object.

本实施例中,为进一步提升用户体验,因此可以将增强现实处理的过程同步发送给电视机,进而借助电视机的大屏幕同步显示用户与AR样本中的虚拟对象所进行的互动,比如对话、合影、K歌等等。此外,若电视机也支持播放AR样本的话,则也可将AR样本发送至电视机上进行播放。In this embodiment, in order to further improve the user experience, the process of augmented reality processing can be sent to the TV synchronously, and then the interaction between the user and the virtual objects in the AR samples can be synchronously displayed on the large screen of the TV, such as dialogue, Group photo, karaoke and so on. In addition, if the TV also supports playing the AR sample, the AR sample can also be sent to the TV for playback.

本实施例中,通过将外设上对AR样本的增强现实处理的过程同步发送给电视机,进而能够间接借助于电视机的大屏幕同步显示用户与AR样本中的虚拟对象所进行的互动,进而提升用户体验。In this embodiment, by synchronously sending the augmented reality processing process of the AR sample on the peripheral device to the TV, the interaction between the user and the virtual object in the AR sample can be displayed indirectly by means of the large screen of the TV synchronously, Thereby improving user experience.

进一步可选的,在本发明电视显示内容的处理装置一实施例中,所述显示内容至少包括视频节目显示内容、电视屏幕上的非视频节目显示内容中的一种或多种,所述特征码的载体形式至少包括视频节目中的人物面部、人物肢体动作、节目场景以及电视屏幕上显示的二维码、三维码。Further optionally, in an embodiment of the device for processing television display content of the present invention, the display content at least includes one or more of video program display content and non-video program display content on the TV screen. The carrier form of the code includes at least the face of the character in the video program, the body movement of the character, the scene of the program, and the two-dimensional code and three-dimensional code displayed on the TV screen.

本实施例中,需要预先将特征码植入电视信号中,进而在电视机解码该电视信号的同时,可以显示植入的特征码。通常,电视信号可以分为视频节目信号、音频节目信号以及其他可以显示的信号,比如电视屏幕上的滚动字幕、电视屏幕上显示的图标或者图片等。In this embodiment, the feature code needs to be embedded in the TV signal in advance, and then the embedded feature code can be displayed while the TV is decoding the TV signal. Generally, TV signals can be classified into video program signals, audio program signals, and other signals that can be displayed, such as scrolling subtitles on the TV screen, icons or pictures displayed on the TV screen, and the like.

因此,本实施例中,对于电视机播放的显示内容既可以是视频节目显示内容,也可以是电视屏幕上的非视频节目显示内容。因此,相应的,对于包含有特征码的显示内容即为特征码的载体形式,因此,本实施例中,特征码的载体形式至少包括视频节目中的人物面部、人物肢体动作、节目场景以及电视屏幕上显示的二维码、三维码等。Therefore, in this embodiment, the display content played by the TV set may be the display content of video programs, or the display content of non-video programs on the TV screen. Therefore, correspondingly, the display content containing the feature code is the carrier form of the feature code. Therefore, in this embodiment, the carrier form of the feature code at least includes the face of the character in the video program, the body movement of the character, the program scene and the TV program. QR codes, 3D codes, etc. displayed on the screen.

比如,电视节目播放孙悟空的视频节目,则可在孙悟空的面部上植入特征码,进而用户通过外设拍摄孙悟空的面部时,将解码获得植入的特征码;或者可以将特征码植入视频节目中的人物肢体动作当中,或者也可以将特征码植入节目场景中,比如植入建筑物中、植入风景中等。当然,除了植入视频节目内容中外,还可以植入屏幕上显示的其他内容中,比如植入滚动显示的字幕中,植入屏幕上显示的二维码、三维码中等。For example, if a TV program broadcasts Monkey King's video program, a feature code can be implanted on Monkey King's face, and then when the user takes a picture of Monkey King's face through a peripheral device, the embedded feature code will be decoded; or the feature code can be embedded in the video In the body movements of the characters in the program, or the feature code can also be implanted in the program scene, such as implanted in the building, implanted in the landscape and so on. Of course, in addition to embedding in video program content, it can also be embedded in other content displayed on the screen, such as embedding in scrolling subtitles, embedding in QR codes and three-dimensional codes displayed on the screen, etc.

参照图5,图5为本发明电视显示内容的处理装置第三实施例的功能模块示意图。基于上述装置第一实施例,本实施例中,电视显示内容的处理装置还包括:Referring to FIG. 5 , FIG. 5 is a schematic diagram of functional modules of a third embodiment of an apparatus for processing television display content according to the present invention. Based on the first embodiment of the device above, in this embodiment, the device for processing the content displayed on the TV further includes:

更新模块50,用于当本地特征样本库中不存在与所述特征码相对应的AR样本时,向云端服务器发送特征样本库更新请求,并将云端服务器下发的最新的特征样本库更新到本地特征样本库中。The update module 50 is configured to send a feature sample library update request to the cloud server when there is no AR sample corresponding to the feature code in the local feature sample library, and update the latest feature sample library issued by the cloud server to in the local feature sample library.

本实施例中,由于电视机播放显示的内容非常丰富,同时也为提升用户使用体验,因此,还可预先制作更多的AR样本并保存在云端,进而通过远程下载方式更新到本地特征样本库中。In this embodiment, because the content displayed on the TV is very rich, and also to improve the user experience, more AR samples can also be pre-made and stored in the cloud, and then updated to the local feature sample library through remote downloading middle.

参照图6,图6为本发明电视显示内容的处理系统第一实施例的功能模块示意图。本实施例中,电视显示内容的处理系统包括电视机210以及上述装置实施例中所述的电视显示内容的处理装置220。Referring to FIG. 6 , FIG. 6 is a schematic diagram of functional modules of a first embodiment of a system for processing content displayed on a television according to the present invention. In this embodiment, the system for processing the content displayed on the TV includes a TV 210 and the device 220 for processing the content displayed on the TV described in the above device embodiments.

本实施例中,电视显示内容的处理装置220为电视机210的外设设备,可以为智能AR眼睛、智能遥控器、智能手机等。In this embodiment, the TV display content processing device 220 is a peripheral device of the TV 210, which may be a smart AR eye, a smart remote control, a smart phone, and the like.

本实施例中,将电视机210上显示的内容作为采集图像,同时,预先在电视显示内容所对应的电视信号中植入相应的特征码,从而电视显示内容的处理装置220通过采集电视显示内容即可直接解码获得该特征码,进而再根据该特征码即可获得对应的本地AR样本并进行AR样本展示,从而实现在电视机的外部设备上进行增强显示处理,因此满足了电视用户对于增强现实的使用需求,增加了用户使用电视机的趣味性与娱乐性。In this embodiment, the content displayed on the TV 210 is used as the captured image, and at the same time, the corresponding feature code is embedded in the TV signal corresponding to the TV display content in advance, so that the processing device 220 of the TV display content collects the TV display content The feature code can be directly decoded to obtain the feature code, and then the corresponding local AR sample can be obtained and displayed according to the feature code, so as to realize enhanced display processing on the external device of the TV, thus satisfying the needs of TV users for enhanced Realistic use requirements increase the interest and entertainment of the user in using the TV set.

参照图7,图7为本发明电视显示内容的处理系统第二实施例的功能模块示意图。基于上述系统第一实施例,本实施例中,所述电视显示内容的处理系统还包括:Referring to FIG. 7 , FIG. 7 is a schematic diagram of functional modules of a second embodiment of a system for processing content displayed on a television according to the present invention. Based on the above-mentioned first embodiment of the system, in this embodiment, the processing system of the TV display content further includes:

第一云端服务器230,用于向所述电视机发送植入有新的特征码的电视信号,并将该新的特征码同步发送给第二云端服务器中的特征样本库;The first cloud server 230 is used to send a TV signal embedded with a new feature code to the TV set, and send the new feature code to the feature sample library in the second cloud server synchronously;

第二云端服务器240,用于接收所述第一云端服务器所发送的新的特征码,并建立该新的特征码与特征样本库中相应AR样本之间的对应关系;以及当接收到所述电视显示内容的处理装置所发送的特征样本库更新请求时,将最新的特征样本库下发给所述电视显示内容的处理装置。The second cloud server 240 is configured to receive the new feature code sent by the first cloud server, and establish a corresponding relationship between the new feature code and the corresponding AR sample in the feature sample library; and when receiving the new feature code, When the feature sample library update request is sent by the TV display content processing device, the latest feature sample library is sent to the TV display content processing device.

本实施例中,为更好地为用户提供更为丰富的AR体验,因此,通过第一云端服务器230,将植入有新的特征码的电视信号发送给电视机210,同时也为保证新的特征码与第二云端服务器240中存储的特征样本库中的相应AR样本建立对应关系,因此,第一云端服务器230还将该新的特征码同步发送给第二云端服务器240中的特征样本库。In this embodiment, in order to better provide users with a richer AR experience, therefore, through the first cloud server 230, the TV signal embedded with the new feature code is sent to the TV 210. The feature code of the corresponding AR sample in the feature sample library stored in the second cloud server 240 establishes a corresponding relationship. Therefore, the first cloud server 230 also sends the new feature code to the feature sample in the second cloud server 240 synchronously. library.

此外,若电视显示内容的处理装置220的本地特征样本库中不存在新的特征码所对应的AR样本,则电视显示内容的处理装置220可向第二云端服务器240发送特征样本库更新请求,进而可从第二云端服务器240上下载最新的特征样本库,也即包含有最新的AR样本,从而可完成新的特征码所对应的AR样本的展示。In addition, if there is no AR sample corresponding to the new feature code in the local feature sample library of the TV display content processing device 220, the TV display content processing device 220 may send a feature sample library update request to the second cloud server 240, Furthermore, the latest feature sample database can be downloaded from the second cloud server 240 , that is, the latest AR sample can be included, so that the display of the AR sample corresponding to the new feature code can be completed.

以上仅为本发明的优选实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process conversion made by using the description of the present invention and the contents of the accompanying drawings, or directly or indirectly used in other related technical fields , are all included in the scope of patent protection of the present invention in the same way.

Claims (10)

1.一种电视显示内容的处理方法,其特征在于,所述电视显示内容的处理方法包括:1. A processing method of television display content, characterized in that, the processing method of said television display content comprises: 获取电视机的当前显示内容,并对所述显示内容进行解码,以提取所述显示内容中预先植入的特征码;Obtaining the current display content of the TV set, and decoding the display content to extract the pre-embedded feature code in the display content; 查找本地特征样本库,以确定本地特征样本库中是否存在与所述特征码相对应的AR样本;Searching the local feature sample library to determine whether there is an AR sample corresponding to the feature code in the local feature sample library; 若存在,则播放所述AR样本,并对所述AR样本进行增强现实处理。If it exists, the AR sample is played, and augmented reality processing is performed on the AR sample. 2.如权利要1所述的电视显示内容的处理方法,其特征在于,所述增强现实处理包括与所述AR样本中的虚拟对象进行互动,所述播放所述AR样本,并对所述AR样本进行增强现实处理之后包括:2. The method for processing television display content according to claim 1, wherein the augmented reality processing includes interacting with virtual objects in the AR samples, playing the AR samples, and AR samples after augmented reality processing include: 将所述增强现实处理的过程同步发送给所述电视机,以供在所述电视机上同步显示与所述AR样本中的虚拟对象所进行的互动,其中,所述互动至少包括与所述虚拟对象进行点击或触摸的接触互动、与所述虚拟对象进行语音或文字的交流互动。synchronously sending the process of the augmented reality processing to the television, so that the interaction with the virtual object in the AR sample can be synchronously displayed on the television, wherein the interaction at least includes the interaction with the virtual The object performs click or touch contact interaction, and performs voice or text communication interaction with the virtual object. 3.如权利要1或2所述的电视显示内容的处理方法,其特征在于,所述显示内容至少包括视频节目显示内容、电视屏幕上的非视频节目显示内容中的一种或多种,所述特征码的载体形式至少包括视频节目中的人物面部、人物肢体动作、节目场景以及电视屏幕上显示的二维码、三维码。3. The method for processing TV display content as claimed in claim 1 or 2, wherein the display content at least includes one or more of video program display content, non-video program display content on the TV screen, The carrier form of the feature code includes at least the face of the character in the video program, the body movement of the character, the scene of the program, and the two-dimensional code and three-dimensional code displayed on the TV screen. 4.如权利要3所述的电视显示内容的处理方法,其特征在于,所述电视显示内容的处理方法还包括:4. the processing method of TV display content as claimed in claim 3, is characterized in that, the processing method of described TV display content also comprises: 当本地特征样本库中不存在与所述特征码相对应的AR样本时,向云端服务器发送特征样本库更新请求,并将云端服务器下发的最新的特征样本库更新到本地特征样本库中。When there is no AR sample corresponding to the feature code in the local feature sample library, a feature sample library update request is sent to the cloud server, and the latest feature sample library issued by the cloud server is updated to the local feature sample library. 5.一种电视显示内容的处理装置,其特征在于,所述电视显示内容的处理装置包括:5. A processing device for TV display content, characterized in that, the processing device for TV display content comprises: 解码模块,用于获取电视机的当前显示内容,并对所述显示内容进行解码,以提取所述显示内容中预先植入的特征码;The decoding module is used to obtain the current display content of the TV set, and decode the display content to extract the pre-embedded feature code in the display content; 查找模块,用于查找本地特征样本库,以确定本地特征样本库中是否存在与所述特征码相对应的AR样本;A search module, configured to search a local feature sample library, to determine whether there is an AR sample corresponding to the feature code in the local feature sample library; 增强现实处理模块,用于当本地特征样本库中存在与所述特征码相对应的AR样本时,播放所述AR样本,并对所述AR样本进行增强现实处理。An augmented reality processing module, configured to play the AR sample and perform augmented reality processing on the AR sample when there is an AR sample corresponding to the feature code in the local feature sample database. 6.如权利要5所述的电视显示内容的处理装置,其特征在于,所述增强现实处理包括与所述AR样本中的虚拟对象进行互动,所述电视显示内容的处理装置还包括:6. The device for processing TV display content according to claim 5, wherein the augmented reality processing includes interacting with virtual objects in the AR samples, and the device for processing TV display content further includes: 同步模块,用于将所述增强现实处理的过程同步发送给所述电视机,以供在所述电视机上同步显示与所述AR样本中的虚拟对象所进行的互动,其中,所述互动至少包括与所述虚拟对象进行点击或触摸的接触互动、与所述虚拟对象进行语音或文字的交流互动。A synchronization module, configured to synchronously send the process of augmented reality processing to the television, so that the interaction with the virtual object in the AR sample can be synchronously displayed on the television, wherein the interaction is at least It includes click or touch contact interaction with the virtual object, voice or text communication interaction with the virtual object. 7.如权利要5或6所述的电视显示内容的处理装置,其特征在于,所述显示内容至少包括视频节目显示内容、电视屏幕上的非视频节目显示内容中的一种或多种,所述特征码的载体形式至少包括视频节目中的人物面部、人物肢体动作、节目场景以及电视屏幕上显示的二维码、三维码。7. The device for processing television display content as claimed in claim 5 or 6, wherein the display content at least includes one or more of video program display content and non-video program display content on the TV screen, The carrier form of the feature code includes at least the face of the character in the video program, the body movement of the character, the scene of the program, and the two-dimensional code and three-dimensional code displayed on the TV screen. 8.如权利要7所述的电视显示内容的处理装置,其特征在于,所述电视显示内容的处理装置还包括:8. The device for processing TV display content as claimed in claim 7, wherein the device for processing TV display content further comprises: 更新模块,用于当本地特征样本库中不存在与所述特征码相对应的AR样本时,向云端服务器发送特征样本库更新请求,并将云端服务器下发的最新的特征样本库更新到本地特征样本库中。An update module, configured to send a feature sample library update request to the cloud server when there is no AR sample corresponding to the feature code in the local feature sample library, and update the latest feature sample library issued by the cloud server to the local In the feature sample library. 9.一种电视显示内容的处理系统,包括电视机,其特征在于,所述电视显示内容的处理系统还包括权利要求5-8中任一项所述的电视显示内容的处理装置。9. A television display content processing system, comprising a television, characterized in that the television display content processing system further comprises the television display content processing apparatus according to any one of claims 5-8. 10.如权利要求9所述的电视显示内容的处理系统,其特征在于,所述电视显示内容的处理系统还包括:10. The processing system of television display content as claimed in claim 9, is characterized in that, the processing system of described television display content further comprises: 第一云端服务器,用于向所述电视机发送植入有新的特征码的电视信号,并将该新的特征码同步发送给第二云端服务器中的特征样本库;The first cloud server is used to send a TV signal embedded with a new feature code to the TV set, and send the new feature code synchronously to the feature sample library in the second cloud server; 第二云端服务器,用于接收所述第一云端服务器所发送的新的特征码,并建立该新的特征码与特征样本库中相应AR样本之间的对应关系;以及当接收到所述电视显示内容的处理装置所发送的特征样本库更新请求时,将最新的特征样本库下发给所述电视显示内容的处理装置。The second cloud server is used to receive the new feature code sent by the first cloud server, and establish the corresponding relationship between the new feature code and the corresponding AR sample in the feature sample library; and when receiving the TV When the feature sample library update request sent by the display content processing device sends the latest feature sample library to the television display content processing device.
CN201610668792.9A 2016-08-15 2016-08-15 TV the display processing method of content, Apparatus and system Pending CN106210909A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610668792.9A CN106210909A (en) 2016-08-15 2016-08-15 TV the display processing method of content, Apparatus and system
PCT/CN2016/112918 WO2018032693A1 (en) 2016-08-15 2016-12-29 Television display content processing method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610668792.9A CN106210909A (en) 2016-08-15 2016-08-15 TV the display processing method of content, Apparatus and system

Publications (1)

Publication Number Publication Date
CN106210909A true CN106210909A (en) 2016-12-07

Family

ID=57522414

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610668792.9A Pending CN106210909A (en) 2016-08-15 2016-08-15 TV the display processing method of content, Apparatus and system

Country Status (2)

Country Link
CN (1) CN106210909A (en)
WO (1) WO2018032693A1 (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106778927A (en) * 2016-12-30 2017-05-31 深圳Tcl新技术有限公司 Update TV semantics recognition dictionary method and device
CN106899870A (en) * 2017-02-23 2017-06-27 任刚 A kind of VR contents interactive system and method based on intelligent television and mobile terminal
WO2018032693A1 (en) * 2016-08-15 2018-02-22 深圳Tcl数字技术有限公司 Television display content processing method, device and system
CN108762482A (en) * 2018-04-16 2018-11-06 北京大学 Data interactive method and system between a kind of large screen and augmented reality glasses
CN108882044A (en) * 2018-07-09 2018-11-23 厦门风云科技股份有限公司 A kind of Digital Media enhancing display interaction method
CN109104632A (en) * 2018-09-27 2018-12-28 聚好看科技股份有限公司 A kind of realization method and system of television terminal AR scene
CN109831423A (en) * 2019-01-22 2019-05-31 阿依瓦(北京)技术有限公司 A kind of interaction systems and interactive approach based on augmented reality
CN109872800A (en) * 2019-03-13 2019-06-11 京东方科技集团股份有限公司 A dietary companion system and dietary companion method
CN110084078A (en) * 2018-12-31 2019-08-02 绍兴柯桥斯坦电子科技合伙企业(有限合伙) A kind of condition code identifying system and method for augmented reality
CN110446088A (en) * 2018-05-03 2019-11-12 尼尔森网联媒介数据服务有限公司 Media information recognition methods, exchange method and the equipment of TV
CN110620945A (en) * 2019-09-05 2019-12-27 佛山市云米电器科技有限公司 Intelligent 5G television storage system based on biological signals

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112887759A (en) * 2021-01-22 2021-06-01 Oppo广东移动通信有限公司 Signal processing method and device of smart television, smart television and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060038833A1 (en) * 2004-08-19 2006-02-23 Mallinson Dominic S Portable augmented reality device and method
KR20120076541A (en) * 2010-11-30 2012-07-09 안명호 Advertising method using augmented reality coder and system thereof
CN103929669A (en) * 2014-04-30 2014-07-16 成都理想境界科技有限公司 Interactive video generator, player, generating method and playing method
CN103929653A (en) * 2014-04-30 2014-07-16 成都理想境界科技有限公司 Enhanced real video generator and player, generating method of generator and playing method of player
CN103945274A (en) * 2013-04-19 2014-07-23 达腾科公司 Method and equipment for providing interactive augmented reality information corresponding to television programs
CN104661101A (en) * 2013-11-22 2015-05-27 胜华科技股份有限公司 System and method for providing augmented reality effect for multimedia data

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101096392B1 (en) * 2010-01-29 2011-12-22 주식회사 팬택 System and method for providing augmented reality
KR101314865B1 (en) * 2010-07-06 2013-10-04 김덕중 Method, additional service server and broadcasting system for providing augmented reality associated tv screen in mobile environment
KR101793738B1 (en) * 2010-12-23 2017-11-07 한국전자통신연구원 System and method of providing broadcast augmented reality advertisement service based on media ID junction
KR101763887B1 (en) * 2011-01-07 2017-08-02 삼성전자주식회사 Contents synchronization apparatus and method for providing synchronized interaction
CN106210909A (en) * 2016-08-15 2016-12-07 深圳Tcl数字技术有限公司 TV the display processing method of content, Apparatus and system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060038833A1 (en) * 2004-08-19 2006-02-23 Mallinson Dominic S Portable augmented reality device and method
KR20120076541A (en) * 2010-11-30 2012-07-09 안명호 Advertising method using augmented reality coder and system thereof
CN103945274A (en) * 2013-04-19 2014-07-23 达腾科公司 Method and equipment for providing interactive augmented reality information corresponding to television programs
CN104661101A (en) * 2013-11-22 2015-05-27 胜华科技股份有限公司 System and method for providing augmented reality effect for multimedia data
CN103929669A (en) * 2014-04-30 2014-07-16 成都理想境界科技有限公司 Interactive video generator, player, generating method and playing method
CN103929653A (en) * 2014-04-30 2014-07-16 成都理想境界科技有限公司 Enhanced real video generator and player, generating method of generator and playing method of player

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018032693A1 (en) * 2016-08-15 2018-02-22 深圳Tcl数字技术有限公司 Television display content processing method, device and system
CN106778927A (en) * 2016-12-30 2017-05-31 深圳Tcl新技术有限公司 Update TV semantics recognition dictionary method and device
CN106899870A (en) * 2017-02-23 2017-06-27 任刚 A kind of VR contents interactive system and method based on intelligent television and mobile terminal
CN108762482A (en) * 2018-04-16 2018-11-06 北京大学 Data interactive method and system between a kind of large screen and augmented reality glasses
CN110446088A (en) * 2018-05-03 2019-11-12 尼尔森网联媒介数据服务有限公司 Media information recognition methods, exchange method and the equipment of TV
CN108882044A (en) * 2018-07-09 2018-11-23 厦门风云科技股份有限公司 A kind of Digital Media enhancing display interaction method
CN109104632A (en) * 2018-09-27 2018-12-28 聚好看科技股份有限公司 A kind of realization method and system of television terminal AR scene
CN110084078A (en) * 2018-12-31 2019-08-02 绍兴柯桥斯坦电子科技合伙企业(有限合伙) A kind of condition code identifying system and method for augmented reality
CN109831423A (en) * 2019-01-22 2019-05-31 阿依瓦(北京)技术有限公司 A kind of interaction systems and interactive approach based on augmented reality
CN109872800A (en) * 2019-03-13 2019-06-11 京东方科技集团股份有限公司 A dietary companion system and dietary companion method
CN109872800B (en) * 2019-03-13 2021-05-14 京东方科技集团股份有限公司 A dietary companion system and dietary companion method
CN110620945A (en) * 2019-09-05 2019-12-27 佛山市云米电器科技有限公司 Intelligent 5G television storage system based on biological signals

Also Published As

Publication number Publication date
WO2018032693A1 (en) 2018-02-22

Similar Documents

Publication Publication Date Title
CN106210909A (en) TV the display processing method of content, Apparatus and system
CN111935491B (en) Live broadcast special effect processing method and device and server
CN106303555B (en) A live broadcast method, device and system based on mixed reality
CN106658200B (en) Method, device and terminal device for sharing and obtaining live video
CN102595228B (en) content synchronization apparatus and method
CN108632633B (en) Live webcast data processing method and device
US20220167036A1 (en) Live broadcast method and apparatus, and computer device and storage medium
CN104618739B (en) A method and system for displaying and playing video program information
CN108632632B (en) Live webcast data processing method and device
US11277658B1 (en) Integrating overlaid digital content into displayed data via graphics processing circuitry
CN110691281B (en) Video playing processing method, terminal device, server and storage medium
CN111800668B (en) Barrage processing method, barrage processing device, barrage processing equipment and storage medium
CN110930517A (en) A panoramic video interactive system and method
CN108635863B (en) Live webcast data processing method and device
CN114139491A (en) Data processing method, device and storage medium
CN106851395B (en) Video playing method and player
CN113573090A (en) Content display method, device and system in game live broadcast and storage medium
CN113661715A (en) Auditorium business management method, interactive method, display device and mobile terminal
CN103959805A (en) Method and device for displaying image
CN112288877B (en) Video playback method, device, electronic device and storage medium
CN112565892B (en) Method for identifying roles of video programs and related equipment
CN111770388A (en) Content processing method, device, equipment and storage medium
CN104618814A (en) Television interactive communication method, television terminal and television remote controller
CN114765692B (en) Live broadcast data processing method, device, equipment and medium
JP6219531B2 (en) Television program image frame capture device, television program image frame acquisition device, system and method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20161207