[go: up one dir, main page]

CN101779459B - Video distribution device and video distribution method - Google Patents

Video distribution device and video distribution method Download PDF

Info

Publication number
CN101779459B
CN101779459B CN2008801031870A CN200880103187A CN101779459B CN 101779459 B CN101779459 B CN 101779459B CN 2008801031870 A CN2008801031870 A CN 2008801031870A CN 200880103187 A CN200880103187 A CN 200880103187A CN 101779459 B CN101779459 B CN 101779459B
Authority
CN
China
Prior art keywords
video
data
distribution
text
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2008801031870A
Other languages
Chinese (zh)
Other versions
CN101779459A (en
Inventor
藤田昌巳
河合直树
中村章
斋藤磨悟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Japan Broadcasting Corp
Original Assignee
Nippon Hoso Kyokai NHK
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nippon Hoso Kyokai NHK filed Critical Nippon Hoso Kyokai NHK
Publication of CN101779459A publication Critical patent/CN101779459A/en
Application granted granted Critical
Publication of CN101779459B publication Critical patent/CN101779459B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/173Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309Transmission or handling of upstream communications
    • H04N7/17318Direct or substantially direct transmission and handling of requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4884Data services, e.g. news ticker for displaying subtitles

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

A video distribution apparatus that distributes video to a receiving apparatus by communication or broadcasting, comprising: a delivery member; associating a plurality of thumbnail data generated from the video data and a plurality of text data generated from subtitle data accompanying the video on a time axis to be previously distributed to the receiving apparatus; a request receiving section that receives a video distribution request including time information of text data selected from the text data displayed in the receiving apparatus from the receiving apparatus; a video distribution unit that, when the distribution request is received, specifies a distribution start position of the video data based on the time information, and distributes the video data to be distributed; and a processing unit configured to perform a predetermined process on the specified portion of the video data distributed by the video distribution unit.

Description

视频配送装置以及视频配送方法Video distribution device and video distribution method

技术领域 technical field

本发明涉及通过通信或广播配送图像的视频配送装置以及视频配送程序。  The present invention relates to a video distribution device and a video distribution program for distributing images by communication or broadcasting. the

本申请基于2007年8月14日在日本申请的专利申请2007-211441号、2007年8月14日在日本申请的专利申请2007-211442号、2007年8月14日在日本申请的专利申请2007-211459号主张优先权,将其内容援用于本说明书。  This application is based on the patent application No. 2007-211441 filed in Japan on August 14, 2007, the patent application No. 2007-211442 filed in Japan on August 14, 2007, and the patent application 2007 filed in Japan on August 14, 2007 - No. 211459 claims priority, and its content is cited in this specification. the

背景技术 Background technique

作为电视广播被广播的节目的数据中,包含视频数据和语音数据。此外,被广播的节目数据中,由于作为视频数据而被包含,因此有时包含在用户侧不能选择是否要显示的字幕(节目名或角色等的介绍,或者,海外作品中的日文字幕)。此外,被广播的节目数据中,有时包含在用户侧能够选择是否使其显示的字幕数据。这样的可选择的字幕数据一般被称为封闭字幕(ClosedCaption),主要开发用于听力障碍者,不仅像海外作品中的日语字幕那样包括出演者的对话,还包括例如BGM或效果音等的说明。  Data of programs broadcast as television broadcasts include video data and audio data. In addition, since the program data to be broadcast is included as video data, subtitles (introduction of program titles, characters, etc., or Japanese subtitles in overseas works) may be included which cannot be selected on the user side. In addition, subtitle data which can be selected on the user side to be displayed may be included in broadcast program data. Such optional subtitle data is generally called Closed Caption (Closed Caption), which is mainly developed for the hearing-impaired. It includes not only the dialogue of the actors like the Japanese subtitles in overseas works, but also includes explanations such as BGM and sound effects. . the

例如,在NTSC(美国国家电视标准委员会:National Television SystemCommittee)方式的模拟的地面波广播中,视频信号中使用525条的扫描线,该525条中,各个场(field)(由2个场构成1个帧)的最初的21条分配用于被称为VBI(Vertical Blanking Interval:垂直消隐期间)的用于开始扫描的间隔(interval)。封闭字幕是通过对各个场的VBI中的第21条上复用字符码而被传输的。然后,使用各个场将2种字符组每秒传输约60字符。  For example, in NTSC (National Television Standards Committee: National Television System Committee) analog terrestrial broadcasting, 525 scanning lines are used in video signals, and in the 525 lines, each field (field) (consisting of two fields) The first 21 entries of 1 frame) are allocated to an interval (interval) for starting scanning called VBI (Vertical Blanking Interval: Vertical Blanking Interval). Closed captions are transmitted by multiplexing character codes on entry 21 of the VBI for each field. Then, about 60 characters per second are transmitted for 2 kinds of character groups using each field. the

此外,关于数字电视广播的字幕信息的传输构成为,如国内规定即地面数字电视广播运用规定、技术资料(ARIB TR-B14)、BS/宽带CS数字广播运用规定、技术资料(ARIB TR-B15)中规定,使用字幕信息用的传输流,能够与视频信息的传输同时传输字幕信息。然后,在数字电视广播用接收机中,对与字幕信息对应的码进行解码,并生成构成字幕的字符、图形,从而将其 叠加在视频上进行显示。在数字电视广播中有如下的技术:将使用字幕信息用的传输流与视频信息的传输同时传输的文本信息保存在内部,通过电视监视器任意时刻都能够显示阅览在内部保存的文本信息,从而即使用户不取被显示的字幕的记录,也能够灵活应用字幕的信息。(例如,参照专利文献1)。  In addition, the transmission of subtitle information on digital TV broadcasting consists of, for example, domestic regulations, namely, terrestrial digital TV broadcasting operating regulations, technical documents (ARIB TR-B14), BS/broadband CS digital broadcasting operating regulations, technical documents (ARIB TR-B15 ) stipulates that subtitle information can be transmitted simultaneously with the transmission of video information by using a transport stream for subtitle information. Then, in a receiver for digital television broadcasting, codes corresponding to subtitle information are decoded to generate characters and graphics constituting subtitles, which are superimposed on the video and displayed. In digital television broadcasting, there is a technique of internally storing text information transmitted simultaneously with transmission of video information using a transport stream for subtitle information, and displaying and viewing the internally stored text information at any time on a TV monitor, thereby Even if the user does not take a record of the displayed subtitles, it is possible to utilize the information of the subtitles. (For example, refer to Patent Document 1). the

近年来,电视广播能够在便携电话或PDA(个人数字助理:PersonalDigital Assistant)等用户可携带的终端中进行阅览。此外,还可以将通过家庭内的录像装置录像的节目,记录在可便携的装置中安装的记录介质中,从该记录介质再现被记录的节目。这样,被广播的字幕数据开始用于各种服务中。此外,电视广播本身也被各种装置接收,还设置能够阅览该被接收的节目的结构。  In recent years, television broadcasts have been viewed on portable terminals such as mobile phones and PDAs (Personal Digital Assistants). In addition, it is also possible to record a program recorded by a recording device at home on a recording medium installed in a portable device, and to reproduce the recorded program from the recording medium. In this way, broadcast subtitle data comes to be used in various services. In addition, television broadcasting itself is also received by various devices, and a configuration is provided in which the received programs can be browsed. the

但是,虽然电视广播被各种装置接收,通过该电视广播被广播的节目,记录在规定的记录介质中,在可便携的装置中进行阅览等,但记录该节目的记录介质的容量有限。此外,若附加可安装(可内置)在可便携的装置的记录介质这一条件,则可利用的记录介质的容量进一步被限定。  However, although TV broadcasts are received by various devices, and programs broadcast by the TV broadcasts are recorded on predetermined recording media and viewed on portable devices, the capacity of the recording media on which the programs are recorded is limited. Furthermore, if a recording medium that can be mounted (built-in) in a portable device is added, the capacity of the recording medium that can be used is further limited. the

因此,若在可便携的装置中阅览节目,则只能阅览短时间的节目(只能阅览节目的一部分),若为了记录长时间的节目而提高压缩率,则存在视频粗糙且画质降低的问题。还存在因此而不普及的问题。因此,期待在可便携的装置中也能够阅览长时间的节目和多个节目,且能够防止画质降低而进行阅览的功能。  Therefore, if you browse programs on a portable device, you can only browse a short program (only a part of the program can be viewed), and if you increase the compression rate to record a long program, the video will be rough and the image quality will be reduced. question. There is also the problem of not being popular because of this. Therefore, there is a demand for a function that allows viewing of long-time programs and multiple programs, and prevents image quality from deteriorating, even on portable devices. the

为了解决这样的问题,公开了如下的信息处理装置中:在可便携的装置中,为了能够阅览长时间的节目,对由便携电话机指示的电视广播的节目进行录像,将该被录像的节目变换为通过时刻信息相关联的缩略图图像数据和文本数据而进行显示,从而能够掌握节目的内容(例如,参照专利文献2)。  In order to solve such a problem, the following information processing device is disclosed: In order to be able to browse a long-time program in a portable device, the program of the TV broadcast instructed by the mobile phone is recorded, and the recorded program is By converting and displaying thumbnail image data and text data associated with time information, the content of the program can be grasped (for example, refer to Patent Document 2). the

专利文献1:特开2003-078889号公报  Patent Document 1: JP-A-2003-078889 Gazette

专利文献2:特开2006-253960号公报  Patent Document 2: JP-A-2006-253960 Gazette

发明内容 Contents of the invention

发明要解决的课题  The problem to be solved by the invention

在以往的技术中,已知包括视频配送装置和接收装置的视频配送系统,该视频配送系统经由网络配送视频数据等视频内容,接收装置经由网络接收从视频配送装置配送的视频内容而进行显示。  Conventionally, there is known a video distribution system including a video distribution device that distributes video content such as video data via a network, and a receiving device that receives and displays the video content distributed from the video distribution device via the network. the

但是,在以往已知的视频配送装置中,关于对接收装置配送的视频内容整体的视听历史信息,虽然能够知道是否有很多用户对该内容整体持有兴趣,但不能正确地确定在内容整体中用户持有兴趣的部分。  However, in conventionally known video distribution devices, regarding the viewing history information of the entire video content distributed to the receiving device, although it can be known whether there are many users who are interested in the entire content, it cannot be accurately determined whether there are many users interested in the entire content. The section in which the user holds an interest. the

因此,存在不能进行以下处理的问题:从视频内容整体中确定很多用户持有兴趣的部分,并对该确定部分进行视听历史信息的收集、利用等规定的处理。  Therefore, there is a problem that it is not possible to identify a portion of the entire video content that many users are interested in, and to perform predetermined processing such as collection and use of viewing history information for the identified portion. the

本发明鉴于这样的问题而完成,其目的在于提供一种能够从视频内容整体中确定多个用户持有兴趣的部分,从而可对该确定部分进行视听历史信息的收集等规定的处理的视频配送系统和视频配送程序。  The present invention was made in view of such a problem, and an object of the present invention is to provide a video distribution capable of specifying a portion of interest to a plurality of users from the entire video content, and performing predetermined processing such as collection of viewing history information on the specified portion System and Video Distribution Program. the

用于解决课题的方法  method used to solve the problem

本发明是一种视频配送装置,通过通信或广播对接收装置配送视频,其特征在于,包括:缩略图配送部件;将根据所述视频的数据生成的多个缩略图数据、以及根据伴随所述视频的字幕数据生成的多个文本数据,在时间轴上进行关联,从而预先配送给所述接收装置;请求接收部件,从所述接收装置接收视频配送请求,所述视频配送请求包括从在所述接收装置中显示的文本数据中选择的文本数据的时间信息;视频配送部件,当接收了所述配送请求的情况下,根据所述时间信息,确定所述视频数据的配送开始位置,并进行应配送的视频数据的配送;以及处理部件,进行对于所述视频配送部件所配送的所述视频数据的确定部分的规定的处理。  The present invention is a video distribution device, which distributes video to a receiving device through communication or broadcasting, and is characterized in that it includes: a thumbnail image distribution part; a plurality of thumbnail image data generated based on the video data; A plurality of text data generated by the subtitle data of the video is correlated on the time axis, thereby being distributed to the receiving device in advance; the request receiving part receives a video distribution request from the receiving device, and the video distribution request includes The time information of the text data selected in the text data displayed in the receiving device; the video distribution part, when receiving the distribution request, determines the distribution start position of the video data according to the time information, and performs distribution of video data to be distributed; and processing means for performing predetermined processing on a specific portion of the video data distributed by the video distribution means. the

本发明的所述处理部件的特征在于,是历史信息收集部件,其收集对于所述视频配送部件所配送的所述视频数据的确定部分的视听历史信息。  The processing means of the present invention is characterized in that it is a history information collecting means that collects viewing history information for a specific portion of the video data distributed by the video distribution means. the

本发明的所述处理部件,是重点视频生成部件,其根据所述视频配送部件配送的所述视频数据的确定部分,生成所述视频数据的重点场景。  The processing unit of the present invention is a key video generating unit, which generates the key scene of the video data according to the determined part of the video data delivered by the video delivery unit. the

本发明的所述处理部件,是注释、评价信息存储部件,其对所述视频配送部件所配送的所述视频数据的确定部分,将在所述接收装置中被输入而发送的注释信息或评价信息相关联,从而进行存储。  The processing unit of the present invention is a comment and evaluation information storage unit, which transmits the comment information or comments inputted in the receiving device to the specified part of the video data distributed by the video distribution unit. Information is associated and thus stored. the

本发明是一种视频配送程序,其特征在于,使通过通信或广播对接收装置配送视频的视频配送装置的计算机执行:缩略图配送步骤,将根据所述视频的数据生成的多个缩略图数据、以及根据伴随所述视频的字幕数据生成的多个文本数据,在时间轴上进行关联,从而预先配送给所述接收装置;请求接收步骤,从所述接收装置接收视频配送请求,所述视频配送请求包括从在 所述接收装置中显示的文本数据中选择的文本数据的时间信息;视频配送步骤,当接收了所述配送请求的情况下,根据所述时间信息,确定所述视频数据的配送开始位置,并进行应配送的视频数据的配送;以及处理步骤,进行对于在所述视频配送步骤中配送的所述视频数据的确定部分的规定的处理。  The present invention is a video distribution program characterized by causing a computer of a video distribution device for distributing a video to a receiving device by communication or broadcasting to execute a thumbnail distribution step of distributing a plurality of thumbnail data generated based on the video data. , and a plurality of text data generated according to the subtitle data accompanying the video are associated on the time axis, thereby being distributed to the receiving device in advance; the request receiving step is to receive a video distribution request from the receiving device, and the video The distribution request includes time information of text data selected from text data displayed on the receiving device; the video distribution step, when the distribution request is received, determines the time information of the video data according to the time information a delivery start location, and delivery of the video data to be delivered; and a processing step of performing predetermined processing for a specified portion of the video data delivered in the video delivery step. the

本发明的所述处理步骤的特征在于,是历史信息收集步骤,其收集对于在所述视频配送步骤中配送的所述视频数据的确定部分的视听历史信息。  The processing step of the present invention is characterized in that it is a history information collecting step of collecting viewing history information on a specified portion of the video data distributed in the video distribution step. the

本发明的所述处理步骤的特征在于,所述处理步骤是重点(highlight)视频生成步骤,其根据在所述视频配送步骤中配送的所述视频数据的确定部分,生成所述视频数据的重点场景。  The processing step of the present invention is characterized in that the processing step is a highlight video generating step of generating a highlight of the video data based on a specified part of the video data distributed in the video distribution step. Scenes. the

本发明的所述处理步骤的特征在于,所述处理步骤是注释、评价信息存储步骤,其对在所述视频配送步骤中所配送的所述视频数据的确定部分,将在所述接收装置中被输入而发送的注释信息或评价信息相关联,从而进行存储。  The processing step of the present invention is characterized in that the processing step is a comment and evaluation information storage step, and the specified part of the video data distributed in the video distribution step is stored in the receiving device. The input and transmitted comment information or evaluation information is associated and stored. the

发明效果  Invention effect

根据本发明,可起到以下效果:从视频内容整体中确定多个用户持有兴趣的部分,对该确定部分能够进行,收集视听历史信息,或生成重点场景,或者将注释信息或评价信息相关联等规定的处理。  According to the present invention, the following effects can be achieved: from the entire video content, a part that a plurality of users are interested in can be determined, and the determined part can be analyzed, and the viewing history information can be collected, or key scenes can be generated, or annotation information or evaluation information can be correlated. processing as prescribed by the Federation. the

附图说明 Description of drawings

图1是表示本发明的一实施方式的结构的方框图。  FIG. 1 is a block diagram showing the configuration of an embodiment of the present invention. the

图2是表示图1所示的配送装置1和接收装置23的动作的流程图。  FIG. 2 is a flowchart showing the operations of the delivery device 1 and the receiving device 23 shown in FIG. 1 . the

图3是表示图1所示的配送装置1和接收装置23的动作的流程图。  FIG. 3 is a flowchart showing the operations of the delivery device 1 and the receiving device 23 shown in FIG. 1 . the

图4是表示图1所示的配送装置1和接收装置23的动作的流程图。  FIG. 4 is a flowchart showing the operations of the delivery device 1 and the receiving device 23 shown in FIG. 1 . the

图5是表示图1所示的配送装置1和接收装置23的动作的流程图。  FIG. 5 is a flowchart showing the operations of the delivery device 1 and the receiving device 23 shown in FIG. 1 . the

图6是表示图1所示的接收装置23的功能的说明图。  FIG. 6 is an explanatory diagram showing the functions of the receiving device 23 shown in FIG. 1 . the

标号说明  Label description

1...配送装置、2...控制单元、3...输入输出单元、4...存储单元、5...文本/缩略图配送单元、6...视频/声音/文本配送单元、8...通信单元、23...接收装置、24...控制单元、25...输入单元、26...显示装置、27...通信单元、28...存储单元、29...文本/缩略图显示单元、33...视频/声音/文本显示单元、30、34...数据缓冲器  1...distribution device, 2...control unit, 3...input and output unit, 4...storage unit, 5...text/thumbnail distribution unit, 6...video/sound/text distribution unit, 8...communication unit, 23...receiving device, 24...control unit, 25...input unit, 26...display device, 27...communication unit, 28...storage unit , 29...text/thumbnail display unit, 33...video/sound/text display unit, 30, 34...data buffer

具体实施方式 Detailed ways

以下,,参照附图说明本发明的一实施方式的视频配送系统。图1是表示该实施方式的结构的方框图。在该图中,标号1是用于配送视频、声音、文本等的配送装置。标号2是统一控制配送装置1的处理动作的控制单元。标号3是除了进行内容数据的输入之外,还进行各种数据的输入输出的输入输出单元。标号4是用于存储文本/缩略图配送、显示软件9、视频/声音/文本配送、显示软件10、内容数据11、12、13、配送、显示单元软件管理数据14、内容管理数据15、用户管理数据16、内容、用户附加数据17等的存储单元。标号5是用于配送文本、缩略图的文本/缩略图配送单元。标号6是用于进行视频、声音、文本的配送的视频/声音/文本配送单元。标号7是接收用户对内容赋予的注释、评价等数据,并配送概括的数据的内容、用户附加数据接收配送单元。标号8是进行信息的广播或信息通信的通信单元。  Hereinafter, a video distribution system according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing the configuration of this embodiment. In this figure, reference numeral 1 is a distributing device for distributing video, sound, text, and the like. Reference numeral 2 is a control unit that collectively controls the processing operations of the delivery device 1 . Reference numeral 3 is an input/output unit that performs input/output of various data in addition to input of content data. Reference numeral 4 is for storing text/thumbnail image distribution, display software 9, video/sound/text distribution, display software 10, content data 11, 12, 13, distribution, display unit software management data 14, content management data 15, user Storage unit for management data 16, content, user additional data 17, etc. Reference numeral 5 is a text/thumbnail distribution unit for distributing text and thumbnails. Reference numeral 6 is a video/audio/text distribution unit for distributing video, audio, and text. Reference numeral 7 is a content and user additional data receiving and delivering unit that receives data such as comments and evaluations given by users to the content, and distributes summarized data. Reference numeral 8 is a communication unit for broadcasting or communicating information. the

规定的处理单元50包括历史信息收集单元51、重点(high light)视频生成单元52、注释、评价信息存储单元53,对视频/声音/文本配送单元6经由通信单元8对接收装置23配送的视频数据的视频数据的确定部分,进行规定的处理。  The prescribed processing unit 50 includes a historical information collection unit 51, a highlight video generation unit 52, comments, and an evaluation information storage unit 53, and the video/sound/text distribution unit 6 distributes the video to the receiving device 23 via the communication unit 8. The determined portion of the video data of the data is subjected to predetermined processing. the

历史信息收集单元51收集对于视频/声音/文本配送单元6经由通信单元8对接收装置23配送的视频数据的确定部分的视听历史信息。  The history information collection unit 51 collects viewing history information for a specific portion of the video data distributed by the video/audio/text distribution unit 6 to the receiving device 23 via the communication unit 8 . the

重点视频生成单元52根据视频/声音/文本配送单元6经由通信单元8对接收装置23配送的视频数据的确定部分,生成视频数据的重点场景(scene)。  The highlight video generation unit 52 generates a highlight scene of the video data according to the determined part of the video data delivered by the video/sound/text delivery unit 6 to the receiving device 23 via the communication unit 8 . the

注释、评价信息存储单元53对视频/声音/文本配送单元6经由通信单元8对接收装置23配送的视频数据的确定部分,将在接收装置23中输入而被发送的注释信息和评价信息相关联并进行存储。  The annotation and evaluation information storage unit 53 correlates the comment information inputted and transmitted by the receiving device 23 with the evaluation information for the specified part of the video data distributed by the video/audio/text distribution unit 6 to the receiving device 23 via the communication unit 8 and store it. the

文本/缩略图配送、显示软件9是用于实现文本/缩略图的配送、显示处理的软件。视频/声音/文本配送、显示软件10是用于实现视频、声音、文本的配送、显示处理的软件。内容数据11是由视频、声音、文本、缩略图、以及其他的数据构成的内容数据,各数据从配送装置1经由通信单元被配送。内容数据11由:还包括时间上切换的静止图像的集合的视频数据(活动图像数据)18;时间上与视频联动的声音数据19;将电视广播的字幕变换为文本的数据等、时间上与视频或声音联动的文本数据20;缩小了视频的静止图像数 据即缩略图数据21;以及其他数据22,其大致区分为内容整体的名称、概要等的整体信息数据以及与内容的一部分场景说明、BGM、标题名等的单独信息数据,且时间上与视频或声音联动。  Text/thumbnail image distribution and display software 9 is software for realizing text/thumbnail image distribution and display processing. The video/audio/text distribution and display software 10 is software for realizing video, audio, and text distribution and display processing. The content data 11 is content data composed of video, audio, text, thumbnail images, and other data, and each data is distributed from the distribution device 1 via communication means. The content data 11 is composed of: video data (moving image data) 18 that also includes a collection of time-switched still images; audio data 19 that is linked to the video in time; Text data 20 linked to video or sound; thumbnail image data 21, which is still image data in which the video has been reduced; and other data 22, which are roughly divided into overall information data such as the name and summary of the entire content, and part of the scene description related to the content. , BGM, title name and other independent information data, and time-linked with video or sound. the

配送/显示单元软件管理数据14是用于管理文本/缩略图配送、显示单元软件以及视频/声音/文本配送、显示软件的数据。内容管理数据15是用于管理内容数据11~13的数据。用户管理数据16是用于管理用户信息的数据。内容、用户附加数据17是用户对内容附加的注释(comment)、评价等的数据。  Distribution/display unit software management data 14 is data for managing text/thumbnail distribution and display unit software and video/audio/text distribution and display software. The content management data 15 is data for managing the content data 11-13. The user management data 16 is data for managing user information. The content and user-added data 17 are data such as comments and evaluations added by the user to the content. the

标号23是用于接收并显示配送装置1所配送的视频、声音、文本等的接收装置,例如,由便携电话终端等构成。标号24是用于统一控制接收装置23的处理动作的控制单元。标号25是由拨号健和功能健等构成,进行与用户的人机联系(man machine interface)的输入单元。标号26是由对用户显示内容数据等的液晶的显示器等构成的显示装置。标号27是接收广播、在配送装置1之间进行信息通信的通信单元。标号28是用于存储文本/缩略图显示软件38、视频/声音/文本显示软件39、内容数据40、41、42等的存储单元。  Reference numeral 23 is a receiving device for receiving and displaying video, audio, text, etc. delivered by the delivery device 1, and is constituted by, for example, a mobile phone terminal or the like. Reference numeral 24 is a control unit for collectively controlling the processing operations of the receiving device 23 . Label 25 is composed of dial key and function key, etc., and carries out the input unit of man-machine contact (man machine interface) with the user. Reference numeral 26 is a display device constituted by a liquid crystal display or the like for displaying content data and the like to the user. Reference numeral 27 is a communication unit that receives broadcasts and communicates information between delivery devices 1 . Reference numeral 28 is a storage unit for storing text/thumbnail image display software 38, video/sound/text display software 39, content data 40, 41, 42, and the like. the

标号29是利用文本/缩略图显示软件38,经由数据缓冲器30从存储单元28读出内容数据中的文本数据和缩略图数据并显示在显示装置26中的文本/缩略图显示单元,是由文本显示单元31和缩略图显示单元32构成的。文本显示单元31将内容数据中的文本数据显示在显示装置26中。文本数据使用在存储单元28中存储的数据、或经由通信单元27取得的数据,以响应于输入单元25中的操作输入的形式,进行换行(line feed)、换页等显示控制。缩略图显示单元32显示内容数据中的缩略图数据和其他的数据。缩略图数据和其他数据使用存储单元28中存储的数据和经由通信单元27取得的数据。关于缩略图数据和其他数据中的单独信息数据,与文本数据联动地进行显示。  Reference numeral 29 is a text/thumbnail display unit that uses text/thumbnail display software 38 to read text data and thumbnail data in the content data from the storage unit 28 via the data buffer 30 and display them in the display device 26. The text display unit 31 and the thumbnail display unit 32 are constituted. The text display unit 31 displays text data in the content data on the display device 26 . For the text data, display control such as line feed and page change is performed in response to operation input in the input unit 25 using data stored in the storage unit 28 or data acquired via the communication unit 27 . The thumbnail image display unit 32 displays thumbnail image data and other data among the content data. Thumbnail image data and other data use data stored in the storage unit 28 and data acquired via the communication unit 27 . The individual information data among thumbnail image data and other data are displayed in conjunction with text data. the

标号33是利用视频/声音/文本显示软件39,经由数据缓冲器34从存储单元28读出内容数据中的视频数据、声音数据、文本数据等并将其显示在显示装置26中的视频/声音/文本显示单元,由视频显示单元、声音输出单元、文本显示单元构成。视频显示单元35显示内容数据中的视频数据。视频数据利用存储单元28中存储的数据或经由通信单元27取得的数据,以响应于输入单元25中的操作输入的形式,进行再现、停止、快进、倒退等显示控制。声音输出单元36显示内容数据中的声音数据。声音数据使用存储单元28中存储的数据和经由通信单元27取得的数据。声音数据与视频数据联动地进行 输出,或者以声音数据先行输出,视频追随的形式联动地进行显示。文本显示单元37显示内容数据中的文本数据和其他的数据。文本数据和其他的数据使用存储单元28中存储的数据或经由通信单元27取得的数据。关于文本数据和其他的数据中的单独信息数据,与视频数据、或声音数据联动地进行显示。  Reference numeral 33 is to use video/sound/text display software 39 to read video data, sound data, text data, etc. in the content data from the storage unit 28 via the data buffer 34 and display it on the video/sound in the display device 26. / The text display unit is composed of a video display unit, a sound output unit, and a text display unit. The video display unit 35 displays video data among the content data. Display control of video data such as playback, stop, fast forward, and rewind is performed in response to operation input in the input unit 25 using data stored in the storage unit 28 or data acquired via the communication unit 27 . The sound output unit 36 displays sound data in the content data. As audio data, data stored in the storage unit 28 and data obtained via the communication unit 27 are used. The audio data and the video data are outputted in conjunction with each other, or the audio data is output first and the video follows and displayed in an interlocking manner. The text display unit 37 displays text data and other data in the content data. As text data and other data, data stored in storage unit 28 or data obtained via communication unit 27 is used. Individual information data among text data and other data is displayed in conjunction with video data or audio data. the

文本/缩略图显示软件38是利用内容数据中的文本数据和缩略图数据,实现在显示装置26上显示的处理的软件。文本/缩略图显示软件38是从配送装置1经由通信单元27取得,并存储在存储单元28中。当根据来自用户的请求,通过文本/缩略图显示单元29视听内容数据的情况下,调出并使用该软件。文本/缩略图显示软件38通过版本升级被改变,最新的软件从配送装置1经由通信单元27依次取得。  The text/thumbnail image display software 38 is software that realizes processing of displaying on the display device 26 using text data and thumbnail image data in content data. The text/thumbnail display software 38 is acquired from the delivery device 1 via the communication unit 27 and stored in the storage unit 28 . This software is called up and used when viewing content data through the text/thumbnail display unit 29 in response to a request from the user. The text/thumbnail display software 38 is changed through version upgrade, and the latest software is sequentially acquired from the delivery device 1 via the communication unit 27 . the

视频/声音/文本显示软件39是利用内容数据中的视频数据、声音数据、文本数据等,实现在显示单元26中显示的处理的软件。视频/声音/文本显示软件39是从配送装置1经由通信单元27取得,并存储在存储单元28中。当根据用户的请求,通过视频/声音/文本显示单元33视听内容数据的情况下,调出并使用该软件。视频/声音/文本显示软件39通过版本升级被改变,最新的软件从配送装置1经由通信单元27依次取得。  The video/sound/text display software 39 is software that realizes processing of displaying in the display unit 26 using video data, sound data, text data, etc. among content data. The video/audio/text display software 39 is acquired from the delivery device 1 via the communication unit 27 and stored in the storage unit 28 . This software is called up and used when viewing content data through the video/audio/text display unit 33 at the user's request. The video/audio/text display software 39 is changed through version upgrade, and the latest software is sequentially acquired from the delivery device 1 via the communication unit 27 . the

文本/缩略图显示单元29通过文本和缩略图等表现视频内容的内容,文本和缩略图等在时间轴上同步,前后发送要显示的页,从而可容易阅览视频内容的内容。此外,将文本用于检索,从而可确定符合期望的关键字的视频内容中的地方。此外,视频/声音/文本显示单元33通过视频和声音以及文本等表现视频内容的内容,视频和声音以及文本等在时间轴上同步。文本/缩略图显示单元29和视频/声音/文本显示单元33的两个显示单元内的各个数据在时间轴上同步,且在指定的时间,可使两个显示单元同步地进行切换,可在文本/缩略图显示单元29中确认了前后的内容的基础上,准确地指定用户希望部分视听的地方,从而可从指定的地方开始视频、声音的再现。  The text/thumbnail image display unit 29 expresses the content of the video content with text and thumbnails, etc., and the text and thumbnails are synchronized on the time axis, and the pages to be displayed are sent forward and backward, so that the content of the video content can be easily viewed. In addition, the text is used for retrieval so that places in the video content matching desired keywords can be determined. In addition, the video/sound/text display unit 33 expresses the content of the video content through video, sound, text, etc., and the video, sound, text, etc. are synchronized on the time axis. The respective data in the two display units of the text/thumbnail display unit 29 and the video/sound/text display unit 33 are synchronized on the time axis, and at a specified time, the two display units can be switched synchronously, which can be The text/thumbnail display unit 29 confirms the content before and after, and accurately designates the place where the user wants to watch and listen to the part, so that the playback of video and audio can be started from the designated place. the

接着,参照图6,说明图1所示的接收装置23中的内容阅览功能。图6是表示图1所示的接收装置23中的内容阅览功能的图。接收装置23具有元数据(metadata)检索功能、阅读模式功能以及观看模式功能三个功能。  Next, referring to FIG. 6, the content browsing function in the receiving device 23 shown in FIG. 1 will be described. FIG. 6 is a diagram showing a content browsing function in the receiving device 23 shown in FIG. 1 . The receiving device 23 has three functions of a metadata search function, a reading mode function, and a viewing mode function. the

(1)元数据检索功能  (1) Metadata retrieval function

通过关键字的输入,能够精确地(pin point)到达节目内想观看的地方 的功能。元数据是利用字幕数据而生成的,并作为文本来提供。  Through the input of keywords, it is possible to precisely (pin point) the function of reaching the place you want to watch in the program. Metadata is generated using subtitle data and provided as text. the

例如,作为检索关键字输入“ていえん(庭院)”,则彻底检索全节目的元数据,能够检索到“日本的庭院”的节目内的场景。  For example, if "ていえん (garden)" is entered as a search keyword, the metadata of the entire program can be searched thoroughly, and scenes in the program "Garden in Japan" can be searched. the

(2)阅读模式功能  (2) Reading mode function

是通过将文本(字幕数据)和静止图像(缩略图)相关联显示,可迅速阅览信息的功能,能够进行滚动和换页。由于事先下载了文本和静止图像,因此即使在电波不能到达的地方也“何时何地都”可进行阅览。  It is a function for quickly viewing information by displaying text (caption data) and still images (thumbnails) in association, and scrolling and page switching are possible. Since the text and still images are downloaded in advance, it can be viewed "anytime, anywhere" even in places where radio waves cannot reach. the

(3)观看模式功能  (3) Watch mode function

是若在观看模式功能下点击文本部分,则可再现该时间点开始的活动图像的功能,具有快进/倒退/搜索功能。活动图像再现包括用于再现预先在接收装置23内存储的视频内容的功能、通过通信或广播由数据流进行再现的功能。由数据流进行再现的情况下,可长时间进行活动图像再现,且存储中断了视听的地方,可简单地再次开始视听。  It is a function that if you click a text part in the viewing mode function, the moving image starting at that point in time can be reproduced, and it has fast forward/rewind/search functions. Movie reproduction includes a function for reproducing video content previously stored in the receiving device 23, and a function for reproducing data streams through communication or broadcasting. In the case of playback by data stream, moving image playback can be performed for a long time, and the point where viewing was interrupted is stored, and viewing can be resumed easily. the

阅读模式和观看模式可联动地进行切换,能够将阅读模式用于检索想观看的活动图像。  The reading mode and viewing mode can be switched in conjunction, and the reading mode can be used to search for a moving image to be viewed. the

接着,参照图2,说明图1所示的配送装置1在接收装置23视听了的全部视频内容,正确地提取多用户持有兴趣的地方的动作。图2是表示图1所示的配送装置1正确地提取在接收装置23中视听了的全部视频内容中,多用户持有兴趣的地方的动作的流程图。首先,文本/缩略图配送单元5根据来自接收装置23的请求,经由通信单元8对接收装置23发送缩略图(缩小静止图像)和伴随各个缩略图的文本信息(字幕信息)(步骤S1)。接收其,接收装置23接收经由通信单元27从配送装置1发送的缩略图和文本的信息,并将其存储在存储单元28中,从而作为该缩略图和文本信息的内容数据40来持有(步骤S2)。在该时间点,视频(活动图像)数据43和声音数据44不被存储在存储单元28中,仅存储文本数据45和缩略图数据46。  Next, referring to FIG. 2 , the operation of correctly extracting points of interest to multiple users by the delivery device 1 shown in FIG. 1 from all the video contents viewed on the receiving device 23 will be described. FIG. 2 is a flowchart showing the operation of the delivery device 1 shown in FIG. 1 to accurately extract points of interest to multiple users from all video contents viewed on the receiving device 23 . First, the text/thumbnail distribution unit 5 transmits thumbnails (reduced still images) and text information (subtitle information) accompanying each thumbnail to the receiving device 23 via the communication unit 8 in response to a request from the receiving device 23 (step S1). Receiving it, the receiving device 23 receives the thumbnail image and text information transmitted from the delivery device 1 via the communication unit 27, and stores it in the storage unit 28, thereby being held as the content data 40 of the thumbnail image and text information ( Step S2). At this point of time, video (moving image) data 43 and sound data 44 are not stored in the storage unit 28, and only text data 45 and thumbnail image data 46 are stored. the

接着,若用户操作输入单元25,从而进行显示接收到的缩略图和文本的指示,则文本显示单元31读出在存储单元28中存储着的文本45,显示在显示装置26中,且缩略图显示单元32读出在存储单元28中存储着的缩略图数据46,显示在显示装置26中(步骤S3)。文本数据45和缩略图数据46都被赋予时间信息(从内容的开头部分开始的再现经过时间),并根据该时间信息,文本和缩略图被同步显示。由此执行图6所示的“阅读模式”。  Next, if the user operates the input unit 25 to instruct to display the received thumbnail and text, the text display unit 31 reads out the text 45 stored in the storage unit 28 and displays it on the display device 26, and the thumbnail The display unit 32 reads out the thumbnail image data 46 stored in the storage unit 28, and displays it on the display device 26 (step S3). Both text data 45 and thumbnail image data 46 are given time information (elapsed reproduction time from the beginning of the content), and based on this time information, text and thumbnail images are displayed synchronously. The "read mode" shown in FIG. 6 is thus executed. the

接着,若用户操作输入单元25,从而使文本/缩略图画面上下滚动,进行用于选择活动图像的想看的部分的文本的操作,则控制单元24对配送装置1发送包含伴随被选择的文本的时间信息的活动图像配送请求指令(S4)。若接收该活动图像配送请求指令(步骤S5),则视频/声音/文本配送单元5根据所接收到的活动图像配送请求指令中包含的时间信息,确定配送开始的位置,从该配送开始位置开始读出视频(活动图像)数据、声音数据、文本(字幕)数据,并经由通信单元8,流(streaming)配送由该视频数据、声音数据以及文本数据构成的活动图像数据(步骤S6)。  Next, when the user operates the input unit 25 to scroll the text/thumbnail screen up and down, and performs an operation for selecting a desired part of the moving image, the control unit 24 transmits to the delivery device 1 a text message containing the selected text. The video distribution request command of the time information (S4). If receiving this moving image distribution request instruction (step S5), then video/sound/text distribution unit 5 determines the position of distribution start according to the time information contained in the received moving image distribution request instruction, and starts from this distribution start position. Video (moving image) data, audio data, and text (subtitle) data are read out, and moving image data composed of the video data, audio data, and text data are streamed and delivered via the communication unit 8 (step S6). the

接收装置23经由通信单元27接收该被流配送的活动图像数据,并将接收到的活动图像数据存储在存储单元28中。由此,视频数据43、声音数据44、以及文本数据45被存储在存储单元28中,与此并行,视频/声音/文本显示单元33经由数据缓冲器34从存储单元28读出视频数据43、声音数据44、以及文本数据45,并将其显示在显示装置26上(步骤S7)。由此,从图6所示的阅读模式转移到观看模式,可阅览从在缩略图/文本画面中选择的部分开始的活动图像。  The receiving device 23 receives the streamed video data via the communication unit 27 , and stores the received video data in the storage unit 28 . Thus, video data 43, sound data 44, and text data 45 are stored in storage unit 28, and in parallel with this, video/sound/text display unit 33 reads video data 43, Voice data 44 and text data 45 are displayed on the display device 26 (step S7). Thereby, transition from the reading mode shown in FIG. 6 to the viewing mode allows viewing of moving images starting from the portion selected on the thumbnail/text screen. the

接着,若用户从输入单元25进行显示切换的操作,则控制单元24对配送装置1发送活动图像配送停止指令(步骤S8)。若接收该活动图像配送停止指令,则视频/声音/文本配送单元6停止活动图像数据的配送动作(步骤S9)。这里,视频/声音/文本配送单元6将配送历史信息作为存储单元4的内容管理数据15来存储(步骤S10),其中配送历史信息由流配送的活动图像的配送开始时间信息(用于确定活动图像的再现位置的从活动图像的开头开始的经过时间)和配送停止时间信息以及用于确定内容的识别信息构成。该配送历史信息被看做用户视听了的部分而成为视听历史信息。  Next, when the user performs a display switching operation through the input unit 25, the control unit 24 transmits a video distribution stop command to the distribution device 1 (step S8). Upon receiving the movie distribution stop command, the video/audio/text distribution unit 6 stops the distribution operation of the movie data (step S9). Here, the video/sound/text distribution unit 6 stores the distribution history information as the content management data 15 of the storage unit 4 (step S10), wherein the distribution history information consists of the distribution start time information of the moving image distributed by the stream (for determining the activity The playback position of the video is constituted by elapsed time from the beginning of the moving picture), delivery stop time information, and identification information for specifying the content. This delivery history information is regarded as the part watched by the user and becomes the viewing history information. the

然后。若终止视频的阅览动作,则接收装置23与配送装置1一同结束处理(步骤S11、S12)。另一方面,若继续阅览动作,则接收装置23返回步骤S3,将缩略图/文本显示在显示装置26中。此外,配送装置1返回步骤S5,等待接收活动图像配送请求指令。接着配送的活动图像配送历史信息被存储在存储单元4中,多个配送历史信息(视听历史信息)作为存储单元4的内容管理数据15被存储。  Then. When the browsing operation of the video is terminated, the receiving device 23 ends the processing together with the delivery device 1 (steps S11, S12). On the other hand, if the browsing operation is continued, the receiving device 23 returns to step S3 to display thumbnails/texts on the display device 26 . In addition, the distribution device 1 returns to step S5, and waits for the reception of a video distribution request command. The moving picture distribution history information that is distributed next is stored in the storage unit 4 , and a plurality of distribution history information (viewing history information) is stored as the content management data 15 of the storage unit 4 . the

由此,可联动切换阅读模式和观看模式,且由于将阅读模式用于想观看的活动图像的检索,将用于识别配送的活动图像的识别信息、活动图像的配 送开始位置和配送停止位置作为视听历史信息来存储,因此能够在被视听的全部视频内容中正确地提取多个用户持有兴趣的地方。  In this way, the reading mode and viewing mode can be switched in conjunction, and since the reading mode is used to retrieve the moving image you want to watch, the identification information for identifying the moving image to be delivered, the distribution start position and the delivery stop position of the moving image Since it is stored as viewing history information, points of interest to a plurality of users can be accurately extracted from all video contents viewed. the

在以往的技术中,当关于广播节目等较长的视频内容,视听预先存储的节目或进行基于流的VOD(Video On Demand)视听的情况下,可通过记录接入的历史,提取内容内的用户接入多的地方。  In the conventional technology, when watching a pre-stored program or stream-based VOD (Video On Demand) viewing of a long video content such as a broadcast program, it is possible to extract the information in the content by recording the access history. Where there are many users. the

但是,由于通常情况下接入集中在内容的开头地方,因此存在难以正确地提取内容内多用户持有兴趣的地方的问题。  However, there is a problem that it is difficult to accurately extract points of interest of many users within the content since access is usually concentrated at the beginning of the content. the

在本实施方式中,在全部视频内容中,可正确地提取多用户持有兴趣的地方。  In the present embodiment, it is possible to accurately extract places of interest to multiple users from all video contents. the

参照图3,说明在图1所示的接收装置23中被视听的全部视频内容中,正确地提取多用户持有兴趣的地方,从而发送给配送装置1的动作。图3是表示在接收装置23中被视听的全部视频内容中正确地提取多用户持有兴趣的地方而发送给配送装置1的动作的流程图。在图3中,与图2所示的动作相同的动作附加相同标号。  Referring to FIG. 3 , the operation of correctly extracting points of interest to multiple users from all video contents viewed on the receiving device 23 shown in FIG. 1 and transmitting them to the distribution device 1 will be described. FIG. 3 is a flowchart showing the operation of correctly extracting points of interest to multiple users from all the video contents viewed on the receiving device 23 and transmitting them to the distribution device 1 . In FIG. 3 , the same operations as those shown in FIG. 2 are given the same reference numerals. the

此外,文本/缩略图配送单元5根据来自接收装置23的请求,通过通信单元8对接收装置23发送缩略图(缩小静止图像)和伴随各个缩略图的文本信息(字幕信息)(步骤S1)。接收其,接收装置23接收经由通信单元27从配送装置1发送的缩略图和文本的信息,并存储在存储单元28,从而作为该缩略图和文本的信息内容数据40来持有(步骤S2)。在该时间点,视频(活动图像)数据43和声音数据44并不存储在存储单元28中,仅存储文本数据45和缩略图数据46。  In addition, the text/thumbnail image distribution unit 5 transmits thumbnails (reduced still images) and text information (subtitle information) accompanying each thumbnail to the receiving device 23 via the communication unit 8 in response to a request from the receiving device 23 (step S1). Receiving it, the receiving device 23 receives the thumbnail and text information sent from the delivery device 1 via the communication unit 27, and stores it in the storage unit 28, thereby holding it as the thumbnail and text content data 40 (step S2) . At this point in time, video (moving image) data 43 and sound data 44 are not stored in the storage unit 28, and only text data 45 and thumbnail image data 46 are stored. the

接着,若用户操作输入单元25,从而进行显示接收到的缩略图和文本的指示,则文本显示单元31读出在存储单元28中存储着的文本45,显示在显示装置26中,且缩略图显示单元32读出在存储单元28中存储着的缩略图数据46,显示在显示装置26中(步骤S3)。文本数据45和缩略图数据46都被赋予时间信息(从内容的开头部分开始的再现经过时间),并根据该时间信息,文本和缩略图被同步显示。由此执行图6所示的“阅读模式”。  Next, if the user operates the input unit 25 to instruct to display the received thumbnail and text, the text display unit 31 reads out the text 45 stored in the storage unit 28 and displays it on the display device 26, and the thumbnail The display unit 32 reads out the thumbnail image data 46 stored in the storage unit 28, and displays it on the display device 26 (step S3). Both text data 45 and thumbnail image data 46 are given time information (elapsed reproduction time from the beginning of the content), and based on this time information, text and thumbnail images are displayed synchronously. The "read mode" shown in FIG. 6 is thus executed. the

接着,若用户操作输入单元25,从而使文本/缩略图画面上下滚动,进行用于选择活动图像的想看的部分的文本的操作,则控制单元24对配送装置1发送包含伴随被选择的文本的时间信息的活动图像配送请求指令(S4)。若接收该活动图像配送请求指令(步骤S5),则视频/声音/文本配送单元5根据接 收到的活动图像配送请求指令中包含的时间信息,确定配送开始的位置,并从该配送开始位置开始读取视频(活动图像)数据、声音数据、文本(字幕)数据,从而经由通信单元8,流配送由该视频数据、声音数据、文本数据构成的活动图像数据(S6)。  Next, when the user operates the input unit 25 to scroll the text/thumbnail screen up and down, and performs an operation for selecting a desired part of the moving image, the control unit 24 transmits to the delivery device 1 a text message containing the selected text. The video distribution request command of the time information (S4). If receiving this moving image distribution request instruction (step S5), then video/sound/text distribution unit 5 determines the position of distribution start according to the time information contained in the received moving image distribution request instruction, and starts from this distribution start position Reading of video (moving image) data, audio data, and text (subtitle) data is started, and moving image data composed of the video data, audio data, and text data is streamed via the communication unit 8 (S6). the

接收装置23经由通信单元27接收该被流配送的活动图像数据,并将接收到的活动图像数据存储在存储单元28中。由此,视频数据43、声音数据44、以及文本数据45被存储在存储单元28中,与此并行,视频/声音/文本显示单元33经由数据缓冲器34从存储单元28读出视频数据43、声音数据44、以及文本数据45,并将其显示在显示装置26上(步骤S7)。由此,从图6所示的阅读模式转移到观看模式,可阅览从在缩略图/文本画面中选择的部分开始的活动图像。  The receiving device 23 receives the streamed video data via the communication unit 27 , and stores the received video data in the storage unit 28 . Thus, video data 43, sound data 44, and text data 45 are stored in storage unit 28, and in parallel with this, video/sound/text display unit 33 reads video data 43, Voice data 44 and text data 45 are displayed on the display device 26 (step S7). Thereby, transition from the reading mode shown in FIG. 6 to the viewing mode allows viewing of moving images starting from the portion selected on the thumbnail/text screen. the

接着,若用户从输入单元25进行显示切换的操作,则控制单元24对配送装置1发送活动图像配送停止指令(步骤S8)。若接收该活动图像配送停止指令,则视频/声音/文本配送单元6停止活动图像数据的配送动作(步骤S9)。这里,视频/声音/文本显示单元33将由被流配送活动图像的配送开始时间信息(用于确定活动图像的再现位置的从活动图像的开头开始的经过时间)和配送停止时间信息以及用于确定内容的识别信息构成的视听历史信息,暂时存储在存储单元29中(步骤S21)。  Next, when the user performs a display switching operation through the input unit 25, the control unit 24 transmits a video distribution stop command to the distribution device 1 (step S8). Upon receiving the movie distribution stop command, the video/audio/text distribution unit 6 stops the distribution operation of the movie data (step S9). Here, the video/sound/text display unit 33 uses the distribution start time information (the elapsed time from the beginning of the moving picture for specifying the reproduction position of the moving picture) and the delivery stop time information of the moving picture to be streamed together with the information for determining the reproduction position of the moving picture. Viewing history information composed of content identification information is temporarily stored in the storage unit 29 (step S21). the

然后,判定是否结束阅览动作(步骤S22、S23),若继续阅览动作,则接收装置23返回步骤S3,将缩略图/文本显示在显示装置26中。由此,从图6所示的观看模式转移到阅读模式,此外,配送装置1返回步骤S5,等待接收活动图像配送请求指令。重复该动作,将接着被配送的视听配送历史信息暂时存储在存储单元28中,从而多个视听历史信息被暂时存储在存储单元28中。  Then, it is judged whether to end the browsing operation (steps S22, S23), and if the browsing operation is continued, the receiving device 23 returns to step S3 to display the thumbnail/text on the display device 26. As a result, the viewing mode shown in FIG. 6 is shifted to the reading mode, and the distribution device 1 returns to step S5, and waits for a video distribution request command to be received. This operation is repeated, and the viewing history distribution information to be delivered next is temporarily stored in the storage unit 28 , whereby a plurality of viewing history information items are temporarily stored in the storage unit 28 . the

另一方面,若结束视频的阅览动作,则接收装置23的控制单元24将暂时存储在存储单元28中的视听历史信息,经由通信单元27发送给配送装置1(步骤S24)。接收其,配送装置1的控制单元2经由通信单元8接收接收装置23发送的视听历史信息,并将接收到的视听历史信息作为存储单元4的内容管理数据15来存储(步骤S25)。然后,接收装置23、配送装置1都结束处理。  On the other hand, when the browsing operation of the video is completed, the control unit 24 of the receiving device 23 transmits the viewing history information temporarily stored in the storage unit 28 to the delivery device 1 via the communication unit 27 (step S24). Receiving this, the control unit 2 of the distribution device 1 receives the viewing history information sent by the receiving device 23 via the communication unit 8, and stores the received viewing history information as the content management data 15 of the storage unit 4 (step S25). Then, both the receiving device 23 and the delivery device 1 end the processing. the

另外,在图3所示的动作中,表示了流配送活动图像的例子,但在步骤 S1中,从配送装置1对接收装置23发送缩略图和文本的情况下,也可以一并将活动图像的全部配送给接收装置23,伴随缩略图的文本被选择的情况下,根据被选择的文本的时间信息,确定活动图像的再现开始位置,将预先接收的活动图像从该再现开始位置开始再现。此时,在每次进行图3所示的显示操作切换操作(步骤S8)时,在视听历史信息被存储在接收装置23中,结束视频的视听的情况下,也只要将在接收装置23内部预先存储的视听历史信息发送给配送装置1(步骤S24)即可。  In addition, in the operation shown in FIG. 3 , an example of stream distribution of moving images was shown, but in step S1, when the distribution device 1 transmits thumbnails and text to the receiving device 23, the moving images may also be streamed together. If the text accompanying the thumbnail is selected, the reproduction start position of the moving image is determined based on the time information of the selected text, and the reproduction of the previously received moving image is started from the reproduction start position. At this time, when the display operation switching operation (step S8) shown in FIG. What is necessary is just to transmit the viewing history information stored in advance to the delivery device 1 (step S24). the

由此,可联动切换阅读模式和观看模式,且由于将阅读模式用于想观看的活动图像的检索,将用于识别配送的活动图像的识别信息、活动图像的配送开始位置和配送停止位置作为视听历史信息来存储,因此能够在被视听的全部视频内容中正确地提取多个用户持有兴趣的地方。  In this way, the reading mode and viewing mode can be switched in conjunction, and since the reading mode is used to search for moving images that you want to watch, the identification information for identifying the moving images to be distributed, the distribution start position and the distribution stop position of the moving images are used as Since the viewing history information is stored, it is possible to accurately extract points of interest of multiple users from all the video contents being viewed. the

如上所述,通过正确地提取多用户持有兴趣的地方,可进行以下的新视听方式。  As described above, by accurately extracting points of interest of multiple users, the following new viewing methods can be performed. the

(1)接入排名上位部分的视听  (1)Audio-visual access to the top part of the ranking

在视频内容中,集计基于多用户的视频视听多的地方,并以消息等形式提供,从而利用接收装置23的文本/缩略图显示单元29、或者视频/声音/文本显示单元33,用户可直接接入该地方。  In the video content, based on the multi-user video viewing and listening, it is provided in the form of a message, so that the user can use the text/thumbnail display unit 29 or the video/sound/text display unit 33 of the receiving device 23. directly into the place. the

(2)接入排名上位部分的内容的丰富(rich)化  (2) Enrichment of content that accesses high-ranking parts

在视频内容中,集计基于多用户的视频视听多的地方,并对接入排名上位部分追加记录关联的伴随信息,从而使内容部分丰富化,并附加用于引导至关联CM或关联电子商务的链接信息,能够实现高度的内容利用。  In the video content, the place where the video is watched by multiple users is collected, and the associated accompanying information is added to the high-ranking part of the access ranking to enrich the content part, and additionally guide to the related CM or related e-commerce The link information can achieve a high degree of content utilization. the

(3)接入排名上位部分的连续视听  (3) Access to the continuous viewing of the top part of the ranking

在视频内容中,集计基于多用户的视频视听多的地方,可仅连续视听接入排名上位部分。此外,用户的接入数据可作为用于自动地提供视频内容的重点场景的数据来使用。  Among the video contents, where there are many video viewings based on the aggregate number of users, only the high-ranked parts can be continuously viewed and viewed. In addition, user's access data may be used as data for automatically providing highlight scenes of video content. the

在以往的技术中,当关于广播节目等较长的视频内容,视听预先存储的节目或进行基于流的VOD(Video On Demand)视听的情况下,可进行对全部内容附加注释,或进行评价,或对朋友推荐等动作。  In the conventional technology, when watching a pre-stored program or stream-based VOD (Video On Demand) viewing of a long video content such as a broadcast program, it is possible to add comments or evaluate the entire content, Or actions such as recommending to friends. the

但是,对于视频内容的确定的场景、确定的部分附加注释、或进行评价、或者对朋友推荐等动作,需要例如“从节目开始经过了10分钟后的部分开始30秒间”等用于表现时间的部件,存在其他用户对该处的接入并不容易,此 外,多个用户的数据集计也困难的问题。  However, for actions such as adding annotations to certain scenes or certain parts of the video content, making comments, or recommending to friends, it is necessary to express time such as "30 seconds from the beginning of the part that has passed 10 minutes from the start of the program". However, it is not easy for other users to access the part. In addition, it is also difficult to collect data from multiple users. the

在本实施方式中,对内容内的确定部分可容易地附加注释、评价、对朋友推荐等,其他用户可容易接入这些确定部分。  In this embodiment, comments, comments, recommendations to friends, etc. can be easily added to specific parts in the content, and other users can easily access these specific parts. the

参照图4,说明在图1所示的接收中23中被视听了的全部视频内容中,可容易对确定部分附加注释、附加评价的动作。图4表示在图1所示的接收装置23中被视听了的全部视频内容中,可容易对确定部分附加注释、附加评价的动作的流程图。在图4中,与图2、图3所示的动作相同的动作附加相同的标号。  Referring to FIG. 4 , an operation for easily adding annotations and adding evaluations to specified parts among all the video contents viewed in the receiving process 23 shown in FIG. 1 will be described. FIG. 4 is a flowchart showing an operation for easily adding annotations and ratings to specific portions of all video contents viewed on the receiving device 23 shown in FIG. 1 . In FIG. 4 , the same operations as those shown in FIGS. 2 and 3 are given the same reference numerals. the

此外,文本/缩略图配送单元5根据来自接收装置23的请求,通过通信单元8对接收装置23发送缩略图(缩小静止图像)和伴随各个缩略图的文本信息(字幕信息)(步骤S1)。接收其,接收装置23接收经由通信单元27从配送装置1发送的缩略图和文本的信息,并存储在存储单元28,从而作为该缩略图和文本的信息内容数据40来持有(步骤S2)。在该时间点,视频(活动图像)数据43和声音数据44并不存储在存储单元28中,仅存储文本数据45和缩略图数据46。  In addition, the text/thumbnail image distribution unit 5 transmits thumbnails (reduced still images) and text information (subtitle information) accompanying each thumbnail to the receiving device 23 via the communication unit 8 in response to a request from the receiving device 23 (step S1). Receiving it, the receiving device 23 receives the thumbnail and text information sent from the delivery device 1 via the communication unit 27, and stores it in the storage unit 28, thereby holding it as the thumbnail and text content data 40 (step S2) . At this point in time, video (moving image) data 43 and sound data 44 are not stored in the storage unit 28, and only text data 45 and thumbnail image data 46 are stored. the

接着,若用户操作输入单元25,从而进行显示接收到的缩略图和文本的指示,则文本显示单元31读出在存储单元28中存储着的文本45,显示在显示装置26中,且缩略图显示单元32读出在存储单元28中存储着的缩略图数据46,显示在显示装置26中(步骤S3)。文本数据45和缩略图数据46都被赋予时间信息(从内容的开头部分开始的再现经过时间),并根据该时间信息,文本和缩略图被同步显示。由此执行图6所示的“阅读模式”。  Next, if the user operates the input unit 25 to instruct to display the received thumbnail and text, the text display unit 31 reads out the text 45 stored in the storage unit 28 and displays it on the display device 26, and the thumbnail The display unit 32 reads out the thumbnail image data 46 stored in the storage unit 28, and displays it on the display device 26 (step S3). Both text data 45 and thumbnail image data 46 are given time information (elapsed reproduction time from the beginning of the content), and based on this time information, text and thumbnail images are displayed synchronously. The "read mode" shown in FIG. 6 is thus executed. the

接着,若用户操作输入单元25,从而使文本/缩略图画面上下滚动,进行用于选择活动图像的想看的部分的文本的操作,则控制单元24对配送装置1发送包含伴随被选择的文本的时间信息的活动图像配送请求指令(步骤S4)。若接收该活动图像配送请求指令(步骤S5),则视频/声音/文本配送单元5根据接收到的活动图像配送请求指令中包含的时间信息,确定配送开始的位置,并从该配送开始位置开始读取视频(活动图像)数据、声音数据、文本(字幕)数据,从而经由通信单元8,流配送由该视频数据、声音数据、文本数据构成的活动图像数据(步骤S6)。  Next, when the user operates the input unit 25 to scroll the text/thumbnail screen up and down, and performs an operation for selecting a desired part of the moving image, the control unit 24 transmits to the delivery device 1 a text message containing the selected text. The video distribution request command of the time information (step S4). If receiving this moving image distribution request instruction (step S5), then video/sound/text distribution unit 5 determines the position of distribution start according to the time information contained in the received moving image distribution request instruction, and starts from this distribution start position Video (moving image) data, audio data, and text (subtitle) data are read, and moving image data composed of the video data, audio data, and text data are streamed via the communication unit 8 (step S6). the

接收装置23经由通信单元27接收该被流配送的活动图像数据,并将接收到的活动图像数据存储在存储单元28中。由此,视频数据43、声音数据 44、以及文本数据45被存储在存储单元28中,与此并行,视频/声音/文本显示单元33经由数据缓冲器34从存储单元28读出视频数据43、声音数据44、以及文本数据45,并将其显示在显示装置26上(步骤S7)。由此,从图6所示的阅读模式转移到观看模式,可阅览从在缩略图/文本画面中选择的部分开始的活动图像。  The receiving device 23 receives the streamed video data via the communication unit 27 , and stores the received video data in the storage unit 28 . Thus, the video data 43, the sound data 44, and the text data 45 are stored in the storage unit 28, and in parallel with this, the video/sound/text display unit 33 reads out the video data 43, the text data 45 from the storage unit 28 via the data buffer 34. Voice data 44 and text data 45 are displayed on the display device 26 (step S7). Thereby, transition from the reading mode shown in FIG. 6 to the viewing mode allows viewing of moving images starting from the portion selected on the thumbnail/text screen. the

接着,若用户从输入单元25进行显示切换的操作,则控制单元24对配送装置1发送活动图像配送停止指令(步骤S8)。若接收该活动图像配送停止指令,则视频/声音/文本配送单元6停止活动图像数据的配送动作(步骤S9)。这里,对于视听的活动图像的注释或评价的信息是从输入单元25输入的。视频/声音/文本显示单元33将被流配送的活动图像的配送开始时间信息(用于确定活动图像的再现位置的从活动图像的开头开始的经过时间)和配送停止时间信息、用于确定内容的识别信息、以及注释信息、评价信息暂时存储在存储单元29中(步骤S31)。注释信息、评价信息由从输入单元25输入的注释或评价的信息构成。  Next, when the user performs a display switching operation through the input unit 25, the control unit 24 transmits a video distribution stop command to the distribution device 1 (step S8). Upon receiving the movie distribution stop command, the video/audio/text distribution unit 6 stops the distribution operation of the movie data (step S9). Here, commentary or evaluation information on the viewed moving image is input from the input unit 25 . The video/audio/text display unit 33 uses the distribution start time information (the elapsed time from the beginning of the moving picture for specifying the playback position of the moving picture) and the distribution stop time information of the streaming moving picture to determine the contents. The identification information, comment information, and evaluation information are temporarily stored in the storage unit 29 (step S31). Comment information and evaluation information are composed of comments or evaluation information input from the input unit 25 . the

然后,判定是否继续阅览动作(步骤S32、S33),若是继续阅览动作,则接收装置23返回步骤S3,将缩略图/文本显示在显示装置26中。由此,从图6所示的观看模式转移到阅读模式。此外,配送装置1返回步骤S5,等待接收活动图像配送请求指令。重复该动作,将对于接收配送的活动图像的注释信息、评价信息暂时存储在存储单元28中,从而多个注释信息、评价信息被暂时存储在存储单元28中。  Then, it is judged whether to continue the browsing operation (steps S32, S33). If the browsing operation is to be continued, the receiving device 23 returns to step S3 to display the thumbnail/text on the display device 26. As a result, the viewing mode shown in FIG. 6 is shifted to the reading mode. In addition, the distribution device 1 returns to step S5, and waits for the reception of a video distribution request command. This operation is repeated to temporarily store annotation information and evaluation information on moving images received and distributed in storage unit 28 , whereby a plurality of annotation information and evaluation information are temporarily stored in storage unit 28 . the

另一方面,若结束视频的阅览动作,则接收装置23的控制单元24将暂时存储在存储单元28中的注释信息、评价信息,经由通信单元27发送给配送装置1(步骤S34)。接收其,配送装置1的控制单元2经由通信单元8接收接收装置23发送的注释信息、评价信息,并将接收到的注释信息、评价信息作为存储单元4的内容、用户附加数据17来存储(步骤S35)。然后,接收装置23和配送装置1都结束处理。  On the other hand, when the browsing operation of the video ends, the control unit 24 of the receiving device 23 transmits the annotation information and evaluation information temporarily stored in the storage unit 28 to the delivery device 1 via the communication unit 27 (step S34). Receiving it, the control unit 2 of the distribution device 1 receives the comment information and evaluation information sent by the receiving device 23 via the communication unit 8, and stores the received comment information and evaluation information as the content of the storage unit 4 and the user additional data 17 ( Step S35). Then, both the receiving device 23 and the delivery device 1 end the processing. the

另外,在图4所示的动作中,表示了流配送活动图像的例子,但在步骤S1中,从配送装置1对接收装置23发送缩略图和文本的情况下,也可以一并将活动图像的全部配送给接收装置23,伴随缩略图的文本被选择的情况下,根据被选择的文本的时间信息,确定活动图像的再现开始位置,将预先接收的活动图像从该再现开始位置开始再现。此时,在每次进行图4所示的显示 操作切换操作(步骤S8)时,在注释或评价的信息被存储在接收装置23中,结束视频的视听的情况下,也将存储在接收装置23内部的注释或评价的信息发送给配送装置1(步骤S34)即可。  In addition, in the operation shown in FIG. 4 , an example of streaming moving images was shown, but in step S1, when the distribution device 1 transmits thumbnails and text to the receiving device 23, the moving images may also be streamed together. If the text accompanying the thumbnail is selected, the reproduction start position of the moving image is determined based on the time information of the selected text, and the reproduction of the previously received moving image is started from the reproduction start position. At this time, when the display operation switching operation (step S8) shown in FIG. What is necessary is just to send the comment or evaluation information inside 23 to the delivery device 1 (step S34). the

由此,可联动切换阅读模式和观看模式,且由于将阅读模式用于想观看的活动图像的检索,将用于识别配送的活动图像的识别信息、活动图像的配送开始位置和配送停止位置、以及注释信息、评价信息作为内容、用户附加数据来存储,因此能够在被视听的全部视频内容中,进行确定部分的注释附加或评价附加。此外,可将对视频内容中的确定部分附加的注释提供给其他用户。此外,对视频内容中的确定部分附加的评价与其他用户的评价进行集计,从而能以总结的形式对其他用户提供信息。  In this way, the reading mode and viewing mode can be switched in conjunction, and since the reading mode is used to search for moving images that you want to watch, the identification information for identifying the moving image to be delivered, the delivery start position and delivery stop position of the moving image, And annotation information and evaluation information are stored as content and user added data, so it is possible to add annotations or evaluations to specific parts of all video contents to be viewed. Additionally, annotations attached to certain portions of the video content may be provided to other users. In addition, the evaluations attached to certain parts of the video content are aggregated with the evaluations of other users, so that information can be provided to other users in a summary form. the

接着,参照图5,说明从在图1所示的接收装置23中被视听的全部视频内容中将确定部分推荐给朋友的动作。图5是表示从在图1所示的接收装置23中被视听的全部视频内容中将确定部分推荐给朋友的动作的流程图。在图5中,对于与图2~图4所示的动作相同的动作附加相同标号。  Next, referring to FIG. 5 , an operation of recommending a specific portion to a friend from among all video contents viewed on the receiving device 23 shown in FIG. 1 will be described. FIG. 5 is a flowchart showing an operation of recommending a specific portion to a friend from among all video contents viewed on the receiving device 23 shown in FIG. 1 . In FIG. 5 , the same operations as those shown in FIGS. 2 to 4 are given the same reference numerals. the

此外,文本/缩略图配送单元5根据来自接收装置23的请求,通过通信单元8对接收装置23发送缩略图(缩小静止图像)和伴随各个缩略图的文本信息(字幕信息)(步骤S1)。接收其,接收装置23接收经由通信单元27从配送装置1发送的缩略图和文本的信息,并存储在存储单元28,从而作为该缩略图和文本的信息内容数据40来持有(步骤S2)。在该时间点,视频(活动图像)数据43和声音数据44并不存储在存储单元28中,仅存储文本数据45和缩略图数据46。  In addition, the text/thumbnail image distribution unit 5 transmits thumbnails (reduced still images) and text information (subtitle information) accompanying each thumbnail to the receiving device 23 via the communication unit 8 in response to a request from the receiving device 23 (step S1). Receiving it, the receiving device 23 receives the thumbnail and text information sent from the delivery device 1 via the communication unit 27, and stores it in the storage unit 28, thereby holding it as the thumbnail and text content data 40 (step S2) . At this point in time, video (moving image) data 43 and sound data 44 are not stored in the storage unit 28, and only text data 45 and thumbnail image data 46 are stored. the

接着,若用户操作输入单元25,从而进行显示接收到的缩略图和文本的指示,则文本显示单元31读出在存储单元28中存储着的文本45,显示在显示装置26中,且缩略图显示单元32读出在存储单元28中存储着的缩略图数据46,显示在显示装置26中(步骤S3)。文本数据45和缩略图数据46都被赋予时间信息(从内容的开头部分开始的再现经过时间),并根据该时间信息,文本和缩略图被同步显示。由此执行图6所示的“阅读模式”。  Next, if the user operates the input unit 25 to instruct to display the received thumbnail and text, the text display unit 31 reads out the text 45 stored in the storage unit 28 and displays it on the display device 26, and the thumbnail The display unit 32 reads out the thumbnail image data 46 stored in the storage unit 28, and displays it on the display device 26 (step S3). Both text data 45 and thumbnail image data 46 are given time information (elapsed reproduction time from the beginning of the content), and based on this time information, text and thumbnail images are displayed synchronously. The "read mode" shown in FIG. 6 is thus executed. the

接着,若用户操作输入单元25,从而使文本/缩略图画面上下滚动,进行用于选择活动图像的想看的部分的文本的操作,则控制单元24对配送装置1发送包含伴随被选择的文本的时间信息的活动图像配送请求指令(步骤S4)。若接收该活动图像配送请求指令(步骤S5),则视频/声音/文本配送单元5根 据接收到的活动图像配送请求指令中包含的时间信息,确定配送开始的位置,并从该配送开始位置开始读取视频(活动图像)数据、声音数据、文本(字幕)数据,从而经由通信单元8,流配送由该视频数据、声音数据、文本数据构成的活动图像数据步骤(步骤S6)。  Next, when the user operates the input unit 25 to scroll the text/thumbnail screen up and down, and performs an operation for selecting a desired part of the moving image, the control unit 24 transmits to the delivery device 1 a text message containing the selected text. The video distribution request command of the time information (step S4). If receiving this moving image distribution request instruction (step S5), then video/sound/text distribution unit 5 determines the position of distribution start according to the time information contained in the received moving image distribution request instruction, and starts from this distribution start position Start reading video (moving image) data, audio data, and text (subtitle) data, and stream the moving image data composed of the video data, audio data, and text data via the communication unit 8 (step S6). the

接收装置23经由通信单元27接收该被流配送的活动图像数据,并将接收到的活动图像数据存储在存储单元28中。由此,视频数据43、声音数据44、以及文本数据45被存储在存储单元28中,与此并行,视频/声音/文本显示单元33经由数据缓冲器34从存储单元28读出视频数据43、声音数据44、以及文本数据45,并将其显示在显示装置26上(步骤S7)。由此,从图6所示的阅读模式转移到观看模式,可阅览从在缩略图/文本画面中选择的部分开始的活动图像。  The receiving device 23 receives the streamed video data via the communication unit 27 , and stores the received video data in the storage unit 28 . Thus, video data 43, sound data 44, and text data 45 are stored in storage unit 28, and in parallel with this, video/sound/text display unit 33 reads video data 43, Voice data 44 and text data 45 are displayed on the display device 26 (step S7). Thereby, transition from the reading mode shown in FIG. 6 to the viewing mode allows viewing of moving images starting from the portion selected on the thumbnail/text screen. the

接着,若用户从输入单元25进行显示切换的操作,则控制单元24对配送装置1发送活动图像配送停止指令(步骤S8)。若接收该活动图像配送停止指令,则视频/声音/文本配送单元6停止活动图像数据的配送动作(步骤S9)。这里,若用户从输入单元25进行用于指示将视听了的活动图像推荐给朋友的操作,则视频/声音/文本显示单元33将流配送的活动图像的配送开始时间信息(用于确定活动图像的再现位置的从活动图像的开头开始的经过时间)和配送停止时间信息、以及用于确定内容的识别信息转给控制单元24。接收其,控制单元24将由从视频/声音/文本显示单元33转来的活动图像的配送开始时间信息和配送停止时间信息、以及用于确定内容的识别信息构成的内容推荐信息发送给朋友的接收终端(其他接收终端)(步骤S41)。该信息发送使用电子邮件等的信息通信部件。  Next, when the user performs a display switching operation through the input unit 25, the control unit 24 transmits a video distribution stop command to the distribution device 1 (step S8). Upon receiving the movie distribution stop command, the video/audio/text distribution unit 6 stops the distribution operation of the movie data (step S9). Here, when the user performs an operation from the input unit 25 for instructing to recommend the movie watched to a friend, the video/audio/text display unit 33 displays the distribution start time information (for specifying the movie) of the movie to be streamed. The elapsed time from the beginning of the reproduction position of the moving picture), delivery stop time information, and identification information for specifying the content are transferred to the control unit 24. Receiving it, the control unit 24 transmits the content recommendation information composed of the distribution start time information and the distribution stop time information of the moving image transferred from the video/sound/text display unit 33, and the identification information for specifying the content to the recipient of the friend. terminal (other receiving terminal) (step S41). This information is transmitted using information communication means such as e-mail. the

然后,判定是否继续阅览动作(步骤S42、S43),若继续阅览动作,则接收装置23返回步骤S3,将缩略图/文本显示在显示装置26中。由此,从图6所示的观看模式转移到阅读模式。此外,配送装置1返回步骤S5,等待接收活动图像配送请求指令。  Then, it is judged whether to continue the browsing operation (steps S42, S43). If the browsing operation is continued, the receiving device 23 returns to step S3 to display thumbnails/texts on the display device 26. As a result, the viewing mode shown in FIG. 6 is shifted to the reading mode. In addition, the distribution device 1 returns to step S5, and waits for the reception of a video distribution request command. the

另一方面,朋友所持有的其他接收装置接收内容推荐信息(步骤S44),其他接收装置的控制单元24将内容配送指令发送给配送装置1(步骤S45),该内容配送指令包括该内容推荐信息中包含的活动图像的配送开始时间信息和配送停止时间信息、以及用于确定内容的识别信息。若接收该内容配送指令(步骤S46),配送装置1的视频/声音/文本配送单元5根据接收到的内容 配送指令中包含的活动图像的配送开始时间信息和配送停止时间信息、以及用于确定内容的识别信息,确定应配送的内容,并确定配送开始的位置,读出该配送开始位置开始至配送停止位置为止的视频(活动图像)数据、声音数据、文本(字幕)数据,从而经由通信单元8,将由该视频数据、声音数据以及文本数据构成的活动图像数据进行流配送(步骤S47)。  On the other hand, other receiving devices held by the friend receive the content recommendation information (step S44), and the control unit 24 of the other receiving devices sends a content distribution instruction to the distribution device 1 (step S45), the content distribution instruction includes the recommended content The information includes delivery start time information and delivery stop time information of moving images, and identification information for specifying content. If the content distribution instruction is received (step S46), the video/sound/text distribution unit 5 of the distribution device 1 will be based on the distribution start time information and distribution stop time information of moving images contained in the received content distribution instruction, and the information used to determine The identification information of the content determines the content to be delivered, and determines the delivery start position, and reads the video (moving image) data, audio data, and text (subtitle) data from the delivery start position to the delivery stop position, so that via communication The unit 8 stream-distributes the video data composed of the video data, audio data, and text data (step S47). the

其他的接收装置23经由通信单元27接收该被流配送的活动图像数据,并将接收的活动图像数据存储在存储单元28中。由此,视频数据43、声音数据、以及文本数据45被存储在存储单元28中。与此并行,视频/声音/文本显示单元33从存储单元28经由数据缓冲器34读出视频数据43、声音数据44、以及文本数据45,并将其显示在显示单元26中(步骤S48)。由此,可阅览朋友推荐的活动图像。  The other receiving device 23 receives the streaming video data via the communication unit 27 and stores the received video data in the storage unit 28 . Thus, video data 43 , sound data, and text data 45 are stored in the storage unit 28 . In parallel with this, video/sound/text display unit 33 reads out video data 43, sound data 44, and text data 45 from storage unit 28 via data buffer 34, and displays them on display unit 26 (step S48). Thereby, moving images recommended by friends can be browsed. the

接着,若其他的接收装置23的用户从输入单元25进行显示终止的操作,则控制单元24将显示终止指令发送给配送装置1(步骤S49)。若接收该显示终止指令,则视频/声音/文本配送单元6停止活动图像数据的配送动作(步骤S50)。  Next, when the user of another receiving device 23 performs an operation to terminate the display from the input unit 25, the control unit 24 transmits a display termination command to the delivery device 1 (step S49). Upon receiving the display termination command, the video/audio/text distribution unit 6 stops the distribution operation of moving image data (step S50). the

另外,在图5所示的动作中,表示了通过流配送活动图像的例子,但在步骤S1中,从配送装置1对接收装置23发送缩略图和文本的情况下,也可以一并将活动图像的全部配送给接收装置23,伴随缩略图的文本被选择的情况下,根据被选择的文本的时间信息,确定活动图像的再现开始位置,将预先接收的活动图像从该再现开始位置开始再现。此时,在每次进行图5所示的用于发送内容推荐信息的操作(步骤S41)时,也可以对其他接收装置23发送内容推荐信息(步骤S34)即可。对其他接收装置配送活动图像的情况下,也不限定于流配送(步骤S47),也可以下载被推荐的部分的全部活动图像而进行显示。  In addition, in the operation shown in FIG. 5 , an example in which moving images are distributed by streaming is shown, but in step S1, when the distribution device 1 transmits thumbnails and texts to the receiving device 23, the moving images may be combined together. All the images are delivered to the receiving device 23, and when the text accompanying the thumbnail is selected, the playback start position of the moving image is determined based on the time information of the selected text, and the playback of the moving image received in advance starts from the playback start position. . In this case, the content recommendation information may be transmitted to another receiving device 23 (step S34 ) every time the operation for transmitting the content recommendation information (step S41 ) shown in FIG. 5 is performed. When distributing the video to another receiving device, it is not limited to the streaming distribution (step S47 ), and all the video of the recommended part may be downloaded and displayed. the

由此,可联动切换阅读模式和观看模式,且由于将阅读模式用于想观看的活动图像的检索,视听了被配送的活动图像的用户将喜欢的部分推荐给朋友,因此通过将用于确定推荐的内容的内容推荐信息发送给朋友所持有的其他接收装置,从而被推荐的用户可直接接入到被推荐的部分的视频。  In this way, the reading mode and viewing mode can be switched in conjunction, and since the reading mode is used to search for moving images that you want to watch, the user who watched the distributed moving images will recommend the favorite parts to friends, so by using the The content recommendation information of the recommended content is sent to other receiving devices held by friends, so that the recommended user can directly access the recommended part of the video. the

接着,说明根据全部视频内容生成重点场景的情况。重点场景的生成以与所述的文本/缩略图显示单元33联动地形式进行,如下进行。  Next, a case where a highlight scene is generated from all video contents will be described. The key scene is generated in conjunction with the above-mentioned text/thumbnail display unit 33, as follows. the

(1)利用多个用户的接入排名  (1) Use the access ranking of multiple users

基于图2、图3所示的视听历史信息的收集动作的结果,在视频内容中,集计基于多个用户的视频视听多的地方,仅将接入排名上位部分自动作为重点场景来使用,从而进行视频配送,从而可进行摘要(digest)视听。  Based on the results of the collection operation of the viewing history information shown in FIGS. 2 and 3 , in the video content, only the high-ranking part of the access ranking is automatically used as the key scene, where the video content is viewed by multiple users. This enables video distribution and digest viewing. the

(2)附加确定的用户  (2) Additional identified users

基于图4所示的注释附加动作的结果,确定的用户选择认为是重点的部分,对该部分附加注释而发送给配送装置1,配送装置1对其他用户进行该重点场景的视频配送,从而可进行摘要视听。  Based on the result of the annotation addition action shown in FIG. 4, the determined user selects the part considered to be the key point, attaches the annotation to the part and sends it to the distribution device 1, and the distribution device 1 distributes the video of the key scene to other users, so that We perform digest viewing and hearing. the

(3)(1)和(2)的组合  (3) A combination of (1) and (2)

通过将用户选择的重点场景和视听多的场景进行组合,从而作为用于摘要视听的数据来使用。  A combination of a highlight scene selected by the user and a scene with a lot of viewing is used as data for digest viewing. the

(4)对(1)、(2)、(3)的各自,配送侧进行附加  (4) Each of (1), (2), and (3) is attached to the delivery side

对上述(1)、(2)、(3)的各自,配送侧进一步附加计划了的重点场景等,从而在配送侧和视听侧双方生成重点场景。  For each of the above (1), (2), and (3), the delivery side further adds planned highlight scenes and the like to generate highlight scenes on both the delivery side and the viewing side. the

这样,根据用于确定用户选择的重点场景和视听多的场景的信息,从全部视频内容中能够生成重点场景,因此能够容易选择用于进行摘要视听的重点场景,能够对用户配送优选的重点场景。  In this way, based on the information for specifying the highlight scene selected by the user and the scene with a lot of viewing and listening, the highlight scene can be generated from all video contents, so the highlight scene for digest viewing can be easily selected, and the preferred highlight scene can be delivered to the user. . the

在以往的技术中,当关于广播节目等较长的视频内容,视听预先存储的节目或进行基于流的VOD(Video On Demand)视听的情况下,可进行仅将重点场景收集而连续视听的摘要视听。此时,决定重点场景的是内容的提供侧,用户一般进行基于被决定的数据的固定的视听,存在难以进行内容提供侧和用户相互生成的重点场景的摘要视听的问题。  In the conventional technology, when watching a pre-stored program or stream-based VOD (Video On Demand) viewing of long video content such as a broadcast program, it is possible to collect only important scenes and continuously watch a digest audiovisual. At this time, it is the content provider who decides the highlight scene, and the user generally performs fixed viewing based on the determined data, and there is a problem that it is difficult to view a summary of the highlight scene mutually generated by the content provider and the user. the

在本实施方式中,内容提供侧和用户相互生成重点场景,在一个内容中,可进行各种摘要视听。  In the present embodiment, the content provider and the user create highlight scenes mutually, and various digests can be viewed and heard in one content. the

另外,也可以将用于实现图1中的处理单元的功能的程序记录在计算机可读取的记录介质中,使计算机系统读入并执行在该记录介质中记录的程序,从而进行视频配送处理。另外,这里所述的“计算机系统”设为包含OS和周边设备等的硬件。此外,“计算机系统”还可以包括具有主页提供环境(或显示环境)的WWW系统。此外,“计算机可读取的记录介质”是指软盘、光磁盘、ROM、CD-ROM等可移动介质、计算机系统中内置的硬盘等存储装置。此外,“计算机可读取的记录介质”还包括经由因特网等网络和电话线路等通信线路发送了程序的情况下的、服务器和成为客户机的计算机系统内部 的易失性存储器(RAM)这样的一定时间持有程序的记录介质。  In addition, the program for realizing the function of the processing unit in FIG. 1 may be recorded in a computer-readable recording medium, and the computer system may read and execute the program recorded in the recording medium to perform video distribution processing. . In addition, the "computer system" described here is assumed to include hardware such as an OS and peripheral devices. In addition, the "computer system" may also include a WWW system having a home page providing environment (or a display environment). In addition, the "computer-readable recording medium" refers to removable media such as floppy disks, magneto-optical disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into computer systems. In addition, the "computer-readable recording medium" also includes volatile memory (RAM) inside a server and a computer system serving as a client when the program is transmitted via a network such as the Internet or a communication line such as a telephone line. The recording medium that holds the program for a certain period of time. the

此外,上述程序也可以从将该程序存储在存储装置等的计算机系统,经由传输介质、或者通过传输介质中的传输波,被传输到其他的计算机系统中。这里,传输程序的“传输介质”是如因特网等网络(通信网)或电话线路等通信线路(通信线)那样具有信息传输功能的介质。此外,上述程序可以是用于实现所述的功能中一部分的程序。此外,也可以是通过与已经在计算机系统中记录的程序的组合来实现所述功能的程序、所谓的差分文件(差分程序)。  In addition, the above-mentioned program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or via a transmission wave in a transmission medium. Here, the "transmission medium" for transmitting the program is a medium having an information transmission function such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. In addition, the above-mentioned program may be a program for realizing some of the functions described above. In addition, a program that realizes the above function by combining with a program already recorded in the computer system, a so-called differential file (difference program) may also be used. the

产业上的可利用性  Industrial availability

本发明能够应用于,能够从视频内容整体中确定多个用户持有兴趣的部分,从而可对该确定部分进行视听历史信息的收集等规定的处理的、视频配送装置和视频配送程序等。  The present invention can be applied to a video distribution device, a video distribution program, etc. that can specify a portion of the entire video content that a plurality of users are interested in, and perform predetermined processing such as collection of viewing history information on the specified portion. the

Claims (6)

1.一种视频配送装置,通过通信或广播对接收装置配送视频,其特征在于,包括:1. A video distribution device for distributing video to a receiving device through communication or broadcasting, characterized in that it comprises: 缩略图配送部件,将根据所述视频的数据生成的多个缩略图数据、以及根据伴随所述视频的字幕数据生成的多个文本数据,在时间轴上进行关联,从而预先配送给所述接收装置;The thumbnail distribution means associates on the time axis a plurality of thumbnail data generated based on the video data and a plurality of text data generated based on the subtitle data accompanying the video, and distributes them to the recipient in advance. device; 请求接收部件,从所述接收装置接收视频配送请求之后,从所述接收装置接收用于请求所述视频的配送停止的视频配送停止请求,其中所述视频配送请求包括从在所述接收装置中显示的文本数据中选择的文本数据的时间信息;request receiving means for receiving a video distribution stop request for requesting stop of distribution of the video from the receiving device after receiving a video distribution request from the receiving device, wherein the video distribution request includes The time information of the selected text data in the displayed text data; 视频配送部件,当接收了所述视频配送请求的情况下,基于所述时间信息,确定所述视频数据的配送开始位置,开始配送所述视频数据,在接收到所述视频配送停止请求的情况下,确定所述视频数据的配送停止位置,停止配送所述视频数据;以及The video distribution component, when receiving the video distribution request, determines the distribution start position of the video data based on the time information, and starts to distribute the video data, and when receiving the video distribution stop request Next, determine the distribution stop position of the video data, and stop the distribution of the video data; and 历史信息收集部件,其收集由与所述视频配送部件所配送的所述视频数据的所述配送开始位置起到所述配送停止位置有关的信息、和确定所述视频的识别信息构成的视听历史信息。a history information collection unit that collects a viewing history consisting of information related to the delivery start position to the delivery stop position of the video data delivered by the video delivery unit, and identification information specifying the video information. 2.如权利要求1所述的视频配送装置,其特征在于,包括:2. The video distribution device according to claim 1, comprising: 重点视频生成部件,其基于所述视频配送部件所配送的所述视频数据的所述配送开始位置起到配送停止位置,生成所述视频数据的重点场景。A highlight video generating unit generates a highlight scene of the video data based on the delivery start position to the delivery stop position of the video data delivered by the video delivery unit. 3.如权利要求1所述的视频配送装置,其特征在于,包括:3. The video distribution device according to claim 1, comprising: 注释、评价信息存储部件,其对所述视频配送部件所配送的所述视频数据的所述配送开始位置起到配送停止位置,将在所述接收装置中被输入而发送的注释信息或评价信息相关联,从而进行存储。Annotation and evaluation information storage means for sending the annotation information or evaluation information inputted in the receiving device from the distribution start position to the distribution stop position of the video data distributed by the video distribution means associated for storage. 4.一种视频配送方法,是通过通信或广播对接收装置配送视频的视频配送装置的视频配送方法,该视频配送方法的特征在于,4. A video distribution method, which is a video distribution method of a video distribution device that distributes video to a receiving device through communication or broadcasting, the video distribution method is characterized in that, 将根据所述视频的数据生成的多个缩略图数据、以及根据伴随所述视频的字幕数据生成的多个文本数据,在时间轴上进行关联,从而预先配送给所述接收装置;correlating on the time axis a plurality of thumbnail data generated based on the video data and a plurality of text data generated based on the subtitle data accompanying the video, so as to distribute to the receiving device in advance; 从所述接收装置接收视频配送请求之后,从所述接收装置接收用于请求所述视频的配送停止的视频配送停止请求,其中所述视频配送请求包括从在所述接收装置中显示的文本数据中选择的文本数据的时间信息;After receiving a video distribution request from the receiving device, receiving a video distribution stop request for requesting a stop of distribution of the video from the receiving device, wherein the video distribution request includes text data displayed in the receiving device The time information of the text data selected in ; 当接收了所述视频配送请求的情况下,基于所述时间信息,确定所述视频数据的配送开始位置,开始配送所述视频数据,在接收到所述视频配送停止请求的情况下,确定所述视频数据的配送停止位置,停止配送所述视频数据;以及When the video distribution request is received, based on the time information, determine the distribution start position of the video data, and start distribution of the video data, and when the video distribution stop request is received, determine the distribution start position of the video data the delivery stop position of the video data, and stop delivery of the video data; and 收集由与所述视频数据的所述配送开始位置起到配送停止位置有关的信息、和确定所述视频的识别信息构成的视听历史信息。Viewing history information including information on the delivery start position to the delivery stop position of the video data and identification information specifying the video is collected. 5.如权利要求4所述的视频配送方法,其特征在于,5. The video distribution method as claimed in claim 4, characterized in that, 基于所述视频数据的所述配送开始位置起到配送停止位置,生成所述视频数据的重点场景。A key scene of the video data is generated based on the delivery start position to the delivery stop position of the video data. 6.如权利要求4所述的视频配送方法,其特征在于,6. The video distribution method as claimed in claim 4, wherein: 对所述视频数据的所述配送开始位置起到配送停止位置,将在所述接收装置中被输入而发送的注释信息或评价信息相关联,从而进行存储。The video data is stored in association with comment information or evaluation information input and transmitted from the delivery start position to the delivery stop position.
CN2008801031870A 2007-08-14 2008-08-13 Video distribution device and video distribution method Expired - Fee Related CN101779459B (en)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
JP2007211441 2007-08-14
JP211441/07 2007-08-14
JP211442/07 2007-08-14
JP211459/07 2007-08-14
JP2007211442 2007-08-14
JP2007211459 2007-08-14
PCT/JP2008/064542 WO2009022708A1 (en) 2007-08-14 2008-08-13 Video distribution device and video distribution program

Publications (2)

Publication Number Publication Date
CN101779459A CN101779459A (en) 2010-07-14
CN101779459B true CN101779459B (en) 2013-09-25

Family

ID=40350760

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2008801031870A Expired - Fee Related CN101779459B (en) 2007-08-14 2008-08-13 Video distribution device and video distribution method

Country Status (3)

Country Link
JP (1) JP5290178B2 (en)
CN (1) CN101779459B (en)
WO (1) WO2009022708A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5073535B2 (en) * 2008-03-04 2012-11-14 シャープ株式会社 CONTENT REPRODUCTION DEVICE, CONTENT REPRODUCTION METHOD, CONTENT REPRODUCTION SYSTEM, CONTENT REPRODUCTION PROGRAM, AND RECORDING MEDIUM CONTAINING THE PROGRAM
US8606848B2 (en) * 2009-09-10 2013-12-10 Opentv, Inc. Method and system for sharing digital media content
CN102377977B (en) * 2010-08-20 2014-08-06 中国移动通信有限公司 Method, device and system for processing video in video call process
JP2014060701A (en) * 2012-08-02 2014-04-03 Information Services International Dentsu Ltd Remote operation system
JP6288830B2 (en) * 2014-02-10 2018-03-07 日本放送協会 Information processing apparatus and program
JP7179387B1 (en) 2022-03-18 2022-11-29 株式会社喋ラボ HIGHLIGHT MOVIE GENERATION SYSTEM, HIGHLIGHT MOVIE GENERATION METHOD, AND PROGRAM

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007174245A (en) * 2005-12-21 2007-07-05 Daikin Ind Ltd Recording / reproducing system and recording / reproducing method

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3928367B2 (en) * 2001-04-05 2007-06-13 日本電気株式会社 Advertising insertion area determination device and program
JP2004007342A (en) * 2002-03-29 2004-01-08 Fujitsu Ltd Automatic digest generation method
JP2004157786A (en) * 2002-11-06 2004-06-03 Nippon Telegr & Teleph Corp <Ntt> Video index generation method and program, and storage medium storing video index generation program
JP4016891B2 (en) * 2003-06-06 2007-12-05 日本電信電話株式会社 Partial content creation method and apparatus, program, and computer-readable recording medium
JP2005136824A (en) * 2003-10-31 2005-05-26 Toshiba Corp Digital video distribution system and video distribution method
JP4296157B2 (en) * 2005-03-09 2009-07-15 ダイキン工業株式会社 Information processing apparatus, portable device, information processing method, and program
JP4556778B2 (en) * 2005-06-17 2010-10-06 株式会社日立製作所 Information distribution system
JP2007036752A (en) * 2005-07-27 2007-02-08 Tdk Corp System, method and program for reproducing contents

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007174245A (en) * 2005-12-21 2007-07-05 Daikin Ind Ltd Recording / reproducing system and recording / reproducing method

Also Published As

Publication number Publication date
JPWO2009022708A1 (en) 2010-11-18
CN101779459A (en) 2010-07-14
JP5290178B2 (en) 2013-09-18
WO2009022708A1 (en) 2009-02-19
HK1145240A1 (en) 2011-04-08

Similar Documents

Publication Publication Date Title
CN101127884B (en) Program switching method
US8533210B2 (en) Index of locally recorded content
US8813127B2 (en) Media content retrieval system and personal virtual channel
KR101002070B1 (en) Related content receiving device, related content providing device, and related content transmission system using same
KR101472013B1 (en) Server and method for providing music streaming include data of add image
CN101779459B (en) Video distribution device and video distribution method
CN101779458B (en) Video distribution device and video distribution program
JP2004173120A (en) Moving image storage device, moving image distribution system
JP2004104721A (en) Multimedia playback device and program providing system
WO2011118249A1 (en) Content recommendation server, content display terminal, and content recommendation system
JP4846674B2 (en) Still image extraction apparatus and still image extraction program
JP4937211B2 (en) Still image extraction apparatus and still image extraction program
KR100848721B1 (en) Recommended content providing system and method
JP4180978B2 (en) Video viewing control system, video viewing control method, video related information management server, viewing scene selection terminal, program thereof, and recording medium for the program
JP2015115802A (en) Electronic apparatus, method, and computer-readable recording medium
US20120263431A1 (en) Video content reproduction apparatus and method of displaying content information
JP4772012B2 (en) Still image extraction apparatus and still image extraction program
JP4972466B2 (en) Content transmission / reception system
JP4229787B2 (en) Digital broadcast recording apparatus, digital broadcast recording method, and program
HK1145240B (en) Video distribution device and video distribution method
KR100904676B1 (en) Live broadcast system and method
JP2008219691A (en) Video distribution service system
JP5279074B2 (en) On-demand viewing system and on-demand viewing method
JP2004304306A (en) Information exchanger, receiver and memory for av stream
US20110202964A1 (en) Television broadcasting receiver

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1145240

Country of ref document: HK

C14 Grant of patent or utility model
GR01 Patent grant
REG Reference to a national code

Ref country code: HK

Ref legal event code: GR

Ref document number: 1145240

Country of ref document: HK

CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130925

Termination date: 20180813

CF01 Termination of patent right due to non-payment of annual fee