JP6286894B2 - Information processing apparatus, display control program, and display control method - Google Patents

Description

  The present invention relates to an information processing apparatus, a display control method, and a display control method.

In recent years, with the progress of information and communication technology (ICT), the number of users who use so-called terrestrial digital terrestrial digital television broadcasting services is increasing. In digital terrestrial television broadcasting services (hereinafter referred to as terrestrial digital broadcasting services), there are weak hierarchical services (hereinafter referred to as one-segment) and strong hierarchical services (hereinafter referred to as full-segment) in the same channel. In the terrestrial digital broadcasting service, for example, the same content provided by a broadcasting station can be received in different broadcasting formats such as one segment and full segment. Full Seg is a broadcasting service that enables viewing with high-definition received video. One Seg is a broadcast service that allows viewing while moving because the resolution of the received video is lower than that of Full Seg, but has high noise resistance. A user receives and provides a broadcast wave of a terrestrial digital broadcasting service by an information processing device that can receive the terrestrial digital broadcasting wave while moving, such as a tablet PC (PC: Personal Computer), a smartphone, or a car navigation device. Enjoyed content.

  The viewing area of Full Seg and One Seg provided by the terrestrial digital broadcasting service has a relationship of Full Seg <One Seg. Therefore, in an area where both full-segment and one-segment broadcasts can be received, the information processing apparatus switches the service manually or automatically, and gives the user priority to full-seg that can receive high-definition video. In addition, in an area where full segment cannot be viewed, the information processing apparatus performs service switching to one segment having a wide service area and provides received video.

  In addition, the following patent documents exist as prior art documents in which technologies related to the technologies described in this specification are described.

JP 2012-227633 A International Publication No. 2008/129649

  In the terrestrial digital broadcasting service, the full-segment broadcast data is provided in advance of the one-segment broadcast data in time. For this reason, in the terrestrial digital broadcasting service, the content provided in one segment causes a time delay with respect to the content provided in full segment. In an area where the broadcast waves of both services can be received, for example, when switching from full segment to one segment, there is a risk that duplicate display of reproduced video or the like may occur. In addition, when switching from the one-segment service to the full-segment service, a lack of a reproduced video or the like may occur.

  In the above-mentioned prior art documents, for example, seamless switching that prevents duplicated display or omission of playback video or the like that may occur at the time of broadcasting service switching is proposed by performing synchronized playback that delays the playback timing of full segment in accordance with one segment. Yes.

In the seamless switching of the prior art documents, the time difference is measured after the service switching trigger occurs. Then, using the measured time difference as a delay amount, a synchronization delay is set (resolved in delay) for the broadcast data to be switched received after the time difference measurement. For this reason, in the seamless switching of the prior art documents, it takes time until the reproduced video after the switching is displayed.

  In one aspect, the present invention provides a technique for promptly switching to a service suitable for viewing when switching to a terrestrial digital broadcasting service.

The above technique is exemplified by the configuration of the following information processing apparatus. That is, the information processing apparatus presents content from the broadcast data of the first service that provides the same content and the broadcast data of the second service whose presentation time to the viewer precedes that of the first service. Means for measuring the time difference of the first service, means for storing the broadcast data of the second service, and the first service at the time when the measurement of the time difference is completed from the stored broadcast data of the second broadcast service. The specifying means for specifying the broadcast data of the second broadcast service corresponding to the broadcast data, the broadcast data stored after the specified broadcast data of the second broadcast service is extracted, and the time difference measurement is completed. Playback means for playing back the content that continues to the broadcast data of the first service.

  According to the information processing apparatus, it is possible to quickly switch to a service suitable for viewing when switching to a terrestrial digital broadcasting service.

It is explanatory drawing of a seamless switching process. It is explanatory drawing of the seamless switching process of this embodiment. It is a figure which shows the hardware structural example of the information processing apparatus of this embodiment. It is a flowchart which illustrates the seamless switching process of this embodiment. It is a data chart for demonstrating the process which extracts the broadcast data of a time difference from the preserve | saved data stored.

  Hereinafter, an information processing apparatus according to an embodiment will be described with reference to the drawings. The configuration of the following embodiment is an exemplification, and the information processing apparatus is not limited to the configuration of the embodiment.

Hereinafter, the information processing apparatus will be described with reference to FIGS. 1 to 5.
<Comparative example>
FIG. 1 illustrates an explanatory diagram of a seamless switching process as a comparative example. In the terrestrial digital broadcasting service, there are a weak hierarchy service (hereinafter referred to as “one segment”) and a strong hierarchy service (hereinafter referred to as “full segment”) in the same channel. In the terrestrial digital broadcasting service, the same content is provided by Full Seg and One Seg, which are different broadcasting formats. The “content” can also be referred to as a program provided by a terrestrial digital broadcasting service. The seamless switching process illustrated in FIG. 1 is realized by, for example, an information processing apparatus that can receive broadcast waves provided by full seg and one seg. Such information processing devices include, for example, portable television receivers, PCs (PCs), tablet PCs, smartphones, car navigation devices, etc., having tuners that allow viewing of digital terrestrial broadcasting services. It can be illustrated. When the information processing apparatus receives a broadcast wave provided in one seg and full seg and performs switching of a received video provided in a terrestrial digital broadcasting service, for example, the information processing apparatus executes a seamless switching process illustrated in FIG.

Here, “Full Seg” is a broadcast service that allows viewing with high-definition received video such as 1920 × 1080 pixels. “One Seg” is, for example, 320 × 180
This is a service that allows viewing with relatively low resolution received video such as pixels.

  Full segment is a service suitable for viewing with a fixed TV receiver or the like installed in each home, for example, because it can receive high-definition video and has low noise resistance. On the other hand, although the resolution of the received video is lower than that of the full segment, One Seg is a service suitable for, for example, a mobile terminal equipped with a reception tuner because it has high noise resistance. In terrestrial digital broadcasting services, 1Seg with high noise resistance secures a wider service area than Full Seg with low noise resistance.

  An information processing device that can receive both full-segment and one-segment broadcasts has good reception of broadcast waves. For example, when there are fewer errors than the predetermined value for the received video of full-segment, high-definition reception Display video preferentially. On the other hand, when the reception state is unsatisfactory, for example, when there are more errors than the predetermined value with respect to the full-segment received video, the information processing apparatus has a low noise but one-segment received video with high noise resistance. Switch to and display.

  For example, a broadcasting station providing a terrestrial digital broadcasting service provides content in a full-seg broadcast format, and then converts the same content to a one-seg broadcast format, so that the full-seg content precedes the one-seg content. Provided. On the information processing apparatus that receives the broadcast wave of the terrestrial digital broadcasting service, the full-segment broadcast data precedes the one-segment broadcast data in terms of time. For this reason, a time delay occurs between the content provided in the full-segment broadcasting format and the content provided in the one-segment broadcasting format. For example, a time delay of about 2 to 4 seconds occurs between content provided in the full-segment broadcasting format and content provided in the one-segment broadcasting format.

  Therefore, when switching from one seg to full seg, if the full-segment content that precedes in time is delayed and the playback timing is not matched, video data will be lost. Similarly, when switching from full segment to one segment, if the full-segment content preceding in time is delayed and the reproduction timing is not matched, duplication of video data will occur.

  The information processing apparatus that performs the seamless switching process illustrated in FIG. 1 performs, for example, synchronous playback that delays the playback timing of a full segment in accordance with one segment in order to prevent duplicate display or missing of the playback video that occurs at the time of service switching.

  In the explanatory diagram of FIG. 1, the received broadcast data of the preceding service that is hatched with a dot fill pattern is, for example, broadcast data of content provided in one segment. For example, the information processing apparatus starts the seamless switching process triggered by, for example, an error occurring in the received video being viewed being less than a predetermined value. In the explanatory diagram of FIG. 1, the seamless switching process is started at the timing of the switching trigger (Ta).

  In parallel with the broadcast data display process of the preceding service, the information processing apparatus acquires the full-segment broadcast data after the switching process and measures the time difference with the one-segment broadcast data that is the preceding service. In the explanatory diagram of FIG. 1, the full-segment broadcast data after the switching process is illustrated by hatching of the fill pattern of the right diagonal line. In the seamless switching process illustrated in FIG. 1, since the one-segment broadcast data of the preceding service is displayed on the display unit being viewed, the full-segment broadcast data acquired by the time difference measurement is discarded.

In the explanatory diagram of FIG. 1, for example, the information processing apparatus performs a reproduction timing delay process on the full-segment broadcast data provided after the switching process based on the time difference measured at the time difference measurement end time (Tb). The synchronous playback process is started. In the synchronous reproduction process, the time difference measured during the period (Tb−Ta) from the switching trigger (Ta) to the end of the time difference measurement is set as the delay amount in the full-segment broadcasting data that precedes in time. The information processing apparatus acquires, for example, full-segment broadcast data that precedes in time at the time difference measurement end point (Tb), and sets the measured time difference as a delay amount (synchronous reproduction). Full-segment broadcast data set with a delay is presented on the display unit as a playback video after switching after the timing of synchronization completion (Tc).

  Here, in the period from the end point (Tb) of the time difference measurement to the completion of synchronization (Tc), for example, the broadcast data of the preceding service at the end point (Tb) of the time difference measurement is stopped, and the display unit of the information processing apparatus Presented to. As an example, on the display unit of the information processing apparatus, the one-segment screen at the time difference measurement end point (Tb) is frozen, the sound is muted, and the period until the synchronization is completed (Tc) is continued. This stop state is resolved at the reproduction timing of the full-segment broadcast data after the switching process after the completion of synchronization (Tc), and the content based on the full-segment broadcast data is continuously provided to the display unit of the information processing apparatus.

  As described above, in the seamless switching process of FIG. 1, the time delay is measured after the occurrence of the service switching trigger, and the synchronization delay that is set in the broadcast data of the switching destination received after the time difference measurement is finished, with the measured time difference as the delay amount. I do. For this reason, it takes time from the occurrence of the service switching opportunity until the content based on the broadcast data after the synchronous reproduction is displayed. In addition, during the period from the time difference measurement end point (Tb) to the synchronization completion (Tc), that is, the period until the display of the content after the synchronized playback is resumed, the preceding service broadcast at the time difference measurement end point (Tb) is broadcast. Data was sometimes displayed in a stopped state.

<Example 1>
FIG. 2 illustrates an explanatory diagram of the seamless switching process of the present embodiment. In the seamless switching process of this embodiment, broadcast data used for time difference measurement is accumulated without being discarded. In the seamless switching process of the present embodiment, broadcast data corresponding to the time difference is extracted from the accumulated broadcast data at the end of the time difference measurement, and the synchronous reproduction process is performed. As a result, in the seamless switching process according to the present embodiment, it is possible to shorten the period from the end of time measurement until the display of the content after synchronized playback is resumed. In the seamless switching process of the present embodiment, it is possible to continuously provide the content of the broadcast data after the switching process that is synchronously reproduced at the end of the time measurement. In addition, the information processing apparatus which implement | achieves the seamless switching process of this embodiment is an information processing apparatus which has a tuner which can receive content, such as a received image provided by a terrestrial digital broadcasting service, by full seg and one seg, as in FIG. It is.

In the explanatory diagram of FIG. 2, the received broadcast data of the preceding service hatched with the dot fill pattern is, for example, one-segment broadcast data as in FIG. 1. For example, the information processing apparatus starts the switching process at the timing of the switching trigger (Ta) when an error or the like that has occurred with respect to the received video of the full segment is less than a predetermined value. It should be noted that the generation condition of the switching opportunity may be the frame rate of video decoded from the received broadcast data, the interruption of audio, or the adjustment of noise. In addition, the occurrence condition of the switching opportunity may be related to an error rate such as a radio wave intensity of received broadcast data, a BER (Bit Error Rate (Ratio)), a PER (Packet Error Ratio), or the like. Furthermore, the occurrence condition of the switching opportunity may be related to the user's state such as the reception position for receiving the broadcast wave of the terrestrial digital broadcasting service, the moving speed at the time of receiving the broadcast wave, and the switching opportunity by the user's manual operation It may be a thing.

In the seamless switching process of the present embodiment, for example, when a switching opportunity occurs, measurement of a time difference from the broadcast data of the service after the switching process is started. The time difference measurement is performed in parallel with the broadcast data display process of the preceding service. The seamless switching process of the present embodiment stores and accumulates the broadcast data of the service provided after the switching process, together with the time difference measurement. Note that the time difference measurement can be performed by pattern matching using, for example, cross-correlation between the decoded video data and audio data of the broadcast data of the preceding service and the broadcast data of the service after the switching process. .

  Also in the seamless switching process of the present embodiment illustrated in FIG. 2, the broadcast data of the preceding service being viewed is displayed on the display unit of the information processing apparatus that is measuring the time difference, as in FIG. In the seamless switching process of the present embodiment illustrated in FIG. 2, the broadcast data of the switching destination service corresponding to the time difference is extracted from the stored data at the end of the time difference measurement. By extracting broadcast data of the switching destination service corresponding to the time difference from the stored data stored, the synchronization delay between the broadcast data of both services related to the time difference measurement is completed. Therefore, in the explanatory diagram of FIG. 2, the synchronization completion (Tc) time is the time difference measurement end time.

For example, assuming that the measured time difference is ΔT, the stored data having the time information of (Tc−ΔT) is synchronized with the broadcast data of the service being viewed at the time of synchronization completion (Tc), Broadcast data of the service. That is, the information processing apparatus performs service switching at the time of synchronization completion (Tc), and decodes broadcast data having time information of (Tc−ΔT) in chronological order, for example, watching at the time of synchronization completion. Full-segment content can be displayed following the one-segment content. In the seamless switching process of the present embodiment, the information processing apparatus presents the full-seg content that precedes in time in chronological order, continuing by the time difference, following the one-seg content being viewed at the time of synchronization completion. Can do.

  As described above, in the seamless switching process according to the present embodiment, the information processing apparatus can accumulate broadcast data of the switching destination service together with the time difference measurement. For this reason, the information processing apparatus can complete the synchronization delay between the broadcast data of both services related to the time difference measurement by extracting stored data corresponding to the time difference from the accumulated broadcast data. For example, the information processing apparatus can process the timing at the end point (Tb) of the time difference measurement illustrated in FIG. 1 as the synchronization completion (Tc) of the synchronized playback. For this reason, the information processing apparatus of this embodiment can shorten the processing time from the time difference measurement end (Tb) time point to the synchronization completion (Tc) point with respect to the seamless switching process illustrated in FIG.

  In addition, in the seamless switching process of the present embodiment, unlike the seamless switching process illustrated in FIG. 1, the broadcast data of the preceding service at the time difference measurement end time (Tb) is not displayed in a stopped state. In the seamless switching process of the present embodiment, it is possible to enjoy the audio and story progress of the content provided by the terrestrial digital broadcasting service before and after the switching without stopping. In the seamless switching process of this embodiment, it is possible to quickly switch to a service suitable for viewing.

〔Device configuration〕
FIG. 3 illustrates a hardware configuration of the information processing apparatus according to this embodiment. The information processing apparatus 10 illustrated in FIG. 3 is an information processing apparatus such as a PC (PC: Personal Computer), a tablet PC, a smartphone, or a car navigation device. The information processing apparatus 10 illustrated in FIG. 3 functions as a receiving apparatus that receives, for example, a weak layer service (for example, one segment) and a strong layer service (for example, full segment) provided in the terrestrial digital broadcasting service. To do.

The information processing apparatus 10 illustrated in FIG. 3 delays the reproduction timing of a service in which content is provided ahead of time in accordance with the service being viewed, for example, when service switching occurs in the content being viewed. Perform a synchronization delay. The synchronization delay is performed in parallel with the display processing of the content provided by the service being viewed. The information processing apparatus 10 accumulates broadcast data relating to time difference measurement as stored data during the synchronization delay processing.

  The information processing apparatus 10 extracts the broadcast data of the measured time difference from the stored data stored, starting from the broadcast data being viewed at the end of the time difference measurement. The information processing apparatus 10 extracts the time difference broadcast data from the stored data, thereby delaying the reproduction timing of the content of the service that precedes in time in accordance with the service being viewed at the end of the time difference measurement. Complete the synchronization delay. For this reason, in the information processing apparatus 10 according to the present embodiment, since the playback synchronization can be completed as the time difference measurement ends, the time from the occurrence of the switching opportunity to the start of the synchronized playback of the content provided by the switching destination broadcast service is reached. Can be shortened.

  Further, the information processing apparatus 10 performs service switching at the timing when the time difference measurement ends, decodes and plays back the extracted broadcast data, and outputs it to the display unit 7. For this reason, in the seamless switching process of the information processing apparatus 10 according to the present embodiment, the content by the service after switching without stopping the audio or story progression of the content presented on the display unit at the synchronization completion time (Tc = Tb). Can enjoy. The user of the information processing apparatus 10 can switch the viewing target without being aware of the time difference in the reproduction timing of the broadcast data related to the service switching process.

An information processing apparatus 10 illustrated in FIG. 3 includes a receiving unit 1, an extracting unit 2, storage units 3a and 3b, decoding units 4a and 4b, renderers 5a and 5b, a switching unit 6, a display unit 7, and a CPU (Central Processing Unit). 11, a main storage unit 12, and an auxiliary storage unit 13. The CPU 11, the main storage unit 12, and the auxiliary storage unit 13 are connected to each other by a connection bus B1. Note that the receiving unit 1, the extracting unit 2, the storing units 3a and 3b, the decoding units 4a and 4b, the renderers 5a and 5b, the switching unit 6 and the display unit 7 may be connected to the connection bus B1.

  In the information processing apparatus 10, the CPU 11 develops a program stored in the auxiliary storage unit 13 so as to be executable in the work area of the main storage unit 12, and controls peripheral devices through the execution of the program. Thereby, the information processing apparatus 10 can implement a function that matches a predetermined purpose. The main storage unit 12 and the auxiliary storage unit 13 are recording media that can be read by the information processing apparatus 10.

  The CPU 11 is a central processing unit that controls the entire information processing apparatus 10. The CPU 11 performs processing according to a program stored in the auxiliary storage unit 13. The main storage unit 12 is a storage medium in which the CPU 11 caches programs and data and expands a work area. The main storage unit 12 includes, for example, a RAM (Random Access Memory) and a ROM (Read Only Memory).

  The auxiliary storage unit 13 stores various programs and various data in a recording medium in a readable and writable manner. The auxiliary storage unit 13 is also called an external storage device. The auxiliary storage unit 13 stores an operating system (OS), various programs, various tables, and the like. The OS includes a communication interface program that exchanges data with an external device or the like. Examples of the external device include other information processing devices and external storage devices.

The auxiliary storage unit 13 is, for example, an EPROM (Erasable Programmable ROM), a solid state drive device, a hard disk drive (HDD, Hard Disk Drive) device, US
B (Universal Serial Bus) memory, memory card, etc. As the auxiliary storage unit 13, for example, a CD drive device, a DVD drive device, a BD drive device, or the like can be presented. Examples of the recording medium include a silicon disk including a nonvolatile semiconductor memory (flash memory), a hard disk, a CD, a DVD, and a BD.

  Note that the information processing apparatus 10 illustrated in FIG. 3 may include an input unit that receives an operation instruction or the like from a user or the like. The input unit includes, for example, a pointing device such as a keyboard and a mouse, a wireless remote controller, a microphone, a touch panel, a camera, and the like. The information processing apparatus 10 may include an output device such as a speaker.

  In the information processing apparatus 10 according to the present embodiment, the CPU 11 reads the OS, various programs, and various data stored in the auxiliary storage unit 13 into the main storage unit 12 and executes them, thereby executing the time difference measurement unit 101 and the delay control unit 102. As a function.

  In the information processing apparatus 10 illustrated in FIG. 3, the storage unit 3a, the decoding unit 4a, and the renderer 5a function as a processing system for content processing related to a first service provided by, for example, a terrestrial digital broadcasting service. The storage unit 3b, the decryption unit 4b, and the renderer 5b function as a processing system for content processing related to the second service. Here, the first service is, for example, a weak tier service, and the second service is, for example, a strong tier service.

In the information processing apparatus 10 illustrated in FIG. 3, the receiving unit 1 receives a broadcast wave of a terrestrial digital broadcasting service related to content. The broadcast wave of the terrestrial digital broadcasting service includes one segment that is a weak layer service and full segment that is a strong layer service in the same channel. For example, the receiving unit 1 transmits an RF (Radio Frequency) signal, which is a broadcast wave of a terrestrial digital broadcasting service, received via an antenna (not shown) in a baseband band including content information provided by each hierarchical service. The signal is frequency converted and output to the extraction unit 2. The receiving unit 1 includes, for example, a frequency converter, a band pass filter, an amplifier circuit, and the like for performing such frequency conversion.

The extraction unit 2 demodulates the baseband signal output from the reception unit 1 and includes a transport stream signal (TS: Transport Stream, hereinafter referred to as a TS signal) including broadcast data of content provided by each hierarchical service. ). The extraction unit 2 then generates a PES (Packetize Elementary) including broadcast data of the weak hierarchical service from the generated TS signal.
Stream) packet and a PES packet including broadcast data of the strong hierarchical service are extracted. For example, the extracted PES of the weak hierarchical service is output to the storage unit 3a, and the PES of the strong hierarchical service is output to the storage unit 3b.

The extraction unit 2 includes, for example, an AD (Analog to Digital) converter, an FFT (Fast Fourier Transform) processing circuit, a demodulation processing circuit, and the like for demodulating a baseband signal. In addition, the extraction unit 2 includes, for example, a decoding processing circuit that performs deinterleaving processing and error correction processing for generating TS signals of each hierarchical service. The extraction unit 2 includes, for example, a TS-DEMUX (TS-Demultiplexer) processing circuit for extracting the PES of each hierarchical service from the TS signal. Each processing circuit included in the extraction unit 2 may be realized by a logic circuit such as an FPGA (Field Programmable Gate Array), for example.
It may function by a program executed by the CPU.

  The storage unit 3a stores and accumulates the PES packets of the weak hierarchy service output from the extraction unit 2. For example, the storage unit 3a receives the notification from the delay control unit 102 and accumulates the PES packets of the weak hierarchical service output from the extraction unit 2 for a predetermined time. Here, for the predetermined time, for example, a period from the service switching opportunity to the end of the time difference measurement can be presented. The PES packet of the weak tier service stored in the storage unit 3a is, for example, received from the delay control unit 102 and discarded.

  The storage unit 3b stores and accumulates the PES packet of the strong hierarchical service output from the extraction unit 2. Similarly to the storage unit 3a, the storage unit 3b receives the notification from the delay control unit 102 and accumulates the PES packets of the strong hierarchical service output from the extraction unit 2 over a predetermined time. Here, for the predetermined time, for example, a period from the service switching opportunity to the end of the time difference measurement can be presented. The PES packet of the strong hierarchical service stored in the storage unit 3b receives, for example, a notification from the delay control unit 102 and is output to the decoding unit 4b.

  The storage units 3a and 3b are first-in first-out read / write memories such as a FIFO (First In First Out) memory, for example. The storage units 3a and 3b may be provided in a predetermined area of the main storage unit 12, for example.

  For example, the decoding unit 4a performs a decoding process on the PES packet of the weak hierarchical service. For example, the video data of the weak hierarchy service is compressed in a format such as H264, and the audio data is compressed in a format such as MPEG2 (Moving Picture Experts Group 2). Therefore, the decoding unit 4a performs a decoding process using an expansion method corresponding to these. The video data and audio data of the weak hierarchical service decoded by the decoding unit 4a are output to the renderer 5a and the time difference measuring unit 101.

For example, the decoding unit 4b performs a decoding process on the PES packet of the strong hierarchical service. For example, video data for strong hierarchical services is MPEG2, audio data is MPEG2 (Moving
Picture Experts Group 2) Since compression is performed in a format such as AAC (Advanced Audio Coding), the decoding unit 4b performs decoding processing by an expansion method corresponding to these. The video data and audio data of the strong hierarchical service decoded by the decoding unit 4b are output to the renderer 5b and the time difference measuring unit 101.

  The renderer 5a reproduces the content provided by the weak hierarchy service from the video data and audio data of the weak hierarchy service output from the decoding unit 4a. The content of the weak hierarchy service reproduced by the renderer 5 a is output to the switching unit 6. Similarly, the renderer 5b also reproduces the content provided by the strong hierarchy service from the video data and audio data of the strong hierarchy service output from the decoding unit 4b. Similarly, the content of the strong hierarchical service reproduced by the renderer 5b is also output to the switching unit 6.

  The switching unit 6 switches the content of the terrestrial digital broadcasting service to be output to the display unit 7 according to the notification from the delay control unit 102, for example. The switching unit 6 performs switching between the content provided by the weak hierarchical service output from the renderer 5a and the content provided by the strong hierarchical service output from the renderer 5b.

The display unit 7 displays the content of the terrestrial digital broadcasting service output from the switching unit 6. The display unit 7 is, for example, a CRT (Cathode Ray Tube) display, LCD (Liquid Crystal), or the like.
Display), PDP (Plasma Display Panel), EL (Electroluminescence) panel,
It is a display device such as an organic EL panel.

For example, the time difference measuring unit 101 calculates the time difference between the content provided by the weak hierarchical service and the content provided by the strong hierarchical service from the decoded video data and audio data output from the decoding units 4a and 4b. measure. The time difference measuring unit 101 uses, for example, a cross-correlation between the decoded video data and audio data output from the decoding unit 4a and the decoded video data and audio data output from the decoding unit 4b. Time difference is measured by pattern matching. The time difference between the content provided by the weak hierarchical service and the content provided by the strong hierarchical service measured by the time difference measuring unit 11 is temporarily stored in a predetermined area of the main storage unit 12, for example. . The time difference measuring unit 101 delivers the measured time difference to the delay time control unit 102.

  From the time difference information measured by the time difference measuring unit 101, the delay control unit 102 performs, for example, synchronized playback between the weak hierarchical service being viewed and the strong hierarchical service after switching, and performs seamless switching processing. The delay control unit 102 refers to the broadcast data stored in the storage unit 3b based on the time difference information measured by the time difference measurement unit 101, and extracts stored data corresponding to the time difference. Extraction of stored data starts from time information of a broadcast service being viewed at the end of the time difference measurement process, for example. The extracted broadcast data is output to the decoding unit included in the service processing system after switching.

  The delay control unit 102 notifies the switching unit 6 of switching of the broadcast service being viewed. In addition, the delay control unit 102 notifies the storage units 3a and 3b to store the broadcast data received by the information processing apparatus 10. The timing of the switching notification to the switching unit 6 can be exemplified when the stored data corresponding to the time difference accumulated in the storage unit is extracted. Note that the switching notification to the switching unit 6 may be performed, for example, after the completion of the decoding process of the extracted broadcast data. Details of the delay control unit 102 will be described later with reference to FIGS.

[Processing flow]
Hereinafter, with reference to FIGS. 4 and 5, the seamless switching process by synchronous reproduction between the weak hierarchical service and the strong hierarchical service of the present embodiment will be described. FIG. 4 is a flowchart of the seamless switching process of the present embodiment. FIG. 5 is a data chart for explaining a process of extracting time-difference broadcast data from accumulated stored data. The processing illustrated in FIGS. 4 and 5 is mainly executed by the delay control unit 102.

  In the flowchart illustrated in FIG. 4, for example, the information processing apparatus 10 is triggered by the fact that the reception state of the broadcast wave of the terrestrial digital broadcasting service exceeds a preset reference value (S1). Process. By the processing of S2-S8, the information processing apparatus 10 performs a seamless switching process by synchronous reproduction between the weak hierarchical service and the strong hierarchical service.

  For example, the information processing apparatus 10 provides the content of the strong hierarchy service when the reception state of the broadcast wave exceeds the reference value, and provides the content of the weak hierarchy service when it does not reach the reference value. Examples of the reception state that triggers such service switching include the radio wave intensity of a received broadcast wave, and an error rate such as BER and PER. Further, for example, the frame rate and noise of the video after decoding may be adjusted, or audio may be interrupted and noise may be adjusted. Furthermore, it may be a user's state such as a receiving position for receiving a terrestrial digital broadcasting service, a moving speed, or a switching instruction by a user's manual operation.

  For example, when the reception state is the radio wave intensity, the information processing apparatus 10 may acquire the radio wave intensity of the broadcast wave received by the receiving unit 1. For example, when the reception state is set to BER and PER, the information processing apparatus 10 may acquire the BER and PER at the time of demodulation by the extraction unit 2. Further, for example, the information processing apparatus 10 may acquire the output of the decoding unit 4b and determine whether or not the frame rate and noise of the video after decoding, audio interruption, and noise addition and subtraction.

For example, the information processing apparatus 10 starts accumulating broadcast data triggered by the service switching in S1, and starts measuring the time difference between the weak hierarchical service and the strong hierarchical service (S2). For example, the storage of the broadcast data is performed by the storage units 3a and 3b. The time difference is measured by the time difference measuring unit 101, for example. The time difference measurement between the weak hierarchy service and the strong hierarchy service has been described in the time difference measurement unit 101. The information processing apparatus 10 temporarily stores the time difference measured in the process of S2 in, for example, a predetermined area in the main storage unit 12, and proceeds to the process of S3.

  Note that, for example, accumulated broadcast data exceeding the measured time difference may be discarded when the process of S2 is completed. The storage capacity of the storage units 3a and 3b provided for storing broadcast data can be minimized. In addition, the stored data of the broadcasting service before switching after the time difference measurement may be discarded, or the newly received broadcasting service data before switching may not be stored. The power consumed for the data storage process can be suppressed.

  In the processing of S3-S8, the information processing apparatus 10 refers to, for example, stored data of the strong hierarchy service stored in the storage unit 3b, and extracts broadcast data corresponding to a time difference with the weak hierarchy service being viewed. Do. The broadcast data extraction in S3-S8 will be described with reference to the data chart illustrated in FIG. 5 as appropriate.

  In the data chart illustrated in FIG. 5, “Received One Seg Stream” is a weak hierarchical service PES, and each English character indicates a video frame included in the PES. Further, the symbol “←” between English characters indicates the transition of the video frame.

  Similarly, in FIG. 5, “received full segment stream” is a PES of a strong hierarchical service, each English character indicates a video frame included in the PES, and a symbol “←” between English characters indicates a transition of the video frame. Show. Note that “B”, “P”, and “I” attached to the lower part of each English character of “Received full segment stream” are frames between GOP (Group of Picture) frames including the video frame indicated by each English character. The frame attribute concerning prediction is shown. “I” indicates an I frame (Intra-coded Frame), “P” indicates a P frame (Predicted Frame), and “B” indicates a B frame (Bi-directional Predicted Frame). In MPEG2, the GOP is compressed / expanded in a unit of 12 frames, such as “IBBPBBPBBPBB”, where the distance between P frames is 3 frames.

  “GOP” including the frame attributes “B”, “P”, and “I” is an example of “screen group structural unit”.

In the data chart of FIG. 5, “T + 4,..., T + 1, T, T−1, T-2,..., T-11” are presentation times (PTS) designated by the broadcasting station included in the PES packet. (Presentation Time Stamp)). “T-**” indicates the current time “T
“T + **” indicates the future time after the current time “T.” In the data chart of FIG. For example, a video frame of a broadcast service displayed on the display unit 7 of the information processing apparatus 10 after the decoding process is illustrated.

  Returning to FIG. 4, in the process of S <b> 3, the information processing apparatus 10 refers to the stored data of the strong hierarchical service stored in the storage unit 3 b, for example, and broadcast data corresponding to the time difference measured in the process of S <b> 2. Identify. The information processing apparatus 10 determines a PTS time that goes back the time difference measured in the process of S2 from the PTS time corresponding to the video frame of the weak hierarchical service input to the decoding unit 3a immediately after the time difference measurement is completed. Then, the information processing apparatus 10 specifies the video frame of the strong hierarchical service that is closest to the PTS time calculated retroactively.

  The process of S3 will be described with reference to the data chart of FIG. In the data chart of FIG. 5, “Tx” is when the time difference measurement is completed. Then, the “C” frame of “received one-segment stream” corresponding to the PTS time “T” is decoded and displayed on the display unit 7. On the display unit 7 of the information processing apparatus 10, video / audio data corresponding to the decoded “C” frame is displayed as a content by one-segment viewing.

  On the other hand, in the “received full segment stream” preceding in time, the video frame corresponding to the PTS time “T” is “G”. In the process of S3, the information processing apparatus 10 obtains broadcast data corresponding to the time difference from the time series of the video frames of the “received full segment stream” that precedes in time based on the time difference information measured with the PTS time. Identify.

  In the data chart of FIG. 5, it is assumed that the PTS time “T-3” is the PTS time determined by going back the time difference. The “received full segment stream” illustrated in FIG. 5 is, for example, broadcast data of a strong hierarchical service stored in the storage unit 4b. The information processing apparatus 10 identifies the “D” frame that is the video frame closest to the PTS time “T-3” from the time series of the video frames of the “received full segment stream”.

  Returning to FIG. 4, the information processing apparatus 10 determines whether or not the frame of the strong hierarchical service identified in the process of S3 is an I frame (S4). For example, the information processing apparatus 10 determines whether the target frame is an I frame from the PES header information or the like. When the video frame of the strong hierarchical service identified in the process of S3 is an I frame (S4, Yes), the information processing apparatus 10 starts the identified video frame of the strong hierarchical service as the head and broadcasts stored thereafter. Data is input to the decoding unit 4b (S5). Broadcast data input to the decoding unit 4b is subjected to decoding processing by a decompression method corresponding to, for example, MPEG2, and is output to the display unit 7 via the renderer 5b and the switching unit 6 (S6). In addition, the timing of the notification of switching with respect to the switch part 6 can illustrate the time of time difference measurement completion, for example.

  On the other hand, when the video frame of the strong hierarchical service specified in the process of S3 is not an I frame (S4, Yes), the information processing apparatus 10 executes the process of S7-S8. The information processing apparatus 10 determines the I frame of the GOP, which is the screen group structural unit including the video frame of the strong hierarchical service specified in the process of S3. Then, the information processing apparatus 10 inputs the broadcast data stored thereafter to the decoding unit 4b with the determined I frame as the head (S7). The broadcast data input to the decoding unit 4b is subjected to predetermined decoding processing and output to the display unit via the renderer 5b and the switching unit 6. However, the information processing apparatus 10 displays the content output to the display unit 7 with the content corresponding to the video frame specified in the process of S3 as the head. The frame information between the video frame specified in the process of S3 and the I frame of the GOP including the video frame is used as information for reproducing the content corresponding to the video frame specified in the process of S3. (S8).

  The processing of S7-S8 will be described with reference to the data chart of FIG. In the example of the data chart of FIG. 5, “D” in the video frame sequence of “received full segment stream” is a frame other than the I frame. In the process of S4, the information processing apparatus 10 determines that “D” in the video frame sequence of “received full segment stream” is not an I frame (S4, No). In order to reproduce the content corresponding to the video frame “D”, the information processing apparatus 10 goes back to the top of the GOP that is the screen group structural unit to which the video frame “D” belongs, and determines the I frame that is the top frame of the GOP. . For example, the information processing apparatus 10 may determine an I frame of a GOP that is a screen group structural unit to which the video frame “D” belongs from, for example, PES header information.

Then, the information processing apparatus 10 outputs the stored data after “A” to the decoding unit 5b, for example, with “A” of the I frame of the GOP which is the calculated screen group structure unit as the head. In the example of the data chart of FIG. 5, the information processing apparatus 10 outputs broadcast data stored after the PTS time “T-6” corresponding to the video frame “A” to the decoding unit 5b (S7). However, in the information processing apparatus 10, the frame information from the video frames “A” to “C” is used to reproduce the content corresponding to the video frame “D” (S8). For this reason, the display unit 7
The content displayed on the screen is displayed from the content corresponding to the video frame “D” as shown in “Frame presented on the display unit”.

  The information processing apparatus 10 displays the content corresponding to “C” of “received one-segment stream” by the PTS time (T), and subsequently displays the content corresponding to “D” of “received full-segment stream”. Can be displayed. The video frame “C” of “Received One Seg Stream” and the video frame “D” of “Received Full Seg Stream” are time-sequential video frames belonging to the same GOP. The information processing apparatus 10 displays the “received one-segment stream” by live reproduction before the PTS time (T), and displays video frames continuous in time series by delayed reproduction (synchronous reproduction) after the PTS time (T). be able to.

  Here, the processing of S2 executed by the information processing apparatus 10 is performed by the broadcast data of the first service providing the same content and the second service whose presentation time to the viewer precedes the first service. It is an example of the step which measures the time difference in which a content is provided from broadcast data. Further, the CPU 11 or the like of the information processing apparatus 10 uses the broadcast data of the first service that provides the same content and the broadcast data of the second service whose presentation time to the viewer precedes the first service. The process of S2 is executed as an example of means for measuring the time difference at which the content is provided.

  Moreover, accumulation | storage in the broadcast data to the preservation | save part 3b performed by the process of S2 of the information processing apparatus 10 is an example of the step which accumulate | stores the broadcast data of a 2nd service. Further, the CPU 11 or the like of the information processing apparatus 10 executes the process of S2 as an example of means for accumulating broadcast data of the second service.

  Further, the process of S3 executed by the information processing apparatus 10 corresponds to the broadcast data of the first service at the time when the measurement of the time difference is completed from the stored broadcast data of the second broadcast service. It is an example of the specific step which specifies the broadcast data of 2 broadcast services. Further, the CPU 11 or the like of the information processing apparatus 10 selects the second broadcast service corresponding to the broadcast data of the first service at the time when the measurement of the time difference is completed from the stored broadcast data of the second broadcast service. As an example of the specifying means for specifying the broadcast data, the process of S3 is executed.

  Further, the processing of S5 executed by the information processing apparatus 10 extracts broadcast data stored after the broadcast data of the specified second broadcast service, and the first service at the time when the time difference measurement is completed. It is an example of the reproduction | regeneration step which reproduces | regenerates the content continued to broadcast data. Further, the CPU 11 or the like of the information processing apparatus 10 extracts broadcast data accumulated after the specified broadcast data of the second broadcast service, and continues to the broadcast data of the first service when the measurement of the time difference is completed. The process of S5 is executed as an example of a playback unit that plays back the content to be played.

  In addition, the process of S7 executed by the information processing apparatus 10 includes the broadcast data of the second broadcast service from the presentation time of the broadcast data of the first service and the measured time difference when the measurement of the time difference is completed. It is an example of the specific step which specifies the screen group structural unit in which is included. Further, the CPU 11 or the like of the information processing apparatus 10 displays a screen including the broadcast data of the second broadcast service from the presentation time of the broadcast data of the first service and the measured time difference when the measurement of the time difference is finished. As an example of specifying means for specifying the group structural unit, the process of S7 is executed.

Further, the process of S8 executed by the information processing apparatus 10 is an example of a playback step of decoding content that is decoded from the head of the specified screen group structure unit and continuing to the broadcast data of the first service. Further, the CPU 11 or the like of the information processing apparatus 10 performs the process of S8 as an example of a reproducing unit that decodes from the head of the specified screen group structure unit and reproduces the content continuing to the broadcast data of the first service.

  Further, the process of S8 executed by the information processing apparatus 10 is a reproduction step in which the content reproduced from the head of the screen group structure unit is output to the display unit from the broadcast data frame corresponding to the time point when the measurement of the time difference is completed. It is an example. Further, the CPU 11 or the like of the information processing apparatus 10 outputs the content reproduced from the top of the screen group structural unit as an example of a reproduction unit that outputs to the display unit from the broadcast data frame corresponding to the time point when the measurement of the time difference is completed. Execute the process.

  As described above, in the information processing apparatus 10 of the present embodiment, broadcast data related to time difference measurement is accumulated as saved data. Then, the information processing apparatus 10 extracts the broadcast data of the measured time difference from the accumulated stored data, starting from the broadcast data being viewed at the end of the time difference measurement. The information processing apparatus 10 extracts the time difference broadcast data from the stored data, thereby delaying the playback timing of the content of the service that precedes the time according to the service being viewed at the end of the time difference measurement. Synchronous processing can be executed. For this reason, in the information processing apparatus 10 according to the present embodiment, the reproduction synchronization can be completed at the end of the time difference measurement. Therefore, the time from the occurrence of the switching opportunity to the start of the synchronous reproduction of the content provided by the broadcasting service after the switching. Can be shortened.

  For example, if the time difference between the one segment of the weak hierarchical service and the full segment of the strong hierarchical service is 3 seconds, in the seamless switching process illustrated in FIG. 1, the time difference measurement is 3 seconds, and 3 seconds before the synchronized playback starts after the time difference measurement ends. Sometimes it took seconds. According to the information processing apparatus 10 of the present embodiment, time difference broadcast data can be accumulated, so that synchronized reproduction can be started at the time difference measurement end point. For this reason, the information processing apparatus 10 according to the present embodiment can shorten, for example, 3 seconds from the start of synchronized playback after the completion of time difference measurement. The information processing apparatus 10 according to the present embodiment can switch broadcast services in response to a change in broadcast wave reception intensity, for example, in response to the seamless switching process illustrated in FIG.

  Further, in the information processing apparatus 10 of the present embodiment, when extracting broadcast data from the stored data, the GOP that is a screen group structure unit corresponding to the video frame of the broadcast service being viewed is specified, and the GOP In this way, video frames that are continuous in time series can be extracted. For this reason, the information processing apparatus 10 according to the present embodiment can perform a reproduction process of decoding from the first frame (I frame) of the GOP that is the specified screen group structure unit. For example, when the viewing service is switched, the information processing apparatus 10 can reproduce the content being viewed even if the full-segment frame corresponding to the one-segment segment at the end of the time difference measurement is a P frame or a B frame.

  In the information processing apparatus 10 according to the present embodiment, the content decoded from the first frame (I frame) of the GOP that is the specified screen group structure unit can be output from the broadcast data corresponding to the time difference measurement end time to the display unit 7. . For this reason, in the information processing apparatus 10 of this embodiment, the content being viewed can be switched smoothly. The information processing apparatus can switch the currently viewed content to the broadcast service to be switched to without stopping the audio or story progress of the currently viewed content. The user of the information processing apparatus 10 according to the present embodiment can switch the viewing target without being aware of the time difference in the reproduction timing of the broadcast data in the service switching process.

<Computer-readable recording medium>
A program for causing a computer or other machine or device (hereinafter, a computer or the like) to realize any of the above functions can be recorded on a recording medium that can be read by the computer or the like. The function can be provided by causing a computer or the like to read and execute the program of the recording medium.

  Here, a computer-readable recording medium is a recording medium that stores information such as data and programs by electrical, magnetic, optical, mechanical, or chemical action and can be read from a computer or the like. Say. Examples of such a recording medium that can be removed from a computer or the like include a flexible disk, a magneto-optical disk, a CD-ROM, a CD-R / W, a DVD, a Blu-ray disk, a DAT, an 8 mm tape, a flash memory, and the like. There are cards. Moreover, there are a hard disk, a ROM, and the like as a recording medium fixed to a computer or the like.

<Others>
The above embodiment further includes an aspect called the following supplementary note. The components included in the following supplementary notes can be combined with the constituents included in the other supplementary notes.
(Appendix 1)
The time difference at which the content is presented is measured from the broadcast data of the first service providing the same content and the broadcast data of the second service whose presentation time to the viewer precedes the first service. Means,
Means for storing broadcast data of the second service;
A specification for identifying broadcast data of the second broadcast service corresponding to the broadcast data of the first service at the time when the measurement of the time difference is completed from the stored broadcast data of the second broadcast service Means,
Broadcast data stored after the specified broadcast data of the second broadcast service is extracted, and the content continuing to the broadcast data of the first service at the time when the measurement of the time difference is completed is played back. Means,
An information processing apparatus comprising:
(Appendix 2)
The specifying means includes a screen group structure including broadcast data of the second broadcast service from a presentation time of the broadcast data of the first service and the measured time difference when the measurement of the time difference is completed. Identify units,
The information processing apparatus according to appendix 1, wherein the reproducing unit reproduces the content that is decoded from the head of the specified screen group structure unit and continues to the broadcast data of the first service.
(Appendix 3)
The information processing apparatus according to claim 2, wherein the reproduction unit outputs the content reproduced from the head of the screen group structure unit to a display unit from a broadcast data frame corresponding to the time point when the measurement of the time difference is completed.
(Appendix 4)
On the computer,
The time difference at which the content is presented is measured from the broadcast data of the first service that provides the same content and the broadcast data of the second service whose presentation time to the viewer precedes the first service. And steps to
Storing broadcast data of the second service;
A specification for identifying broadcast data of the second broadcast service corresponding to the broadcast data of the first service at the time when the measurement of the time difference is completed from the stored broadcast data of the second broadcast service Steps,
Broadcast data stored after the specified broadcast data of the second broadcast service is extracted, and the content continuing to the broadcast data of the first service at the time when the measurement of the time difference is completed is played back. Steps,
Display control program to execute.
(Appendix 5)
The specifying step includes a screen group structure including broadcast data of the second broadcast service from the presentation time of the broadcast data of the first service and the measured time difference when the measurement of the time difference is completed. Identify units,
The display control program according to appendix 4, wherein the reproduction step reproduces the content that is decoded from the head of the specified screen group structure unit and continues to the broadcast data of the first service.
(Appendix 6)
The display control program according to appendix 5, wherein the reproduction step outputs the content reproduced from the head of the screen group structural unit to a display unit from a broadcast data frame corresponding to the time point when the measurement of the time difference is completed.
(Appendix 7)
Computer
The time difference at which the content is presented is measured from the broadcast data of the first service providing the same content and the broadcast data of the second service whose presentation time to the viewer precedes the first service. Steps,
Storing broadcast data of the second service;
A specification for identifying broadcast data of the second broadcast service corresponding to the broadcast data of the first service at the time when the measurement of the time difference is completed from the stored broadcast data of the second broadcast service Steps,
Broadcast data stored after the specified broadcast data of the second broadcast service is extracted, and the content continuing to the broadcast data of the first service at the time when the measurement of the time difference is completed is played back. Steps,
Display control method to execute.
(Appendix 8)
The specifying step includes a screen group structure including broadcast data of the second broadcast service from the presentation time of the broadcast data of the first service and the measured time difference when the measurement of the time difference is completed. Identify units,
The display control method according to appendix 7, wherein the reproduction step reproduces the content that is decoded from the head of the specified screen group structure unit and continues to the broadcast data of the first service.
(Appendix 9)
9. The display control method according to appendix 8, wherein in the reproduction step, the content reproduced from the head of the screen group structural unit is output to a display unit from a broadcast data frame corresponding to the time point when the measurement of the time difference is completed.

DESCRIPTION OF SYMBOLS 1 Reception part 2 Extraction part 3a, 3b Storage part 4a, 4b Decoding part 5a, 5b Renderer 6 Switching part 7 Display part 10 Information processing apparatus 11 CPU
12 Main storage unit 13 Auxiliary storage unit 101 Time difference measurement unit 102 Delay control unit

Claims (4)

From the same first broadcasting service broadcast data and broadcast data of the second broadcast service that is presentation time precedes to the first broadcast service viewers than providing content, time difference which the content is presented Means for measuring
Means for storing broadcast data of the second broadcast service;
Of the stored broadcast data of the second broadcast service, the broadcast data of the second broadcast service corresponding to the broadcast data frame of the first broadcast service at the time when the measurement of the time difference is completed . A identifying means for identifying the frame ;
The extracts broadcast data of the stored second broadcast service after a certain frame, to continue the broadcast data of the previous SL first broadcasting service of time when the measurement time difference has been completed, the extracted the Reproduction means for reproducing broadcast data of the second broadcast service ;
An information processing apparatus comprising: Said specifying means, the time when the measurement time difference has been completed, from said time difference the presentation time that is measured in the frame of the broadcast data of the first broadcast service, the frame of the broadcast data of the second broadcast service Identify the screen group structural units included,
The reproduction means decodes from the head of the specified screen group structure unit, and reproduces the extracted broadcast data of the second broadcast service continuously from the broadcast data of the first broadcast service. Item 4. The information processing apparatus according to Item 1. On the computer,
From the same first broadcasting service broadcast data and broadcast data of the second broadcast service that is presentation time precedes to the first broadcast service viewers than providing content, time difference which the content is presented Measuring steps,
Storing broadcast data of the second broadcast service;
Of the stored broadcast data of the second broadcast service, the broadcast data of the second broadcast service corresponding to the broadcast data frame of the first broadcast service at the time when the measurement of the time difference is completed . A specific step of identifying the frame ;
The extracts broadcast data of the stored second broadcast service after a certain frame, to continue the broadcast data of the previous SL first broadcasting service of time when the measurement time difference has been completed,
A reproduction step of reproducing the extracted broadcast data of the second broadcast service ;
Display control program to execute. Computer
From the same first broadcasting service broadcast data and broadcast data of the second broadcast service that is presentation time precedes to the first broadcast service viewers than providing content, time difference which the content is presented Measuring steps,
Storing broadcast data of the second broadcast service;
Of the stored broadcast data of the second broadcast service, the broadcast data of the second broadcast service corresponding to the broadcast data frame of the first broadcast service at the time when the measurement of the time difference is completed . A specific step of identifying the frame ;
The extracts broadcast data of the stored second broadcast service after a certain frame, to continue the broadcast data of the previous SL first broadcasting service of time when the measurement time difference has been completed, the extracted the A reproduction step of reproducing broadcast data of the second broadcast service ;
Display control method to execute.

Images