KR20110129715A - Method for searching for objects displayed on video display device, system and video display device - Google Patents

Abstract

The present invention relates to an image display apparatus capable of installing an application and a method of controlling the operation thereof. More specifically, the present invention relates to an image display apparatus capable of downloading and installing an application through a network server and an operation control method thereof. The image display device according to an embodiment of the present invention may display a broadcast content image, an application related image, and application related information installed in the image display apparatus provided through a broadcasting station through one screen. The user can download and install various applications to the image display device according to the present invention and use the image display device for various purposes.

Description

Image Display Device and Method and Operating Method for Object Displayed in Image Display Device

The present invention relates to a video display device and a method for controlling the operation thereof, and more particularly, to a video display device and an operation control method for improving the user's ease of use.

An image display device is a device having a function of displaying an image that a user can watch. The user can watch the broadcast through the image display device. The video display device displays a broadcast selected by a user on a display among broadcast signals transmitted from a broadcasting station. Currently, broadcasting is shifting from analog broadcasting to digital broadcasting worldwide.

Digital broadcasting refers to broadcasting for transmitting digital video and audio signals. Digital broadcasting is more resistant to external noise than analog broadcasting, so it has less data loss, is advantageous for error correction, has a higher resolution, and provides a clearer picture. In addition, unlike analog broadcasting, digital broadcasting is capable of bidirectional services.

The remote control device is a device that can remotely control the video display device. The remote controller transmits a signal included in a command corresponding to a user's operation to the image display apparatus. The video display device is controlled to operate according to a command included in a signal transmitted from a remote controller.

An object of the present invention is to provide an image display device, a system thereof, and an operation control method thereof, which can improve user convenience.

The present invention also provides an image display device, a system, and an operation control method thereof, by which a user can easily acquire desired information.

Another object of the present invention is to provide an image display device, a system thereof, and an operation control method capable of providing various user interfaces.

Another object of the present invention is to provide a method and system for searching an object in an image display apparatus capable of installing an application.

According to an embodiment of the present invention, an object searching method displayed by an image display device includes displaying a screen on which a type of an application or online information that can be searched according to attribute information of an object is set, on a display unit; Displaying a screen including at least one object on a display unit; Receiving a command for selecting at least one of objects included in the screen; Selecting an object corresponding to the selection command; Searching for keyword and attribute information of the selected object; Searching for information of a type corresponding to attribute information of an object set through the setting screen, from among applications or online information corresponding to the keyword; And displaying the searched application or online information on the display unit.

An object searching method displayed by an image display apparatus according to an exemplary embodiment of the present invention may include: displaying a screen on which a type of an application or online information that can be displayed according to attribute information of an object to be searched is displayed on a display unit; Displaying a screen including at least one object on a display unit; Receiving a command for selecting at least one of objects included in the screen; Selecting an object corresponding to the selection command; Searching for keyword and attribute information of the selected object; Retrieving application or online information corresponding to the keyword; And displaying, on the display unit, information of a type corresponding to attribute information of an object set through the setting screen among the searched applications or online information.

According to an embodiment of the present invention, a user of an image display device may install an application on the image display device. In addition, when the image display device displays a screen including at least one object, the user of the image display device may select an object to be searched. For example, the user of the image display device may select an object to be searched using a remote control device of the image display device.

The image display device or the brokering server connected to the image display device determines a keyword corresponding to the object selected by the user. Thereafter, the video display device or the brokering server queries the determined keyword or the like with an internet search engine or an application providing server. The internet search engine or application providing server transmits a result corresponding to the query to the video display device or the brokering server. The image display device may display a result corresponding to the query on the screen of the image display device.

Accordingly, the user may check the object related information included in the screen viewed through the image display apparatus through the image display apparatus.

1 is a view schematically showing a video display device system according to an embodiment of the present invention.
2 is a block diagram illustrating an image display device according to an embodiment of the present invention.
3 is a diagram illustrating a device capable of transmitting and receiving data with the image display device of FIG. 2.
4 is an internal block diagram of the controller of FIG. 2.
5 to 6 are diagrams illustrating various examples of a platform structure diagram of the image display device of FIG. 2.
7 is a view showing the operation of the remote control device of FIG.
FIG. 8 is an internal block diagram of the remote control device of FIG. 2.
9 and 10 are views for explaining various examples of an operation method of an image display device according to an embodiment of the present invention.
11 and 12 are views for explaining an object searching method displayed on an image display device according to an embodiment of the present invention.
13 to 19 illustrate screens displayed on an image display device according to an embodiment of the present invention.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

The suffixes "module" and "unit" for components used in the following description are merely given in consideration of ease of preparation of the present specification, and do not impart any particular meaning or role by themselves. Therefore, the "module" and "unit" may be used interchangeably.

1 to 10

On the other hand, the video display device described in this specification is an intelligent video display device that adds a computer support function to the broadcast reception function, and is faithful to the broadcast reception function, but the Internet function is added, the handwriting type input device, touch screen or It can be equipped with a more convenient interface such as a space remote control. In addition, by being connected to the Internet and a computer with the support of a wired or wireless Internet function, it is possible to perform functions such as e-mail, web browsing, banking or gaming. A standardized general-purpose OS can be used for these various functions.

That is, in the image display device described in the present invention, various applications can be freely added or deleted on the general-purpose OS kernel, and thus various user-friendly functions can be performed. For example, it may be a smart TV.

1 is a view schematically showing a video display device system according to an embodiment of the present invention.

Referring to the drawings, the video display device system according to an embodiment of the present invention, when viewed in terms of providing a content service on a broadcast sender basis, a content provider (CP) 10, a service provider (Service) It may be divided into a provider (SP) 20, a network provider (NP) 30, and a user 40.

The content provider 10 produces and provides various contents. As shown in FIG. 1, the content provider 10 includes a terrestrial broadcaster, a cable system operator or a multiple system operator, a satellite broadcaster, and an internet broadcaster. An internet broadcaster and the like can be exemplified.

In addition to the broadcast content, the content provider 10 may provide various applications. In this regard, it will be described later with reference to FIG.

The service provider 20 may provide a service package of contents provided by the content provider 10. For example, the service provider 20 of FIG. 1 may package and provide a first terrestrial broadcast, a second terrestrial broadcast, a cable MSO, satellite broadcast, various internet broadcasts, applications, and the like to a user.

Meanwhile, the service provider 20 may provide a service to the user 40 using a unicast or multicast scheme. The unicast method is a method of transmitting data 1: 1 between one sender and one receiver. For example, in the unicast method, when a receiver requests data from a server, the server may transmit data to the receiver according to the request. Multicasting is a method of transmitting data to a plurality of recipients of a specific group. For example, the server can send data to multiple pre-registered receivers at once. For such multicast registration, the Internet Group Management Protocol (IGMP) protocol may be used.

The network provider 30 may provide a network for providing a service to the user 40. The user 40 may be provided with a service by building a home network end user (HNED).

As a means for protecting the content transmitted from the video display device system, a conditional access or a content protection may be used. As one example for such a restriction reception or content protection, a scheme such as a cable card or a downloadable conditional access system (DCAS) may be used.

On the other hand, the user 40 can also provide content through the network. In this case, unlike the above, the user 40 may be a content provider, and the content provider 10 may receive content from the user 40. Accordingly, an interactive content service or a data service may be possible.

2 is a block diagram illustrating an image display device according to an embodiment of the present invention.

Referring to FIG. 2, the video display device 100 according to an embodiment of the present invention may include a broadcast receiving unit 105, an external device interface unit 135, a storage unit 140, a user input interface unit 150, The controller 170 may include a display unit 180, an audio output unit 185, and a power supply unit 190. The broadcast receiving unit 105 may include a tuner 110, a demodulator 120, and a network interface unit 130. Among them, the tuner 110 and the demodulator 120 may be provided with the network interface unit 130 selectively.

The tuner 110 selects an RF broadcast signal corresponding to a channel selected by a user or all pre-stored channels among RF (Radio Frequency) broadcast signals received through an antenna. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the tuner 110 may process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal CVBS / SIF output from the tuner 110 may be directly input to the controller 170.

In addition, the tuner 110 may receive an RF broadcast signal of a single carrier according to an Advanced Television System Committee (ATSC) scheme or an RF broadcast signal of a plurality of carriers according to a digital video broadcasting (DVB) scheme.

Meanwhile, the tuner 110 may sequentially select RF broadcast signals of all broadcast channels stored through a channel memory function among RF broadcast signals received through an antenna and convert them to intermediate frequency signals or baseband video or audio signals. have.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

For example, when the digital IF signal output from the tuner 110 is the ATSC scheme, the demodulator 120 performs an 8-VSB (8-Vestigal Side Band) demodulation. Also, the demodulation unit 120 may perform channel decoding. To this end, the demodulator 120 includes a trellis decoder, a de-interleaver, and a reed solomon decoder to perform trellis decoding, deinterleaving, Solomon decoding can be performed.

For example, when the digital IF signal output from the tuner 110 is a DVB scheme, the demodulator 120 performs COFDMA (Coded Orthogonal Frequency Division Modulation) demodulation. Also, the demodulation unit 120 may perform channel decoding. To this end, the demodulator 120 may include a convolutional decoder, a deinterleaver, a reed-soloman decoder, and the like to perform convolutional decoding, deinterleaving, and reed-soloman decoding.

The demodulator 120 may output a stream signal TS after performing demodulation and channel decoding. In this case, the stream signal may be a signal multiplexed with a video signal, an audio signal, or a data signal. For example, the stream signal may be an MPEG-2 TS (Transport Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

On the other hand, the demodulator 120 described above can be provided separately according to the ATSC system and the DVB system. That is, it can be provided as an ATSC demodulation unit and a DVB demodulation unit.

The stream signal output from the demodulator 120 may be input to the controller 170. After performing demultiplexing, image / audio signal processing, and the like, the controller 170 outputs an image to the display unit 180 and outputs an audio to the audio output unit 185.

The external device interface unit 135 may connect the external device to the image display device 100. To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 135 may be connected to an external device such as a digital versatile disk (DVD), a Blu-ray, a game device, a camera, a camcorder, a computer (laptop), or the like by wire / wireless. The external device interface unit 135 transmits an externally input image, audio or data signal to the controller 170 of the image display device 100 through a connected external device. In addition, the controller 170 may output an image, audio, or data signal processed by the controller 170 to a connected external device. To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The A / V input / output unit may use a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), and a DVI to input video and audio signals from an external device to the video display device 100. (Digital Visual Interface) terminal, HDMI (High Definition Multimedia Interface) terminal, RGB terminal, D-SUB terminal and the like.

The wireless communication unit can perform short-range wireless communication with other electronic devices. The image display device 100 may communicate with Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and Digital Living Network Alliance (DLNA). Depending on the specification, it can be networked with other electronic devices.

In addition, the external device interface unit 135 may be connected through at least one of the various set top boxes and the various terminals described above, and perform input / output operations with the set top box.

Meanwhile, the external device interface unit 135 may receive an application or a list of applications in a neighboring external device and transmit the received application or list to the controller 170 or the storage 140.

The network interface unit 130 provides an interface for connecting the video display device 100 to a wired / wireless network including an internet network. The network interface unit 130 may include an Ethernet terminal for connecting to a wired network, and for connecting to a wireless network, a WLAN (Wi-Fi) or Wibro (Wireless). Broadband, Wimax (World Interoperability for Microwave Access), High Speed Downlink Packet Access (HSDPA) communication standards, and the like may be used.

The network interface unit 130 may access a predetermined web page through a network. That is, by accessing a predetermined web page through the network, it is possible to send or receive data with the server. In addition, content or data provided by a content provider or a network operator may be received. That is, it can receive contents such as a movie, an advertisement, a game, a VOD, a broadcast signal, and related information provided from a content provider or a network provider through a network. In addition, the update information and the update file of the firmware provided by the network operator can be received. It may also transmit data to the Internet or content provider or network operator.

In addition, the network interface unit 130 may select and receive a desired application from among applications that are open to the public through the network.

The storage 140 may store a program for processing and controlling each signal in the controller 170, or may store a signal processed video, audio, or data signal.

In addition, the storage 140 may perform a function for temporarily storing an image, audio, or data signal input from the external device interface 135 or the network interface 130. In addition, the storage 140 may store information on a predetermined broadcast channel through a channel storage function.

In addition, the storage 140 may store an application or a list of applications input from the external device interface 135 or the network interface 130.

The storage unit 140 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), It may include at least one type of storage medium such as RAM, ROM (EEPROM, etc.). The video display device 100 may provide a user with a content file (video file, still image file, music file, document file, application file, etc.) stored in the storage 140.

2 illustrates an embodiment in which the storage 140 is provided separately from the controller 170, but the scope of the present invention is not limited thereto. The storage unit 140 may be included in the control unit 170.

The user input interface unit 150 transmits a signal input by the user to the control unit 170 or a signal from the control unit 170 to the user.

For example, the user input interface unit 150 may be powered on / off, channel selection, and screen from the remote controller 200 according to various communication methods such as a radio frequency (RF) communication method and an infrared (IR) communication method. The controller may receive and process a user input signal or a control signal such as a setting, or transmit a control signal from the controller 170 to the remote controller 200.

In addition, for example, the user input interface unit 150 may transmit a user input signal or a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the controller 170. have.

In addition, for example, the user input interface unit 150 may transmit a user input signal or a control signal input from a sensing unit (not shown) that senses a user's gesture to the controller 170 or from the controller 170. The signal of may be transmitted to a sensing unit (not shown). Here, the sensing unit (not shown) may include a touch sensor, an audio sensor, a position sensor, an operation sensor, and the like.

The control unit 170 demultiplexes the input stream or processes the demultiplexed signals through the tuner 110, the demodulator 120, or the external device interface unit 135, and outputs a video or audio signal. You can create and output.

The image signal processed by the controller 170 may be input to the display unit 180 and displayed as an image corresponding to the image signal. The video signal processed by the controller 170 may be input to the external output device through the external device interface 135. [

The audio signal processed by the control unit 170 may be output to the audio output unit 185 through audio. In addition, the voice signal processed by the controller 170 may be input to the external output device through the external device interface unit 135.

Although not shown in FIG. 2, the controller 170 may include a demultiplexer, an image processor, and the like. This will be described later with reference to FIG. 4.

In addition, the controller 170 may control overall operations of the image display device 100. For example, the controller 170 may control the tuner 110 to control the tuner 110 to select an RF broadcast corresponding to a channel selected by a user or a pre-stored channel.

In addition, the controller 170 may control the image display device 100 by a user command or an internal program input through the user input interface unit 150. In particular, the user may access the network to download the desired application or application list into the video display device 100.

For example, the controller 170 controls the tuner 110 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface unit 150. Then, video, audio, or data signals of the selected channel are processed. The controller 170 allows the channel information selected by the user to be output through the display unit 180 or the audio output unit 185 together with the processed image or audio signal.

As another example, the controller 170 may receive an external device image playback command received through the user input interface unit 150 from an external device, for example, a camera or a camcorder, input through the external device interface unit 135. The video signal or the audio signal may be output through the display unit 180 or the audio output unit 185.

The controller 170 may control the display 180 to display an image. For example, a broadcast image input through the tuner 110, an external input image input through the external device interface unit 135, or an image input through the network interface unit or an image stored in the storage unit 140 may be displayed on a display unit ( 180) to control the display. In this case, the image displayed on the display unit 180 may be a still image or a video, and may be a 2D image or a 3D image.

Meanwhile, when entering an application view item, the controller 170 may control to display a list of applications or applications that can be downloaded from the video display device 100 or from an external network.

The controller 170 may control to install and run an application downloaded from an external network, along with various user interfaces. In addition, by selecting a user, an image related to an executed application may be controlled to be displayed on the display unit 180.

On the other hand, although not shown in the figure, it may be further provided with a channel browsing processing unit for generating a thumbnail image corresponding to the channel signal or the external input signal. The channel browsing processor may receive a stream signal TS output from the demodulator 120 or a stream signal output from the external device interface 135, extract a video from the input stream signal, and generate a thumbnail image. Can be. The generated thumbnail image may be input as it is or encoded to the controller 170. In addition, the generated thumbnail image may be encoded in a stream form and input to the controller 170. The controller 170 may display a thumbnail list including a plurality of thumbnail images on the display unit 180 using the input thumbnail image. Meanwhile, the thumbnail images in the thumbnail list may be updated sequentially or simultaneously. Accordingly, the user can easily grasp the contents of the plurality of broadcast channels.

The display unit 180 converts an image signal, a data signal, an OSD signal processed by the controller 170, or an image signal, data signal, etc. received from the external device interface unit 135 into R, G, and B signals, respectively. Generate a drive signal.

The display unit 180 may be a PDP, an LCD, an OLED, a flexible display, a 3D display, or the like.

The display unit 180 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 185 receives a signal processed by the controller 170, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs a voice signal. The voice output unit 185 may be implemented by various types of speakers.

On the other hand, a photographing unit (not shown) for photographing the user may be further provided. The photographing unit (not shown) may be implemented by one camera, but is not limited thereto and may be implemented by a plurality of cameras. The image information photographed by the photographing unit (not shown) is input to the controller 170.

Meanwhile, in order to detect a gesture of a user, as described above, a sensing unit (not shown) including at least one of a touch sensor, a voice sensor, a position sensor, and a motion sensor may be further provided in the image display apparatus 100. have. The signal detected by the sensing unit (not shown) may be transmitted to the controller 170 through the user input interface unit 150.

The controller 170 may detect a gesture of a user by combining or combining an image captured by a photographing unit (not shown) or a detected signal from a sensing unit (not shown).

The power supply unit 190 supplies the corresponding power throughout the image display device 100. In particular, power may be supplied to the controller 170, which may be implemented in the form of a System On Chip (SOC), a display unit 180 for displaying an image, and an audio output unit 185 for audio output. Can be.

To this end, the power supply unit 190 may include a converter (not shown) for converting the AC power into DC power. Meanwhile, for example, when the display unit 180 is implemented as a liquid crystal panel having a plurality of backlight lamps, an inverter (not shown) capable of PWM operation may be further provided for driving of variable brightness or dimming. It may be.

The remote control apparatus 200 transmits the user input to the user input interface unit 150. To this end, the remote control apparatus 200 can use Bluetooth, RF (radio frequency) communication, infrared (IR) communication, UWB (Ultra Wideband), ZigBee, or the like.

In addition, the remote control apparatus 200 may receive an image, an audio or a data signal output from the user input interface unit 150, display it on the remote control apparatus 200 or output an audio or vibration.

The video display device 100 described above is a fixed type of ATSC (8-VSB) digital broadcasting, DVB-T (COFDM) digital broadcasting, ISDB-T (BST-OFDM) digital broadcasting, and the like. It may be a digital broadcast receiver capable of receiving at least one.

Meanwhile, the image display device described herein is an image display device in which the display unit 180 and the audio output unit 185 shown in FIG. 2 are excluded, and the display unit 180 and the audio output are provided through wireless communication. It may be of a wireless type, which transmits and receives data with the unit 185.

Meanwhile, a block diagram of the image display device 100 shown in FIG. 2 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specification of the image display device 100 that is actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

On the other hand, the image display device 100, unlike shown in Figure 2, does not include the tuner 110 and the demodulator 120 shown in Figure 2, the network interface unit 130 or the external device interface unit 135 ), The video content may be received and played back.

3 is a diagram illustrating a device capable of transmitting and receiving data with the image display device of FIG. 2.

Referring to the drawings, the image display device 100 according to an embodiment of the present invention may communicate with the broadcasting station 210, the network server 220, or the external device 230.

The video display device 100 may receive a broadcast signal including a video signal transmitted from the broadcast station 210. The video display device 100 may process a video signal, an audio signal, or a data signal included in a broadcast signal so as to be suitable for outputting from the video display device 100. The image display device 100 may output an image or audio based on the processed image signal.

The image display apparatus 100 may communicate with the network server 220. The network server 220 is a device capable of transmitting and receiving a signal with the image display device 100 through an arbitrary network. For example, the network server 220 may be a mobile phone terminal that may be connected to the image display device 100 through a wired or wireless base station. In addition, the network server 220 may be a device capable of providing content to the image display device 100 through an Internet network. The content provider may provide content to the video display device 100 using a network server.

The image display device 100 may communicate with the external device 230. The external device 230 is a device capable of directly transmitting and receiving a signal with the image display device 100 by wire or wirelessly. For example, the external device 230 may be a media storage device or a playback device used by a user. That is, the external device 230 may be a camera, a DVD or a Blu-ray player, a personal computer, or the like.

The broadcasting station 210, the network server 220, or the external device 230 may transmit a signal including a video signal to the video display device 100. The image display device 100 may display an image based on an image signal included in an input signal. In addition, the image display device 100 may transmit a signal transmitted from the broadcasting station 210 or the network server 220 to the image display device 100 to the external device 230. In addition, the signal transmitted from the external device 230 to the image display device 100 may be transmitted to the broadcasting station 210 or the network server 220. That is, the video display device 100 may transmit content included in a signal transmitted from the broadcasting station 210, the network server 220, and the external device 230 in addition to directly playing the content on the video display device 100.

4 is an internal block diagram of the controller of FIG. 2.

Referring to the drawings, the control unit 170 according to an embodiment of the present invention, the demultiplexer 310, the image processor 320, the OSD generator 340, the mixer 350, the frame rate converter 355 ), And a formatter 360. In addition, the apparatus may further include a voice processor (not shown) and a data processor (not shown).

The demultiplexer 310 demultiplexes an input stream. For example, when an MPEG-2 TS is input, it may be demultiplexed and separated into video, audio, and data signals, respectively. Here, the stream signal input to the demultiplexer 310 may be a stream signal output from the tuner 110, the demodulator 120, or the external device interface unit 135.

The image processor 320 may perform image processing of the demultiplexed image signal. To this end, the image processor 320 may include an image decoder 325 and a scaler 335.

The image decoder 325 decodes the demultiplexed image signal, and the scaler 335 performs scaling to output the resolution of the decoded image signal on the display unit 180.

The video decoder 325 may include decoders of various standards.

For example, when the demultiplexed video signal is an encoded video signal of MPEG-2 standard, it may be decoded by an MPEG-2 decoder.

Also, for example, when the demultiplexed video signal is a digital video broadcasting (DMB) scheme or an encoded video signal of H.264 standard according to DVB-H, it may be decoded by an H.264 decoder.

On the other hand, the video signal decoded by the image processor 320 is input to the mixer 350.

The OSD generator 340 generates an OSD signal according to a user input or itself. For example, a signal for displaying various types of information on a screen of the display unit 180 as a graphic or text may be generated based on a user input signal or a control signal. The generated OSD signal may include various data such as a user interface screen, various menu screens, widgets, and icons of the image display apparatus 100.

For example, the OSD generator 340 may generate a signal for displaying broadcast information based on subtitles or EPGs of a broadcast image.

The mixer 350 may mix the OSD signal generated by the OSD generator 340 and the decoded image signal processed by the image processor 220. The mixed signal is provided to the formatter 360. Since the decoded broadcast video signal or the external input signal and the OSD signal are mixed, the OSD can be overlaid on the broadcast image or the external input image.

The frame rate converter (FRC) 355 may convert the frame rate of the input video. For example, a 60Hz frame rate is converted to 120Hz or 240Hz. When converting a frame rate of 60 Hz to 120 Hz, it is possible to insert the same first frame or insert a third frame predicted from the first frame and the second frame between the first frame and the second frame. When converting a frame rate of 60 Hz to 240 Hz, it is possible to insert three more identical frames or three predicted frames. On the other hand, it is also possible to maintain the input frame rate without additional conversion.

The formatter 360 receives the output signal of the frame rate converter 355 and changes the format of the signal to be suitable for the display unit 180 and outputs the signal. For example, the R, G, B data signals may be output, and the R, G, B data signals may be output as low voltage differential signaling (LVDS) or mini-LVDS.

The voice processing unit (not shown) in the controller 170 may perform voice processing of the demultiplexed voice signal. To this end, the voice processing unit (not shown) may include various decoders.

The speech processing unit (not shown) in the controller 170 may decode the demultiplexed speech signal if it is an encoded speech signal. For example, the demultiplexed speech signal may be decoded by an MPEG-2 decoder, or an MPEG 4 decoder, or an AAC decoder, or an AC-3 decoder.

Also, the voice processing unit (not shown) in the controller 170 may process a base, a treble, a volume control, and the like.

The data processor (not shown) in the controller 170 may perform data processing of the demultiplexed data signal. For example, when the demultiplexed data signal is an encoded data signal, it may be decoded. The encoded data signal may be EPG (Electronic Program Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcasted in each channel. For example, the EPG information may be ATSC-PSIP (ATSC-Program and System Information Protocol) information in the case of the ATSC scheme, and may include DVB-Service Information (DVB-SI) in the case of the DVB scheme. . The ATSC-PSIP information or the DVB-SI information may be information included in the aforementioned stream, that is, the header (4 bytes) of the MPEG-2 TS.

On the other hand, a block diagram of the control unit 170 shown in Figure 4 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specification of the controller 170 that is actually implemented.

5 to 6 are diagrams illustrating various examples of a platform structure diagram of the image display device of FIG. 2.

The platform of the image display apparatus 100 according to the embodiment of the present invention may include OS-based software in order to perform the above-described various operations.

First, referring to FIG. 5, the platform of the video display device 100 according to another embodiment of the present invention is a detachable platform, and the legacy system platform 400 and the smart system platform 405 are separated. Can be designed. The OS kernel 410 may be commonly used in the legacy system platform 400 and the smart system platform 405.

The legacy system platform 400 may include a driver 420, a middleware 430, and an application layer 450 on the OS kernel 410.

The smart system platform 405 may include a library 435, a framework 440, and an application layer 455 on the OS kernel 410.

The OS kernel 410 is a core of an operating system, and when a video display device 100 is driven, a hardware driver is driven, security of hardware and a processor in the video display device 100, efficient management of system resources, and memory. At least one of management, provision of an interface to hardware by hardware abstraction, multiprocessing, and schedule management according to multiprocessing may be performed. The OS kernel 410 may further provide power management and the like.

The hardware driver in the OS kernel 410 may be, for example, at least one of a display driver, a WiFi driver, a Bluetooth driver, a USB driver, an audio driver, a power manager, a binder driver, a memory driver, and the like. It may include.

In addition, the hardware driver in the OS kernel 410 is a driver for a hardware device in the OS kernel 410, and includes a character device driver, a block device driver, and a network device driver. dirver). The block device driver may need a buffer to store as much as the unit size because data is transmitted in a specific block unit, and the character device driver may not need a buffer because it is transmitted in a basic data unit, that is, a character unit.

The OS kernel 410 may be implemented as a kernel based on various operating systems (OS) such as Unix-based (Linux) and Windows-based. In addition, the OS kernel 410 is an open OS kernel and may be general purpose that can be used in other electronic devices.

The driver 420 is located between the OS kernel 410 and the middleware 430 and, together with the middleware 430, drives the device for the operation of the application layer 450. For example, the driver 420 may include a micom, a display module, a graphics processing unit (GPU), a frame rate converter (FRC), a general purpose input / output pin (GPIO), and the like in the video display device 100. It may include a driver such as HDMI, SDEC (System Decoder or Demultiplexer), VDEC (Video Decoder), ADEC (Audio Decoder), PVR (Personal Video Recorder), or I2C (Inter-Integrated Circuit). . These drivers operate in conjunction with hardware drivers in the OS kernel 410.

In addition, the driver 420 may further include a driver for the remote control apparatus 200, particularly a spatial remote controller, which will be described later. Meanwhile, the driver of the spatial remote controller may be variously provided in the OS kernel 410 or the middleware 430 in addition to the driver 420.

The middleware 430 may be located between the OS kernel 410 and the application layer 450, and may serve as an intermediary to exchange data between different hardware or software. As a result, a standardized interface can be provided, and various environments can be supported and systems can interoperate with other tasks.

Examples of the middleware 430 in the legacy system platform 400 may include middleware of multimedia and hypermedia information coding expert groups (MHEG) and advanced common application platform (ACAP), which are data broadcasting related middleware, and PSIP, which is broadcast information related middleware. Or there may be a middleware of the SI, and DLNA middleware, which is a middleware related to the peripheral communication.

The application layer 450 on the middleware 430, that is, the application 450 layer in the legacy system platform 400, may, for example, provide a user interface application for various menus in the image display device 100. It may include. The application layer 450 on the middleware 430 may be editable by a user's selection and may be updated through a network. By using the application layer 450, it is possible to enter a desired menu among various user interfaces according to the input of the remote control apparatus 200 while watching a broadcast image.

In addition, the application layer 450 in the legacy system platform 400 may further include at least one of a TV guide application, a Bluetooth application, a reservation application, a digital video recorder (DVR) application, and a hotkey application. Can be.

On the other hand, the library 435 in the smart system platform 405 is located between the OS kernel 410 and the framework 440, and may form the basis of the framework 440. For example, the library 435 may include a security-related library, SSL (Secure Socket Layer), a web engine-related library, WebKit, libc (c library), a video format, an audio format, and the like. The media framework, which is a media related library, may be included. Such a library 435 may be written based on C or C ++. In addition, it may be exposed to the developer through the framework 440.

The library 435 may include a runtime 437 having a core java library and a virtual machine (VM). This runtime 437, together with the library 435, forms the basis of the framework 440.

The virtual machine VM may be a plurality of instances, that is, a virtual machine capable of performing multitasking. Meanwhile, each virtual machine (VM) may be allocated and executed according to each application in the application layer 455. In this case, a binder (in the OS kernel 410) may be used for scheduling or interconnection among a plurality of instances. Binder) driver (not shown) may operate.

The binder driver and the runtime 437 may connect a Java-based application to a C-based library.

The library 435 and the runtime 437 may correspond to the middleware of the legacy system.

Meanwhile, the framework 440 in the smart system platform 405 includes a program on which the application in the application layer 455 is based. The framework 440 may be compatible with any application and may reuse, move, or exchange components. The framework 440 may include a support program, a program that ties other software components, and the like. For example, the resource manager may include a resource manager, an activity manager related to an activity of an application, a notification manager, a content provider that summarizes sharing information between applications, and the like. . The framework 440 may be written based on Java (JAVA).

The application layer 455 on the framework 440 includes various programs that can be driven and displayed in the image display device 100. For example, a core application including at least one of an email, a short message service (SMS), a calendar, a map, a browser, and the like may be included. Can be. The application layer 450 may be written based on JAVA.

In addition, the application layer 455 may be an application 465 stored in the image display device 100 and not deleted by the user, and downloaded and stored through an external device or a network, and may be free to be installed or deleted by the user. 475).

Through the application in this application layer 455, by Internet connection, Internet telephony service, video on demand (VOD) service, web album service, social networking service (SNS), location based service (LBS), map service, web search Services, application search services, etc. may be performed. In addition, various functions such as a game and schedule management may be performed.

Next, referring to FIG. 6, the platform of the image display apparatus 100 according to an exemplary embodiment of the present invention is an integrated platform, including an OS kernel 510, a driver 520, and middleware ( 530, a framework 540, and an application layer 550.

The platform of FIG. 6 differs from that of the library 435 of FIG. 5 in comparison with FIG. 5, and that the application layer 550 is provided as an integrated layer. In addition, the driver 520 and the framework 540 correspond to FIG. 5.

On the other hand, the library 435 of FIG. 5 can be regarded as being merged into the middleware 530. That is, the middleware 530 is a middleware under a legacy system. The middleware of the data broadcasting related middleware, MHEG or ACAP, the broadcasting information related middleware, the PSIP or SI middleware, and the peripheral communication related middleware DLNA middleware, of course, the image display. The middleware under the device system may include a security-related library, SSL (Secure Socket Layer), a web engine-related library (WebKit), libc, a media-related library (Media Framework). On the other hand, it may further include the above-described runtime.

The application layer 550 is an application under the legacy system, and includes a menu related application, a TV guide application, a reservation application, and the like, and an application under the video display system, and may include an email, an SMS, a calendar, a map, a browser, and the like. have.

On the other hand, the application layer 550 is an application 565 stored in the image display device 100 that cannot be deleted by a user, and an application 575 downloaded and stored through an external device or a network and free to install or delete. It can also be divided into.

5 and 6 described above can be used in a variety of other electronic devices, as well as the image display device. Meanwhile, the platform of FIGS. 5 and 6 may be loaded in the storage 140 or the controller 170 or a separate processor (not shown).

7 is a view showing the operation of the remote control device of FIG.

Referring to the drawings, the remote control apparatus 200 may transmit and receive a signal with the image display device 100 according to an RF communication standard or an IR communication standard.

FIG. 7A illustrates that a pointer 205 corresponding to the remote controller 200 is displayed on the display unit 180.

The user can move or rotate the remote control device 200 up and down, left and right (Fig. 7 (b)), front and back (Fig. 7 (c)). The pointer 205 displayed on the image display device 100 corresponds to the movement of the remote control apparatus 200. The remote control apparatus 200 may be referred to as a spatial remote controller because the pointer 205 is moved and displayed according to the movement in the 3D space as shown in the figure.

FIG. 7B illustrates that when the user moves the remote control apparatus 200 to the left side, the pointer 205 displayed on the image display apparatus 100 also moves to the left side correspondingly. Information about the movement of the remote control apparatus 200 sensed by the sensor of the remote control apparatus 200 is transmitted to the image display apparatus 100. The image display device 100 may calculate the coordinates of the pointer 205 from information about the movement of the remote control apparatus 200. The image display device 100 may display the pointer 205 to correspond to the calculated coordinates.

FIG. 7C illustrates a case in which a user moves the remote control apparatus 200 away from the display unit 180 while pressing a specific button in the remote control apparatus 200. As a result, the selection area in the display unit 180 corresponding to the pointer 205 may be zoomed in to be enlarged and displayed. On the contrary, when the user moves the remote controller 200 to be closer to the display unit 180, the selection area in the display unit 180 corresponding to the pointer 205 may be zoomed out and reduced. On the other hand, when the remote control apparatus 200 moves away from the display unit 180, the selection area is zoomed out, and when the remote control apparatus 200 approaches the display unit 180, the selection area may be zoomed in.

On the other hand, while pressing a specific button in the remote control device 200 can recognize the up, down, left and right movement. That is, when the remote control apparatus 200 moves away from or approaches the display unit 180, the up, down, left, and right movements are not recognized, and only the front and back movements may be recognized. In a state where a specific button in the remote controller 200 is not pressed, only the pointer 205 moves according to the up, down, left, and right movements of the remote controller 200.

Meanwhile, the moving speed or the moving direction of the pointer 205 may correspond to the moving speed or the moving direction of the remote control apparatus 200.

The pointer in the present specification refers to an object displayed on the display unit 180 in response to the operation of the remote control apparatus 200. Thus, the pointer 205 may be an object of various shapes in addition to the arrow shape shown in the drawing. For example, the concept may include a point, a cursor, a prompt, a thick outline, and the like. In addition, the pointer 205 may be displayed corresponding to any one of the horizontal axis and the vertical axis of the display unit 180, or may be displayed corresponding to a plurality of points such as a line and a surface. Do.

FIG. 8 is an internal block diagram of the remote control device of FIG. 2.

Referring to the drawings, the remote control apparatus 200 includes a wireless communication unit 225, a user input unit 235, a sensor unit 240, an output unit 250, a power supply unit 260, a storage unit 270, The controller 280 may be included.

The wireless communication unit 225 transmits and receives a signal with the image display device 100. In the present embodiment, the remote control apparatus 200 may include an RF module 221 capable of transmitting and receiving a signal with the image display device 100 according to the RF communication standard. In addition, the remote control apparatus 200 may include an IR module 223 capable of transmitting and receiving a signal with the image display device 100 according to the IR communication standard.

In the present embodiment, the remote control apparatus 200 transmits a signal containing information on the movement of the remote control apparatus 200 to the image display apparatus 100 through the RF module 221. In addition, the remote control apparatus 200 may receive a signal transmitted from the image display apparatus 100 through the RF module 221. In addition, the remote control apparatus 200 may transmit a command regarding power on / off, channel change, volume change, etc. to the image display device 100 through the IR module 223 as necessary.

The user input unit 235 may be configured as a keypad, a button, a touch pad, or a touch screen. The user may input a command related to the image display apparatus 100 to the remote control apparatus 200 by manipulating the user input unit 235. When the user input unit 235 includes a hard key button, the user may input a command related to the image display device 100 to the remote control apparatus 200 through a push operation of the hard key button. When the user input unit 235 includes a touch screen, the user may input a command related to the image display apparatus 100 to the remote controller 200 by touching a soft key of the touch screen. In addition, the user input unit 235 may include various kinds of input means that the user can operate, such as a scroll key or a jog key, and the present embodiment does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243. The gyro sensor 241 may sense information about the movement of the remote controller 200. For example, the gyro sensor 241 may sense information about the operation of the remote control apparatus 200 based on the x, y, and z axes. The acceleration sensor 243 may sense information about a moving speed of the remote controller 200. On the other hand, the distance measuring sensor may be further provided, whereby the distance to the display unit 180 can be sensed.

The output unit 250 may output a video or audio signal corresponding to a manipulation of the user input unit 235 or a signal transmitted from the image display apparatus 100. The user may recognize whether the user input unit 235 is manipulated or whether the image display device 100 is controlled through the output unit 250.

For example, the output unit 250 may include a LED module 251 that is turned on when the user input unit 235 is manipulated or a signal is transmitted and received with the image display device 100 through the wireless communication unit 225, and a vibration module generating vibration. 253, a sound output module 255 for outputting sound, or a display module 257 for outputting an image.

The power supply unit 260 supplies power to the remote control device 200. The power supply unit 260 may reduce power waste by stopping the power supply when the remote controller 200 does not move for a predetermined time. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control apparatus 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for controlling or operating the remote control apparatus 200. If the remote control device 200 transmits and receives a signal wirelessly through the image display device 100 and the RF module 221, the remote control device 200 and the image display device 100 transmit signals through a predetermined frequency band. Send and receive The control unit 280 of the remote control device 200 stores in the storage unit 270 information on a frequency band for transmitting and receiving a signal wirelessly with the image display device 100 paired with the remote control device 200. Reference may be made.

The controller 280 controls various matters related to the control of the remote controller 200. The controller 280 transmits a signal corresponding to a predetermined key manipulation of the user input unit 235 or a signal corresponding to the movement of the remote controller 200 sensed by the sensor unit 240 through the wireless communication unit 220. 100 can be sent.

9 illustrates that the application list on the network is displayed on the display unit 180. That is, the user can directly access the corresponding content server or network server, and search for and download various applications.

FIG. 9A illustrates that various application lists 910 in the connected server are displayed on the display unit 180. The application list 910 may include an icon representing each application and brief description information about each application. On the other hand, in the video display device 100, since full browsing is possible, it is possible to enlarge and display the size of the icon or description information received from the connected server. Accordingly, the user can easily grasp the application item.

Next, FIG. 9B illustrates selecting one application item 920 of the application list 910 using the pointer 205 of the remote controller 200. Accordingly, the application can be easily downloaded.

Meanwhile, FIG. 10 illustrates that a list of applications in the image display device is displayed on the display.

First, FIG. 10 (a) illustrates that the application list 960 stored in the image display device 100 is displayed on the display unit 180 when the user enters the application list view item by the operation of the user's remote control apparatus 200. Illustrates what is shown in. In the drawing, only an icon representing each application is illustrated, but is not limited thereto. As shown in FIG. 9, brief description information about each application may be included. Accordingly, the user can easily grasp the application item.

Next, FIG. 10B illustrates selecting an application item 970 of the corresponding application list 960 using the pointer 205 of the remote controller 200. Accordingly, the application can be easily executed.

<Description of Fig. 11>

FIG. 11 is a diagram referred to for describing an object searching method displayed on an image display device according to an exemplary embodiment. The image display device 1001 according to an embodiment of the present invention may transmit and receive signals with the image pattern server 1002 and the search engine or application providing server 1003. More specifically, the image display device 1001 may transmit and receive signals to and from the image pattern server 1002 and the search engine or application providing server 1003 using wired or wireless Internet.

The image display device 1001 according to the present embodiment may display a screen including at least one object on the display unit (S1005). In the present embodiment, the object may include at least one of an icon, a widget, a menu, and a pointer which the image display device 1001 may display through the display unit. Also, in the present embodiment, the object may include an object included in a screen that the image display device 1001 can display through the display unit. For example, the image display device 1001 that is playing content may include a character or a prop on the screen. In this case, the object includes an object that is separated from other characters or props, such as a character or a prop included in the screen, and exists independently.

The user may input an object selection command included in the screen of the image display device 1001 to the image display device 1001. The video display device 1001 receives an object selection command in operation S1010. In the present embodiment, the user of the image display device 1001 may input an object selection command to the image display device 1001 by using a remote control device. For example, when the remote controller is a spatial remote controller, the image display device 1001 may display a pointer corresponding to a signal transmitted from the spatial remote controller on the screen. The signal transmitted from the spatial remote control corresponds to the movement of the spatial remote control. The user can move the spatial remote control so that the movement trajectory of the pointer includes a predetermined object. In this case, the image display device 1001 determines that an object selection command included in the movement trajectory is input to the image display device 1001.

In the present embodiment, when there are at least two objects included in the movement trajectory, the image display device 1001 may determine that an object selection command displayed at the center of the movement trajectory is input. In addition, the image display device 100 may determine that the object selection command that is most included in the movement trajectory is input.

The video display device 1001 selects a corresponding object according to the input selection command in operation S1015. In this case, the image display device 1001 may change at least one of a color, contrast, size, and border of the selected object. The user may check the selected object through the color, contrast, size, or border of the changed object.

The image display device 1001 transmits a signal including the image pattern of the selected object to the image pattern server 1002 (S1020). The image pattern server 1002 has a database that contains information about image patterns of various objects. The image pattern server 1002 may query the database for an image pattern to search for keyword or attribute information corresponding to the image pattern (S1025).

In the present embodiment, when the content is being played on the video display device 1001, the user may select the character or the object corresponding to the item of the content being played by using the pointer. In this case, the image display device 1001 transmits a signal including information on the image pattern of the character or the item to the image pattern server 1002. In addition, the image display device 1001 may transmit the information about the content currently being played to the image pattern server 1002 together with the information about the image pattern.

The information about the content that the video display device 1001 can transmit to the image pattern server 1002 may include a content title currently playing on the video display device 1001, a person appearing in the content, or a content plot. . In addition, when the content currently being played by the video display device 1001 is content transmitted from a broadcasting station, the video display device 1001 may transmit program information provided through the broadcasting station to the image pattern server 1002.

More specifically, the video display device 1001 according to an embodiment of the present invention may include content related information or EPG information (broadcast information) being played on the video display device 1001 to search for keyword or attribute information corresponding to the selected object. Details). The type of detailed information that may be referred to by the video display device 1001 may include information about a genre, title, plot, performer, producer, prop, etc. of a broadcast video currently being played on the video display device. In addition, it may include information about the genre, content name, summary information, author, editor, performer, prop, etc. of the content currently being played on the video display device.

When the image display device 1001 searches for keyword or attribute information with reference to information other than an image pattern, as in an exemplary embodiment of the present invention, the keyword or attribute information corresponding to the object selected by the user may be searched more accurately. In addition, the time required for searching for keywords or attribute information can be reduced. For example, when the user selects an object corresponding to the wine bottle displayed by the image display apparatus 1001, the image display apparatus 1001 may be included in the image pattern of the object corresponding to the wine bottle and additional information of the screen currently being played. The keyword or the attribute information may be searched for by referring to the information corresponding to the prop among the information. If the additional information includes the product name of the prop appearing on the currently playing screen, the video display device 1001 may search for keyword or attribute information corresponding to the selected object through the product name of the prop in addition to the image pattern. .

The image pattern server 1002 queries the database for information about an image pattern included in the received signal. The image pattern server 1002 searches for information corresponding to the queried image pattern among the information stored in the database. In the present embodiment, the information retrieved by the image pattern server 1002 is keyword or attribute information corresponding to the object selected by the image display device 1001. The image pattern server 1002 transmits keyword or attribute information corresponding to the selection object to the video display device 1001 (S1030).

In this embodiment, the keyword transmitted by the image pattern server 1002 to the image display device 1001 may be a thing name or a person name of the selected object. In addition, the attribute information may be information about a type of a thing when the selection object is a thing. As another example, the attribute information may be information about a person's occupation, nationality, gender, etc. when the selection object is a person.

The video display device 1001 receives a signal transmitted from the image pattern server 1002. The image display device 1001 determines keywords or attribute information to be searched based on the received signal (S1035). The video display device 1001 queries the search engine or the application providing server 1003 for keyword or attribute information (S1040).

The search engine or application providing server 1003 may transmit / receive signals with the image display device 1001 through wired or wireless Internet. A search engine is an engine that searches online information related to a keyword or attribute information queried among information provided through the Internet. The application providing server 1003 is a server in which an application that can be installed and executed in the video display device 1001 is stored. The application providing server 1003 may search for information related to an application related to the queried keyword or attribute information (S1045).

The search engine or the application providing server 1003 may transmit a signal including the searched information to the image display device 1001 (S1050). The image display device 1001 displays a search result on the display unit based on the information included in the received signal (S1055). In this embodiment, the search result displayed by the image display device 1001 may be information searched through a search engine. In addition, the search result may be application related information provided through the application providing server 1003.

<Description of Fig. 12>

12 is a flowchart referred to describe an object searching method displayed on an image display device according to an embodiment of the present invention.

The image display device 1011 according to an embodiment of the present invention displays a screen including at least one or more objects on the display unit (S1105). Upon receiving the object selection command, the image display device 1011 selects an object corresponding to the selection command, and outputs a signal including information on the image pattern of the selected object to the brokering server 1012 (S1110 and S1115). , S1120).

The brokering server 1012 transmits to the image pattern server 1013 a signal including information on an image pattern of an object selected by the image display device 1011 or information related to content being played on the image display device 1011 (see FIG. S1125). In addition, the brokering server 1012 receives signals transmitted by the image pattern server 1013 after searching for information on an object matching the image pattern (S1130 and S1135).

The brokering server 1012 determines keyword or attribute information to be searched based on the information included in the received signal, and queries the keyword or attribute information to the search engine or the application providing server 1014 (S1140 and S1145). The search engine or the application providing server 1014 searches for information corresponding to the query, and then transmits a signal including the searched information to the brokering server 1012 (S1150 and S1155).

The brokering server 1012 receives a signal transmitted from the search engine or the application providing server 1014 and includes the search results in the video display device 1011 so that the search results can be displayed on the video display device 1011. The signal is transmitted (S1160). The image display device 1011 displays the search result on the display unit based on the received signal (S1165).

In the present embodiment, the brokering server 1012 searches for keyword or attribute information of the selected object among the objects displayed on the image display device 1011. In order to retrieve keyword or attribute information of the selected object, the brokering server 1012 may display information about the image pattern of the selected object and content related information or broadcast information currently being played on the image display device 1011. To send). The image pattern server 1013 may generate keyword or attribute information corresponding to the selected object among the objects included in the screen displayed on the image display device 1011 based on the image pattern included in the signal transmitted from the brokering server 1012. Search.

More specifically, the brokering server 1012 according to an embodiment of the present invention is content-related information or EPG information (broadcast information) being played on the video display device 1011 to search for keyword or attribute information corresponding to the selected object. Details). The type of detailed information that may be referred to by the brokering server 1012 may include information about a genre, title, plot, performer, producer, prop, etc. of a broadcast image currently being played on a video display device. In addition, it may include information about the genre, content name, summary information, author, editor, performer, prop, etc. of the content currently being played on the video display device.

As in an embodiment of the present invention, when the brokering server 1012 searches for keyword or attribute information with reference to information other than an image pattern, the brokering server 1012 may search for keyword or attribute information corresponding to the object selected by the user more accurately. In addition, the time required for searching for keywords or attribute information can be reduced. For example, when the user selects an object corresponding to the wine bottle displayed by the image display device 1011, the brokering server 1012 may include the image pattern of the object corresponding to the wine bottle and the additional information of the currently playing screen. The keyword or the attribute information may be searched for by referring to the information corresponding to the prop among the information. If the additional information includes the product name of the prop appearing on the currently playing screen, the brokering server 1012 may search for keyword or attribute information corresponding to the selected object through the product name of the prop in addition to the image pattern. .

The brokering server 1012 may determine a keyword or attribute information corresponding to the object selected by the image display device 1011 based on the search result of the image pattern server 1013. The brokering server 1012 queries the searched keyword or attribute information to the search engine or the application providing server 1014. The brokering server 1012 transmits a signal including the information retrieved by the search engine or the application providing server 1014 in response to the query to the image display device 1011.

The brokering server 1012 according to the present embodiment is a device separate from the image display device 1011. The brokering server 1012 is an image display device 1011 through an image display device 1011, an external device for transmitting a video signal to the image display device 1011, or a broadcast station for transmitting a video signal to the image display device 1011. Information related to the content being played back may be determined. Therefore, even when the video display device 1011 does not have an apparatus or algorithm for determining the selected object, the video display device 1011 may search for the selected object more accurately and simply through the brokering server 1012. Can be.

<Description of FIG. 13 and FIG. 14>

FIG. 13 is a diagram referred to describe a screen displayed on an image display device according to an exemplary embodiment.

As shown in FIG. 13A, the image display device 100 according to an exemplary embodiment may display a content playback screen 1301 on a display unit. In the present embodiment, the content playback screen 1301 is a playback screen of movie content being played through the video display device 100. More specifically, the content playback screen 1301 includes at least two objects 1311 and 1312. In the present embodiment, the first and second objects 1311 and 1312 included in the content playback screen 1301 are objects representing people appearing in the content.

The user may input a command for selecting one of the first and second objects 1311 and 1312 included in the content playback screen 1301 into the image display device 100. In the present embodiment, the user may input a selection command to the image display device 100 using a remote control device of the image display device 100. The image display device 100 may display a pointer corresponding to the signal transmitted from the remote controller on the screen.

FIG. 13B is a diagram illustrating an image display apparatus 100 in which a trajectory 1313 at which a pointer is moved is displayed in response to a signal transmitted from a remote control apparatus. The user can manipulate the remote control to include the object he wants to select. In the present embodiment, the remote control device transmits a signal including the information about the user's movement to the image display device (100). The video display device 100 changes the display area of the pointer to correspond to the information included in the signal transmitted from the remote control apparatus. As the display area of the pointer changes, the image display device 100 displays the movement trajectory 1313 of the pointer on the screen. In the present embodiment, the object included in the movement trajectory 1313 is the second object 1312.

14 is a diagram illustrating an example in which the image display device 100 changes a border of a selected object. In the present embodiment, the image display device 100 may change at least one of the color, contrast, size, or border of the selected object so that the user can confirm that the object included in the movement trajectory is selected.

In addition, when the image display device 100 of the present embodiment has at least two objects included in the movement trajectory, the image display device 100 may determine that one object is selected. More specifically, the image display apparatus 100 may determine that an object displayed at the center of the movement trajectory or an object most included in the movement trajectory is selected among the objects included in the movement trajectory. The image display device 100 changes the display state of the object determined to be selected among the objects included in the movement trajectory.

As shown in FIG. 14A, an object 1402 that is the most included among the objects included in the movement trajectory 1401 is a face 1402 representing a face of a content character. Accordingly, the video display device 100 determines that the content character is selected. Also, the image display device 100 changes the border of the object 1402 representing the face of the content character to be thick. Accordingly, the user may confirm that the object 1402 representing the content character is selected.

FIG. 14B illustrates a screen displayed by the video display device when the keyword or the attribute information corresponding to the selected object 1402 is determined by the video display device or the brokering server connected to the video display device.

More specifically, as shown in FIG. 14A, when an object 1402 representing a face of a content character is selected among the objects displayed on the image display apparatus, the image display apparatus or the brokering server may be configured to display the image pattern of the selected object 1402. Search for corresponding keyword or attribute information. In the present embodiment, the selected object is a character located inside the pointer movement trajectory 1401, and the keyword is 'Chris Lee', which is the name of the character.

The video display device or the brokering server may display the keyword on the display screen as shown in FIG. 14B before querying the keyword to the search engine or the application providing server.

More specifically, the image display apparatus displays a keyword search window 1410 including a keyboard object 1411, a keyword display window 1412, and a search command input icon 1413 on the screen. The keyword display window 1412 is a window for displaying a keyword to be searched by the video display device or the brokering server. The keyboard object 1411 is an object in which a video display device or a brokering server may input a keyword to query a search engine or an application providing server. When the search command input icon 1413 is manipulated, the video display device or the brokering server may query the search engine or the application providing server for the keyword displayed on the keyword display window 1412.

The user of the image display device may check a keyword corresponding to the selected object 1402 through the keyword display window 1412. In addition, the user of the image display device may modify the keyword to be searched by the image display device or the brokering server through the keyboard object 1411 or directly input the keyword to the image display device.

15 to 17

15, 16, and 17 are diagrams for describing a screen displaying a search result in an image display apparatus according to an embodiment of the present invention.

As shown in FIG. 15A, the image display apparatus may display a setting window 1501 on which a display method of displaying a search result is set on a display screen. As described above, the image display device may display information or an application corresponding to the selected object on the display screen as a search result. The user may select the popup window setting command icon 1502 so that the search result is displayed through the popup window.

More specifically, the user may manipulate the remote controller so that the pointer 1503 corresponding to the signal transmitted by the remote controller is located at the popup window setting command icon 1502, and then input an enter command to the remote controller. . In this case, the video display device is set to display a search result through a popup window.

FIG. 15B is a diagram for explaining an example of displaying a search result through a pop-up window.

As shown in FIG. 15B, the image display device 100 may display information searched by a search engine in relation to the selected character on the content playback screen 1510. More specifically, the image display device may display the information searched by the search engine on the content playback screen 1510 through the popup window 1511.

The image display device according to an embodiment of the present invention may display a search result based on attribute information corresponding to the selected object. For example, when the search object is a person, the image display device according to an embodiment of the present invention may display a search result corresponding to the person appearing in the content in the popup window 1511 using text. In addition, when the search object is a prop, the image display device according to an embodiment of the present invention may display a popup window including an image corresponding to the search result on the content playback screen. The user may set a search result display format (eg, text, image, etc.) for each attribute information of the object in the image display device.

As another example, the image display device may divide the display screen and display the search results in one area of the divided screen. That is, as illustrated in FIG. 16A, the user may select the screen division command icon 1601 so that the search result is displayed through the divided screen.

More specifically, the user may manipulate the remote controller so that the pointer 1602 corresponding to the signal transmitted by the remote controller is located at the screen division command icon 1601, and then input an enter command to the remote controller. . In this case, the video display device is set to display the search result through the divided screen.

FIG. 16B is a diagram referred to for describing an example in which an image display device displays a search result through a divided screen. As illustrated, the video display device may divide the display screen into a content playback screen 1611 and a search result display screen 1612. The video display device displays an icon 1613 corresponding to the search result on the search result display screen 1612.

More specifically, FIG. 16B illustrates an example of displaying application-related information in a search result corresponding to the selected object. The image display device may display an icon 1613 corresponding to an application related to the selected object on the search result display screen 1612. In the present embodiment, the icon 1613 displayed on the search result display screen 1612 is an icon capable of executing a corresponding application, an icon representing a name of the corresponding application, an icon representing a function provided by the corresponding application, and a corresponding application. It may include at least one of the icons representing the information provided by the.

As another example, the image display device may display a search result on the entire area of the display screen. That is, as illustrated in FIG. 17A, the user may select the full screen display command icon 1701 so that the search result is displayed through the full screen.

More specifically, the user may manipulate the remote control device such that the pointer 1702 corresponding to the signal transmitted by the remote control device is located at the full screen display command icon 1701, and then input an enter command to the remote control device. have. In this case, the video display device is set to display the search results through the entire screen.

FIG. 17B is a diagram referred to for describing an example in which an image display apparatus displays a search result through a full screen. As shown, the image display device displays the search results in the entire area of the display screen.

In this embodiment, the search result corresponding to the selected object is reproduced on a movie in which the person selected on the content playback screen, a book related to content being played on the content playback screen, biographic information of the person selected on the content playback screen, and the content playback screen. Information regarding the place where the content being shot is captured. The image display device displays information 1712 related to a movie in which a selected person appears in a search result on a display screen.

In addition, the image display apparatus displays tabs 1711 and 1713 corresponding to the search result on the display screen. The user may select a tab corresponding to information to be checked through the display screen among the tabs 1711 and 1713. The image display device may display a search result corresponding to the tab determined as being selected among the tabs 1711 and 1713 on the display screen.

<Description of FIG. 18 and FIG. 19>

FIG. 18 is a diagram for explaining an example of setting a type of information searchable through an image display device or a brokering server according to an embodiment of the present invention.

In the present embodiment, the user of the image display device may set the type of information to be searched for each selected object. More specifically, the video display device or the brokering server may search for a keyword corresponding to the object selected by the user. Furthermore, the video display device or the brokering server may receive the attribute information (ex, person, object, building, etc.) of the selected object through the image pattern server.

The user may set the video display device or the brokering server to search for different types of information according to the attribute information of the selection object. The image display device illustrated in FIG. 18 displays a search result setting window 1801 on a display screen. The user may set the type of information searched for by attribute information of the selected object through the setting window 1801.

That is, when the selection object is a person, the user may set through the search result setting window 1801 to search for content in which the person appears, biographic information or news information of the person, and social network site information of the person. . The first area 1802 of the search result setting window 1801 indicates the type of information that can be searched if the search object is a person.

In addition, when the selection object is a thing, the user may set through the search result setting window 1801 to search for an Internet site for purchasing the thing and product information of the thing. The second area 1803 of the search result setting window 1801 indicates the type of information that can be searched if the search object is a thing.

In another embodiment, the user may set the type of information to be displayed on the display unit among the search results of the selected object. In this case, the image display device may display only information corresponding to the type of information selected by the user among the search results on the display unit.

FIG. 19 is a diagram referred to describe a screen displayed by an image display apparatus when the image display apparatus or the brokering server searches for search object related information according to the type of the search result set by the user.

As shown in FIG. 19A, an object included in the movement trajectory 1901 is the object 1902 representing the clothes worn by the content character. Accordingly, the video display device determines that the clothes worn by the content characters are selected. In addition, the video display device thickly changes the edge of the object 1902 representing the clothing worn by the content character. Accordingly, the user may confirm that an object 1902 representing a costume worn by the content character is selected.

19B illustrates an example of displaying a search result of an object corresponding to a selected object among objects included in a content screen.

As shown, the video display device displays the content playback screen 1911 and the search result display screens 1912 and 1913. In the present embodiment, the object selected by the user is an object corresponding to the thing. Accordingly, the image display device displays a screen 1912 indicating a shopping mall site where the object can be purchased, and a screen 1913 indicating internet search information about a manufacturer or material of the object.

The object retrieval method, the image display device and the system thereof displayed on the image display device according to the present invention are not limited to the configuration and method of the embodiments described as described above, but the embodiments may be modified in various ways. All or part of each of the embodiments may be configured to be selectively combined to make it possible.

On the other hand, the operating method of the image display device of the present invention can be implemented as a processor-readable code on a processor-readable recording medium provided in the image display device. The processor-readable recording medium includes all kinds of recording devices that store data that can be read by the processor. Examples of the processor-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet. . The processor-readable recording medium can also be distributed over network coupled computer systems so that the processor-readable code is stored and executed in a distributed fashion.

In addition, although the preferred embodiment of the present invention has been shown and described above, the present invention is not limited to the specific embodiments described above, but the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

Claims (20)

Displaying a screen for setting a type of an application or online information searchable according to the attribute information of the object on a display unit;
Displaying a screen including at least one object on a display unit;
Receiving a command for selecting at least one of objects included in the screen;
Selecting an object corresponding to the selection command;
Searching for keyword and attribute information of the selected object;
Searching for information of a type corresponding to attribute information of an object set through the setting screen, from among applications or online information corresponding to the keyword; And
And displaying the searched application or online information on the display unit. The method of claim 1,
The attribute information of the object includes at least one of a person, a chattel, or a real property. The method of claim 1,
When the attribute information of the object is a person, the type of information to be searched may include at least one of a film of the person, a biograph of the person, media content related to the person, and a social network site of the person. Including
When the attribute information of the object is a chattel, the type of information to be searched for includes at least one of a site from which the corresponding property can be purchased, a video related to the garden, and a description related to the garden,
When the attribute information of the object is a real property, the type of information to be searched is displayed by the image display device including at least one of a map related to the real estate, a video related to the real estate, and a description of the real estate. How to find an object. The method of claim 1,
The keyword or attribute information search step,
Querying a keyword or attribute information corresponding to the image pattern of the selected object to a server storing the keyword or attribute information corresponding to the image pattern; And
And receiving a signal including a keyword or attribute information transmitted from the image pattern server in response to the query. The method of claim 1,
The keyword or attribute information search step,
Querying keyword or attribute information corresponding to the image pattern of the selected object and content related information or EPG information being played on the video display device to a server storing the keyword or attribute information corresponding to the image pattern; And
And receiving a signal including a keyword or attribute information transmitted from the image pattern server in response to the query. The method of claim 1,
The application or online information retrieval step,
Querying an application or online information corresponding to the keyword or attribute information with an application providing server or a search engine; And
And receiving a signal including an application or online information provided by the application providing server or a search engine in response to the query. The method of claim 1,
Displaying a pointer corresponding to a signal transmitted from a remote control device of the image display device on the display unit;
In the receiving of the selection command, when the pointer is moved so that the movement trajectory of the pointer includes at least one object included in the screen, the image display device receives a selection command of an object included in the movement trajectory. How to search the displayed object. Displaying a screen for setting a type of an application or online information that can be displayed according to attribute information of an object to be searched on a display unit;
Displaying a screen including at least one object on a display unit;
Receiving a command for selecting at least one of objects included in the screen;
Selecting an object corresponding to the selection command;
Searching for keyword and attribute information of the selected object;
Retrieving application or online information corresponding to the keyword; And
And displaying, on the display unit, information of a type corresponding to attribute information of an object set through the setting screen among the searched applications or online information. The method of claim 8,
The attribute information of the object includes at least one of a person, a chattel, or a real property. The method of claim 8,
When the attribute information of the object is a person, the type of information to be displayed may include at least one of a film of the person, a biograph of the person, media content related to the person, and a social network site of the person. Including
When the attribute information of the object is a chattel, the type of information to be displayed includes at least one of a site from which the corresponding property can be purchased, a video related to the garden, and a description related to the garden,
If the attribute information of the object is a real property, the type of information to be displayed is displayed by a video display device including at least one of a map related to the real estate, a video related to the real estate, and a description of the real estate. How to find an object. The method of claim 8,
The keyword or attribute information search step,
Querying a keyword or attribute information corresponding to the image pattern of the selected object to a server storing the keyword or attribute information corresponding to the image pattern; And
And receiving a signal including a keyword or attribute information transmitted from the image pattern server in response to the query. The method of claim 8,
The keyword or attribute information search step,
Querying keyword or attribute information corresponding to the image pattern of the selected object and content related information or EPG information being played on the video display device to a server storing the keyword or attribute information corresponding to the image pattern; And
And receiving a signal including a keyword or attribute information transmitted from the image pattern server in response to the query. The method of claim 8,
The application or online information retrieval step,
Querying an application or online information corresponding to the keyword or attribute information with an application providing server or a search engine; And
And receiving a signal including an application or online information provided by the application providing server or a search engine in response to the query. The method of claim 8,
Displaying a pointer corresponding to a signal transmitted from a remote control device of the image display device on the display unit;
In the receiving of the selection command, when the pointer is moved so that the movement trajectory of the pointer includes at least one object included in the screen, the image display device receives a selection command of an object included in the movement trajectory. How to search the displayed object. Displaying a screen including at least one object on a display unit;
Receiving a command for selecting at least one of objects included in the screen;
Selecting an object corresponding to the selection command;
Searching for keyword and attribute information of the selected object;
Displaying keyword or attribute information of the searched object on the display unit;
Receiving a keyword or attribute information search command of the displayed object;
Searching for an application or online information corresponding to the received search command; And
And displaying the searched application or online information on the display unit. 16. The method of claim 15,
The keyword or attribute information display step,
A keyword display window for displaying the keyword or attribute information on the display unit, a keyboard object for editing the keyword or attribute information displayed on the keyword display window, and an icon for inputting a keyword or attribute information search command displayed on the keyword display window; An object search method displayed by an image display device, characterized by displaying a keyword search window to be displayed. 16. The method of claim 15,
Displaying a screen for setting the search result display format;
The search result display step is the object search method displayed by the image display device, characterized in that for displaying the search results in accordance with the format set on the setting screen. The method of claim 17,
The search result display format may include at least one of a format for displaying a search result through a pop-up window, a format for displaying a search result through a split screen, and a format for displaying the search result through a full screen. How to search for objects displayed by. Displaying a screen including at least one object on a display unit;
Receiving a command for selecting at least one of objects included in the screen;
Selecting an object corresponding to the selection command;
Searching for keyword and attribute information of the selected object;
Searching for information of a type corresponding to attribute information of the object among application or online information corresponding to the keyword; And
And displaying the searched application or online information on the display unit. 20. The method of claim 19,
The method may further include displaying a screen for setting a type of an application or online information searchable according to the attribute information of the object on the display unit.
The application or online information retrieval step of the object search method displayed by the video display device, characterized in that for searching the type of information set through the setting screen.

Images