KR102171449B1 - Display device for managing a plurality of time source data and method for controlling the same - Google Patents

Abstract

A display device that manages a plurality of time source data, comprising: a user interface unit receiving first time source data from a user, a broadcast service module receiving a broadcast signal, and NTP (Network Time Protocol) a communication module performing data communication with a server, a memory storing the plurality of time source data, and a controller controlling an operation of the display device, wherein the controller is a setting application connected to the user interface unit At least one time of at least one of first time source data extracted from (Setting Application), second time source data extracted from broadcast service module, and third time source data received from NTP (Network Time Protocol) server A display device is designed to extract the source data and set the application time according to a preset priority based on the extracted time source data and the type of application.

Description

A display device that manages multiple time source data and its control method {DISPLAY DEVICE FOR MANAGING A PLURALITY OF TIME SOURCE DATA AND METHOD FOR CONTROLLING THE SAME}

The present invention relates to a technology applicable to various display devices, and more particularly, when there is various time source data such as broadcast time information, network time information, manual time information, etc., when setting the time of a specific application The present invention relates to a display device for determining an algorithm for whether to use data and a control method thereof.

The display device may receive a broadcast signal through a broadcast service module including at least one tuner. In addition, the display device may receive various data input from a user through a user interface. In addition, the display device may perform data communication with an external server using various wired/wireless communication modules. Further, the display device may include volatile memory and nonvolatile memory. The display device corresponds to, for example, a mobile phone, a smart phone, a computer, a tablet PC, a notebook, a netbook, a TV (Television), and other broadcast receiving devices.

The technical problem to be achieved by an embodiment of the present invention is to determine which time source data is used to set the time when setting the time of a specific application when a plurality of time source data exist.

In addition, a technical problem to be achieved by another embodiment of the present invention is to design a method for correcting time source data received from outside by using manual offset information input from a user.

In addition, the technical problem to be achieved by another embodiment of the present invention is to set the time of a specific application using preset factory default setting time data when appropriate time source data does not exist in the system of the display device. , To increase user convenience, a solution or solution is specifically defined.

In a display device for managing a plurality of time source data according to an embodiment of the present invention, a user interface unit receiving first time source data from a user, and a broadcast service receiving a broadcast signal A module (Broadcast Service Module), a communication module for performing data communication with a Network Time Protocol (NTP) server, a memory for storing the plurality of time source data, and a controller for controlling the operation of the display device, the controller First time source data extracted from a setting application connected to the user interface unit, second time source data extracted from a broadcast service module, and a third received from a Network Time Protocol (NTP) server A display device is designed to extract at least one time source data from among the time source data and set the application time according to a preset priority based on the extracted time source data and the type of the application.

And, in the control method of a display device for managing a plurality of time source data according to an embodiment of the present invention, first time source data extracted from a setting application, second time source data extracted from a broadcast service module, NTP Extracting at least one time source data from among third time source data received from the server, and setting an application time according to a preset priority based on the extracted time source data and the type of the application. Design.

According to an embodiment of the present invention, when there are a plurality of time source data, there is a technical effect of determining which time source data to use when setting a time for a specific application.

In addition, according to another embodiment of the present invention, there is an advantage of designing a method of correcting externally received time source data using manual offset information input from a user.

In addition, when appropriate time source data does not exist in the system of the display device, a solution or solution to increase user convenience is specified by setting the time of a specific application using the preset factory default time data. It has the advantage of defining it as.

FIG. 1 is a diagram schematically illustrating a service system including a display device according to an exemplary embodiment of the present invention.
2 is a block diagram illustrating a configuration of a display device according to an embodiment of the present invention.
3 is a block diagram illustrating a display device according to another exemplary embodiment of the present invention.
4 is a block diagram illustrating a configuration of a display device according to another embodiment of the present invention.
5 is a block diagram illustrating a detailed configuration of a control unit of FIGS. 2 to 4 according to an embodiment of the present invention.
6 is a diagram illustrating an input means connected to the display device of FIGS. 2 to 4 according to an embodiment of the present invention.
7 is a diagram illustrating a Web OS architecture according to an embodiment of the present invention.
8 is a diagram illustrating an architecture of a Web OS device according to an embodiment of the present invention.
FIG. 9 is a diagram illustrating a graphic composition flow in a Web OS device according to an embodiment of the present invention.
10 is a diagram illustrating a media server according to an embodiment of the present invention, and FIG. 11 is a diagram illustrating a configuration block diagram of a media server according to an embodiment of the present invention, and FIG. 12 Is a diagram illustrating a relationship between a media server and a TV service according to an embodiment of the present invention.
13 is a detailed block diagram illustrating a configuration module of a display device according to another embodiment of the present invention.
14 is a diagram illustrating an example in which a display device manages a plurality of time source data according to an embodiment of the present invention.
FIG. 15 is a diagram for describing a method of determining a priority for setting an application time using a plurality of time source data in a display device according to an embodiment of the present invention.
16 is another diagram for describing a method of determining a priority for setting an application time using a plurality of time source data in a display device according to an embodiment of the present invention.
17 is a diagram for explaining an example of managing a time of DRM content in a display device according to an embodiment of the present invention.
18 is a flowchart illustrating an algorithm for setting an application time by using a plurality of time source data by a display device according to an embodiment of the present invention.
19 is a diagram illustrating an example of extracting broadcast time information from a broadcast signal in a display device according to an embodiment of the present invention.
20 to 21 are diagrams for explaining an example in which a user inputs time information and a manual offset through a setting application of a display device according to an embodiment of the present invention.
22 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffixes "module" and "unit" for the constituent elements used in the following description are simply given in consideration of ease of writing in the present specification, and the "module" and "unit" may be used interchangeably with each other.

Further, embodiments of the present invention will be described in detail with reference to the accompanying drawings and contents described in the accompanying drawings, but the present invention is not limited or limited by the embodiments.

The terms used in the present specification have selected general terms that are currently widely used as possible while considering functions in the present invention, but this may vary according to the intention or custom of a technician working in the art, or the emergence of new technologies. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning will be described in the description of the corresponding invention. Therefore, it should be noted that terms used in the present specification should be interpreted based on the actual meaning of the term and the entire contents of the present specification, not a simple name of the term.

Hereinafter, the term “display device” described herein refers to, for example, transmitting, receiving, processing and outputting data, content, service, application, etc. Includes all devices that perform at least one or more. The display device can be paired or connected (hereinafter referred to as'pairing') with another display device, an external server, etc. through a wired/wireless network, through which predetermined data is transmitted. Can send/receive. At this time, if necessary, the data may be appropriately converted before transmission/reception. The display device includes, for example, a standing device such as Network TV, Hybrid Broadcast Broadband TV (HBBTV), Smart TV, Internet Protocol TV (IPTV), Personal Computer (PC), etc. Wow, a mobile device or handheld device such as a personal digital assistant (PDA), a smart phone, a tablet PC, and a notebook may all be included. In the present specification, a digital TV is illustrated in FIG. 2 to be described later in order to aid understanding of the present invention and for convenience of explanation by the applicant, and in FIG. 3, a mobile device is illustrated and described as an example of a display device. In addition, the display device described in the present specification may be a configuration having only a panel, or a configuration such as a set-top box (STB), a device, a system, etc. .

Meanwhile, the “wired/wireless network” described herein collectively refers to a communication network supporting various communication standards or protocols for pairing or/and data transmission/reception between display devices or display devices and an external server. These wired/wireless networks include all communication networks to be supported now or in the future according to the standard, and can support all of one or more communication protocols therefor. Such wired/wireless networks include, for example, USB (Universal Serial Bus), CVBS (Composite Video Banking Sync), Component, S-Video (analog), DVI (Digital Visual Interface), HDMI (High Definition Multimedia Interface), Networks for wired connection such as RGB and D-SUB, communication standards or protocols therefor, Bluetooth, RFID (Radio Frequency Identification), infrared communication (IrDA, infrared Data Association), UWB (Ultra Wideband), Zigbee (ZigBee), DLNA (Digital Living Network Alliance), WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), LTE/LTE -A (Long Term Evolution (LTE)/LTE-Advanced), Wi-Fi direct (direct), such as a network for wireless connection and communication standards or protocols for the network.

In addition, in the case of simply referring to a display device in the present specification, the meaning may mean a fixed device or a mobile device depending on the context, or may be used as a meaning including both unless otherwise specified.

On the other hand, the display device is an intelligent device that supports, for example, a broadcast reception function, a computer function or support, at least one external input, etc., through the above-described wired/wireless network, e-mail, web browsing, etc. , Banking, games, applications, etc. can be supported. In addition, the display device may include an interface for supporting at least one input or control means (hereinafter referred to as'input means'), such as a handwritten input device, a touch-screen, and a spatial remote control. I can.

In addition, the display device may use a standardized general-purpose OS, but in particular, the display device described in the present specification uses a Web OS as an example. Therefore, the display device can process adding, deleting, amending, and updating various services or applications on a general-purpose OS kernel or Linux kernel. It is possible, and through it, a more user-friendly environment can be configured and provided.

Meanwhile, the above-described display device may receive and process an external input. In this case, the external input is connected to an external input device, that is, through a wired/wireless network, and transmits/receives data to be processed. And an input means or a display device. For example, the external input is HDMI (High-Definition Multimedia Interface), a game device such as a Playstation or X-Box, a smart phone, a tablet PC, and a pocket photo. Photo), etc., and display devices such as smart TVs and Blu-ray devices are all included.

In addition, the term "server" described in this specification means a display device or system that supplies data to or receives data from the above-described display device, that is, a client, and is also referred to as a processor. do. To the server, for example, a web page, a portal server providing web content or web service, an advertising server providing advertising data, Content server providing content, SNS server providing social network service (SNS), service server provided by manufacturer, paid service server providing pay service, etc. May be included.

Hereinafter, the present invention will be described in more detail with reference to the accompanying drawings.

FIG. 1 is a diagram schematically illustrating a service system including a display device according to an exemplary embodiment of the present invention.

Referring to FIG. 1, the service system includes a content provider (CP) 10, a service provider (SP) 20, a network provider (NP) 30, and a home network (HNED). End User) (Customer) (40). Here, the HNED 40 includes, for example, the client 100, that is, a display device according to the present invention.

The content provider 10 produces and provides various types of content. As shown in Fig. 1, such a content provider 10 is a terrestrial broadcaster, a cable SO (System Operator) or MSO (Multiple SO), a satellite broadcaster, various Internet broadcasters, and individuals. Content providers and the like can be exemplified. Meanwhile, the content provider 10 may produce and provide various services or applications in addition to broadcast content.

The service provider 20 provides service packetizing the content produced by the content provider 10 to the HNED 40. For example, the service provider 20 packages at least one or more of contents produced by a first terrestrial broadcast, a second terrestrial broadcast, a cable MSO, a satellite broadcast, various Internet broadcasts, applications, etc. for a service, and the HNED ( 40).

The service provider 20 provides a service to the client 100 in a uni-cast or multi-cast method. Meanwhile, the service provider 20 may transmit data to a plurality of pre-registered clients 100 at once, and for this purpose, an Internet Group Management Protocol (IGMP) protocol or the like may be used.

The content provider 10 and the service provider 20 described above may be the same entity. For example, the content produced by the content provider 10 may be packaged as a service and provided to the HNED 40 to perform the function of the service provider 20 or vice versa.

The network provider 30 provides a network network for data exchange between the content provider 10 or/and the service provider 20 and the client 100.

The client 100, as a consumer belonging to the HNED 40, receives data by establishing, for example, a home network through the network provider 30, and provides various services such as Video on Demand (VoD). You can also send/receive data related to the application or the like.

Meanwhile, the content provider 10 or/and the service provider 20 in the service system may use conditional access or content protection means to protect transmitted content. Accordingly, the client 100 may use a processing means such as a cable card (or Point of Deployment (POD)) or a downloadable CAS (DCAS) in response to the conditional reception or content protection.

In addition, the client 100 may also use a two-way service through a network network. In this case, the client 100 may rather perform the role or function of a content provider, and the service provider 20 may receive it and transmit it back to another client.

In FIG. 1, the content provider 10 or/and the service provider 20 may be a server that provides a service described later in this specification. In this case, the server may mean owning or including the network provider 30 as necessary. Even if not specifically mentioned below, services or service data include not only services or applications received from the outside, but also internal services or applications, and these services or applications include services or application data for the client 100 based on Web OS. It can mean.

2 is a block diagram illustrating a configuration of a display device according to an embodiment of the present invention.

The display device described herein below corresponds to the client 100 of FIG. 1 described above.

In an embodiment, in the display device according to the present invention, the display device 200 includes a network interface 201, a TCP/IP manager 202, and a service delivery manager. Manager 203, SI decoder 204, Demux or demultiplexer 205, Audio Decoder 206, Video Decoder 207, Display A/ V and OSD module (208), Service Control Manager (209), Service Discovery Manager (210), SI&Metadata DB (211), Metadata Manager Manager) 212, service manager 213, UI manager 214, and the like.

The network interface unit 201 is an IP packet(s) (Internet Protocol (IP) packet(s)) or IP datagram(s) (IP datagram(s)) (hereinafter, IP packet(s)) through an access network network. )) is transmitted/received. For example, the network interface unit 201 may receive a service, application, content, etc. from the service provider 20 of FIG. 1 through a network network.

The TCP/IP manager 202 transmits a packet between a source and a destination with respect to IP packets received by the display device 200 and IP packets transmitted by the display device 200. Packet Delivery). The TCP/IP manager 202 classifies the received packet(s) to correspond to an appropriate protocol, and the service delivery manager 205, the service discovery manager 210, the service control manager 209, and the metadata manager 212 ), and the like, outputs the classified packet(s).

The service delivery manager 203 is responsible for controlling received service data. For example, the service delivery manager 203 may use RTP/RTCP when controlling real-time streaming data. When transmitting the real-time streaming data using RTP, the service delivery manager 203 parses the received data packet according to RTP and transmits it to the demultiplexer 205 or is controlled by the service manager 213 It is stored in the SI & metadata database 211 according to. Then, the service delivery manager 203 feeds back the network reception information to the server providing the service using RTCP.

The demultiplexer 205 demultiplexes the received packet into audio, video, SI (System Information) data, and the like, and transmits the demultiplexed to the audio/video decoder 206/207 and the SI decoder 204, respectively.

The SI decoder 204 includes demultiplexed SI data, that is, Program Specific Information (PSI), Program and System Information Protocol (PSIP), Digital Video Broadcasting-Service Information (DVB-SI), and Digital Television Terrestrial Multimedia (DTMB/CMMB). It decodes service information such as Broadcasting/Coding Mobile Multimedia Broadcasting). Further, the SI decoder 204 may store decoded service information in the SI & metadata database 211. The stored service information may be read and used according to the configuration at the request of a user, for example.

The audio/video decoders 206/207 decode each of the demultiplexed audio data and video data. The audio data and video data decoded in this way are provided to the user through the display unit 208.

The application manager includes, for example, a UI manager 214 and a service manager 213 and may perform a control function of the display device 200. In other words, the application manager may manage the overall state of the display device 200, provide a user interface, and manage other managers.

The UI manager 214 provides a GUI (Graphic User Interface)/UI for a user using an OSD (On Screen Display), etc., and receives a key input from the user and performs a device operation according to the input. For example, when the UI manager 214 receives a key input for channel selection from a user, the UI manager 214 transmits the key input signal to the service manager 213.

The service manager 213 controls managers associated with a service, such as a service delivery manager 203, a service discovery manager 210, a service control manager 209, and a metadata manager 212.

In addition, the service manager 213 generates a channel map and controls channel selection and the like using the generated channel map according to a key input received from the UI manager 214. The service manager 213 receives service information from the SI decoder 204 and sets the audio/video PID (Packet Identifier) of the selected channel to the demultiplexer 205. The PID set in this way can be used in the demultiplexing process described above. Accordingly, the demultiplexer 205 filters audio data, video data, and SI data using the PID (PID or section filtering).

The service discovery manager 210 provides information necessary to select a service provider that provides a service. Upon receiving a signal regarding channel selection from the service manager 213, the service discovery manager 210 searches for a service using the information.

The service control manager 209 is responsible for service selection and control. For example, the service control manager 209 uses IGMP or RTSP when a user selects a live broadcasting service such as an existing broadcasting method, and selects a service such as Video on Demand (VOD). RTSP is used to select and control services. The RTSP protocol may provide a trick mode for real-time streaming. In addition, the service control manager 209 may initialize and manage a session through the IMS gateway 250 using IMS (IP Multimedia Subsystem) and SIP (Session Initiation Protocol). The protocols are an exemplary embodiment, and other protocols may be used according to implementation examples.

The metadata manager 212 manages metadata associated with a service and stores the metadata in the SI & metadata database 211.

The SI & metadata database 211 stores service information decoded by the SI decoder 204, metadata managed by the metadata manager 212, and information necessary to select a service provider provided by the service discovery manager 210 do. In addition, the SI & metadata database 211 may store set-up data for the system and the like.

The SI & metadata database 211 may be implemented using a nonvolatile memory (Non-Volatile RAM: NVRAM) or a flash memory.

Meanwhile, the IMS gateway 250 is a gateway that collects functions necessary for accessing an IMS-based IPTV service.

3 is a block diagram illustrating a display device according to another exemplary embodiment of the present invention.

While FIG. 2 described above has been described using the fixed device as an example of the display device, FIG. 3 refers to the mobile device as another example of the display device.

Referring to FIG. 3, the mobile device 300 includes a wireless communication unit 310, an audio/video (A/V) input unit 320, a user input unit 330, a sensing unit 340, an output unit 350, and A memory 360, an interface unit 370, a control unit 380, a power supply unit 390, and the like may be included.

Hereinafter, each component will be described in detail.

The wireless communication unit 310 may include one or more modules that enable wireless communication between the mobile device 300 and a wireless communication system or between the mobile device and a network in which the mobile device is located. For example, the wireless communication unit 310 may include a broadcast receiving module 311, a mobile communication module 312, a wireless Internet module 313, a short-range communication module 314, a location information module 315, and the like. .

The broadcast receiving module 311 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. Here, the broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and/or broadcast-related information, or a server that receives and transmits a previously-generated broadcast signal and/or broadcast-related information to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal in a form in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 312.

Broadcast-related information may exist in various forms, for example, in the form of an electronic program guide (EPG) or an electronic service guide (ESG).

The broadcast receiving module 311 is, for example, ATSC, DVB-T (Digital Video Broadcasting-Terrestrial), DVB-S (Satellite), MediaFLO (Media Forward Link Only), DVB-H (Handheld), ISDB-T ( Integrated Services Digital Broadcast-Terrestrial) and other digital broadcasting systems can be used to receive digital broadcasting signals. Of course, the broadcast receiving module 311 may be configured to be suitable for not only the digital broadcasting system described above, but also other broadcasting systems.

The broadcast signal and/or broadcast related information received through the broadcast receiving module 311 may be stored in the memory 360.

The mobile communication module 312 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include a voice signal, a video call signal, or various types of data according to transmission/reception of text/multimedia messages.

The wireless Internet module 313 may be built-in or external to the mobile device 300, including a module for wireless Internet access. As a wireless Internet technology, WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), and the like may be used.

The short-range communication module 314 refers to a module for short-range communication. As short range communication technology, Bluetooth, RFID (Radio Frequency Identification), infrared data association (IrDA), UWB (Ultra Wideband), ZigBee, RS-232, RS-485, etc. can be used. I can.

The location information module 315 is a module for obtaining location information of the mobile device 300, and may be a Global Position System (GPS) module as an example.

The A/V input unit 320 is for inputting an audio or/and video signal, and may include a camera 321 and a microphone 322. The camera 321 processes image frames such as still images or moving pictures obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 351.

The image frame processed by the camera 321 may be stored in the memory 360 or transmitted to the outside through the wireless communication unit 310. Two or more cameras 321 may be provided depending on the use environment.

The microphone 322 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, or the like and processes it as electrical voice data. The processed voice data may be converted into a format transmittable to a mobile communication base station through the mobile communication module 312 and outputted in the case of a call mode. Various noise removal algorithms may be implemented in the microphone 322 to remove noise generated in the process of receiving an external sound signal.

The user input unit 330 generates input data for the user to control the operation of the terminal. The user input unit 330 may be composed of a key pad, a dome switch, a touch pad (positive pressure/electrostatic), a jog wheel, a jog switch, and the like.

The sensing unit 340 may monitor the current state of the mobile device 300 such as an open/closed state of the mobile device 300, a location of the mobile device 300, whether a user is in contact, a direction of the mobile device, and acceleration/deceleration of the mobile device. It detects and generates a sensing signal for controlling the operation of the mobile device 300. For example, when the mobile device 300 is moved or tilted, the position or tilt of the mobile device may be sensed. Also, whether the power supply unit 390 supplies power or whether the interface unit 370 is coupled to an external device may be sensed. Meanwhile, the sensing unit 240 may include a proximity sensor 341 including near field communication (NFC) or the like.

The output unit 350 is for generating an output related to visual, auditory or tactile sense, and may include a display unit 351, a sound output module 352, an alarm unit 353, and a haptic module 354. have.

The display unit 351 displays (outputs) information processed by the mobile device 300. For example, when the mobile device is in a call mode, a UI or GUI related to a call is displayed. When the mobile device 300 is in a video call mode or a photographing mode, a photographed or/and received image, UI, or GUI is displayed.

The display unit 351 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display ( flexible display) and a 3D display.

Some of these displays may be configured as a transparent type or a light-transmitting type so that the outside can be seen through them. This may be referred to as a transparent display, and a representative example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 351 may also be configured as a light transmission type structure. With this structure, the user can see objects located behind the terminal body through an area occupied by the display unit 351 of the terminal body.

Two or more display units 351 may exist depending on the implementation type of the mobile device 300. For example, in the mobile device 300, a plurality of display units may be spaced apart or integrally disposed on one surface, or may be disposed on different surfaces, respectively.

When the display unit 351 and a sensor (hereinafter referred to as'touch sensor') for detecting a touch operation form a mutual layer structure (hereinafter, referred to as a'touch screen'), the display unit 351 inputs input in addition to the output device. It can also be used as a device. The touch sensor may have, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 351 or a capacitance generated at a specific portion of the display unit 351 into an electrical input signal. The touch sensor may be configured to detect not only a touched position and area, but also a pressure at the time of touch.

When there is a touch input to the touch sensor, a signal(s) corresponding thereto is transmitted to the touch controller. The touch controller processes the signal(s) and then transmits the corresponding data to the controller 380. As a result, the control unit 380 can know which region of the display unit 351 has been touched.

A proximity sensor 341 may be disposed in an inner area of the mobile device surrounded by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity using the force of an electromagnetic field or infrared rays without mechanical contact. Proximity sensors have a longer lifespan and higher utilization than contact sensors.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, an infrared proximity sensor, and the like. When the touch screen is capacitive, it is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, an action of allowing the pointer to be recognized as being positioned on the touch screen by approaching the touch screen without contacting the pointer is referred to as "proximity touch", and the touch The act of actually touching the pointer on the screen is referred to as "contact touch". A position at which a proximity touch is performed by a pointer on the touch screen means a position at which the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 352 may output audio data received from the wireless communication unit 310 or stored in the memory 360 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 352 also outputs sound signals related to functions (eg, a call signal reception sound, a message reception sound, etc.) performed by the mobile device 300. The sound output module 352 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 353 outputs a signal for notifying the occurrence of an event of the mobile device 300. Examples of events that occur in mobile devices include call signal reception, message reception, key signal input, and touch input. The alarm unit 353 may output a signal for notifying the occurrence of an event in a form other than a video signal or an audio signal, for example, by vibration. The video signal or audio signal may also be output through the display unit 351 or the audio output module 352, so that they 351 and 352 may be classified as part of the alarm unit 353.

The haptic module 354 generates various tactile effects that a user can feel. A typical example of the tactile effect generated by the haptic module 354 is vibration. The intensity and pattern of the vibration generated by the haptic module 354 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output. In addition to vibration, the haptic module 354, in addition to vibration, is a pin arrangement that moves vertically with respect to the contact skin surface, the blowing force or suction force of air through the injection or inlet, the grazing of the skin surface, contact of the electrode, and stimulation such as electrostatic force. It can generate various tactile effects, such as the effect by the effect and the effect by reproducing the feeling of cooling and warming using an endothermic or heat generating element. The haptic module 354 may not only deliver a tactile effect through direct contact, but may also be implemented so that a user can feel the tactile effect through muscle sensations such as a finger or an arm. Two or more haptic modules 354 may be provided depending on the configuration aspect of the mobile device 300.

The memory 360 may store a program for the operation of the controller 380 and may temporarily store input/output data (eg, phone book, message, still image, video, etc.). The memory 360 may store data on vibrations and sounds of various patterns output when a touch input on the touch screen is performed.

The memory 360 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory, etc.), RAM (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, It may include at least one type of storage medium among magnetic disks and optical disks. The mobile device 300 may operate in connection with a web storage that performs a storage function of the memory 360 over the Internet.

The interface unit 370 serves as a passage for all external devices connected to the mobile device 300. The interface unit 370 receives data from an external device, receives power, and transmits it to each component inside the mobile device 300, or transmits data inside the mobile device 300 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio input/output (I/O) port, A video I/O port, an earphone port, etc. may be included in the interface unit 370.

The identification module is a chip that stores various types of information for authenticating the use rights of the mobile device 300, and includes a user identification module (UIM), a subscriber identification module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module, USIM), etc. may be included. A device equipped with an identification module (hereinafter referred to as “identification device”) may be manufactured in a smart card format. Accordingly, the identification device may be connected to the terminal 200 through the port.

When the mobile device 300 is connected to an external cradle, the interface unit 370 becomes a path through which power from the cradle is supplied to the mobile device 300, or various types of input from the cradle by a user. It may be a path through which the command signal is transmitted to the mobile device. Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile device is correctly mounted on the cradle.

The controller 380 generally controls the overall operation of the mobile device 300. The control unit 380 performs related control and processing for, for example, voice calls, data communication, and video calls. The controller 380 may also include a multimedia module 381 for playing multimedia. The multimedia module 381 may be implemented in the control unit 380 or may be implemented separately from the control unit 380. The controller 380 may perform a pattern recognition process capable of recognizing handwriting input or drawing input performed on the touch-screen as characters and images, respectively.

The power supply unit 390 receives external power and internal power under the control of the control unit 380 to supply power necessary for operation of each component.

The various embodiments described herein may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of a processor, controller, micro-controllers, microprocessors, and electrical units for performing other functions, in some cases implementations described herein. Examples may be implemented by the control unit 380 itself.

According to software implementation, embodiments such as procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. Software code can be implemented with a software application written in an appropriate programming language. Here, the software code may be stored in the memory 360 and executed by the controller 380.

4 is a block diagram illustrating a configuration of a display device according to another embodiment of the present invention.

Other examples of the display device 400 include a broadcast receiving unit 405, an external device interface unit 435, a storage unit 440, a user input interface unit 450, a control unit 470, a display unit 480, and audio An output unit 485, a power supply unit 490, and a photographing unit (not shown) may be included. Here, the broadcast receiving unit 405 may include at least one tuner 410, a demodulator 420, and a network interface unit 430. However, in some cases, the broadcast reception unit 405 may include a tuner 410 and a demodulation unit 420 but may not include the network interface unit 430 and vice versa. Further, although the broadcast receiving unit 405 is not shown, a multiplexer is provided to provide a signal demodulated by the demodulation unit 420 through the tuner 410 and a signal received through the network interface unit 430. Can also be multiplexed. In addition, the broadcast receiving unit 425 is also not shown, but is provided with a demultiplexer to demultiplex the multiplexed signal or to demultiplex the demodulated signal or the signal that has passed through the network interface unit 430. I can.

The tuner 410 receives an RF broadcast signal by tuning a channel selected by a user or all previously stored channels among radio frequency (RF) broadcast signals received through an antenna. Also, the tuner 410 converts the received RF broadcast signal into an intermediate frequency (IF) signal or a baseband signal.

For example, if the received RF broadcast signal is a digital broadcast signal, it is converted to a digital IF signal (DIF), and if the received RF broadcast signal is an analog broadcast signal, it is converted to an analog baseband video or audio signal (CVBS/SIF). That is, the tuner 410 may process both digital broadcast signals or analog broadcast signals. The analog baseband video or audio signal (CVBS/SIF) output from the tuner 410 may be directly input to the control unit 470.

Further, the tuner 410 may receive an RF broadcast signal of a single carrier or multiple carriers. Meanwhile, the tuner 410 sequentially tunes and receives RF broadcast signals of all broadcast channels stored through a channel memory function among RF broadcast signals received through an antenna, and receives them, and receives them from an intermediate frequency signal or a baseband signal (DIF: Digital Intermediate). Frequency or baseband signal).

The demodulation unit 420 may receive and demodulate the digital IF signal DIF converted by the tuner 410, and may perform channel decoding or the like. To this end, the demodulation unit 420 is provided with a Trellis decoder, a de-interleaver, a Reed-Solomon decoder, or the like, or a convolution decoder, a deinterleaver and a read. -Can be equipped with a Soloman decoder.

The demodulator 420 may output a stream signal TS after demodulation and channel decoding are performed. In this case, the stream signal may be a signal in which a video signal, an audio signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 Transport Stream (TS) in which an MPEG-2 standard video signal and a Dolby AC-3 standard audio signal are multiplexed.

The stream signal output from the demodulation unit 420 may be input to the control unit 470. The controller 470 may control demultiplexing, video/audio signal processing, and the like, and control output of an image through the display unit 480 and an audio output through the audio output unit 485.

The external device interface unit 435 provides an interfacing environment between the display device 300 and various external devices. To this end, the external device interface unit 335 may include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 435 includes a digital versatile disk (DVD), a Blu-ray, a game device, a camera, a camcorder, a computer (laptop), a tablet PC, a smart phone, and a Bluetooth device. device) and external devices such as the cloud, etc. may be connected by wire or wirelessly. The external device interface unit 435 transmits a signal including data such as an image, video, and audio input through a connected external device to the control unit 470 of the display device. The controller 470 may control the processed image, video, audio, etc. to output a data signal to a connected external device. To this end, the external device interface unit 435 may further include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The A/V input/output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), so that video and audio signals from an external device can be input to the display device 400. A Digital Visual Interface (DVI) terminal, a High Definition Multimedia Interface (HDMI) terminal, an RGB terminal, a D-SUB terminal, and the like may be included.

The wireless communication unit may perform short-range wireless communication with another display device. The display device 400 is, for example, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, Digital Living Network Alliance (DLNA). It may be networked with other display devices according to a communication protocol such as.

In addition, the external device interface unit 435 may be connected through at least one of the set-top-box STB and the above-described various terminals to perform input/output operations with the set-top-box STB.

Meanwhile, the external device interface unit 435 may receive an application or an application list in an adjacent external device and transmit it to the controller 470 or the storage unit 440.

The network interface unit 430 provides an interface for connecting the display device 400 to a wired/wireless network including an Internet network. The network interface unit 430 may include, for example, an Ethernet terminal for connection to a wired network, and for connection to a wireless network, for example, WLAN (Wireless LAN) (Wi- Fi), Wireless broadband (Wibro), World Interoperability for Microwave Access (Wimax), and High Speed Downlink Packet Access (HSDPA) communication standards can be used.

The network interface unit 430 may transmit or receive data with another user or another display device through a connected network or another network linked to the connected network. Particularly, some content data stored in the display device 400 may be transmitted to another user registered in advance with the display device 400 or to a selected user or a selected display device among other display devices.

Meanwhile, the network interface unit 430 may access a predetermined web page through a connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, the server and data can be transmitted or received. In addition, content or data provided by a content provider or a network operator may be received. That is, content such as movies, advertisements, games, VODs, and broadcast signals provided from a content provider or a network provider may be received through a network, and information related thereto. In addition, it is possible to receive update information and an update file of firmware provided by a network operator. It can also transmit data to the Internet or content provider or network operator.

In addition, the network interface unit 430 may select and receive a desired application from among applications opened through a network.

The storage unit 440 may store a program for processing and controlling each signal in the control unit 470, or may store signal-processed video, audio, or data signals.

In addition, the storage unit 440 may perform a function for temporary storage of a video, audio, or data signal input from the external device interface unit 435 or the network interface unit 430. The storage unit 440 may store information on a predetermined broadcast channel through a channel memory function.

The storage unit 440 may store an application or an application list input from the external device interface unit 435 or the network interface unit 330.

In addition, the storage unit 440 may store various platforms to be described later.

The storage unit 440 includes, for example, a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (for example, SD or XD Memory, etc.), RAM, and ROM (EEPROM, etc.). The display device 400 may reproduce and provide a content file (movie file, still image file, music file, document file, application file, etc.) stored in the storage unit 440 to a user.

4 illustrates an embodiment in which the storage unit 440 is provided separately from the control unit 470, but the present invention is not limited thereto. In other words, the storage unit 440 may be included in the control unit 470.

The user input interface unit 450 transmits a signal input by a user to the controller 470 or transmits a signal from the controller 470 to the user.

For example, the user input interface unit 450 controls power on/off from the remote control device 500, channel selection, screen setting, etc. according to various communication methods such as an RF communication method and an infrared (IR) communication method. The signal may be received and processed, or a control signal of the controller 470 may be transmitted to the remote control device 500.

In addition, the user input interface unit 450 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the control unit 470.

The user input interface unit 450 transmits a control signal input from a sensing unit (not shown) that senses a user's gesture to the controller 470, or transmits a signal from the controller 470 to the sensing unit. Can be transmitted to (not shown). Here, the sensing unit (not shown) may include a touch sensor, a voice sensor, a position sensor, and a motion sensor.

The control unit 470 demultiplexes the stream input through the tuner 410, the demodulation unit 420, or the external device interface unit 435 or processes demultiplexed signals to generate a signal for video or audio output. And can be output.

The image signal processed by the controller 470 may be input to the display unit 480 and displayed as an image corresponding to the corresponding image signal. Also, the image signal processed by the controller 470 may be input to an external output device through the external device interface unit 435.

The audio signal processed by the controller 470 may be audio output to the audio output unit 485. Also, the voice signal processed by the controller 470 may be input to an external output device through the external device interface unit 435.

Although not shown in FIG. 4, the controller 470 may include a demultiplexer, an image processor, and the like.

The controller 470 may control the overall operation of the display device 400. For example, the controller 470 may control the tuner 410 to tune an RF broadcast corresponding to a channel selected by a user or a previously stored channel.

The controller 470 may control the display device 400 according to a user command or an internal program input through the user input interface 450. In particular, it is possible to access a network to download an application or an application list desired by a user into the display device 400.

For example, the control unit 470 controls the tuner 410 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface unit 450. And it processes the video, audio or data signal of the selected channel. The control unit 470 enables channel information selected by the user to be output through the display unit 480 or the audio output unit 485 together with the processed image or audio signal.

As another example, the controller 470 may be configured from an external device, for example, a camera or a camcorder, input through the external device interface unit 435 according to an external device video playback command received through the user input interface unit 450. The video signal or the audio signal can be output through the display unit 480 or the audio output unit 485.

Meanwhile, the controller 470 may control the display unit 480 to display an image. For example, a broadcast image input through the tuner 410, an external input image input through the external device interface unit 435, an image input through a network interface unit, or an image stored in the storage unit 440 , It can be controlled to be displayed on the display unit 480. In this case, the image displayed on the display unit 480 may be a still image or a moving image, and may be a 2D image or a 3D image.

Also, the control unit 470 may control to play content. The content at this time may be content stored in the display device 400, received broadcast content, or external input content input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file.

Meanwhile, the controller 470 may control to display an application or a list of applications that can be downloaded from the display device 300 or from an external network when entering the application view item.

The controller 470 may control to install and run an application downloaded from an external network in addition to various user interfaces. In addition, according to the user's selection, it is possible to control the display unit 480 to display an image related to an executed application.

Meanwhile, although not shown in the drawing, a channel browsing processing unit for generating a thumbnail image corresponding to a channel signal or an external input signal may be further provided.

The channel browsing processing unit receives the stream signal TS output from the demodulation unit 320 or the stream signal output from the external device interface unit 335 and extracts an image from the input stream signal to generate a thumbnail image. I can. The generated thumbnail image may be input to the controller 470 as it is or after being encoded. In addition, the generated thumbnail image may be encoded in a stream format and input to the controller 470. The controller 470 may display a thumbnail list including a plurality of thumbnail images on the display unit 480 by using the input thumbnail images. Meanwhile, the thumbnail images in the thumbnail list may be updated sequentially or simultaneously. Accordingly, the user can easily grasp the contents of a plurality of broadcast channels.

The display unit 480 converts an image signal, a data signal, an OSD signal processed by the control unit 470, or an image signal and a data signal received from the external device interface unit 435 into R, G, and B signals, respectively. Generate a drive signal.

The display unit 480 may be a PDP, LCD, OLED, flexible display, 3D display, or the like.

Meanwhile, the display unit 480 may be configured as a touch screen and used as an input device other than an output device.

The audio output unit 485 receives a signal processed by the control unit 470, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs it as audio. The audio output unit 485 may be implemented with various types of speakers.

Meanwhile, in order to detect a user's gesture, as described above, a sensing unit (not shown) including at least one of a touch sensor, a voice sensor, a position sensor, and a motion sensor may be further provided in the display device 400. . The signal sensed by the sensing unit (not shown) may be transmitted to the control unit 3470 through the user input interface unit 450.

Meanwhile, a photographing unit (not shown) for photographing a user may be further provided. Image information captured by the photographing unit (not shown) may be input to the control unit 470.

The controller 470 may detect a user's gesture by combining or combining an image captured from a photographing unit (not shown) or a signal detected from a sensing unit (not shown).

The power supply unit 490 supplies corresponding power throughout the display device 400.

In particular, power is supplied to the control unit 470 that can be implemented in the form of a System on Chip (SoC), the display unit 480 for image display, and the audio output unit 485 for audio output. I can.

To this end, the power supply unit 490 may include a converter (not shown) that converts AC power into DC power. On the other hand, for example, when the display unit 480 is implemented as a liquid crystal panel having a plurality of backlight lamps, an inverter capable of operating a pulse width modulation (PWM) operation for variable brightness or dimming driving (inverter) (not shown) may be further provided.

The remote control device 500 transmits a user input to the user input interface unit 450. To this end, the remote control device 500 may use Bluetooth, Radio Frequency (RF) communication, infrared (IR) communication, Ultra Wideband (UWB), ZigBee, or the like.

In addition, the remote control device 500 may receive an image, audio, or data signal output from the user input interface unit 450 and display it on the remote control device 500 or output a sound or vibration.

The above-described display device 400 may be a digital broadcast receiver capable of processing a digital broadcast signal of a fixed or mobile ATSC method or DVB method.

In addition, the display device according to the present invention may omit some of the illustrated configurations as necessary, or may further include a configuration not illustrated. Meanwhile, the display device may not have a tuner and a demodulation unit, and may receive and play content through a network interface unit or an external device interface unit, unlike the above-described method.

5 is a block diagram illustrating a detailed configuration of a control unit of FIGS. 2 to 4 according to an embodiment of the present invention.

An example of a control unit is a demultiplexer 510, an image processing unit 5520, an OSD generation unit 540, a mixer 550, a frame rate converter (FRC) 555, and A formatter 560 may be included. In addition, although not shown, the control unit may further include a voice processing unit and a data processing unit.

The demultiplexer 510 demultiplexes an input stream. For example, the demultiplexer 510 may demultiplex input MPEG-2 TS video, audio, and data signals. Here, the stream signal input to the demultiplexer 510 may be a stream signal output from a tuner or demodulator or an external device interface unit.

The image processing unit 420 performs image processing on the demultiplexed image signal. To this end, the image processing unit 420 may include an image decoder 425 and a scaler 435.

The image decoder 425 decodes the demultiplexed image signal, and the scaler 435 scales the resolution of the decoded image signal to be output from the display unit.

The video decoder 525 may support various standards. For example, the video decoder 525 functions as an MPEG-2 decoder when the video signal is encoded in the MPEG-2 standard, and the video signal is encoded in the Digital Multimedia Broadcasting (DMB) method or the H.264 standard. In this case, it may perform the function of an H.264 decoder.

Meanwhile, the image signal decoded by the image processing unit 520 is input to the mixer 450.

The OSD generator 540 generates OSD data by itself or according to a user input. For example, the OSD generation unit 440 generates data for displaying various types of data on the screen of the display unit 380 in the form of a graphic or text based on a control signal of the user input interface unit. The generated OSD data includes various data such as a user interface screen of a display device, various menu screens, widgets, icons, and viewing rate information. The OSD generator 540 may also generate data for displaying a caption of a broadcast image or broadcast information based on EPG.

The mixer 550 mixes the OSD data generated by the OSD generation unit 540 with the image signal processed by the image processing unit and provides the mixture to the formatter 560. As the decoded video signal and OSD data are mixed, the OSD is displayed as an overlay on a broadcast video or an external input video.

The frame rate converter (FRC) 555 converts a frame rate of an input video. For example, the frame rate converter 555 may convert the frame rate of an input 60 Hz image to have a frame rate of, for example, 120 Hz or 240 Hz according to an output frequency of the display unit. As described above, there may be various methods for converting the frame rate. For example, when converting the frame rate from 60Hz to 120Hz, the frame rate converter 555 inserts the same first frame between the first frame and the second frame, or the first frame predicted from the first frame and the second frame. It can be converted by inserting 3 frames. As another example, when converting the frame rate from 60Hz to 240Hz, the frame rate converter 555 may convert by inserting three more identical frames or predicted frames between existing frames. Meanwhile, when separate frame conversion is not performed, the frame rate conversion unit 555 may be bypassed.

The formatter 560 changes the output of the input frame rate conversion unit 555 according to the output format of the display unit. For example, the formatter 560 may output R, G, B data signals, and these R, G, B data signals are output as a low voltage differential signal (LVDS) or mini-LVDS. Can be. In addition, when the output of the input frame rate converter 555 is a 3D image signal, the formatter 560 may support 3D service through the display unit by configuring and outputting in a 3D format suitable for an output format of the display unit.

Meanwhile, the voice processing unit (not shown) in the control unit may perform voice processing of the demultiplexed voice signal. Such a voice processing unit (not shown) may support processing various audio formats. For example, even when a voice signal is encoded in a format such as MPEG-2, MPEG-4, AAC, HE-AAC, AC-3, BSAC, a decoder corresponding thereto may be provided and processed.

In addition, a voice processing unit (not shown) in the control unit may process a base, a treble, and a volume control.

A data processing unit (not shown) in the control unit may perform data processing on the demultiplexed data signal. For example, the data processing unit may decode the demultiplexed data signal even when it is encoded. Here, the encoded data signal may be EPG information including broadcast information such as a start time and an end time of a broadcast program broadcast on each channel.

Meanwhile, the above-described display device is an example according to the present invention, and each component may be integrated, added, or omitted according to specifications of a display device that is actually implemented. That is, if necessary, two or more components may be combined into one component or one component may be subdivided into two or more components. In addition, functions performed by each block are for explaining an embodiment of the present invention, and specific operations or devices thereof do not limit the scope of the present invention.

Meanwhile, the display device may be an image signal processing device that performs signal processing of an image stored in the device or an input image. Other examples of video signal processing devices include a set-top box (STB) excluding the display unit 480 and the audio output unit 485 shown in FIG. 4, the above-described DVD player, Blu-ray player, game device, and computer. And the like may be further illustrated.

6 is a diagram illustrating an input means connected to the display device of FIGS. 2 to 4 according to an embodiment of the present invention.

A front panel (not shown) or control means (input means) provided on the display device 600 is used to control the display device 600.

On the other hand, the control means is a user interface device (UID) capable of wired and wireless communication, and is mainly implemented for the control purpose of the display device 600, a remote control 610, a keyboard 630, a pointing device 620, A touch-pad or the like is included, but a control means exclusively for external input connected to the display device 600 may also be included. In addition, a mobile device such as a smart phone or a tablet PC that controls the display device 600 through mode switching, etc., which is not for the purpose of controlling the display device 600 is also included in the control means. However, in this specification, for convenience, a pointing device is described as an example, but the present disclosure is not limited thereto.

Input means are communication protocols such as Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, Digital Living Network Alliance (DLNA), RS, etc. By employing at least one or more as necessary, it is possible to communicate with the display device.

The remote control 610 refers to a conventional input means provided with various key buttons necessary for controlling the display device 600.

The pointing device 620 implements a pointer corresponding to the screen of the display device 600 based on the user's movement, pressure, rotation, etc. by mounting a gyro sensor, etc. ) To transmit a predetermined control command. The pointing device 620 may be named by various names such as a magic remote control and a magic controller.

The keyboard 630 is an intelligent integrated display device that goes beyond the conventional broadcasting only, and provides various services such as web browsers, applications, and SNS (Social Network Service), so that only the conventional remote control 610 can be used to control the keyboard 630. It was not easy, and it was implemented to improve the convenience of inputting text, etc. by implementing it similar to the keyboard of a PC.

On the other hand, the control means such as the remote control 610, the pointing device 620, and the keyboard 630 are provided with a touch pad as necessary to provide more convenient and various control purposes such as text input, pointer movement, and enlargement/reduction of photos or videos. Can be used for

The display device described in this specification uses a Web OS as an OS and/or a platform. Hereinafter, processes such as Web OS-based configuration or algorithm may be performed by the control unit of the display device described above. Here, the control unit is used in a broad sense including the control unit in FIGS. 2 to 5 described above. Therefore, in the following, for processing of services, applications, and contents based on or related to the Web OS in the display device, hardware or components including related software and firmware are used as a controller. Name and explain.

Such a Web OS-based platform is for enhancing development independence and functional scalability by integrating services and applications based on, for example, Luna-service Bus, and application development based on Web application framework. It can also increase productivity. In addition, it is possible to support multi-tasking by efficiently utilizing system resources through Web OS process and resource management.

Meanwhile, the Web OS can be used not only in fixed devices such as PCs, TVs, and set-top boxes (STBs), but also mobile devices such as mobile phones, smart phones, tablet PCs, and notebook computers.

The structure of software for display devices is a single process and a closed product based on multi-threading technology with a monolithic structure that is dependent on the conventional problem solving and market. ), there was a difficulty in external application, and after that, we aimed to develop a global platform-based development, and pursue cost innovation through chip-set replacement and efficiency of UI application and external application development, and layering and componentization. & componentization) to have a 3-layered structure, add-on, single source product, and add-on structure for open application. In recent years, the software structure has been further improved by providing a modular architecture of functional units, a Web Open API (Application Programming Interface) for an eco-system, and a game engine. Modular design for a native open API, etc. is being made, and accordingly, it is created in a multi-process structure based on a service structure.

7 is a diagram illustrating a Web OS architecture according to an embodiment of the present invention.

Referring to FIG. 7, the architecture of the Web OS platform will be described as follows.

The platform can be broadly classified into a kernel, a system library-based Web OS core platform, an application, and a service.

The architecture of the Web OS platform is a layered structure, with OS at the bottom layer, system libraries at the next layer, and services at the top.

First, the lowest layer may include a Linux kernel as an OS layer, and may include Linux as an OS of the display device.

Above the OS layer, a Board Support Package (BSP)/Hardware Abstraction Layer (HAL) layer, a Web OS core modules layer, a service layer, and a Luna-Service bus layer Bus layer), Enyo framework/NDK (Native Developer's Kit)/QT layer (Enyo framework/NDK/QT layer), and an application layer in the uppermost layer in sequence.

Meanwhile, some of the layers in the Web OS layer structure described above may be omitted, a plurality of layers may be formed as one layer, or conversely, one layer may have a plurality of layer structures.

The Web OS core module layer is based on LSM (Luna Surface Manager) that manages surface windows, SAM (System & Application Manager) that manages application execution and execution status, and WebKit. Thus, it may include a Web Application Manager (WAM) that manages web applications.

The LSM manages an application window displayed on the screen. The LSM manages the display hardware (Display HW), provides a buffer that can render content necessary for applications, and synthesizes the results of multiple applications on the screen. Can be printed.

The SAM manages execution policies for various conditions of the system and application.

On the other hand, WAM recommends application development based on the Enyo Framework, since web OS can see a web application as a basic application.

The application's service use is performed through the Luna-service bus, and a service can be newly registered on the bus, and the application can find and use the service it needs.

The service layer may include services of various service levels such as TV service and Web OS service. Meanwhile, the Web OS service may include a media server, Node.JS, and the like. Here, the Node.JS service supports, for example, javascript.

Web OS service is a Linux process that implements function logic and can communicate over a bus. This can be largely divided into four parts, and is developed as a service that is migrated to the Web OS from the TV process and the existing NetCast, or is a manufacturer differentiated service, and is developed as a Web OS common service and JavaScript, and Node.js It consists of a Node.js service used through.

The application layer may include all applications supported by a display device, such as a TV application, a showcase application, a native application, and a web application.

Applications on the Web OS may be classified into a Web Application, a Palm Development Kit (PDK) application, and a Qt Markup Language (QML) application according to an implementation method.

The web application is based on a WebKit engine and is executed on a WAM runtime. These web applications can be developed and executed based on the Enyo framework, or based on general HTML5, CSS, and JavaScript.

The PDK application includes a native application developed in C/C++ based on a PDK provided for a third-party or external developer. The PDK refers to a set of development libraries and tools provided so that third parties such as games can develop native applications (C/C++). For example, the PDK application can be used in the development of an application whose performance is important.

The QML application is a Qt-based native application, and includes basic applications provided with the Web OS platform, such as a card view, a home dashboard, and a virtual keyboard. Here, QML can improve development productivity because applications can be developed in a script-type mark-up language instead of C++.

Meanwhile, in the above, the meaning of “Native” refers to an application developed in C/C++, compiled, and executed in a binary form, and such a native application has the advantage of having a high execution speed.

8 is a diagram illustrating an architecture of a Web OS device according to an embodiment of the present invention.

FIG. 8 is a block diagram based on a runtime of a Web OS device, which can be understood with reference to the layered structure of FIG. 7.

Hereinafter, description with reference to FIGS. 7 and 8 is as follows.

Referring to FIG. 8, services, applications, and Web OS core modules are included on a system OS (Linux) and system libraries, and communication between them may be performed through a Luna-service bus.

Node.js services based on HTML5, CSS, and java script, such as e-mail, contact, and calendar, logging, backup, and file notifications Web OS services such as notify), database (DB), activity manager, system policy, audio daemon (AudioD: Audio Daemon), update, media server, EPG TV services such as (Electronic Program Guide), PVR (Personal Video Recorder), and data broadcasting, voice recognition, Now on, Notification, and search , Auto Content Recognition (ACR), Contents List Broswer (CBOX), wfdd, DMR, Remote Application, download, CP services such as SDPIF(), PDK applications, browsers, QML applications, etc. Native applications, UI-related TV applications and Web applications based on the Enyo framework are processed through the aforementioned Web OS core modules such as SAM, WAM, and LSM through the Luna-service bus. Meanwhile, in the above, TV applications and Web applications may not necessarily be based on the Enyo framework or related to UI.

CBOX and connectivity can manage content lists and metadata of external devices such as USB, DLNA, and cloud connected to the TV. Meanwhile, the CBOX may output content listings of various content containers such as USB, DMS, DVR, cloud, etc. as an integrated view. In addition, CBOX can display various types of content listings such as pictures, music, and videos, and manage metadata information thereof. In addition, the CBOX can output the contents of the attached storage device in real-time. For example, when a storage device such as USB is plugged in, the CBOX must be able to immediately output a list of contents of the storage device. In this case, a standardized method for processing the content listing may be defined. In addition, CBOX can accommodate various connection protocols.

The SAM is intended to improve module complexity and improve scalability. For example, the existing system manager handles various functions such as system UI, window management, web application runtime, and constraints processing on UX in one process. Implementation complexity is reduced by clarifying the interface between them.

LSM supports independent development and integration of system UX implementations such as card view and launcher, and supports easy response to changes in product requirements. On the other hand, LSM enables multi-tasking by maximizing hardware resources (HW resources) when synthesizing multiple application screens, and can provide a window management mechanism for multi-windows and 21:9. have.

LSM supports default implementation of system UI based on QML, and improves system UI development productivity. QML UX is based on MVC, and it is possible to easily compose a view of a screen layout and UI components, and to easily develop a code for handling user input. Meanwhile, the interface between the QML and the Web OS component is made through the QML extension plug-in, and the graphic operation of the application may be based on the wayland protocol and the luna-service call.

As described above, LSM is an abbreviation of Luna Surface Manager and functions as an application window compositor.

LSM combines independently developed applications and UI components on the screen and displays them. Relatedly, when components such as a Recents application, a showcase application, and a launcher application each render their own content, the LSM defines an output area and an interworking method as a compositor. In other words, the compositor LSM handles graphic synthesis, focus management, and input events. At this time, the LSM receives events, focus, and the like from the input manager. The input manager may include an IR remote controller, a magic remote controller, an HID such as a mouse & keyboard, a joystick, a game pad, an application remote, and a pen touch.

In this way, LSM supports multiple window models, and it can be executed simultaneously in all applications due to the nature of the system UI. Regarding, LSM can support launcher, recents, setting, notification, system keyboard, volume UI, search, finger gesture, voice recognition (STT, NLP), pattern gesture (camera, MRCU), live menu, ACR, etc. have.

FIG. 9 is a diagram illustrating a graphic composition flow in a Web OS device according to an embodiment of the present invention.

Referring to FIG. 9, graphic composition processing is performed through a Web application manager 910 in charge of a UI process, a Webkit 920 in charge of a web process, an LSM 930, and a graphic manager 940. I can.

When web application-based graphic data (or application) is generated as a UI process in the web application manager 910, the generated graphic data is transmitted to the LSM 940 if it is not a full-screen application. On the other hand, the web application manager 910 receives the application generated by the Webkit 920 to share GPU memory for graphic management between the UI process and the web process, and if it is not a full-screen application as described above, the LSM Pass it to 930. In the case of a full-screen application above, the LSM 930 may be bypassed, and in this case, it may be directly transmitted to the graphic manager 940.

The LSM 930 transmits the received UI application to the Wayland Compositor via the Wayland surface, processes it properly in the Wayland compositor, and delivers it to the graphic manager. In this way, the graphic data transmitted from the LSM 930 is transmitted to the graphic manager compositor through the LSM GM surface of the graphic manager 940, for example.

Meanwhile, as described above, the full-screen application is directly transferred to the graphic manager 940 without passing through the LSM 930, and such an application is processed in the graphic manager compositor through the WAM GM surface.

The graphic manager processes all graphic data in the Web OS device, and receives all graphic data that has passed through the GM surface such as data broadcasting applications and caption applications as well as the data through the LSM GM surface and the data through the WAM GM surface. Process to be properly output on the image. Here, the function of the GM compositor is the same or similar to the above-described compositor.

10 is a diagram illustrating a media server according to an embodiment of the present invention, and FIG. 11 is a diagram illustrating a configuration block diagram of a media server according to an embodiment of the present invention, and FIG. 12 Is a diagram illustrating a relationship between a media server and a TV service according to an embodiment of the present invention.

The media server supports the execution of various multimedia in the display device and manages necessary resources. In relation to this, the media server can efficiently use hardware resources required for media play. For example, the media server requires audio/video hardware resources to execute multimedia, and manages resource usage and can efficiently utilize them. Relatedly, in a fixed device having a large screen unlike a mobile device, hardware resources are required when performing multimedia. In addition, since the amount of data is large, the encoding/decoding and graphic data transfer speeds must be fast. On the other hand, the media server, in addition to streaming and file-based playback, performs broadcasting, recording and tuning tasks, and simultaneously records while viewing, or simultaneously displays the sender and receiver screens during a video call. It must be able to handle tasks such as doing or doing. However, in the media server, the number of hardware resources such as encoders, decoders, tuners, and display engines is limited for each chip-set, making it difficult to execute multiple tasks at the same time, limiting user usage scenarios or receiving user selection and processing.

The media server can enhance system stability (robustness). For example, the media server may remove and restart a playback pipeline in which an error occurs during media playback for each pipeline, so that when an error occurs, other media playback may not be affected. Such a pipeline is a chain that connects each unit functions such as decoding, analysis, and output when a media playback request is made, and necessary unit functions may vary according to a media type.

The media server must have extensibility. The media server can add new types of pipelines without affecting the existing implementation. For example, it should be able to accommodate cameras, video conferencing (Skype) and third-party pipelines.

The media server may process general media playback and TV task execution as separate services. This is because the interface of the TV service is different from the case of media playback. In the case of TV service, it has operations such as'setchannel','channelup','channeldown','channeltuning', and'recordstart', and when playing general media, operations such as'play','pause', and'stop' It is desirable that both have different operations and are treated as separate services.

The media server can control or integrated management of resource management functions. In the media server, hardware resource allocation and retrieval are integrated in the media server, and the TV service process delivers the running task and resource allocation status to the media server. For each media execution, resources are secured and the pipeline is executed, and based on the resource status occupied by each pipeline, the media server allows execution by priority when requesting media execution and retrieves resources from other pipelines. . To this end, predefined execution priority and necessary resource information for a specific request are managed by a policy manager.

The media server may hold identification factors for all operations related to playback. For example, the media server may instruct a specific pipeline based on the identifier and issue a command. The media server may issue commands to the pipelines for playing more than one media.

The media server can be responsible for playing HTML 5 standard media.

In addition, in the media server, the separate service process of the TV pipeline may follow the TV restructuring range. The media server may be designed and implemented irrespective of the TV restructuring range. If the TV is not processed as a separate service, the entire TV may need to be re-executed when a problem occurs in a specific task.

The media server is also referred to as uMS, that is, a micro media server. Here, the media player is a media client, which includes, for example, an HTML5 video tag, a camera, a TV, a Skype, a second screen, etc. It can mean a webkit for.

In the media server, the management of micro resources such as a resource manager and a policy manager is a key function. In relation to this, the media server also controls a playback control role for web standard media content. In this regard, the media server may also manage a pipeline controller resource.

Such a media server supports, for example, extensibility, reliability, and efficient resource usage.

In other words, uMS, that is, a media server, is a web OS device such as a cloud game, an MVPD (pay service, etc.), a camera preview, a second screen (2nd screen, second screen), Skype, etc., and a TV resource. It manages and controls the use of resources for proper processing in an overall management and control so that efficient use is possible. Meanwhile, when each resource is used, for example, a pipeline is used, and the media server can generally manage and control the creation, deletion, and use of a pipeline for resource management.

Here, the pipeline is created when, for example, the media related to a task starts a series of tasks such as parsing a request, a decoding stream, and a video output. Can be. For example, in relation to TV services or applications, watching, recording, channel tuning, etc. are handled by receiving control over resource usage, etc., through pipelines created according to the respective requests. .

With reference to FIG. 10, the processing structure of the media server will be described in more detail as follows.

In FIG. 10, an application or service is connected to a media server 1020 through a Luna-service bus 1010, and the media server 1020 includes pipelines created again through the Luna-service bus 1010 ( 1030, 1040, 1050, etc.).

An application or service may have various clients according to its characteristics, and may exchange data with the media server 1020 or the pipeline 1040 through them.

The clients include, for example, a uMedia client (web kit) for connection with the media server 1020 and a resource manager (RM) client (C/C++).

The application including the uMedia client is connected to the media server 1020 as described above. In more detail, the uMedia client corresponds to, for example, a video object to be described later, and this client uses the media server 1020 to operate the video by request or the like.

Here, the video operation relates to a video state, and loading, unloading, play, playback, or reproduce, pause, stop, etc. are all states related to the video operation. May contain data. Each action or state of these videos can be processed through the creation of a separate pipeline. Accordingly, the uMedia client transmits state data related to the video operation to the pipeline manager 1022 in the media server.

The pipeline manager 1022 obtains information on a resource of a current device through data communication with the resource manager 1024 and requests allocation of a resource corresponding to the state data of the uMedia client. At this time, the pipeline manager 1022 or the resource manager 1024 controls resource allocation through data communication with the policy manager 1026 when necessary in relation to the resource allocation. For example, when there is no or insufficient resource to be allocated according to the request of the pipeline manager 1022 in the resource manager 1024, appropriate resource allocation may be performed according to the request according to the priority comparison of the policy manager 1026. I can.

Meanwhile, the pipeline manager 1022 requests the media pipeline controller 1028 to create a pipeline for an operation according to the request of the uMedia client with respect to the resource allocated according to the resource allocation of the resource manager 1024. .

The media pipeline controller 1028 creates a necessary pipeline under the control of the pipeline manager 1022. In the pipeline thus generated, as illustrated, a media pipeline 1030 and a camera pipeline, as well as pipelines related to playback, pause, and pause may be generated. Meanwhile, the pipeline may include a pipeline for HTML5, Web CP, smartshare playback, thumbnail extraction, NDK, cinema, MHEG, and the like.

In addition, the pipeline may include, for example, a service-based pipeline (its own pipeline) 1040 and a URI-based pipeline (media pipeline) 1050.

Referring to FIG. 10, an application or service including an RM client may not be directly connected to the media server 1020. This is because an application or service may directly handle media. In other words, when an application or service directly processes media, it may not go through the media server. However, in this case, resource management is required for the creation and use of the pipeline. To this end, the uMS connector 1032 in the service-based pipeline 1040 functions. Meanwhile, when a resource management request for direct media processing of the application or service is received, the uMS connector 1032 communicates with the media server 1020 including the resource manager 1024. To this end, the media server 1020 must also be provided with a uMS connector 1029.

Accordingly, the application or service can respond to the request of the RM client by receiving resource management from the resource manager through the uMS connectors 1029 and 1032. These RM clients can handle services such as native CP, TV service, second screen, flash player, YouTube Medai Source Extensions (MSE), cloud games, and Skype. In this case, as described above, the resource manager 1024 may properly manage resources through data communication with the policy manager 1026 when necessary for resource management.

On the other hand, the URI-based pipeline is performed through the media server 1020 rather than the case of directly processing media like the above-described RM client. Such a URI-based pipeline may include a player factory, a G streamer, a streaming plug-in, and a DRM plug-in pipeline.

Meanwhile, an interface method between an application and media services may be as follows.

One is how to interface using services in web applications. This is a method of using Luna Call using PSB (Palm Service Bridge) and a method using Cordova, which extends the display to a video tag. There may be other ways to use the HTML5 standard for video tags or media elements.

The other is how to interface using a service in the PDK.

Another is a method of using a service in an existing CP. This can be used by extending the plug-in of the existing platform based on Luna for backward compatibility.

Finally, this is how to interface in case of non-Web OS. In this case, you can interface by calling the Luna bus directly.

TVWIN is a process to show TV on the screen without web OS before booting the web OS. This is defined for the purpose of providing the basic function of TV service for quick response when Power On to users because the booting time of the web OS is late. It is part of the TV service process, and is a development area limited to fast booting, basic TV functions, and factory mode support functions. It is also responsible for switching from non-web OS mode to web OS mode.

Referring to FIG. 11, a processing structure of a media server is shown.

In this case, in FIG. 11, a solid box indicates a process processing configuration, and a dotted box may indicate an internal processing module during a process. Further, a solid arrow may indicate an inter-process call, that is, a Luna service call, and a dotted arrow may indicate a notification such as register/notify or a data flow.

A service or a Web application or a PDK application (hereinafter referred to as “application”) is connected to various service processing configurations through a Luna-service bus, through which the application is operated or operation controlled.

The data processing path varies depending on the type of application. For example, if the application is image data related to a camera sensor, it is transmitted to the camera processing unit 1140 and processed. In this case, the camera processing unit 1140 processes image data of the received application, including a gesture and a face detection module. Here, the camera processing unit 1140 may process the data by creating a pipeline through the media server processing unit 1110 in the case of data that is requested by the user to select or automatically use a pipeline.

Alternatively, when the application includes audio data, the audio may be processed through the audio processing unit (AudioD) 1150 and the audio module (PulseAudio) 1160. For example, the audio processing unit 1150 processes audio data received from an application and transmits the processed audio data to the audio module 1160. In this case, the audio processing unit 1150 may include an audio policy manager to determine processing of audio data. The audio data processed in this way is processed by the audio module 1160. Meanwhile, the application may notify data related to audio data processing to the audio module 1160, which may also notify the audio module 1160 in a related pipeline.

Alternatively, if the application includes content on which DRM is applied, the corresponding content data is transmitted to the DRM service processor 1170, and the DRM service processor 1170 generates a DRM instance to process the content data on which DRM is applied. . Meanwhile, the DRM service processor 1170 may be connected to and processed through a DRM pipeline in a media pipeline and a Luna-service bus to process the content data on which the DRM is applied.

Hereinafter, processing when the application is media data or TV service data (broadcast data) will be described.

FIG. 12 is a diagram for describing in more detail only the media server processing unit and the TV service processing unit in FIG. 11 described above.

Therefore, hereinafter, it will be described with reference to FIGS. 11 and 12 together.

First, when the application includes TV service data, it is processed by the TV service processing unit 1120/1220.

Here, the TV service processing unit 1120 includes at least one of, for example, a DVR/channel manager, a broadcasting module, a TV pipeline manager, a TV resource manager, a data broadcasting module, an audio setting module, and a path manager. Alternatively, in FIG. 12, the TV service processing unit 1220 includes a TV broadcast handler, a TV broadcast interface, a service processing unit, a TV middleware (TV MW (middleware)), a path manager, and a BSP. Can include. Here, the service processing unit may mean a module including, for example, a TV pipeline manager, a TV resource manager, a TV policy manager, and a USM connector.

In the present specification, the TV service processor may have a configuration as shown in FIG. 11 or 12 or may be implemented as a combination of both, and some configurations may be omitted or some components not shown may be added.

The TV service processing unit 1120/1220 transmits the data related to the DVR or channel to the DVR/channel manager based on the attribute or type of the TV service data received from the application, and transmits the data to the TV pipeline manager to transmit the TV pipe. Create and process lines. Meanwhile, when the property or type of the TV service data is broadcast content data, the TV service processing unit 1120 generates and processes a TV pipeline through a TV pipeline manager to process the data through a broadcast module.

Alternatively, a json (Javascript standard object notation) file or a file written in c is processed by a TV broadcast handler and transmitted to a TV pipeline manager through a TV broadcast interface to create and process a TV pipeline. In this case, the TV broadcast interface unit may transmit the data or file that has passed the TV broadcast handler to the TV pipeline manager based on the TV service policy, and refer to it when generating the pipeline.

Meanwhile, the TV pipeline manager may receive control of the TV resource manager when generating one or more pipelines according to a TV pipeline generation request from a processing module or a manager within a TV service. Meanwhile, the TV resource manager may receive the control of the TV policy manager to request the status and allocation of resources allocated for TV service according to the TV pipeline creation request from the TV pipeline manager, and the media server processing unit 1110 /1210) and uMS connector for data communication. The resource manager in the media server processing unit 1110/1210 transmits the status of the resource for the current TV service and whether or not to be allocated according to the request of the TV resource manager. For example, as a result of checking the resource manager in the media server processing unit 1110/1210, if all resources for a TV service are already allocated, the TV resource manager may notify that all resources are currently allocated. At this time, the resource manager in the media server processing unit removes a predetermined TV pipeline according to a priority or a predetermined criterion among TV pipelines pre-allocated for TV service, along with the notification, and a TV pipeline for the requested TV service. Creation can also be requested or assigned. Alternatively, the TV resource manager may properly remove, add, or create a TV pipeline according to a status report of the resource manager in the media server processing unit 1110/1210.

Meanwhile, the BSP supports backward compatibility with, for example, an existing display device.

The TV pipelines created in this way can be properly operated under the control of the path manager in the process. The path manager may determine or control a processing path or process of the pipelines in consideration of not only the TV pipeline but also the operation of the pipeline generated by the media server processing unit 1110/1210 during the processing.

Next, when the application includes media data rather than TV service data, it is processed by the media server processing unit 1110/1210. Here, the media server processing unit 1110/1210 includes a resource manager, a policy manager, a media pipeline manager, a media pipeline controller, and the like. On the other hand, in the pipeline created under the control of the media pipeline manager and the media pipeline controller, a camera preview pipeline, a cloud game pipeline, and a media pipeline can be variously created. Meanwhile, the media pipeline may include a streaming protocol, an automatic/static gstreamer, and DRM, and the processing flow may be determined according to the control of the path manager. The detailed processing process in the media server processing unit 1110/1210 uses the description of FIG. 10 described above, and the description is not repeated here.

13 is a detailed block diagram illustrating a configuration module of a display device according to another embodiment of the present invention. With reference to FIGS. 1 to 12 described above, a part of the module of the display device of FIG. 13 may be added or changed, and the scope of the present invention is not determined by the elements described in FIGS. 1 to 13, but in principle patents It should be interpreted in accordance with the matters set forth in the claims. 13, a display device 1300 according to another embodiment of the present invention includes a user interface unit 1310, a broadcast service module 1320, a communication module 1330, a memory 1340, and a controller. 1350), etc.

The user interface unit 1310 may receive a specific signal from a user. The user interface unit 1310 may perform a data transmission/reception role between a user and a setting application included in the display device 1300. The user interface unit 1310 may receive a specific signal through a touch panel connected to a display module (not shown) of the display device 1300, and an infrared ray (IR) signal received from a sensor module (not shown). You can receive a specific signal by using.

The broadcast service module 1320 may receive a broadcast signal including broadcast program data from a broadcasting station or a content provider (CP), and may process the received broadcast signal. The broadcast service module 1320 may include a tuner, a demultiplexer, an image decoder, a scaler, a mixer, a frame rate converter, a formatter, and the like. The broadcast service module 1320 may receive a broadcast signal, decode the received broadcast signal, and transmit broadcast time information included in the broadcast signal to the controller 1350.

The communication module 1330 may perform data communication with an external device or an external server using various wired/wireless communication protocols. The external device may include a bio device and a mobile device. In addition, the external server may include a Network Time Protocol (NTP) server. The NTP server will be described in detail with reference to FIGS. 14 and 16 below.

The memory 1340 may store a plurality of time source data received by the display device according to an embodiment of the present invention. The plurality of time source data includes first time source data including time information input from a user, second time source data including broadcast time information included in broadcast signal information, and network time information received from an NTP server. The third time source data may be included. In addition, the memory 1340 may store the first time source data, the second time source data, and the third time source data in a DB (Data Base) to manage the first time source data according to a preset period. The DB may be updated by detecting data, the second time source data, and the third time source data.

The controller 1350 performs a function of overall management of the functions of at least one or more modules shown in FIG. 13, such as the user interface unit 1310, the broadcast service module 1320, the communication module 1330, and the memory 1340. do. In this regard, it will be described later in more detail with reference to FIGS. 14 to 22.

14 is a diagram illustrating an example in which a display device manages a plurality of time source data according to an embodiment of the present invention.

The display device 1400 according to an embodiment of the present invention may include a controller 1410, a setting application 1420, a settings service 1430, and a broadcast service module 1440. .

The controller 1410 of the display device 1400 according to an embodiment of the present invention includes first time source data extracted from the setting application 1420 connected to the user interface unit, second time source data extracted from the broadcast service module, At least one or more time source data among the third time source data received from the NTP server may be extracted, and the application time may be set according to a preset priority based on the extracted time source data and the type of the application.

The first time source data may include at least one of time information input by a user and a manual offset.

The second time source data may include broadcast time information included in a broadcast signal.

The third time source data may include network time information stored in the NTP server.

The network time information may be received and updated from the NTP server at a preset period.

The type of application may include a first type application including a web application and a second type application including a broadcast application.

The manual offset may include time zone information and daylight saving time information.

The display device may include a Web OS (Web Operating System), the web application may be an application generated based on the Web OS, and the broadcast application may be an application connected to the broadcast service module to use a broadcast signal.

The controller of the display device 1400 according to an embodiment of the present invention may receive at least one of manual time information and manual offset from a user through the setting application 1420. The setting application 1420 may be an application embedded in the display device 1400. The setting application 1420 may be connected to a user interface unit of the display device 1400. The manual time information may refer to time information directly input by the user, and the manual offset may refer to time zone information and daylight saving time information. The user may select an automatic setting for automatically setting a time setting of a specific application through the display device through the setting application 1420 and a manual setting for performing a time setting using a time directly input by the user. In addition, when at least one of manual time information and manual offset is received from the user, the setting application 1420 may transmit the received information to the setting service 1430 and the controller 1410. The setting service 1430 may store data received from the setting application 1420 in a DB. In addition, the setting service 1430 may transmit the information received from the setting application 1420 to the broadcast service module 1440. The broadcast service module 1440 includes a tuner or the like, and when receiving a broadcast signal from a broadcasting station, etc., may extract broadcast time information by parsing the received broadcast signal. In addition, the broadcast service module 1440 may transmit the extracted broadcast time information to the controller 1410. The broadcast time information transmitted by the broadcast service module 1440 to the controller may include both broadcast time information based on Universal Time Coordinated (UTC) time and broadcast time information based on manual offset information received from the setting service 1430. have. The broadcast time information based on the manual offset information may mean time information in which a correction value using manual offset information is reflected in the broadcast time information based on the UTC time. And, when the user wants to input manual time information, the setting application 1420 requests the broadcast time information transmitted from the broadcast service module 1440 to the controller 1410, and the controller 1410 The updated broadcast time information may be transmitted to the setting application 1420. In addition, the setting application 1420 may display the broadcast time information transmitted from the controller 1410 to the user, thereby allowing the user to input manual time information based on the broadcast time information. In addition, the controller 1410 of the display device 1400 according to an embodiment of the present invention may manage a plurality of time source data. The plurality of time source data includes first time source data extracted from the setting application 1420 connected to the user interface unit, second time source data extracted from the broadcast service module 1440, and a third time source received from the NTP server. May contain data. Further, the controller 1410 of the display device 1400 according to an embodiment of the present invention extracts at least one of a plurality of time source data, and based on the extracted time source data and the type of application, a preset priority You can set the time of the application according to the ranking. The type of application may include a first type application 1450 including a web application and a second type application 1460 including a broadcast application. The display device 1400 may include a Web OS, and the first type application 1450 including the web application may be an application generated based on the Web OS. The controller 1400 of the display device 1400 according to an embodiment of the present invention sets the times of the first type application 1450 and the second type application 1460 using a plurality of extracted time source data. can do. For example, when the user does not input manual time information through the setting application 1420 and there are both second time source data including broadcast time information and third time source data including network time information, The controller 1410 may set the time of the first type application 1450 to be the same as network time information included in the third time source data, and the time of the second type application 1460 is a second time source. It can be set in the same manner as broadcast time information included in the data. This will be described in detail in FIG. 15 below. By designing as shown in FIG. 14, when there are a plurality of time source data and the types of applications are different, there is an advantage of setting an optimal time using appropriate time source data.

FIG. 15 is a diagram for describing a method of determining a priority for setting an application time using a plurality of time source data in a display device according to an embodiment of the present invention.

As shown in FIG. 15, the display device according to an embodiment of the present invention may manage first time source data 1501, second time source data 1502, and third time source data 1503. The first time source data 1501 may include at least one of time information input by a user and a manual offset, and the second time source data 1502 is broadcast time information included in a broadcast signal. The third time source data 1503 may include network time information stored in the NTP server.

The display device according to an embodiment of the present invention basically has eight types of time setting depending on whether the first time source data 1501, the second time source data 1502, and the third time source data 1503 are extracted. Can exist.

The first time setting type 1510 includes time information input by the user in the first time source data 1501, the second time source data 1502 is extracted, and the third time source data 1503 is extracted. It may be the case.

The second time setting type 1520 includes time information input by the user in the first time source data 1501, the second time source data 1502 is not extracted, and the third time source data 1503 is It may be the case of extraction.

The third time setting type 1530 includes time information input by the user in the first time source data 1501, the second time source data 1502 is extracted, and the third time source data 1503 is extracted. This may not be the case.

The fourth time setting type 1540 includes time information input by the user in the first time source data 1501, the second time source data 1502 is not extracted, and the third time source data 1503 is It may be the case that it is not extracted.

As shown in FIG. 15, in the case of a first time setting type 1510, a second time setting type 1520, a third time setting type 1530, and a fourth time setting type, according to an embodiment of the present invention. The controller of the display device may set the time of the first type application 1505 and the second type application 1506 to be the same as time information input by the user included in the first time source data 1501. .

The fifth time setting type 1550 does not include the time information input by the user in the first time source data 1501, only the manual offset, the second time source data 1502 is extracted, and the third time source The data 1503 may be extracted. In the case of the fifth time setting type (1550), the controller of the display device according to an embodiment of the present invention, the time of the first type application 1505 is a network time included in the third time source data 1503 It may be set the same as the information, and the time of the second type application 1506 may be set the same as the broadcast time information included in the second time source data 1502.

The sixth time setting type 1560 does not include the time information input by the user in the first time source data 1501, only the manual offset, the second time source data 1502 is not extracted, and the third time The source data 1503 may be extracted. In the case of the sixth time setting type 1560, the controller of the display device according to an embodiment of the present invention calculates the times of the first type application 1505 and the second type application 1506 as the third time source data. It may be set to be the same as the network time information included in 1503.

The seventh time setting type 1570 does not include time information input by a user in the first time source data 1501, only a manual offset, the second time source data 1502 is extracted, and the third time source There may be a case where the data 1503 is not extracted. In the case of the seventh time setting type 1570, the controller of the display device according to an embodiment of the present invention determines the times of the first type application 1505 and the second type application 1506 as the second time source data. It can be set to be the same as broadcast time information included in 1502.

In the eighth time setting type 1580, time information input by the user in the first time source data 1501 is not included, only a manual offset is included, the second time source data 1502 is not extracted, and the third time The source data 1503 may not be extracted. In the case of the eighth time setting type (1580), the controller of the display device according to an embodiment of the present invention stores the time of the first type application 1505 and the second type application 1506 in a memory. It can be set the same as the time (Factory Default Time) information. The factory default time may be a time determined as a default value when the display device is produced. The factory default time may be 0:0:0 on January 1, 2014. The first time setting type 1510 to the eighth time setting type 1380 will be further described below with reference to FIG. 16.

And, as an exceptional case, in the case of DRM (Digital Rights Management) content 1504, since the DRM content 1504 includes its own time information, regardless of a plurality of time source data extracted from the display device, the display device The case of setting separately in may not occur. The DRM content 1504 will be described in more detail in FIG. 17 below.

16 is another diagram for describing a method of determining a priority for setting an application time using a plurality of time source data in a display device according to an embodiment of the present invention.

As shown in FIG. 16, the broadcast service module 1610 included in the display device according to an embodiment of the present invention may receive a broadcast signal from a broadcasting station, etc., and parse the received broadcast signal to obtain a start time ( Start time), end time (End Time), and UTC broadcast time information including duration information can be extracted. In addition, after extracting the broadcast offset included in the broadcast signal and the manual offset information input by the user, the user local broadcast time information can be determined by reflecting the time zone and daylight time saving information corresponding to the current location of the user using the display device. have.

In addition, as shown in FIG. 16, the controller of the display device according to an embodiment of the present invention may receive network time information from an NTP server, and may receive manual time information from a user. And, as described in Fig. 15, when there is manual time information directly input by the user, when setting the time of the first application 1632 and the second application 1634, the manual time information directly input by the user It can be set in the same way. And, when there is no manual time information directly input by the user, the time setting of the first application 1632 and the second application 1634 is a second time source data including broadcast time information and a first time information including network time information. 3 Determined by the presence or absence of time source data. Since the time setting determination process is the same as described in FIG. 15, redundant descriptions will be omitted.

17 is a diagram for explaining an example of managing time of DRM content in a display device according to an embodiment of the present invention.

The DRM function is a function that safely protects the rights and interests of content providers, prevents illegal copying, and supports from content creation, distribution, and management, such as charging usage fees and payment agency. Therefore, the DRM function can prevent the use of the content unless a certain usage fee is paid by installing a security authentication system for each content. The DRM function is being developed as a means of protecting the online privacy of commercial products, which is rapidly increased by the widespread use of file exchange programs by users. Although online content is said to be protected by copyright law, it is a very difficult achievement in reality to crack down on illegal web use and catch criminals.

Therefore, time management is very important for DRM content. If the time information of the DRM content is arbitrarily manipulated or the time of an external server is received and set so that it can be changed, great damage may occur to the DRM content provider.

Therefore, as shown in FIG. 17, the display device according to an embodiment of the present invention separately includes a DRM module to separately manage the DRM content time received from the DRM content provider, and the first time source data, the second Since the time source data and the third time source data are not used to change, the rights of the DRM content provider can be protected.

By designing as shown in FIGS. 15 to 17, there is an advantage in that a display device equipped with a Web OS can determine an algorithm for setting an optimal time according to an application or content type using a plurality of time source data.

18 is a flowchart illustrating an algorithm for setting an application time by using a plurality of time source data by a display device according to an embodiment of the present invention.

18, the controller of the display device according to an embodiment of the present invention first extracts the first time source data from the setting application (S1810), and the user inputs the first time source data. It may be determined whether information is included (S1820). The controller of the display device according to an embodiment of the present invention, when the determination result, when the time information input by the user is included in the first time source data, the user determines the times of the first type application and the second type application. It is possible to set the same as the input time information (S1822). And, the controller of the display device according to an embodiment of the present invention, when the determination result, the first time source data does not include the time information input by the user, the second time source data and the third time source data It can be determined whether it is extracted (S1830, S1840, S1850). In the controller of the display device according to an embodiment of the present invention, when the second time source data and the third time source data are extracted as a result of the determination, the time of the first type application is included in the third time source data. It is possible to set the same as the network time information, and the time of the second type application to be the same as the broadcast time information included in the second time source data (S1842). And, the controller of the display device according to an embodiment of the present invention, if the second time source data is extracted and the third time source data is not extracted as a result of the determination, the time of the first type application and the second type application It may be set to be the same as broadcast time information included in the second time source data (S1844). And, as a result of the determination, when the second time source data is not extracted and the third time source data is extracted, the controller of the display device according to an embodiment of the present invention determines the times of the first type application and the second type application. It may be set to be the same as network time information included in the third time source data (S1852). Finally, the controller of the display device according to an embodiment of the present invention determines the time of the first type application and the second type application if neither the second time source data nor the third time source data are extracted as a result of the determination. It can be set the same as the factory default time information (S1854).

19 is a diagram illustrating an example of extracting broadcast time information from a broadcast signal in a display device according to an embodiment of the present invention.

The broadcast service module included in the display device according to an embodiment of the present invention may receive and parse a broadcast signal to extract broadcast time information and transmit it to the controller. As an example for explaining this process, the Program and System Information Protocol (PSIP) established by the Advanced Television System Committee (ATSC), which is a standard for digital broadcasting, to transmit channel information and program information will be described as an example. In addition, if this is just an example for explanation, the same can be applied to the European standard Digital Video Broadcasting (DVB).

19 is an example of a System Time Table (STT) format. STT is a table that provides information on the current date and time. In addition, it is possible to provide time information for an application that requires time synchronization. In the case of digital broadcasting, such STT may be included in the broadcast signal and transmitted together. The STT may include GPS time information elapsed up to the current time based on 00:00:00 on January 6, 1980. In addition, STT may include UTC time (Greenwich Mean Time) information and daylight saving time information. Further, although not shown in FIG. 19, the broadcast signal may also include Event Information Tables (EIT). The EIT may include a broadcast schedule of a broadcast program and a description of broadcast content. Accordingly, the broadcast service module included in the display device according to an embodiment of the present invention may transmit broadcast time information to the controller by receiving and parsing a broadcast signal and extracting the STT and EIT information, and the controller Information may be provided to a user through a setting application, or a broadcast application time may be set based on the broadcast time information.

20 to 21 are diagrams for explaining an example in which a user inputs time information and a manual offset through a setting application of a display device according to an embodiment of the present invention.

As illustrated in FIG. 20, the display device according to an embodiment of the present invention may receive various information for time setting from a user by outputting the user interface 2000. The user interface 2000 includes an automatic setting icon 2010, a manual time input area 2020, a date input area 2030, a time zone input area 2040, and a time offset input area 2050. can do. The user may input desired time information through the user interface 2000. For example, when the user selects the automatic setting icon 2010 to activate the automatic time setting function, the controller of the display device according to an embodiment of the present invention uses the second time source data and the third time source data. Thus, the time can be set according to a preset algorithm.

In addition, as shown in FIG. 21, the user can directly set the time through the manual time input area 2020. In this case, the controller of the display device may display broadcast time information included in the second time source data to a user, thereby providing a function of allowing the user to set a time by referring to the broadcast time information. As the user refers to the broadcast time information, there is an effect of reducing an error in using the reservation recording function.

In addition, the user may input the current date and time zone information corresponding to the user's location through the user interface unit 2000. Also, the user can directly input the time offset. For example, in the case of a user located in Korea, a time offset may be input at GMT +9:00 through the time offset input area 2050.

In this way, by allowing the user to directly set the time information through the user interface, it is a technical effect that even when the display device is used in various regions, the reservation recording function, etc., can be used with a small margin of error based on accurate time information. There is.

22 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention.

As shown in FIG. 22, a method for controlling a display device according to an embodiment of the present invention includes first time source data extracted from a setting application, second time source data extracted from a broadcast service module, and received from an NTP server. Extracting at least one time source data from among the third time source data (S2210) and setting an application time according to a preset priority based on the extracted time source data and the type of application (S2220). It can be implemented including. The detailed description of each step is the same as described above, so a repetitive description is omitted.

Furthermore, although each drawing has been described separately for convenience of description, it is possible to design a new embodiment by merging the embodiments described in each drawing. In addition, the display device and a method of controlling the same according to an exemplary embodiment may not be limitedly applicable to the configuration and method of the exemplary embodiments described above. That is, the above-described embodiments may be configured by registering all or part of each of the embodiments so that various modifications may be made.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. In addition, various modifications may be possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

In addition, in this specification, both the product invention and the method invention are described, and the description of both inventions may be supplementarily applied as necessary.

1100: display device
1110: user interface unit
1120: broadcast service module
1130: Communication module
1140: memory
1150: controller

Claims (20)

In the control method of a display device for managing a plurality of time source (Time Source) data,
At least one of first time source data extracted from a setting application, second time source data extracted from a broadcast service module, and third time source data received from a Network Time Protocol (NTP) server Extracting the above time source data;
Setting an application time according to a preset priority based on the extracted time source data and an application type; And
When receiving manual offset and time information from a user through the setting application, including the step of displaying broadcast time information included in the second time source data,
The first time source data includes at least one of time information and a manual offset input by a user through the setting application,
The second time source data includes broadcast time information included in a broadcast signal,
The third time source data includes network time information stored in the NTP server,
The type of application includes a first type application including a web application and a second type application including a broadcast application. A method of controlling a display device for managing a plurality of time source data.

The method of claim 1,
The manual offset is a control method of a display device for managing a plurality of time source data, characterized in that it includes time zone (Time Zone) information and daylight saving time (Daylight Saving Time) information. The method of claim 1,
The display device includes a Web OS (Web Operating System),
The web application is an application generated based on the Web OS,
The broadcast application is an application connected to the broadcast service module to use a broadcast signal. A method of controlling a display device for managing a plurality of time source data. The method of claim 1,
When the first time source data is extracted and the time information input by the user is included in the first time source data,
The control method of a display device for managing a plurality of time source data, characterized in that setting times of the first type and second type applications to be the same as time information input by the user. The method of claim 1,
When the first time source data, second time source data, and third time source data are extracted and only a manual offset is included in the first time source data,
The time of the first type application is set equal to network time information included in the third time source data,
The control method of a display device for managing a plurality of time source data, wherein the time of the second type application is set equal to the broadcast time information included in the second time source data. The method of claim 1,
When the first time source data and the second time source data are extracted and only a manual offset is included in the first time source data,
The control method of a display device for managing a plurality of time source data, wherein the times of the first type and the second type application are set equal to the broadcast time information included in the second time source data. The method of claim 1,
When the first time source data and the third time source data are extracted, and only a manual offset is included in the first time source data,
The control method of a display device for managing a plurality of time source data, wherein the times of the first type and second type applications are set equal to network time information included in the third time source data. The method of claim 1,
When the first time source data is extracted and only a manual offset is included in the first time source data,
The first type and second type application times are set to be the same as factory default time information stored in a memory,
The control method of a display device for managing a plurality of time source data, wherein the factory default time is a time determined as a default value when the display device is produced. The method of claim 1,
The network time information is received from the NTP server at a preset period and updated. A method of controlling a display device for managing a plurality of time source data. delete In a display device that manages a plurality of time source data,
A user interface unit receiving first time source data from a user;
A broadcast service module for receiving a broadcast signal;
A communication module for performing data communication with a Network Time Protocol (NTP) server;
A memory for storing the plurality of time source data; And
A controller for controlling the operation of the display device,
The controller is
First time source data extracted from a setting application connected to the user interface unit, second time source data extracted from a broadcast service module, and a third received from a Network Time Protocol (NTP) server Extracting at least one time source data from the time source data,
Based on the extracted time source data and the type of application, the application time is set according to a preset priority,
When receiving manual offset and time information from a user through the setting application, displaying broadcast time information included in the second time source data,
The first time source data includes at least one of time information input by a user and a manual offset,
The second time source data includes broadcast time information included in a broadcast signal,
The third time source data includes network time information stored in the NTP server,
The type of the application includes a first type application including a web application and a second type application including a broadcast application.
Display device. The method of claim 11,
The manual offset is a display device for managing a plurality of time source data, characterized in that including time zone (Time Zone) information and daylight saving time (Daylight Saving Time) information. The method of claim 11,
The display device includes a Web OS (Web Operating System),
The web application is an application generated based on the Web OS,
The display device for managing a plurality of time source data, wherein the broadcast application is an application connected to the broadcast service module and using a broadcast signal. The method of claim 11,
When the controller extracts first time source data and includes time information input by a user in the first time source data,
The display device for managing a plurality of time source data, characterized in that the time of the first type and the second type of application is set equal to the time information input by the user. The method of claim 11,
When the controller extracts the first time source data, the second time source data, and the third time source data and includes only a manual offset in the first time source data,
The time of the first type application is set equal to network time information included in the third time source data,
The display device for managing a plurality of time source data, wherein the time of the second type application is set to be the same as broadcast time information included in the second time source data. The method of claim 11,
When the controller extracts the first time source data and the second time source data and includes only a manual offset in the first time source data,
The display device for managing a plurality of time source data, wherein the times of the first type and the second type application are set to be the same as broadcast time information included in the second time source data. The method of claim 11,
The controller extracts the first time source data and the third time source data, and when only a manual offset is included in the first time source data,
The display device for managing a plurality of time source data, wherein the times of the first type and second type applications are set to be the same as network time information included in the third time source data. The method of claim 11,
When the controller extracts the first time source data and includes only a manual offset in the first time source data,
The first type and second type application times are set to be the same as factory default time information stored in a memory,
The display device managing a plurality of time source data, wherein the factory default time is a time determined as a default value when the display device is produced. The method of claim 11,
The display device for managing a plurality of time source data, wherein the network time information is received and updated from the NTP server at a preset period. delete

Images