KR102074760B1 - Image display apparatus for conducting auto wireless communication among devices and image displaying method thereof - Google Patents

Abstract

The present invention relates to a method for automatically connecting a wireless network between a mobile terminal and a video display device capable of implementing peer-to-peer transmission and control, and a video display device using the same. An image display device according to an aspect of the present invention includes a display unit for externally receiving an AV signal and outputting the same, wherein the image display device includes an external mobile terminal according to a Wi-Fi Direct communication standard. Wireless communication interface unit for transmitting and receiving a predetermined signal including an AV signal, first connection history information for the connected mobile terminals and wireless communication connection according to the Wi-Fi Direct communication standard with the mobile terminal A storage unit for storing an application program for the mobile station, authentication information for setting a wireless communication network with the mobile terminal, and automatically generating a connection request message based on the first connection history information to generate a mobile terminal with a connection history; It includes a control unit for sending out.

Description

Image display apparatus for conducting auto wireless communication among devices and image displaying method

The present invention relates to a video display device and an image display method according to the automatic wireless communication between the device, and more particularly to a wireless network between the mobile terminal and the video display device that can implement the peer-to-peer transmission and control A method of connecting and an image display device using the same.

Wi-Fi CERTIFIED Miracast, a new certification program introduced by the Wi-Fi Alliance, is designed to provide a broad range of industries across chip, mobile device and electronics manufacturers to ensure seamless sharing of graphics and audio content between Wi-Fi devices. It was developed based on support.

After the initial pairing between the two Wi-Fi devices, the user can choose to stream content or mirror the display from one device (source device) to another (display device). Miracast allows users to form a direct Wi-Fi connection between two devices, eliminating the need to leverage existing networks.

Based on Wi-Fi, Miracast gives users the freedom to display content on the device they want, while maintaining ease of use, interoperability between manufacturers, and the security shared by all Wi-Fi CERTIFIED products. Doing. Miracast supports the most commonly used codecs and video formats, allowing users to access the audio and video content they want on any device.

Miracast supports Wi-Fi CERTIFIED n (enhancing throughput and coverage), Wi-Fi Direct (device to device), Wi-Fi Protected Access (WPA2) (security), Wi-Fi Multimedia (WMM) (traffic management), and Wi-Fi Many of the factors that have enriched the user experience over the past few years, such as Fi Protected Setup, and have increased user confidence in Wi-Fi, have been utilized.

Some Miracast devices will also support Tunneled Direct Link Setup (TDLS), which allows connectivity through infrastructure networks. In the case of TDLS, more efficient data transmission is possible, and it is possible to use more advanced Wi-Fi functions than if the device-to-device connection is made by a legacy infrastructure network.

Miracast is an optional certification program for client devices that support video features such as TVs, set-top boxes, cameras, projectors, smartphones, tablets and laptops. To use Miracast, both display and source devices must be Miracast certified. You can use Miracast on devices that don't have Wi-Fi by using a Miracast-certified adapter that supports an interface such as HDMI or USB.

The market for smart devices has opened up. In addition, the market for applications and accessories is expanding rapidly. Interest in wireless connected has also been confirmed in recent IT trends.

Many smart terminal manufacturers at home and abroad are launching Miracast certified products. Smartphone manufacturers are mainly engaged in the development of Miracast-related technologies, and there are no specifications for the Miracast connection between the vehicle head unit and the mobile terminal.

In particular, Miracast does not have a standard for automatic connection between devices, and when a screen transmission service is used after connecting a Wi-Fi Miracast in a vehicle, there is a problem in that the utilization stage is many and complicated and the utilization is low.

Accordingly, an object of the present invention is to provide a method for automatically connecting a wireless network between a mobile terminal and a video display device capable of implementing peer-to-peer transmission and control, and a video display device using the same.

An image display apparatus according to an aspect of the present invention for achieving the above object is a video display device including a display unit for receiving and outputting an external AV signal, according to the Wi-Fi Direct communication standard Therefore, a wireless communication interface unit for transmitting and receiving a predetermined signal including the AV signal with an external mobile terminal, first connection history information for the connected mobile terminals, and Wi-Fi Direct with the mobile terminal A storage unit for storing an application program for a wireless communication connection according to a communication standard, authentication information for setting a wireless communication network with the mobile terminal, and automatically generating a connection request message based on the first connection history information; And a control unit for transmitting to a mobile terminal having a connection history.

In a preferred embodiment, the first connection history information includes information on whether there is a connection with an external mobile terminal, and identification information of the previously connected mobile terminal.

In an embodiment, the controller may refer to the first connection history information and, when there is a fact that the mobile terminal is connected to an external mobile terminal, the application program for wireless communication connection according to a Wi-Fi Direct communication standard. Will run automatically.

In another embodiment, after the application program is automatically executed, the control unit uses a wireless communication network interface including a Bluetooth communication network interface and a 3G / 4G communication network interface. Fi Direct) Broadcasts a message requesting the execution of an application program for wireless communication connection according to the communication standard.

In another embodiment, the control unit is a mobile terminal having the identification information, if there is a mobile terminal corresponding to the identification information of the connected mobile terminal among the inquiry neighboring mobile terminal as a result of the scan (discovery) for the neighboring mobile terminal; Send the connection request message automatically.

In another embodiment, when the control unit receives a connection response message from the mobile terminal having the identification information, the controller connects the wireless communication interface according to the Wi-Fi Direct communication standard with the mobile terminal having the identification information. The mobile terminal having the identification information automatically generates and transmits the connection response message when the connection request message is received from a video display device having a previously connected history.

Meanwhile, the mobile terminal having the identification information stores application history information about an application program executed while the image display device and the wireless communication interface according to the Wi-Fi Direct communication standard are connected, and displays the image. When the device and the wireless communication interface according to the Wi-Fi Direct communication standard are connected, any application is automatically executed based on the application history information.

According to the present invention, after using the first service for transmitting the Wi-Fi Miracast screen between the video display device such as the head unit of the vehicle and the mobile terminal, the Mac address, the device name, etc. of the two devices are stored, and afterwards, You can use the Wi-Fi Miracast screen transmission technology automatically without any operation.

1 is a diagram showing the configuration of a Wi-Fi Direct communication network.
FIG. 2 is a block diagram illustrating an internal configuration of an image display apparatus connected to automatic wireless communication between devices according to an embodiment of the present invention.
3 is a flowchart for explaining an operation performed in an image display apparatus according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is said to "include" a certain component, it means that it can further include other components, except to exclude other components unless specifically stated otherwise. In addition, the terms “… unit”, “… unit”, “module”, etc. described in the specification mean a unit that processes at least one function or operation, which may be implemented by hardware or software or a combination of hardware and software. have.

1 is a diagram illustrating a configuration of a Wi-Fi Direct communication network.

Wi-Fi Direct communication network is based on peer-to-peer communication based on direct device-to-device communication without the need for an Internet connection or a network relay device such as a wireless access point (AP) in one Wi-Fi Direct network. Peer to Peer) A communication network that implements transport.

Referring to FIG. 1, a wireless communication network according to Wi-Fi Direct includes a video display device 10 such as an IPTV (Internet Protocol Television), a PC 20, a mobile communication terminal A 30 and B ( 40), it supports simultaneous connection between up to eight electronic devices, such as game console 50.

Wi-Fi Direct can implement a wireless communication network without a wireless router, an access point (AP), which is a wireless network relay device that was previously required for using Wi-Fi. Wi-Fi Direct uses 802.11n, a wireless LAN standard, to transmit data up to 300Mbps and coverage of 120m. In addition, the latest encryption technologies such as Wi-Fi Protected Access 2 (WPA2), Wi-Fi Positioning System (WPS), and the like can also be used, thereby improving security during communication.

For the first connection between wireless network devices in a Wi-Fi Direct network, the IPTV 10 broadcasts its identifier, that is, a Service Set Identifier (SSID), and the PC 20 broadcasts the broadcasted SSID. Receives and detects all identifier information located in the vicinity. The PC 20 selects and connects any one of all detected identifiers, thereby making a connection with the wireless network device of the selected identifier.

Near field communication (NFC) is also used as a connection method between wireless network devices in a Wi-Fi Direct network. NFC establishes the initial connection with physical proximity between wireless network devices and is used for transportation cards, tickets, and payments.

In order to secure a connection between wireless network devices in a Wi-Fi Direct network, WEP (Wired Equivalent PRivacy), WPA / WPA2 (WiFi Protected Access / WiFi Protected Access2), and WPS (WiFi Protected Setup) may be used.

WEP is a challenge / response security. When the IPTV 10 searches for an identifier of the PC 20 and performs an access request, the PC 20 clear-text. ) Is transmitted to the IPTV 10 to encrypt the clear text with the security key previously distributed in the IPTV 10, and then transmitted to the PC 20 to authenticate the security credentials and establish a connection.

WPA / WPA2 is a security method that improves security vulnerabilities in WEP. Its main function is to prevent per-packet key mixing and packet forgery / falsification attacks. User authentication, access control, authorization verification, data confidentiality and integrity are supported.

WPS addresses the challenge of establishing the initial connection to the strong security features of WPA. Each wireless network device with WPS has a physical / virtual button and can establish a connection at the click of a button between the devices.

Meanwhile, in FIG. 1, the connection between wireless network devices in a Wi-Fi Direct network is IPTV 10, PC 20, or PC 20 and other wireless communication devices 30, 40, and 50. Although illustrated as being made in between, for convenience of description, an embodiment of the present invention assumes a situation where a Wi-Fi Direct based wireless network is connected between a head unit (including a display unit) mounted in a vehicle and a mobile terminal. do.

Accordingly, the image display apparatus described in the following embodiments of the present invention refers to a head unit of a vehicle including a display unit, and a mobile terminal refers to a portable user terminal such as a smart phone.

FIG. 2 is a block diagram illustrating an internal configuration of an image display apparatus connected to automatic wireless communication between devices according to an exemplary embodiment of the present invention.

Referring to FIG. 2, the video display device 100 of the present invention receives a predetermined signal including an audio / video (AV) signal from the outside without using a wireless network relay device such as an access point (AP). And a display unit 130 that outputs the screen. Here, the AV (Audio-Video) signal includes all signals capable of displaying a visually recognizable screen.

In the image display apparatus 100 according to an exemplary embodiment of the present invention, a Wi-Fi Direct communication network may be used as the wireless communication network 140 between the mobile terminals 10. Accordingly, the video display device 100 includes wireless LANs supporting the Wi-Fi Direct protocol for directly communicating between nodes without an access point (AP). Hereinafter, a case in which a Wi-Fi Direct communication network is used as the wireless communication network 140 between the mobile terminals 10 in the video display device 100 will be described as an example.

FIG. 2 is a block diagram illustrating an internal configuration of an image display apparatus connected to automatic wireless communication between devices according to an exemplary embodiment of the present invention.

Referring to FIG. 2, the image display apparatus 100 according to an exemplary embodiment of the present invention may include a wireless communication interface 110, a controller 120, a display 130, a storage 140, and an audio processor 150. And a video processor 160.

The wireless communication interface 110 transmits and receives predetermined data with the external mobile terminal 10 according to a wireless communication network that satisfies the Wi-Fi Direct communication standard. The wireless communication interface unit 110 receives an AV signal transmitted from the external mobile terminal 10 and transmits it to the control unit 120.

The controller 120 controls the video screen corresponding to the transmitted AV signal to be displayed. In detail, the control unit 120 receives an AV signal transmitted through the wireless communication interface unit 110, and when the AV signal is not a display format-converted signal, the display unit 130 may display the display format. Can be converted and output according to.

In addition, the controller 120 may receive the AV signal transmitted from the external mobile terminal 10 connected through the Wi-Fi Direct protocol and control the AV signal to be output to the display 130. In particular, the user may access the Wi-Fi Direct communication network to download the desired application or the application list into the display unit 130.

On the other hand, in the present invention, the control unit 120 allows the external mobile terminal 10 and the wireless communication interface according to the Wi-Fi Direct communication standard is automatically connected. Hereinafter, look at the specific configuration for this.

The controller 120 generates authentication information for establishing a wireless communication network with the mobile terminal, and automatically generates a connection request message based on the connection history information and transmits the connection request message to the mobile terminal having the connection history.

In detail, the control unit 120 may refer to connection history information and, when there is a fact that the mobile terminal is connected to an external mobile terminal, provides an application program for wireless communication connection according to the Wi-Fi Direct communication standard. Run automatically. Here, the application program is stored in the storage 140, which will be described later.

In addition, after the application program is automatically executed, the controller 120 uses a wireless communication network interface including a Bluetooth communication network interface and a 3G / 4G communication network interface. Fi Direct) Broadcasts a message requesting the execution of an application program for wireless communication connection according to the communication standard.

In addition, when there is a mobile terminal corresponding to identification information of a previously connected mobile terminal among the inquired neighboring mobile terminals as a result of the scan / discovery of the neighboring mobile terminals, the controller 120 has the mobile terminal having the identification information. Send the connection request message automatically.

In addition, when receiving a connection response message from the mobile terminal having the identification information, the controller 120 connects the mobile terminal having the identification information to a wireless communication interface according to a Wi-Fi Direct communication standard. . In this case, the mobile terminal having the identification information automatically generates and transmits the connection response message when the connection request message is received from an image display apparatus having a previously connected history.

Specifically, the mobile terminal having the identification information stores application history information about an application program executed while the image display device and the wireless communication interface according to the Wi-Fi Direct communication standard are connected, When the image display device and the wireless communication interface according to the Wi-Fi Direct communication standard are connected, any application is automatically executed based on the application history information.

The storage unit 140 may be configured of a program memory and a data memory. The program memory stores an operation program of the display unit 130 and an application program for a wireless communication interface according to a Wi-Fi Direct communication standard. In addition, the data memory may store a program for processing and controlling each signal in the controller 120, or may store a signal processed video, audio, or data signal.

In addition, the data memory of the storage unit 140 stores a multimedia storage area for storing one or more multimedia files (audio files, video files, etc.) and playback information (volume information, tone information, speed information, etc.) for the multimedia files. And a playback control information storage area.

In addition, the storage 140 may further include a connection information storage area for storing information on whether there is a connection with an external mobile terminal and whether connection history information including identification information of the previously connected mobile terminal is stored. .

Hereinafter, an image display method or an automatic wireless communication network connection process performed in the image display apparatus according to the present invention will be described with reference to FIG. 3.

3A illustrates an operation performed by the image display apparatus when the external mobile terminal is initially connected, and FIG. 3B illustrates an operation performed by the image display apparatus when there is a connection history with the external mobile terminal.

Referring to FIG. 3A, the video display device 100 and the external mobile terminal (eg, Wi-Fi Direct) are initially set by the video display device 100 to establish an external mobile terminal 10 and a wireless communication network (for example, Wi-Fi Direct). 10) performs a search (scan / discovery) for device discovery (S10).

The video display device 100 transmits a connection request message to the found mobile terminal 10 (S20), and the mobile terminal 10 provides authentication information (universal resource locator (URL) information and PIN information for accessing the authentication server). Etc.) and a connection response message to the video display device 100 (S30 and S40). The authentication information may include identifier PIN (Internet Personal Identification Number) information of the mobile terminal 10 that has been granted since manufacture, an ID generated based on the PIN information, and the like. The authentication information may be transmitted from a service provider server that provides a wireless communication network (for example, Wi-Fi Direct) service.

The video display device 100 authenticates the connection of the wireless communication network based on the received authentication information, and accordingly, the wireless communication interface (or wireless communication network) according to the Wi-Fi Direct standard is connected between the mobile terminals 10. It becomes (S50).

In this case, each of the video display device 100 and the mobile terminal 10 stores information related to the fact of connection establishment and connection history information including identification information of the connected devices as a database (S51 and S52).

The AV signal output from the mobile terminal 10 while the wireless communication interface is connected is transmitted to the image display apparatus 100 (S60), and the image display apparatus 100 converts the AV signal into a predetermined format and displays the display unit. Output on (S61).

Referring to FIG. 3B, when the power of the image display device 100 is turned on, the mobile terminal and the Wi-Fi Direct (Wi−-) may be previously described with reference to history information stored in the access information storage area of the storage 140. Fi Direct) checks whether there is a history of connecting the wireless communication interface according to the communication standard (S101).

If it is confirmed that there is a connection history before, the application program for the wireless communication connection stored in the storage unit 140 is automatically executed (S102).

After the application program is executed, the video display device 100 uses a wireless communication network interface including a Bluetooth communication network interface and a 3G / 4G communication network interface, and thus, Wi-Fi stored in the mobile terminal 10. Direct) broadcasts a request message so that an application program for wireless communication connection according to the communication standard can be executed (S103).

The mobile terminal 10 receiving the broadcasted request message executes an application program (S104), and the image display apparatus 100 and the mobile terminal 10 perform a search (scan / discovery) for device discovery (S104). S105).

As a result of the scan / discovery of the neighboring mobile terminals, if there is a mobile terminal corresponding to the identification information of the connected mobile terminal among the inquired neighboring mobile terminals, the mobile terminal having the identification information and the Wi-Fi Direct In step S106, transmit a request message to connect to a wireless communication interface according to a communication standard.

Meanwhile, when the mobile terminal 10 having the identification information receives the connection request message, the mobile terminal 10 checks whether the connection request message is received from an image display apparatus having a pre-connected history, and displays the image with a pre-connected history. If it is received from the device automatically generates a connection response message and transmits to the video display device 100 (S107).

A wireless communication interface (or a wireless communication network) conforming to the Wi-Fi Direct standard is connected between the image display device 100 and the mobile terminal 10 as a result of transmitting and receiving a request message and a response message (S108).

Meanwhile, the mobile terminal 10 having the identification information may store application history information regarding an application program executed while the image display device and the wireless communication interface according to the Wi-Fi Direct communication standard are connected. .

In this case, when the image display device 100 and the wireless communication interface according to the Wi-Fi Direct communication standard are connected, the mobile terminal 10 automatically executes an arbitrary application based on the application history information. The AV signal is transmitted to the video display device 100 according to the execution.

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and changes without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

Claims (11)

delete delete delete delete delete delete delete An image display method of an image display apparatus including a display unit which externally receives an AV signal and outputs the same.
Confirming wireless communication interface connection information according to a Wi-Fi Direct communication standard with an external mobile terminal by referring to connection history information when the image display apparatus is powered on;
If the image display device determines that there is a connection history previously according to the confirmation of the connection information, automatically executing an application program that performs a Miracast function;
After the application program is executed, the image display device uses a wireless communication network interface including a Bluetooth communication network interface and a 3G / 4G communication network interface, and then uses Wi-Fi Direct communication stored in an external mobile terminal. Broadcasting a request message so that an application program for a wireless communication connection according to the standard can be executed;
Automatically executing an application program for performing the Miracast function by neighboring mobile terminals receiving the request message;
Performing the search / discovery for device discovery by the neighboring mobile terminals receiving the image display device and the request message as the neighboring mobile terminals automatically execute the application program;
When there is a mobile terminal corresponding to the identification information of the connected mobile terminal among the inquired neighboring mobile terminals as a result of the scan / discovery of the neighboring mobile terminals, the image display device has a mobile terminal and the Wi-Fi having the identification information. Connecting a wireless communication interface according to a Wi-Fi Direct communication standard;
Outputting the AV signal transmitted from the mobile terminal having the identification information on the display unit;
Image display method comprising a.
The method of claim 8, wherein connecting to the wireless communication interface comprises:
Automatically transmitting the connection request message to the mobile terminal having the identification information;
When receiving a connection response message from the mobile terminal having the identification information, comprising the step of connecting the mobile terminal having the identification information and a wireless communication interface according to the Wi-Fi Direct communication standard,
The mobile terminal having the identification information automatically generates and transmits the connection response message when the connection request message is received from a video display device having a previously connected history.
Image display method. The method of claim 8, wherein the connection history information,
Including information on whether there is a connection with an external mobile terminal in advance and identification information of the previously connected mobile terminal
Image display method. The method of claim 8, wherein the mobile terminal having the identification information,
Store application history information regarding an application program executed while the image display device and a wireless communication interface according to a Wi-Fi Direct communication standard are connected;
Automatically executing any application based on the application history information when the image display device and the wireless communication interface according to the Wi-Fi Direct communication standard are connected.
Image display method.

Images