CN103593130A - Portable device - Google Patents

Abstract

A portable device comprises a touch display panel, a communication interface and a processing unit. The processing unit generates a first reference coordinate according to at least one touch point on the touch display panel and operates according to the first reference coordinate, the first reference coordinate is a reference position on a picture displayed by the touch display panel, and the processing unit generates first picture data to the touch display panel. When the communication interface is connected with the external display device, the processing unit generates a second reference coordinate according to at least one touch point on the touch display panel and operates according to the second reference coordinate, the second reference coordinate indicates a reference position on a picture displayed by the external display device, and the processing unit generates second picture data and transmits the second picture data to the external display device through the communication interface.

Description

portable device

technical field

The present invention relates to an electronic device, and in particular to a portable device.

Background technique

The mobile phone can be connected to the personal computer through wireless communication. Users can use the mobile phone as a touchpad of the personal computer by installing an application program (App) on the mobile phone and the personal computer. The touch panel of the mobile phone controls the operation of the external personal computer to display the screen. However, this known technology requires a personal computer to generate frame data to display corresponding frames. Furthermore, when the mobile phone is connected to a personal computer, the user needs to look back and forth between the screen of the mobile phone and the screen of the external personal computer, which increases the inconvenience of operation.

Contents of the invention

The invention provides a portable device, which is used to enable the user to focus on the screen of the external display device when establishing a connection with the external display device, thereby increasing the convenience of operation.

An embodiment of the present invention provides a portable device, including a touch display panel, a communication interface, and a processing unit. The processing unit is coupled to the touch display panel and the communication interface. When the communication interface is not connected with the external display device, the processing unit switches to the first operation mode. In the first operation mode, the processing unit generates first reference coordinates according to at least one touch point on the touch display panel and performs operations according to the first reference coordinates. The first reference coordinates indicate the touch display panel Reference position on the displayed screen. In the first operation mode, the processing unit generates first frame data, and the first frame data is used to transmit to the touch display panel, so that the touch display panel displays a frame represented by the first frame data. When the communication interface establishes a connection with the external display device, the processing unit switches to the second operation mode. In the second operation mode, the processing unit generates second reference coordinates according to at least one touch point on the touch display panel and performs operations according to the second reference coordinates. The second reference coordinates indicate the image displayed on the external display device The reference position on . In the second operation mode, the processing unit generates second picture data, and the second picture data is used to transmit to the external display device through the communication interface, so that the external display device displays the picture represented by the second picture data.

In an embodiment of the present invention, in the first operation mode, the processing unit generates first reference coordinates based on an absolute position corresponding to the at least one touch point on the touch display panel.

In an embodiment of the present invention, in the second operation mode, the processing unit generates second reference coordinates based on a relative position corresponding to the at least one touch point on the touch display panel.

In an embodiment of the present invention, in the second operation mode, the processing unit generates a second reference coordinate based on a relative position generated by a pointing device, and the external display device is coupled to or includes the pointing device.

In an embodiment of the present invention, in the second operation mode, the processing unit receives pointing data corresponding to the relative position from an external display device through the communication interface.

In an embodiment of the present invention, the above-mentioned pointing device is a mouse, a trackball or a touch pad.

In an embodiment of the present invention, in the second operation mode, the processing unit further receives an input signal from an external display device through the communication interface, and performs a corresponding operation according to the input signal. Wherein, the input signal is generated by an input device and obtained through processing by the external display device, and the external display device is coupled to or includes the input device.

In an embodiment of the present invention, the above-mentioned input device is a keyboard, a character input device or a touch panel.

In an embodiment of the present invention, in the second operation mode, in the frame represented by the second frame data, a cursor is displayed at the reference position indicated by the second reference coordinates. The cursor moves in response to the movement of the at least one touch point.

In an embodiment of the present invention, in the first operation mode, in the frame represented by the first frame data displayed on the touch display panel, no cursor is displayed at the reference position indicated by the first reference coordinates.

In an embodiment of the present invention, in the second operation mode, the second frame data is not transmitted to the touch display panel, so that the touch display panel does not display frames according to the second frame data.

In an embodiment of the present invention, in the second operation mode, the processing unit also transmits the third picture data to the touch display panel, so that the touch display panel displays the picture represented by the third picture data .

In an embodiment of the present invention, the above-mentioned second frame data and the third frame data are at least partly the same.

In an embodiment of the present invention, the above-mentioned second frame data is different from the third frame data.

In an embodiment of the present invention, when the communication interface establishes a connection with the external display device, the touch display panel and the external display device simultaneously display images with the same content.

In an embodiment of the present invention, in the second operation mode, the touch display panel and the external display device display images with different contents.

In an embodiment of the present invention, in the first operation mode, the screen displayed on the touch display panel has a first desktop layout. In the second operation mode, the screen displayed on the external display device has a second desktop layout. Wherein, the first desktop layout is different from the second desktop layout.

In an embodiment of the present invention, for the image data from the same source, the single image displayed on the external display device in the second operation mode is compared with the single image displayed on the touch display panel in the first operation mode. A single frame is to display more data in the image data from the same source.

In an embodiment of the present invention, the above-mentioned more data includes more page data or more desktop data.

In an embodiment of the present invention, the above-mentioned more pages of data include: data of a larger area in the data of a single page, or data of a larger number of pages in the data of multiple pages.

In an embodiment of the present invention, the above-mentioned more desktop data includes data of more desktop icons in a single desktop data.

In an embodiment of the present invention, in the first operation mode, at least one touch operation gesture on the touch display panel is associated with at least one corresponding operation in a first correspondence relationship. In the second operation mode, at least one touch operation gesture on the touch display panel is associated with at least one corresponding operation in a second correspondence relationship. Wherein, the first correspondence is different from the second correspondence.

In an embodiment of the present invention, in the second operation mode, the screen represented by the second screen data includes one or more operation links, corresponding to one or more operation programs, and the processing unit responds to the touch display panel The operation gesture corresponding to the operation link located at the second reference coordinate is started.

In an embodiment of the present invention, in the second operation mode, the processing unit responds to a zoom-in or zoom-out operation gesture on the touch display panel to zoom in or zoom out the partial area including the second reference coordinates.

In an embodiment of the present invention, the communication protocols run by the above-mentioned communication interface include Mobile High-definition Link (MHL), High-Definition Multimedia Interface (High-Definition Multimedia Interface, HDMI), universal Serial bus (Universal SerialBus, USB), mini-DisplayPort (mini-DisplayPort, mDP) or Intel Wireless Display (IntelWireless Display, WiDi).

In an embodiment of the present invention, in the second operation mode, the processing unit adjusts the resolution of the second image data according to the display resolution returned by the external display device.

Based on the above, the embodiment of the present invention provides a portable device, which determines whether the processing unit switches to the first operation mode or the second operation mode according to whether the connection is established with the external display device. In the first operation mode, the processing unit generates a first reference coordinate according to at least one touch point on the touch display panel, and operates according to the first reference coordinate, wherein the first reference coordinate indicates the touch display The reference position on the screen displayed on the panel. In the second operation mode, the processing unit generates a second reference coordinate according to at least one touch point on the touch display panel, and operates according to the second reference coordinate, wherein the second reference coordinate indicates the external display device Reference position on the displayed screen. Therefore, when establishing a connection with the external display device, the user can focus on the screen of the external display device, which increases the convenience of operation.

In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail together with the accompanying drawings.

Description of drawings

FIG. 1 is a schematic block diagram illustrating a circuit of a portable device and an external display device according to an embodiment of the present invention.

FIG. 2 is a schematic flowchart illustrating an operation method of a portable device according to an embodiment of the invention.

FIG. 3 is a schematic diagram illustrating an operation situation of the portable device shown in FIG. 1 and an external display device according to an embodiment of the present invention.

FIG. 4 is a schematic diagram illustrating an operation situation of the portable device shown in FIG. 1 and the external display device according to another embodiment of the present invention.

FIG. 5 is a schematic diagram illustrating an operation situation of the portable device and the external display device shown in FIG. 1 according to yet another embodiment of the present invention.

FIG. 6 is a schematic block diagram illustrating a circuit of a portable device and an external display device according to another embodiment of the present invention.

FIG. 7 is a schematic flowchart illustrating an operation method of a portable device according to another embodiment of the present invention.

[Description of main component labels]

10, 20: External display device 11: Display panel

12: Display chip 13: Communication interface

14: pointing device 15: input device

100: Portable device 110: Touch display panel

120: Processing unit 130: Communication interface

310: cursor 411, 412, 413, 414: control icons

S205～S250, S710: steps

Detailed ways

The term "coupled" used throughout this specification (including claims) may refer to any direct or indirect means of connection. For example, if it is described that a first device is coupled to a second device, it should be interpreted that in some embodiments, the first device may be directly connected to the second device, or in other embodiments, the first A device may be indirectly connected to a second device through another device or some connection means.

FIG. 1 is a schematic circuit block diagram illustrating a portable device 100 and an external display device 10 according to an embodiment of the present invention. The external display device 10 may be a television, a monitor, a projector or other display devices. In this embodiment, the external display device 10 includes a display panel 11 , a display chip 12 and a communication interface 13 . The display chip 12 is coupled to the display panel 11 and the communication interface 13 . The display chip 12 can receive the image data output by the external device (such as the portable device 100 ) through the communication interface 13 , and then drive the display panel 11 according to the image data, so that the display panel 11 displays the image represented by the image data.

The display panel 11 is, for example, a cathode ray tube (cathode ray tube, CRT) display, a liquid crystal display (liquid crystal display, LCD) panel, a plasma display panel (plasma display panel, PDP), an organic light emitting diode (organic light emitting diode, OLED) ) panel, or other display panels. If the external display device 10 is a projector, the display panel 11 is, for example, a liquid crystal on silicon (LCOS) panel, a digital light processing (DLP) panel or other display panels. The image light from the display panel 11 can be projected to the outside of the display device 10 through an optical engine structure.

The communication interface 13 can be a wired communication interface or a wireless communication interface. The so-called communication interface 13 herein may refer to a single interface or multiple interfaces. For example, the communication interface 13 can be an image graphics array (Video Graphics Array, hereinafter referred to as VGA) interface, a digital video interface (Digital Visual Interface, hereinafter referred to as DVI), a high-resolution multimedia interface (High-Definition Multimedia Interface, hereinafter referred to as HDMI), Universal Serial Bus (hereinafter referred to as USB) interface, mini-DisplayPort (hereinafter referred to as mDP) interface, Mobile High-definition Link (hereinafter referred to as MHL) interface or other wired communication interface. Alternatively, the communication interface 13 may be a Wireless Fidelity (Wide Fidelity, hereinafter referred to as WiFi) interface, an Intel Wireless Display (Intel Wireless Display, hereinafter referred to as WiDi) interface or other wireless communication interfaces.

The portable device 100 may be a smartphone, a tablet computer or other portable electronic devices with a touch panel. In this embodiment, the portable device 100 includes a touch display panel 110 , a processing unit 120 and a communication interface 130 . The touch display panel 110 may be any type of display panel with a touch function. The processing unit 120 is coupled to the touch display panel 110 and the communication interface 130 . The processing unit 120 can communicate with external devices through the communication interface 130 . The communication interface 130 can be a wired communication interface or a wireless communication interface, such as a VGA interface, DVI, HDMI, USB interface, mDP interface, MHL interface, WiFi interface, WiDi interface and the like. In some embodiments, when the portable device 100 is connected with the external display device 10, the external display device 10 can charge the portable device 100 through the communication interfaces 13 and 130 (such as USB).

FIG. 2 is a flow chart illustrating the operation method of the portable device 100 according to an embodiment of the present invention. Please refer to FIG. 1 and FIG. 2 , in step S205 , the communication interface 130 detects whether there is a signal from an external device. Therefore, the processing unit 120 can determine whether the portable device 100 has established a connection with the external display device 10 according to the detection result of the communication interface 130 (step S210 ). When the communication interface 130 is not connected to the external display device 10, the processing unit 120 switches to the first operation mode (step S215).

In the first operation mode, the processing unit 120 generates first reference coordinates according to one or more touch points touched by the user on the touch display panel 110 (step S220 ). Wherein, the first reference coordinate indicates a reference position on the screen displayed on the touch display panel 110 . For example, in the first operation mode, the processing unit 120 generates the first reference coordinates based on the absolute position (actual position) of the touch point on the touch display panel 110 .

After obtaining the first reference coordinates, the processing unit 120 may perform corresponding operations according to the first reference coordinates (step S225 ). For example, the processing unit 120 performs general operations of the smart phone according to gestures (eg, defined by quantity, position and/or moving direction) represented by one or more touch points on the touch display panel 110 . For example, if two user touch points on the touch display panel 110 indicate a zoom-in operation gesture, the processing unit 120 may generate the first reference coordinate based on the central position between the two touch points , and the processing unit 120 zooms in on the partial area including the first reference coordinate in response to the zoom-in operation gesture. If a single user touch point on the touch display panel 110 is an operation gesture representing a moving object, the processing unit 120 generates the first reference coordinates based on the position of the single touch point, and the processing unit 120 responds to The moving operation gesture moves the object at the position of the touch point. Therefore, according to the operation of step S225, the processing unit 120 can correspondingly generate the first frame data to the touch display panel 110 (step S230), so that the touch display panel 110 displays the frame represented by the first frame data. After step S230 is completed, the portable device 100 returns to step S205. It should be noted that, in the first operation mode, in the screen represented by the first screen data displayed on the touch display panel 110, the reference position indicated by the first reference coordinates may or may not display a cursor. .

When step S210 determines that the connection between the communication interface 130 and the external display device 10 is established, the processing unit 120 switches to the second operation mode (step S235 ). In the second operation mode, the processing unit 120 generates second reference coordinates according to one or more touch points touched by the user on the touch display panel 110 (step S240 ). Wherein, the second reference coordinate indicates a reference position on the screen displayed by the external display device 10 . For example, in the second operation mode, the processing unit 120 generates the second reference coordinate based on the relative position of the touch point on the touch display panel 110, wherein the position of the second reference coordinate does not represent the touch Pointing on the position of the touch display panel 110 indicates the reference position on the screen displayed on the external display device 10 . In addition, the movement of the second reference coordinates is in response to the movement of the touch point on the touch display panel 110 , so the movement of the touch point on the touch display panel 110 , the second reference coordinates are displayed on the screen displayed on the external display device 10 The reference position above will also move accordingly. In other words, the processing unit 120 generates the second reference coordinates based on the relative position of the touch point on the touch display panel 110 . The starting position of the second reference coordinates can be set as a center position of the picture displayed on the external display device 10 , or other predetermined positions, for example.

After obtaining the second reference coordinates, the processing unit 120 may perform operations according to the second reference coordinates (step S245). The processing unit 120 can determine whether the gesture represented by the user's one or more touch points on the touch display panel 110 (for example, defined by the number, position and/or direction of movement) belongs to movement, click (click), double-tap (double click) or other gestures, and then perform corresponding operations according to the second reference coordinates. For example, by touching the touch display panel 110 of the portable device 100, the user can move the cursor (Cursor) on the screen displayed on the external display device 10 to the object (such as text, pattern, etc.) on the display panel 11. , button, etc.). When the user clicks, double-taps or other gestures at any position on the touch display panel 110 of the portable device 100, the processing unit 120 can calculate the position of the cursor on the screen displayed on the external display device 10 (that is, the second reference coordinate position) to select or hyperlink (Hyperlink) and other operations.

For example, if a single user touch point on the touch display panel 110 is an operation gesture representing movement, the processing unit 120 moves the second touch point based on the movement direction of the single touch point on the touch display panel 110 . The reference coordinates indicate the reference position on the screen displayed by the external display device 10 . If the two touch points on the touch display panel 110 in the second operation mode represent a zoom-in (or zoom-out) operation gesture, the processing unit 120 responds to the zoom-in (or zoom-out) operation gesture to include the Partial areas of the second reference coordinates are enlarged (or reduced).

Therefore, according to the operation of step S245, the processing unit 120 can correspondingly generate the second frame data. The second frame data is transmitted to the external display device 10 through the communication interface 130 (step S250 ), so that the external display device 10 displays the frame represented by the second frame data. After step S250 is completed, the portable device 100 returns to step S205.

It should be noted that, in some embodiments, the communication connection between the portable device 100 and the external display device 10 may be unidirectional, that is, the portable device 100 transmits data including the second screen and other control commands. to an external display device 10. In other embodiments, the communication connection between the portable device 100 and the external display device 10 can be bidirectional. When the portable device 100 establishes a connection with the external display device 10 , the portable device 100 can receive a control command from the external display device 10 . That is to say, the portable device 100 communicates with the external display device 10 via the communication interface 13 , 130 in two directions. For example, the portable device 100 can read resolution information, frequency information, image encryption and decryption information supported by the external display device 10 or other information of the external display device 10 . When the communication interface 130 establishes a connection with the external display device 10 , the external display device 10 can send back the resolution of the display panel 11 to the portable device 100 . The processing unit 120 can adjust the resolution (or frame size) of the second frame data according to the display resolution returned by the external display device 10 .

In other words, when the portable device 100 establishes a connection with the external display device 10, the display chip 12 can notify the portable device 100 of the current status and/or response of the external display device 10 through the control channel between the communication interfaces 12 and 130. Data required by the portable device 100 . For example, the portable device 100 can receive the resolution information of the display panel 11 from the external display device 10 via the control channel. On the other hand, the portable device 100 transmits image data to the external display device 10 via the data channel between the communication interfaces 12 and 130 . It is worth noting that the control command (such as the resolution information of the display panel 11 or other information) is transmitted from the external display device 10 to the control channel (channel or bus) of the portable device 100, and from the portable device 100 The data channels for transmitting the image data to the external display device 10 may be different channels or the same channel.

In this embodiment, the user can use the portable device 100 for document processing, multimedia playback, web browsing or other functional applications. The user's operation on the touch display panel 110 is to directly control the portable device 100 itself instead of controlling the external display device 10 . In other words, relevant programs such as document processing, multimedia playback, web browsing, or other functional applications can be stored in the memory device (not shown) in the portable device instead of the external display device 10 . However, if the screen size of the touch display panel 110 is reduced due to the requirement of portability, the convenience of operation will be limited because the touch display panel 110 is too small. Such as browsing the network, editing files, watching movies or other multimedia files, etc., a larger display screen can increase the convenience of operation or viewing effect. Therefore, the user can connect the external display device 10 to the portable device 100 . When the portable device 100 establishes a connection with the external display device 10, the portable device 100 can transmit the image data to the external display device 10 through the communication interface 130, so that the external display device 10 displays the image represented by the image data. Using the external display device 10 with a large display area to display images/pictures, the user can conveniently browse the Internet, play multimedia files, edit files or perform other operations in a comfortable view.

It should be noted that when the communication interface 130 establishes a connection with the external display device 10 , the touch display panel 110 can selectively display (or not display) images. For example, in some embodiments, in the second operation mode, the second frame data may not be transmitted to the touch display panel 110 so that the touch display panel 110 does not display frames according to the second frame data. In this case, the processing unit 120 may disable the display function of the touch display panel 110 to reduce power consumption. In some other embodiments, in the second operation mode, in addition to transmitting the second picture data to the external display device 10, the processing unit 120 may also transmit the third picture data to the touch display panel 110, so that the touch The control display panel 110 displays the picture represented by the third picture data. According to the application scenarios of different embodiments, the second picture data and the third picture data may be at least partly the same, completely the same, or totally different (or irrelevant). Therefore, when the communication interface establishes a connection with the external display device, the touch display panel 110 and the external display device 10 can simultaneously display images with the same contents, or display images with different or even irrelevant contents.

In the above-mentioned second operation mode, the reference position indicated by the second reference coordinates can be prompted (or not) in any way to the user on the screen displayed on the external display device 10 according to the design requirements of the actual product. For example, FIG. 3 is a schematic diagram illustrating an operation situation of the portable device 100 and the external display device 10 shown in FIG. 1 according to an embodiment of the present invention. In the above-mentioned second operation mode, the external display device 10 receives the second frame data provided by the portable device 100 , and the display panel 11 of the external display device 10 displays the frame represented by the second frame data. In this embodiment, the touch display panel 110 of the portable device 100 and the display panel 11 of the external display device 10 are an example of simultaneously displaying images with the same content. As shown in FIG. 3 , in the picture represented by the second picture data (that is, the picture shown on the display panel 11 of the external display device 10 ), the reference position indicated by the second reference coordinate is additionally displayed with a cursor (cursor) 310. And the screen displayed by the touch display panel according to the first screen data in the first operation mode, and/or the screen displayed according to the third screen data in the second operation mode, the position indicated by the first reference coordinate The cursor may not be displayed.

The movement of the cursor 310 is in response to the movement of the touch point on the touch display panel 110 . The user can move the cursor 310 by sliding the finger on the touch display panel 110 of the portable device 100 to increase the convenience of use. For example, if the moving direction of the touch point on the touch display panel 110 is upward right, the processing unit 120 correspondingly moves the cursor 310 (ie, the reference position indicated by the second reference coordinates) upward right. If the cursor 310 indicates that the reference position is at the upper right position of the screen displayed on the display panel 11 of the external display device 10, then although the zoom-in operation gesture (touch point) is at the center of the touch display panel 110 of the portable device 100 , but the processing unit 120 zooms in on the upper right area containing the cursor 310 in response to the zoom-in operation gesture. Therefore, when the portable device 100 is connected with the external display device 10 , the user can focus on the screen of the external display device 10 without looking at the touch display panel 110 , which increases the convenience of operation.

Generally speaking, the resolution of the display panel 11 of the external display device 10 may be higher than the resolution of the touch display panel 110 of the portable device 100 . When the portable device 100 switches to the above-mentioned second operation mode, the image resolution output from the portable device 100 to the external display device 10 can also be selected, and the image data is output at a higher resolution. Even, with the larger display panel 11 of the external display device 10, the portable device 100 can also have different desktop layouts (such as desktop size, icon size, quantity, position configuration, etc.) for users to choose or use. In other words, in the first operation mode, the screen displayed on the touch display panel 110 has a first desktop layout. In the second operation mode, the screen displayed on the external display device 10 has a second desktop layout. Wherein, the first desktop layout can be the same as or different from the second desktop layout.

FIG. 4 is a schematic diagram illustrating an operation situation of the portable device 100 and the external display device 10 shown in FIG. 1 according to another embodiment of the present invention. For the embodiment shown in FIG. 4 , reference may be made to the related description of FIG. 3 . In this embodiment, the image displayed by the touch display panel 110 of the portable device 100 and the image displayed by the display panel 11 of the external display device 10 are partially identical as an example. As shown in FIG. 4 , compared with the screen displayed on the touch display panel 110 , the screen shown on the display panel 11 of the external display device 10 further includes a control bar, wherein the control bar includes a plurality of control icons (icon) 411 , 412, 413 and 414. The user can move the cursor 310 displayed on the display panel 11 of the external display device 10 to one of the control icons 411-414 by inputting an operation gesture on the touch display panel 110 of the portable device 100, so as to trigger the portable device 100. The processing unit 120 of the device 100 performs corresponding control functions.

In other embodiments, the screen displayed on the display panel 11 of the external display device 10 may additionally include one or more text or operation links, wherein these operation links correspond to one or more operations respectively, such as opening an application program, opening an operation menu, etc. Appears, or the URL link of the browser...etc. The processing unit 120 of the portable device 100 responds to the opening operation gesture on the touch display panel 110, and starts the operation program corresponding to the operation link located at the second reference coordinate (that is, the position of the cursor 310), or downloads the operation program. /Displays the page corresponding to the URL link.

FIG. 5 is a schematic diagram illustrating an operation situation of the portable device 100 and the external display device 10 shown in FIG. 1 according to yet another embodiment of the present invention. For the embodiment shown in FIG. 5 , reference may be made to the related descriptions of FIG. 3 and FIG. 4 . In this embodiment, in the first operation mode, the screen displayed on the touch display panel 110 has a first desktop layout, such as the desktop (or window) displayed on the touch display panel 110 shown in FIG. 5 m icons (icon, or operation link) are configured. For example, in the second operation mode, the picture displayed on the display panel 11 of the external display device 10 has a second desktop layout, such as the desktop (or window) displayed on the display panel 11 of the external display device 10 shown in FIG. ) is configured with n icons (or operation links), where n can be set to be greater than or equal to m. In the embodiment shown in FIG. 5 , m and n are respectively 8 and 14 as examples, but the present invention is not limited thereto. In addition, in the second operation mode, as mentioned above, if the touch display panel 110 displays images, it may display at least part of the same or different images.

In addition, in addition to the desktop content, the same can be done for viewing the page content of other types of files (such as document files). More specifically, the portable device 100 usually has multiple pages, and the user can use fingers to switch the contents of different pages, so as to view different contents in different pages. When the portable device 100 establishes a connection with the external display device 10, the portable device 100 can simultaneously display the content of multiple pages in one screen through the external display device 10, so the user can display a single page at the same time Watch up to see more.

That is to say, for image data from the same source, compared with the single image displayed on the touch display panel 110 in the first operation mode, the images displayed by the external display device 10 in the second operation mode at the same time A single frame can display "more data" among the image data from the same source. Wherein, the "more data" includes "more page data" or "more desktop data". The "more pages of data" include: data with a larger area in the single-page data, or data with more pages in the multi-page data. The "more desktop data" includes data of more desktop icons in a single desktop data.

It is worth mentioning that when the portable device 100 establishes a connection with the external display device 10 , the above operations may not affect other functions of the portable device 100 . For example, assume that the portable device 100 is a mobile phone with multiple functions, and the user uses the mobile phone 100 to play a movie and output the movie screen to the external display device 10 . Therefore, the external display device 10 can use a larger display screen to display movie images and/or operation pages. The user can use the touch display panel 110 of the mobile phone 100 to control the playback of movies. If someone calls during the playing of the movie, the user can operate the relevant buttons on the mobile phone 10 to answer/hang up the call without affecting the playing of the movie.

In the second operation mode of this type of embodiment, the processing unit 120 can not only transmit the movie picture data to the external display device 10 , but also transmit the call operation picture data to the touch display panel 110 . At this time, the images displayed by the external display device 10 and the touch display panel 110 are completely different. In other embodiments, when the portable device 100 receives a call, the screen displayed on the touch display panel 110 is divided into a first part and a second part, wherein the first part is the incoming call operation screen, and the second part is the Part or all of the movie screen displayed on the external display device 10 .

In other embodiments, the determination condition of step S210 in FIG. 2 can also be added with the selection of the user. When the portable device 100 is connected to the external display device 10, and the portable device 100 outputs screen data to the external display device 10, the touch display panel 110 of the portable device 100 will display a prompt message to ask the user whether to It is necessary to switch from the first operation mode (such as the absolute position touch mode) to the second operation mode (such as the relative position touch mode). As mentioned above, when the user selects the second operation mode, the portable device 100 can additionally display the mouse cursor 310 on the touch display panel 110 and/or the display panel 11 of the external display device 10 . The initial position of the mouse cursor 310 can be preset, such as the center of the screen or other predetermined positions.

In addition, regarding the operation gestures, in the first operation mode, at least one touch operation gesture on the touch display panel 110 is associated with at least one corresponding operation in a first correspondence relationship. In the second operation mode, at least one touch operation gesture on the touch display panel 110 is associated with at least one corresponding operation in a second correspondence relationship. Wherein, the first corresponding relationship is different from the second corresponding relationship. For example, the touch operation gesture on the touch display panel 110 is assumed to be a single touch point sliding down. In the first operation mode, the operation gesture of sliding the touch point down can make the screen content on the touch display panel 110 scroll down. However, in the second operation mode, the same operation gesture (touch point sliding down) on the touch display panel 110 will cause the cursor on the screen displayed on the external display device 10 to move downward.

FIG. 6 is a schematic circuit block diagram illustrating the portable device 100 and the external display device 20 according to another embodiment of the present invention. The external display device 20 may be a smart TV (smart TV), a computer monitor (monitor), a projector or other display devices. For the portable device 100 and the external display device 20 shown in FIG. 6 , reference may be made to the relevant description of the portable device 100 and the external display device 10 in FIG. 1 . What is different from the external display device 10 shown in FIG. 1 is that the external display device 20 shown in FIG. 6 is additionally coupled to the pointing device 14 and/or the input device 15 .

Referring to FIG. 6 , the pointing device 14 and/or the input device 15 are coupled to the display chip 12 of the external display device 20 . The pointing device 14 may include a mouse, a trackball or a touchpad (TouchPad or TrackPad). The pointing device 14 can detect the user's operation action to generate "relative position" information, and the display chip 12 can convert the "relative position" information into pointing data. To cooperate with the use of the pointing device 14 , the external display device 20 may include an interface converter (for example, it may be integrated inside the display chip 12 , not shown). The interface converter can convert the output (such as PS2 or USB signal) of the pointing device 14 (such as a mouse) into a data format suitable for transmission to the communication interface 130 via the communication interface 13 . The pointing data of the pointing device 14 conforms to a protocol receivable by the display chip 12, such as Universal Asynchronous Receiver-Transmitter (UART), Serial Peripheral Interface (SPI), Inter-Integrated Circuit (Inter-Integrated Circuit) , I ² C) or other protocols.

In this embodiment, the communication connection between the portable device 100 and the external display device 20 is bidirectional. When the portable device 100 establishes a connection with the external display device 20 , the portable device 100 can receive a control command from the external display device 20 . For example, in the second operation mode, the display chip 12 can transmit the pointing data to the portable device 100 through the communication interface 13 . The processing unit 120 of the portable device 100 can receive the pointing data provided by the external display device 20 through the communication interface 130, and generate the second reference coordinates according to the pointing data. Therefore, the processing unit 120 of the portable device 100 can generate the second reference coordinates according to the "relative position" generated by the pointing device 14 of the external display device 20 in the second operation mode, wherein the second reference coordinates indicate The reference position on the screen displayed by the external display device 20 . Therefore, the user can use the touch display panel of the portable device 100 for input, and/or can use the pointing device 14 coupled to the external display device 20 for input. In other embodiments, the portable device 100 can also be connected with another pointing device to provide user input. The user can use the touch display panel and/or the pointing device of the portable device 100 for input, and/or can use the pointing device 14 coupled to the external display device 20 for input.

For another example, in the second operation mode, the processing unit 120 also receives an input signal from the external display device 20 through the communication interface 130 , and performs corresponding operations according to the input signal. Wherein, the input signal is generated by the input device 15 and processed by the external display device 20 , wherein the external display device 20 is coupled to or includes the input device 15 . The input device 15 may include a keyboard, a character input device or a touch pad. In other embodiments, in order to cooperate with the use of the input device 15 , the external display device 20 may include an interface converter (for example, it may be integrated inside the display chip 12 , not shown). The interface converter can convert the keyboard output (such as PS2 or USB signal) into a data format suitable for transmission to the communication interface 130 via the communication interface 13, such as UART, SPI, I ² C or other protocols. The user can input text to the portable device 100 by operating the input device 15 . In other embodiments, the portable device 100 also has a keyboard for users to input text. The user can use the keyboard of the portable device 100 to input text, and/or can use the input device 15 coupled to the external display device 20 to input text.

In another embodiment, the input device 15 may be or may further include a camera device. The photographing device can capture images of users. The display chip 12 can receive a user image captured by the photographing device, and analyze the user image to obtain user gesture data. When the communication interface 130 establishes a connection with the external display device 20, the processing unit 120 of the portable device 100 can receive the user gesture data provided by the external display device 20 through the communication interface 130, and move FIG. 3 according to the user gesture data. The position of the cursor 310 is shown. The processing unit 120 can also perform corresponding operations according to the user gesture data, such as starting a program where the cursor 310 is located, or zooming in on the image where the cursor 310 is located.

It is worth noting that the data channel (channel or bus) for transmitting the image data from the portable device 100 to the external display device 20, and the control commands (such as pointing data, input signals, user gestures, etc.) data or other information) to the control channel of the portable device 100, the two channels may be the same or different channels. The display chip 12 transmits control commands to the portable device 100 via the control channel. The portable device 100 can react according to the incoming control command, and transmit image data to the external display device 20 via the data channel. In addition, it should be noted that, in some other embodiments, the pointing device 14 or the input device 15 may not be arranged to be coupled to the external display device 20 , but instead be configured as components of the external display device 20 itself.

FIG. 7 is a flow chart illustrating an operation method of the portable device 100 according to another embodiment of the present invention. For the embodiment shown in FIG. 7 , reference may be made to the related description of FIG. 2 . The difference from the embodiment shown in FIG. 2 is that the embodiment shown in FIG. 7 uses step S710 instead of step S240 shown in FIG. 2 . Please refer to FIG. 6 and FIG. 7, in step S710, in the second operation mode, the processing unit 120 can generate/move the second The reference coordinates can also be generated/moved according to the “relative position” generated by the user operating the pointing device 14 of the external display device 20 . The second reference coordinate indicates a reference position on the screen displayed by the external display device 20 . In some embodiments, both the touch display panel 110 and the pointing device 14 can be used to generate the second reference coordinates. In other embodiments, only one of them is used to generate the second reference coordinates. More specifically, in response to the coupling or activation of the pointing device, the touch display panel 110 can be used instead of the pointing device 14 to generate the second reference coordinates. In addition, in response to the pointing device being uncoupled or not activated, only the touch display panel 110 can be used to generate the second reference coordinates.

Likewise, in this embodiment, the user's touch operation on the touch display panel 110 directly controls the portable device 100 itself instead of controlling the external display device 20 . In other words, relevant programs such as document processing, multimedia playing, web browsing, or other functional applications can be stored in the memory device (not shown) in the portable device instead of the external display device 20 . When the portable device 100 establishes a connection with the external display device 20, the portable device 100 can transmit the image data to the external display device 20 through the communication interface 130, so that the external display device 20 displays the image represented by the image data. Using the external display device 20 with a large display area to display images/pictures, the user can conveniently browse the Internet, play multimedia files, edit files or perform other operations in a comfortable view. Meanwhile, the user can operate/control the portable device 100 through the pointing device 14 and/or the input device 15 (such as a conventional keyboard and mouse) of the external display device 20 .

In some embodiments, in the second operation mode, the driver program of the touch display panel 110 can be appropriately modified to meet the requirements of one or more of the following items.

1. When the user puts the finger on the touch display panel 110 to move, the mouse cursor 310 will move correspondingly with reference to the moving track of the finger on the touch panel.

2. When the user clicks on the touch display panel 110 with a finger, the APP (application program) icon pointed to by the mouse cursor 310 will be opened/triggered instead of being opened/triggered corresponding to the clicked position on the touch display panel 110 app icon.

3. Support simultaneous movement of multiple points to zoom in (move your fingers away from each other) or zoom out (move your fingers toward each other), where the zoomed in or zoomed out area is centered on the position of the mouse cursor 310, and the nearby area is zoomed in or out zoom out.

4. When you support moving your finger quickly, it can cause the effect of switching to different pages.

5. In the second operation mode, the user may also be provided with a choice of different desktop modes, so that the output desktop image is more convenient to operate.

6. In the second operation mode, a mouse and/or a keyboard connected to the external display device 10 can be simultaneously supported to provide more convenient input for the user.

To sum up, the above-mentioned embodiments provide the portable device 100 . The portable device 100 can determine whether the processing unit 120 switches to the first operation mode or the second operation mode according to whether the connection with the external display device is established. In the first operation mode, the first reference coordinate generated by the processing unit 120 points to the position of the touch point on the touch display panel 110 . That is to say, in the first operation mode, the position of a single touch point on the touch display panel 110 is used as the operation reference position, or the representative positions (such as geometric center points) of multiple touch points on the touch display panel 110 as a reference position for operation. The processing unit 120 operates according to the first reference coordinate. In the second operation mode, the processing unit 120 generates second reference coordinates according to one or more touch points on the touch display panel 110, wherein the second reference coordinates indicate the operation reference position on the screen displayed by the external display device . The processing unit 120 operates according to the second reference coordinate. Wherein, the position of the second reference coordinate is not related to the position of the touch point on the touch display panel 110 , and the movement of the second reference coordinate is in response to the movement of the touch point on the touch display panel 110 . Therefore, when the portable device 100 establishes a connection with the external display device, the user can focus on the screen of the external display device, which increases the convenience of operation.

Although the present invention has been disclosed as above with the embodiments, it is not intended to limit the present invention. Anyone with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention should be defined by the appended claims.

Claims (28)

1. A portable device comprising: a touch display panel; a communication interface; and a processing unit, coupled to the touch display panel and the communication interface; wherein When the communication interface is not connected to an external display device, the processing unit is switched to a first operation mode, and in the first operation mode, the processing unit operates according to at least one touch point on the touch display panel generating a first reference coordinate and operating according to the first reference coordinate, the first reference coordinate indicating a reference position on the screen displayed on the touch display panel, and the processing unit generating a first frame data, the The first picture data is used to transmit to the touch display panel, so that the touch display panel displays the picture represented by the first picture data; and When the communication interface establishes a connection with the external display device, the processing unit switches to a second operation mode, and in the second operation mode, the processing unit generates according to at least one touch point on the touch display panel A second reference coordinate and operate according to the second reference coordinate, the second reference coordinate indicates a reference position on the screen displayed by the external display device, and the processing unit generates a second frame data, the second The picture data is used to transmit to the external display device through the communication interface, so that the external display device displays the picture represented by the second picture data. 2. The portable device according to claim 1, wherein in the first operation mode, the processing unit generates the first touch point based on an absolute position corresponding to the at least one touch point on the touch display panel. a reference coordinate. 3. The portable device according to claim 1, wherein in the second operation mode, the processing unit generates the first touch point based on a relative position corresponding to the at least one touch point on the touch display panel. Two reference coordinates. 4. The portable device according to claim 1, wherein in the second operation mode, the processing unit generates the second reference coordinates based on a relative position generated by a pointing device, and the external display device is coupled to or include the pointing device. 5. The portable device according to claim 4, wherein in the second operation mode, the processing unit receives pointing data corresponding to the relative position from the external display device via the communication interface. 6. The portable device according to claim 4, wherein the pointing device is a mouse, a trackball or a touchpad. 7. The portable device according to claim 3, wherein in the second operation mode, the processing unit also receives an input signal from the external display device through the communication interface, and performs corresponding processing according to the input signal operation, wherein the input signal is generated by an input device and obtained through processing by the external display device, and the external display device is coupled to or includes the input device. 8. The portable device according to claim 7, wherein the input device is a keyboard or a touchpad. 9. The portable device according to claim 4, wherein in the second operation mode, the processing unit also receives an input signal from the external display device through the communication interface, and performs corresponding processing according to the input signal operation, wherein the input signal is generated by an input device and obtained through processing by the external display device, and the external display device is coupled to or includes the input device. 10. The portable device according to claim 9, wherein the input device is a keyboard or a character input device. 11. The portable device according to claim 1, wherein in the second operation mode, in the picture represented by the second picture data, the reference position indicated by the second reference coordinates shows a A cursor, the cursor moves in response to the movement of the at least one touch point. 12. The portable device according to claim 11, wherein in the first operation mode, in the frame represented by the first frame data displayed on the touch display panel, the first reference coordinate The reference position indicated does not display a cursor. 13. The portable device according to claim 1, wherein in the second operation mode, the second frame data is not transmitted to the touch display panel, so that the touch display panel does not rely on the second screen data to display the screen. 14. The portable device according to claim 1, wherein in the second operation mode, the processing unit also transmits a third frame data to the touch display panel, so that the touch display panel displays the The picture represented by the third picture data. 15. The portable device according to claim 14, wherein the second frame data and the third frame data are at least partially identical. 16. The portable device according to claim 14, wherein the second frame data is different from the third frame data. 17 . The portable device according to claim 14 , wherein when the communication interface establishes a connection with the external display device, the touch display panel and the external display device simultaneously display images with the same content. 18. The portable device according to claim 14, wherein in the second operation mode, the touch display panel and the external display device display images with different contents. 19. The portable device according to claim 18, wherein the screen displayed on the touch display panel in the first operation mode has a first desktop layout, and in the second operation mode the external The picture displayed on the display device has a second desktop layout, wherein the first desktop layout is different from the second desktop layout. 20. The portable device according to claim 1, wherein for the same source image data, a single frame displayed by the external display device in the second operation mode is larger than that displayed in the first operation mode A single frame displayed by the touch display panel is to display more data in the image data from the same source. 21. The portable device according to claim 20, wherein the more data comprises more page data or more desktop data. 22. The portable device according to claim 21, wherein the more pages of data include: data of a larger area in the single page data, or data of more pages in the multi-page data. 23. The portable device according to claim 21, wherein the more desktop data includes data of more desktop icons in a single desktop data. 24. The portable device according to claim 1, wherein in the first operation mode, at least one touch operation gesture on the touch display panel is in a first corresponding relationship with at least one corresponding operation Associated; in the second operation mode, at least one touch operation gesture on the touch display panel is associated with at least one corresponding operation in a second correspondence, wherein the first correspondence is different from the Second Correspondence. 25. The portable device according to claim 1, wherein in the second operation mode, the screen represented by the second screen data includes one or more operation links corresponding to one or more operation programs, and the processing The unit responds to an opening operation gesture on the touch display panel to open the operation program corresponding to the operation link located at the second reference coordinate. 26. The portable device according to claim 1, wherein in the second operation mode, the processing unit responds to a zoom-in or zoom-out operation gesture on the touch display panel to include the second reference A part of the coordinate area is enlarged or reduced. 27. The operation method of the portable device according to claim 1, wherein the communication protocol run by the communication interface includes Mobile High Definition Link, High Definition Multimedia Interface, Universal Serial Bus, Mini DisplayPort or Intel Wireless Display . 28. The portable device according to claim 1, wherein in the second operation mode, the processing unit adjusts the resolution of the second image data according to a display resolution returned by the external display device.

Images