Detailed Description
Fig. 1 is a schematic diagram of a display system 1 according to an embodiment of the invention. The display system 1 includes a touch display 10 and an image controller 11. The touch display 10 can display an image. The touch display 10 can receive the laser signal LS at the position P1 and generate the coordinate information corresponding to the position P1. The image controller 11 is coupled to the touch display 10. The image controller can determine the input image source of the image. The image controller 11 may execute an application corresponding to the input image source, and the image controller 11 operates the application according to the coordinate information to control the input image source, so as to control the image displayed on the touch display 10. In general, the display system 1 can receive the laser signal LS from the external laser remote controller 13, and then control the display operation of the display system 1.
In detail, the touch display 10 can be, for example, but not limited to, a touch display 10 with an optical touch function. In addition to the touch display 10 being capable of displaying images, the touch display 10 further includes a touch panel (not shown in fig. 1). Therefore, the touch display 10 can receive the optical signal to determine the touch operation of the user on the touch display 10 and the coordinate information of the touch operation. Further, the touch panel of the touch display 10 can receive the laser signal LS emitted to the position P1 on the touch display 10, and provide the coordinate information of the position P1 to the image controller 11.
The image controller 11 is coupled to the touch display 10. The image controller 11 may control the touch display 10 to display an image. In one embodiment, the video controller 11 may receive a plurality of video sources 12-1-12-m, and the video sources 12-1-12-m may be, for example, television video sources, streaming video sources, or one of Over The Top (OTT) video sources, Universal Serial Bus (USB) video sources, and High Definition Multimedia Interface (HDMI) video sources. The image controller 11 receives data provided by the image sources 12-1 to 12-m, performs image processing, and displays images of one or more of the image sources 12-1 to 12-m on the touch display 10 according to user selection or preset control. On the other hand, the image controller 11 may also receive the coordinate information of the position P1 provided by the touch display 10 when the laser signal LS is transmitted to the position P1 on the touch display 10. Accordingly, the image controller 11 can determine which of the image sources 12-1 to 12-m is the input image source according to the source of the image. The image controller 11 can select a corresponding application program according to the input image source and operate the application program according to the coordinate information to control the input image source.
For example, the image controller 11 can be, but is not limited to, a Central Processing Unit (CPU), or other Programmable general purpose or special purpose Micro Control Unit (MCU), a Microprocessor (Microprocessor), a Digital Signal Processor (DSP), a Programmable controller, an Application Specific Integrated Circuit (ASIC), a Graphics Processing Unit (GPU), an Arithmetic Logic Unit (ALU), a Complex Programmable Logic Device (CPLD), a Field Programmable Gate Array (FPGA), or other similar devices or combinations thereof. Alternatively, the video controller 11 may be a Hardware Circuit designed by Hardware Description Language (HDL) or any other digital Circuit design known to those skilled in the art, and implemented by Field Programmable Gate Array (FPGA), Complex Programmable Logic Device (CPLD) or Application-specific Integrated Circuit (ASIC). In an embodiment, the image controller 11 may be integrated with the touch display 10 and disposed in a single hardware structure, or separately disposed in different hardware structures, which is not limited in the present invention.
In short, the touch display 10 can receive the laser signal LS and provide corresponding coordinate information. The image controller 11 may integrate one or more image sources to display images on the touch display 10, and control or adjust the images displayed on the touch display 10 by receiving the coordinate information corresponding to the laser signal LS from the different image sources 12-1 to 12-m. Therefore, the display system 1 can receive the operation of the laser signal LS and further integrate the operations of the different image sources, so that the user can save the complicated process of pairing the remote controllers to simply operate the display system 1 to adjust or change the image displayed by the touch display 10.
Referring to fig. 2, fig. 2 is a flowchart illustrating a display method according to an embodiment of the invention, and the display system 1 shown in fig. 1 can be used to perform the display method shown in fig. 2, so that the following description of the operation of the display system 1 will be understood with reference to fig. 1 and 2.
In step S10, the touch display 10 displays an image. The image displayed by the touch display 10 may be the image of one or more of the image sources 12-1 to 12-m of the image controller 11.
In step S11, the touch display 10 receives the laser signal LS directed to the position P1 on the touch display 10 and generates the coordinate information of the corresponding position P1. Touches the display 10 and provides the coordinate information to the image controller 11. In an embodiment, the touch display 10 may receive the laser signal LS through a photo sensing circuit for receiving the touch signal, so as to determine the coordinate information of the position P1 to which the laser signal LS is directed, but the invention is not limited thereto, as long as the touch display 10 can determine the coordinate information of the laser signal LS, and the invention also falls into the scope of the invention.
In step S12, the image controller 11 can determine the input image source of the image, execute the application corresponding to the input image source through the image controller 11, call out different control modules through the image controller 11, operate the application according to the coordinate information, and further control the input image source. Specifically, for the image source of the image displayed on the touch display 10, the image controller 11 can determine whether the laser signal LS is displayed on the touch display 10 according to the coordinate information, and determine the position to which the laser signal is emitted according to the coordinate information. Further, the image controller 11 can determine which of the image sources 12-1 to 12-m the input image source is according to the source of the image. The image controller 11 can select a corresponding application program to call out different control modules according to the input image source, and operate the application program according to the coordinate information to control the input image source. Finally, the image controller 11 may operate a User Interface (UI) corresponding to the image source being displayed or played by the touch display 10 according to the coordinate information, so as to adjust and control the image displayed by the touch display 10.
Fig. 3 is a schematic diagram of a display system 2 according to an embodiment of the invention. The display system 2 includes a touch display 10 (e.g., an optical touch display), an image controller 11, and a laser remote controller 13. In general, the display system 2 is similar to the display system 1 except that the display system 2 further includes a laser remote controller 13, and the laser remote controller 13 can receive a user command and provide an input control signal corresponding to the user command to the image controller 11, so that the image controller 11 can operate an application program corresponding to an input image source according to the laser signal LS and the input control signal, and further control the input image source.
In detail, please refer to fig. 4A to 4C for details of the laser remote controller 13, and fig. 4A is a schematic diagram of the laser remote controller 13 according to an embodiment of the present invention. In the laser remote control 13 depicted in fig. 4A, it may include a laser transmitter 130, a laser receiver 131, a controller 132, a transmission interface 133 and keys 134. The laser transmitter 130 may emit a laser signal LS. The laser receiver 131 can receive the laser signal LS reflected by the touch display 10 to calculate the distance information between the laser remote controller 13 and the touch display 10. The buttons 134 may receive user instructions provided by user operations. The transmission interface 133 can be connected to the image controller 11 in a wireless communication manner. The controller 132 is coupled to the laser transmitter 130, the laser receiver 131, the transmission interface 133 and the key 134. Controller 132 may control the operation of laser emitter 130. The controller 132 may receive user commands provided by the buttons 134. Further, the controller 132 may control the transmission interface 133 to provide distance information and input control signals corresponding to user commands.
In addition, the configuration of the laser remote controller 13 can be modified or changed naturally to meet different system specifications or use requirements, for example, the number of the keys on the laser remote controller 13 can be set to one or more in different situations, and then refer to fig. 4B and 4C, where fig. 4B and 4C are schematic diagrams of the laser remote controllers 13a and 13B according to the embodiment of the present invention. For convenience of the following description, some elements of the laser remote controllers 13a and 13B, such as the laser receiver 131 and the controller 132 …, are omitted in fig. 4B and 4C. In fig. 4B, a single key 134 is provided in the laser remote controller 13 a. In FIG. 4C, the laser remote controller 13 is provided with a plurality of keys 134-1 to 134-6. In this way, when the laser remote controller 13 in the display system 2 is provided with a single key 134 as shown in fig. 4B, the operation interface of the laser remote controller 13 can be preferably simplified, and the operation threshold of the user is reduced. On the other hand, when the laser remote controller 13 in the display system 2 is provided with a plurality of keys 134-1 to 134-6 as shown in fig. 4C, the laser remote controller 13b can provide a faster and more convenient operation interface for the user to operate, thereby improving the operation convenience of the user.
In the embodiment shown in fig. 4B, although the laser remote controller 13a is only provided with the key 134, the user still provides different user instructions through different operations. In one embodiment, the user may preset a key press 134 (e.g., a quick double click, a long press … that exceeds a preset threshold, etc.) to generate a corresponding user command. In one embodiment, the buttons 134 can sense different user pressing pressures to generate corresponding user commands. In this way, the controller 132 can recognize the user commands with different pressing rules and generate the input control signal corresponding to the user commands accordingly.
In the embodiment shown in FIG. 4C, the laser remote control 13b is provided with keys 134-1 to 134-6. In one embodiment, the laser remote control 13b can integrate the control of different input video sources according to the keys 134-1 to 134-6. In one embodiment, key 134-1 may be, for example, a power key, key 134-2 may be, for example, a confirmation key, key 134-3 may be, for example, a scroll wheel key, key 134-4 may be, for example, a return key, key 134-5 may be, for example, a function call key, and key 134-6 may be, for example, a mute key. Thus, when the user presses one or more of the buttons 134-1-134-6, the buttons 134-1-134-6 can respectively generate the input control signals such as the power signal, the confirmation signal, the function call signal, the scroll wheel signal, the return signal and the mute signal.
In one embodiment, the display system 2 can integrate the applications of different input image sources through the keys of the laser remote controller 13 b. For example, referring to fig. 5, fig. 5 is a table 500 showing the generation of input control signals by the buttons 134-1 to 134-6 of the laser remote controller 13b according to the embodiment of the present invention, wherein the table divides the operation into 7 modules, and the image controller makes a call according to the input source and the application program. In general, the image controller 13b can integrate a plurality of remote controllers as shown in fig. 9A to 9G according to the content of the table 500, thereby effectively improving the convenience of the user in operation.
In detail, the buttons 134-1 through 134-6 are listed in columns of the table 500. The different modes of operation of keys 134-1 to 134-6 are exemplarily listed in the second row of table 500. The functions for the different modes of operation are listed in the third row of table 500. In general, the display system 2 can integrate the applications of different input video sources through the keys 134-1 to 134-6 of the laser remote controller 13 b. For example, in the fourth row of table 500, input control signals provided by keys 134-1-134-6 are illustratively listed when the input video source is a television and the corresponding application is a television menu. In the fifth row of the table 500, exemplary input control signals provided by the buttons 134-1-134-6 for controlling the corresponding Application when the input video source is a software Application (Application Launcher) video source, an Over The Top (OTT) video source, or a computer video source for viewing a brief report are listed. Exemplary input control signals provided by the buttons 134-1-134-6 are listed in the sixth row of the table 500 when the input video source is a multimedia video source and the corresponding application is video playback software. Exemplary input control signals that may be provided by keys 134-1-134-6 for keyboard entry when the input video source is from a computer video source for web browsing, editing operations, or viewing text are listed in the seventh row of table 500. Exemplary in the eighth row of table 500 are input control signals that keys 134-1-134-6 may provide for mouse input when the input image source is from a software application image source or a computer image source. In the ninth row of table 500, exemplary input control signals are listed for keys 134-1-134-6 that provide for handwriting input when the input video source is from a television video source or a computer video source and an editing operation is being performed. Exemplary in the ninth row of table 500 are input control signals that keys 134-1-134-6 may provide for a stylus operation when the input video source is from a computer video source and an editing operation or a viewing of a brief is being performed.
With respect to the detailed operation of the display system 2, please refer to fig. 6, fig. 6 is a flowchart illustrating a display method according to an embodiment of the invention, and the display system 2 illustrated in fig. 3 can be used to execute the display method illustrated in fig. 6, so that the operation of the display system 2 will be better understood by referring to fig. 3 and 6 together.
In step S20, the touch display 10 can display an image, wherein the image displayed by the touch display 10 can be an image of one of the image sources 12-1 to 12-m received by the image controller 11, and the image is received by the image controller 11, processed, and provided to the touch display 10 for displaying.
In step S21, the touch display 10 receives the laser signal LS from the laser remote controller 13 to the position P1 on the touch display 10, and the touch display 10 generates the coordinate information corresponding to the position P1. In an embodiment, the touch display 10 may receive the laser signal LS through a photo sensing circuit for receiving the touch signal, so as to determine the coordinate information of the position P1 to which the laser signal LS is directed, but the invention is not limited thereto, as long as the touch display 10 can determine the coordinate information of the laser signal LS, and the invention is within the scope of the invention.
In step S22, the video controller 11 determines the input video source of the video displayed on the touch display 10, and the video controller 11 can execute the application corresponding to the input video source. For example, the input video sources may be tv video sources, streaming video sources, or network streaming media video sources, usb video sources, and hdmi video sources, and each of the input video sources has a corresponding tv menu application, streaming video source application, computer device application, and the like. Accordingly, the image controller 11 can execute the corresponding application program according to the input image source.
In step S23, the video controller 11 receives the input control signal, converts the input control signal to be compatible with the application program of the input video source, and operates the application program according to the coordinate information and the converted input control signal to control the input video source. In one embodiment, the contents of the third row in the table 500 of fig. 5 can be referred to with respect to the input control signal received by the video controller 11, and the contents of the fourth to tenth rows in the table 500 of fig. 5 can be referred to with respect to the contents of the fourth to tenth rows in the table 500 of fig. 5 with respect to the application program of the video controller 11 corresponding to the input video source to generate the converted input control signal.
Fig. 7A to 7G are schematic operation diagrams illustrating the image controller 11 controlling the image displayed on the touch display 10 according to the coordinate information according to the embodiment of the invention, and the following descriptions of the display system and the display method will be better understood with reference to fig. 3, fig. 6, and fig. 7A to 7G. In the embodiment shown in fig. 7A, in step S20, the input image source of the image displayed on the touch display 10 may be a streaming image source or a network streaming media image source. In step S21, the touch display 10 of the display system 2 receives the laser signal LS sent by the laser remote controller 13 and determines the coordinate information to which the laser signal is emitted. In step S22, the video controller 11 determines the application program corresponding to the input video source. In step S23, the image controller 11 can convert the input control signal according to the application program corresponding to the input image source, and the image controller 11 can select the image area pointed by the laser signal LS in the image of the touch display 10 according to the laser signal LS, the position information corresponding to the laser signal LS, and the converted input control signal.
In the embodiment shown in fig. 7B, in step S22, the image controller 11 determines the application corresponding to the input image source, and in step S23, the image controller 11 generates the control menu OSD of the on-screen keyboard to be superimposed on the displayed image. Then, the image controller 11 receives the coordinate information and operates the control menu OSD according to the converted input control signal.
In the embodiment shown in fig. 7C, in step S22, the image controller 11 determines the application corresponding to the input image source, and in step S23, the image controller 11 generates the control menu RC of the screen remote controller to be superimposed on the displayed image. Then, the image controller 11 receives the coordinate information and operates the control menu RC according to the converted input control signal.
In the embodiments illustrated in fig. 7D and 7E, the display system 2 can perform the dragging operation according to the change of the position to which the laser signal LS is emitted. In detail, at a first time, the laser signal LS emitted by the laser remote controller 13 can be emitted to the position P1 as illustrated in fig. 7D, and at a second time after the first time, the laser signal LS emitted by the laser remote controller 13 can be changed to be emitted to the position P2 in fig. 7E. In this embodiment, the image displayed on the touch display 10 can be from the image source of the computer device, and the position to which the laser signal LS is directed can be changed from the position P1 to the position P2 according to the user operation. Correspondingly, in step S21, the touch display 10 can provide the corresponding coordinate information to the image controller 11 to reflect the change of the laser signal LS from the position P1 to the position P2. In step S22, the video controller 23 determines the application program of the input video source. In step S23, the image controller 11 determines the movement of the laser signal LS according to the coordinate information provided by the touch display 10, and provides a corresponding control signal to the image source of the computer device according to the converted input control signal to change the range of the displayed image. More specifically, the image controller 11 may drag the image displayed by the image controller 11 according to the position change of the laser signal LS, so that the range of the image displayed on the touch display 10 may be changed corresponding to the laser signal LS changing from the position P1 to the position P2.
In the embodiment shown in fig. 7F and 7G, the laser remote controller 13 may further provide distance information to the image controller 11, so that the display system 1 may perform the scaling operation of the image according to the distance between the laser remote controller 13 and the touch display 10. Specifically, the laser remote controller 13 may have a laser ranging function, and receive the laser signal LS reflected by the touch display 10 to calculate the distance information between the laser remote controller 13 and the touch display 10. In the first time period shown in fig. 7F, the laser remote controller 13 can emit the laser signal LS at a distance D1, and in the second time period shown in fig. 7G, the laser remote controller 13 can be changed to emit the laser signal LS at a distance D2. As such, in step S21, in addition to the touch display 10 providing the coordinate information to the image controller 11, the laser remote controller 13 may also provide the distance information to the image controller 11 to indicate the change of the distance between the laser remote controller 13 and the touch display 10. Next, in step S22, the video controller 11 determines the application corresponding to the input video source. Finally, in step S23, the image controller 11 can control the application program according to the laser signal LS, the coordinate information of the laser signal LS, the converted input control signal and the distance information. In this way, the image controller 11 can display the image at the first time with the position P1 to which the laser signal LS is directed as the center and according to the first magnification corresponding to the distance D1, and display the image at the second time with the position P2 to which the laser signal LS is directed as the center and according to the second magnification corresponding to the distance D2, thereby achieving the zoom operation of the image through the additional distance information.
In an embodiment, when the laser remote controller 13 adjusts the magnification of the displayed image at different distances, the laser remote controller 13 may also adjust the range of the displayed image, that is, when the laser remote controller 13 adjusts the magnification of the displayed image by changing the distance between the laser remote controller 13 and the touch display 10, the laser remote controller 13 may also change the position of the laser signal LS emitted to the touch display 10. In this way, the image controller 11 can adjust the frame of the displayed image according to the change of the coordinate information, and the image controller 11 can also adjust the magnification of the displayed image according to the change of the distance information, so that the touch display 10 can zoom according to the position of the laser signal LS emitted to the touch display 10.
In one embodiment, the display system 2 may adjust all or part of the displayed image by the distance between the laser remote controller 13 and the touch display 10. For example, when the display image is a map image, the display system 2 can adjust the magnification of the whole map by changing the distance between the laser remote controller 13 and the touch display 10, so as to zoom the map. Alternatively, when the display image is a movie image including subtitles, the display system 2 may adjust only the size of the subtitles in the movie image according to the laser signal LS emitted to the subtitles and along with the change of the distance between the laser remote controller 13 and the touch display 10.
In addition, the various image operations illustrated in fig. 7A to 7G are not limited to the corresponding operations that can be performed only when a specific key receives an instruction. For example, the display system 2 is not limited to performing the zooming operation only when the zooming key receives the user command. In one embodiment, when the display system 2 includes a remote controller 13a, such as the one shown in fig. 4B, and only has the key 134, the image controller 11 may execute the application program in step S22. In step S23, the application and the user interface of the application are operated according to the laser signal LS and the coordinate information, so as to control the input image source. In one embodiment, when the display system 2 includes a remote controller 13b, such as the one shown in FIG. 4C, and has buttons 134-1 to 134-6, the image controller 11 can perform the zooming operation when the button 134-4 receives the zooming user command.
In this way, the user can control the display system 2 by using the laser signal LS, and intuitively operate the display system with visual feedback to control the image displayed on the touch display 10. On the other hand, in some use cases, the control direction of the user operating the controller and the display direction of the display may deviate, thereby causing inconvenience in operation of the whole system. For example, when the user uses a device such as a motion sensing remote controller or a mouse as the controller, the control direction of the user is not consistent with the direction of the screen in the display when the user is not facing the display, which causes inconvenience in operation. Therefore, the display system 2 can also provide an intuitive operation interface for the user, thereby effectively improving the convenience and the user experience of the display system and the display method.
Fig. 8A is an operation flow of the laser remote controller 13 according to an embodiment of the invention. The operation process illustrated in fig. 8A may be performed by the laser remote controller 13 illustrated in fig. 1 or fig. 3, or by one of the laser remote controllers 13, 13a, and 13b illustrated in fig. 4A to fig. 4C. In step S30, the operation flow of fig. 8A may be started when any one of the keys of the laser remote controller 13 or the power key is pressed. In step S31, the laser remote controller 13 may emit a laser signal LS. In step S32, the laser remote controller 13 may determine whether an acknowledgement (acknowledge) signal returned by the image controller 11 is received, wherein after receiving the indication of receiving the laser signal LS and providing the coordinate information from the touch display 10, the image controller 11 determines that the laser signal LS is emitted onto the screen of the touch display 10, and provides the acknowledge signal accordingly. When the determination of receiving the confirmation signal is yes, step S33 is executed. When the determination of receiving the confirmation signal is negative, step S34 is executed to stop emitting the laser signal LS. In step S33, the laser remote controller 13 can determine whether any key is pressed, and execute step S35 to send a corresponding input control signal when any key is pressed. And re-executes step S32 when not pressed to determine whether an acknowledgement signal is received.
Fig. 8B is an operation flow of the touch display 10 according to an embodiment of the invention. The operation flow illustrated in fig. 8B may be executed by the touch display 10 illustrated in fig. 1 or fig. 3. In step S40, the touch display 10 can be activated to start executing the operation flow. In step S41, the touch display 10 may determine whether the laser signal LS is received, so as to perform step S42 when determining that the laser signal LS is received, and perform step S43 when determining that the laser signal LS is received. In step S42, when the touch display 10 receives the laser signal LS, the touch display 10 can instruct the image controller 11 to receive the laser signal LS and provide the coordinate information of the position to which the laser signal LS is emitted. In step S43, when the touch display 10 does not receive the laser signal LS, the touch display 10 may indicate to the image controller 11 that it does not receive the laser signal LS.
Fig. 8C is a flowchart illustrating an operation of the image controller 11 according to an embodiment of the invention. The operation flow illustrated in fig. 8C may be executed by the image controller 11 illustrated in fig. 1 or fig. 3. In step S50, the video controller 11 can be activated to start executing the operation flow. In step S51, the image controller 11 may determine whether the touch display 10 indicates that it receives the laser signal LS and the corresponding coordinate information. When the determination result of step S51 is yes, the operation flow may execute step S52. On the contrary, when the determination result in the step S51 is no, the operation flow may repeatedly execute the step S51 to determine whether the touch display 10 receives the laser signal LS. Next, in step S52, the image controller 11 determines the input image source of the image displayed on the touch display 10 and classifies the input image source according to the displayed image. In an embodiment, when the step S52 is entered, the image controller 11 may further send a confirmation signal to the laser remote controller 13 in response to the indication that the touch display 10 receives the laser signal LS. In step S53, the video controller 11 determines the application corresponding to the input video source. In one embodiment, the image controller may determine the corresponding application according to the classification of the input image source. In step S54, the image controller 11 executes the application program and displays the corresponding user interface according to the control of the laser signal LS. In step S55, the image controller 11 determines whether an input control signal provided by the laser remote controller 13 is received. When the determination of step S55 is yes, the flow proceeds to step S56. When the determination of step S55 is no, go back to step S55 to determine whether an input control signal is received. In step S56, the image controller 11 can operate the user interface of the application program according to the laser signal LS, the coordinate information corresponding to the laser signal LS, and the input control signal, and then returns to step S54.
In summary, the display system and the display method of the present invention can intuitively operate the touch display according to the laser signal, and effectively integrate the control of the plurality of image sources. Therefore, the display system and the display method can effectively eliminate the complex control signal matching process aiming at a plurality of image sources or the hardware burden brought by operating a plurality of controllers of a plurality of image sources. In addition, the key configuration of the laser remote controller and the application program of the image controller for judging the input image source can effectively integrate and uniformly control the key control of different image sources, and the operation convenience of the display system and the display method is improved.