CN102385467A - Video control method, processing method and system thereof - Google Patents

Abstract

The present invention relates to an image control method and a processing method applicable to a system including a controller and a terminal device. The image control method includes: receiving a selected image and displaying the selected image on a touch screen of the controller, wherein the selected image corresponds to a selection box on a terminal screen of the terminal device; receiving a user command corresponding to the selected image through the touch screen; and transmitting a control command to the terminal device according to the user command to control the terminal device.

Description

Video control method, processing method and system thereof

technical field

The present invention relates to a control method, a processing method and a system thereof, in particular to an image control method, a processing method and a system thereof.

Background technique

Nowadays, it has become more and more popular to use home appliances as terminal devices and combine them with multimedia application devices. For example, a home appliance such as a TV may combine different functions such as a digital video disk (DVD) player, a Blu-ray disc player, an audio device, a game console, or a web browser. However, traditionally, a dedicated controller is required for each multimedia application device, which brings complicated and confusing control methods to users.

Even if multiple controllers are integrated into one to control a terminal device with multiple multimedia functions, the integrated controller still has many problems. For example, it is often necessary to configure multiple buttons representing different signal functions on the controller, but the numerous buttons not only take up a lot of space, but also easily confuse the user. Especially for TVs with web browser or game functions, in addition to the original controller, an additional mouse is often needed to meet the needs of controlling the cursor. Adding a mouse not only increases the hardware cost, but also complicates the operation.

That is to say, traditionally, a terminal device with multiple multimedia functions has the disadvantages of needing to correspond to multiple control devices, high cost, inconvenient and complicated control methods, and the like.

Contents of the invention

In order to solve the above problems, the present invention proposes a video control method, a processing method and a system thereof. The video control method and processing method are suitable for a controller of the video control system and a terminal device with a terminal screen.

Wherein the image control method is executed on the controller, which includes: receiving a selected image and displaying the selected image on a touch screen of the controller, wherein the selected image corresponds to a marquee on a terminal screen of the terminal device; The screen receives a user command corresponding to the selected image; and sends a control command to the terminal device according to the user command to control the terminal device.

The user command may include a click command, and the control command includes a click coordinate corresponding to the selected image. The image control method may further include: enabling the terminal device to open a click hyperlink according to the click coordinates.

The user command can also include a movement command, and the control command can include a movement direction. The image-based control method may further include: making the terminal device move the marquee frame according to the moving direction; and receiving a selected image corresponding to the moved marquee frame, and displaying the moved selected image on the touch screen. The images corresponding to the marquee and the moved marquee may partially overlap.

The user command may further include a zoom-out command, and the image-based control method may further include: according to the zoom-out command, the terminal device enlarges the marquee to obtain a selected image whose content is reduced; and receiving a selected image corresponding to the enlarged marquee , and display the reduced selected image on the touch screen.

The user command may also include a zoom-in command, and the image-based control method may further include: making the terminal device shrink the marquee according to the zoom-in command to obtain a selected image whose content is enlarged; and receiving a selected image corresponding to the reduced marquee , and display the enlarged selected image on the touch screen.

In addition, the image control method may further include: receiving a markup language information corresponding to the selection box, and displaying the markup language information on the touch screen, wherein the markup language information includes at least one hyperlink label.

And when the user command is a click command, the control command may be a clicked hyperlink label. The video control method may further include: enabling the terminal device to open the clicked hyperlink according to the clicked hyperlink label. Wherein the touch screen can display a hyperlink label with a display object.

The image processing method proposed in the present invention is executed on the terminal device, which includes: setting a marquee frame on the terminal screen; transmitting the selected image corresponding to the marquee frame to the controller, so that the touch screen of the controller displays the selected image; receiving a control command, wherein the control command corresponds to a user command received by the controller through the touch screen; and processing the terminal screen according to the control command.

A video control system is also proposed. The video control system includes a terminal device and its controller. The terminal device includes a terminal screen. The terminal device sets a marquee frame on the terminal screen, and transmits a selected image corresponding to the marquee frame. The controller includes a touch screen, which receives the selected image from the terminal device and displays the selected image on the touch screen. The controller receives a user command corresponding to the selected image through the touch screen, and sends a control command to the terminal device according to the user command to control the terminal device. After receiving the control command, the terminal device processes the terminal screen according to the control command.

In the image-based control system, the user command includes a click command, the control command includes a click coordinate corresponding to the selected image, and the terminal device opens a click hyperlink according to the click coordinate.

In the image-based control system, the user command includes a movement command, the control command includes a movement direction, and the terminal device moves the marquee according to the movement direction, and the controller receives corresponding to the movement selecting the selected image in the frame, and displaying the moved selected image on the touch screen.

In the image-based control system, the selection frame partially overlaps with the moved selection frame.

In the image-based control system, the user command includes a zoom-out command, and the terminal device zooms in on the marquee according to the zoom-out command to obtain the selected image whose content is zoomed out, and the controller receives corresponding to the enlarged the selected image in the marquee, and display the reduced selected image on the touch screen.

In the image-based control system, wherein the user command includes a zoom-in command, and the terminal device shrinks the marquee according to the zoom-in command to obtain the selected image whose content is zoomed in, the controller receives corresponding to the zoom-out the selected image of the marquee, and display the enlarged selected image on the touch screen.

In the above-mentioned video control system, wherein the controller further receives a markup language information corresponding to the selection frame from the terminal device, and displays the markup language information on the touch screen, wherein the markup language information includes at least A hyperlink label.

In the image control system, the user command is a click command, the control command is the clicked hyperlink label, and the terminal device opens a clicked hyperlink according to the clicked hyperlink label, and The touch screen displays the hyperlink label with a display.

To sum up, the video control method, the processing method and the system thereof allow the user to control the terminal device in an easy and intuitive manner only by using a single controller.

Description of drawings

FIG. 1 is a schematic diagram of an implementation example image control system;

FIG. 2 is a flowchart of an image processing method according to an embodiment;

FIG. 3 is a flow chart of an image control method according to an implementation example;

FIG. 4 is a schematic diagram of a moving marquee and its display in an embodiment;

Fig. 5 is a schematic diagram of overlapping marquee boxes of an implementation example;

FIG. 6 is an enlarged marquee and a schematic display diagram of an implementation example;

FIG. 7 is a schematic diagram of a reduced marquee and a display of an implementation example;

FIG. 8 is a schematic diagram of a display object according to an embodiment.

Among them, reference signs:

20 terminal devices

22 terminal screen

24 marquee

26 Original Marquee

28 Overlap

30 controllers

32 touch screen

34 display display

Detailed ways

The detailed features and advantages of the present invention are described in detail below in the embodiments, the content of which is sufficient to enable any person familiar with the relevant art to understand the technical content of the present invention and implement it accordingly, and according to the content disclosed in this specification, the scope of the patent application and the drawings , anyone skilled in the relevant art can easily understand the related objects and advantages of the present invention.

A video-based control method and a video-based processing method proposed by the present invention are suitable for a video-based control system, wherein the video-based control system includes a terminal device and a controller for controlling the terminal device. Please refer to FIG. 1 , which is a schematic diagram of an implementation example of a video control system.

The terminal device 20 includes a terminal screen 22 . The terminal device 20 may be, for example, a television or a computer monitor, and a projector and a picture projected by the projector may also be regarded as the terminal device 20 and the terminal screen 22 . Application programs such as a video on demand (VOD) player for watching TV programs, a web browser, or video games can be executed in the terminal device 20 .

The controller 30 includes a touch screen 32 so that the user can control the terminal device 20 in a more intuitive and simple manner through the touch screen 32 . The touch screen 32 only needs to support single-touch, but can also support multi-touch to provide a more convenient user experience. The controller 30 further includes necessary hardware (not shown) such as a processor capable of executing the video control method. The controller 30 may also include other buttons for assisting operations. In addition, data can be transmitted between the terminal device 20 and the controller 30 through a wireless transmission interface such as Wi-Fi, radio frequency (RF) or Bluetooth (Bluetooth).

Please cooperate with FIG. 1 and refer to FIG. 2 . FIG. 2 is a flowchart of an image processing method according to an embodiment. The image processing method is executed on the terminal device 20 . First, the terminal device 20 sets a check box 24 on the terminal screen 22 (step S100 ). Then, the selected image corresponding to the selection box 24 is sent to the controller 30, so that the touch screen 32 of the controller 30 displays the selected image (step S110). The selected image refers to a part of the image within the selection frame 24 in the entire screen of the terminal screen 22 .

It can be seen from FIG. 1 that only the part of the frame selected by the marquee 24 is displayed on the touch screen 32 . The aspect ratio of the marquee 24 can be set to be the same as that of the touch screen 32 , and the controller 30 can automatically scale the selected image to the same resolution as the touch screen 32 to facilitate viewing by the user. But the user can also use a scroll bar on the touch screen 32 to display the selected image. It should be noted here that the selection box 24 can be a frame line obviously displayed on the terminal screen 22 or a virtual frame line not obviously displayed on the terminal screen 22 .

The terminal device 20 also receives a control command from the controller 30 (step S120 ), wherein the control command corresponds to a user command received by the controller 30 through the touch screen 32 . In other words, the user inputs a user command through the touch screen 32 , and the controller 30 transmits a control command to the terminal device 20 according to the user command. Then the terminal device 20 processes the terminal screen 22 according to the control command (step S130 ). The above step S120 and step S130 can be repeatedly executed to respond to the user's control. The content of the user command and the control command and the processing method of the terminal device 20 will be described in detail later.

Please cooperate with FIG. 1 and refer to FIG. 3 , which is a flow chart of an implementation example of an image control method. The video control method is executed on the controller 30 . The controller 30 receives the selected image from the terminal device 20 and displays the selected image on the touch screen 32 of the controller 30 (step S200 ), wherein the selected image corresponds to the selection frame 24 of the terminal screen 22 of the terminal device 20 . The controller 30 receives a user command corresponding to the selected image through the touch screen 32 (step S210 ); and transmits a control command to the terminal device 20 according to the user command (step S220 ), so as to control the terminal device 20 . The above step S210 and step S220 can also be executed repeatedly, so as to be processed according to the control of the user.

Among them, the image-based control method and the image-based processing method, the so-called "image-based" is a simple and intuitive control method provided by selecting images and the touch screen 32 . The user can look at the selected image and the touch screen 32 and issue user commands according to the requirement to control the terminal device 20 .

The user command can be a click command, a move command, a zoom-out command or a zoom-in command. The user can input user commands through various gestures, and the touch screen 32 detects different gestures as different user commands, and there are no restrictions on the gestures used as user commands. In addition, although the web browser is used as an example of the application program of the terminal device 20 in this specification, in fact, the video control method and processing method can also control other application programs, not limited to the web browser.

For example, when the terminal device 20 is running a web browser and the user wants to open a hyperlink in the webpage, the user can click a position corresponding to the hyperlink in the webpage in the selection image displayed on the touch screen 32 as a click command. The controller 30 can know the position where the touch screen 32 is clicked, and transmit a click coordinate of the position as a control command to the terminal device 20 . According to the click coordinates and the position of the marquee 24 on the terminal screen 22 , the terminal device 20 can obtain where is clicked in the whole screen of the terminal screen 22 , and open the corresponding one-click hyperlink. For another example, when the terminal device 20 is executing a random video or game application, the user can click on the objects displayed on the touch screen 32 to control the objects on the terminal screen 22 .

When the user wants to move the marquee 24 to view other parts of the screen through the controller 30 (that is, to capture images), he can use his finger or stylus to slide on the touch screen 32, and use this as a movement command . The controller 30 determines a moving direction according to the moving command, and transmits the moving command to the terminal device 20 .

Please refer to FIG. 4 , which is a schematic diagram of a moving marquee and its display according to an implementation example. For example, it can be defined that when the user's finger slides across the touch screen 32 from right to left, the moving direction is right. The terminal device 20 moves the selection frame 24 according to the moving direction, and then transmits the selected image corresponding to the moved selection frame 24 to the controller 30 . In this way, the controller 30 can receive a new selected image and display it on the touch screen 32 . In FIG. 4, the original marquee box 26 is indicated by a dotted line.

More specifically, the upper left corner of the terminal screen 22 can be positioned as the coordinate origin; when the moving direction is right, the abscissa of the original marquee 26 plus a displacement is used as the abscissa of the marquee 24 after the movement. Similarly, no matter which direction the marquee frame 24 wants to move up, down, left, or right, the user can freely control the position of the marquee frame 24 .

According to an embodiment, the original selection box 26 and the moved selection box 24 may partially overlap, as shown in FIG. 5 . There is an overlapping portion 28 between the original marquee box 26 and the moved marquee frame 24, so as to avoid hyperlinks with too small clickable range. In addition, the controller 30 can also continuously send the moving direction as a control command to the terminal device 20 when it detects that the user is inputting a moving command and continues to press an edge of the touch screen 32, so that the selection box 24 moves continuously. Move direction to move.

The user can also change the size of the marquee box 24 on the terminal screen 22 through a zoom-out command or a zoom-in command. Please refer to FIG. 6 and FIG. 7 , which are respectively an enlarged marquee frame and a schematic view of a display, and a reduced marquee frame and a schematic view of a display, respectively.

After receiving the zoom-out command, the controller 30 can send a signal representing the zoom-out command as a control command to the terminal device 20 . The zoom out command indicates that the user may want to zoom out the content of the selected image to get more content. As shown in FIG. 6 , the terminal device 20 enlarges the selection frame 24 according to the zoom-out command, so as to obtain a selected image whose content is reduced. The terminal device 20 transmits the selected image corresponding to the enlarged selection frame 24 to the controller 30 , and the controller 30 displays the reduced selected image on the touch screen 32 after receiving it.

Similarly, after receiving the zoom-in command, the controller 30 can send a signal representing the zoom-in command as a control command to the terminal device 20 . The zoom-in command indicates that the user may want to zoom in on the selected image to view detailed content in the selected image. As shown in FIG. 7 , the terminal device 20 shrinks the selection frame 24 according to the zoom-in command, so as to obtain a selected image whose content is enlarged. The terminal device 20 transmits the selected image corresponding to the reduced marquee frame 24 to the controller 30 , and the controller 30 displays the enlarged selected image on the touch screen 32 after receiving it.

In addition to the above-mentioned click command, move command, zoom out command, or zoom in command, user commands may also include other types of commands, such as simulating a right mouse click to call out a menu or dragging a cursor to select a frame.

In addition, according to an implementation example, when the terminal device 20 opens the web browser, the terminal device 20 may transmit a markup language information corresponding to the selection frame 24 to the controller 30 in addition to selecting an image. The controller 30 receives the markup language information and displays it on the touch screen 32 . The markup language information may include at least one hyperlink tag (tag), and may also include tags of other webpage elements. Wherein the hyperlink tag can be, for example, "<a href="http://www.tipo.gov.tw">".

The markup language information can be regarded as a small web page corresponding to the check box 24 generated by the terminal device 20 according to the web browser, the content of the web page that the user is browsing, and the check box 24 . It can be generated in a format conforming to Hypertext Markup Language (HTML), Extensible Markup Language (XML) or Standard Generalized Markup Language (SGML). Relatively, the controller 30 may have a browser to analyze the received markup language information and related necessary data, and then cooperate with the selected image to display on the touch screen 32 . In this way, web page elements that can interact with users, such as hyperlink labels or drop-down menus in the web page, can be presented through the controller 30 to provide a more intuitive control method.

When the touch screen 32 receives a click command, the controller 30 can know which label in the marked language information is clicked in conjunction with the marked language information. Then the controller 30 can transmit the clicked tag to the terminal device 20 for processing. Therefore, when the user clicks on a certain hyperlink label, the controller 30 can make the terminal device 20 open the corresponding clicked hyperlink according to the clicked hyperlink label.

In addition, sometimes it may be difficult for the user to determine the presence or absence of a hyperlink only based on the selected image, so the touch screen 32 can also display a hyperlink label with a "display target", as shown in FIG. 8 . The browser of the controller 30 can use, for example, a bottom line, text of different colors, text size or style of text, frame, or change the background color of text blocks as the display object 34 .

To sum up, the controller in the image control system is a single controller, and provides a touch screen with good operability and wide application range; compared with traditional controllers, it can save a mouse or a large number of buttons . Furthermore, through various user commands, the image control method, the processing method and the system thereof enable the user to simply and easily control the terminal device through the touch screen on the controller. The method of simultaneously transmitting the selected image and marking language information and building a simple browser in the controller allows the user to intuitively use the web browser function of the terminal device.

Of course, the present invention can also have other various embodiments, and those skilled in the art can make various corresponding changes and deformations according to the present invention without departing from the spirit and essence of the present invention. All changes and deformations should belong to the protection scope of the appended claims of the present invention.

Claims (18)

1. A video control method, suitable for a controller to control a terminal device, characterized in that the video control method comprises: receiving a selection image and displaying the selection image on a touch screen of the controller, wherein the selection image corresponds to a selection frame of a terminal screen of the terminal device; receiving a user command corresponding to the selected image through the touch screen; and Sending a control command to the terminal device according to the user command to control the terminal device. 2. The image-based control method according to claim 1, wherein the user command includes a click command, and the control command includes a click coordinate corresponding to the selected image, and the image-based control method further includes: According to the click coordinates, the terminal device is enabled to open a click hyperlink. 3. The image control method according to claim 1, wherein the user command includes a movement command, and the control command includes a movement direction, and the image control method further includes: causing the terminal device to move the marquee according to the moving direction; and The selected image corresponding to the moved marquee is received, and the moved selected image is displayed on the touch screen. 4. The image-based control method according to claim 3, wherein the images corresponding to the marquee frame partially overlap with the moved marquee frame. 5. The video-based control method according to claim 1, wherein the user command includes a zoom-out command, and the video-based control method further comprises: making the terminal device zoom in on the marquee according to the zoom out command, so as to obtain the selected image whose content is zoomed out; and The selected image corresponding to the enlarged marquee is received, and the reduced selected image is displayed on the touch screen. 6. The image-based control method according to claim 1, wherein the user command includes a zoom-in command, and the image-based control method further comprises: making the terminal device shrink the marquee according to the zoom-in command, so as to obtain the selected image whose content is zoomed in; and The selected image corresponding to the reduced marquee is received, and the enlarged selected image is displayed on the touch screen. 7. The image control method according to claim 1, further comprising: Receive a markup language information corresponding to the selection box, and display the markup language information on the touch screen, wherein the markup language information includes at least one hyperlink label. 8. The video control method according to claim 7, wherein the user command is a click command, and the control command is the clicked hyperlink label, and the video control method further comprises: According to the clicked hyperlink label, make the terminal device open a clicked hyperlink. 9 . The image-based control method according to claim 7 , wherein the touch screen displays the hyperlink label with a display icon. 10 . 10. An image processing method, suitable for a terminal device having a terminal screen, characterized in that the image processing method comprises: setting a check box on the terminal screen; transmitting a selected image corresponding to the marquee to a controller, so that a touch screen of the controller displays the selected image; receiving a control command, wherein the control command corresponds to a user command received by the controller through the touch screen; and The terminal screen is processed according to the control command. 11. An image control system, characterized in that it comprises: A terminal device including a terminal screen, the terminal device sets a marquee frame on the terminal screen, and transmits a marquee image corresponding to the marquee frame; and a controller including a touch screen, the terminal device receives the selected image and displays the selected image on the touch screen, the controller receives a user command corresponding to the selected image through the touch screen, and sending a control command to the terminal device according to the user command to control the terminal device; Wherein the terminal device processes the terminal screen according to the control command after receiving the control command. 12. The image control system according to claim 11, wherein the user command includes a click command, the control command includes a click coordinate corresponding to the selected image, and the terminal device is opened according to the click coordinate One click hyperlink. 13. The image control system according to claim 11, wherein the user command includes a movement command, the control command includes a movement direction, and the terminal device moves the marquee according to the movement direction, the control The device receives the selected image corresponding to the moved marquee, and displays the moved selected image on the touch screen. 14. The image control system according to claim 13, wherein the selection frame partially overlaps with the moved selection frame. 15. The image-based control system according to claim 11, wherein the user command includes a zoom-out command, and the terminal device enlarges the marquee according to the zoom-out command to obtain the selected image whose content is zoomed out, the The controller receives the selected image corresponding to the enlarged marquee, and displays the reduced selected image on the touch screen. 16. The image-based control system according to claim 11, wherein the user command includes a zoom-in command, and the terminal device shrinks the marquee according to the zoom-in command to obtain the selected image whose content is zoomed in, the The controller receives the selected image corresponding to the reduced selection frame, and displays the enlarged selected image on the touch screen. 17. The image control system according to claim 11, wherein the controller further receives a markup language information corresponding to the selection box from the terminal device, and displays the markup language information on the touch screen , wherein the markup language information includes at least one hyperlink tag. 18. The video control system according to claim 17, wherein the user command is a click command, the control command is the clicked hyperlink label, and the terminal device is based on the clicked hyperlink label The label is opened upon clicking the hyperlink, and the touch screen displays the hyperlink label with a display indicator.

Images