CN109960556B

CN109960556B - Display device

Info

Publication number: CN109960556B
Application number: CN201910199348.0A
Authority: CN
Inventors: 宁静; 孔祥键
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2019-03-15
Filing date: 2019-03-15
Publication date: 2021-11-05
Anticipated expiration: 2039-03-15
Also published as: WO2020186863A1; CN109960556A

Abstract

The application discloses a display device for improving user experience. The display device includes: a display for displaying a GUI, the GUI including at least a first presentation area and a second presentation area, the first presentation area including a plurality of items, the second presentation area including at least one sub-item associated with the item; and a selector indicating that the item is selected; a user interface for receiving a movement instruction for controlling movement of the selector; a controller for performing: when it is determined that the selector is moved within the first presentation area based on the movement instruction and the selector is moved to an item, scrolling a plurality of sub-items of the second presentation area by a preset distance such that a boundary sub-item associated with the selected item among the plurality of sub-items is scrolled to a position around the selected item; the boundary sub-item is a sub-item arranged at an edge in at least one sub-item associated with the selected item.

Description

Display device

Technical Field

The application relates to the technical field of display, in particular to a display device.

Background

The operability of displaying a user interface on a display device affects the user experience.

However, the content of the user interface displayed by the display device is very rich, and generally, when the content of different grouping categories is displayed, only the content under the currently selected grouping category is provided, and the content under other grouping categories is not provided, so that the clear visibility of the grouping categories can be realized, but the user is not facilitated to browse more contents. Therefore, it is desirable to provide a novel user interface display method for improving the experience of the user.

Disclosure of Invention

The embodiment of the application provides a display device, which is used for improving the user experience of a user for operating the display device.

In a first aspect, there is provided a display device comprising:

a display for displaying a GUI, the GUI including at least a first presentation area and a second presentation area, the first presentation area including a plurality of items, the second presentation area including at least one sub-item associated with the item; and a selector indicating that the item is selected;

a user interface for receiving a movement instruction for controlling movement of the selector;

a controller for performing:

when it is determined that the selector is moved within the first presentation area based on the movement instruction and the selector is moved to an item, scrolling a plurality of sub-items of the second presentation area by a preset distance such that a boundary sub-item associated with the selected item among the plurality of sub-items is scrolled to a position around the selected item; the boundary sub-item is a sub-item arranged at an edge in at least one sub-item associated with the selected item.

In some exemplary embodiments, the sub-items displayed in the second presentation area in the GUI are scrolled and updated in a sub-item arrangement direction to remove the sub-items displayed in the GUI from the GUI while displaying the sub-items not previously displayed in the GUI.

In some exemplary embodiments, the plurality of sub-items within the second presentation area are arranged horizontally in rows or vertically in columns.

In some exemplary embodiments, the scrolling the plurality of sub-items of the second presentation area by a preset distance so that a boundary sub-item associated with the selected item among the plurality of sub-items scrolls to a position around the selected item specifically includes:

scrolling a plurality of sub-items arranged horizontally in a row by a preset distance in a left or right direction such that a boundary sub-item among at least one sub-item associated with a selected item is scrolled to an up or down position of the selected item; or,

scrolling the plurality of sub-items vertically arranged in columns by a preset distance in an up or down direction such that a boundary sub-item among at least one sub-item associated with a selected item is scrolled to a left or right direction position of the selected item.

In some exemplary embodiments, the preset distance is determined based on a width of the item in the first presentation area and an index of the item within the first presentation area.

In some exemplary embodiments, the preset distance is determined based on a width of the item in the first presentation area and an index of the item in the first presentation area, and a spacing between different items in the first presentation area.

In a second aspect, there is provided another display device comprising:

a display for displaying a GUI, the GUI including at least a first presentation area and a second presentation area, the first presentation area including a plurality of items, the second presentation area including at least one sub-item associated with the item; and a selector indicating that the sub-item is selected;

a controller for performing:

when it is determined based on the movement instruction that the selector is moved within the second presentation area and the selector is moved to one sub-item, scrolling through a plurality of sub-items of the second presentation area such that an offset is presented between the selected sub-item of the at least one sub-item and the item to which it belongs.

In some exemplary embodiments, in at least one sub-item associated with an item, the offset presented between the selected sub-item and the item progressively changes in the order of arrangement from one boundary sub-item to another boundary sub-item; the boundary sub-item is a sub-item arranged at an edge in at least one sub-item associated with one item.

In some exemplary embodiments, the offset is greater than or equal to 0 and less than the width of the item to which the selected sub-item belongs in the first presentation area.

In some exemplary embodiments, the offset is determined by the index of the selected sub-item in the sub-item associated with the item to which it belongs and the number of sub-items associated with the item to which it belongs.

In some exemplary embodiments, the controller is further configured to perform:

when it is determined, based on the movement instruction, that the selector is moved within the second presentation area and the selector is moved from a boundary sub-item associated with a first item to a boundary sub-item associated with a second item, changing a display state of the second item within the first presentation area in place of a display state of the first item.

Compared with the prior art, the technical solutions proposed in the exemplary embodiments of the present application have the following beneficial effects:

in at least some embodiments provided herein, the display device can not only implement clear grouping categories, but can also provide a way to conform to the user's browsing habits to prompt the user to browse content under multiple grouping categories.

Drawings

Fig. 1A is a schematic diagram illustrating an operation scenario between a display device and a control apparatus;

fig. 1B is a block diagram schematically illustrating a configuration of the control apparatus 100 in fig. 1A;

fig. 1C is a block diagram schematically illustrating a configuration of the display device 200 in fig. 1A;

a block diagram of the architectural configuration of the operating system in the memory of the display device 200 is illustrated in fig. 1D.

FIG. 2 schematically illustrates a GUI400 provided by the display device 200;

fig. 3A-3E schematically show a GUI400 provided by the display device 200 by operating the control apparatus 100;

fig. 4A-4E schematically show another GUI400 provided by the display apparatus 200 by operating the control device 100;

fig. 5A-5E schematically illustrate yet another GUI400 provided by the display apparatus 200 by operating the control device 100;

6A-6B illustrate a flow chart of a method 600 provided by a display device when a selector is moved within a first presentation area;

FIG. 7 is a diagram illustrating a method for calculating the scrolling distance of a plurality of sub-items in a second presentation area as a selector is moved within a first presentation area;

8A-8B illustrate a flow chart of a method 800 for providing by a display device a selection of a second presentation area;

9A-9B illustrate a method for calculating the scroll distance of a plurality of sub-items in the second presentation area as the selector is moved within the second presentation area.

Detailed Description

To make the objects, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary one or more examples, it is to be understood that each aspect of the disclosure can be utilized independently and separately from other aspects of the disclosure to provide a complete disclosure.

It should be understood that the terms "first," "second," "third," and the like in the description and in the claims of the present application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used are interchangeable under appropriate circumstances and can be implemented in sequences other than those illustrated or otherwise described herein with respect to the embodiments of the application, for example.

Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module," as used herein, refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "gesture" as used in this application refers to a user's behavior through a change in hand shape or an action such as hand motion to convey a desired idea, action, purpose, or result.

Fig. 1A is a schematic diagram illustrating an operation scenario between a display device and a control apparatus. As shown in fig. 1A, the control apparatus 100 and the display device 200 may communicate with each other in a wired or wireless manner.

Among them, the control apparatus 100 is configured to control the display device 200, which may receive an operation instruction input by a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an intermediary for interaction between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation.

The control device 100 may be a remote controller 100A, which includes infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc. to control the display apparatus 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.

The control device 100 may also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a notebook computer, and the like. For example, the display device 200 is controlled using an application program running on the smart device. The application program may provide various controls to a user through an intuitive User Interface (UI) on a screen associated with the smart device through configuration.

For example, the mobile terminal 100B may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 100B may be caused to establish a control instruction protocol with the display device 200 to implement the functions of the physical keys as arranged in the remote control 100A by operating various function keys or virtual buttons of the user interface provided on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.

The display apparatus 200 may be implemented as a television, and may provide an intelligent network television function of a broadcast receiving television function as well as a computer support function. Examples of the display device include a digital television, a web television, a smart television, an Internet Protocol Television (IPTV), and the like.

The display device 200 may be a liquid crystal display, an organic light emitting display, a projection display device. The specific display device type, size, resolution, etc. are not limited.

The display apparatus 200 also performs data communication with the server 300 through various communication means. Here, the display apparatus 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display apparatus 200. By way of example, the display device 200 may send and receive information such as: receiving Electronic Program Guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The servers 300 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.

Fig. 1B is a block diagram illustrating the configuration of the control device 100. As shown in fig. 1B, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, an output interface 150, and a power supply 160.

The controller 110 includes a Random Access Memory (RAM) 111, a Read Only Memory (ROM) 112, a processor 113, a communication interface, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components of the communication cooperation, external and internal data processing functions.

Illustratively, when an interaction of a user pressing a key disposed on the remote controller 100A or an interaction of touching a touch panel disposed on the remote controller 100A is detected, the controller 110 may control to generate a signal corresponding to the detected interaction and transmit the signal to the display device 200.

And a memory 120 for storing various operation programs, data and applications for driving and controlling the control apparatus 100 under the control of the controller 110. The memory 120 may store various control signal commands input by a user.

The communicator 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the control apparatus 100 transmits a control signal (e.g., a touch signal or a button signal) to the display device 200 via the communicator 130, and the control apparatus 100 may receive the signal transmitted by the display device 200 via the communicator 130. The communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132. For example: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.

The user input interface 140 may include at least one of a microphone 141, a touch pad 142, a sensor 143, a key 144, and the like, so that a user can input a user instruction regarding controlling the display apparatus 200 to the control apparatus 100 through voice, touch, gesture, press, and the like.

The output interface 150 outputs a user instruction received by the user input interface 140 to the display apparatus 200, or outputs an image or voice signal received by the display apparatus 200. Here, the output interface 150 may include an LED interface 151, a vibration interface 152 generating vibration, a sound output interface 153 outputting sound, a display 154 outputting an image, and the like. For example, the remote controller 100A may receive an output signal such as audio, video, or data from the output interface 150, and display the output signal in the form of an image on the display 154, in the form of audio on the sound output interface 153, or in the form of vibration on the vibration interface 152.

And a power supply 160 for providing operation power support for each element of the control device 100 under the control of the controller 110. In the form of a battery and associated control circuitry.

A hardware configuration block diagram of the display device 200 is exemplarily illustrated in fig. 1C. As shown in fig. 1C, the display apparatus 200 may further include a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, an audio processor 280, an audio input interface 285, and a power supply 290.

The tuner demodulator 210 receives the broadcast television signal in a wired or wireless manner, may perform modulation and demodulation processing such as amplification, mixing, and resonance, and is configured to demodulate, from a plurality of wireless or wired broadcast television signals, an audio/video signal carried in a frequency of a television channel selected by a user, and additional information (e.g., EPG data).

The tuner demodulator 220 is responsive to the user selected frequency of the television channel and the television signal carried by the frequency, as selected by the user and controlled by the controller 250.

The tuner demodulator 220 may receive a television signal in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; and according to different modulation types, a digital modulation mode or an analog modulation mode can be adopted; and can demodulate the analog signal and the digital signal according to the different kinds of the received television signals.

In other exemplary embodiments, the tuning demodulator 220 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a television signal after modulation and demodulation, and inputs the television signal into the display apparatus 200 through the external device interface 240.

The communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, the display apparatus 200 may transmit content data to an external apparatus connected via the communicator 220, or browse and download content data from an external apparatus connected via the communicator 220. The communicator 220 may include a network communication protocol module or a near field communication protocol module, such as a WIFI module 221, a bluetooth communication protocol module 222, and a wired ethernet communication protocol module 223, so that the communicator 220 may receive a control signal of the control device 100 according to the control of the controller 250 and implement the control signal as a WIFI signal, a bluetooth signal, a radio frequency signal, and the like.

The detector 230 is a component of the display apparatus 200 for collecting signals of an external environment or interaction with the outside. The detector 230 may include an image collector 231, such as a camera, a video camera, etc., which may be used to collect external environment scenes to adaptively change the display parameters of the display device 200; and the function of acquiring the attribute of the user or interacting gestures with the user so as to realize the interaction between the display equipment and the user. A light receiver 232 may also be included to collect ambient light intensity to adapt to changes in display parameters of the display device 200, etc.

In some other exemplary embodiments, the detector 230 may further include a temperature sensor, such as by sensing an ambient temperature, and the display device 200 may adaptively adjust a display color temperature of the image. For example, when the temperature is higher, the display apparatus 200 may be adjusted to display a color temperature of an image that is cooler; when the temperature is lower, the display device 200 may be adjusted to display a warmer color temperature of the image.

In some other exemplary embodiments, the detector 230, which may further include a sound collector, such as a microphone, may be configured to receive a sound of a user, such as a voice signal of a control instruction of the user to control the display device 200; alternatively, ambient sounds may be collected that identify the type of ambient scene, enabling the display device 200 to adapt to ambient noise.

The external device interface 240 is a component for providing the controller 210 to control data transmission between the display apparatus 200 and an external apparatus. The external device interface 240 may be connected to an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.

The external device interface 240 may include: a High Definition Multimedia Interface (HDMI) terminal 241, a Composite Video Blanking Sync (CVBS) terminal 242, an analog or digital Component terminal 243, a Universal Serial Bus (USB) terminal 244, a Component terminal (not shown), a red, green, blue (RGB) terminal (not shown), and the like.

The controller 250 controls the operation of the display device 200 and responds to the operation of the user by running various software control programs (such as an operating system and various application programs) stored on the memory 260.

As shown in fig. 1C, the controller 250 includes a Random Access Memory (RAM) 251, a Read Only Memory (ROM) 252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256. The RAM251, the ROM252, the graphic processor 253, and the CPU processor 254 are connected to each other through a communication bus 256 through a communication interface 255.

The ROM252 stores various system boot instructions. When the display apparatus 200 starts power-on upon receiving the power-on signal, the CPU processor 254 executes a system boot instruction in the ROM252, copies the operating system stored in the memory 260 to the RAM251, and starts running the boot operating system. After the start of the operating system is completed, the CPU processor 254 copies the various application programs in the memory 260 to the RAM251 and then starts running and starting the various application programs.

A graphic processor 253 for generating screen images of various graphic objects such as icons, images, and operation menus. The graphic processor 253 may include an operator for performing an operation by receiving various interactive instructions input by a user, and further displaying various objects according to display attributes; and a renderer for generating various objects based on the operator and displaying the rendered result on the display 275.

A CPU processor 254 for executing operating system and application program instructions stored in memory 260. And according to the received user input instruction, processing of various application programs, data and contents is executed so as to finally display and play various audio-video contents.

In some example embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some initialization operations of the display apparatus 200 in the display apparatus preload mode and/or operations of displaying a screen in the normal mode. A plurality of or one sub-processor for performing an operation in a state of a standby mode or the like of the display apparatus.

The communication interface 255 may include a first interface to an nth interface. These interfaces may be network interfaces that are connected to external devices via a network.

The controller 250 may control the overall operation of the display apparatus 200. For example: in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.

Where the object may be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object is, for example, an operation of displaying a link to a hyperlink page, document, image, or the like, or an operation of executing a program corresponding to an icon. The user input command for selecting the GUI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch panel, etc.) connected to the display apparatus 200 or a voice command corresponding to a user uttering voice.

A memory 260 for storing various types of data, software programs, or applications for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or nonvolatile memory. And the term "memory" includes the memory 260, the RAM251 and the ROM252 of the controller 250, or a memory card in the display device 200.

In some embodiments, the memory 260 is specifically used for storing an operating program for driving the controller 250 of the display device 200; storing various application programs built in the display apparatus 200 and downloaded by a user from an external apparatus; data such as visual effect images for configuring various GUIs provided by the display 275, various objects related to the GUIs, and selectors for selecting GUI objects are stored.

In some embodiments, the memory 260 is specifically configured to store drivers and related data for the tuner demodulator 210, the communicator 220, the detector 230, the external device interface 240, the video processor 270, the display 275, the audio processor 280, and the like, external data (e.g., audio-visual data) received from the external device interface, or user data (e.g., key information, voice information, touch information, and the like) received from the user interface.

In some embodiments, memory 260 specifically stores software and/or programs representing an Operating System (OS), which may include, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. Illustratively, the kernel may control or manage system resources, as well as functions implemented by other programs (e.g., the middleware, APIs, or applications); at the same time, the kernel may provide an interface to allow middleware, APIs, or applications to access the controller to enable control or management of system resources.

A block diagram of the architectural configuration of the operating system in the memory of the display device 200 is illustrated in fig. 1D. The operating system architecture comprises an application layer, a framework layer and a kernel layer from top to bottom.

The application layer, the application programs built in the system and the non-system-level application programs belong to the application layer. Is responsible for direct interaction with the user. The application layer may include a plurality of applications such as a live television application, a video-on-demand application, a media center application, a screenshot application, and the like.

The live television application program can provide live television through different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.

A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.

The media center application program can provide various applications for playing multimedia contents. For example, the media center may be different from a live tv or a video-on-demand, and the user may access various images or videos stored in the memory through the media center application program.

The screenshot application program can perform screenshot on a current display picture on the display, and perform annotation such as identification frames, names and the like on identification objects (such as characters, channel station logos, buildings and the like) contained in the screenshot image, so as to provide a display function of various identification object information contained in the display picture for a user. The current display picture can be at least one of characters, images and videos.

Framework layer (framework) responsible for providing the APIs needed by the application layer. For example, a live television application, a video-on-demand application, and a media center application may call a decoder to perform audio and video decoding through an interface provided by the framework layer. For another example, the screenshot application may call the screenshot image of the current display that has been captured through an interface provided by the framework layer.

The kernel layer provides core system services, such as: file management, memory management, process management, network management, system security authority management and the like. The kernel also provides communication between system software and hardware, providing device driver services for various hardware, such as: provide display driver for the display, provide camera driver for the camera, provide button driver for the remote controller, provide wiFi driver for the WIFI module, provide audio driver for audio output interface, provide power management drive for Power Management (PM) module etc..

Illustratively, when a display device executes a screenshot processing function on a picture on a display, a user touches a screenshot key arranged on a remote controller, a key driving program in a kernel layer converts a key value corresponding to the screenshot key into a screenshot input instruction, and transmits the screenshot input instruction to a framework layer; the frame layer informs a screenshot input instruction to a screenshot application program, and the screenshot application program informs the frame layer of starting screenshot processing on a picture on a display and storing the screenshot of the picture; and the screenshot application program acquires the screenshot of the picture and displays the screenshot on the display.

A user interface 265 receives various user interactions. Specifically, it is used to transmit an input signal of a user to the controller 250 or transmit an output signal from the controller 250 to the user. For example, the remote controller 100A may transmit an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to the user interface 265, and then the input signal is transferred to the controller 250 through the user interface 265; alternatively, the remote controller 100A may receive an output signal such as audio, video, or data output from the user interface 265 via the controller 250, and display the received output signal or output the received output signal in audio or vibration form.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on the display 275, and the user interface 265 receives the user input commands through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of a selector in the GUI to select different objects or items.

Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 receives the user input command by recognizing the sound or gesture through the sensor.

The video processor 270 is configured to receive an external video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on the display 275.

Illustratively, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is configured to demultiplex an input audio/video data stream, where, for example, an input MPEG-2 stream (based on a compression standard of a digital storage media moving image and voice), the demultiplexing module demultiplexes the input audio/video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert a frame rate of an input video, for example, convert a frame rate of an input 60Hz video into a frame rate of 120Hz or 240Hz, where a common format is implemented by using, for example, an interpolation frame method.

And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.

And a display 275 for receiving the image signal from the output of the video processor 270 and displaying video, images and menu manipulation interfaces. For example, the display may display video from a broadcast signal received by the tuner demodulator 210, may display video input from the communicator 220 or the external device interface 240, and may display an image stored in the memory 260. The display 275, while displaying a user manipulation interface UI generated in the display apparatus 200 and used to control the display apparatus 200.

And, the display 275 may include a display screen assembly for presenting a picture and a driving assembly for driving the display of an image. Alternatively, a projection device and projection screen may be included, provided display 275 is a projection display.

The audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played by the speaker 286.

Illustratively, audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), high efficiency AAC (HE-AAC), and the like.

Audio output interface 285 receives audio signals from the output of audio processor 280. For example, the audio output interface may output audio in a broadcast signal received via the tuner demodulator 210, may output audio input via the communicator 220 or the external device interface 240, and may output audio stored in the memory 260. The audio output interface 285 may include a speaker 286, or an external audio output terminal 287, such as an earphone output terminal, that outputs to a generating device of an external device.

In other exemplary embodiments, video processor 270 may comprise one or more chips. Audio processor 280 may also comprise one or more chips.

And, in other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips or may be integrated with the controller 250 in one or more chips.

And a power supply 290 for supplying power supply support to the display apparatus 200 from the power input from the external power source under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display apparatus 200 or may be a power supply installed outside the display apparatus 200.

A schematic view of one GUI400 provided by the display device 200 is illustrated in fig. 2.

As shown in fig. 2, the display device may provide a GUI to the display that includes a plurality of presentation areas, each of which includes one or more different items arranged therein. For example, a first display area 41 and a second display area 42. And the GUI further includes a selector 43 indicating that any one of the items is selected, the position of the selector in the GUI being movable by input from a user operating the control means to change the selection of a different item.

It should be noted that the plurality of display areas may be visible boundaries or invisible boundaries. Such as: different display areas can be identified through different background colors, different display areas can be identified through visible identifications such as boundary lines, and different display areas can also be identified through invisible boundaries. Multiple presentation areas may not have visible or invisible boundaries, and only associated items in a certain range of areas are displayed on the screen, and when the associated items have the same display attribute, the certain range of areas are regarded as the existence of the boundary of the same presentation area, such as: items in the first presentation area 41 are not scrollable and items in the second presentation area 42 are scrollable.

It is also noted that the item refers to a visual object displayed in each presentation area of the GUI in the display apparatus 200 to represent corresponding content such as an icon, a thumbnail, a video clip, a link, and the like. For example: the items may represent movies, image content or video clips of a television show, audio content of music, applications, or other user access content history information.

In some embodiments, the items may display image thumbnails. If the item is a movie or a tv show, the item may be displayed as a poster of the movie or tv show. If the item is music, a poster of a music album may be displayed. Such as an icon for the application when the item is an application, or a screenshot of the content that captures the application when it was most recently executed. If the item is the user access history, the content screenshot in the latest execution process can be displayed. The items may be displayed as video clips. Such as: the item is a video clip dynamic of a trailer of a television or a television show.

Further, the item may represent an interface or a set of interfaces to which the display device 200 is connected with an external device, or may represent a name of an external device connected to the display device, or the like. Such as: a signal source input interface set, or an HDMI interface, a USB interface, a PC terminal interface, etc.

The presentation forms of items are often diverse. For example, the items may include text content and/or images for displaying thumbnails related to the text content, or video clips related to the text. As another example, the item may be text and/or an icon of an application.

The items may or may not be the same size. For example, the items in the first display region have the same width W1, the items in the second display region have the same width W2, and W1 may be equal to W2.

It is further noted that the selector is used to indicate that any item therein has been selected, such as the focus object. The movement of the display focus object in the display apparatus 200 may be controlled to select or control items according to an input of a user through the control device 100. Such as: the user may select and control items by controlling the movement of the focus object between items through the direction keys on the control device 100.

The focus object refers to an object that moves between items according to user input. Illustratively, the location of the focus object 43 is implemented or identified by drawing a thick line through the item edges as in FIG. 3A. In other embodiments, the focus object form is not limited to an example, and the position of the focus object 43 may be identified by changing the border line, size, color, transparency, and outline of the text or image of the focused item, and/or the font, and the like.

Fig. 3A-3E schematically show a GUI400 provided by the display device 200 by operating the control apparatus 100.

In the GUI shown in fig. 3A-3E, a first presentation area 41 is provided comprising a plurality of different items for selection by a selector 43, such that the display device displays at least one sub-item associated with the selected item within a second presentation area 42.

Wherein the sub-items are grouped under different item categories based on content data stored within the display device or configured in the background. For example, where the item is a game category, its sub-items may be game links of royal glory, hero union, fruit ninja, etc.; when the item is a video category, the sub-item can be a TV play or movie link such as a Dahan day, a translation official and the like; when the item is a setting category, its sub-items may be function links such as volume setting, notification setting, authority setting, and the like.

Wherein the items in the first and second presentation areas are horizontally arranged in a row. In other embodiments, the items in the first and second presentation areas may also be arranged vertically in a column.

For example, as shown in FIG. 3A, the first presentation area 41 includes items 411-415, the current selector indicates that the item 411 is selected, and the second presentation area 42 displays sub-items 4111-4113 associated with the selected item 411.

In FIG. 3A, when the user presses the right direction key on the control device, as shown in FIG. 3B, and moves the position of the selector in response to the input right direction command so that the selector indicates that item 412 in the first presentation area 41 is selected, sub-items 4121-4122 associated with the selected item 412 are displayed in the second presentation area 42, and sub-items 4111-4113 associated with item 411 are no longer displayed.

In FIG. 3B, when the user continues to press the right direction key on the control device, as shown in FIG. 3C, moving the position of the selector in response to the input right direction command causes the selector to indicate that item 413 in first presentation area 41 is selected, sub-items 4131-4134 associated with the selected item 413 are displayed in second presentation area 42, and sub-items 4121-4122 associated with item 412 are no longer displayed.

In FIG. 3C, as the user continues to press the right direction key on the control device, as shown in FIG. 3D, moving the position of the selector in response to the input right direction command causes the selector to indicate that item 414 in the first presentation area 41 is selected, sub-items 4141-4144 associated with the selected item 414 are displayed in the second presentation area 42, and sub-items 4131-4134 associated with item 413 are no longer displayed.

In FIG. 3D, as the user continues to press the right direction key on the control device, as shown in FIG. 3E, moving the position of the selector in response to the input right direction command causes the selector to indicate that item 415 in the first presentation area 41 is selected, sub-items 4151-4155 associated with the selected item 415 are displayed in the second presentation area 42, and sub-items 4141-4144 associated with item 414 are no longer displayed.

In the GUI provided in fig. 3A-3E, when the selector indicates that one item in the first presentation area is selected, only at least one sub-item associated with the selected item is provided in the second presentation area, and sub-items associated with items other than the one item in the first presentation area are not provided. Thus, although the classification of sub-items can be achieved clearly, it is not beneficial for the user to browse more sub-item information in the current GUI. In addition, because the number of sub-items associated with the item is configured according to the default or background, blank areas may appear in the second display area, which is less aesthetically pleasing.

Fig. 4A-4E are schematic diagrams illustrating another GUI400 provided by the display apparatus 200 by operating the control device 100.

In the GUI shown in fig. 4A-4E, a first presentation area 41 is provided which includes a plurality of items for selection by a selector 43, so that the display device displays at least one sub-item associated with the selected item and a part of sub-items associated with items other than the selected item within a second presentation area 42.

Wherein the sub-items displayed in the second presentation area are part of a sub-item list comprising sub-items associated with all items in the first presentation area. The list of sub-items is typically longer than the second presentation area in the GUI, so the second presentation area may only display a portion of the sub-items in the scrolling list of sub-items, i.e. the second presentation area, may be scrolled to update the sub-items displayed in the GUI by user input.

Next, a GUI change process indicating movement of the selector within the first presentation area in accordance with user input is illustrated by FIGS. 4A-4E.

For example, as shown in FIG. 4A, the first presentation area 41 includes items 411-415, the current selector indicates that the item 411 is selected, and the second presentation area 42 displays sub-items 4111-4113 associated with the selected item 411 and sub-items 4121-4122 associated with an item 412 adjacent to the item 411.

In FIG. 4A, when the user presses the right direction key on the control device, as shown in FIG. 4B, the position of the selector is moved in response to the input right direction command so that the selector indicates that the item 412 in the first presentation area 41 is selected, the second presentation area 42 is scrolled in the left direction by a distance such that the sub-item 4121 of the sub-items 4121-4122 associated with the selected item 412 is scrolled to a position directly below the item 412, and at the same time, the sub-item 4113 associated with the item 411 adjacent to the item 412, the sub-items 4121-4122, and the sub-items 4131-4132 associated with the item 413 adjacent to the item 412 are displayed in the second presentation area 42 in place of the sub-items 4111-4113 and the sub-items 4121-4122 displayed in FIG. 4A.

In FIG. 4B, when the user presses the right direction key on the control device, as shown in FIG. 4C, the position of the selector is moved in response to the input right direction command so that the selector indicates that the item 413 in the first presentation area 41 is selected, the second presentation area 42 is scrolled in the left direction by a distance such that the sub-item 4131 of the sub-items 4131-4134 associated with the selected item 413 is scrolled to a position directly below the item 413, and at the same time, the sub-items 4121-4122, 4131-4133 associated with the item 412 adjacent to the item 413 are displayed in the second presentation area 42, instead of the sub-item 4113, sub-items 4121-4122 and sub-items 4131-4132 shown in FIG. 4B.

In FIG. 4C, when the user presses the right direction key on the control device, as shown in FIG. 4D, the position of the selector is moved in response to the input right direction command so that the selector indicates that the item 414 in the first presentation area 41 is selected, the second presentation area 42 is scrolled in the left direction by a distance such that the sub-item 4141 of the sub-items 4141-4144 associated with the selected item 414 is scrolled to a position directly below the item 414, and at the same time, the sub-items 4132-4134, 4141-4142 associated with the item 413 adjacent to the item 414 are displayed in the second presentation area 42, instead of the sub-items 4121-4122 and the sub-items 4131-4133 shown in FIG. 4C.

In FIG. 4D, when the user presses the right direction key on the control device, as shown in FIG. 4E, the position of the selector is moved in response to the input right direction command so that the selector indicates that the item 415 in the first presentation area 41 is selected, the second presentation area 42 is scrolled in the left direction by a distance such that the sub-item 4151 of the sub-items 4151-4154 associated with the selected item 415 is scrolled to a position directly below the item 415, and at the same time, the sub-items 4141-4144, 4151 associated with the item 414 adjacent to the item 415 are displayed in the second presentation area 42, instead of the sub-items 4132-4134 and the sub-items 4141-4142 shown in FIG. 4D.

Similarly, in FIG. 4E, when the user presses the left directional key on the control device, the position of the selector is moved in response to the input left directional command, so that the inverse transformation process of FIG. 4E-4D-4C-4B-4A is displayed in the GUI.

4A-4E, when the selector indicates that an item in the first presentation area is selected, not only at least one sub-item associated with the selected item but also sub-items associated with items other than the one item in the first presentation area are provided in the second presentation area. In this way, not only can the classification of sub-items be achieved, but the user can browse more sub-item information in the current GUI. In addition, as the second display area can be used for scrolling and updating the sub-items displayed in the second display area along the arrangement direction of the sub-items, no blank area appears in the second display area, and the aesthetic feeling is provided for the user.

In some embodiments, when the selector indicates that an item in the first presentation area is selected, the plurality of items in the second presentation area are scrolled a distance such that a bounding sub-item of the at least one sub-item associated with the selected item in the first presentation area moves to a position below the selected item in the second presentation area. Therefore, the user can conveniently move the position of the selector by operating the control device to enable the selector to indicate that the boundary sub-item is selected, so that the user can browse a plurality of sub-items under the item category in a certain sequence from the boundary sub-item to meet the common browsing habit of the user; and may also link to a GUI associated with the application and/or function corresponding to the selected border sub-item to facilitate user access to the function corresponding to the border sub-item.

Here, the boundary sub-item is a sub-item arranged at an edge in a sub-item arrangement direction among at least one sub-item related to the selected item, such as sub-item 4121 and sub-item 4122 being boundary sub-items among sub-items 4121 to 4122 related to the item 412, sub-item 4131 and sub-item 4134 being boundary sub-items among sub-items 4131 to 4134 related to the item 413, and the like.

For example, referring to FIGS. 4A and 4B, when the user presses the right direction key on the control device, moving the position of the selector in response to an input right direction command causes the selector to move from item 411 to item 412 in the first presentation area 41, the second presentation area 42 scrolls in the left direction by a distance that causes a boundary sub-item 4121 of the at least one sub-item 4121-4122 associated with the item 412 indicated by the selector to scroll to a position directly below the item 412. The boundary sub-item 4121 is the first sub-item in the left-to-right direction among the sub-items 4121-4122. In this way, when the user presses the down direction key on the control device, the user can be facilitated to browse a plurality of sub-items under the same item category in order from left to right.

For another example, in conjunction with fig. 4B and 4A, when the user presses the left direction key on the control device, and moves the position of the selector in response to an input left direction command so that the selector moves from item 412 to item 411 within the first presentation area 41, the second presentation area 42 scrolls in the right direction by a distance such that a boundary sub-item 4111 of at least one sub-item 4111-4113 associated with the item 411 indicated by the selector scrolls to a position directly below the item 411. The boundary sub-item 4111 is the first sub-item in the left-to-right direction among the sub-items 4111 to 4113. In this way, when the user presses the down direction key on the control device, the user can be facilitated to browse a plurality of sub-items under the same item category in order from left to right.

In some embodiments, in conjunction with fig. 4A and 5A, when the user presses the down direction key on the control device, moving the position of the selector in response to the input down direction command causes the selector to move from item 411 in the first presentation area 41 to sub-item 4111 in the second presentation area 42, at which point item 411 in the first presentation area 41 is displayed differently from the other items 412-415 to prompt the user that the currently browsed selected sub-item 4111 belongs to the category of item 411. For example, in FIG. 5A, the border color of item 411 is shown as gray, and the border colors of the other items 412-415 are shown as black.

Next, a GUI change process indicating movement of the selector within the second presentation area in accordance with user input is illustrated by FIGS. 5A-5E.

Fig. 5A-5E illustrate schematic views of yet another GUI400 that the display apparatus 200 provides by operating the control device 100.

The GUI shown in fig. 5A-5E herein corresponds to the layout style of the GUI shown in fig. 4A-4E.

In the GUI illustrated in FIGS. 5A-5E, a first presentation area 41 is provided that includes a plurality of items, and a second presentation area 42 is provided that includes a plurality of sub-items associated with the plurality of items. These sub-items are intended to be selected by the selector 43 such that an offset is presented between the selected sub-item and the item to which it belongs while scrolling through the plurality of sub-items in the second presentation area.

For example, as shown in FIG. 5A, the first presentation area 41 includes items 411-415, and the second presentation area includes sub-items 4111-4113 associated with the item 411, and sub-items 4121-4122 associated with the item 412. The current selector indicates that sub-item 4111 is selected within the second presentation area, and sub-item 4111 is located directly below its belonging item 411, i.e. the offset0 between sub-item 4111 and its belonging item 411 is 0.

In fig. 5A, when the user presses the right direction key on the control device, as shown in fig. 5B, and moves the position of the selector in response to the input right direction command so that the selector indicates that sub-item 4112 in the second presentation area 42 is selected, the plurality of sub-items in the second presentation area 42 are scrolled in the left direction by a distance such that the offset between the selected sub-item 4112 and the item 411 to which it belongs is offset 1. Meanwhile, in FIG. 5B, the color of the border of the item 411 is displayed as gray, and the color of the borders of the other items 412-415 is displayed as black.

In fig. 5B, when the user presses the right direction key on the control device, as shown in fig. 5C, and the position of the selector is moved in response to the input right direction command so that the selector indicates that sub-item 4113 in the second presentation area 42 is selected, the plurality of sub-items in the second presentation area 42 are scrolled in the left direction by a distance such that the offset between the selected sub-item 4113 and the item 411 to which it belongs is offset 2. Meanwhile, in FIG. 5C, the border color of the item 411 is displayed as gray, and the border colors of the other items 412 to 415 are displayed as black.

In fig. 5C, when the user presses the right direction key on the control device, as shown in fig. 5D, the position of the selector is moved in response to the input right direction command so that the selector indicates that sub-item 4121 in the second presentation area 42 is selected, the sub-items in the second presentation area 42 are scrolled a certain distance in the left direction so that the selected sub-item 4121 is located directly below the item 412 to which it belongs, i.e. the offset0 between sub-item 4121 and the item 412 to which it belongs is 0. Meanwhile, the border color of the item 412 in FIG. 5D changes to gray, and the border colors of the other items 411, 413-415 are displayed as black to indicate to the user that the currently selected sub-item 4121 belongs under the category of the item 412.

In fig. 5D, when the user presses the right direction key on the control device, as shown in fig. 5E, the position of the selector is moved in response to the input right direction command so that the selector indicates that sub-item 4122 in second presentation area 42 is selected, then the plurality of sub-items in second presentation area 42 are scrolled a distance in the left direction so that the offset between the selected sub-item 4122 and the item 412 to which it belongs is offset 1. Meanwhile, in FIG. 5E, the color of the border of the item 412 is displayed as gray, and the colors of the borders of the other items 411, 413-415 are displayed as black.

Similarly, in FIG. 5E, when the user presses the left directional key on the control device, the position of the selector is moved in response to the input left directional command, so that the inverse transformation process of FIG. 5E-5D-5C-5B-5A is displayed in the GUI.

In one aspect, if the selector is sequentially instructed to select the sub-items from one boundary sub-item to another boundary sub-item in the at least one sub-item in the same item category, the offset presented between the selected sub-item and the item to which the selected sub-item belongs is gradually changed, so as to prompt the user to browse between the at least one sub-item in the same item category according to the direction or sequence of the gradual change.

For example, as shown in fig. 5A-5C, the offsets presented between sub-item 4111, sub-item 4112, sub-item 4113 and the corresponding item 411 are offset0, offset1, and offset2, respectively, and offset0< offset1< offset2, i.e., these offsets are gradually increased from left to right, so that the user can be prompted to browse sub-items 4111-4113 under the category of item 411 currently in the order from left to right. On the contrary, as shown in fig. 5C-5A, the offsets presented between the sub-item 4113, the sub-item 4112, the sub-item 4111 and the corresponding item 411 are offset2, offset1 and offset0, respectively, and offset2> offset1> offset0, that is, these offsets decrease gradually from right to left, so that the user can be prompted to browse the sub-items 4111-4113 under the item 411 category currently from right to left.

5D-5E, the sub-items 4121, 4122 and their belongings 412 are respectively offset0, offset1, and offset0< offset1, i.e. these offsets are increasing from left to right, which can prompt the user to browse the sub-items 4121-4122 under the category of items 412 in order from left to right. On the contrary, as shown in fig. 5E-5D, the sub-items 4122 and 4121 and the corresponding item 412 have offsets 1 and 0, respectively, and the offsets 1> 0, i.e. the offsets decrease gradually from right to left, so that the user can be prompted to browse the sub-items 4121-4122 under the item 412 category currently in the right to left order.

On the other hand, the offset presented between the selected sub-item and the item to which the selected sub-item belongs is greater than or equal to 0 and smaller than the width of the item to which the selected sub-item belongs in the first display area, so as to prompt the user to browse among at least one sub-item under the same item category currently.

For example, as shown in fig. 5A-5C, the offsets presented between sub-item 4111, sub-item 4112, sub-item 4113 and the item 411 to which they belong are offset0, offset1, and offset2, respectively, and these offsets are greater than or equal to 0 and less than the width of the item 411, so that it can be suggested to the user that the sub-items 4111-4113 belong to the item 411 category. As shown in fig. 5D-5E, the sub-items 4121 and 4122 and the item 412 to which they belong are offset0 and offset1, respectively, which are greater than or equal to 0 and smaller than the width of the item 412, so that the user can be informed that the sub-items 4121-4122 belong to the item 412 category.

Fig. 6A-6B illustrate a flow chart of a method 600 provided by a display device as a selector is moved within a first presentation area.

Referring to FIG. 1C and FIGS. 6A-6B, the method 600 for providing a display device when a selector moves in a first display area includes the following steps S61-S63:

step S61, displaying a GUI comprising a first presentation area and a second presentation area on the display, wherein the first presentation area comprises a plurality of items and the second presentation area comprises at least one sub-item related to the item; and a selector indicating that the item or the sub-item is selected.

For example, as shown in FIG. 4A, the GUI includes a first presentation area 41 providing a plurality of items 411-415, and a second presentation area 42 providing items 4111-4113 associated with the item 411, items 4121-4122 associated with the item 412, and a selector 43 indicating that the item 411 is selected.

In step S62, a movement instruction for controlling the movement of the selector is received through the user interface.

For example, the user interface may receive an instruction from a user to control the selector to move in the left/right direction in the GUI by pressing a left/right direction key on the control device to change the position of the selector in the GUI.

Step S63, executed by the controller: when it is determined that the selector is moved within the first presentation area based on the movement instruction and the selector is moved to one item, the plurality of sub-items of the second presentation area are scrolled by a preset distance such that a boundary sub-item of at least one sub-item related to the selected item among the plurality of sub-items is scrolled to a position around the selected item.

Here, the selected item surrounding position may be an up direction, a down direction, a left direction, and a right direction position of the selected item; and the selector may be moved from the position of the selected item to a position around the selected item by user input.

For example, as shown in fig. 4A and 4B, when the selector moves from the item 411 to the item 412, the plurality of sub-items of the second presentation area are scrolled by a preset distance, so that a boundary sub-item 4121 related to the item 412 among the plurality of sub-items is scrolled to a position below the item 412.

In some embodiments, when it is determined by the controller that the selector is moved to an item, the controller specifically performs the steps of:

in step S631, the current index TabIndex of the selected item in the first presentation area before the selector is moved is obtained.

Step S632, judging whether the current index TabIndex is the last index in the first display area; if not, go to step S633; otherwise, the flow ends.

In step S633, the target index targetindex of the selected item in the first display area after the selector moves is obtained.

Here, for example, if the selector moves from left to right, the target index targetindex = TabIndex + 1; moving the selector from right to left, the target index targetindex = TabIndex-1.

In step S634, the index targetDemoIndex of the boundary sub-item under the selected item category is acquired based on the target index.

In step S635, the abscissa value targetDemoX of the boundary sub-item is acquired based on the index of the boundary sub-item.

In step S636, a scrolling distance L1 that a plurality of sub-items in the second presentation area need to be scrolled is calculated according to formula 1.

In step S637, the plurality of sub-items in the second presentation area are scrolled by the distance L1, so that the boundary sub-item related to the selected item is scrolled to a position around the selected item.

The method 600 is described in more detail below in conjunction with FIGS. 6A-6B and FIG. 7.

Fig. 7 is a schematic diagram illustrating a method for calculating the rolling distance of a plurality of sub-items in the second presentation area when the selector moves in the first presentation area.

As shown in FIG. 7 a, a first presentation area 41 comprising items 411-415, a second presentation area 42 comprising sub-items 4113, 4121-4122, 4131-4132, a sub-item list 44 comprising all sub-items associated with items 411-415 are displayed in the GUI. Wherein the sub-item list comprises 18 sub-items, and the second display area can completely display 5 sub-items.

The user can move the position of the selector within the first presentation area 41 by means of the control means, thereby scrolling the plurality of sub-items within the second presentation area 42 a distance in the sub-item arrangement direction such that sub-items 4111-4112 arranged to the left of sub-item 4113 and not previously displayed in the GUI are displayed in the second presentation area 41, or such that sub-items 4133-4155 arranged to the right of sub-item 4132 and not previously displayed in the GUI are displayed in the second presentation area 41.

For example, as shown in fig. 7 a and b, when the selector is instructed by the control device to move from the item 412 in fig. 7 a to the item 413 in fig. 7 b, the sub-item list 44 is scrolled to the left by a certain distance, so that the 5 sub-items displayed in the second display area 42 are updated to 4121-4122, 4131-4133 from the 5 sub-items 4113, 4121-4122, 4131-4132 displayed in fig. 7 a.

For another example, as shown in fig. 7 b and d, when the selector is instructed by the control device to move from item 413 in fig. 7 b to item 414 in fig. 7 d, the sub-item list 44 scrolls to the left by a certain distance, so that the 5 sub-items displayed in the second display area are updated from the 5 sub-items 4121-4122, 4131-4133 shown in fig. 7 b to 4132-4134, 4141-4142.

At the same time, the user may move the position of the selector within the first presentation area 41 by the control means to cause the selector to indicate that an item is selected, thereby scrolling the plurality of sub-items of the second presentation area 42 a distance in the sub-item arrangement direction such that a boundary sub-item of the at least one sub-item associated with the selected item within the first presentation area 41 is scrolled to a position directly below the item.

Here, the scroll distance L1, by which the sub item list needs to be scrolled, may be calculated by the following formula, so that a boundary sub item among at least one sub item associated with the selected item is scrolled to a position directly below the selected item.

Equation 1: l1= targetDemoX-targetTabIndex (a + W) -D

In the above formula:

targetDeMoX-represents the distance of the boundary sub-item associated with the selected item from the left edge of the first presentation area (i.e., the abscissa of the boundary sub-item, with the bottom left corner of the screen as the origin of coordinates); here, the targetDemoX may be directly acquired by the controller according to an index of the boundary sub-item under the selected item category.

targetTabIndex-represents the index of the selected item within the first presentation area, i.e. the number of items to the left of the selected item within the first presentation area; here, the indexes of the items 411-415 in the first presentation area are 0-4, respectively.

A-represents the spacing between different items within the first presentation area; a is equal to or greater than 0.

W-represents the width of an item in the first presentation area.

D-represents the gap between the first item on the left side in the first display area and the left edge of the first display area; d is greater than or equal to 0.

Referring to a diagram a and b in fig. 7, when the selector is instructed by the control device to move from the item 412 in a diagram a in fig. 7 to the item 413 in b diagram in fig. 7, the plurality of sub-items in the second presentation area are scrolled in the left direction by a certain distance, so that the sub-item 4131 is scrolled to the position right below the item 413, that is, as shown in a diagram a in fig. 7, the sub-item 4131 needs to be scrolled from the starting position to the end position, the scrolling distance L1= starting position-end position needs to be scrolled, and the index targetindex of the item 413 is 2, so that starting position = targetDemoX, end = D +2 (a + W), and therefore L = targetDemoX-targetindex (a + W) -D = targetDemoX-2 (a + W) -D can be obtained.

In connection with the b diagram and the a diagram of fig. 7, when the selector is instructed by the control device to move from the item 413 in the b diagram of fig. 7 to the item 412 in the a diagram of fig. 7, the plurality of sub-items in the second presentation area are scrolled in the right direction by a certain distance, so that the sub-item 4121 is scrolled to the position directly below the item 412, that is, as shown in the b diagram of fig. 7, the sub-item 4121 needs to be scrolled from the starting position to the end position, the scrolling distance L1= starting position-end position, and the index targetindex of the item 412 is 1, so that starting position = targetDemoX, end position = D +1 (a + W), so that L1= targettargetindex (a + W) -D = targetDemoX-1 (a + W) -D can be obtained.

In connection with the diagrams c and D in fig. 7, when the selector is instructed by the control device to move from the item 413 in the diagram c in fig. 7 to the item 414 in the diagram D in fig. 7, the plurality of sub-items in the second presentation area are scrolled in the right direction by a certain distance, so that the sub-item 4141 is scrolled to the position directly below the item 414, that is, as shown in the diagram c in fig. 7, the sub-item 4141 needs to be scrolled from the starting position to the end position, the scrolling distance L1= starting position-end position, and the index targetindex of the item 414 is 3, so that starting position = targetDemoX, end position = D +3 (a + W), so that L1= targetdelx-targetindex (a + W) -D = targetDemotx-3 (a + W) -D can be obtained.

In the diagrams of a-d in fig. 7, the items in the first display area and the sub-items in the second display area have the same width W, so that the arrangement of the user intuitive experience items has uniform style and attribute and conforms to the habit of the user.

However, the spacing between different items in the first presentation area and the spacing between different sub-items in the second presentation area need not be the same.

As shown in a of fig. 7, different items in the first display area have the same spacing a; and different sub-items in the same category in the second display area have the same spacing B, such as the spacing B between sub-item 4121 and sub-item 4122, the spacing B between sub-item 4131 and sub-item 4132, and the spacing a between edge sub-items in different categories, such as the spacing a between sub-item 4113 and sub-item 4121, and the spacing a between sub-item 4122 and sub-item 4131. Here, on one hand, the distance a between different items is the same as the distance a between edge sub-items in sub-items of different categories, so that the user can experience that the items in the first display area and the second display area are classified clearly and consistently; on the other hand, the distance B may be smaller than the distance a, so that the user can visually distinguish the sub-items in the same category from the sub-items in different categories in the second presentation area.

As shown in a of FIG. 9A, different items in the first display area have the same spacing A; and different sub-items in the same category in the second display area have the same spacing B, such as the spacing B between sub-item 4121 and sub-item 4122, the spacing B between sub-item 4131 and sub-item 4132, and the spacing C between edge sub-items in different categories, such as the spacing C between sub-item 4113 and sub-item 4121, and the spacing C between sub-item 4122 and sub-item 4131. The distance C can be larger than the distance A, and the distance A can be larger than the distance B, so that the user can visually distinguish the sub-items in the same category and the sub-items in different categories in the second display area.

However, the present embodiment does not limit the interval between the items. If the different items in the first display area have the same distance A, and the different sub-items in the second display area also have the same distance A, the arrangement of the user visual experience items can also have uniform style and attributes.

In addition, the present embodiment also does not limit the form of distinguishing the sub-items in different categories, and besides that the above-mentioned distance between the sub-items in the same category is smaller than the distance between the sub-items in different categories, the above-mentioned sub-items in the same category may also be distinguished by using the background color of the sub-items in the same category is different from the background color of the sub-items in different categories.

Fig. 8A-8B illustrate a flow chart of a method 800 for providing a display device while a selector is moved within a second presentation area.

Referring to FIG. 1C and FIGS. 8A-8B, the method 800 for providing a display device when the selector moves in the second display area includes the following steps S81-S83:

step S81, displaying a GUI comprising a first presentation area and a second presentation area on the display, wherein the first presentation area comprises a plurality of items and the second presentation area comprises at least one sub-item related to the item; and a selector indicating that the item or the sub-item is selected.

For example, as shown in FIG. 5A, the GUI includes a first presentation area 41 providing a plurality of items 411-415, and a second presentation area 42 providing items 4111-4113 associated with the item 411, items 4121-4122 associated with the item 412, and a selector 43 indicating that the item 4111 is selected.

In step S82, a movement instruction for controlling the movement of the selector is received through the user interface.

Step S83, executed by the controller: when it is determined based on the movement instruction that the selector is moved within the second presentation area and the selector is moved to one of the sub-items, the plurality of sub-items of the second presentation area are scrolled such that an offset is presented between the selected one of the at least one sub-item and the item to which it belongs.

For example, as shown in fig. 5A and 5B, when the selector is moved from sub-item 4111 to sub-item 4112, the plurality of sub-items of the second presentation area are scrolled a preset distance such that an offset1 is presented between the selected sub-item 4112 and the item to which it belongs.

In some embodiments, when it is determined by the controller that the selector is moved to a sub-item, the controller specifically performs the steps of:

in step S831, the target index targetindex of the item to which the selected sub-item belongs in the first presentation area after the selector is moved is obtained.

In step S832, based on the target index, the index targetDemoIndex of the selected sub-item under the item category to which the selected sub-item belongs is obtained.

In step S833, based on the index of the selected sub-item, the abscissa value targetDemoX of the selected sub-item is acquired.

In step S834, a scroll distance L1 for the selected sub-item to scroll to a position directly below the item to which it belongs is calculated according to formula 1.

Step S835, calculating a unit offset of each sub-entry in the target index to the entry to which the sub-entry belongs according to formula 2.

In step S836, the offset actualOffset between the selected sub-item and the item to which it belongs is calculated according to formula 3.

Step S837, calculating a scrolling distance L2 that the plurality of sub items in the second display area need to be scrolled according to formula 4.

Step S838 scrolls the plurality of sub-items within the second presentation area by a distance L2 such that an offset is presented between the selected sub-item and the item to which it belongs.

The method 800 is described in more detail below in conjunction with FIGS. 8A-8B and 9A-9B.

As shown in a of FIG. 9A, a first presentation area 41 comprising items 411-415, a second presentation area 42 comprising sub-items 4111-4113, 4121-4122, and a sub-item list 44 comprising all sub-items associated with the items 411-415 are displayed in the GUI. Wherein the sub-item list comprises 18 sub-items, and the second display area can completely display 5 sub-items.

The user can move the position of the selector within the second presentation area 42 by means of the control device, thereby scrolling the plurality of sub-items within the second presentation area 42 a distance in the sub-item arrangement direction such that sub-items 4131-4155 arranged to the right of the sub-item 4122 and not previously displayed in the GUI are displayed in the second presentation area 42.

Meanwhile, the user may move the position of the selector within the second presentation area 42 through the control means, and determine that the selector is moved between at least one sub-item associated with one item, scroll the plurality of sub-items of the second presentation area 42 by a distance along the sub-item arrangement direction such that the offset presented between the selected sub-item and one item of the at least one sub-item progressively changes in the arrangement order from one boundary sub-item to another boundary sub-item.

Here, the scroll distance L2, by which the sub item list needs to be scrolled, may be calculated by the following formula, so that the offset presented between the selected sub item and one item in at least one sub item gradually changes in the arrangement order from one boundary sub item to another boundary sub item.

First, according to formula 1, a distance L1 for the selected sub-item to scroll to a position directly below the item to which the selected sub-item belongs is calculated.

Equation 1: l1= targetDemoX-targetTabIndex (a + W) -D

In the above equation 1:

targetDeMoX-represents the distance from the selected sub-item to the left edge of the first presentation area (i.e., the abscissa of the selected sub-item, with the lower left corner of the screen as the origin of coordinates); here, the targetDemoX may be directly acquired by the controller according to an index of the selected sub-item under the item category to which it belongs.

targetTabIndex-represents the index of the item to which the selected sub-item belongs in the first presentation area, i.e. the number of items to the left of the item to which the first presentation area belongs; here, the indexes of the items 411-415 in the first presentation area are 0-4, respectively.

W-represents the width of an item in the first presentation area.

Next, the unit offset occupied by each sub-item in (a + W) associated with the item to which the selected sub-item belongs is calculated according to formula 2.

Equation 2: offset = (a + W)/N;

in the above equation 2: n-represents the number of sub-items associated with the item to which the selected sub-item belongs.

Again, the offset between the selected sub-item and the item to which the selected sub-item belongs is calculated according to equation 3:

equation 3: actualooffset = targetDemoIndex offset;

in the above equation 3: targetDemoIndex-represents the index of the selected sub-item in the at least one sub-item associated with the item to which it belongs, i.e. the number of sub-items to the left of the selected sub-item in the at least one sub-item; for example, the indexes of the sub-items 4111 to 4113 associated with the item 411 are 0 to 2, respectively.

Finally, according to formula 4, the scrolling distance L2 that the sub item list needs to be scrolled is calculated:

equation 4: l2= L1-actualOffset.

For example, as shown in fig. 9A and b, when the selector is instructed by the control device to move from sub-item 4111 in fig. a to sub-item 4112 in fig. 9A, b, the sub-item list 44 scrolls to the left by a certain distance, so that the offset presented between sub-item 4112 and item 411 is offset, instead of no offset between sub-item 4111 and item 411 in fig. 9A. That is, as shown in a diagram in fig. 9A, the sub-item 4112 needs to be scrolled from the starting position to the end position, and the scrolling distance L2= starting-end position needs to be scrolled. And the index of item 411 in the first presentation area is 0, the index of sub-item 4112 in the at least one sub-item associated with item 411 to which it belongs is 1, and the number of sub-items associated with item 411 is 3, so L1= = targetDemoX-0 = (a + W) -D is calculated according to formula 1, offset = (a + W)/3 is calculated according to formula 2, actualooffset = 1 × offset is calculated according to formula 3, and finally L2= L1-actualooffset = targetDemoX-D-offset is obtained.

As another example, when the selector is instructed by the control device to move from sub-item 4112 in b of fig. 9A to sub-item 4113 in c of fig. 9A, as shown in b and c of fig. 9A, the sub-item list 44 scrolls to the left by a distance such that the offset presented between sub-item 4113 and item 411 is 2 x offset. That is, as shown in b of fig. 9A, the sub-item 4113 needs to be scrolled from the starting position to the end position, and the scrolling distance L2= starting-end position needs to be scrolled. And the index of item 411 in the first presentation area is 0, the index of sub-item 4113 in the at least one sub-item associated with item 411 to which it belongs is 2, and the number of sub-items associated with item 411 is 3, so L1= = targetDemoX-0 = (a + W) -D is calculated according to formula 1, offset = (a + W)/3 is calculated according to formula 2, actualooffset = 2 × offset is calculated according to formula 3, and finally L2= L1-actualooffset = targetDemoX-D-2 × offset is available.

As another example, in connection with fig. 9A, diagrams c and d, when the selector is instructed via the control means to move from sub-item 4113 in fig. 9A, diagram c, to sub-item 4121 in fig. 9A, diagram d, the sub-item list 44 scrolls to the left by a distance such that the offset presented between sub-item 4121 and item 412 is 0. That is, as shown in the c diagram in fig. 9A, the sub-item 4121 needs to be scrolled from the starting position to the end position, and the scroll distance L2= starting-end position needs to be scrolled. And the index of the item 412 in the first presentation area is 1, the index of the sub-item 4121 in the at least one sub-item associated with the item 412 to which it belongs is 0, and the number of sub-items associated with the item 412 is 2, so that L1= = targetDemoX-1 = (a + W) -D is calculated according to formula 1, offset = (a + W)/2 is calculated according to formula 2, actualooffset = 0 = offset is calculated according to formula 3, and finally L2= L1-actualooffset = targetDemoX- (a + W) -D is obtained.

Here, when the selected sub-item to be indicated by the selector is a boundary sub-item of the item to which the selected sub-item belongs, the scrolling distance L2 that the sub-item list needs to be scrolled may also be directly calculated according to equation 1, that is, when L2= L1. For example, as shown in the c diagram in fig. 9A, the sub-item 4121 needs to be scrolled from the starting position to the end position, and the scrolling distance L2= starting position-end position, i.e., L2= L1= targetDemoX- (a + W) -D.

As another example, when the selector is instructed via the control means to move from sub-item 4121 in fig. 9A in d to sub-item 4122 in fig. 9A in e, as shown in connection with fig. 9A in d and e, the sub-item list 44 scrolls to the left by a distance such that the offset presented between sub-item 4122 and item 412 is offset. That is, as shown in the d diagram in fig. 9A, the sub-item 4122 needs to be scrolled from the starting position to the end position, and the scroll distance L2= starting-end position needs to be scrolled. And the index of the item 412 in the first presentation area is 1, the index of the sub-item 4122 in the at least one sub-item associated with the item 412 to which it belongs is 1, and the number of sub-items associated with the item 412 is 2, so that L1= = targetDemoX-1 = (a + W) -D is calculated according to formula 1, offset = (a + W)/2 is calculated according to formula 2, actualooffset = 1 × (offset) is calculated according to formula 3, and finally L2= L1-actualooffset = targetDemoX- (a + W) -D-offset is obtained.

As another example, when the selector is instructed via the control device to move from sub-item 4121 in fig. 9B in fig. f to sub-item 4113 in fig. c, as shown in fig. 9B and c, the sub-item list 44 scrolls to the right by a distance such that the offset presented between sub-item 4113 and item 411 is 2 x offset. That is, as shown in the f diagram in fig. 9B, the sub-item 4113 needs to be scrolled from the starting position to the end position, and the scrolling distance L2 that needs to be scrolled = starting-end position. And the index of item 411 in the first presentation area is 0, the index of sub-item 4113 in the at least one sub-item associated with item 411 to which it belongs is 2, and the number of sub-items associated with item 411 is 3, so L1= = targetDemoX-0 = (a + W) -D is calculated according to formula 1, offset = (a + W)/3 is calculated according to formula 2, actualooffset = 2 × offset is calculated according to formula 3, and finally L2= L1-actualooffset = targetDemoX-D-2 offset is obtained.

As shown in a-c diagram in fig. 9A, in sub-items 4111 to 4113, in the order that the selected sub-items are 4111, 4112 and 4113, the offsets between the selected sub-item and the item 411 are 0, offset and 2 × offset in sequence, and the offsets are gradually increased; conversely, these shifts tend to decrease. As shown in fig. 9A, d-e, the sub-items 4121-4122 show offsets 0 and offset in the

order

4121 and 4122 in the selected sub-item and the item 412, and the offsets gradually increase; conversely, these shifts tend to decrease.

Furthermore, as shown in equations 3 and 2, the offset actualOffset = targetDemoIndex offset = targetDemoIndex (a + W)/N between the selected sub-item and the item to which the selected sub-item belongs, so that the offset is greater than or equal to 0 and smaller than the sum of the width of the item to which the selected sub-item belongs in the first presentation area and the pitch of the items.

Furthermore, as can be seen from equations 3 and 2, the offset actualOffset = targetDemoIndex offset = targetDemoIndex (a + W)/N between the selected sub-item and the item to which the selected sub-item belongs, so the size of the offset is related to the number N of sub-items in the same item category. The larger the number N of sub-items under the same category, the smaller the offset actualooffset that is present between the selected sub-item at the same index targetDemoIndex under the category and the item to which it belongs.

For example, as shown in b in fig. 9A, the offset presented between sub-entry 4112 and entry 411 is offset = (a + W)/3; as shown in e diagram in fig. 9A, the offset presented between sub-entry 4122 and entry 412 is offset = (a + W)/2; here, since the number of sub-items 3 under the item 411 category is larger than the number of sub-items 2 under the item 412 category, the offset presented between sub-item 4112 and item 411 is smaller than the offset presented between sub-item 4122 and item 412.

While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

Claims

1. A display device, comprising:

a controller for performing:

when it is determined that the selector is moved within the first presentation area based on the movement instruction and the selector is moved to an item, scrolling a plurality of sub-items of the second presentation area by a preset distance such that a boundary sub-item associated with the selected item among the plurality of sub-items is scrolled to a position around the selected item; the boundary sub-item is a sub-item arranged at an edge in at least one sub-item associated with the selected item;

displaying sub-items associated with other items in the first display area besides the selected item in addition to at least one sub-item associated with the selected item in the second display area;

the plurality of sub-items within the second presentation area are arranged horizontally in rows or vertically in columns.

2. The display apparatus according to claim 1, wherein the sub-items displayed in the second presentation area in the GUI are scrolled and updated in the sub-item arrangement direction to remove the sub-items displayed in the GUI from the GUI while displaying the sub-items not previously displayed in the GUI.

3. The display device according to claim 2, wherein the scrolling the plurality of sub-items of the second presentation area by a preset distance such that a boundary sub-item associated with the selected item among the plurality of sub-items scrolls to a position around the selected item, specifically comprises:

4. The display device of claim 1, wherein the preset distance is determined based on a width of the item in the first presentation area and an index of the item within the first presentation area.

5. The display device of claim 1, wherein the predetermined distance is determined based on a width of the item in the first presentation area and an index of the item in the first presentation area, and a spacing between different items in the first presentation area.

6. A display device, comprising:

a controller for performing:

when it is determined based on the movement instruction that the selector is moved within the second presentation area and the selector is moved to one sub-item, scrolling through a plurality of sub-items of the second presentation area such that an offset is presented between the selected sub-item of the at least one sub-item and the item to which it belongs, the offset distance being greater than or equal to 0 and less than the width of the item;

7. The display device according to claim 6, wherein in at least one sub-item associated with one item, the offset presented between the selected sub-item and the one item gradually changes in the order of arrangement from the one boundary sub-item to the other boundary sub-item; the boundary sub-item is a sub-item arranged at an edge in at least one sub-item associated with one item.

8. The display device according to claim 7, wherein the offset is greater than or equal to 0 and less than the width of the item to which the selected sub-item belongs in the first presentation area.

9. A display device according to claim 8, wherein the offset is determined by the index of the selected sub-item in the sub-item associated with the item to which it belongs and the number of sub-items associated with the item to which it belongs.

10. The display device according to claim 9, wherein the controller is further configured to perform: