KR20240037796A - An electronic apparatus and a method thereof - Google Patents

Abstract

It includes an output unit, a communication unit, a memory storing one or more instructions, and one or more processors executing one or more instructions stored in the memory, wherein the one or more processors execute the one or more instructions and receive a control signal from the control device through the communication unit. And, if the content output to the output unit is a first type of content, the content output is controlled in the first mode based on the control signal, and if the content output to the output unit is a second type of content, the content output is controlled in the first mode based on the control signal. The content output is controlled in a mode, and the control signal is at least one of a first control signal according to selection of a first direction key provided in the control device and a second control signal according to selection of a second direction key, which is different from the first direction key. An electronic device comprising:

Description

An electronic apparatus and a method thereof}

Various disclosed embodiments relate to an electronic device and a method of operating the same, and more specifically, to an electronic device and a method of operating the same that control content output in various modes according to a control signal from a control device.

A user can control the operation of an electronic device such as a television using a control device such as a remote control. When a user selects one of a plurality of keys included in the remote control, the remote control may generate a control signal corresponding to the selected key input and transmit it to the electronic device. Electronic devices can be controlled according to control signals received from a remote control.

With the development of technology, electronic devices can output various types of content in addition to broadcast content. Accordingly, there is a need to control various contents using a single remote control.

An electronic device according to an embodiment includes an output unit, a communication unit, and a memory that stores one or more instructions; and one or more processors executing one or more instructions stored in the memory.

In an embodiment, the one or more processors may receive a control signal from the control device 150 through the communication unit by executing the one or more instructions.

In an embodiment, the one or more processors may control content output in a first mode based on the control signal when the content output to the output unit is a first type of content by executing the one or more instructions.

In an embodiment, the one or more processors may control content output in a second mode based on the control signal when the content output to the output unit is a second type of content by executing the one or more instructions.

In an embodiment, the control signal includes at least one of a first control signal according to selection of a first direction key provided in the control device and a second control signal depending on selection of a second direction key, which is different from the first direction key. can do.

A control device according to an embodiment may include an input unit, a communication unit, a memory storing one or more instructions, and one or more processors executing one or more instructions stored in the memory.

In an embodiment, the one or more processors may transmit a control signal to the electronic device through the communication unit by executing the one or more instructions.

In an embodiment, the input unit may include a first direction key and a second direction key different from the first direction key.

In an embodiment, the first direction key may be placed on the front of the control device, and the second direction key may be placed on at least one of the front, back, rear, and side positions of the control device.

A method of operating an electronic device according to an embodiment may include receiving a control signal from a control device.

In an embodiment, a method of operating an electronic device may include controlling content output in a first mode based on the control signal when the output content is a first type of content.

In an embodiment, a method of operating an electronic device may include controlling content output in a second mode based on the control signal when the output content is a second type of content.

In an embodiment, the control signal includes at least one of a first control signal according to selection of a first direction key provided in the control device and a second control signal depending on selection of a second direction key, which is different from the first direction key. can do.

The recording medium according to the embodiment may be a computer-readable recording medium on which a program that allows a computer to perform a method of operating an electronic device, including receiving a control signal from a control device, is recorded.

In an embodiment, the recording medium is a program that can perform a method of operating an electronic device by a computer, including controlling output of the content in a first mode based on the control signal when the content is a first type of content. This may be a computer-readable recording medium.

In an embodiment, the recording medium may perform a method of operating an electronic device by a computer, including controlling output of content in a second mode based on the control signal when the content to be output is a second type of content. It may be a computer-readable recording medium on which a program is recorded.

In an embodiment, the recording medium may be configured such that the control signal is at least one of a first control signal according to selection of a first direction key provided in the control device and a second control signal depending on selection of a second direction key, which is different from the first direction key. It may be a computer-readable recording medium on which a program capable of executing a method of operating an electronic device, including one, is recorded by a computer.

FIG. 1 is a diagram illustrating how an electronic device controls content output based on a control signal from a control device, according to an embodiment.
Figure 2 is an internal block diagram of an electronic device and a control device according to an embodiment.
3 is an internal block diagram of a processor of an electronic device according to an embodiment.
FIG. 4 is a diagram illustrating how an electronic device controls content output in a first mode based on a control signal from a control device, according to an embodiment.
FIG. 5 is a diagram illustrating an electronic device controlling content output in a first mode based on a control signal from a control device, according to an embodiment.
FIG. 6 is a diagram illustrating how an electronic device controls content output in a second mode based on a control signal from a control device, according to an embodiment.
FIG. 7 is a diagram illustrating how an electronic device controls content output in a second mode based on a control signal from a control device, according to an embodiment.
FIG. 8 is a diagram illustrating how an electronic device controls content output in a third mode based on a control signal from a control device, according to an embodiment.
Figure 9 illustrates a case where a control device includes three or more direction keys, according to an embodiment.
10 is an internal block diagram of an electronic device according to an embodiment.
FIG. 11 is a flowchart showing how an electronic device operates, according to an embodiment.
FIG. 12 is a diagram illustrating an electronic device controlling content output in a first mode based on a control signal from a control device, according to an embodiment.
FIG. 13 is a diagram illustrating how an electronic device controls content output in a second mode based on a control signal from a control device, according to an embodiment.
FIG. 14 is a diagram illustrating how an electronic device controls content output in a third mode based on a control signal from a control device, according to an embodiment.

In the present disclosure, the expression “at least one of a, b, or c” refers to “a”, “b”, “c”, “a and b”, “a and c”, “b and c”, “a, b and c", or variations thereof.

Below, with reference to the attached drawings, embodiments of the present disclosure will be described in detail so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in many different forms and is not limited to the embodiments described herein.

The terms used in this disclosure are described as general terms currently used in consideration of the functions mentioned in this disclosure, but may mean various other terms depending on the intention or precedents of those skilled in the art, the emergence of new technologies, etc. You can. Accordingly, the terms used in this disclosure should not be interpreted only by the name of the term, but should be interpreted based on the meaning of the term and the overall content of this disclosure.

Additionally, the terms used in the present disclosure are merely used to describe specific embodiments and are not intended to limit the present disclosure.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected," but also the case where it is "electrically connected" with another element in between. .

As used in this specification, particularly in the patent claims, “the” and similar indicators may refer to both the singular and the plural. Additionally, unless there is a description clearly designating the order of steps describing the method according to the present disclosure, the steps described may be performed in any suitable order. The present disclosure is not limited by the order of description of the steps described.

Phrases such as “in some embodiments” or “in one embodiment” that appear in various places in this specification do not necessarily all refer to the same embodiment.

Some embodiments of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented in various numbers of hardware and/or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors, or may be implemented by circuit configurations for certain functions. Additionally, for example, functional blocks of the present disclosure may be implemented in various programming or scripting languages. Functional blocks may be implemented as algorithms running on one or more processors. Additionally, the present disclosure may employ conventional technologies for electronic environment setup, signal processing, and/or data processing. Terms such as “mechanism,” “element,” “means,” and “configuration” may be used broadly and are not limited to mechanical and physical components.

Additionally, connection lines or connection members between components shown in the drawings merely exemplify functional connections and/or physical or circuit connections. In an actual device, connections between components may be represented by various replaceable or additional functional connections, physical connections, or circuit connections.

In addition, terms such as "... unit" and "module" used in the specification refer to a unit that processes at least one function or operation, which may be implemented as hardware or software, or as a combination of hardware and software. .

Additionally, the term “user” in the specification refers to a person who uses an electronic device and may include a consumer, evaluator, viewer, administrator, or installer.

Hereinafter, the present disclosure will be described in detail with reference to the attached drawings.

FIG. 1 is a diagram illustrating how the electronic device 100 controls content output based on a control signal from the control device 150, according to an embodiment.

Referring to FIG. 1, the electronic device 100 may be an electronic device capable of outputting images. According to one example, the electronic device 100 may be implemented as various types of electronic devices including a display. The electronic device 100 may be fixed or mobile, and may be a digital TV capable of receiving digital broadcasting, but is not limited thereto.

In an embodiment, the electronic device 100 may include a desktop, a smart phone, a tablet personal computer, a mobile phone, a video phone, an e-book reader, or a laptop PC. personal computer, netbook computer, digital camera, PDA (Personal Digital Assistants), PMP (Portable Multimedia Player), camcorder, navigation, wearable device, smart watch, home network system, It may include at least one of a security system and a medical device.

The electronic device 100 may be implemented not only as a flat display device, but also as a curved display device, which is a screen with a curvature, or a flexible display device whose curvature can be adjusted. The output resolution of the electronic device 100 may have various resolutions, such as High Definition (HD), Full HD, Ultra HD, or a resolution clearer than Ultra HD.

The electronic device 100 can output various types of content provided by content providers. Content may include video such as still images and moving pictures, audio, subtitles, and other additional information. A content provider may refer to a terrestrial broadcasting station, cable broadcasting station, satellite broadcasting station, IPTV (Internet Protocol Television) service provider, or OTT (Over the Top) service provider that provides various contents to consumers.

In an embodiment, the electronic device 100 may receive and output various contents generated by a content provider through an external device (not shown). For example, external devices may be implemented as various types of source devices such as PCs, set-top boxes, Blu-ray disc players, mobile phones, game consoles, home theaters, audio players, USB, etc. An external device may be connected to the electronic device 100 through a wired communication network such as HDMI or a wireless communication network and provide various contents to the electronic device 100. The electronic device 100 may receive VOD (Video On Demand) content provided by an IPTV service provider or an OTT service provider through a set-top box and output it. VOD service is a service that provides the video the user wants at the desired time through a communication network connection, and can refer to various types of content provided by OTT service providers or IPTV service providers. IPTV service providers or OTT service providers can provide not only VOD content but also real-time broadcast programs.

In an embodiment, the electronic device 100 may be a smart TV. Smart TV may refer to a digital TV equipped with an operating system (OS) and an Internet access function. Smart TV may also be called Internet TV, connected TV, or hybrid TV.

In an embodiment, in addition to real-time broadcasting programs, the electronic device 100 may stream and output various types of VOD content generated by OTT service providers such as YouTube or Netflix using an internally mounted operating system.

Hereinafter, content that users can watch, such as broadcast programs or VOD content, will be referred to as viewing content.

In an embodiment, the electronic device 100 may access the Internet to provide web surfing services, social network services, etc. Additionally, the electronic device 100 can function as a communication center that can check news, weather, e-mail, etc. in real time.

In an embodiment, the electronic device 100 may execute various types of applications. The electronic device 100 may have various types of apps (applications) installed by default. Alternatively, the electronic device 100 may access the Internet, search for the app requested by the user, and install it under the user's control. The electronic device 100 can run an app to provide various services. For example, the electronic device 100 may run an app that provides a video call service and provide a video call service with another remote user.

In an embodiment, the electronic device 100 may be controlled by the control device 150. In an embodiment, the control device 150 may be a device used to control the electronic device 100, such as a remote controller. A user can control various functions of the electronic device 100 using the control device 150.

In an embodiment, the control device 150 may include an input unit. The input unit may receive user input for controlling the electronic device 100. The input unit included in the control device 150 may include a plurality of keys. Keys may be in various forms, such as a physical button that receives a user's push operation, a jog & shuttle, or a touch button displayed on a touchpad that detects touch. A user can control various functions of the electronic device 100 using a plurality of keys provided on the control device 150.

A plurality of keys included in the control device 150 can be used to control various functions of the electronic device 100. The user can use the control device 150 to perform various functions of the electronic device 100, such as turning the power on/off, changing channels, adjusting the volume, terrestrial broadcasting, cable broadcasting, satellite broadcasting, One of various broadcasts such as Internet broadcasting can be selected, an object such as a specific item or content can be selected on the screen, or environment settings, etc. can be performed.

In the past, the remote control had various types of keys used to control the electronic device 100, such as number keys, channel control keys, volume control keys, direction selection keys, menu selection keys, etc., exposed on the front. In other words, existing remote controls mostly included keys that directly matched TV functions. Because there are many types of buttons included in the remote control, it was difficult for users to find the button to execute a specific function, and they had to look at the remote control and select the button to execute the function instead of looking at the content displayed on the electronic device.

Accordingly, recently, simple remote controls have been developed and used that minimize rarely used buttons and include only buttons for functions frequently used by users. Users can now operate buttons provided on the remote control while looking at the screen of the electronic device 100 without having to look at the remote control to find keys corresponding to desired functions one by one.

As TVs have evolved into smart TVs, TV functions have become more complex and many new functions have appeared. Users need to use the remote control not only to perform simple operations such as power, volume control, and channel change, but also to perform various operations or services such as app search, web surfing, SNS, VOD, video calls, games, etc. . As TVs perform a variety of functions, there is a limit to matching and using all the functions performed by the TV with a small number of keys on the remote control. Accordingly, in order to control various functions of the TV with a small number of buttons provided on the remote control, the user had to select the buttons on the remote control in several steps or depths.

FIG. 1 illustrates that the electronic device 100 receives a control signal from the control device 150 through the communication network 130 according to an embodiment. In an embodiment, control device 150 is an example of a simple remote control that includes only a few buttons. 1 shows the front 150-1 and the rear 150-2 of the control device 150, respectively.

In an embodiment, the control device 150 may include a plurality of keys. In an embodiment, the control device may include a plurality of direction keys 151 and 155.

For example, as shown in FIG. 1, the control device 150 has a first direction key 151 on the front side 150-1 and a second direction key 155 on the back side 150-2. can do. However, this is one embodiment, and the control device 150 is provided with a first direction key 151 on the front side 150-1, not on the front or rear side of the control device 150. , Alternatively, a second direction key 151 may be provided on the side. Alternatively, the control device 150 may be provided with both a first direction key 151 and a second direction key 155 on the front surface 150-1. Alternatively, the control device 150 is provided with both a first direction key 151 and a second direction key 155 on the front side 150-1 and another third direction key on the back side 150-2. You may.

Most users who use a television want to watch content output from the electronic device 100 in as comfortable a position as possible. For example, users tend to watch television in a ‘lean back’ state, with their upper body tilted back. The remote control is also a user interface used while the user is watching television in a comfortable position, so it is required to be in a form that can be operated as simply and conveniently as possible. Accordingly, remote controls have been developed into a form that users can operate with one hand.

In an embodiment, the plurality of direction keys 151 and 155 provided in the control device 150 may be placed in a position where the user can operate them with one hand. For example, when the first direction key 151 is placed on the front side 150-1 of the control device 150 and the second direction key 151 is placed on the back side 150-2 of the control device 150. , the first direction key 151 may be operated by the user's thumb, and at the same time, the second direction key 155 may be placed in a position that can be operated by the user's index or middle finger.

In an embodiment, when the direction keys 151 and 155 are selected, the control device 150 may generate control signals corresponding to the selected direction keys 151 and 155. In an embodiment, the control signal may include at least one of a control signal depending on selection of the first direction key 151 provided in the control device 150 and a control signal depending on selection of the second direction key 155.

The control signal according to selection of the first direction key 151 provided in the control device 150 is called a first control signal, and the control signal according to selection of the second direction key 155, which is different from the first direction key, is called a second control signal. It will be called a control signal. The first control signal may be a control signal including a key code command corresponding to each of the four directions of the first direction key 151. Additionally, the second control signal may be a control signal including key code commands corresponding to each of the four directions of the second direction key 155.

In an embodiment, when the direction keys 151 and 155 are selected, the control device 150 may transmit a control signal corresponding to the selected direction keys 151 and 155 to the electronic device 100.

In an embodiment, the electronic device 100 may receive a control signal from the control device 150 and perform an operation corresponding to the control signal.

In an embodiment, the electronic device 100 may operate differently in response to a control signal depending on the type of content currently being output. That is, in an embodiment, when the electronic device 100 receives a control signal from the control device 150, the electronic device 100 may control content output in a different mode in response to the same control signal depending on the type of content currently being output.

The type of content refers to the type or type of content. Depending on whether the content is metaverse content, viewing content, or video call content, there are different types such as the first type, the second type, and the third type. It can be classified as: However, it is not limited to this, and the type of content may be in various forms, such as content for accessing an Internet browser, content for web surfing, content provided by SNS services such as a real-time chat room, etc.

In an embodiment, the electronic device 100 may output a guide UI. The guide UI may be an interface that guides actions or functions performed when a plurality of direction keys 151 and 155 are selected depending on the type of content currently being output.

If the operation performed depending on the selection of the direction keys 151 and 155 varies depending on the type of content, the user may be confused about which key to select when controlling the content. Accordingly, in an embodiment, the electronic device 100 may generate a guide UI suitable for the type of content being output and output it together with the content.

In an embodiment, the guide UI includes a first guide UI displaying an operation performed based on selection of the first direction key 151 and a second guide displaying an operation performed based on selection of the second direction key 155. May include at least one of the UI.

In an embodiment, the electronic device 100 may output a guide UI at preset time intervals or whenever an event occurs. In an embodiment, the event may include at least one of an event in which the type of content output by the electronic device 100 changes and an event in which a function controlled based on a control signal changes.

The user can use the guide UI displayed on the screen of the electronic device 100 to identify the function performed when selecting the direction keys 151 and 155, and control the content by manipulating the direction keys 151 and 155 accordingly. .

In an embodiment, if the content currently being output is the first type of content, the electronic device 100 may control content output in the first mode based on a control signal.

In an embodiment, the first type of content may be metaverse content. Metaverse can refer to a three-dimensional space platform that allows social, economic, educational, cultural, and scientific and technological activities similar to actual reality through avatars. The electronic device 100 can output metaverse content by running an app that provides metaverse content. Metaverse content may be content representing the virtual space provided by the Metaverse platform.

Metaverse content features avatars that users can manipulate. Users can manipulate the avatar to make the avatar interact with other avatars, explore the surroundings, or perform actions appropriate for various situations. In order to control the avatar's movements, it is necessary to control the avatar's movement direction and gaze direction, respectively.

Since a remote control usually includes only one direction key, the user cannot control the avatar in the metaverse content through the electronic device 100 using an existing remote control.

As in the embodiment, when the control device 150 includes the first direction key 151 and the second direction key 155, the user uses the first direction key 151 provided in the control device 150. The avatar's movement direction and gaze can be controlled using the and second direction keys 155, respectively.

In an embodiment, the electronic device 100 may control the output of metaverse content in the first mode based on at least one of the first control signal and the second control signal.

For example, in an embodiment, the electronic device 100 may control the movement direction of the avatar in the metaverse content based on the first control signal according to the input of the first direction key 151. Additionally, the electronic device 100 may control the gaze direction of the avatar in the metaverse content based on the second control signal corresponding to the input of the second direction key 155.

In an embodiment, the electronic device 100 may output a guide UI suitable for the metaverse content while outputting the metaverse content. That is, the electronic device 100 includes a first guide UI indicating that the avatar's movement direction is controlled when the first direction key 151 is selected, and a first guide UI indicating that the avatar's movement direction is controlled when the second direction key 155 is selected. A second guide UI indicating that the gaze direction is controlled may be output.

In an embodiment, if the content currently being output is a second type of content, the electronic device 100 may control content output in the second mode based on a control signal.

In embodiments, the second type of content may be viewing content. Content for viewing may refer to content such as videos or videos that can be viewed, such as movies or dramas. For example, content for viewing may be a broadcast program, VOD content through an OTT service, or content such as a video, photo, or picture acquired through an external device such as a USB or PC.

In an embodiment, content for viewing may include a basic screen that is basically displayed when the electronic device 100 is turned on. The basic screen may also be called a home screen. The main screen can include a list of various VODs or executable apps.

In embodiments, content for viewing may include various objects. In the present disclosure, an object may mean an item that a user can select using the control device 150. In an embodiment, various VDO contents or apps included in the basic screen may each be one object.

In embodiments, content for viewing may include preview content for specific content. Preview content is content to introduce content such as a movie or drama before it is played. It includes the synopsis of the content, the actors, the director, the year of production, and, if the content is a series, which season the content is from. It may include at least one of trailers, such as information about the content and a video about the content. In embodiments, preview content may include various objects that can be selected, such as selecting to play, adding the content to a watch list, selecting a preference for the content, etc.

In an embodiment, while watching content for viewing, a user may control the content for viewing in various ways using two or more direction keys provided in the control device 150.

In an embodiment, the electronic device 100 may control the output of content for viewing in the second mode based on at least one of the first control signal and the second control signal.

For example, in an embodiment, the electronic device 100 may control the direction of focus movement for selecting an object included in content for viewing based on the first control signal. In an embodiment, the electronic device 100 may select a new object by moving the cursor or focus in a direction according to the first control signal.

Additionally, in an embodiment, the electronic device 100 may perform a function corresponding to the second control signal that can be performed on the currently output viewing content screen based on the second control signal. Functions that can be performed on the currently output viewing content screen may vary depending on the content screen being output.

In an embodiment, as the control device 150 is equipped with the second direction key 155, the control device 150 changes the function of other buttons previously included in the remote control to the function of the second direction key 155. It can be replaced.

For example, in Figure 1, the multi-key 152 disposed on the left above the first direction key 151 is a button for providing various functions. The user can select the multi-key 152 to call the setting function of the electronic device 100. Additionally, each time the user presses the multi-key 152, a color button window and a virtual number pad window may be alternately displayed on the electronic device 100. When a color button window is output on the electronic device 100, the user can select a specific color button using the first direction key 151, and the electronic device 100 can execute a function corresponding to the selected color. The function corresponding to the selected color may mean an additional function for each function that is provided differently depending on the current content. In addition, when the virtual number pad window is displayed on the electronic device 100, the user can change channels, enter a PIN, enter a zip code, etc. by selecting and entering a desired number using the first direction key 151 in the window. You can.

Additionally, in FIG. 1, the multi-view button 153 disposed on the right above the first direction key 151 can be used to view the electronic device 100 in multi-view. When the multi-view button 153 is selected, the electronic device 100 can select content to be output in multi-view and output a multi-view screen including two or more selected screens as partial screens.

In an embodiment, the second direction key 155 may instead provide at least one of the functions of the multi-key 152 or the function of the multi-view button 153. In this case, the control device 100 according to the embodiment may not include at least one of the multi-key 152 or the multi-view button 153.

In an embodiment, based on the second control signal according to the input of the second direction key 152, the electronic device 100 performs the operation when the multi-key 152 or multi-view button 153 described above is selected. It can be done. For example, when the right direction of the second direction key 155 provided in the control device 150 is selected while outputting the second type of content, the electronic device 100 immediately displays a screen showing a setting function. Can be printed.

Alternatively, when the left direction of the second direction key 155 provided in the control device 150 is selected, the electronic device 100 may output a virtual number pad window on the screen.

Alternatively, when the upper button of the second direction key 155 provided in the control device 150 is selected, the electronic device 100 may output a multi-view screen.

As such, according to the embodiment, when the electronic device 100 receives a second control signal according to selection of the second direction key 155 while outputting content for viewing, various functions can be immediately executed at once. . In this case, an operation that was performed by manipulating the multi-key 152 several times, that is, by entering keys at several stages or at several depths, is performed immediately by selecting the second direction key 155 only once. It can provide user convenience.

In an embodiment, while outputting content for viewing, the electronic device 100 may output a guide UI appropriate for the content for viewing and guide the user in an operation according to direction key selection. In an embodiment, the electronic device 100 may output a second guide UI indicating what operation will be performed when the second direction key 155 is selected. The second guide UI may vary depending on the currently displayed viewing content.

For example, the electronic device 100 may output the second guide UI while the preview screen is displayed. At this time, when the second direction key 155 is selected, the second guide UI output plays content, fast forwards, fast backwards, pauses, etc. according to each of the four directions included in the second direction key 155. It can indicate that the operation can be performed.

For example, when the electronic device 100 outputs the basic screen, the electronic device 100 may output a second guide UI whose color matches the direction of the second direction key 155. The user can perform an operation corresponding to the blue color by selecting a direction, for example, the right button, that matches a specific color, for example, a blue color, among the second direction keys 155.

In an embodiment, if the content currently being output is a third type of content, the electronic device 100 may control content output in the third mode based on a control signal.

In embodiments, the third type of content may include video call content.

In an embodiment, if the content currently being output is a third type of content, the electronic device 100 selects one of a plurality of screens included in the video call content based on one of the first control signal and the second control signal. You can control the direction of focus movement for selection.

In an embodiment, the electronic device 100 may control at least one of the size, position, angle of view, and zoom function of one selected screen based on the remaining control signal among the first control signal and the second control signal.

In an embodiment, the electronic device 100 may output a guide UI suitable for the video call content while outputting the video call content. The guide UI suitable for video call content can guide the user to operations corresponding to the four directions of the second direction key 155, such as enlarging or reducing the screen, adjusting the screen position, or changing the angle of view.

As such, according to the embodiment, even when receiving a control signal from the same control device 150, the electronic device 100 may control content output in a different mode depending on the type of content currently being output.

Additionally, according to an embodiment, the electronic device 100 receives control signals corresponding to each direction key 151 and 155 from the control device 150 including two or more direction keys 151 and 155, Accordingly, the content can be controlled in various ways.

Additionally, according to an embodiment, the electronic device 100 may output a guide UI indicating the operation performed when the direction keys 151 and 155 are selected.

A user can conveniently control various types of content in different modes by manipulating a plurality of direction keys 151 and 155 included in one control device 150 while viewing the guide UI.

Figure 2 is an internal block diagram of the electronic device 100 and the control device 150 according to an embodiment.

Referring to FIG. 2 , the electronic device 100 and the control device 210 may be connected using a communication network 130.

Referring to FIG. 2, the electronic device 100 according to the embodiment includes an output unit 107, a communication unit 105, a memory 103 that stores one or more instructions, and a device that executes one or more instructions stored in the memory 103. It may include one or more processors 101.

The memory 103 according to an embodiment may store at least one instruction. The memory 103 may store at least one program that the processor 101 executes. Additionally, the memory 103 may store data input to or output from the electronic device 100.

The memory 103 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory, etc.), and RAM. (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk , and may include at least one type of storage medium among optical disks.

In an embodiment, one or more instructions for identifying the type of content output by the output unit 107 may be stored in the memory 103.

In an embodiment, one or more instructions for identifying a mode corresponding to the type of content currently being output may be stored in the memory 103.

In an embodiment, if the content currently being output is a first type of content, one or more instructions for identifying that the corresponding content output mode is the first mode may be stored in the memory 103.

In an embodiment, if the content currently being output is a second type of content, one or more instructions for identifying that the corresponding content output mode is the second mode may be stored in the memory 103.

In an embodiment, if the content currently being output is a third type of content, one or more instructions for identifying that the corresponding content output mode is the third mode may be stored in the memory 103.

In an embodiment, one or more instructions for controlling content output depending on the output mode may be stored in the memory 103.

In an embodiment, when the output mode is the first mode, one or more instructions for controlling content output in the first mode may be stored in the memory 103.

In an embodiment, one or more instructions for controlling content output in a first mode include instructions for controlling the movement direction of an avatar in the metaverse content based on one of the first control signal and the second control signal. may include.

In an embodiment, one or more instructions for controlling content output in the first mode may include one or more instructions for controlling the gaze direction of the avatar based on the remaining control signal of the first control signal and the second control signal. .

In an embodiment, when a sensing signal for movement of the control device is received from the control device 150, one or more instructions for controlling an avatar's gesture based on the sensing signal may be stored in the memory 103.

In an embodiment, if the output mode is the second mode, one or more instructions for controlling content output in the second mode may be stored in the memory 103.

In an embodiment, one or more instructions for controlling content output in the second mode include focus for selecting an object included in the viewing content based on one of the first control signal and the second control signal. It may contain one or more instructions to control the direction of movement.

In an embodiment, one or more instructions for controlling content output in the second mode may include one or more instructions for causing a corresponding function to be performed based on one of the first control signal and the second control signal. there is.

In an embodiment, if the output mode is the third mode, one or more instructions for controlling content output in the third mode may be stored in the memory 103.

In an embodiment, one or more instructions for controlling content output in a third mode include selecting one of a plurality of screens included in video call content based on a control signal of one of the first control signal and the second control signal. It may contain one or more instructions to control the direction of focus movement.

In an embodiment, one or more instructions for controlling content output in the third mode include adjusting at least one of the size, position, and angle of view of the selected screen based on the remaining control signal of the first control signal and the second control signal. It may contain one or more instructions for

In an embodiment, the memory 103 includes, depending on the content type, a first guide UI that displays an operation performed based on selection of a first direction key and a second guide that displays an operation performed based on selection of a second direction key. One or more instructions for outputting at least one of the UI may be stored.

In an embodiment, one or more instructions for outputting a guide UI may be stored in the memory 103.

In an embodiment, one or more instructions for when to output the guide UI may be stored in the memory 103.

The communication unit 105 according to an embodiment may perform communication with at least one external electronic device through a wired or wireless communication network.

The communication unit 105 may connect the electronic device 100 to the control device 150 or other peripheral devices, external devices, servers, mobile terminals, etc. through control of the processor 101.

The communication unit 105 may include at least one communication module capable of performing wireless communication. The communication unit 105 may include at least one of a wireless LAN module, a Bluetooth module, and a wired Ethernet depending on the performance and structure of the electronic device 100.

The communication unit 105 may include at least one short-range communication module that performs communication according to communication standards such as Bluetooth, Wi-Fi, BLE (Bluetooth Low Energy), NFC/RFID, Wifi Direct, UWB, or ZIGBEE. You can.

Additionally, the communication unit 105 may further include a long-distance communication module that communicates with a server to support long-distance communication according to long-distance communication standards. Specifically, the communication unit 105 may include a long-distance communication module that performs communication through a network for Internet communication. For example, the communication unit 105 may include a long-distance communication module that performs communication through a communication network that complies with communication standards such as 3G, 4G, and/or 5G.

In an embodiment, the communication unit 105 may communicate with the control device 150 using infrared, RF communication, Wi-Fi communication, or BLE communication. The communication unit 105 may receive a control signal from the control device 150 through communication with the control device 150.

The processor 101 according to the embodiment controls the overall operation of the electronic device 100. The processor 101 may control the electronic device 100 to function by executing one or more instructions stored in the memory 103. In an embodiment, the electronic device 100 may include one or more processors 101.

In an embodiment, one or more processors 101 may receive a control signal from the control device 150 through the communication unit 105 by executing one or more instructions.

In an embodiment, one or more processors 101 may control content output in a first mode based on a control signal if the content output to the output unit 107 is a first type of content by executing one or more instructions. there is.

In an embodiment, one or more processors 101 may control content output in a second mode based on a control signal if the content output to the output unit 107 is a second type of content by executing one or more instructions. there is.

In an embodiment, the first type of content may be metaverse content, and the second type of content may be viewing content.

In an embodiment, one or more processors 101 may output a guide UI through the output unit 107 by executing one or more instructions.

In an embodiment, the guide UI includes at least one of a first guide UI that displays an operation performed based on selection of a first direction key and a second guide UI that displays an operation performed based on selection of a second direction key. can do.

In an embodiment, one or more processors 101 may output a guide UI at preset time intervals or whenever an event occurs. For example, the processor 101 may newly output a guide UI suitable for the content type whenever an event that changes the type of content occurs. Additionally, the processor 101 may newly output a guide UI to guide new functions whenever an event that changes a function controlled based on a control signal occurs.

In an embodiment, the one or more processors 101 execute one or more instructions, so that if the content to be output is a first type of content, that is, metaverse content, the first control signal from the control device 150 and the second The movement direction of the avatar within the metaverse content can be controlled based on one of the control signals. In an embodiment, one or more processors 101 may control the gaze direction of the avatar based on the remaining control signals among the first control signal and the second control signal.

In an embodiment, one or more processors 101 may receive a sensing signal for movement of the control device 150 from the control device 150 through the communication unit 105 by executing one or more instructions. In an embodiment, one or more processors 101 may control an avatar's gestures based on a sensing signal.

In an embodiment, the one or more processors 101 execute one or more instructions, so that if the content to be output is a second type of content, that is, if it is content for viewing, the object included in the content for viewing is based on the first control signal. You can control the direction of movement of the cursor or focus for selection. In an embodiment, the one or more processors 101 may perform a function corresponding to the second control signal that can be performed on the currently output viewing content screen based on the second control signal. The function corresponding to the second control signal may be provided differently depending on the screen and executable functions. That is, the function corresponding to the second control signal may be modified in various ways depending on the content displayed on the current screen.

In an embodiment, the one or more processors 101 execute one or more instructions to output, through the output unit 107, a second guide UI displaying an operation performed based on the selection of the second direction key, and perform the second control. Upon receiving the signal, the function corresponding to the second control signal can be immediately performed without receiving an additional control signal. Here, the function corresponding to the second control signal may be an operation guided by the second guide UI.

In an embodiment, one or more processors 101 may control content output in a third mode based on a control signal if the content output to the output unit 107 is a third type of content by executing one or more instructions. there is. In an embodiment, the third content type may be video call content. In an embodiment, the one or more processors 101 execute one or more instructions to select a focus among a plurality of screens included in the video call content based on one of the first control signal and the second control signal. You can control the direction of movement. In an embodiment, the one or more processors 101 may adjust at least one of the size, position, angle of view, and zoom function of one selected screen based on the remaining control signal among the first control signal and the second control signal.

The control device 150 according to the embodiment may include a processor 151, a memory 153, a communication unit 155, and an input unit 157.

In an embodiment, the control device 150 may be implemented as various types of devices used to control the electronic device 100. The control device 150 may be implemented as a terminal capable of receiving various types of user input, such as touch, press, touch gesture, voice, or motion. For example, the control device 150 is a portable computer such as a laptop, netbook, or tablet PC, a portable terminal such as a smart phone or PDA, a remote control, a keyboard, a mouse, a joy pad, or a terminal in which two or more of these devices are integrated. It may include, but is not limited to, etc.

The memory 153 according to the embodiment may store at least one instruction. The memory 153 may store at least one program that the processor 151 executes. Predefined operation rules or programs may be stored in the memory 153. Additionally, the memory 153 may store data input to or output from the control device 150.

In an embodiment, memory 153 may store key code instructions. The key code command may include a key scan code value defined by matching the data and command input from the input unit 157. The memory 153 may include key code commands corresponding to each of a plurality of keys included in the input unit 157.

The memory 153 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory, etc.), and RAM. (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk , and may include at least one type of storage medium among optical disks.

The input unit 157 according to the embodiment may receive a user input for controlling the control device 150. The input unit 157 may be implemented in various forms. For example, the input unit 157 may include a key pad. The keypad may include buttons, a touchpad, etc. The touch pad can be implemented in various forms, such as a contact capacitive type, a pressure-type resistive type, an infrared detection type, a surface ultrasonic conduction type, an integral tension measurement type, a piezo effect type, etc. The input unit 157 may include a keyboard, dome switch, jog wheel, jog switch, etc. The input unit 157 may further include a microphone capable of receiving the user's voice.

In an embodiment, the input unit 157 may include a plurality of direction keys. In an embodiment, the input unit 157 may include a first direction key 151 and a second direction key 155. In an embodiment, the first direction key 151 is disposed on the front side 150-1 of the control device 150, and the second direction key 155 is disposed on the front and back sides 150-2 of the control device 150. , may be placed in at least one of the rear and side positions.

In an embodiment, the first direction key 151 and the second direction key 155 may be arranged within a range that the user can simultaneously operate with one hand. For example, when the first direction key 151 is placed on the front side 150-1 of the control device 150 and the second direction key 155 is placed on the back side 150-2 of the control device 150. , the first direction key 151 may be operated by the user's thumb, and the second direction key 155 may be placed in a position that can be operated by the user's index or middle finger.

In an embodiment, the input unit 157 may further include a third direction key. For example, both the first direction key 151 and the second direction key 155 are disposed on the front side 150-1 of the control device 150, and the third direction key is disposed on the back side 150-1 of the control device 150. 2) can be placed. In this case, when using metaverse content, the user turns the control device 150 horizontally and controls the avatar's movement direction and gaze direction using the first direction key 151 and the second direction key 155. When using content for viewing, the control device 150 can be turned vertically and the first direction key 151 and the third direction key located on the back can be operated with one hand.

In an embodiment, the input unit 157 may further include a sensor capable of recognizing the motion of the control device 150. In an embodiment, when the input unit 157 includes a sensor capable of motion recognition, the input unit 157 may detect the direction of the control device 150 using this sensor. The control device 150 may transmit a sensing signal indicating the direction of the control device 150 to the electronic device 100.

The processor 151 according to the embodiment controls the overall operation of the control device 150. The processor 151 may control the control device 150 to function by executing one or more instructions stored in the memory 153.

In an embodiment, the processor 151 may be, for example, a Micro Controller Unit (MCU).

In an embodiment, when the processor 151 receives a key input from the user through the input unit 157, the processor 151 may generate a control signal including a key code command corresponding to the input key.

The communication unit 155 according to an embodiment may include at least one communication module. The communication unit 155 may connect the control device 150 to the electronic device 100 under control of the processor 151 using a wired or wireless communication network.

The communication unit 155 may transmit a signal corresponding to a user input through the input unit 157 to the electronic device 100. The signal corresponding to the user input may be a control signal including a key code command corresponding to the key selected by the user. The control signal corresponding to the user input may be implemented as a Bluetooth type, IR signal type, RF signal type, Wi-Fi type, etc., depending on the type of communication module included in the communication unit 155.

In an embodiment, the communication network 130 includes Bluetooth (bluetooth), BLE (bluetooth low energy (not shown), NFC (near field communication (not shown)), IR (Infrared) communication, RF (Radio Frequency) communication, and Wi-Fi (Wi-Fi). -Fi) communication, may include one or more networks among wired Ethernet.

In an embodiment, when the electronic device 100 and the control device 150 transmit and receive signals by performing IR communication, the control device 150 may generate a control signal including a key code command as an IR signal. For example, the control device 150 may generate an infrared signal having a unique frequency assigned to the key code command of the input key. The control device 150 may transmit an infrared signal to the electronic device 100 using the communication network 130.

In an embodiment, when the electronic device 100 and the control device 150 transmit and receive signals by performing BLE communication, the control device 150 receives a key input from the user and sends a key code command corresponding to the input key. The included control signal can also be generated as a BLE signal. The control device 150 may transmit a BLE signal to the electronic device 100 through the communication network 130.

However, this is one embodiment, and the communication network 130 may be a communication network based on the Wi-Fi communication method.

FIG. 3 is an internal block diagram of the processor 101 of the electronic device 100 according to an embodiment.

Referring to FIG. 3, the processor 101 may include a content type identification unit 310 and a content output control unit 330.

In an embodiment, the content type identification unit 310 may identify the type of content currently being output.

For example, when the electronic device 100 receives and outputs content through an external device, such as a set-top box or an external game console, it is difficult for the electronic device 100 to identify the type of content acquired through the external device. .

In an embodiment, the content type identification unit 310 may obtain metadata for content received through an external device and identify the content type using the metadata. Alternatively, in an embodiment, the content type identification unit 310 may capture the received content screen and identify the text or logo displayed on the content screen to identify the type of content currently being output.

In an embodiment, when the electronic device 100 is a smart TV, the electronic device 100 executes an app using the operating system and Internet function installed inside the electronic device 100, thereby identifying the type of app currently running. can do. For example, when the electronic device 100 currently outputs VOD content provided by an OTT service provider called Netflix, the content type identification unit 310 determines that the currently running app is the Netflix app and that the Netflix app provides VOD content. By identifying the app provided, it is possible to identify that the content currently being output is content for viewing.

Similarly, when the electronic device 100 is currently running a metaverse content app, the content type identification unit 310 identifies the currently running app as an app for metaverse content, thereby determining that the currently output content is metaverse content can be identified.

In an embodiment, the content type identification unit 310 may transmit the type of content currently being output to the content output control unit 320.

In an embodiment, the content output control unit 320 may receive a content type from the content type identification unit 310 and identify an output mode corresponding to the content type.

In an embodiment, the content output control unit 320 may identify the first mode as the output mode if the content currently being output is content of the first type. In an embodiment, the content output control unit 320 may control content output in the first mode when receiving a control signal from the control device 150.

In an embodiment, the content output control unit 320 may identify the second mode as the output mode if the content currently being output is content of the second type. In an embodiment, the content output controller 320 may control content output in the second mode when receiving a control signal from the control device 150.

In an embodiment, the content output control unit 320 may identify the third mode as the output mode if the content currently being output is a third type of content. In an embodiment, the content output control unit 320 may control content output in the third mode when receiving a control signal from the control device 150.

FIG. 4 is a diagram illustrating how the electronic device 100 controls content output in a first mode based on a control signal from the control device 150, according to an embodiment.

Referring to FIG. 4, the electronic device 100 may output metaverse content 410. Metaverse content 410 may be content representing a virtual world based on the Metaverse platform. Metaverse content 410 may include an avatar 411.

In an embodiment, the electronic device 100 may identify that the content currently being output is metaverse content. For example, the electronic device 100 may identify that the currently running app is a metaverse content app, and accordingly, identify that the type of content currently being output is metaverse content.

In an embodiment, the electronic device 100 may output a guide UI 420 suitable for metaverse content, corresponding to the fact that the content currently being output is metaverse content. The guide UI 420 may be an interface screen for guiding the user in manipulating the direction keys 151 and 155 provided in the control device 150.

In an embodiment, the electronic device 100 may output the guide UI 420 together with the metaverse content 410. For example, as shown in FIG. 4 , the electronic device 100 may display the guide UI 420 by overlaying it on a partial area of the metaverse content 410 . The size, output position, transparency, and/or shape of the guide UI 420 may be modified in various ways.

In an embodiment, the guide UI 420 includes a first guide UI 420-1 that displays an operation performed based on selection of the first direction key 151 and an operation performed based on selection of the second direction key 155. It may include at least one of the second guide UIs 420-2 that display the operation being performed.

In an embodiment, the first guide UI 420-1 and the second guide UI 420-2 may include information for indicating which direction key the corresponding UI is. For example, as shown in FIG. 4, the first guide UI 420-1 includes a large circle imitating the shape of the first direction key 153, and is located at the position where the first direction key 153 is placed. May contain the word 'front'. On the other hand, the second guide UI 420-2 includes a small circle imitating the shape of the second direction key 155, and may include the word 'back', which is the position where the second direction key 155 is placed. You can.

The user uses the large circle included in the first guide UI (420-1) and the word 'front' to guide the user to the function of the first direction key (151). can be identified. Additionally, the user identifies the second guide UI (420-2) as a guide UI for the second direction key (155) using the small circle and the word 'back' included in the second guide UI (420-2). can do.

In an embodiment, the first guide UI 420-1 and the second guide UI 420-2 may include information indicating an operation when a specific direction key is selected. For example, as shown in FIG. 4, the first guide UI 420-1 may include the word 'movement', and the second guide UI 420-2 may include the word 'gaze manipulation'. .

In an embodiment, the user can predict the operation performed when manipulating the first and second direction keys 151 and 155 provided in the control device 150 by using the guide UI 420. The user can use the word 'move' included in the first guide UI 420-1 to identify that the first direction key 151 is used to move the avatar. Additionally, the user can use the word 'gaze manipulation' included in the second guide UI 420-2 to identify that the second direction key 155 is used to control the avatar's gaze.

The user can easily operate the plurality of direction keys 151 and 155 provided on the control device 150 with one hand while viewing the metaverse content 410 and the guide UI 420 output by the electronic device 100. You can. For example, the user operates the first direction key 151 disposed on the front 150-1 of the control device 150 with the thumb, and at the same time, uses the index or middle finger to control the back 151 of the control device 150. The second direction key 155 placed at -2) can be operated simultaneously.

The control device 150 corresponds to the selected direction key among the first direction key 151 and the second direction key 155 in response to at least one of the first direction key 151 and the second direction key 155 being selected. A control signal containing a key code command can be generated.

In an embodiment, the control device 150 may generate a first control signal including a key code command corresponding to the first direction key 151. In an embodiment, the control device 150 may generate a first control signal including a key code command indicating one of four directions selected from the first direction key 151.

In an embodiment, the control device 150 may generate a second control signal including a key code command corresponding to the second direction key 151. In an embodiment, the control device 150 may generate a control signal including a key code command indicating one of four directions selected from the second direction key 155.

The control device 150 may transmit at least one of the first control signal and the second control signal to the electronic device 100 through the communication network 130.

In an embodiment, the electronic device 100 may receive a first control signal including a key code command corresponding to the first direction key 151 from the control device 150. In an embodiment, the electronic device 100 may control content output in the first mode based on the first control signal. For example, the electronic device 100 may control the movement direction of the avatar 411 based on the first control signal. The electronic device 100 moves the avatar 411 in one direction of right, left, up, and down in response to the user selecting one of right, left, up, and down directions of the first direction key 151. You can control it to move.

In an embodiment, the electronic device 100 may receive a second control signal including a key code command corresponding to the second direction key 155 from the control device 150. In an embodiment, the electronic device 100 may control content output in the first mode based on the second control signal. For example, the electronic device 100 may control the gaze direction of the avatar 411 based on the second control signal. The electronic device 100 changes the gaze of the avatar 411 to one of right, left, top, and bottom in response to the user selecting one of right, left, top, and bottom directions using the second direction key 151. You can control the direction it faces. In response to a change in the gaze of the avatar 411, the electronic device 100 may output metaverse content representing the virtual world located in the direction in which the gaze of the avatar 411 is directed.

In an embodiment, the user uses the first direction key 151 disposed on the front side 150-1 of the control device 150 and the second direction key 155 disposed on the rear side 150-2 of the control device 150. ) are operated simultaneously, the electronic device 100 can simultaneously change the movement direction and gaze direction of the avatar 411 correspondingly.

In this way, according to the embodiment, the user can enjoy the metaverse content 410 by controlling the movement direction and gaze direction of the avatar 411 using different direction keys provided in the control device 150.

FIG. 5 is a diagram illustrating how the electronic device 100 controls content output in a first mode based on a control signal from the control device 150, according to an embodiment.

In an embodiment, the control device 150 may further include a sensor 160 capable of motion recognition. In an embodiment, sensor 160 may include at least one of a geomagnetic sensor and/or a gyroscope sensor. In an embodiment, the sensor 160 may be placed on top of the control device 150, but is not limited thereto.

In an embodiment, the sensor 160 provided in the control device 150 may detect the direction of the control device 150.

When the sensor 160 is a geomagnetic sensor, the geomagnetic sensor can detect the direction of geomagnetism with respect to the control device 150. When the sensor 160 is a gyroscope sensor, the gyroscope sensor can detect the angular velocity, which is the rotation speed of the control device 150. Gyroscope sensors can also be called angular velocity sensors. The gyroscope sensor can calculate the direction of the control device 150 by converting the Coriolis Force generated when the control device 150 rotates into an electrical signal.

The control device 150 may check the location of the device relative to the magnetic north pole by using at least one of a geomagnetic sensor and a gyroscope sensor.

Additionally, the control device 150 may detect the relative direction with the electronic device 100 using the sensor 160. For example, if the user suddenly moves the control device 150 upward or downward, or to the left or right within a reference time based on the direction toward the electronic device 100, the geomagnetic sensor and/or gyroscope sensor may detect the control device 150. ) can be detected that the direction has suddenly changed within a reference time.

In an embodiment, the control device 150 may transmit a sensing signal obtained through the sensor 160 to the electronic device 100.

In an embodiment, when the electronic device 100 receives a sensing signal from the control device 150, the electronic device 100 may control the operation of the avatar 411 based on the sensing signal. The operation performed based on the sensing signal obtained through the sensor 160 provided in the control device 150 may vary depending on the type of metaverse content app, the content or situation of the metaverse content, etc.

For example, the electronic device 100 may control the avatar 411 to express an opinion according to a sensing signal. For example, when the user moves the control device 150 up and down, the electronic device 100 may control the head of the avatar 411 to nod back and forth based on the sensing signal received from the control device 150. . This can be matched with the avatar 411 expressing positive intention in a specific action or situation.

Additionally, when the user moves the control device 150 left and right, the electronic device 100 can control the avatar 411 to shake its head left and right based on the sensing signal received from the control device 150. In this case, the avatar 411 may be matched by expressing a negative intention in a specific action or situation. Figure 5 shows, as an example, when the user moves the control device 150 left and right, the avatar 411 shakes its head left and right.

In another example, if the metaverse content is content about war and the avatar is a warrior fighting on the battlefield, when the user moves the control device 150 up and down, the electronic device 100 Based on the received sensing signal, the warrior can be controlled to strike the sword up and down. Additionally, when the user moves the control device 150 left and right, the electronic device 100 can control the warrior to swing the sword left and right based on the sensing signal received from the control device 150.

As such, according to the embodiment, the control device 150 may identify the direction of the control device 150 using the sensor 160 and transmit this to the electronic device 100.

Additionally, according to an embodiment, the electronic device 100 may control the operation of the avatar 411 in various forms based on the sensing signal received from the control device 150.

FIG. 6 is a diagram illustrating how the electronic device 100 controls content output in a second mode based on a control signal from the control device 150, according to an embodiment.

Referring to FIG. 6 , the electronic device 100 may output content 610 for viewing.

In an embodiment, the electronic device 100 may identify that the content currently being output is content for viewing. In an embodiment, the electronic device 100 may output a guide UI suitable for the viewing content, corresponding to the fact that the currently output content is viewing content.

FIG. 6 illustrates, as an example, the electronic device 100 outputs preview content among content 610 for viewing.

Typically, the user knows that when the first direction key 151 is operated, an object included in content is selected. Accordingly, in the embodiment, when the electronic device 100 outputs content for viewing, the electronic device 100 does not output the first guide UI for guiding the operation according to the operation of the first direction key 151. , only the second guide UI 620 for guiding the operation according to the manipulation of the second direction key 155 can be output. However, this is one embodiment, and the electronic device 100 may output a first guide UI for guiding the operation according to the operation of the first direction key 151 along with the second guide UI 620.

In an embodiment, the electronic device 100 may output the second guide UI 620 together with the viewing content 610. For example, as shown in FIG. 6 , the electronic device 100 may display the second guide UI 620 on a portion of the content 610 for viewing. The size, output position, transparency, and/or shape of the second guide UI 620 may be modified in various ways.

In an embodiment, the second guide UI 620 indicates the location of the control device 150 where the second direction key 155 is placed, or has various forms indicating that the corresponding UI is for the second direction key 155. May contain information. For example, as shown in FIG. 6, the second guide UI 620 may include a small circle imitating the shape of the second direction key 155. However, it is not limited to this, and the second guide UI 620 includes the word 'back' to indicate that the second direction key 155 is located on the back of the control device 150, or It may also include various shapes representing the back of the device 150.

The user can use the information included in the second guide UI 620 to identify that the second guide UI 620 is for the second direction key 155. For example, in FIG. 6, the user sees a small circle imitating the shape of the second direction key 155 included in the second guide UI 620, and the second guide UI 620 is connected to the second direction key 155. It can be identified as a guide UI.

In an embodiment, the second guide UI 620 may include information indicating an operation when a specific direction key is selected. For example, as shown in FIG. 6, the second guide UI 620 may include symbols representing pause, play, fast forward, and fast backward, respectively, at four directions centered on a small circle.

In an embodiment, the user can use symbols included in the second guide UI 620 to identify that the second direction key 155 is used to select pause or play, fast forward or fast backward. there is.

The user views the viewing content 610 output by the electronic device 100 and the second guide UI 620 together, and operates the second direction key 155 to perform the function displayed on the second guide UI 620. You can make it run.

Additionally, the user may operate the first direction key 151 to select an object included in the content.

The control device 150 may generate a control signal corresponding to selection of at least one of the first direction key 151 and the second direction key 155. The control device 150 may generate a first control signal including a key code command corresponding to the direction selected by the first direction key 151. Additionally, the control device 150 may generate a second control signal including a key code command corresponding to the direction selected by the second direction key 155. The control device 150 may transmit at least one of a first control signal and a second control signal to the electronic device 100.

In an embodiment, the electronic device 100 displays the viewing content 610 in the second mode based on receiving at least one of the first control signal and the second control signal while outputting the viewing content 610. Output can be controlled.

In an embodiment, the electronic device 100 controls the output of the viewing content 610 in the second mode when the first control signal is received, based on the first control signal. It may include an operation of selecting one of a plurality of objects included in the content 610. In addition, in an embodiment, the electronic device 100 controls the output of the viewing content 610 in the second mode when receiving the second control signal, based on the second control signal, using the second guide UI. The operation guided by (620) can be performed.

In an embodiment, the electronic device 100 that receives the second control signal for the second direction key 155 from the control device 150 may immediately perform the operation guided by the second guide UI 620. For example, when preview content is output on the electronic device 100 as shown in FIG. 6, when a user wants to watch content introduced in the preview content from the middle, the user usually uses the control device provided in the control device 150. Select the play button 157 to enter the content displayed by the preview content, and then select the play button 157 or any other forward button to have the electronic device 100 play the content from the middle point. You can do it.

However, according to this embodiment, the user can control the content to move forward immediately by selecting only the right button of the second direction key 155, as instructed in the second guide UI 620. That is, according to the embodiment, the electronic device 100 immediately executes a specific operation by simply pressing the second direction key 155 once, rather than pressing the button provided on the control device 150 multiple times. You can control it to do so.

In this way, according to the embodiment, the user can conveniently control viewing content using the second direction key 155 provided in the control device 150.

FIG. 7 is a diagram illustrating how the electronic device 100 controls content output in a second mode based on a control signal from the control device 150, according to an embodiment.

Referring to FIG. 7 , the electronic device 100 may output content 710 for viewing.

In an embodiment, the electronic device 100 may identify that the content currently being output is content 710 for viewing. In an embodiment, the electronic device 100 may output a guide UI 720 suitable for the viewing content 710, corresponding to the fact that the content currently being output is the viewing content 710.

FIG. 7 illustrates, as an example, the electronic device 100 outputs a basic screen as content 710 for viewing. In an embodiment, the basic screen may be a home screen that is first displayed when the electronic device 100 is turned on. The basic screen may vary depending on the manufacturer of the electronic device 100, whether the electronic device 100 is a smart TV, or the type of set-top box connected to the electronic device 100. The basic screen may be one of the content 710 for viewing.

FIG. 7 shows an example of a basic screen that is displayed for the first time when the electronic device 100 is a smart TV and the electronic device 100 is turned on.

Referring to FIG. 7, the basic screen may include an app tile 711. In an embodiment, the app tile 711 represents an executable app in the form of a tile, and includes various apps, such as apps provided by OTT service providers or IPTV service providers, shopping apps, music apps, and metaverse content apps. It may include at least one of: The user can select a desired app from among the app tiles 711 and run the app.

Additionally, the basic screen may include various VOD contents 713 in the form of thumbnails. VOD content 713 may be one of the viewing content 710. The basic screen may include at least one of currently viewable content, popular content, content that the user has viewed in the past, and recommended content recommended by the electronic device 100 in the form of a thumbnail, content title, etc. .

In an embodiment, the viewing content 710 may include various objects. For example, the app tile 711 or the VOD content 713 included in the basic screen may all be objects that can be selected using the control device 150. The user can adjust the position of the cursor using the first direction key 151 provided in the control device 150. A cursor may be a marker indicating an input location on the screen. The user can use the first direction key 151 to select a desired app or VOD content from among a plurality of objects included in the viewing content 710.

In an embodiment, the electronic device 100 may control content output in the second mode based on receiving a first control signal from the control device 150 while outputting content 710 for viewing.

In an embodiment, the electronic device 100 may select one of a plurality of objects included in the viewing content 710 currently displayed on the screen by changing the position of the cursor based on the first control signal.

In an embodiment, the user may use the second direction key 155 to immediately execute a specific action. The operation or function corresponding to each of the four directions of the second direction key 155 may vary depending on the type of app and may also vary depending on the content of the viewing content 710 currently displayed on the screen.

In an embodiment, while outputting content for viewing 710, the electronic device 100 may output a second guide UI 720 to guide operations according to manipulation of the second direction key 155. The user can view the second guide UI 720 displayed on the screen and identify what function will be executed when the second direction key 155 is selected.

In an embodiment, the electronic device 100 may output the second guide UI 720 together with the viewing content 710. As shown in FIG. 7 , the electronic device 100 may display the second guide UI 720 by overlaying it on one area on the viewing content 710 . The size, output position, transparency, and/or shape of the second guide UI 720 may be modified in various ways.

In an embodiment, the second guide UI 720 includes information indicating the shape of the second direction key 155 or the position where the second direction key 155 is placed, so that the second direction key 155 It can indicate that it is about.

In an embodiment, the second guide UI 720 may include information indicating an action or function performed when each of the four directions of the second direction key 155 provided in the control device 150 is selected. For example, the second guide UI 720 may be expressed in color. As shown in FIG. 7, the second guide UI 720 has a blue circle 722 and a yellow circle 723 at four directional positions, respectively, centered on a shape 721 that mimics the second direction key 155. , a green circle 724, and a red circle 725.

In an embodiment, the second guide UI 720 may further include actions or functions corresponding to each of the four directions along with specific colors at positions in the four directions. For example, as shown in FIG. 7, the second guide UI 720 has colors at four direction positions and directions corresponding to each direction, such as 'watch previous content', 'search', 'menu', and 'recording'. It may contain information indicating function. This may mean that the function corresponding to the blue circle 722 is a function to reload the content that was previously viewed, and the function corresponding to the yellow circle 723 is a search window function. Additionally, the function corresponding to the green circle 724 may mean a menu item selection function, and the function corresponding to the red circle 725 may mean a recording function. However, this is one embodiment, and the functions or operations corresponding to the colors located in the four directions vary depending on the type of viewing content 710 currently displayed on the screen, functions supported by the electronic device 100, etc. It can be.

In an embodiment, the user selects one of the four directions included in the second direction key 155 using the color for each direction included in the second guide UI 720 and/or information representing the operation corresponding to the color. By doing so, the function corresponding to the selected color can be executed.

In an embodiment, the control device 150 may generate a control signal including a key code command corresponding to a direction selected by the user among the four directions included in the second direction key 155. The control device 150 may transmit the generated control signal to the electronic device 100.

In an embodiment, the electronic device 100 may receive a second control signal corresponding to the second direction key 155 from the control device 150. In an embodiment, the electronic device 100 may control content output in the second mode based on receiving a second control signal while outputting content 710 for viewing.

For example, when the user selects the right direction among the four directions included in the second direction key 155 and the blue circle 722 is selected among the four colors included in the second guide UI 720, the electronic device 100 The content that was previously output by the electronic device 100 can be reloaded and immediately displayed on the screen.

In general, when the basic screen is displayed on the electronic device 100 as shown in FIG. 7, to re-watch the content that was previously viewed, the user uses the first direction key 151 to select the content that was being viewed on the basic screen. You must find and select the object, and select the play button 157 provided on the control device 150 again to play the selected object. However, according to the present disclosure, the user can immediately watch the content that was previously viewed by selecting the right direction among the four directions included in the second direction key 155 while the basic screen is displayed. That is, the user can immediately execute the desired function by simply operating the second direction key 155 once, without having to manipulate the control device 150 multiple times.

FIG. 8 is a diagram for explaining that the electronic device 100 controls content output in a third mode based on a control signal from the control device 150, according to an embodiment.

In an embodiment, the electronic device 100 may perform a video call function. In order to perform a video call function, the electronic device 100 may be equipped with a camera 801.

In an embodiment, the camera 801 may be integrally included in the electronic device 100 or may be a separate device from the electronic device 100 and connected to the electronic device 100. The camera 801 may be placed in one area of the electronic device 100. For example, as shown in FIG. 8, the camera 810 may be placed on top of the electronic device 100 to photograph the user and obtain a real-time image of the user.

In an embodiment, when the user controls the electronic device 100 to run a video call app, the electronic device 100 may output video call content 810 according to the execution of the video call app on the screen.

In an embodiment, the electronic device 100 may communicate with the other terminal in response to the video call app being executed. The electronic device 100 can transmit a video captured by the camera 810 to the other terminal in real time and also receive the video from the other terminal in real time.

In an embodiment, the electronic device 100 may output the user's screen acquired with the camera 810 and the other party's screen received from the other party's terminal in a multi-view through a partial screen. The number of partial screens may be one or multiple depending on the number of counterpart terminals. For example, as shown in FIG. 8, the video call content 810 includes a user screen 811 acquired by the camera 810, a first party screen 813 showing the first party, and a second party screen 813 showing the second party. It may include the other party's screen 815. The user screen 811, the first counterpart screen 813, and the second counterpart screen 815 may each be one object.

In an embodiment, the user may control the video call content 810 using the control device 150. In an embodiment, the electronic device 100 may control content output in the third mode based on receiving a signal from the control device 150 while outputting video call content 810.

In an embodiment, controlling content output in the third mode includes selecting one screen among the multi-views included in the video call content 810 based on the first control signal according to selection of the first direction key 151. It may include controlling the direction of focus movement. In an embodiment, the user adjusts the position of the cursor or focus using the first direction key 151 provided in the control device 150 to control a plurality of objects included in the video call content 810, that is, a plurality of screens. You can select the screen you want. For example, when the user operates the first direction key 151 and selects the second counterpart's screen 815 among a plurality of screens, the electronic device 100 displays the second counterpart's screen 815, as shown in FIG. 8. By displaying the border in a thick color, it can be indicated that the second counterpart's screen 815 is focused.

In an embodiment, controlling content output in the third mode includes adjusting at least one of the size, position, angle of view, and zoom function of one selected screen based on a second control signal according to selection of the second direction key 155. It may include:

In an embodiment, the electronic device 100 may generate and output a guide UI 820 suitable for the video call content 810, corresponding to the fact that the content currently being output is the video call content 810.

In an embodiment, the electronic device 100 may output the second guide UI 820 along with the video call content 810. For example, as shown in FIG. 8, the electronic device 100 may display the second guide UI 820 on a partial area of the screen. The size, output position, transparency, and/or shape of the second guide UI 620 may be modified in various ways.

In an embodiment, the second guide UI 820 may include information indicating that the second guide UI 820 is for controlling the second direction key 155. For example, as shown in FIG. 8, the second guide UI 820 may include a small circle imitating the shape of the second direction key 155.

In an embodiment, the second guide UI 820 may include information indicating an operation when a specific direction key is selected. For example, as shown in FIG. 8, the second guide UI 820 has arrows indicating four directions centered on a small circle, and 'size', 'position', 'angle of view', and 'zoom' around each direction. It may contain the word '. However, this is just one embodiment, and the functions or operations corresponding to the four directions may vary depending on the situation.

In an embodiment, the user can use symbols or characters included in the second guide UI 820 to identify that the second direction key 155 is used to adjust the screen size, position, angle of view, and zoom. .

The user views the video call content 810 and the second guide UI 820 output by the electronic device 100 together, and uses the second direction key 155 to execute the function displayed on the second guide UI 820. can be manipulated.

In an embodiment, the electronic device 100 may adjust the position of the selected screen based on one of the four directions included in the second direction key 155 being selected. For example, when the user selects the left button of the second direction key 155, the electronic device 100 may change the location of the screen selected with the first direction key 151 to another location. When the user selects the left button of the second direction key 155 once, the electronic device 100 adjusts the position of the selected screen, that is, the second opponent's screen 815 in the above example, to the left to The positions of the first counterpart screen 813 and the second counterpart screen 815 can be changed. When the user selects the left button of the second direction key 155 again, the electronic device 100 can change the positions of the second counterpart's screen 815 and the user's screen 811. However, this is an example, and the electronic device 100 may change the location of the selected screen in various ways.

In an embodiment, the electronic device 100 may adjust the size of the selected screen based on one of the four directions included in the second direction key 155 being selected. For example, based on the user selecting the upper button of the second direction key 155, the electronic device 100 may gradually enlarge the size of the second counterpart's screen 815. At this time, the electronic device 100 may display that the size of the selected screen is increasing by outputting UIs 830-1, 830-2, 830-3, and 830-4 such as arrows shown in FIG. 8. there is. Even when the size of the selected screen has increased to a certain size, if the user continues to select the up button of the second direction key 155, the electronic device 100 may gradually reduce the size of the selected screen. The electronic device 100 may output a UI indicating that the size of the selected screen is decreasing, for example, an arrow pointing inward around the selected screen.

In an embodiment, when one of the four directions included in the second direction key 155 is selected while the user screen 811 is selected, the electronic device 100 changes the position or size of the user screen 811. In addition to performing the adjustment function, it can also perform the zoom function or wide-angle function. For example, in the embodiment, the user may select the down button among the four directions included in the second direction key 155 while the user screen 811 is selected. In this case, the electronic device 100 can adjust the shooting area for the user by zooming in or out by adjusting the focal length of the lens included in the camera 801.

Alternatively, in an embodiment, when the user selects the right button of the second direction key 155 while the user screen 811 is selected, the electronic device 100 may adjust the viewing angle of the user screen 811. That is, the electronic device 100 can adjust the lens position of the camera 801 to adjust the range that can be captured with the lens, so that an area to the left or right of the current screen is visible on the user screen 811.

In this way, according to the embodiment, the user operates the second direction key 155 as instructed in the second guide UI 820 to adjust the size, position, angle of view, zoom, etc. of the screen in the video call content 810. It can be adjusted conveniently.

FIG. 9 illustrates a case where the control device 150 includes three or more direction keys, according to an embodiment.

Referring to FIG. 9 , the control device 150 may further include a third direction key 157 in addition to the first direction key 151 and the second direction key 155.

In an embodiment, the third direction key 157 may be disposed on the front 150-1 of the control device 150 like the first direction key 151. In an embodiment, the first direction key 151 and the third direction key 157 are arranged to be spaced apart from each other by a predetermined distance or more, so that when the user lays the control device 150 horizontally and uses it, the first direction key 151 and the third direction key 157 are used with the thumbs of both hands of the user. It can be placed in a convenient location for operation.

In an embodiment, the electronic device 100 may output metaverse content 410.

In an embodiment, the electronic device 100 may control content output in the first mode corresponding to outputting the metaverse content 410.

In an embodiment, while the electronic device 100 is outputting the metaverse content 410, only the first direction key 151 and the third direction key 157 provided in the control device 150 may be activated. In order to control the metaverse content 410, the user rotates the control device 150 horizontally and uses the first direction key 151 and the third direction key 151 provided on the front 150-1 of the control device 150. By manipulating the direction keys 157 with both thumbs, the avatar 411 that appears in the metaverse content 410 can be controlled.

In an embodiment, the electronic device 100 outputs metaverse content 410 and outputs a guide UI indicating functions when manipulating the first and third direction keys 151 and 157 to the user. You can.

The user can control the movement direction of the avatar 411 by manipulating the first direction key 151 while viewing the guide UI. The electronic device 100 may receive a control signal according to the selection of one of the four directions of the first direction key 151 from the user, and accordingly control the avatar 411 to move in the selected direction among the four directions. there is.

In an embodiment, the electronic device 100 may receive a control signal including a key code command corresponding to the third direction key 157 from the control device 150. In an embodiment, the electronic device 100 may control the gaze direction of the avatar 411 based on the control signal corresponding to the third direction key 157. The electronic device 100 changes the gaze of the avatar 411 to one of right, left, top, and bottom in response to the user selecting one of right, left, top, and bottom directions of the third direction key 157. You can control the direction it faces. The electronic device 100 may output content showing a virtual world located in the direction in which the avatar 411's gaze is directed, in response to the gaze of the avatar 411.

In an embodiment, the electronic device 100 may output content 710 for viewing.

In an embodiment, the electronic device 100 may control content output in the second mode corresponding to outputting content 710 for viewing.

In an embodiment, while the electronic device 100 is outputting content 710 for viewing, the first direction key 151 provided on the front 150-1 of the control device 150 and the control device 150 Only the second direction key 157 provided on the rear surface 150-2 may be activated, and the third direction key 157 may be deactivated.

In an embodiment, the electronic device 100 outputs viewing content 710 and provides a guide UI that indicates to the user a function when operating at least one of the first and second direction keys 151 and 155. can be output.

In order to control the viewing content 710, the user stands up the control device 150 in the vertical direction and uses the first direction key 151 provided on the front 150-1 of the control device 150 and the back ( The second direction key 155 provided in 150-2) can be held and operated with one hand.

For example, the user can select one of the objects included in the viewing content 710 by manipulating the first direction key 151 to adjust the focus movement direction. In addition, the user can control content output in the second mode by manipulating the second direction key 155 to perform a function corresponding to a control signal that can be performed on the currently displayed viewing content 710 screen. .

As such, according to the embodiment, the control device 150 may be provided with three or more direction keys. When using the metaverse content 410 and the viewing content 710 with the electronic device 100, the user operates the plurality of direction keys provided on the control device 150 for different purposes, Content can be conveniently controlled with one control device 150.

Figure 10 is an internal block diagram of the electronic device 100 according to an embodiment.

The electronic device 100 of FIG. 10 may be an example of the electronic device 100 of FIG. 2 . Hereinafter, descriptions that overlap with those described in FIG. 2 will be omitted.

Referring to FIG. 10 , the electronic device 100 may include a processor 101 and a memory 103. Since the processor 101 and memory 103 included in the electronic device 100 perform the same operations as the processor 101 and memory 103 included in the electronic device 100 of FIG. 2, the same reference numerals are used. did.

In an embodiment, the electronic device 100 includes, in addition to the processor 101 and the memory 103, a tuner unit 1010, a communication unit 1020, a detection unit 1030, an input/output unit 1040, and a video processing unit 1050. ), a display 1060, an audio processing unit 1070, an audio output unit 1080, and a user input unit 1090.

The tuner unit 1010 amplifies, mixes, resonates, etc. broadcast content received by wire or wirelessly, and selects only the frequency of the channel desired to be received by the electronic device 100 among many radio wave components. You can select it by tuning. Content received through the tuner unit 1010 is decoded and separated into audio, video, and/or additional information. Separated audio, video and/or additional information may be stored in the memory 103 under the control of the processor 101.

In an embodiment, the communication unit 1020 may connect the electronic device 100 to a peripheral device, an external device, a server, a mobile terminal, etc. under the control of the processor 101. The communication unit 1020 may include at least one communication module capable of performing wireless communication. The communication unit 1020 may include at least one of a wireless LAN module 1021, a Bluetooth module 1022, and a wired Ethernet 1023 depending on the performance and structure of the electronic device 100.

The Bluetooth module 1022 can receive a Bluetooth signal transmitted from a peripheral device according to the Bluetooth communication standard. The Bluetooth module 1022 can be a BLE (Bluetooth Low Energy) communication module and can receive BLE signals. The Bluetooth module 1022 may continuously or temporarily scan the BLE signal to detect whether the BLE signal is being received. The wireless LAN module 1021 can transmit and receive Wi-Fi signals with surrounding devices according to Wi-Fi communication standards.

The sensing unit 1030 detects the user's voice, the user's image, or the user's interaction, and may include a microphone 1031, a camera unit 1032, a light receiving unit 1033, and a sensing unit 1034. The microphone 1031 can receive an audio signal including the user's utterance or noise, and can convert the received audio signal into an electrical signal and output it to the processor 101.

The camera unit 1032 includes a sensor (not shown) and a lens (not shown), and can photograph and capture images on the screen and transmit them to the processor 101.

In an embodiment, the camera unit 1032 may capture a picture of the user corresponding to the video call app being executed. In an embodiment, the camera unit 1032 may adjust the angle of view for photographing the user or perform zoom-in and zoom-out based on a control signal according to the user's control of the second direction key 155.

The optical receiver 1033 can receive optical signals (including control signals). The light receiver 1033 may receive an optical signal corresponding to a user input (eg, touch, press, touch gesture, voice, or motion) from the control device 150, such as a remote control or a mobile phone.

The input/output unit 1040 receives video (e.g., a dynamic image signal or a still image signal, etc.), audio (e.g., a voice signal, or music signal) from an external device 120, etc. under the control of the processor 101. signals, etc.) and additional information, etc. can be received.

The input/output unit 1040 is one of an HDMI port (High-Definition Multimedia Interface port, 1041), a component jack (1042), a PC port (PC port, 1043), and a USB port (USB port, 1044). may include. The input/output unit 1040 may include a combination of an HDMI port 1041, a component jack 1042, a PC port 1043, and a USB port 1044.

The video processing unit 1050 processes image data to be displayed by the display 1060 and performs various image processing operations such as decoding, rendering, scaling, noise filtering, frame rate conversion, and resolution conversion on the image data. You can.

The display 1060 can output on the screen content received from a broadcasting station or from an external device such as an external server or external storage medium, or provided by various apps, such as an OTT service provider or a metaverse content provider. Content is a media signal and may include video signals, images, text signals, etc.

In an embodiment, the display 1060 may output a guide UI indicating an action or function performed when the first direction key 151 or the second direction key 155 is selected. In an embodiment, the display 1060 may display a first guide UI indicating a corresponding action when the first direction key 151 is selected or a second guide indicating a corresponding action when the second direction key 155 is selected. At least one of the UI can be output.

In an embodiment, when the control device 150 is further equipped with a third direction key 157, the display 1060 may output a guide UI to guide the operation when the third direction key 157 is selected. there is.

The audio processing unit 1070 performs processing on audio data. The audio processing unit 1070 may perform various processing such as decoding, amplification, noise filtering, etc. on audio data.

The audio output unit 1080 outputs audio included in content received through the tuner unit 1010 under the control of the processor 101, audio input through the communication unit 1020 or the input/output unit 1040, and memory ( 103) can be output. The audio output unit 1080 may include at least one of a speaker 1081, headphones 1082, or S/PDIF (Sony/Philips Digital Interface: output terminal) 1083.

In an embodiment, the audio output unit 1080 may adjust the volume of audio output according to the control of the remote control device 110 or the processor 101.

The user input unit 1090 may receive user input for controlling the electronic device 100. The user input unit 1090 includes a touch panel that detects the user's touch, a button that receives the user's push operation, a wheel that receives the user's rotation operation, a keyboard, and a dome switch, and voice recognition. It may include, but is not limited to, various types of user input devices including a microphone for detecting motion, a motion detection sensor for detecting motion, etc. In an embodiment, when controlling the electronic device 100 with the control device 150, the user input unit 1090 may receive a control signal received from the control device 150.

FIG. 11 is a flowchart showing how the electronic device 100 operates, according to an embodiment.

Referring to FIG. 11, the electronic device 100 may receive a control signal (step 1110).

In an embodiment, the electronic device 100 may receive a control signal including commands corresponding to a plurality of keys provided in the control device 150 from the control device 150.

In an embodiment, the control signal is a first control signal according to selection of the first direction key 151 provided in the control device 150 and a second direction key 155, which is different from the first direction key 151. It may include at least one of the second control signals.

In an embodiment, the electronic device 100 may identify the type of content currently being output. In an embodiment, the electronic device 100 may identify whether the content being output is the first type of content (step 1120). The first type of content may be, for example, metaverse content. For example, if the app currently being executed is a metaverse app, the electronic device 100 may identify that the content currently being output is metaverse content.

In an embodiment, if the content output by the electronic device 100 is the first type of content, the electronic device 100 may control content output in the first mode (step 1130).

In an embodiment, the electronic device 100 may identify whether the content being output is the second type of content (step 1140). The second type of content may be, for example, viewing content.

In an embodiment, if the content output by the electronic device 100 is a second type of content, the electronic device 100 may control content output in the second mode (step 1150).

FIG. 12 is a diagram for explaining that the electronic device 100 controls content output in a first mode based on a control signal from the control device 150, according to an embodiment.

Referring to FIG. 12, the electronic device 100 may communicate with the control device 150.

In an embodiment, the electronic device 100 may output a first type of content (step 1210). The first type of content may be metaverse content.

In an embodiment, when the electronic device 100 receives a control signal while outputting the first type of content, it may control content output in the first mode.

In an embodiment, the electronic device 100 may output a guide UI that displays an operation performed based on direction key selection along with the first type of content. Users can operate the direction keys using the guide UI.

The user can select the first direction key 151 provided in the control device 150. In an embodiment, the control device 150 may receive a first direction key input from the user (step 1220). The control device 150 may generate a first control signal corresponding to the selection of the first direction key 151 (step 1230). The first control signal may be a control signal including a key code command corresponding to one of the four directions of the first direction key 151.

In an embodiment, the control device 150 may transmit a first control signal to the electronic device 100 (step 1240).

In an embodiment, the electronic device 100 may control the movement direction of the avatar based on the first control signal (step 1250). In an embodiment, the electronic device 100 may control the movement direction of the avatar according to the direction selected by the user using the first direction key 151.

The user can select the second direction key 155 provided in the control device 150. In an embodiment, the control device 150 may receive a second direction key input from the user (step 1260). The control device 150 may generate a second control signal corresponding to the selection of the second direction key 155 (step 1270). The second control signal may be a control signal including a key code command corresponding to one of the four directions of the second direction key 155.

In an embodiment, the control device 150 may transmit a second control signal to the electronic device 100 (step 1280).

In an embodiment, the electronic device 100 may control the gaze direction of the avatar based on the second control signal (step 1290). In an embodiment, the electronic device 100 controls the gaze direction of the avatar according to the direction selected by the user using the second direction key 155, thereby outputting metaverse content representing the virtual reality toward which the avatar's gaze is directed. You can.

FIG. 13 is a diagram for explaining that the electronic device 100 controls content output in a second mode based on a control signal from the control device 150, according to an embodiment.

Referring to FIG. 13, the electronic device 100 may communicate with the control device 150.

In an embodiment, the electronic device 100 may output a second type of content (step 1310). In embodiments, the second type of content may be viewing content.

In an embodiment, when the electronic device 100 receives a control signal while outputting the second type of content, it may control content output in the second mode.

In an embodiment, the electronic device 100 may output a guide UI that displays an operation performed based on direction key selection along with the second type of content. Users can operate the direction keys using the guide UI.

In an embodiment, the control device 150 may receive a first direction key input from the user (step 1320). In an embodiment, the control device 150 may generate a first control signal corresponding to the selection of the first direction key 151 (step 1330). The first control signal may be a control signal including a key code command corresponding to each direction of the first direction key 151.

In an embodiment, the control device 150 may transmit a first control signal to the electronic device 100 (step 1340).

In an embodiment, the electronic device 100 may control the focus movement direction based on the first control signal. That is, based on the first control signal, the electronic device 100 may move the focus or cursor for selecting an object included in viewing content in one of the following directions: up, down, left, or right.

In an embodiment, the control device 150 may receive a second direction key input from the user (step 1360). The control device 150 may generate a second control signal corresponding to the selection of the second direction key 155 (step 1370). The second control signal may be a control signal including a key code command corresponding to each direction of the second direction key 155.

In an embodiment, the control device 150 may transmit a second control signal to the electronic device 100 (step 1380).

In an embodiment, the electronic device 100 may perform a corresponding function based on the second control signal (step 1390). The operation performed according to the input of the second direction key 155 may vary depending on the screen.

In an embodiment, the electronic device 100 may perform an operation displayed on a guide UI that displays an operation performed based on selection of the second direction key 155, based on the second control signal.

FIG. 14 is a diagram for explaining that the electronic device 100 controls content output in a third mode based on a control signal from the control device 150, according to an embodiment.

Referring to FIG. 14, the electronic device 100 may output a third type of content (step 1410). In an embodiment, the third type of content may be video call content. In an embodiment, when the electronic device 100 receives a control signal while outputting third type of content, it may control content output in the third mode.

In an embodiment, the electronic device 100 may output a guide UI that guides the operation corresponding to the direction key input along with the third type of content.

In an embodiment, the control device 150 may receive a first direction key input from the user (step 1420). The control device 150 may generate a first control signal corresponding to the selection of the first direction key 151 (step 1430). The first control signal may be a control signal including a key code command corresponding to one of the four directions included in the first direction key 151.

In an embodiment, the control device 150 may transmit a first control signal to the electronic device 100 (step 1440).

In an embodiment, the electronic device 100 may control the focus movement direction based on the first control signal (step 1450).

In an embodiment, the control device 150 may receive a second direction key input from the user (step 1460) and correspondingly generate a second control signal corresponding to the second direction key 151 (step 1460). Step 1470). The second control signal may include key code commands corresponding to each direction of the second direction key 151.

In an embodiment, the control device 150 may transmit a second control signal to the electronic device 100 (step 1480).

In an embodiment, the electronic device 100 may control the selected screen based on receiving the second control signal from the control device 150 (step 1490). For example, the electronic device 100 can adjust the position or size of the selected screen. Additionally, the electronic device 100 may control the selected screen by controlling the camera provided in the electronic device 100 to adjust the angle of view or zoom in or out based on the second control signal.

Methods and devices for operating electronic devices according to some embodiments may also be implemented in the form of a recording medium containing instructions executable by a computer, such as program modules executed by a computer. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and non-volatile media, removable and non-removable media. Additionally, computer-readable media may include both computer storage media and communication media. Computer storage media includes both volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Communication media typically includes computer-readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave, or other transmission mechanism, and includes any information delivery medium.

In addition, the electronic device and its operating method according to the above-described embodiment of the present disclosure include receiving a control signal from a control device, and if the content to be output is a first type of content, the content is set to a first mode based on the control signal. Controlling the output, and if the output content is a second type of content, controlling the output of the content in a second mode based on the control signal, wherein the control signal is transmitted to the first type of content provided in the control device. A computer in which a program for implementing a method of operating an electronic device is recorded, including at least one of a first control signal according to selection of a direction key and a second control signal depending on selection of a second direction key, which is different from the first direction key. It may be implemented as a computer program product including a readable recording medium/storage medium.

A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory storage medium' simply means that it is a tangible device and does not contain signals (e.g. electromagnetic waves). This term is used to refer to cases where data is semi-permanently stored in a storage medium and temporary storage media. It does not distinguish between cases where it is stored as . For example, a 'non-transitory storage medium' may include a buffer where data is temporarily stored.

According to one embodiment, methods according to various embodiments disclosed in this document may be provided and included in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. A computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or through an application store or between two user devices (e.g. smartphones). It may be distributed in person or online (e.g., downloaded or uploaded). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) is stored on a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server. It can be temporarily stored or created temporarily.

Claims (20)

In the electronic device 100,
output unit 107;
Department of Communications (105);
a memory 103 that stores one or more instructions; and
Comprising one or more processors (101) executing the one or more instructions stored in the memory,
The one or more processors execute the one or more instructions,
Receiving a control signal from the control device 150 through the communication unit,
If the content output to the output unit is a first type of content, control the content output in a first mode based on the control signal,
If the content output to the output unit is a second type of content, control the output of the content in a second mode based on the control signal,
The control signal includes at least one of a first control signal in response to selection of a first direction key provided in the control device and a second control signal in response to selection of a second direction key, which is different from the first direction key. . The electronic device of claim 1, wherein the first type of content is metaverse content, and the second type of content is viewing content. The method of claim 1 or 2, wherein the one or more processors execute the one or more instructions,
Outputs a guide UI through the output unit,
The guide UI includes at least one of a first guide UI that displays an operation performed based on selection of the first direction key and a second guide UI that displays an operation performed based on selection of the second direction key. , electronic devices. 4. The method of claim 3, wherein the one or more processors execute the one or more instructions,
Output the guide UI at preset time intervals or whenever an event occurs,
The event includes at least one of an event in which the type of content to be output is changed, and an event in which a function controlled based on the control signal is changed. The method according to any one of claims 2 to 4, if the output content is the first type of content,
The one or more processors execute the one or more instructions,
Controlling the movement direction of an avatar in the metaverse content based on one of the first control signal and the second control signal, and the remaining control signal among the first control signal and the second control signal An electronic device that controls content output in the first mode by controlling the gaze direction of the avatar based on . The method of claim 5, wherein the one or more processors execute the one or more instructions,
Receiving a sensing signal about the movement of the control device from the control device through the communication unit,
An electronic device that controls the gestures of the avatar based on the sensing signal. The method according to any one of claims 2 to 6, if the output content is the second type of content,
The one or more processors execute the one or more instructions,
Controlling a focus movement direction for selecting an object included in the viewing content based on the first control signal, and performing the control on the currently output viewing content screen based on the second control signal, An electronic device that controls content output in the second mode by allowing a function corresponding to a second control signal to be performed. 8. The method of claim 7, wherein the one or more processors execute the one or more instructions,
Outputting a second guide UI displaying an operation performed based on selection of the second direction key through the output unit,
Upon receiving the second control signal, the function corresponding to the second control signal is immediately performed without receiving an additional control signal,
The function corresponding to the second control signal is an operation guided by the second guide UI. The method of any one of claims 1 to 8, wherein the one or more processors execute the one or more instructions,
If the content output to the output unit is a third type of content, control the content output in a third mode based on the control signal,
The third content type is video call content,
Controlling content output in the third mode includes:
Controls the direction of focus movement for selecting one of a plurality of screens included in the video call content based on the first control signal, and controls the size and position of the selected screen based on the second control signal. , an electronic device comprising adjusting at least one of a view angle and a zoom function. In the control device 150,
input unit 157;
Department of Communications (155);
a memory 153 that stores one or more instructions; and
Comprising one or more processors 151 that execute the one or more instructions stored in the memory,
The one or more processors execute the one or more instructions,
Transmitting a control signal to the electronic device 100 through the communication unit,
The input unit includes a first direction key 151 and a second direction key 155 that is different from the first direction key,
The first direction key is disposed on the front of the control device, and the second direction key is disposed on at least one of the front, back, rear, and side positions of the control device. The control device according to claim 10, wherein the first direction key and the second direction key are disposed within a range that can be simultaneously operated by a user with one hand. In a method of operating an electronic device,
Receiving a control signal from a control device;
If the content to be output is a first type of content, controlling output of the content in a first mode based on the control signal; and
If the content to be output is a second type of content, controlling output of the content in a second mode based on the control signal,
The control signal includes at least one of a first control signal in response to selection of a first direction key provided in the control device and a second control signal in response to selection of a second direction key, which is different from the first direction key. How it works. The method of claim 12, wherein the first type of content is metaverse content, and the second type of content is viewing content. The method of claim 12 or 13, further comprising outputting a guide UI,
The guide UI includes at least one of a first guide UI that displays an operation performed based on selection of the first direction key and a second guide UI that displays an operation performed based on selection of the second direction key. , how electronic devices work. The method of claim 14, wherein the step of outputting the guide UI is
Including the step of outputting the guide UI at preset time intervals or whenever an event occurs,
The event includes at least one of an event in which the type of content to be output is changed and an event in which a function controlled based on the control signal is changed. The method of any one of claims 13 to 15, wherein controlling content output in the first mode comprises:
Controlling a movement direction of an avatar in the metaverse content based on one of the first control signal and the second control signal; and
A method of operating an electronic device, comprising controlling the gaze direction of the avatar based on the remaining control signal among the first control signal and the second control signal. The method of claim 16, further comprising receiving a sensing signal for movement of the control device from the control device,
The step of controlling content output in the first mode is
A method of operating an electronic device, further comprising controlling a gesture of the avatar based on the sensing signal. The method of any one of claims 13 to 17, wherein controlling content output in the second mode comprises:
controlling a focus movement direction for selecting an object included in the viewing content based on the first control signal; and
A method of operating an electronic device, comprising performing a function corresponding to the second control signal that can be performed on a currently output viewing content screen based on the second control signal. The method according to any one of claims 12 to 18, further comprising controlling content output in a third mode based on the control signal when the content to be output is a third type of content,
The step of controlling content output in the third mode is
controlling a focus movement direction to select one of a plurality of screens included in the video call content based on the first control signal; and
A method of operating an electronic device, comprising adjusting at least one of the size, position, angle of view, and zoom function of the selected screen based on the second control signal. A computer-readable recording medium on which a program capable of performing the method of any one of claims 12 to 19 is recorded by a computer.

Images