KR102840429B1 - Display device and operating method thereof for the same - Google Patents

Abstract

A display device and an operating method thereof are disclosed. The display device comprises a display unit, a memory storing one or more instructions, and a processor executing the one or more instructions stored in the memory, wherein the processor can acquire an image by executing the one or more instructions, convert the acquired image based on visual characteristic information of a user including a type of visual impairment, and display the converted image on the display unit.

Description

DISPLAY DEVICE AND OPERATING METHOD THEREOF FOR THE SAME

The present disclosure relates to a visual assistance display device and an operating method thereof, and more particularly, to a visual assistance display device that provides converted images for low vision users and an operating method thereof.

As various devices, including mobile terminals, offer complex and diverse functions, technologies are being developed to enable users to use these devices more conveniently. Furthermore, with the development of wearable devices, these devices are being implemented with customized features.

Recently, with the advancement of multimedia technology, network technology, and image processing technology, research is required to provide users with a more convenient interface environment and images suited to their visual characteristics.

In addition, with the recent advancement of virtual reality technology, research is being required to provide customized functions using virtual reality devices.

The present disclosure provides a visual assistance display device that provides converted images for low vision users and a method of operating the same.

The technical problems to be solved by the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

According to one embodiment of the present invention, a display device for realizing the above-described task includes a display unit, a memory storing one or more instructions, and a processor executing the one or more instructions stored in the memory, wherein the processor can acquire an image by executing the one or more instructions, convert the acquired image based on visual characteristic information of a user including a type of visual impairment, and display the converted image on the display unit.

A method of operating a display device according to one embodiment for realizing the above-described task may include a step of acquiring an image, a step of converting the acquired image based on visual characteristic information of a user including a type of visual impairment, and a step of displaying the converted image on a display unit.

According to another aspect, a computer-readable recording medium may include a recording medium having recorded thereon a program for executing the above-described method on a computer.

FIG. 1 is a drawing for explaining an operating method of a display device according to one embodiment.
FIG. 2 is a drawing for explaining an operation method of a display device, a control device, and an external device related to one embodiment.
Figure 3 is a flowchart for explaining an operating method of a display device according to one embodiment.
Figures 4 to 9 are drawings illustrating examples of providing converted images based on user visual characteristic information.
Figure 10 is a drawing for explaining an example of converting and providing an image received from an external server.
Figure 11 is a flowchart for explaining an operating method of a display device according to one embodiment.
Figures 12 to 16 are drawings for explaining examples of providing a converted image based on an object included in an image.
FIG. 17 is a flowchart illustrating a method for determining image conversion information according to one embodiment.
FIGS. 18 to 23 are diagrams for explaining examples of determining image conversion information according to one embodiment.
FIG. 24 is a flowchart illustrating a method for determining image transformation information according to another embodiment.
FIG. 25 is a diagram for explaining an example of determining image conversion information according to another embodiment.
Figures 26 and 27 are block diagrams of a display device related to one embodiment.
Fig. 28 is a block diagram of a control device related to one embodiment.

Below, embodiments of the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. Furthermore, for the purpose of clearly explaining the present disclosure in the drawings, parts irrelevant to the description are omitted, and similar parts are designated with similar reference numerals throughout the specification.

The terms used in this disclosure are described as currently common terms, taking into account the functions mentioned herein. However, these terms may mean various other terms depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Therefore, the terms used in this disclosure should not be interpreted solely based on their names, but rather based on the meanings of the terms and the overall content of this disclosure.

Additionally, while terms such as first, second, etc. may be used to describe various components, the components should not be limited by these terms. These terms are used to distinguish one component from another.

Furthermore, the terminology used herein is merely used to describe specific embodiments and is not intended to limit the present disclosure. The singular expression includes the plural unless the context clearly dictates otherwise. Furthermore, throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected," but also the case where it is "electrically connected" with another element in between. Furthermore, when a part is said to "include" a certain component, this does not exclude other components, but rather means that it can include other components, unless specifically stated otherwise.

As used herein, and particularly in the claims, the terms "above" and "above" and similar referents may refer to both the singular and the plural. Furthermore, unless the order of steps in a method according to the present disclosure is explicitly specified, the steps described may be performed in any appropriate order. The present disclosure is not limited by the order in which the steps are described.

The appearances of phrases such as “in some embodiments” or “in one embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment.

Some embodiments of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various hardware and/or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors or by circuit configurations for a given function. Furthermore, for example, the functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks may be implemented by algorithms that execute on one or more processors. Furthermore, the present disclosure may employ conventional techniques for electronic configuration, signal processing, and/or data processing. Terms such as “mechanism,” “element,” “means,” and “configuration” may be used broadly and are not limited to mechanical and physical configurations.

Additionally, the connecting lines or connecting members between components depicted in the drawings are merely exemplary representations of functional connections and/or physical or circuit connections. In an actual device, connections between components may be represented by various functional connections, physical connections, or circuit connections that may be replaced or added.

The present disclosure will be described in detail with reference to the attached drawings below.

FIG. 1 is a drawing for explaining an operating method of a display device according to one embodiment.

According to one embodiment, the display device (100) can convert an image (11) captured by a camera (161) based on the user's visual characteristic information, and then display the converted image (13) on the display unit (121).

For example, in the case of visual characteristics that are difficult to correct with general glasses, it may be difficult to recognize objects with an image (12) visible to the user's eyes. According to one embodiment, the display device (100) displays an image (13) converted based on the user's visual characteristic information on the display unit (121), so that the user wearing the display device (100) can recognize objects more clearly. For example, the user can fix the display device (100) on the head and view an image converted to suit the user's visual characteristics through the display unit (121).

According to one embodiment, the processor (130) of the display device (100) extracts the outline of an object included in an image and provides an image converted by adjusting the contrast between the outline and the remaining area, thereby enabling a low-vision user to more clearly recognize objects within the image. In addition, for example, the processor (130) of the display device (100) can improve the object recognition rate of a low-vision user by converting an input image into a binary image and providing it.

Visual characteristic information according to one embodiment may include information about the type of visual impairment of the user and the degree of visual impairment according to the type of visual impairment.

For example, types of visual impairments may include low vision, color blindness, metamorphopsia, central scotoma, and tunnel vision.

For example, the degree of visual impairment, depending on the type of visual impairment, could refer to the visual acuity grade in the case of low vision. Furthermore, for example, in the case of color blindness, it could refer to red-green color blindness, blue-yellow color blindness, or total color blindness. Furthermore, for example, in the case of a central scotoma, it could refer to the location, shape, and size of the scotoma. However, this is not limited to these terms.

In addition, according to one embodiment, the display device (100) can convert and provide not only an image captured by a camera (161), but also an image stored in the memory (170) of the display device (100) and an image received from an external device according to the user's visual characteristics.

Meanwhile, the display device (100) according to one embodiment may be a VR (Virtual Reality) headset or a glass-type device, but is not limited thereto. For example, the VR headset may be implemented in a form in which a display unit (121) is built in, or in a form in which a smartphone can be mounted, so that the display of the smartphone is used as the display unit (121).

According to one embodiment, the display device (100) can provide a VR (Virtual Reality) image to a user, and the format of the image provided is not limited thereto.

VR videos can be videos that use computer graphics technology to make the user feel as if they are viewing the actual surrounding environment through the user's sight or hearing.

According to one embodiment, the image provided by the display device (100) may be a stereoscopic 3D image. Stereoscopic 3D is a technology for implementing a three-dimensional image that utilizes the visual difference between the two eyes to present a pair of 2D images with binocular disparity to each eye of the viewer, thereby allowing the viewer to perceive a three-dimensional sense of depth.

According to one embodiment, the display unit (121) may be implemented to display left-eye images and right-eye images by dividing them into two screens. For example, the display unit (121) may implement a stereoscopic image effect according to a time-division stereoscopic method that alternately displays left-eye images and right-eye images to create a stereoscopic image effect, but is not limited thereto.

Additionally, the image provided by the display device (100) may be an augmented reality image. The augmented reality image may be an image that displays a three-dimensional virtual image by overlaying it on a real image captured by a camera (161).

Figure 1 illustrates one embodiment, but is not limited thereto.

FIG. 2 is a drawing for explaining an operation method of a display device, a control device, and an external device related to one embodiment.

According to one embodiment, the display device (100) may be, but is not limited to, a VR (Virtual Reality) headset (100a), a glass-type wearable device (100b), a glass-type device (100c) equipped with a transparent display, or a head-mounted display.

In addition, according to one embodiment, the display device (100) may be implemented as various electronic devices such as a mobile phone, a tablet PC, a digital camera, a camcorder, a laptop computer, a tablet PC, a desktop, an e-book reader, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation device, an MP3 player, a wearable device, etc.

An external device (300) according to one embodiment may include, but is not limited to, a server (300a) or another display device (e.g., TV) (300b) capable of providing video content to a display device (100).

In addition, according to one embodiment, the external device (300) may be a digital broadcast receiver capable of receiving digital broadcasts. In addition, the external device (300) may be a playback device that plays multimedia content. For example, the external device (300) may include a Blu-ray Disc player, a set-top box, a Digital Versatile Disk (DVD) player, a streaming device, a home theater, etc. Alternatively, the external device (300) may be implemented as various electronic devices such as a smart phone, a tablet personal computer (PC), a mobile phone, a video phone, an e-book reader, a desktop personal computer (PC), a laptop personal computer (PC), a netbook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a wearable device, etc.

According to one embodiment, a display device (100) and an external device (300) can transmit and receive data, signals, etc. using wired or wireless communication. For example, a server (300) can transmit video content to the display device (100).

Meanwhile, according to one embodiment, the server (300) may, in response to a request signal from the display device (100), convert an image based on image conversion information and provide the converted image to the display device (100).

Additionally, for example, the server (300) may receive user visual characteristic information from the display device (100) and transmit image conversion information based on the visual characteristic information to the display device (100).

According to one embodiment, the control device (200) may be implemented as various types of devices for controlling the display device (100), such as a remote control (200b), a keyboard (200a), or a mobile phone (not shown).

A control device (200) according to one embodiment can control a display device (100) using short-range communication including infrared or Bluetooth. The control device (200) can control the function of the display device (100) using at least one of a key (including a button), a touchpad, a microphone (not shown) capable of receiving a user's voice, and a sensor (not shown) capable of recognizing the motion of the control device (200).

According to one embodiment, the control device (200) may include a power on/off button for turning the power of the display device (100) on or off. The control device (200) may also zoom in/out, adjust contrast, adjust color sharpness, adjust saturation, adjust color temperature, or set visual characteristic information, image conversion information, etc. of the display of the display device (100) by user input.

Figure 2 illustrates one embodiment, but is not limited thereto.

Figure 3 is a flowchart for explaining an operating method of a display device according to one embodiment.

In step S301, a display device (100) according to one embodiment can obtain an image to be displayed on a display unit (121).

According to one embodiment, the display device (100) can capture images in real time through a camera (161). In addition, according to one embodiment, the display device (100) can receive image content from an external device (300) through a communication unit (150). In addition, according to one embodiment, the display device (100) can determine an image stored in a memory (170) as an image to be displayed on the display unit (121).

In step S302, the display device (100) according to one embodiment can convert the acquired image based on the user's visual characteristic information including the type of visual impairment.

For example, the user's visual characteristic information may include low vision, color blindness, metamorphopsia, central scotoma, tunnel vision, etc.

According to one embodiment, the control unit (130) of the display device (100) can determine image conversion information for converting the acquired image based on visual characteristic information.

According to one embodiment, the image conversion information may include image conversion values for enabling the user to perceive the image more clearly based on the user's visual characteristic information. For example, the image conversion information may include conversion values related to conversion into a binary image, enlargement or reduction of an object included in the image, change of display position, contrast adjustment of the object's outline, color sharpness adjustment, saturation adjustment, color temperature adjustment, etc.

The control unit (130) of the display device (100) according to one embodiment can convert the acquired image based on the image conversion information.

For example, the display device (100) can convert the color of an image based on image conversion information including a color conversion value of the image. In addition, for example, the display device (100) can convert the display position of an image so that the image is displayed in an area of the display unit (121) excluding an area corresponding to the user's central dark spot, based on image conversion information including a display position change value of the image.

In step S303, the display device (100) according to one embodiment can display the converted image on the display unit (121).

For example, since the display device (100) converts and provides an image captured through a camera (161) in real time based on image conversion information, a low vision user wearing the display device (100) (e.g., VR headset) can recognize objects more clearly.

In addition, for example, the display device (100) converts and provides image content received from an external server (300) based on the vision information of a low-vision user, thereby allowing the user to view image content that is recognized more clearly through the display device (100).

Figures 4 to 9 are drawings illustrating examples of providing converted images based on user visual characteristic information.

According to one embodiment, the visual characteristic information may include at least one of a type of visual impairment and a degree of visual impairment depending on the type of visual impairment.

Figure 4 illustrates an example of converting and providing an image based on visual characteristic information of a user with color vision deficiency. As illustrated in Figure 4, an image (42) visible to a user with color vision deficiency may have difficulty distinguishing the colors of objects.

According to one embodiment, the display device (100) can provide a converted image (43) of an input image (41) captured by a camera (161) so that a user with color vision deficiency can distinguish the colors of an object.

According to one embodiment, the processor (130) of the display device (100) may determine, as image conversion information, a conversion value that removes a specific color and highlights another specific color based on the degree of color weakness (e.g., red-green color weakness, blue-yellow color weakness, total color weakness). In addition, for example, the processor (130) of the display device (100) may determine, as image conversion information, a conversion value regarding an RGB color filter and a conversion value regarding adjustment of color temperature according to an ambient light source. The processor (130) may display, on the display unit (121), a converted image (43) according to the determined image conversion information.

Figure 5 illustrates an example of converting and providing an image based on visual characteristic information of a user with metamorphopsia. Metamorphopsia is a condition in which objects within the field of view appear distorted or deformed. As illustrated in Figure 5, the image (52) seen by a user with metamorphopsia may appear distorted in part of the field of view.

According to one embodiment, the display device (100) can provide a converted image (53) of an input image (51) captured by a camera (161) so that a user with astigmatism does not see the image distorted.

According to one embodiment, the processor (130) of the display device (100) may determine a transformation value for correcting a distorted area based on the degree of metamorphopsia (e.g., the degree to which an object appears distorted, the location, size, shape, etc. of the distorted area in the field of view, as image transformation information. The processor (130) according to one embodiment may display a transformed image (53) based on the determined image transformation information on the display unit (121). For example, the transformed image (53) may be an image that is deformed by reversing the distortion direction visible in the field of view of a user with metamorphopsia.

Figure 6 illustrates an example of converting and providing an image based on visual characteristic information of a user with central scotoma. Central scotoma is a phenomenon in which the central area of the user's field of vision is not visible due to macular degeneration, and the shape of the scotoma may be circular, oval, or racket-shaped. As illustrated in Figure 6, an image (62) visible to the eyes of a user with macular degeneration may not show part of the central area of the field of vision.

According to one embodiment, the display device (100) may provide a converted image (63) of an input image (61) captured by a camera (161) so that the image of a central region invisible to a user with central scotomas can be viewed from a different location. For example, a central scotomas area (65) that is invisible to the user's field of view may be displayed in a portion (66) of an area visible to the user's field of view.

According to one embodiment, the processor (130) of the display device (100) may determine a transformation value regarding a change in the display position of an image corresponding to the central scotoma area as image transformation information based on the degree of the central scotoma (e.g., the position, size, shape, etc. of the central scotoma). For example, the image transformation information may include information regarding the position, size, and shape of an area to be displayed by changing the position of the image corresponding to the central scotoma area.

According to one embodiment, the processor (130) can display a converted image (63) on the display unit (121) according to the determined image conversion information.

Figure 7 illustrates another example of converting and providing an image based on visual characteristic information of a user with central scotoma symptoms.

As illustrated in FIG. 7, an image (72) visible to a user with central scotoma may not show part of the central region of the visual field. The display device (100) may provide a converted image (73) from an input image (71) captured by a camera (161) so that the user with central scotoma can view the image of the central region that is not visible from a different location. For example, a central scotoma region (75) that is not visible from the user's visual field may be displayed in part (76) of the region that is visible from the user's visual field.

According to one embodiment, the processor (130) of the display device (100) may determine a transformation value for displaying the entire image of the user's field of view, including the image corresponding to the central scotoma area, in a portion of the remaining area excluding the central scotoma area, based on the degree of the central scotoma (e.g., the location, size, shape, etc. of the central scotoma), as image transformation information. For example, the image transformation information may include information regarding the location, size, and shape at which the entire image of the user's field of view is to be displayed.

According to one embodiment, the processor (130) can display a converted image (73) on the display unit (121) according to the determined image conversion information.

Figure 8 illustrates an example of converting and providing an image based on visual characteristic information of a user with tunnel vision. Tunnel vision is a phenomenon in which the field of vision is limited, as if looking at the entrance of a tunnel from inside. As illustrated in Figure 8, the image (82) seen from the perspective of a user with tunnel vision may not show the peripheral areas except for the central area.

According to one embodiment, the display device (100) may provide a converted image (83) so that the input image (81) captured by the camera (161) can be viewed through a central area (85) visible to the user.

According to one embodiment, the processor (130) of the display device (100) may determine a transformation value for displaying the entire input image in an area viewable by the user based on the degree of tunnel vision symptoms (e.g., location, size, shape, etc. of the tunnel vision area) as image transformation information. For example, the image transformation information may include information regarding the location, size, and shape at which the entire image of the user's field of vision is to be displayed.

According to one embodiment, the processor (130) can display a converted image (83) on the display unit (121) according to the determined image conversion information.

Figure 9 illustrates an example of converting and providing an image based on a user's visual characteristic information in a low-light environment. As illustrated in Figure 9, an image (91) input in a low-light environment may make it difficult for the user to recognize objects.

According to one embodiment, the display device (100) can provide an image (93) converted from an input image (91) captured by a camera (161) so as to recognize an object within the image.

According to one embodiment, the processor (130) of the display device (100) may determine image conversion information by changing the image conversion information determined based on the user's visual characteristic information in a low-light environment. For example, in a low-light environment, the processor (130) may determine image conversion information by changing conversion values related to brightness, sharpness, contrast adjustment, noise removal, etc.

Figure 10 is a drawing for explaining an example of converting and providing an image received from an external device.

According to one embodiment, the display device (100) may receive image content being output from an external device (300b). At this time, the display device (100) may receive image content converted based on the user's visual characteristic information. According to one embodiment, the image content may be a VR image, but is not limited thereto.

According to one embodiment, the external device (300b) can receive video content from an external source through at least one of an HDMI port (High-Definition Multimedia Interface port), a component jack, a PC port, and a USB port.

According to one embodiment, the external device (300b) may perform image conversion processing so that a low vision user can perceive the image content more clearly, and then transmit the converted image content to the display device (100).

According to one embodiment, the display device (100) can receive image content through the communication unit (150). For example, the wireless communication method may include IR, Bluetooth, BLE, ultrasound, Zigbee, Wi-Fi, etc.

Additionally, according to one embodiment, the processor (130) of the display device (100) may, after receiving image content, convert the image based on at least one of the user's visual characteristic information and image conversion information. The processor (130) may display the converted image on the display unit (121).

Figures 4 to 10 illustrate one embodiment, but are not limited thereto.

Fig. 11 is a flowchart illustrating an operating method of a display device according to one embodiment. Figs. 12 to 16 are diagrams illustrating examples of providing a transformed image based on an object included in an image. The description of Fig. 11 will be described with reference to the examples illustrated in Figs. 12 to 16.

In step S1101, a display device (100) according to one embodiment can obtain an image to be displayed on a display unit (121).

According to one embodiment, the processor (130) may acquire at least one of an image captured by a camera (161), an image received from an external source via a communication unit (150), and an image stored in a memory (170) as an image to be displayed on the display (121).

In step S1102, the display device (100) according to one embodiment may determine image conversion information for converting the acquired image based on at least one of the user's visual characteristic information including the type of visual impairment and the object included in the image. In step S1103, the display device (100) according to one embodiment may convert the acquired image based on the image conversion information. In step S1104, the display device (100) according to one embodiment may display the converted image on the display unit (121).

According to one embodiment, the processor (130) can extract an object contained in an image and determine image transformation information based on the properties of the object.

For example, the object may be at least one of text, a person, a landscape, and the screen of another display device.

Referring to FIG. 12, according to one embodiment, the processor (130) can enlarge and display an image output on the screen of another display device.

According to one embodiment, the processor (130) may extract a screen (1205) of another display device within an input image (1201) captured by a camera (161). According to one embodiment, the processor (130) may determine a conversion value for displaying an enlarged image within the screen (1205) as image conversion information.

According to one embodiment, the processor (130) may display an image (1203) that is an enlarged image of only the image area of the screen (1205) on the display unit (121). For example, the display device (100) may provide a high sense of immersion by allowing a user watching TV to view only the TV image with the surrounding images removed through the entire area of the display unit (121).

Additionally, according to one embodiment, the processor (130) may determine image transformation information for transforming an image including a screen area excluding a surrounding image based on the user's visual characteristic information (e.g., low vision, metamorphopsia, etc.).

Referring to FIG. 13, according to one embodiment, the processor (130) may enlarge and display a text area of a book.

According to one embodiment, the processor (130) may extract an object containing text, such as a book or newspaper, within an input image (1301). The processor (130) may determine image transformation information including transformation values for extracting and enlarging lines of text from a text area and displaying them.

For example, when a display device (100) acquires an image including a book through a camera (161), it can provide high readability to the user by enlarging and displaying only the text area of the book excluding the surrounding image.

Additionally, according to one embodiment, the processor (130) may determine image conversion information for converting an image including a text area excluding a surrounding image of a book based on the user's visual characteristic information (e.g., low vision, metamorphopsia, etc.).

Referring to FIG. 14, according to one embodiment, the processor (130) may provide a converted image so that a user can recognize a person included in the image.

For example, a user with central scotoma may see an image (1402) with the central area obscured, and therefore, if a person is included in the central area of the image, the user may not be able to identify the person.

According to one embodiment, the processor (130) may extract a person within an input image (1401). Furthermore, according to one embodiment, the processor (130) may determine image transformation information based on the user's visual characteristic information (e.g., the location, size, and shape of a central dark spot).

For example, the processor (130) may determine image transformation information including transformation values for changing the display position of a person obscured by a central dark spot area within the image.

Referring to FIG. 15, according to one embodiment, the processor (130) can change the display position of text and display it.

In one embodiment, an image (1502) visible to a user with central scotoma symptoms may have part of the text obscured by a central scotoma area (1505).

According to one embodiment, the processor (130) may extract text within an input image (1501). In addition, according to one embodiment, when the processor (130) obtains the location, size, and shape of a central dark spot as user visual characteristic information, the processor (130) may determine image transformation information for moving the display location of the text to an area other than the central dark spot area.

For example, the processor (130) may determine image transformation information for displaying text (e.g., BCD) that is not visible due to the central scotoma (1505) in the left and right areas of the central scotoma region (1503, 1504). The processor (130) may display a part of the text (e.g., B) corresponding to the central scotoma region (1505) in the left area of the central scotoma, and a part of the text (e.g., CD) in the right area of the central scotoma. In addition, the processor (130) may move the display position so that text (e.g., A, E) displayed in an area other than the central scotoma is not obscured. For example, text (e.g., AB) may be displayed in the left area based on the central scotoma region (1506, 1507), and text (e.g., CDE) may be displayed in the right area based on the central scotoma region.

Meanwhile, according to one embodiment, the processor (130) may display an area corresponding to the user's central dark spot within the converted image in the form of a circle (1506), a square (1507), or the like, but is not limited thereto.

Referring to FIG. 16, according to one embodiment, the processor (130) can display text input through a keyboard (200a) on the display unit (121).

According to one embodiment, the processor (130) may acquire text input through a keyboard (200a) as an object to be displayed on the display unit (121), and determine image conversion information to process the text so that the text can be highlighted by using the inversion of the colors of the lines and background of the text.

Additionally, according to one embodiment, the processor (130) may determine image transformation information including transformation values for text magnification ratio and color inversion based on the user's vision characteristic information (e.g., low vision, astigmatism, etc.).

Figures 12 to 16 illustrate one embodiment, but are not limited thereto.

Fig. 17 is a flowchart illustrating a method for determining image transformation information according to an embodiment. Figs. 18 to 23 are diagrams illustrating examples of determining image transformation information according to an embodiment. The description of Fig. 17 will be described with reference to the examples illustrated in Figs. 18 to 23.

In step S1701, the display device (100) according to an embodiment may provide a user interface for obtaining visual characteristic information including at least one of the type of visual impairment of the user and the degree of visual impairment according to the type of visual impairment. In step S1702, the display device (100) according to an embodiment may obtain visual characteristic information through the user interface. In step S1703, the display device (100) according to an embodiment may determine image conversion information based on the visual characteristic information.

For example, if the display device (100) detects that the user is wearing the headset-type display device (100), the display device (100) may display a user interface for receiving the user's visual characteristic information on the display unit (121). In addition, for example, if the display device (100) receives a user input of the user pressing a button provided on the display device (100), the display device (100) may display a user interface for receiving the user's visual characteristic information on the display unit (121), but is not limited thereto.

Meanwhile, according to one embodiment, the display device (100) may output the content displayed on the display unit (121) as sound through the sound output unit (122).

According to one embodiment, the display device (100) can receive information input through a control device (200) (e.g., a keyboard (200a), a remote control (200b)). For example, the display device (100) can receive an input signal for moving a selection item displayed on the display unit (121) up, down, left, and right to select it through the remote control (200b).

Figure 18 illustrates an example of obtaining visual characteristic information regarding low vision.

As illustrated in FIG. 18, the processor (130) can display the type of visual impairment on the display unit (121) and receive a user input for selecting low vision (1801). In addition, the processor (130) can display the level of low vision on the display unit (121) and receive a user input for selecting the user's level of vision (e.g., level 2) (1802). In addition, the processor (130) can provide an example of a converted image to the display unit (121) and receive a user input for selecting the image that is most visible to the user (1803).

According to one embodiment, the processor (130) may determine image conversion information based on user visual characteristic information (e.g., low vision, level 2, image selected as an image that the user can see well) input through the user interface.

Figure 19 illustrates an example of obtaining visual characteristic information regarding color blindness.

As illustrated in FIG. 19, the processor (130) can display the type of visual impairment on the display unit (121) and receive a user input for selecting color weakness (1901). In addition, the processor (130) can display a test screen for identifying the type of color weakness (e.g., red-green color weakness, blue-yellow color weakness, full color weakness) on the display unit (121) (1902).

According to one embodiment, the processor (130) may determine image conversion information based on user visual characteristic information (e.g., red-green color weakness) obtained through the user interface.

Figure 20 illustrates an example of obtaining visual characteristic information regarding metamorphopsia.

As illustrated in FIG. 20, the processor (130) can display the type of visual impairment on the display unit (121) and receive a user input for selecting metamorphopsia (2001). In addition, the processor (130) can display a grid-patterned test screen (e.g., an Amsler grid chart) on the display unit (121) to obtain the location and degree of distortion in the user's field of vision.

According to one embodiment, the processor (130) may receive user input to correct a line that appears distorted in the user's field of view into a straight line (2002). For example, the processor (130) may receive user input to move an icon displayed on a test screen left, right, up, or down via a keyboard (200a) or a remote control (200b). The processor (130) may receive user input to move a line that appears distorted and adjust it until it appears as a straight line (2003).

According to one embodiment, the processor (130) may analyze a correction pattern input through a grid test and, by using the correction pattern inversely, determine image transformation information for correcting the image so that the image does not appear distorted in the user's field of view.

Figures 21 and 22 illustrate examples of obtaining visual characteristic information regarding central scotoma symptoms.

As illustrated in FIG. 21, the processor (130) can display the type of visual impairment on the display unit (121) and receive user input for selecting a central scotoma (2101). In addition, the processor (130) can display a predetermined image on the display unit (121) (2102). At this time, a part of the central portion of the image may not be visible to the user suffering from the central scotoma symptom (2102).

According to one embodiment, the processor (130) may display a circular icon (2106) on the display unit (121) and receive a user input for adjusting the position and size of the icon (2106). For example, the processor (130) may receive a user input for changing the position of the icon (2106), selecting a shape of the icon (2106) (e.g., circular, oval, square, racket-shaped, etc.), or enlarging or reducing the size of the icon (2106) through a button input of the remote control (200b) (2103).

The processor (130) may receive user input (2104) to adjust the position, size, and shape of the icon (2107) until the entire central scotoma area of the user is covered. For example, the processor (130) may receive user input to enlarge the size of the icon (2107) to a degree that covers the entire central scotoma area visible to the user.

According to one embodiment, the processor (130) may determine a central dark spot area of the user through user input and determine image transformation information based on the determined central dark spot area.

Referring to FIG. 22, the processor (130) of the display device (100) can receive a user input for selecting a location to display by moving an image corresponding to the central dark spot area.

According to one embodiment, the processor (130) may display a predetermined image on the display unit (121) (2201). At this time, a central portion (2205) of the image may not be visible to a user with central scotoma symptoms (2201).

According to one embodiment, the processor (130) may display an icon (2206) on the display unit (121) and receive a user input for adjusting the position and size of the circular icon (2206) (2202).

For example, the processor (130) may receive a user input for changing the position of the icon (2206) through a button input of a keyboard (200a) or a remote control (200b). Based on the user input for adjusting the position and size of the icon (2206), the processor (130) may determine a position to display the image corresponding to the user's dark spot area by moving it.

Additionally, the processor (130) can change the location at which the image corresponding to the user's dark spot area is displayed according to user input for moving the icon (2207) up, down, left, and right (2203).

Figure 23 illustrates an example of obtaining visual characteristic information regarding tunnel vision symptoms.

As illustrated in FIG. 23, the processor (130) can display the type of visual impairment on the display unit (121) and receive a user input for selecting tunnel vision (2301). Furthermore, the processor (130) can display a predetermined image on the display unit (121) (2302). At this time, a user with tunnel vision symptoms may not be able to see some of the outer edges of the image (2302).

According to one embodiment, the processor (130) may display a circular icon (2305) on the display unit (121) and receive user input for adjusting the position and size of the icon (2305). For example, the processor (130) may enlarge or reduce the size of the circular icon (2305) through a button input of a keyboard (200a) or a remote control (200b) (2302).

The processor (130) may receive user input to adjust the position, size, and shape of the icon (2306) until it approaches the boundary of an area that is not visible due to the user's tunnel vision (2303).

According to one embodiment, the processor (130) may determine a user's tunnel vision area through user input. Based on the determined tunnel vision area, the processor (130) may determine image transformation information for displaying a reduced version of the entire image within the tunnel vision area.

Meanwhile, in step S1704, the display device (100) according to one embodiment can store the determined image conversion information corresponding to the user identification information.

In one embodiment, user identification information may be information that can distinguish multiple users. For example, user identification information may be determined as numbers, letters, symbols, specific key input signals, etc., but is not limited thereto.

According to one embodiment, the display device (100) may store image conversion information corresponding to each of a plurality of user identification pieces in the memory (170).

According to one embodiment, the processor (130) of the display device (100) can extract image conversion information corresponding to user identification information from among a plurality of image conversion information stored in the memory (170).

For example, the processor (130) may extract image conversion information corresponding to the user identification information based on an input set corresponding to the user identification information (e.g., a user input using a specific button of the display device (100) or the control device (200), and display an image converted based on the extracted image conversion information.

Additionally, according to one embodiment, the processor (130) may store user visual characteristic information corresponding to user identification information in the memory (170). According to one embodiment, the processor (130) may store a plurality of pieces of visual characteristic information corresponding to each of a plurality of pieces of user identification information in the memory (170).

Additionally, the processor (130) according to one embodiment can convert an input image by using at least one of visual characteristic information and image conversion information corresponding to user identification information stored in the memory (170).

Meanwhile, although examples of a user interface being displayed on the display unit (121) are shown in FIGS. 18 to 23, the present invention is not limited thereto. For example, the display device (100) may output a guide message through the audio output unit (122) so that the user can input visual characteristic information, and may also receive the user's visual characteristic information through the control device (200) (e.g., a keyboard (200a), a remote control (200b)).

Figures 18 to 23 illustrate one embodiment, but are not limited thereto.

FIG. 24 is a flowchart illustrating a method for determining image transformation information according to another embodiment.

In step S2401, the display device (100) according to one embodiment can display an image converted based on image conversion information set corresponding to the acquired visual characteristic information on the display unit (121).

According to one embodiment, the processor (130) of the display device (100) may determine image conversion information set as default in response to visual characteristic information. According to one embodiment, the memory (170) of the display device (100) may pre-store conversion values for converting an image based on the visual characteristic information. Furthermore, according to one embodiment, the display device (100) may receive image conversion information corresponding to the visual characteristic information from an external device (300).

For example, the display device (100) can preset an average conversion value (e.g., an image magnification ratio, an outline contrast adjustment ratio, etc.) for converting an image for low vision.

In step S2402, the display device (100) can change the image conversion information according to the user input and display the converted image based on the changed image conversion information on the display unit (121).

According to one embodiment, the processor (130) may receive a user input for changing the image conversion information. For example, the processor (130) may change the image conversion information based on a user input manipulating a button provided on the display device (100), and may convert the image based on the changed image conversion information. In addition, the processor (130) may change the image conversion information based on a control signal via the remote control (200b), but is not limited thereto.

A display device (100) according to one embodiment can display a converted image on a display unit (121) based on changed image conversion information.

In step S2403, the display device (100) according to one embodiment may determine image conversion information corresponding to the selected image based on a user input for selecting a displayed image.

According to one embodiment, the processor (130) of the display device (100) may provide a converted image to the display unit (121) in response to a user input, and receive an input for selecting a converted image that is clearly visible to the user. For example, the processor (130) may receive a user input for selecting a converted image using a button provided on the control device (200) or the display device (100).

According to one embodiment, the processor (130) can determine image transformation information corresponding to a transformation image selected by user input.

In step S2404, the display device (100) according to one embodiment may store the determined image conversion information corresponding to the user identification information.

According to one embodiment, the processor (130) may store image conversion information corresponding to the selected converted image in the memory (170) corresponding to user identification information.

Additionally, according to one embodiment, the processor (130) may store a plurality of pieces of image conversion information corresponding to each piece of user identification information. According to one embodiment, the processor (130) may call the image conversion information stored in the memory (170) based on the user identification information.

FIG. 25 is a diagram for explaining an example of determining image conversion information according to another embodiment.

According to one embodiment, the display device (100) may provide a converted image in advance to the display unit (121) and allow the user to select an optimal image.

Referring to FIG. 25, a processor (130) of a display device (100) according to one embodiment may change image conversion information based on a user input, convert an image based on the changed image conversion information, and sequentially display the converted images (2501, 2502, 2503).

According to one embodiment, the processor (130) may store image conversion information corresponding to an image selected by the user from among a plurality of converted images (2501, 2502, 2503) in correspondence with user identification information. For example, the user may check an image converted based on the changed image conversion information through the display unit (121) by using a button provided on the control device (200) or the display device (100). The processor (130) of the display device (100) may store image conversion information corresponding to a converted image selected according to a user input.

Figure 25 illustrates one embodiment, but is not limited thereto.

Figures 26 and 27 are block diagrams of a display device related to one embodiment.

As illustrated in FIG. 26, a display device (100) according to some embodiments may include a control unit (130) and a display unit (121). However, not all components illustrated in FIG. 26 are essential components of the display device (100). The display device (100) may be implemented with more components than the components illustrated in FIG. 26, or may be implemented with fewer components than the components illustrated in FIG. 26.

For example, as illustrated in FIG. 27, a display device (100) according to some embodiments may further include a user input unit (110), an output unit (120), a sensing unit (140), a communication unit (150), an A/V input unit (160), and a memory (170) in addition to a control unit (130) and a display unit (121).

The user input unit (110) refers to a means for a user to input data for controlling the display device (100). For example, the user input unit (110) may include, but is not limited to, a key pad, a dome switch, a touch pad (contact electrostatic capacitance type, pressure resistive film type, infrared detection type, surface ultrasonic conduction type, integral tension measurement type, piezo effect type, etc.), a jog wheel, a jog switch, etc.

According to one embodiment, the user input unit (110) may receive user input for setting visual characteristic information and image conversion information. In addition, the user input unit (110) may receive user input for selecting a converted image to determine image conversion information.

The output unit (120) can output an audio signal, a video signal, or a vibration signal, and the output unit (120) can include a display unit (121), an audio output unit (122), and a vibration motor (123).

The display unit (121) displays and outputs information processed in the display device (100). For example, the display unit (121) can display a user interface for receiving user visual characteristic information, a user interface for setting image conversion information, and an image converted based on the image conversion information.

Meanwhile, when the display unit (121) and the touchpad form a layer structure to form a touch screen, the display unit (121) can be used as an input device in addition to an output device. The display unit (121) can include at least one of a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a 3D display, and an electrophoretic display. In addition, depending on the implementation form of the display device (100), the display device (100) may include two or more display units (121). In this case, the two or more display units (121) can be arranged to face each other using a hinge.

The audio output unit (122) outputs audio data received from the communication unit (150) or stored in the memory (170). In addition, the audio output unit (122) outputs audio signals related to functions performed in the display device (100) (e.g., call signal reception sound, message reception sound, notification sound). The audio output unit (122) may include a speaker, a buzzer, or the like.

According to one embodiment, the audio output unit (122) may output guide information for receiving visual characteristic information and image conversion information. In addition, the audio output unit (122) may output audio data included in image content when the display device (100) plays the image content.

The vibration motor (123) can output a vibration signal. For example, the vibration motor (123) can output a vibration signal corresponding to the output of audio data or video data (e.g., a call signal reception sound, a message reception sound, etc.). In addition, the vibration motor (123) can also output a vibration signal when a touch is input to the touch screen.

The processor (130) typically controls the overall operation of the device (100). For example, the processor (130) can control the user input unit (110), output unit (120), sensing unit (140), communication unit (150), A/V input unit (160), etc., by executing programs stored in the memory (170). In addition, the processor (130) can perform the functions of the device (100) described in FIGS. 1 to 25 by executing programs stored in the memory (170).

The processor (130) may include a graphic processor (Graphic Processing Unit, not shown) for processing graphics corresponding to video. The processor may be implemented as a SoC (System On Chip) integrating a core (not shown) and a GPU (not shown). The processor may include single cores, dual cores, triple cores, quad cores, and multiples thereof.

Additionally, the processor may include multiple processors. For example, the processor may be implemented with a main processor (not shown) and a subprocessor (not shown) that operates in a sleep mode.

The graphic processing unit (not shown) uses the calculation unit (not shown) and the rendering unit (not shown) to generate a screen including various objects such as icons, images, and text. The calculation unit uses the user input input through the user input unit (110) to calculate the attribute values such as the coordinate values, shape, size, and color to be displayed for each object according to the layout of the screen. The rendering unit generates a screen with various layouts including objects based on the attribute values calculated by the calculation unit. The screen generated by the rendering unit is displayed within the display area of the display unit (121).

A processor (130) according to one embodiment can acquire an image. The processor (130) can acquire at least one of an image captured by a camera (161), an image received from an external device via a communication unit (150), and an image stored in a memory (170).

Additionally, the processor (130) according to one embodiment can determine image conversion information for converting the acquired image based on the user's visual characteristic information including the type of visual impairment.

A processor (130) according to one embodiment provides a user interface for obtaining visual characteristic information including at least one of a type of visual impairment of a user and a degree of visual impairment according to the type of visual impairment, obtains visual characteristic information through the user interface, and determines image conversion information based on the obtained visual characteristic information.

According to one embodiment, the processor (130) can control to store image conversion information corresponding to user identification information in the memory (170).

According to one embodiment, a processor (130) may determine image transformation information based on an object included in an acquired image. According to one embodiment, the object may include at least one of text, a person, a landscape, and a screen of another display device.

According to one embodiment, a processor (130) can change image conversion information according to a user input and convert an image based on the changed image conversion information. The processor (130) can display the converted image on the display unit (121) and determine image conversion information corresponding to the selected image based on a user input for selecting the displayed image.

According to one embodiment, the processor (130) may control to store image conversion information in the memory (170) corresponding to user identification information. According to one embodiment, the image conversion information may include a conversion value related to at least one of changing the display position of an object included in an image, enlarging or reducing the object, changing the color or saturation of the object, and changing the contrast of the outline of the object.

A processor (130) according to one embodiment can convert an acquired image based on determined image conversion information and display the converted image on a display unit (121).

The sensing unit (140) can detect the status of the display device (100) or the status around the display device (100) and transmit the detected information to the control unit (130).

The sensing unit (140) may include at least one of a magnetic sensor (141), an acceleration sensor (142), a temperature/humidity sensor (143), an infrared sensor (144), a gyroscope sensor (145), a position sensor (e.g., GPS) (146), a pressure sensor (147), a proximity sensor (148), and an RGB sensor (illuminance sensor) (149), but is not limited thereto. Since the function of each sensor can be intuitively inferred from its name by those skilled in the art, a detailed description thereof will be omitted.

The communication unit (150) may include one or more components that enable communication between the display device (100) and the control device (200) or between the display device (100) and an external device (e.g., a server) (300). For example, the communication unit (150) may include a short-range communication unit (151), a mobile communication unit (152), and a broadcast receiving unit (153).

The short-range wireless communication unit (151) may include, but is not limited to, a Bluetooth communication unit, a BLE (Bluetooth Low Energy) communication unit, a near field communication unit, a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, an infrared (IrDA, infrared Data Association) communication unit, a WFD (Wi-Fi Direct) communication unit, a UWB (ultra wideband) communication unit, an Ant+ communication unit, etc.

The mobile communication unit (152) transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signals may include various types of data, such as voice call signals, video call signals, or text/multimedia message transmission and reception.

The broadcast receiver (153) receives broadcast signals and/or broadcast-related information from an external source via a broadcast channel. The broadcast channel may include a satellite channel or a terrestrial channel. Depending on the implementation example, the display device (100) may not include the broadcast receiver (153).

Additionally, according to one embodiment, the communication unit (150) may transmit and receive information necessary to convert an image based on the user's visual characteristic information and provide it to the display unit (121) with the control device (200) and the server (300).

The A/V (Audio/Video) input unit (160) is for inputting audio signals or video signals, and may include a camera (161) and a microphone (162), etc. The camera (161) can obtain image frames, such as still images or moving images, through an image sensor in video call mode or shooting mode. Images captured through the image sensor can be processed through a control unit (130) or a separate image processing unit (not shown).

The image frame processed by the camera (161) can be stored in the memory (170) or transmitted externally through the communication unit (150). Two or more cameras (161) may be provided depending on the configuration of the terminal.

The microphone (162) receives external acoustic signals and processes them into electrical voice data. For example, the microphone (162) can receive acoustic signals from an external device or a speaker. The microphone (162) can utilize various noise removal algorithms to remove noise generated during the process of receiving external acoustic signals.

The memory (170) can store a program for processing and controlling the control unit (130), and can also store data input to or output from the display device (100).

The memory (170) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

Programs stored in memory (170) can be classified into multiple modules according to their functions, for example, a UI module (171), a touch screen module (172), a notification module (173), etc.

The UI module (171) can provide specialized UI, GUI, etc. that are linked to the display device (100) for each application. The touch screen module (172) can detect a user's touch gesture on the touch screen and transmit information about the touch gesture to the control unit (130). The touch screen module (172) according to some embodiments can recognize and analyze a touch code. The touch screen module (172) can also be configured as separate hardware including a controller.

To detect touch or proximity touch on a touchscreen, various sensors may be installed inside or near the touchscreen. One example of a sensor for detecting touch on a touchscreen is a tactile sensor. A tactile sensor is a sensor that detects the contact of a specific object at or beyond the level of human touch. A tactile sensor can detect various information, such as the roughness of the contact surface, the hardness of the contact object, and the temperature of the contact point.

Additionally, there is a proximity sensor as an example of a sensor for detecting touch on a touchscreen.

A proximity sensor is a sensor that detects the presence or absence of an object approaching a predetermined detection surface or existing nearby without mechanical contact using the force of an electromagnetic field or infrared rays. Examples of proximity sensors include a transmissive photoelectric sensor, a direct reflection photoelectric sensor, a retroreflective photoelectric sensor, a high-frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. User touch gestures may include tap, touch and hold, double tap, drag, pan, flick, drag and drop, and swipe.

The notification module (173) can generate a signal to notify the occurrence of an event in the display device (100). Examples of events occurring in the display device (100) include reception of a call signal, reception of a message, input of a key signal, and schedule notification. The notification module (173) can output a notification signal in the form of a video signal through the display unit (121), output a notification signal in the form of an audio signal through the sound output unit (122), or output a notification signal in the form of a vibration signal through the vibration motor (123).

Fig. 28 is a block diagram of a control device related to one embodiment.

Referring to FIG. 28, the control device (200) may include a wireless communication unit (220), a user input unit (230), a sensor unit (240), an output unit (250), a power supply unit (260), a storage unit (270), and a control unit (280).

The wireless communication unit (220) can transmit and receive signals with any one of the image display devices or peripheral devices according to the embodiments described above. The wireless communication unit (220) can be equipped with an IR module capable of transmitting and receiving signals with the image display device (100) or peripheral device (300) according to the IR communication standard. For example, the control device (200) can transmit commands for power on/off, channel change, volume change, etc. to the image display device (100) or peripheral device (300) through the IR module as needed.

Alternatively, the wireless communication unit (220) can transmit and receive signals with the video display device (100) or peripheral device (300) in a wireless LAN (e.g., Wi-Fi), Bluetooth, BLE (Bluetooth low energy), ultrasound, Zigbee, etc.

The user input unit (230) may be configured as a keypad, a button, a touch pad, or a touch screen. The user can input a command related to the video display device (100) or the peripheral device (300) to the control device (200) by operating the user input unit (230). If the user input unit (230) has a hard key button, the user can input a command related to the display device (100) or the external device (300) to the control device (200) by pushing the hard key button. If the user input unit (230) has a touch screen, the user can input a command related to the display device (100) or the external device (300) to the control device (200) by touching a soft key of the touch screen.

The sensor unit (240) may include a gyro sensor (241) or an acceleration sensor (243). The gyro sensor (241) may sense information regarding the movement of the control device (200). For example, the gyro sensor (241) may sense information regarding the operation of the control device (200) based on the x, y, and z axes. The acceleration sensor (243) may sense information regarding the movement speed of the control device (200). Meanwhile, a distance measurement sensor may be further included, thereby sensing the distance to the display device (100).

The output unit (250) can output a video or audio signal corresponding to the operation of the user input unit (230) or to a signal received from the display device (100) or an external device (300). Through the output unit (250), the user can recognize whether the user input unit (230) is being operated or whether the display device (100) or an external device (300) is being controlled.

For example, the output unit (250) may include an LED module that lights up when the user input unit (230) is operated or a signal is transmitted and received with the display device (100) or an external device (300) through the wireless communication unit (220), a vibration module that generates vibration, an audio output module that outputs sound, or a display module that outputs an image.

The power supply unit (260) supplies power to the control device (200). The power supply unit (260) can reduce power waste by stopping the power supply when the control device (200) is not moved for a predetermined period of time. The power supply unit (260) can resume the power supply when a predetermined key provided in the control device (200) is operated.

The storage unit (270) can store various types of programs, application data, etc. required for the control or operation of the control device (200).

The control unit (280) controls all matters related to the control of the control device (200). The control unit (280) can transmit a signal corresponding to a predetermined key operation of the user input unit (230) or a signal corresponding to the movement of the control device (200) sensed by the sensor unit (240) to the display device (100) or the external device (300) via the wireless communication unit (220).

According to one embodiment, the control unit (280) may transmit a user input signal for inputting at least one of user visual characteristic information and image conversion information to the display device (100). In addition, the control unit (280) may transmit a user input signal for changing the image conversion information to the display device (100). In addition, the control unit (280) may transmit a user input signal for selecting a conversion image to the display device (100).

Meanwhile, the above-described embodiments can be implemented in a general-purpose digital computer that can be written as a program that can be executed on a computer and that executes the program using a computer-readable medium. In addition, the data structure used in the above-described embodiments can be recorded on a computer-readable medium through various means. In addition, the above-described embodiments can be implemented in the form of a recording medium that includes computer-executable instructions, such as program modules that are executed by a computer. For example, methods implemented as software modules or algorithms can be stored on a computer-readable recording medium as codes or program instructions that a computer can read and execute.

A computer-readable medium may be any recording medium that can be accessed by a computer, and may include volatile and nonvolatile media, removable and non-removable media. A computer-readable medium may include, but is not limited to, magnetic storage media, such as ROM, floppy disks, hard disks, etc., and optical storage media, such as CD-ROMs, DVDs, etc. In addition, a computer-readable medium may include a computer storage medium and a communication medium.

Additionally, a plurality of computer-readable recording media may be distributed across network-connected computer systems, and data stored on the distributed recording media, such as program instructions and code, may be executed by at least one computer.

The specific implementations described in this disclosure are merely exemplary and do not limit the scope of the present disclosure in any way. For the sake of brevity, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted.

The above description of the present disclosure is provided for illustrative purposes only, and those skilled in the art will readily appreciate that modifications to other specific forms can be made without altering the technical spirit or essential features of the present disclosure. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, components described as being single may be implemented in a distributed manner, and similarly, components described as being distributed may be implemented in a combined manner.

Any use of examples or exemplary terms, such as “etc.”, in this disclosure is merely intended to illustrate the disclosure in more detail and is not intended to limit the scope of the disclosure by virtue of such examples or exemplary terms, unless otherwise limited by the claims.

Additionally, unless specifically stated as “essential,” “important,” etc., components described in this disclosure may not be components absolutely necessary for the implementation of this disclosure.

A person skilled in the art will understand that the embodiments of the present disclosure may be implemented in modified forms without departing from the essential characteristics of the above description.

The present disclosure may be modified and have numerous embodiments. Therefore, the present disclosure is not limited to the specific embodiments described in the specification, and it should be understood that all modifications, equivalents, and alternatives falling within the spirit and technical scope of the present disclosure are encompassed by the present disclosure. Therefore, the disclosed embodiments should be understood in an illustrative rather than a restrictive sense.

The scope of the present disclosure is indicated by the claims rather than the detailed description of the invention, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present disclosure.

The terms “unit”, “module”, etc. described in this specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software.

The "sub-module" may be stored in an addressable storage medium and implemented by a program executable by a processor.

For example, a “unit”, a “module” may be implemented by components such as software components, object-oriented software components, class components, and task components, and by processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables.

In this specification, the description "A can include one of a1, a2 and a3" is a broad one that exemplary elements that can be included in the element called A are a1, a2 or a3.

The above description does not necessarily mean that the elements that can constitute element A are limited to a1, a2, or a3. Therefore, it should be noted that the elements that can constitute A are not interpreted exclusively, meaning that they exclude other elements not exemplified other than a1, a2, and a3.

Additionally, the description above means that A can include a1, include a2, or include a3. The description does not necessarily mean that the elements constituting A are selectively determined within a given set. For example, it should be noted that the description is not limited to meaning that a1, a2, or a3 selected from the set including a1, a2, and a3 constitute component A.

100: Display device
130: Control unit
121: Display section

Claims (20)

In the HMD (head-mounted display) device (100),
Filming Department (161);
Communication Department (150);
Display section (121);
A memory (170) storing one or more instructions; and
comprising at least one processor (130),
The above at least one processor (130) executes the one or more instructions,
Obtain a shooting image using the above shooting unit (161),
Through the above communication unit (150), the above-mentioned captured image is transmitted to an external device (300),
Through the communication unit (150), from the external device (300), a converted image is obtained in which the display position of a portion of the captured image is converted based on visual characteristic information,
An HMD device that displays the above-mentioned converted image on the display unit (121). In the first paragraph,
The dark spot area is determined based on the above visual characteristics,
The above-mentioned part includes the above-mentioned dark spot area,
The above-mentioned converted image is an HMD device in which an image of the dark spot area of the above-mentioned captured image is displayed in another area outside the dark spot area. In the first paragraph,
An HMD device in which the above-mentioned captured image is converted based on a conversion area determined based on user input. In the third paragraph,
An HMD device, wherein the above transformation area includes at least one of the position, size, or shape of the area for transforming the captured image. In the first paragraph,
The above communication unit (150) is an HMD device including an interface for wired communication or an interface for wireless communication. In the first paragraph,
An HMD device, wherein the above visual characteristic information includes information about the user's visual impairment. In the first paragraph,
An HMD device, wherein the above visual characteristic information includes at least one of the type of the user's visual impairment and the degree of the visual impairment according to the type of the visual impairment. In the first paragraph,
The above memory is,
An HMD device that stores the visual characteristic information corresponding to user identification information. In the first paragraph,
An HMD device, wherein the above-mentioned transformed image includes at least one of changing the display position of an object included in the captured image, enlarging or reducing the object, changing the color or saturation of the object, and changing the contrast of the outline of the object. In the first paragraph,
The above at least one processor (130) executes the one or more instructions,
An HMD device that transmits the visual characteristic information to the external device through the communication unit (150). In the method of converting the video,
A step of obtaining a captured image from an HMD (head-mounted display) device;
A step of generating a transformed image by transforming the display position of a portion of the captured image based on visual characteristic information; and
A method comprising: a step of transmitting the converted image to the HMD device; In the 11th paragraph, the step of converting the captured image is:
A step of determining a dark spot area of the captured image based on the above visual characteristics;
A step of displaying an image of a dark spot area of the above-mentioned captured image in another area outside the dark spot area;
A method wherein the above-mentioned partial area includes the above-mentioned dark spot area. In Article 11,
A method in which the above-mentioned captured image is transformed based on a transformation area determined based on user input. In the 13th paragraph,
A method wherein the above transformation area includes at least one of the position, size, or shape of the area for transforming the photographed image. In the 13th paragraph,
A method wherein the user input is at least one of a touch input or a voice input. In Article 11,
A method wherein the above visual characteristic information includes at least one of the type of the user's visual impairment and the degree of the visual impairment according to the type of the visual impairment. In the 11th paragraph, the method,
A method further comprising: storing the visual characteristic information corresponding to user identification information. In Article 11,
The steps for converting the above-mentioned captured video are:
A method comprising: a step of changing at least one of changing the display position of an object included in the above-described captured image, enlarging or reducing the object, changing the color or saturation of the object, and changing the contrast of the outline of the object. In the 11th paragraph, the method,
A method further comprising: receiving the visual characteristic information from the HMD device. A computer-readable recording medium having recorded thereon a program for executing the method of any one of claims 11 to 19 on a computer.