KR101679570B1 - Image display apparatus and method for operating the same - Google Patents

Abstract

The present invention relates to an image display apparatus and an operation method thereof. According to an embodiment of the present invention, there is provided a method of operating an image display device, including: receiving a 3D image; detecting a depth of the 3D image; detecting a depth of the 3D image; And controlling the sound phase localization. Thus, the user can output an audio signal corresponding to the depth of 3D image display.

Description

[0001] The present invention relates to an image display apparatus and a method of operating the same,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display apparatus, and more particularly, to an image display apparatus or an image display method capable of outputting an audio signal corresponding to a depth of a 3D image display.

A video display device is a device having a function of displaying an image that a user can view. The user can view the broadcast through the video display device. A video display device displays a broadcast selected by a user among broadcast signals transmitted from a broadcast station on a display. Currently, broadcasting is changing from analog broadcasting to digital broadcasting around the world.

Digital broadcasting refers to broadcasting in which digital video and audio signals are transmitted. Compared to analog broadcasting, digital broadcasting is strong against external noise and has a small data loss, is advantageous for error correction, has a high resolution, and provides a clear screen. Also, unlike analog broadcasting, digital broadcasting is capable of bidirectional service.

In addition, various studies on stereoscopic images have been conducted recently, and stereoscopic image technology has become more common and practical in various other environments and technologies as well as computer graphics.

An object of the present invention is to provide an image display apparatus and an operation method thereof capable of outputting an audio signal corresponding to a depth of a 3D image display.

According to another aspect of the present invention, there is provided a method of operating an image display device, the method including receiving a 3D image, detecting a depth of the 3D image, And controlling the sound image localization of the input audio signal.

According to another aspect of the present invention, there is provided a method of operating a video display device including receiving a 3D image, detecting a depth of the 3D image, Performing phase control of the audio signal, adjusting the phase of the audio signal, or adjusting the gain of the audio signal.

According to another aspect of the present invention, there is provided an image display apparatus including: a display for displaying an image; an audio output unit for outputting an audio signal; And a control unit for controlling the sound phase position of the synchronized input audio signal and outputting the audio signal phase-shifted.

According to the embodiment of the present invention, stereoscopic sound can be outputted by adjusting the image position, phase adjustment or gain of the audio signal corresponding to the depth in 3D image display. This increases the usability of the user.

In addition, when there are a plurality of objects in the 3D image, the 3D signal processing of the audio signal using the average of the depths can provide realistic stereo sound.

In addition, when a plurality of objects in the 3D image are processed, 3D signals are processed for the audio signals corresponding to the individual depths, thereby realizing realistic stereo sound.

1 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.
2 is an internal block diagram of the control unit of FIG.
3 is an internal block diagram of the video decoder of FIG.
4 is an internal block diagram of the audio processing unit of FIG.
5 is a view showing various formats of a 3D image.
6 is a diagram showing the operation of an additional display of glasses type according to the format of FIG.
Fig. 7 is a view for explaining how images are formed by the left eye image and the right eye image.
8 is a view for explaining the depth of the 3D image according to the interval between the left eye image and the right eye image.
9 is a flowchart illustrating an operation method of an image display apparatus according to an embodiment of the present invention.
Figs. 10 to 14 are drawings referred to explain various examples of the operation method of the video display device of Fig.

Hereinafter, the present invention will be described in detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

1 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.

1, an image display apparatus 100 according to an exemplary embodiment of the present invention includes a tuner 110, a demodulator 120, an external device interface 130, a network interface 135, A user input interface unit 150, a control unit 170, a display 180, an audio output unit 185, and a 3D viewing device 195. [

The tuner 110 selects a channel selected by the user or an RF broadcast signal corresponding to all previously stored channels among RF (Radio Frequency) broadcast signals received through the antenna. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the tuner 110 can process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner 110 can be directly input to the controller 170.

Also, the tuner 110 can receive RF carrier signals of a single carrier according to an Advanced Television System Committee (ATSC) scheme or RF carriers of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

In the present invention, the tuner 110 sequentially selects RF broadcast signals of all broadcast channels stored through a channel memory function among RF broadcast signals received through an antenna, and outputs the selected RF broadcast signals as an intermediate frequency signal, a baseband image, or a voice signal Can be converted.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

For example, when the digital IF signal output from the tuner 110 is the ATSC scheme, the demodulator 120 performs 8-VSB (7-Vestigal Side Band) demodulation. Also, the demodulation unit 120 may perform channel decoding. To this end, the demodulator 120 includes a trellis decoder, a de-interleaver, and a reed solomon decoder to perform trellis decoding, deinterleaving, Solomon decoding can be performed.

For example, when the digital IF signal output from the tuner 110 is a DVB scheme, the demodulator 120 performs COFDMA (Coded Orthogonal Frequency Division Modulation) demodulation. Also, the demodulation unit 120 may perform channel decoding. For this, the demodulator 120 may include a convolution decoder, a deinterleaver, and a reed-solomon decoder to perform convolutional decoding, deinterleaving, and reed solomon decoding.

The demodulation unit 120 may perform demodulation and channel decoding, and then output a stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 TS (Transport Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

Meanwhile, the demodulating unit 120 may be separately provided according to the ATSC scheme and the DVB scheme. That is, it can be provided as an ATSC demodulation unit and a DVB demodulation unit.

The stream signal output from the demodulation unit 120 may be input to the controller 170. The control unit 170 performs demultiplexing, video / audio signal processing, and the like, and then outputs an image to the display 180 and outputs audio to the audio output unit 185.

The external device interface unit 130 can transmit or receive data with the connected external device 190. [ To this end, the external device interface unit 130 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 130 can be connected to an external device 190 such as a digital versatile disk (DVD), a Blu ray, a game device, a camera, a camcorder, a computer . The external device interface unit 130 transmits external video, audio or data signals to the controller 170 of the video display device 100 through the connected external device 190. Also, the control unit 170 can output the processed video, audio, or data signal to the connected external device. To this end, the external device interface unit 130 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The A / V input / output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), a DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, and the like.

The wireless communication unit can perform short-range wireless communication with other electronic devices. The image display apparatus 100 is capable of performing communication such as Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, DLNA (Digital Living Network Alliance) Depending on the standard, it can be networked with other electronic devices.

Also, the external device interface unit 130 may be connected to various set-top boxes via at least one of the various terminals described above to perform input / output operations with the set-top box.

On the other hand, the external device interface unit 130 can transmit and receive data to and from the 3D viewing device 195.

The network interface unit 135 provides an interface for connecting the video display device 100 to a wired / wireless network including the Internet network. The network interface unit 135 may include an Ethernet terminal and the like for connection with a wired network and may be a WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless) broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed Downlink Packet Access) communication standards.

The network interface unit 135 can receive, via the network, contents or data provided by the Internet or a content provider or a network operator. That is, it can receive contents and related information such as movies, advertisements, games, VOD, broadcasting signals, etc., provided from the Internet, a content provider, and the like through a network. In addition, the update information and the update file of the firmware provided by the network operator can be received. It may also transmit data to the Internet or a content provider or network operator.

The network interface unit 135 is connected to, for example, an IP (Internet Protocol) TV and receives the processed video, audio or data signals from the settop box for IPTV to enable bidirectional communication, And can transmit the signals processed by the controller 170 to the IPTV set-top box.

Meanwhile, the IPTV may include ADSL-TV, VDSL-TV, FTTH-TV and the like depending on the type of the transmission network. The IPTV may include a TV over DSL, a video over DSL, a TV over IP BTV), and the like. In addition, IPTV may also mean an Internet TV capable of accessing the Internet, or a full browsing TV.

The storage unit 140 may store a program for each signal processing and control in the control unit 170 or may store the processed video, audio, or data signals.

In addition, the storage unit 140 may perform a function for temporarily storing video, audio, or data signals input to the external device interface unit 130. [ In addition, the storage unit 140 may store information on a predetermined broadcast channel through a channel memory function such as a channel map.

The storage unit 140 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) RAM, ROM (EEPROM, etc.), and the like. The image display apparatus 100 can reproduce files (moving picture files, still picture files, music files, document files, etc.) stored in the storage unit 140 and provide them to users.

1 shows an embodiment in which the storage unit 140 is provided separately from the control unit 170, the scope of the present invention is not limited thereto. The storage unit 140 may be included in the controller 170.

The user input interface unit 150 transmits a signal input by the user to the control unit 170 or a signal from the control unit 170 to the user.

For example, the user input interface unit 150 may be configured to turn on / off the power, select the channel, and display the screen from the remote control device 200 according to various communication methods such as a radio frequency (RF) communication method and an infrared Or transmit a signal from the control unit 170 to the remote control device 200. The remote control device 200 may be connected to the remote control device 200 via a network.

For example, the user input interface unit 150 may transmit a user input signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the controller 170.

For example, the user input interface unit 150 may transmit a user input signal input from a sensing unit (not shown) that senses the gesture of the user to the control unit 170 or a signal from the control unit 170 (Not shown). Here, the sensing unit (not shown) may include a touch sensor, an audio sensor, a position sensor, an operation sensor, and the like.

The control unit 170 demultiplexes the input stream or processes the demultiplexed signals through the tuner 110 or the demodulation unit 120 or the external device interface unit 130 to generate a signal for video or audio output Can be generated and output.

The video signal processed by the controller 170 may be input to the display 180 and displayed as an image corresponding to the video signal. Also, the image signal processed by the controller 170 may be input to the external output device through the external device interface unit 130.

The audio signal processed by the control unit 170 may be output to the audio output unit 185 as an audio signal. The audio signal processed by the controller 170 may be input to the external output device through the external device interface unit 130. [

Although not shown in FIG. 1, the controller 170 may include a demultiplexer, an image processor, and the like. This will be described later with reference to FIG.

In addition, the control unit 170 can control the overall operation in the video display device 100. [ For example, the controller 170 controls the tuner 110 to control the tuner 110 to select an RF broadcast corresponding to a channel selected by the user or a previously stored channel.

In addition, the controller 170 may control the image display apparatus 100 according to a user command or an internal program input through the user input interface unit 150.

For example, the controller 170 controls the tuner 110 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface unit 150. Then, video, audio, or data signals of the selected channel are processed. The control unit 170 may output the video or audio signal processed by the user through the display 180 or the audio output unit 185 together with the channel information selected by the user.

The control unit 170 controls the operation of the external device 190 through the external device interface unit 130 according to an external device video reproducing command received through the user input interface unit 150. For example, Or the video signal or audio signal from the camcorder can be output through the display 180 or the audio output unit 185. [

Meanwhile, the control unit 170 may control the display 180 to display an image. For example, the broadcast image input through the tuner 110, the external input image input through the external device interface unit 130, the image input through the network interface unit 135, or the image stored in the storage unit 140 To be displayed on the display 180 can be controlled.

At this time, the image displayed on the display 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

On the other hand, the controller 170 generates a 3D object for a predetermined object among the images displayed on the display 180, and displays the 3D object. For example, the object may be at least one of a connected web screen (newspaper, magazine, etc.), EPG (Electronic Program Guide), various menus, widgets, icons, still images, moving images, and text.

Such a 3D object may be processed to have a different depth than the image displayed on the display 180. [ Preferably, the 3D object may be processed to be projected relative to the image displayed on the display 180.

On the other hand, the control unit 170 recognizes the position of the user based on the image photographed from the photographing unit (not shown). For example, the distance (z-axis coordinate) between the user and the image display apparatus 100 can be grasped. In addition, the x-axis coordinate and the y-axis coordinate in the display 180 corresponding to the user position can be grasped.

Although not shown in the drawing, a channel browsing processing unit for generating a channel signal or a thumbnail image corresponding to an external input signal may be further provided. The channel browsing processing unit receives the stream signal TS output from the demodulation unit 120 or the stream signal output from the external device interface unit 130 and extracts an image from an input stream signal to generate a thumbnail image . The generated thumbnail image may be directly or encoded and input to the controller 170. In addition, the generated thumbnail image may be encoded in a stream format and input to the controller 170. The control unit 170 may display a thumbnail list having a plurality of thumbnail images on the display 180 using the input thumbnail image. At this time, the thumbnail list may be displayed in a simple view mode displayed on a partial area in a state where a predetermined image is displayed on the display 180, or in a full viewing mode displayed in most areas of the display 180. The thumbnail images in the thumbnail list can be sequentially updated.

The display 180 converts a video signal, a data signal, an OSD signal, a control signal processed by the control unit 170, a video signal, a data signal, a control signal, and the like received from the external device interface unit 130, .

The display 180 may be a PDP, an LCD, an OLED, a flexible display, or the like. In particular, according to an embodiment of the present invention, a three-dimensional display (3D display) is preferable.

The display 180 for viewing three-dimensional images can be divided into an additional display method and a single display method.

The single display method can implement a 3D image only on the display 180 without a separate additional display, for example, a glass or the like, and examples thereof include a lenticular method, a parallax barrier, and the like Various methods can be applied.

Meanwhile, the additional display method can implement a 3D image using an additional display in addition to the display 180. For example, various methods such as a head mount display (HMD) type and a glasses type can be applied. In addition, the glasses type can be further divided into a passive type such as a polarizing glasses type and an active type such as a shutter glass type. On the other hand, head-mounted display type can be divided into a passive type and an active type.

In the practice of the present invention, 3D glasses are mainly described by an additional display 195 for 3D viewing. The glass for 3D 195 may include a passive polarizing glass or an active shutter glass, and is described as a concept including the head mount type described above.

Meanwhile, the display 180 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 185 receives a signal processed by the control unit 170, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs it as a voice. The voice output unit 185 may be implemented by various types of speakers.

In order to detect a user's gesture, a sensing unit (not shown) having at least one of a touch sensor, a voice sensor, a position sensor, and an operation sensor may be further provided in the image display apparatus 100 have. A signal sensed by a sensing unit (not shown) is transmitted to the controller 170 through the user input interface unit 150.

The control unit 170 can sense the gesture of the user by combining the images captured from the photographing unit (not shown) or the sensed signals from the sensing unit (not shown), respectively.

The remote control apparatus 200 transmits the user input to the user input interface unit 150. [ To this end, the remote control apparatus 200 can use Bluetooth, RF (radio frequency) communication, infrared (IR) communication, UWB (Ultra Wideband), ZigBee, or the like. Also, the remote control apparatus 200 can receive the video, audio, or data signal output from the user input interface unit 150 and display it or output it by the remote control apparatus 200.

The video display apparatus 100 described above can be applied to a digital broadcasting of ATSC system (7-VSB system), digital broadcasting of DVB-T system (COFDM system), digital broadcasting of ISDB-T system (BST-OFDM system) And a digital broadcasting receiver capable of receiving at least one of the digital broadcasting signals. In addition, as a portable type, digital terrestrial DMB broadcasting, satellite DMB broadcasting, ATSC-M / H broadcasting, DVB-H broadcasting (COFDM broadcasting), MediaFoward Link Only And a digital broadcasting receiver capable of receiving at least one of digital broadcasting and the like. It may also be a digital broadcast receiver for cable, satellite communications, or IPTV.

Meanwhile, the video display device described in the present specification can be applied to a TV set, a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) .

Meanwhile, the block diagram of the image display apparatus 100 shown in FIG. 1 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the image display apparatus 100 actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

2 is an internal block diagram of the controller of FIG. 1, FIG. 3 is an internal block diagram of the video decoder of FIG. 2, FIG. 4 is an internal block diagram of the audio processor of FIG. 2, Fig. 6 is a view showing the operation of an additional display of glasses type according to the format of Fig. 5; Fig.

The control unit 170 includes a demultiplexing unit 210, an image processing unit 220, an OSD generating unit 240, a mixer 245, a frame rate converting unit 260, (250), and a formatter (260). An audio processing unit 230, and a data processing unit (not shown).

The demultiplexer 210 demultiplexes the input stream. For example, when an MPEG-2 TS is input, it can be demultiplexed into video, audio, and data signals, respectively. The stream signal input to the demultiplexer 210 may be a stream signal output from the tuner 110 or the demodulator 120 or the external device interface 130.

The image processing unit 220 may perform image processing of the demultiplexed image signal. To this end, the image processing unit 220 may include an image decoder 225 and a scaler 235.

The video decoder 225 decodes the demultiplexed video signal and the scaler 235 performs scaling so that the resolution of the decoded video signal can be output from the display 180.

The video decoder 225 may include a decoder of various standards. For example, the video decoder 225 may include at least one of an MPEG-2 decoder, an H.264 decoder, an MPEC-C decoder (MPEC-C part 3), an MVC decoder, and an FTV decoder.

FIG. 3 illustrates a 3D video decoder 310 for decoding a 3D video signal in the video decoder 220. FIG.

 The demultiplexed video signal input to the 3D video decoder 310 may be, for example, a video signal encoded with MVC (Multi-view Video Coding), a video signal encoded with dual AVC, And a right eye image signal.

 When the input signal is a signal obtained by mixing the left and right eye image signals encoded as described above, the 2D image decoder can be used as it is. For example, if the demultiplexed video signal is an MPEG-2 standard encoded video signal or an AVC-standard encoded video signal, it can be decoded by an MPEG-2 decoder or an AVC decoder.

Meanwhile, the 3D video decoder 310 may include a Base View Decoder 320 and an Extended View Decoder 330 as an MVC decoder.

For example, when the extended view video signal (Extended View Video) of the encoded 3D video signal input to the 3D video decoder 310 is coded by MVC, in order to decode it, a corresponding base view video signal ). To this end, the basic viewpoint image signal decoded by the basic viewpoint decoder 320 is transmitted to the expansion point decoder 330.

As a result, the decoded 3D video signal output from the 3D video decoder 310 has a delay until the decoding of the expansion-point decoder 330 is completed. As a result, the decoded base-view video signal Base View Video) and a decoded extended view video signal (Extended View Video) are mixed and output.

In addition, for example, when the extended view video signal (Extended View Video) of the encoded 3D video signal input to the 3D video decoder 310 is encoded with AVC, unlike the case of the MVC described above, (Extended View Video) and a base view video signal (Base View Video) can be simultaneously decoded. Accordingly, the basic viewpoint decoder 320 and the expansion point decoder 330 independently perform a decoding operation. Meanwhile, the decoded base view video signal and the decoded extended view video signal are mixed and output.

Alternatively, the 3D image decoder 310 may include a chrominance image decoder and a depth image decoder. That is, when the stereoscopic image is coded by separating the color image and the depth image, the chrominance image decoder decodes the chrominance image, and the depth image decodes the depth image. It is possible. In this case, it is also possible that a color difference image is used as a reference image for depth image decoding.

On the other hand, the image signal decoded by the image processing unit 220 can be divided into a case where there is only a 2D image signal, a case where a 2D image signal and a 3D image signal are mixed, and a case where there is only a 3D image signal.

For example, when a 2D video signal and a 3D video signal are mixed when an external video signal input from the external device 190 or a broadcasting video signal of a broadcasting signal received from the tuner 110 includes only a 2D video signal, And a 3D image signal only. Accordingly, the controller 170, particularly the image processing unit 220, processes the 2D image signal, the mixed signal of the 2D image signal and the 3D image signal, A 3D video signal can be output.

Meanwhile, the image signal decoded by the image processing unit 220 may be a 3D image signal of various formats. For example, a 3D image signal composed of a color image and a depth image, or a 3D image signal composed of a plurality of view image signals. The plurality of viewpoint image signals may include, for example, a left eye image signal and a right eye image signal.

5, the format of the 3D video signal is a side-by-side format (FIG. 5A) in which the left eye image signal L and the right eye image signal R are arranged left and right, A frame sequential format (FIG. 5C) in which time division is arranged (FIG. 5C), an interlaced format in which the left eye image signal and the right eye image signal are mixed line by line 5d), a checker box format (FIG. 5e) in which the left eye image signal and the right eye image signal are mixed box by box, and the like.

The OSD generation unit 240 generates an OSD signal according to a user input or by itself. For example, based on a user input signal, a signal for displaying various information in a graphic or text form on the screen of the display 180 can be generated. The generated OSD signal may include various data such as a user interface screen of the video display device 100, various menu screens, a widget, and an icon. In addition, the generated OSD signal may include a 2D object or a 3D object.

The mixer 245 may mix the OSD signal generated by the OSD generator 240 and the decoded video signal processed by the image processor 220. At this time, the OSD signal and the decoded video signal may include at least one of a 2D signal and a 3D signal. The mixed video signal is supplied to a frame rate converter 250.

A frame rate converter (FRC) 250 converts a frame rate of an input image. For example, a frame rate of 60 Hz is converted to 120 Hz or 240 Hz. When converting the frame rate of 60 Hz to 120 Hz, it is possible to insert the same first frame between the first frame and the second frame, or insert the third frame predicted from the first frame and the second frame. When converting a frame rate of 60 Hz to 240 Hz, it is possible to insert three more identical frames or insert three predicted frames.

On the other hand, the frame rate converter 250 can output the frame rate directly without any frame rate conversion. Preferably, when a 2D video signal is input, the frame rate can be output as it is. On the other hand, when a 3D video signal is input, the frame rate can be varied as described above.

The formatter 260 receives the mixed signal, that is, the OSD signal and the decoded video signal in the mixer 245, and separates the 2D video signal and the 3D video signal.

In the present specification, a 3D video signal means a 3D object. Examples of the 3D object include a picuture in picture (PIP) image (still image or moving picture), an EPG indicating broadcasting program information, Icons, texts, objects in images, people, backgrounds, web screens (newspapers, magazines, etc.).

On the other hand, the formatter 260 can change the format of the 3D video signal. For example, it may be changed to any of the various formats illustrated in FIG. Accordingly, according to the format, the operation of the additional display of the glasses type can be performed as shown in Fig.

6 (a) illustrates the operation of the 3D viewing device 195, particularly the shutter glass 195, when the formatter 260 sorts and outputs the frame sequential format of the format of Fig.

6 (b) is a view showing that the left eye glass of the shutter glass 195 is opened and the right eye glass is closed when the left eye image L is displayed on the display 180, Is closed, and the right eye glass is opened.

6 (b) illustrates the operation of the 3D viewing device 195, particularly the polarizing glass 195, when the formatter 260 sorts and outputs in the side-by-side format of the format of FIG. On the other hand, the 3D viewing apparatus 195 applied in FIG. 6 (b) can be a shutter glass, and the shutter glass at this time can maintain the open state of both the left eye glass and the right eye glass, have.

Meanwhile, the formatter 260 may convert a 2D video signal into a 3D video signal. For example, according to a 3D image generation algorithm, an edge or a selectable object is detected in a 2D image signal, and an object or a selectable object according to the detected edge is separated into a 3D image signal and is generated . At this time, the generated 3D image signal can be separated into the left eye image signal L and the right eye image signal R, as described above.

Meanwhile, the audio processing unit 230 in the control unit 170 can perform the audio processing of the demultiplexed audio signal. 4, the audio processing unit 230 includes an audio decoder 410, an image phase shifting unit 420, a crosstalk reducing unit 430, a subband analyzing unit 440, a phase adjusting unit 450 ), A gain adjusting unit 460, and a subband combining unit 470.

The audio decoder 410 may include various decoders for decoding audio signals encoded in various ways.

For example, if the demultiplexed speech signal is a coded speech signal, it can be decoded. Specifically, when the demultiplexed speech signal is an MPEG-2 standard encoded speech signal, it can be decoded by an MPEG-2 decoder. In addition, if the demultiplexed speech signal is a coded voice signal of the MPEG 4 BSAC (Bit Sliced Arithmetic Coding) standard according to a terrestrial DMB (Digital Multimedia Broadcasting) scheme, it can be decoded by an MPEG 4 decoder. Also, if the demultiplexed speech signal is an encoded audio signal of the AAC (Advanced Audio Codec) standard of MPEG 2 according to the satellite DMB scheme or DVB-H, it can be decoded by the AAC decoder. If the demultiplexed speech signal is a Dolby AC-3 standard encoded audio signal, it can be decoded by an AC-3 decoder.

The sound localization unit 420 controls the sound localization for the input decoded audio signal. Here, the sound image localization means a position of a perceptually sensed sound image. For example, for stereo audio signals of the left and right channels, if the audio signals of the respective channels are the same, the sound localization may be the middle of the left and right speakers.

The method of orienting the sound image is a method of locating a sound source at a specific position (specific direction) in a sound field space based on, for example, a phase difference (time difference) of a sound signal reaching each ear of a listener and a level ratio I can make you feel.

For such sound level control, in the embodiment of the present invention, head-related transfer function filtering can be used for the input decoded audio signal.

The HRTF refers to a transfer function between a sound wave from a sound source having an arbitrary position and a sound wave reaching the eardrum of the ear, By inserting a microphone into the microphone and measuring the impulse response of the audio signal at a particular angle.

Such a head transfer function (HRTF) varies depending on the azimuth and altitude of the sound source. It may also vary depending on physical characteristics such as the listener's head shape, head size or ear shape.

On the other hand, in the embodiment of the present invention, the head transfer function is varied corresponding to the depth of the 3D image. For example, it is assumed that the position of the sound source varies according to the depth of the 3D image, and each of the head transfer functions can be set based on the sound source corresponding to the depth. That is, the coefficient of the head transfer function (HRTF) may vary depending on the depth. Also, the coefficients of the HRTF can be changed by frequency. In particular, the coefficient adjustment of the head transfer function (HRTF) can be performed so that the higher the depth, or the greater the variation in depth, the higher frequency components are removed.

On the other hand, the coefficient information of the HRTF or the HRTF depending on the depth of the 3D image may be stored in the storage unit 140 or the like as previously measured.

As described above, the sound localization method using the head transfer function (HRTF) according to the depth of the 3D image can provide a three-dimensional effect such as spatial feeling and realism.

On the other hand, HRTF filtering can be performed on a mono channel basis. For example, a mono channel audio signal may be convoluted with an impulse response to a first head transfer function and an impulse response to a second head transfer function, respectively, to generate a left audio signal and a right audio signal. As a result, sound image localization can be performed.

On the other hand, when a multi-channel audio signal is input, HRTF filtering is performed for each channel, and a left audio signal and a right audio signal are generated, respectively, and finally, they are summed and output.

The cross-talk canceler 430 performs signal processing for reducing the crosstalk of the audio signal subjected to the image-localization control. That is, an additional audio signal for erasing the sound can be emitted in order to prevent a sound emitted from reaching the left ear and arriving at the right ear, thereby making it impossible to recognize the direction of the virtual sound source (crosstalk phenomenon) .

For example, the crosstalk canceling unit 430 may add a plurality of reverberation components having a delay time to the difference signal between the audio signal of the right channel and the audio signal of the left channel.

Accordingly, the left audio signal and the right audio signal that have passed through the crosstalk reducing unit 430 are heard only by the corresponding ears (left ear, right ear) of the listener.

On the other hand, the signal processing for crosstalk reduction is performed based on the time domain, but it is not limited thereto, and it is also possible to perform based on the frequency domain.

On the other hand, the crosstalk reducing unit 430 may be selectively provided. That is, it is also possible to directly input the left audio signal and the right audio signal output from the image positioning unit 420 to the subband analyzing unit 440.

The subband analysis unit 440 performs subband analysis filtering on the audio signal subjected to the image-localization control. That is, a subband analysis filter bank is provided to convert the audio signal, which is subjected to the image phase-normalization control, into a frequency signal. The subband of the filtered audio signal in the subband analyzer 440 may be 32 subbands or 64 subbands.

The audio signal classified by the frequency bands can be subjected to phase adjustment or gain adjustment for each frequency band or for each frequency band group in the following phase adjusting unit 450 and gain adjusting unit 460.

A frequency dependent phase controller 450 adjusts the phase of each of the frequency bands separated on a band-by-band basis. This phase adjustment can be performed based on the detected depth information or the variation amount of the depth. It is preferable to increase the phase as the detected depth is larger or the variation amount of the depth is larger. It is possible to increase the phase to the upper limit value. On the other hand, when there is little depth or when there is little variation in depth, i.e., less than a predetermined value, the phase adjustment may not be performed.

For example, when the phase of an audio signal of a predetermined frequency is increased by 180 degrees, it can be understood that the audio signal is further projected in the user direction.

The phase adjustment method can be performed in various ways. For example, it is possible to change the sign between channels by dividing the band or band only for a certain frequency range, to change the sign between channels by grouping them for a specific frequency range, to adjust the phase between the channels independently in all frequency bands, You can adjust the phase between channels by dividing bands or bands for specific frequency ranges, or you can group them for specific frequency ranges to adjust the phase between channels.

Further, the phase adjustment can be performed such that the higher the depth or the larger the variation in depth, the higher the frequency components are removed.

On the other hand, the phase adjustment according to the depth can be performed based on the average depth or the maximum depth in the 3D image. For example, when there are a plurality of 3D objects in the 3D image, the average depth of the corresponding 3D object is calculated, the phase adjustment is performed based on the average depth, or the maximum of the plurality of 3D object depths Lt; RTI ID = 0.0 > 3D < / RTI > depth.

The frequency dependent gain controller 460 adjusts the gain for each of the frequency bands separated for each band. This gain adjustment can be performed based on the detected depth information or the variation amount of the depth. It is preferable to increase the gain as the detected depth is larger or the variation amount of the depth is larger.

For example, if the detected depth is doubled, the gain can be increased by a factor of four, and if the detected depth is increased by four, the gain can be increased by eight. Accordingly, a band for zooming of an audio signal can be emphasized.

The gain adjustment method can be performed in various ways. For example, gain can be adjusted independently for all frequency bands, gain can be adjusted by dividing bands or bands only for specific frequency ranges, or groups can be grouped for specific frequency ranges to control gain for each group.

For example, if the frequency band is 1000 Hz to 4000 Hz, the gain can be adjusted and the gain can not be adjusted in other frequency bands.

In addition, the gain adjustment can be performed such that the higher the depth or the greater the variation in depth, the higher the frequency components are removed.

On the other hand, the gain adjustment according to the depth can be performed based on the average depth or the maximum depth in the 3D image. For example, when there are a plurality of 3D objects in the 3D image, the average depth of the corresponding 3D object is calculated, and the gain adjustment is performed based on the average depth. Alternatively, among the plurality of 3D object depths, Gain adjustment can be performed based on the maximum 3D depth.

The subband synthesis unit 470 performs subband synthesis filtering on the audio signal whose phase or gain is adjusted for each frequency band. That is, a subband synthesis filter bank is provided to synthesize subbands divided into four subbands or 64 subbands. Thus, finally, the audio signal on which the image phase normalization, phase adjustment, gain adjustment, and the like have been performed is output according to the depth. Such an audio signal is zoomed out according to the depth, and can be perceived as being output in front of the listener's head.

On the other hand, it is also possible to selectively perform sound phase normalization, phase adjustment, gain adjustment, and the like depending on the depth. That is, at least one of the sound image localization, the phase adjustment, or the gain adjustment may be performed corresponding to the depth. For example, only the phase adjustment corresponding to the depth may be performed, or only the gain adjustment corresponding to the depth may be performed. Alternatively, it is also possible to selectively perform the phase adjustment or the depth adjustment on the assumption of the sound phase localization according to the depth.

Although not shown in the drawing, a channel separator 420 may be provided between the audio decoder 410 and the sound image localizer 420.

The channel separating unit 420 separates input audio signals on a channel-by-channel basis. For example, the audio signal can be divided into a rear channel and a front channel. The rear channel may be an audio signal output from the rear of the video display device 100 and the front channel may be an audio signal output from the front of the video display device 100. [ It is also possible to divide it into 5.1 channels or the like, or to divide it into a left channel and a right channel in the case of stereo.

In addition, the audio processing unit 230 in the control unit 170 can process a base, a treble, a volume control, and the like.

The data processing unit (not shown) in the control unit 170 can perform data processing of the demultiplexed data signal. For example, if the demultiplexed data signal is a coded data signal, it can be decoded. The encoded data signal may be EPG (Electronic Program Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcasted on each channel. For example, the EPG information may be ATSC-PSIP (ATSC-Program and System Information Protocol) information in the case of the ATSC scheme and may include DVB-SI information in the DVB scheme . The ATSC-PSIP information or the DVB-SI information may be information included in the above-mentioned stream, that is, the header (2 bytes) of the MPEG-2 TS.

2, a signal from the OSD generating unit 240 and the image processing unit 220 is mixed in a mixer 245, and then a 3D processing is performed in a formatter 260. However, the present invention is not limited to this, May be located behind the formatter. That is, the output of the image processing unit 220 is 3D-processed by the formatter 260. The OSD generating unit 240 performs the 3D processing together with the OSD generation, and then the 3D signals processed by the mixer 245 are mixed It is also possible to do.

Meanwhile, the block diagram of the controller 170 shown in FIG. 2 is a block diagram for an embodiment of the present invention. Each component of the block diagram can be integrated, added, or omitted according to the specifications of the control unit 170 actually implemented.

In particular, the frame rate converter 250 and the formatter 260 are not provided in the controller 170, but may be separately provided.

FIG. 7 is a view for explaining how images are formed by a left eye image and a right eye image, and FIG. 8 is a view for explaining depths of a 3D image according to an interval between a left eye image and a right eye image.

First, referring to FIG. 7, a plurality of images or a plurality of objects 615, 625, 635, and 645 are illustrated.

First, the first object 615 includes a first left eye image 611 (L) based on the first left eye image signal and a first right eye image 613 (R) based on the first right eye image signal, It is exemplified that the interval between the first left eye image 611, L and the first right eye image 613, R is d1 on the display 180. [ At this time, the user recognizes that an image is formed at an intersection of an extension line connecting the left eye 601 and the first left eye image 611, and an extension line connecting the right eye 603 and the first right eye image 603. Accordingly, the user recognizes that the first object 615 is positioned behind the display 180. [

Next, since the second object 625 includes the second left eye image 621, L and the second right eye image 623, R and overlaps with each other and is displayed on the display 180, do. Accordingly, the user recognizes that the second object 625 is located on the display 180. [

Next, the third object 635 and the fourth object 645 are arranged in the order of the third left eye image 631, L, the second right eye image 633, R, the fourth left eye image 641, Right eye image 643 (R), and their intervals are d3 and d4, respectively.

According to the above-described method, the user recognizes that the third object 635 and the fourth object 645 are positioned at positions where the images are formed, respectively, and recognizes that they are located before the display 180 in the drawing.

At this time, it is recognized that the fourth object 645 is projected before the third object 635, that is, more protruded than the third object 635. This is because the interval between the fourth left eye image 641, L and the fourth right eye image 643, d4 is larger than the interval d3 between the third left eye image 631, L and the third right eye image 633, R. [

Meanwhile, in the embodiment of the present invention, the distance between the display 180 and the objects 615, 625, 635, and 645 recognized by the user is represented by a depth. Accordingly, it is assumed that the depth when the user is recognized as being positioned behind the display 180 has a negative value (-), and the depth when the user is recognized as being positioned before the display 180 (depth) has a negative value (+). That is, the greater the degree of protrusion in the user direction, the greater the depth.

8, the interval a between the left eye image 701 and the right eye image 702 in FIG. 8A is smaller than the interval between the left eye image 701 and the right eye image 702 shown in FIG. 8 (b) (b ') of the 3D object in Fig. 8 (b) is smaller than the depth a' of the 3D object in Fig. 8 (a).

In this way, when the 3D image is exemplified as the left eye image and the right eye image, the positions recognized as images are different depending on the interval between the left eye image and the right eye image. Accordingly, by adjusting the display intervals of the left eye image and the right eye image, the depth of the 3D image or the 3D object composed of the left eye image and the right eye image can be adjusted.

FIG. 9 is a flowchart illustrating an operation method of an image display apparatus according to an embodiment of the present invention, and FIGS. 10 to 14 are referred to for explaining various examples of an operation method of the image display apparatus of FIG.

Referring to FIG. 9, first, a 3D image is input (S905). The input 3D image is input to an external input image from the external device 190, an image input from a content provider via a network, a broadcast image from a broadcast signal received from the tuner 110, Lt; / RTI >

Meanwhile, the controller 170 may determine whether the input image is a 3D image. For example, it is possible to receive information indicating whether a 3D image is included in a header or metadata of an input video stream, and to determine whether the 3D image is a 3D image based on the received information.

Next, the depth of the 3D image is calculated (S910). The control unit 170 can calculate the depth of the 3D image upon decoding the input 3D image or upon format conversion after decoding.

For example, when an input 3D image is coded by the MPEG-C Part 3 method and is coded by a chrominance image and a depth image, the depth can be calculated by decoding the depth image in the image processing unit 220 .

This depth may be generated on a frame-by-frame basis or on an object-by-object basis. For example, when the number of 3D objects in a frame is one, it is possible to calculate the depth of the frame based on the depth of the object. When there are a plurality of 3D objects in the frame, it is possible to calculate the average value as the depth of the frame using a plurality of depths.

For example, when an input 3D image is coded by a method such as MPEG-2 and is coded by a left eye image and a right eye image, once the left eye image and the right eye image are decoded, It is possible to calculate the depth from the parallax information. It is possible to calculate the depth from the parallax information of the left eye image and the right eye image in the formatter 260 in the control unit 170. [ The detected depth is input into the audio processing unit 230 as shown in FIG. 2 and FIG.

Next, the sound image position of the audio signal synchronized with the 3D image is controlled corresponding to the detected depth (S915).

As described in the description of FIG. 4, the sound image position control unit 420 controls the sound image position in the audio processing unit 230. Particularly, in the embodiment of the present invention, HRTF filtering is performed in accordance with the depth so that the sound image localization is performed according to the depth.

10 to 12, FIG. 10 illustrates that an object 1010 is disposed within the display 180. FIG. Here, assuming that the sound source is present in the object 1010, the angle between the sound source and the listener is set to? 1, and the distance is set to L1.

Next, FIG. 11 illustrates that, unlike FIG. 10, the 3D object 1015 has a depth d1 and protrudes from the display 180. FIG. Here, assuming that a sound source is present in the 3D object 1015, the angle between the sound source and the listener is set to? 2, and the distance is set to L2.

Next, FIG. 12 illustrates that, unlike FIG. 11, the 3D object 1020 has a depth d2 and protrudes further from the display 180. FIG. Here, assuming that a sound source is present in the 3D object 1020, the angle between the sound source and the listener is set to? 3, and the distance is set to L3.

10 to 12, for an object having no depth, the angle with respect to the listener 1005 is set to be the smallest among the angles? 1 in Figs. 10 to 12, and the distance from the listener 1005 to the listener 1005 in Figs. 10 to 12 The largest L1 is set. 11, the angle with respect to the listener 1005 is set to? 2, which is the middle in Figs. 10 to 12, and the distance from the listener 1005 to the listener 1005 is less than the distance from the listener 1005, The middle L2 is set. 12, the angle θ3 with respect to the listener 1005 is set to the largest θ3 in FIGS. 10 to 12, and the distance from the listener 1005 to the listener 1005 is greater than the distance from the listener 1005 in FIG. 10 to FIG. 12 The smallest L3 is set.

Accordingly, in the embodiment of the present invention, when the 3D images have different depths, as shown in FIGS. 10 to 12, the HRTFs are measured in advance corresponding to the respective depths, And then performs corresponding head transfer function (HRTF) filtering. Thus, the sound image position control can be performed corresponding to the depth.

On the other hand, although not shown in the figure, after the sound image leveling control, the crosstalk reduction control can be performed as described in Fig. That is, an additional audio signal (for example, a reverberation signal) can be generated and added in order to prevent crosstalk between the left and right audio signals outputted in the sound image phase.

Subband analysis filtering is then performed (S920). 4, the subband analyzing unit 440 in the audio processing unit 230 performs subband analysis filtering on the audio signal subjected to the image position control. That is, a subband analysis filter bank is provided to convert the audio signal, which is subjected to the image phase-normalization control, into a frequency signal. The subband of the filtered audio signal in the subband analyzer 440 may be, for example, 32 subbands or 64 subbands.

Next, the phase is adjusted corresponding to the detected depth (S925). 4, in the audio processing unit 230, the phase adjusting unit 440 adjusts the phase for each frequency band separated by the frequency band. This phase adjustment can be performed based on the detected depth information. The larger the detected depth, the more desirable it is to increase the phase. Alternatively, the larger the amount of change in the detected depth, the more the phase can be increased. For example, when the phase of an audio signal of a predetermined frequency is increased by 180 degrees, it can be understood that the audio signal is further projected in the user direction.

On the other hand, the phase adjustment method can be performed in various ways. For example, it is possible to change the sign between channels by dividing the band or band only for a certain frequency range, to change the sign between channels by grouping them for a specific frequency range, to adjust the phase between the channels independently in all frequency bands, You can adjust the phase between channels by dividing bands or bands for specific frequency ranges, or you can group them for specific frequency ranges to adjust the phase between channels.

Next, the gain is adjusted corresponding to the detected depth (S930). 4, in the audio processing unit 230, the gain adjusting unit 450 adjusts the gain for each frequency band separated for each band. Such gain adjustment can be performed based on the detected depth information. It is desirable to increase the gain as the detected depth is larger. On the other hand, it is also possible to increase the gain as the variation amount of the detected depth is larger.

For example, if the detected depth is doubled, the gain can be increased by a factor of four, and if the detected depth is increased by four, the gain can be increased by eight. Accordingly, a band for zooming of an audio signal can be emphasized.

The gain adjustment method can be performed in various ways. For example, gain can be adjusted independently for all frequency bands, gain can be adjusted by dividing bands or bands only for specific frequency ranges, or groups can be grouped for specific frequency ranges to control gain for each group.

Subband synthesis filtering is then performed (S935). Then, an audio signal synchronized with the 3D image and the 3D image is output (S940).

As described in the description of FIG. 4, in the audio processing unit 230, the subband combining unit 460 performs subband synthesis filtering on an audio signal whose phase or gain is adjusted for each frequency band. That is, a subband synthesis filter bank is provided to synthesize subbands divided into four subbands or 64 subbands. Thus, finally, the audio signal on which the image phase normalization, phase adjustment, gain adjustment, and the like have been performed is output according to the depth. Such an audio signal is zoomed out according to the depth, and can be perceived as being output in front of the listener's head.

13 illustrates that a 3D image 1110 having a 3D object 1120 with a depth d1 is displayed on the display 180. [ Thus, the audio output unit 185 outputs an audio signal that is signal-processed in synchronization with the 3D image.

At this time, the depth d1 of the audio signal is less than a predetermined value, so that the audio signal is output as an input audio signal band. That is, the audio signal 1135 of the left channel and the right channel is output in accordance with the input audio signal. The audio signal output in this way can not provide a stereoscopic image corresponding to the depth to the user 1105 watching the image 1110 wearing the 3D viewing apparatus 195. That is, the audio signal 1130 is output from the user 1105.

Next, FIG. 14 illustrates that a 3D image 1210 having a 3D object 1220 with a depth d2 is displayed on the display 180. FIG. 11, since the depth is larger and has a depth equal to or greater than a predetermined value, the input audio signal is processed as a separate 3D audio signal such as sound image position, phase adjustment, or gain adjustment as described above.

As described above, the audio signal is further projected and output by adjusting the phase of the channel and the like.

In the figure, it is exemplified that the audio signals 1235 of the left channel and the right channel are emphasized and output. The audio signal 1230 output in this way is output in the vicinity of the user 1105 watching the video 1210 wearing the 3D viewing device 195. Therefore, stereoscopic sound can be implemented according to the depth of the 3D image.

13 to 14, the 3D signal processing of the audio signal is performed by the depth of the object in the image. However, the present invention is not limited to this, and if there are a plurality of objects in the image, the depth of each object is used It is also possible to perform the 3D signal processing of the audio signal by using the average depth. It is also possible to separately perform the 3D signal processing of the audio signal corresponding to each object based on the depth of each object.

The image display apparatus and the operation method thereof according to the present invention are not limited to the configuration and method of the embodiments described above but the embodiments can be applied to all or some of the embodiments May be selectively combined.

Meanwhile, the operation method of the image display apparatus of the present invention can be implemented as a code that can be read by a processor on a recording medium readable by a processor included in the image display apparatus. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (17)

Claim 1 has been abandoned due to the setting registration fee. Receiving a 3D image;
Detecting a depth of the 3D image; And
And controlling the sound image localization of the audio signal input in synchronization with the 3D image corresponding to the detected depth,
Wherein the sound image phase control step comprises:
Related transfer function filtering in which coefficients of the audio signal are varied according to a depth of the 3D image. delete Claim 3 has been abandoned due to the setting registration fee. The method according to claim 1,
Further comprising: reducing crosstalk of the audio signal controlled by the sound image position control. Claim 4 has been abandoned due to the setting registration fee. The method according to claim 1,
And performing subband analysis filtering on the audio-signal-controlled audio signal. Claim 5 has been abandoned due to the setting registration fee. The method according to claim 1,
And adjusting the phase of the audio signal according to a frequency band corresponding to the detected depth or depth variation. Claim 6 has been abandoned due to the setting registration fee. 6. The method of claim 5,
And increases the phase as the detected depth increases. Claim 7 has been abandoned due to the setting registration fee. The method according to claim 1,
And adjusting a gain of the audio signal according to a frequency band corresponding to a variation amount of the detected depth or depth. Claim 8 has been abandoned due to the setting registration fee. 8. The method of claim 7,
Wherein the gain is increased as the detected depth is increased. Claim 9 has been abandoned due to the setting registration fee. 9. The method according to claim 7 or 8,
And performing subband synthesis filtering on the audio signal whose phase or gain has been adjusted for each frequency band. Claim 10 has been abandoned due to the setting registration fee. Receiving a 3D image;
Detecting a depth of the 3D image; And
And performing at least one of a sound level control of an audio signal input in synchronization with the 3D image, a phase adjustment of the audio signal, or a gain adjustment of the audio signal in correspondence with the detected depth And,
Wherein the head-related transfer function is configured to filter the audio signal at the time of the image-normalization control, the head-related transfer function having a variable coefficient according to a depth of the 3D image. A display for displaying an image;
An audio output unit for outputting an audio signal; And
And a control unit for controlling the sound image position of the audio signal to be synchronized with the 3D image in accordance with the depth of the input 3D image and outputting the audio signal having the sound image position,
Wherein,
Related transfer function filtering in which coefficients are varied according to a depth of the 3D image to control the sound image localization of the audio signal. delete delete 12. The method of claim 11,
Wherein,
And a phase adjusting unit for adjusting the phase of the audio signal according to a frequency band corresponding to a variation amount of depth or depth of the 3D image. 12. The method of claim 11,
Wherein,
And a phase adjuster for adjusting gain of the audio signal according to a frequency band corresponding to a change amount of depth or depth of the 3D image. 12. The method of claim 11,
Wherein,
And a crosstalk canceling unit for reducing the crosstalk of the audio signal whose sound level is controlled. 12. The method of claim 11,
Wherein,
And a formatter for detecting the depth of the 3D image.

Images