KR101923640B1 - Method and apparatus for providing virtual reality broadcast - Google Patents

Abstract

A method for providing a virtual reality broadcast according to an exemplary embodiment of the present invention is a method for providing a virtual reality broadcast by providing a first image and a virtual reality Requesting streaming of a second image photographed from a photographing apparatus, not a photographing apparatus, and a second image window displaying a first image and a second image in response to the request, The virtual reality photographing apparatus includes a virtual reality photographing device and a virtual reality photographing device. The virtual reality photographing device is capable of operating the viewpoint of the photographed image from a virtual reality photographing device through various methods, .

Description

[0001] METHOD AND APPARATUS FOR PROVIDING VIRTUAL REALITY BROADCAST [0002]

The present invention relates to a method and an apparatus for providing a virtual reality broadcast, and more particularly, to a method and an apparatus capable of easily changing a viewpoint of a virtual reality shot image while simultaneously providing a virtual reality shot image and a personal image .

Virtual Reality (VR) is the interface between a user and a computer that creates a picture of a specific environment or situation and makes the user feel as if they are in real life situations and environments. In other words, virtual reality is a simulation environment that enables users to experience virtual reality from an experiential viewpoint. Virtual reality has the advantage of providing users with an interface that is difficult for users to experience on a daily basis, making them feel as if they are entering the environment, and manipulating the environment.

As a result, the functions of various information communication devices including the Internet of Things (IoT) have been developed, and virtual reality related technologies have been commercialized. Specifically, development of input and output device functions included in information communication devices, commercialization of a microprocessor having a high processing speed, miniaturization of a mass storage device size, development of a graphic engine technology, and development of an entry-level HMD (Head Mounted Display) The emergence of virtual reality technology is accelerating.

Since virtual reality provides users with an interface that is difficult for users to experience on a daily basis, the user can feel as if they are in the environment, and manipulate the environment, so that the supply and demand of contents related to virtual reality are increasing.

Further, there is a need for a method of providing virtual reality related contents in various forms so that users can experience various experiences and acquire more information.

[Related Technical Literature]

Operation control system and method in virtual reality (Patent No. 10-0947735)

SUMMARY OF THE INVENTION It is an object of the present invention to provide a method and apparatus for providing a virtual reality broadcast capable of providing a user interface for providing an image and a broadcast image together from a virtual reality photographing apparatus.

Another object of the present invention is to provide a method and apparatus for providing a virtual reality broadcast capable of providing additional information and manipulation of an image photographed by a virtual reality photographing apparatus.

The problems of the present invention are not limited to the above-mentioned problems, and other problems not mentioned can be clearly understood by those skilled in the art from the following description.

According to an aspect of the present invention, there is provided a method for providing a virtual reality broadcast in a video management server, including: receiving a first image photographed from a virtual reality photographing apparatus, Requesting streaming of the second image, and providing a first image window displaying the first image and a second image window displaying the second image in response to the request through the display unit at the same time.

According to another aspect of the present invention, the step of requesting streaming of the first image and the second image includes requesting the provision of the first image according to an output request for the first image in a state where the second image is provided Lt; / RTI >

According to another aspect of the present invention, simultaneously providing the first image window and the second image window may include adding a second image window to the first image window and varying a size of the second image window.

According to another aspect of the present invention, a method for providing a virtual reality broadcast includes receiving a viewpoint change signal for a first image, and displaying the first image in a first image window at a time point corresponding to the viewpoint change signal Step < / RTI >

According to another aspect of the present invention, the step of receiving the viewpoint change signal may include receiving a drag signal through the touch input device or the pointing input device in the first image window.

According to another aspect of the present invention, the step of receiving the viewpoint change signal may be a step of receiving angle information of the device from the sensor.

According to another aspect of the present invention, there is provided a method for generating a viewpoint image, the method comprising the steps of: providing a viewpoint for a first image in a first image window or separately as a two-dimensional image or a three- Image or an input corresponding to a point of time to vary in the three-dimensional image.

According to another aspect of the present invention, a method for providing a virtual reality broadcast includes receiving a time line variation signal for a first image, and receiving a first image at a changed time corresponding to a time line variation signal, And displaying it on the window.

According to another aspect of the present invention, there is provided a method for providing a map image in which a first image received from a position sensor included in a virtual reality photographing apparatus, .

According to another aspect of the present invention, a method of providing a virtual reality broadcast may further include displaying time information corresponding to location information or path movement information on a map image.

According to another aspect of the present invention, a method of providing virtual reality broadcasting may further include receiving additional object data for a first image and applying additional object data to a first image.

According to another aspect of the present invention, the additional object data may include position information in the first image.

According to another aspect of the present invention, the device is a mobile device, and may further include displaying the first image in a stereoscopic manner upon request.

According to another aspect of the present invention, the step of displaying the first image in a stereoscopic manner may further include the step of providing only audio for the second image.

According to an aspect of the present invention, there is provided an apparatus for providing a virtual reality broadcast, the apparatus including: a first image picked up from a virtual reality image pickup apparatus and a second image picked up from a photographing apparatus, And a display unit for providing a first image window displaying a first image and a second image window displaying a second image in response to a request through a processor and a processor requesting streaming of the second image.

According to another aspect of the present invention, an apparatus for providing a virtual reality broadcast includes an input unit for receiving a viewpoint change signal for a first image, and the display unit displays a first image at a time point corresponding to the viewpoint change signal, 1 It can be displayed in the image window.

According to another aspect of the present invention, the input unit may receive the drag signal in the first image window.

According to another aspect of the present invention, an apparatus for providing a virtual reality broadcast may further include a sensor for detecting angle information of a device providing a virtual reality broadcast.

The details of other embodiments are included in the detailed description and drawings.

The present invention provides a method and an apparatus for providing a virtual reality broadcast capable of providing a user interface for providing an image and a broadcast image together from a virtual reality photographing apparatus.

The present invention provides a method and apparatus for providing a virtual reality broadcast capable of providing additional information and manipulation of an image photographed from a virtual reality photographing apparatus.

The effects according to the present invention are not limited by the contents exemplified above, and more various effects are included in the specification.

FIG. 1 is a schematic view for explaining a relation between a virtual reality broadcast production apparatus, a video management server, and a virtual reality broadcast viewing apparatus according to an embodiment of the present invention.
2 is a block diagram illustrating a schematic configuration of a virtual reality broadcast production apparatus and a virtual reality broadcast viewing apparatus according to an embodiment of the present invention.
3 is a flowchart illustrating a procedure for providing a virtual reality broadcast according to a method of providing a virtual reality broadcast according to an embodiment of the present invention.
4A to 4C illustrate a screen for a broadcast producer to produce a virtual reality broadcast according to another embodiment of the present invention.
FIG. 5 illustrates a screen for a viewer to view a virtual reality broadcast according to an embodiment of the present invention.
FIGS. 6A and 6B illustrate a screen for providing a two-dimensional image and a three-dimensional image with respect to a viewpoint of a first image according to an embodiment of the present invention.
FIG. 7 illustrates a screen for providing a map image corresponding to a first image according to an embodiment of the present invention.
FIG. 8 illustrates a screen for a first image including additional object data according to an embodiment of the present invention.
9A and 9B illustrate a first image screen in a spectacle-type frame device capable of mounting a smartphone according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims.

The shapes, sizes, ratios, angles, numbers, and the like disclosed in the drawings for describing the embodiments of the present invention are illustrative, and thus the present invention is not limited thereto. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. Where the terms 'comprises', 'having', 'done', and the like are used herein, other parts may be added as long as '~ only' is not used. Unless the context clearly dictates otherwise, including the plural unless the context clearly dictates otherwise.

In interpreting the constituent elements, it is construed to include the error range even if there is no separate description.

Although the first, second, etc. are used to describe various components, these components are not limited by these terms. These terms are used only to distinguish one component from another. Therefore, the first component mentioned below may be the second component within the technical spirit of the present invention.

Like reference numerals refer to like elements throughout the specification unless otherwise specified.

It is to be understood that each of the features of the various embodiments of the present invention may be combined or combined with each other partially or entirely and technically various interlocking and driving is possible as will be appreciated by those skilled in the art, It may be possible to cooperate with each other in association.

FIG. 1 is a schematic view for explaining a relation between a virtual reality broadcast production apparatus, a video management server, and a virtual reality broadcast viewing apparatus according to an embodiment of the present invention.

Referring to FIG. 1, a virtual reality broadcast providing system 1000 manages a virtual reality broadcast produced by a broadcast provider and provides the viewer with various types of information. In this case, the virtual reality broadcast providing system 1000 includes a virtual reality broadcast production apparatus 100, a video management server 200, and a virtual reality broadcast viewing apparatus 300.

The virtual reality broadcast production apparatus 100 is a device for producing a virtual reality broadcast to be provided to a viewer by a broadcast provider. The virtual reality broadcast production apparatus 100 includes various electronic devices. Specifically, the virtual reality broadcast production apparatus 100 includes, but is not limited to, a desktop or a laptop that processes a first image photographed from the virtual reality photographing apparatus and a second image photographed from the photographing apparatus rather than the virtual reality photographing apparatus . At this time, the photographing apparatus may be a webcam connected to a desktop or a laptop, or may be a camera incorporated in a laptop, but is not limited thereto. Furthermore, the virtual reality broadcast production apparatus 100 may include a virtual reality photographing apparatus for photographing the first image. Therefore, when the virtual reality broadcast production apparatus 100 includes a virtual reality photographing apparatus, the virtual reality photographing apparatus is connected to a desktop or a laptop or a smart phone processing the first image, and is provided to a desktop, a laptop or a smart phone in real time can do.

The video management server 200 is a server for receiving virtual reality broadcasts including a first video and a second video from a virtual reality broadcast production apparatus 100 and providing the virtual reality broadcasts to viewers. Accordingly, the video management server 200 communicates with the virtual reality broadcast production apparatus 100 and the virtual reality broadcast viewing apparatus 300. [ For example, as shown in FIG. 1, the video management server 200 may be connected to the virtual reality broadcast production apparatus 100 and the virtual reality broadcast viewing apparatus 300 through a network. Here, the video management server 200 may be a co-location server, a cloud server, or the like, but is not limited thereto.

The virtual reality broadcast viewing apparatus 300 is a device for providing a viewer with a virtual reality broadcast produced by a broadcast provider through the virtual reality broadcast production apparatus 100. The virtual reality broadcast viewing apparatus 300 includes a desktop, a laptop, a tablet PC, or a smart phone. In addition, the virtual broadcast viewing apparatus 300 may include a frame device in the form of a spectacle capable of mounting a smart phone.

1, the virtual reality broadcast producing apparatus 100 and the virtual reality broadcast viewing apparatus 300 are shown as one apparatus for convenience of explanation. However, the present invention is not limited thereto, and a plurality of virtual reality broadcast production apparatuses and a plurality of virtual reality broadcast The viewing apparatus can communicate with the video management server 200.

Hereinafter, FIG. 2 will be referred to for a more detailed description of a virtual reality broadcast providing method in the virtual reality broadcast providing system 1000. FIG.

2 is a block diagram illustrating a schematic configuration of a virtual reality broadcast production apparatus and a virtual reality broadcast viewing apparatus according to an embodiment of the present invention. Will be described with reference to Fig. 1 for convenience of explanation.

Hereinafter, a user interface common to a broadcast provider for producing a virtual reality broadcast and viewers participating in viewing and participating in a provided virtual reality broadcast will be described. The virtual reality broadcast may be a form in which a first image photographed from the virtual reality photographing apparatus and a second image photographed from the photographing apparatus and provided as a flat image are simultaneously transmitted. The first and second images, that is, the virtual reality image and the image in which the broadcast provider appears, are simultaneously provided, so that the virtual reality image is simply reproduced, and the comment or comment of the broadcast producer can be heard through the image in which the broadcast provider appears. It is very important how the two images are arranged in harmony and which user experience is to be provided in the combination of the virtual reality image and the image in which the broadcast provider appears. In the user interface of the broadcast producer and the viewer, images in which the virtual reality image and the broadcast producer appear are commonly displayed. Further, the operation and display of the virtual reality image are substantially the same at the interface between the broadcasting producer and the viewer.

Referring to FIG. 2, a virtual reality broadcast production apparatus 100 includes a processor 110, a display unit 120, and an input unit 130.

The processor 110 of the virtual reality broadcast production apparatus 100 requests the video management server 200 to stream the first image photographed from the virtual reality photographing apparatus. When the virtual reality photographing apparatus 100 is included in the virtual reality photographing apparatus 100, the processor 110 requests the virtual reality photographing apparatus to perform real-time streaming of the first image. In addition, the processor 110 requests transmission of the first video requested to be streamed and a second video captured from a photographing apparatus, for example, a webcam, rather than a virtual reality photographing apparatus.

In addition, the processor 110 performs processing on the viewpoint change signal with respect to the first image. Here, the viewpoint change signal means a signal corresponding to an input that changes the viewpoint of the first image displayed on the display unit 120. [ The viewpoint change signal may be input through the input unit 130. [ In addition, the processor 110 performs processing on the time line variation signal for the first image. Here, the time line variation signal means a signal corresponding to an input that varies the reproduction time with respect to the first video displayed on the display unit 120. [ For example, in the case of the time line variation signal, the first image corresponding to the 00:03:23 reproduction time is displayed on the display unit 120, but the time for displaying the first image corresponding to the 00:10:10 reproduction time It is a signal that fluctuates the line.

The display unit 120 of the virtual reality broadcast production apparatus 100 displays a first image window for displaying a first image and a second image window for displaying a second image window in response to a request through the processor 110 do. Also, the display unit 120 displays the first image on the first image window at a time point corresponding to the view-change signal. Further, the display unit 120 displays the first image in the first image window at a time corresponding to the time line variation signal in the first image window.

The input unit 130 of the virtual reality broadcast production apparatus 100 receives the viewpoint change signal and the time line variation signal for the first image. In addition, the input unit 130 receives an input for additional object data, which is data to be additionally provided to the first image. The additional object data means data on an image displayed on the first image to give a score to the viewer. Here, the input unit 130 may be a keyboard or a mouse that is a pointing input device.

Referring to FIG. 2, the virtual reality broadcast viewing apparatus 300 includes a processor 310, a display unit 320, an input unit 330, and a sensor 340.

The processor 310 of the virtual reality broadcast viewing apparatus 300 requests the video management server 200 to stream the first video and the second video. The processor 310 may request only streaming of the first image in response to a viewer's request. At this time, the processor 310 requests streaming of sound included in the second image.

Furthermore, the processor 310 performs processing on the map image, which is data to be additionally provided to the first image. Here, the map image means an image in which the first image is photographed or an image in which path movement information according to time is displayed. In addition, the processor 310 performs processing on the additional object data input to the input unit 130 of the virtual reality broadcast production apparatus 100. Thus, the processor 310 performs processing to provide a map image or additional object data to the first image.

The display unit 320 of the virtual reality broadcast viewing apparatus 300 displays a first image window displaying the first image and a second image window displaying the second image in response to the request through the processor 310. [ At this time, the display unit 320 may display the first image to which the viewpoint change signal received in the input unit 130 of the virtual reality broadcast production apparatus 100 is applied. In addition, the display unit 320 displays a first image to which the received time line variation signal is applied to the input unit 130 of the virtual reality broadcast production apparatus 100. In addition, the display unit 320 displays a first image to which the map image or the additional object data is applied on the first image in the first image window.

Also, the display unit 320 can display the first image in a stereoscopic manner. Here, the stereoscopic method is a stereoscopic image realization method that enables a three-dimensional stereoscopic effect to be perceived by displaying the first image on the left eye and the right eye, respectively. Therefore, the display unit 320 can display the first image in two areas corresponding to the left eye and the right eye according to the stereoscopic method.

Also, the input unit 330 of the virtual reality broadcast providing apparatus 300 receives the viewpoint change signal for the first image. The input unit 330 of the virtual reality broadcast viewing apparatus 300 may be a touch input device.

 The sensor 340 of the virtual reality broadcast viewing apparatus 300 senses the angle information of the virtual reality broadcast viewing apparatus 300. Specifically, when the virtual reality broadcast viewing apparatus 300 includes a frame-shaped frame device capable of mounting a smartphone, the sensor 340 senses the angle information of the changed virtual reality broadcast viewing apparatus 300 . Here, the angle information means information about an angle that varies from a reference angle based on x-axis, y-axis, and z-axis. By sensing the angle information of the virtual reality broadcast viewing apparatus 300 by the sensor 340, the display unit 320 can display the first image at the changed time according to the angle information.

Accordingly, the virtual reality broadcast production apparatus 100 includes a processor 110, a display unit 120, and an input unit 130 so that a first image, . The virtual reality broadcast providing apparatus 300 includes a processor 310, a display unit 320, an input unit 330 and a sensor 340. The virtual reality broadcast providing apparatus 300 includes a first image provided by the virtual reality broadcast production apparatus 100, The viewer can view a second image providing commentary or comment on the image and change the viewpoint of the first image as needed.

Hereinafter, a method of providing a virtual reality broadcast in the virtual reality broadcast production apparatus 100 and the virtual reality broadcast providing apparatus 300 will be described in detail with reference to FIG.

3 is a flowchart illustrating a procedure for providing a virtual reality broadcast according to a method of providing a virtual reality broadcast according to an embodiment of the present invention. For convenience of explanation, the components will be described with reference to FIG. 1 and FIG. 2 and reference numerals.

The processor 310 of the virtual reality broadcast providing apparatus 300 transmits the first image photographed from the virtual reality photographing apparatus and the second image photographed from the photographing apparatus rather than the virtual reality photographing apparatus to the video management server 200 (S310).

Specifically, the processor 310 requests the presentation of the first image according to an output request for the first image in a state where the second image is provided. Here, the second image is an image associated with the first image, which means that the broadcast producer, for example, BJ (Broadcast Jacky) directly displays the first image. Accordingly, the first image is displayed on the display unit 320 in response to a request for outputting the first image while the second image is displayed first.

In response to the request, the display unit 320 of the virtual reality broadcast providing apparatus 300 provides a first video window for displaying the first video and a second video window for displaying the second video in operation S320.

Specifically, the display unit 320 provides both the first image window and the second image window by changing the size of the second image window while the processor 310 adds the second image window to the first image window. For example, the display unit 320 may provide a first image window having a size smaller than that of the initial second image window and a second image window having a size larger than that of the second image window. Concrete configurations of the first image window and the second image window will be described later in detail with reference to FIGS. 4A to 4C and FIG. The display unit 320 simultaneously provides the first image and the second image so that the viewer can learn detailed information about the first image by listening to the commentary or comment of the broadcast producer and the broadcast producer through the second image.

Then, the input unit 330 of the virtual reality broadcast providing apparatus 300 receives the viewpoint change signal for the first image (S330). Here, the viewpoint change signal may be received by the sensor 340 instead of the input unit 330, and the first video display according to the viewpoint change signal by the sensor will be described later.

Specifically, the input unit 330 can receive the drag signal in the first image window. For example, when the viewer tries to change the viewpoint to the right with respect to the first image, the input unit 330 may receive the drag signal moving from right to left. Also, when the viewer tries to change the viewpoint of the first image upward, the input unit 330 can receive the drag signal moving from top to bottom. A screen for receiving a specific drag signal will be described later in detail with reference to FIG.

When the view change signal is received by the sensor 340, the processor 310 receives the angle information from the sensor 340. That is, the processor 310 receives the angle information of the reference point from the sensor 340 and receives the changed angle information from the reference point. When the viewpoint change signal is received by the sensor 340, the virtual reality broadcast providing apparatus 300 may be mounted on a frame device of a glasses type. Accordingly, the sensor 340 can detect the motion of the viewer without a separate operation request, and can change the viewpoint of the first image.

Also, the input unit 330 may receive the viewpoint change signal through the two-dimensional image or the three-dimensional image expressing the viewpoint of the first image. Specifically, the display unit 120 provides the viewpoints for the first image in the first image window or separately as the two-dimensional image or the three-dimensional image. Then, the input unit 400 receives an input corresponding to the point of time of the change in the two-dimensional image or the three-dimensional image. At this time, in the case of a two-dimensional image, the input unit 400 receives an input corresponding to at least one point. Further, in the case of a three-dimensional image, the input unit 330 receives input corresponding to at least two points. Configurations for specific two-dimensional images and three-dimensional images will be described later with reference to Figs. 6A and 6B. By receiving the viewpoint change signal through the two-dimensional image or the three-dimensional image, the viewer can easily grasp the position with respect to the point of time of the change in the first image, and can accurately input the desired point of change.

Then, the display unit 320 of the virtual reality broadcast providing apparatus 300 displays the first image on the first image window at a time point corresponding to the view-change signal (S340).

Specifically, the changed time corresponding to the drag signal is applied to the first image displayed on the first image window by the display unit 320 by the processor 310. In addition, the first image displayed on the first image window by the display unit 320 is applied to the two-dimensional image or the three-dimensional image by the processor 310. [ Even when the virtual reality broadcast providing apparatus 300 is mounted on the frame device of the glasses type, the first image displayed on the first image window by the display unit 320 is displayed on the first image displayed on the first image window by the processor 310, Is applied. The first image to which the changed viewpoint corresponding to the specific angle information is applied will be described later in detail with reference to FIG.

On the other hand, in another embodiment, the display unit 320 of the virtual reality broadcast providing apparatus 300 may display the first video to which the time line corresponding to the time line variation signal input by the broadcast producer is applied in the first video window have. At this time, the viewer can be implemented such that the time line for the first image displayed on the display unit 320 can not be changed.

In addition, in another embodiment, the display unit 320 of the virtual reality broadcast providing apparatus 300 may display a virtual reality image, which is included in the virtual reality photographing apparatus or is received from a separate apparatus, for example, 1 provides a map image in which positional information of the image is photographed or path movement information according to time. Timeline information corresponding to the position information or timeline information corresponding to the path movement information is displayed in the provided map image. That is, the map image displays the location where the first image was shot and the playback time of the first image corresponding to the point at which the shot location is output. The map image displays the playback time of the first video corresponding to the movement of the first video. The detailed map image providing screen for the first image will be described later in detail with reference to FIG. The display unit 320 provides location information on which the first image is photographed, or route movement information according to time, through the map image, thereby enabling the viewer to easily acquire the position to be displayed on the image, , It is possible to confirm the route movement information according to time at a glance.

Further, in another embodiment, the input unit 330 of the virtual reality broadcast providing apparatus 300 receives the additional object data for the first image. Here, the additional object data may include an image object placed in the first image to be displayed, position information, a score, or animation according to the input signal. Accordingly, the display unit 320 can provide the first image to which the additional object data is applied. The additional object data may be applied by the processor 310 to the first image. At this time, the additional object data may be applied to the first image by the processor 310 in real time. A first image to which concrete additional object data is applied will be described later in detail with reference to FIG.

When the virtual reality broadcast providing apparatus 300 is mounted on a frame apparatus of a glasses type, the display unit 320 displays the first image in a stereo scope manner upon a request. At this time, the processor 310 provides only the audio for the second video together with the first video. A first image displayed in a specific stereoscopic manner will be described later in detail with reference to FIG. By providing the first image in a stereoscopic manner, the viewer can view the first image more realistically as if it is located in the first image.

4A to 4C illustrate a screen for a broadcast producer to produce a virtual reality broadcast according to another embodiment of the present invention.

Referring to FIG. 4A, a display unit 120 of a virtual reality broadcast production apparatus 100 displays a screen for producing a virtual reality broadcast. The virtual reality broadcast production screen includes a broadcast start button 410, a recording start button 430, and a VR button 430.

Referring to FIG. 4A, when a signal for the broadcast start button 410 is received through the input unit 130, the display unit 120 displays the second image 420 captured by the photographing apparatus. The signal for the recording start button 430 indicates recording for the second image photographed. That is, when receiving the signal for the recording start button 430 through the input unit 130, the processor 120 records the second image 420 displayed through the display unit 120, Lt; / RTI > When receiving a signal for the VR button 440 through the input unit 130, the display unit 120 prepares the display of the first image and the second image photographed from the virtual reality photographing apparatus. The first image photographed from the virtual reality changing apparatus may be a previously stored virtual reality image or an image provided in real time using the virtual reality photographing apparatus. Hereinafter, a method of providing a first image, which is a previously stored virtual reality image, will be described as an exemplary embodiment of the present invention.

Referring to FIG. 4B, the display unit 120 displays a screen for selecting a previously stored first image 450 to be displayed together with the second image 420. The display unit 120 may display a list 441 for the first image stored in advance or a button for allowing the first image 450 photographed from the virtual reality photographing apparatus to be streamed in real time. Accordingly, when receiving the selection signal for the first image from the list 441 for the first image stored in advance through the input unit 130, the display unit 120 displays the first image 450 corresponding to the selection signal do. When the first image 450 captured from the virtual reality photographing apparatus is streamed in real time, the selection signal for the first image is not received from the list 441 for the first image stored in advance through the input unit 130, And may receive a selection signal for a button to be streamed in real time.

Referring to FIG. 4B, the display unit 120 may display the viewpoint of the first image 450 as a two-dimensional image 451. The configuration for the specific two-dimensional image will be described later in detail with reference to FIG. 6A. At this time, it is possible to receive a signal for the second video display button 442 on whether to display the second video together with the first video through the input unit 130. That is, when a display signal is received through the second image display enable button 442, the display unit 120 displays the first image 450 and the second image 420 together. On the other hand, when receiving the hidden signal through the second video display / non-display button 442, the display unit 120 displays only the first video 450. Then, a signal for the VR start button 443 is received through the input unit 130.

4C, when the input unit 130 receives a signal for the VR start button 443, the display unit 120 displays the first image 450 and the second image 420. Furthermore, the display unit 120 also displays a two-dimensional image 451 indicating the viewpoint of the first image 450. [ The size of the first image 450 and the size of the second image 420 are not changed according to the start of the VR broadcast in the display unit 120 but the size of the first image 450 is enlarged to the viewer, And the second image 420 is displayed on the lower right side of the first image 450.

Accordingly, the virtual reality broadcast production apparatus 100 can provide the viewer with the virtual reality broadcast more easily by providing the function corresponding to the procedure for providing the virtual reality broadcast. The virtual reality broadcast production apparatus 100 simultaneously displays the first image 450 and the second image 420 through the display unit 120 so that the broadcast producer can check the image to be provided to the viewer at a glance.

FIG. 5 illustrates a screen for a viewer to view a virtual reality broadcast according to an embodiment of the present invention.

Referring to FIG. 5, the display unit 320 of the virtual reality broadcast providing apparatus 300 displays a first image 450 and a second image 420 produced by a broadcast producer. Specifically, the display unit 320 displays the first image 450 as a main display, and displays the first image 450 as a small size at the lower right of the first image 450. In this case, the input unit 330 of the virtual reality broadcast providing apparatus 300 can receive the viewpoint change signal for the first image 450. Specifically, the input unit 330 can receive the drag signal 452 input to the first image 450. For example, when receiving the drag signal 452 moving from right to left through the input unit 330, the display unit 320 displays the first image 450 corresponding to the point of time when the right is changed. In addition, when the drag signal 452 moving from the upper side to the lower side is received through the input unit 330, the display unit 320 displays the first image 450 corresponding to the changed time point. At this time, the time line for the first image 450 can be implemented so that it can not be changed by the virtual reality broadcast providing apparatus 300.

Meanwhile, in another embodiment, the display unit 320 may display the first image 450 to which the time producer and the time line are applied. Here, the processor 310 may synchronize the viewpoint and the time line of the first image 450, which is changed by the broadcast producer, and provide the same to the display unit 320.

In FIG. 5, the virtual reality broadcast providing apparatus 300 is shown as a desktop for convenience of explanation, but the present invention is not limited thereto, and it may be a smartphone including a touch input device. Accordingly, when the virtual reality broadcast providing apparatus 300 is a smart phone, the drag signal 452 can be input through the touch input device.

Accordingly, the virtual reality broadcast providing apparatus 300 provides an interface that can simultaneously provide the second image, which is a broadcast for commentary or comment of the broadcast producer on the first image and the first image, It is possible to acquire a description of the first image.

FIGS. 6A and 6B illustrate a screen for providing a two-dimensional image and a three-dimensional image with respect to a viewpoint of a first image according to an embodiment of the present invention.

Referring to FIG. 6A, the display unit 320 of the virtual reality broadcast providing apparatus 300 may display the first image at a point in time with respect to the first image so that the right and left viewpoints of the first image can be easily changed. Dimensional image represented by the two-dimensional image. The processor 310 applies a point of view from the input of the point 453 to the first image 450 to a predetermined distance when the input of the point 453 is received around the circle through the input 330. [ Accordingly, the display unit 320 displays the first image 450 to which the time-varying viewpoint is applied through the two-dimensional image.

Referring to FIG. 6B, the display unit 320 of the virtual reality broadcast providing apparatus 300 displays a viewpoint of a first image, specifically, a viewpoint of a first image so that a viewpoint of a first image can be easily changed Dimensional image 454 represented by the three-dimensional image 454. When the point 453 is received on the spherical surface through the input unit 330, the processor 310 applies the point of time corresponding to the range determined from the point 453 to the predetermined distance to the first image 450. For example, if the point 453 is received above the spherical surface through the input 330, the processor 310 applies the viewpoint for the first image upward. Accordingly, the display unit 320 displays the first image 450 to which the up, down, left, and right viewpoints changed by the three-dimensional image are applied.

6A and 6B, the virtual reality broadcast providing apparatus 300 is shown to change the viewpoint on the first image through the two-dimensional image 452 or the three-dimensional image 454. However, The virtual reality broadcast production apparatus 100 also displays the two-dimensional image 452 or the three-dimensional image 454 so that the broadcast producer can display the first image 452 or the third image 454 through the two- Can be changed. When the viewpoint of the first image is changed through the two-dimensional image 452 or the three-dimensional image 454 displayed on the virtual reality broadcast production apparatus 100, the changed viewpoint is displayed on the virtual reality broadcast providing apparatus 300 Is applied to the first image.

Accordingly, the virtual reality broadcast providing apparatus 300 can confirm the entire viewpoint of the first image at a glance, and provides a two-dimensional image or a three-dimensional image expressed in a more stereoscopic manner, It is possible to accurately grasp the time point applied to the first image and to easily change the viewpoint.

FIG. 7 illustrates a screen for providing a map image corresponding to a first image according to an embodiment of the present invention.

Referring to FIG. 7, the display unit 320 of the virtual reality broadcast providing apparatus 300 displays a map image 455 corresponding to the first image together with the first image 450. Specifically, the display unit 320 displays location information 456 on which the first image 450 received from the position sensor included in the virtual reality photographing apparatus or the connected smart phone is photographed, or path movement information 457 according to time And displays the map image 455 appearing. For example, when a virtual reality photographing device is used to photograph Gwanghwamun, Hongryeomun, Gyeongbokgung, and Gyeongjeonjeon, the display unit 320 displays a map image 455 in which location information 456 for Gwanghwamun, Hongryeomun, . In addition, the display unit 320 displays a map image 455 in which the past travel path information 457 is displayed while photographing the Gwanghwamun, Hongryeomun, Gyeongbokgung Palace, The display unit 320 displays the time information 458 corresponding to the position information 456 or the path movement information 457 in which the first image 450 is photographed in the map image 455. Further, For example, the display unit 320 may display the time of the first image 450 captured by Kyng-bokkung 456 on the map image 455. In addition, the display unit 320 may display the position information 459 corresponding to the time line of the first image 450 currently displayed.

Accordingly, the virtual reality broadcast providing apparatus 300 provides the map image in which the first image is photographed and the path movement information according to the time, so that in the case of an external mobile broadcast or a travel broadcast, And acquire positional information and path movement information on the location where the robot is located.

FIG. 8 illustrates a screen for a first image including additional object data according to an embodiment of the present invention.

Referring to FIG. 8, the display unit 320 of the virtual reality broadcast providing apparatus 300 displays additional object data 461 applied to the first image 450. Specifically, when the broadcast producer inputs the additional object image, the animation, and the score given to the additional object image to be applied to the first image 450, the display unit 320 displays the additional object data 461 according to the input element, . Thus, when receiving a selection for additional object data 461 via the input 330, the processor 310 gives the viewer a predetermined score.

Accordingly, the virtual reality broadcast providing apparatus 300 can display the additional object data in the first video, thereby inducing the viewer to watch the video more aggressively.

9A and 9B illustrate a first image screen in a spectacle-type frame device capable of mounting a smartphone according to an embodiment of the present invention.

9A, the display unit 320 of the virtual reality broadcast providing apparatus 300 in the eyeglass-type frame apparatus displays the same first image in the first region 321 and the second region 322 according to the stereoscopic scheme Display. Specifically, the display unit 320 displays the two first images in the first area 321 and the second area 322 corresponding to the left and right eyes, respectively. By displaying the first image in the first area 321 and the second area 322 respectively, the viewer can feel the stereoscopic effect on the first image.

Referring to FIG. 9B, in a spectacle-type frame device, the display unit 320 of the virtual reality broadcast providing apparatus 300 displays a first image to which angle information received from the sensor 340 is applied. For example, when angle information on the upward direction is received from the sensor 340, the display unit 320 displays the first viewpoint of the first image in an upward direction. In addition, when angle information directed to the right from the sensor 340 is received, the display unit 320 displays the first viewpoint of the video image to the right. Likewise, when angle information directed downward from the sensor 340 is received, the display unit 320 displays the first viewpoint of the video image downwardly. At this time, the second image is not displayed, but the voice 421 for the second image is outputted. The changed time point of the first image is determined according to a predetermined calculation formula based on the angle information received from the sensor 340. [

Accordingly, in the eyeglass-type frame apparatus, the virtual reality broadcast providing apparatus 300 does not display the second video together with the first video, but provides the viewer with the audio of the second video so that the viewer can watch the first video The description of the first image can be recognized.

In this specification, each block or each step may represent a part of a module, segment or code that includes one or more executable instructions for executing the specified logical function (s). It should also be noted that in some alternative embodiments, the functions mentioned in the blocks or steps may occur out of order. For example, two blocks or steps shown in succession may in fact be performed substantially concurrently, or the blocks or steps may sometimes be performed in reverse order according to the corresponding function.

The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software module may reside in a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a removable disk, a CD-ROM or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor, which is capable of reading information from, and writing information to, the storage medium. Alternatively, the storage medium may be integral with the processor. The processor and the storage medium may reside within an application specific integrated circuit (ASIC). The ASIC may reside within the user terminal. Alternatively, the processor and the storage medium may reside as discrete components in a user terminal.

Although the embodiments of the present invention have been described in detail with reference to the accompanying drawings, it is to be understood that the present invention is not limited to those embodiments and various changes and modifications may be made without departing from the scope of the present invention. . Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. Therefore, it should be understood that the above-described embodiments are illustrative in all aspects and not restrictive. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

100: Virtual reality broadcast production device
110, 310: Processor
120, 320:
130, 330:
200: video management server
300: Virtual reality broadcast viewing device
321: First area
322: second region
340: sensor
410: Broadcast start button
420: Second image
430: Start recording button
440: VR button
450: First image
451: Two-dimensional image
452: Drag signal
453: Points
454: Three-dimensional image
455: Map image
456: Location information
457: Path movement information
458: Timeline information
459: Location information corresponding to timeline
461: Additional object data
1000: Virtual Reality Broadcasting System

Claims (18)

A method of providing a virtual reality broadcast to a device including a display unit,
Requesting a video management server to stream a first video shot from a virtual reality shooting device and a second video shot from an imaging device other than the virtual reality shooting device;
Providing a first image window displaying the first image and a second image window displaying the second image simultaneously in response to the request; And
And providing a map image through which the first image received from the position sensor included in the virtual reality photographing apparatus is photographed or in which a path movement information according to time is displayed through the display unit, How to provide. The method according to claim 1,
Wherein the step of requesting streaming for the first video and the second video comprises:
And requesting to provide the first image according to an output request for the first image in a state where the second image is provided. The method according to claim 1,
Wherein the step of simultaneously providing the first image window and the second image window comprises:
And adding the second image window to the first image window and varying the size of the second image window. The method according to claim 1,
Receiving a viewpoint change signal for the first image; And
And displaying the first image on the first image window at a time point corresponding to the viewpoint change signal. 5. The method of claim 4,
Wherein the step of receiving the view-
And receiving a drag signal through the touch input device or the pointing input device in the first image window. 5. The method of claim 4,
Wherein the step of receiving the view-
And receiving angle information of the device from a sensor. 5. The method of claim 4,
Further comprising providing a viewpoint for the first image in the first image window or separately as a two-dimensional image or a three-dimensional image,
Wherein the step of receiving the view-
And receiving an input corresponding to a point of time to change in the two-dimensional image or the three-dimensional image. A method of providing a virtual reality broadcast to a device including a display unit,
Requesting a video management server to stream a first video shot from a virtual reality shooting device and a second video shot from an imaging device other than the virtual reality shooting device;
Providing a first image window displaying the first image and a second image window displaying the second image simultaneously in response to the request;
Receiving a timeline variation signal for the first image; And
And displaying the first video in the first video window at a time varying in time corresponding to the timeline variation signal. delete The method according to claim 1,
And displaying timeline information corresponding to the location information or the path movement information in the map image. The method according to claim 1,
Receiving additional object data for the first image; And
And applying the additional object data to the first image to provide the additional object data. 12. The method of claim 11,
Wherein the additional object data comprises location information in the first video. The method according to claim 1,
Wherein the device is a mobile device,
And displaying the first image in a stereoscopic manner upon request. ≪ Desc / Clms Page number 21 > 14. The method of claim 13,
Wherein the step of displaying the first image in the stereoscopic manner comprises:
Further comprising providing only audio for the second video. ≪ Desc / Clms Page number 21 > A processor for requesting a video management server to stream a first image photographed from the virtual reality photographing apparatus and a second image photographed from the photographing apparatus, not the virtual reality photographing apparatus; And
And a display unit for providing a first image window for displaying the first image and a second image window for displaying the second image in response to the request through the processor,
Wherein the display unit further displays a map image in which the first image received from the position sensor included in the virtual reality photographing apparatus is photographed or path movement information according to time is displayed. 16. The method of claim 15,
And an input unit for receiving a viewpoint change signal for the first image,
The display unit includes:
Wherein the first image is displayed on the first image window at a time point corresponding to the viewpoint change signal. 17. The method of claim 16,
Wherein the input unit comprises:
And receiving a drag signal in the first image window. 17. The method of claim 16,
And a sensor for sensing angle information of a device providing the virtual reality broadcast.

Images