CN107103645B - virtual reality media file generation method and device - Google Patents
virtual reality media file generation method and device Download PDFInfo
- Publication number
- CN107103645B CN107103645B CN201710288923.5A CN201710288923A CN107103645B CN 107103645 B CN107103645 B CN 107103645B CN 201710288923 A CN201710288923 A CN 201710288923A CN 107103645 B CN107103645 B CN 107103645B
- Authority
- CN
- China
- Prior art keywords
- image
- virtual reality
- media file
- picture
- image group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000000007 visual effect Effects 0.000 claims abstract description 101
- 230000004044 response Effects 0.000 claims abstract description 10
- 238000012545 processing Methods 0.000 claims description 11
- 230000005540 biological transmission Effects 0.000 claims description 2
- 230000000694 effects Effects 0.000 description 26
- 230000008859 change Effects 0.000 description 10
- 210000000162 simple eye Anatomy 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 238000003384 imaging method Methods 0.000 description 6
- 230000004048 modification Effects 0.000 description 6
- 238000012986 modification Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 239000000463 material Substances 0.000 description 4
- 238000005303 weighing Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000009877 rendering Methods 0.000 description 3
- 239000011800 void material Substances 0.000 description 3
- 241000208340 Araliaceae Species 0.000 description 2
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 2
- 235000003140 Panax quinquefolius Nutrition 0.000 description 2
- VYPSYNLAJGMNEJ-UHFFFAOYSA-N Silicium dioxide Chemical compound O=[Si]=O VYPSYNLAJGMNEJ-UHFFFAOYSA-N 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 235000008434 ginseng Nutrition 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/97—Determining parameters from multiple pictures
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of virtual reality media file generation method and devices.Wherein, this method includes：It obtains to generate and ask, wherein generate request for requesting to generate virtual reality media file, generate and carried in request and the matched reference by location mark of virtual reality media file；Response generates request and obtains image group according to predetermined policy, wherein, one group of image group is used to indicate on the reference position in three-dimensional scenic in predetermined instant indicated by the reference identification of position, the multiple pictures got from multiple visual angles, every image are at least used to indicate the picture that a visual angle is got；Virtual reality media file is generated according to image group.The present invention solves and can not generate the excessively single technical problem of the content caused by virtual reality media file in the prior art.
Description
Technical field
The present invention relates to computer realms, in particular to a kind of virtual reality media file generation method and device.
Background technology
Currently, the media file for broadcasting generated in the prior art, is often made with physical hardware devices acquisition
Media file obtained from real world.
However, the media file obtained in this way, not only so that acquisition cost increases, but also the media generated
File still can only watch two-dimensional picture, the content of media file excessively single.
For above-mentioned problem, currently no effective solution has been proposed.
Invention content
An embodiment of the present invention provides a kind of virtual reality media file generation method and devices, at least to solve existing skill
The excessively single technical problem of content caused by virtual reality media file can not be generated in art.
One side according to the ... of the embodiment of the present invention provides a kind of virtual reality media text based on virtual reality scenario
Part generation method, including：It obtaining and generates request, wherein above-mentioned generation is asked for requesting to generate virtual reality media file, on
It states to carry in generation request and be identified with the matched reference by location of above-mentioned virtual reality media file；Above-mentioned generation request is responded to press
Image group is obtained according to predetermined policy, wherein one group of above-mentioned image group is used to indicate in three-dimensional scenic in predetermined instant in upper rheme
It sets on the reference position indicated by reference identification, the multiple pictures got from multiple visual angles, every image is at least used to indicate
The picture that one visual angle is got；Above-mentioned virtual reality media file is generated according to above-mentioned image group.
Another aspect according to the ... of the embodiment of the present invention additionally provides a kind of virtual reality media based on virtual reality scenario
File creating apparatus, including：First acquisition unit generates request for obtaining, wherein above-mentioned generation request is for requesting to generate
Virtual reality media file carries and the matched reference by location mark of above-mentioned virtual reality media file in above-mentioned generation request
Know；Second acquisition unit obtains image group, wherein one group of above-mentioned image for responding above-mentioned generation request according to predetermined policy
Group is used to indicate in three-dimensional scenic in predetermined instant on the indicated reference position of above-mentioned reference by location mark, from multiple visual angles
The multiple pictures got, every image are at least used to indicate the picture that a visual angle is got；Generation unit is used for root
Above-mentioned virtual reality media file is generated according to above-mentioned image group.
In embodiments of the present invention, after getting generation request, wherein generate and carried and virtual reality matchmaker in request
The matched reference by location mark of body file, the three-dimensional in three-dimensional scenic for rendering on reference position is obtained according to predetermined policy
The image group of picture, wherein be included in multiple pictures that predetermined instant is got from multiple visual angles in one group of image group, to generate
The virtual reality media file that 3-D effect in three-dimensional scenic can be presented, to reach broadcasting for abundant played media file
Put the purpose of content so that the side for playing virtual reality media file can see the three-dimensional on reference position from multiple visual angles
Picture realizes the effect for carrying out expansion of content to broadcasting content, and then solves and can not generate virtual reality matchmaker in the prior art
The excessively single technical problem of content caused by body file.
Description of the drawings
Attached drawing described herein is used to provide further understanding of the present invention, and is constituted part of this application, this hair
Bright illustrative embodiments and their description are not constituted improper limitations of the present invention for explaining the present invention.In the accompanying drawings：
Fig. 1 is a kind of virtual reality media file life optionally based on virtual reality scenario according to the ... of the embodiment of the present invention
At the application environment schematic diagram of method；
Fig. 2 is a kind of virtual reality media file life optionally based on virtual reality scenario according to the ... of the embodiment of the present invention
At the flow chart of method；
Fig. 3 is a kind of virtual reality media file life optionally based on virtual reality scenario according to the ... of the embodiment of the present invention
At the effect diagram of method；
Fig. 4 is another virtual reality media file optionally based on virtual reality scenario according to the ... of the embodiment of the present invention
The schematic diagram of generation method；
Fig. 5 is another virtual reality media file optionally based on virtual reality scenario according to the ... of the embodiment of the present invention
The schematic diagram of generation method；
Fig. 6 is a kind of virtual reality media file life optionally based on virtual reality scenario according to the ... of the embodiment of the present invention
At the effect diagram of method；
Fig. 7 is another virtual reality media file optionally based on virtual reality scenario according to the ... of the embodiment of the present invention
The schematic diagram of generation method；
Fig. 8 is a kind of virtual reality media file life optionally based on virtual reality scenario according to the ... of the embodiment of the present invention
At the schematic diagram of device；
Fig. 9 is a kind of virtual reality media file life optionally based on virtual reality scenario according to the ... of the embodiment of the present invention
At the schematic diagram of server.
Specific implementation mode
In order to enable those skilled in the art to better understand the solution of the present invention, below in conjunction in the embodiment of the present invention
Attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is only
The embodiment of a part of the invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill people
The every other embodiment that member is obtained without making creative work should all belong to the model that the present invention protects
It encloses.
It should be noted that term " first " in description and claims of this specification and above-mentioned attached drawing, "
Two " etc. be for distinguishing similar object, without being used to describe specific sequence or precedence.It should be appreciated that using in this way
Data can be interchanged in the appropriate case, so as to the embodiment of the present invention described herein can in addition to illustrating herein or
Sequence other than those of description is implemented.In addition, term " comprising " and " having " and their any deformation, it is intended that cover
It includes to be not necessarily limited to for example, containing the process of series of steps or unit, method, system, product or equipment to cover non-exclusive
Those of clearly list step or unit, but may include not listing clearly or for these processes, method, product
Or the other steps or unit that equipment is intrinsic.
Embodiment 1
In embodiments of the present invention, a kind of virtual reality media file generation method based on virtual reality scenario is provided
Embodiment, as an alternative embodiment, should virtual reality media file generation method based on virtual reality scenario
It can be, but not limited to be applied to application scenarios as shown in Figure 1, be applied to the smart machine of virtual reality scenario (as shown in Figure 1
Virtual reality glasses 102) in the first client is installed, server 106 passes through network 104 and obtains the life that the first client is sent
At request, wherein generation request carried for requesting to generate virtual reality media file, and in generation request with virtually
The real matched reference by location mark of media file；Server 106 responds above-mentioned generation request and obtains image according to predetermined policy
Group, wherein one group of image group is used to indicate the reference position in three-dimensional scenic in predetermined instant indicated by the reference identification of position
On, multiple pictures for being got from multiple visual angles, wherein every image is at least used to indicate the picture that a visual angle is got
Face；Then, according to the virtual reality media file got under above-mentioned image group generation virtual reality scenario.
In the present embodiment, after getting generation request, wherein carried in generation request and virtual reality media are literary
The matched reference by location mark of part, obtains the image group for generating virtual reality media file, wherein one according to predetermined policy
The group image group is used to indicate on the reference position in three-dimensional scenic in predetermined instant indicated by the reference identification of position, from multiple
Multiple pictures that visual angle is got, every image are at least used to indicate the picture that a visual angle is got；It is upper to utilize
It states image group and generates corresponding virtual reality media file.That is, obtaining on the reference position in three-dimensional scenic for being in
The image group of existing three-dimensional picture, wherein one group of image group includes being got from multiple visual angles in predetermined instant in three-dimensional scenic
Multiple pictures played with generating the virtual reality media file that 3-D effect in three-dimensional scenic is presented to reach abundant
Virtual reality media file broadcasting content purpose so that play virtual reality media file a side can be regarded from multiple
The three-dimensional picture on reference position is seen at angle, and then realizes the effect that expansion of content is carried out to virtual reality media file.
Optionally, in the present embodiment, above application is generated in the virtual reality media file based on virtual reality scenario
The equipment of method can include but is not limited to：Virtual reality (Virtual Reality, abbreviation VR) glasses and other for real
The hardware device of existing virtual reality scenario interaction.Above-mentioned only a kind of example, the present embodiment do not do this any restriction.
According to embodiments of the present invention, a kind of virtual reality media file generation side based on virtual reality scenario is provided
Method, as shown in Fig. 2, this method includes：
S202 is obtained and is generated request, wherein is generated request for requesting to generate virtual reality media file, is generated request
In carry and the matched reference by location of virtual reality media file identifies；
S204, response generate request and obtain image group according to predetermined policy, wherein one group of image group is used to indicate three dimensional field
On reference position in scape in predetermined instant indicated by the reference identification of position, the multiple pictures got from multiple visual angles, often
It opens image and is at least used to indicate the picture that a visual angle is got；
S206 generates virtual reality media file according to image group.
Optionally, in the present embodiment, above-mentioned virtual reality media file generation method can be, but not limited to be applied to not
It is same to have in the application of virtual reality scenario, and the application can provide three-dimensional picture material.For example, above application may include
But it is not limited to：Game application, shopping application etc..For example, the above-mentioned virtual reality media file based on virtual reality scenario generates
Method can be, but not limited to be applied in the game application with virtual reality scenario, acquires and joins in the three-dimensional scenic of game application
The three-dimensional picture material (such as image group) on position is examined, to generate the process for the virtual reality media file that 3-D effect is presented
In, that is to say, that the game video that 3-D effect is presented in three-dimensional scenic can be recorded).Above-mentioned is only a kind of example, this implementation
Any restriction is not done to this in example.
It should be noted that after getting generation request, wherein carried in generation request and virtual reality media are literary
The matched reference by location mark of part, obtains the image group for generating virtual reality media file, wherein one according to predetermined policy
The group image group is used to indicate on the reference position in three-dimensional scenic in predetermined instant indicated by the reference identification of position, from multiple
Multiple pictures that visual angle is got, every image are at least used to indicate the picture that a visual angle is got；It is upper to utilize
It states image group and generates corresponding virtual reality media file.That is, obtaining on the reference position in three-dimensional scenic for being in
The image group of existing three-dimensional picture, wherein one group of image group includes being got from multiple visual angles in predetermined instant in three-dimensional scenic
Multiple pictures played with generating the virtual reality media file that 3-D effect in three-dimensional scenic is presented to reach abundant
Virtual reality media file broadcasting content purpose so that play virtual reality media file a side can be regarded from multiple
The three-dimensional picture on reference position is seen at angle, and then realizes the effect that expansion of content is carried out to virtual reality media file.
Optionally, in the present embodiment, above-mentioned generation request can be, but not limited to use the first client of the first account
The generation request that end is sent, requested virtual reality media file can be, but not limited to have incidence relation with the first account,
For example, the above-mentioned position indicated with the matched reference by location mark of virtual reality media file can include but is not limited to：Three
Tie up the position in scene where virtual portrait role used in the first account, the fixation predeterminated position in three-dimensional scenic.It is above-mentioned
Only it is a kind of example, any restriction is not done to this in the present embodiment.
Optionally, in the present embodiment, it after generating virtual reality media file according to image group, can be, but not limited to
Virtual reality media file transmitting is given to the second account, so that the second account plays virtual reality media file, wherein the second account
Number with the first account be associated account number.For example, the second account and the first account are the good friend's account paid close attention to mutually, or have and award
The associated account number of power does not do this any restriction in the present embodiment.
It should be noted that above-mentioned second account can be, but not limited to close with the first account in the application for the first account institute
Good friend's account of connection, the virtual reality media file that the second account is pushed by playing the first account, wherein virtual reality matchmaker
Body file includes based on reference position, and the different pictures got with different view are three-dimensional to watch the first account place
Three-dimensional picture in scene.For example, the first account and application where the second account can be game application, to realize
Using interior shared virtual reality media file；In addition, in the present embodiment, above-mentioned second account can also but be not limited to and the
Account in the different application of application where one account, two kinds of applications have incidence relation, for example, application is awarded where the first account
The above-mentioned virtual reality media file of application plays where weighing the second account.For example, application where the first account can be trip
Play application, application where the second account can be to play application, wherein game application mandate plays application, allows to play and apply
Generated virtual reality media file is played, to realize cross-platform sharing media data.Above-mentioned is only a kind of example, this reality
It applies and does not do any restriction in example to this.
Optionally, in the present embodiment, it can be, but not limited to from virtual reality matchmaker using the second client of the second account
The picture to match with the visual angle of the second client is obtained in body file to play out.That is, the second account is regarded by broadcasting
Angle is limited, and the picture to match with visual angle will be played.It should be noted that as the second account plays the change at visual angle, broadcast
The picture put can change therewith, and the different pictures got with different view in traversal virtual reality media file may be implemented.
Optionally, in the present embodiment, respond generation request includes according to predetermined policy acquisition image group：
1) in the case where it is media data packet to generate the generated virtual reality media file of request instruction, according to predetermined
Strategy obtains multiple series of images group within a predetermined period of time, wherein the when a length of virtual reality media file of predetermined amount of time
Playing duration；And/or
2) in the case where it is Media Stream to generate the generated virtual reality media file of request instruction, according to predetermined policy
Real-time image acquisition group.
It should be noted that in the present embodiment, above-mentioned virtual reality media file can be, but not limited to as media data
Packet, for example, above-mentioned virtual reality media file can be the complete video resource being generated in advance.By obtaining predetermined amount of time
Interior multiple series of images group is playing end by broadcasting to generate complete video resource using above-mentioned multiple series of images group to realize
The acquisition request video resource is put, to play above-mentioned generated virtual reality media file；In addition, in the present embodiment, on
It states virtual reality media file and can also but be not limited to Media Stream, for example, above-mentioned virtual reality media file can be fluxion
According to.By obtaining the image group at corresponding moment in real time, to generate Media Stream, above-mentioned give birth to is broadcast live during live streaming to realize
At virtual reality media file.
Optionally, in the present embodiment, above-mentioned predetermined policy can include but is not limited at least one of：
1) simple eye strategy, using the indicated reference position of above-mentioned reference position mark as reference center, opposite reference center
Build cube；The picture that will be got on cubical each surface, as the image in image group, wherein cube
A surface correspond to a visual angle.
That is, using a reference position as the center of referring to, the cube that will be built centered on the reference position
Six surfaces on picture three-dimensional scenic is generated based on above-mentioned image group to realize as six images in image group
In based on simple eye virtual reality media file.
2) eyes strategy, using the indicated reference position of above-mentioned reference position mark as reference center, preset distance is ginseng
Radius is examined, circle of reference is obtained；Multiple collection points are uniformly obtained on circle of reference, wherein the field range of multiple collection points covers
360 degree of panoramas；The picture within the scope of predetermined field-of-view angle is obtained on each collection point in multiple collection points respectively, as figure
As the image in group, wherein a collection point at least corresponds to a visual angle.
That is, using the collection point on circle of reference as the reference of two eyes of left eye and right eye, left eye is existed respectively
The picture within the scope of predetermined field-of-view angle got on each collection point, gets on each collection point respectively with right eye
Picture within the scope of predetermined field-of-view angle, and the top image above circle of reference and the base map picture below circle of reference,
As the image in image group, the virtual reality media based on eyes in three-dimensional scenic are generated based on above-mentioned image group to realize
File.
Optionally, in the present embodiment, predetermined field-of-view angle is obtained respectively on each collection point in multiple collection points
Picture in range includes：It rotates in the direction of the clock, it will be within the scope of the predetermined field-of-view angle that got on each collection point
Picture, as the image in the first image set；And rotate counterclockwise, it is predetermined by what is got on each collection point
Picture within the scope of field-of-view angle, as the image in the second image set；Figure is obtained according to the first image set and the second image set
As group.Wherein, above-mentioned multiple collection points can be, but not limited to as equally distributed four collection points on circle of reference, each deformity point
Predetermined field-of-view angle range can be, but not limited to be more than or equal to 90 degree.Above-mentioned is only a kind of example, and the present embodiment does not do this
Any restriction.
Optionally, in the present embodiment, by repeating following steps, to obtain whole figures in one group of image group
Picture；
S12 obtains the picture in current visual angle as an image in image group；
S14 judges whether to get all images in image group；
S16 adjusts visual angle, to obtain in next visual angle in the case of all images during image group has not been obtained
Picture as next image in image group.
It should be noted that can be, but not limited to automatically switch visual angle in the present embodiment, to obtain in different visual angles
Picture is as the image in image group, after all images in obtaining one group of image group, can push to broadcasting end and be broadcast
It puts.
It is specifically illustrated in conjunction with following example, repeats following steps, can presented three in three-dimensional scenic with generating
Tie up the VR virtual reality media files of effect：
(1) mouse and/or keyboard operation, the mouse-keyboard event that shielding mouse and/or keyboard operation are generated are obtained.Example
Such as, corresponding input source is window message, directx input etc..When changing due to visual angle, on screen the mapping of 2D to 3D changed
Become, the mouse-keyboard event that this when responds mouse and/or keyboard operation is generated, it may occur that unexpected behavior, because
And in the present embodiment, actively do not obtain user's operation by the message for intercepting shielding user's operation or in current period
Message.
(2) modification adjustment visual angle.It is to need to generate based on simple eye virtual reality media file, still according to current strategies
Virtual reality media file based on eyes, must constantly change current visual angle in current period, for example, based on simple eye
Virtual reality media file will adjust separately obtain designated position (such as reference position) before, it is right, rear, left, upper and lower, six regard
The corresponding view picture in angle, the field-of-view angle at each visual angle can be, but not limited to be 90 degree respectively；Alternatively, based on the virtual of eyes
Real media file will adjust separately obtain designated position (such as reference position) in front of eye left, front is eyed right, right to the left
See, right is eyed right, rear is eyed left, rear is eyed right, left is eyed left, left is eyed right, above and below, each visual angle regards
Wild angle can be, but not limited to be 100 degree.In this way, the image group got will can cover the entire 3D generation based on reference position
The picture on boundary.Find the place at setting visual angle, in the present embodiment, can be, but not limited to actively by the interface of directx such as
D3DXMatrixLookAtLH, D3DXMatrixPerspectiveFovLH, SetTransform etc. modify, or game
Interface help modification is provided.
(3) drafting of 2D contents is shielded.Wherein, 2D contents may include：Prompt message, chat message etc..At this
In embodiment, it can be, but not limited to be shielded by the entrance that 2D is rendered, or do not render 2D elements in current period.
(4) it obtains game the 3D section and corresponds to the 2D images projected into, be not rendered into screen.Calling similar directx
Corresponding 2D images can be generated after EndScene interfaces, image data can be taken out by similar lock interfaces
Come.But these pictures are not shown on screen, can be accomplished by shielding the methods of Present.
(5) it can be, but not limited to obtain for generating virtual reality media file using two kinds of strategies in the present embodiment,
Wherein, the image group that simple eye strategy opens generation based on cubical one group six, to generate virtual reality media file, eyes plan
One group of 10 image group opened will slightly be generated.In the present embodiment, the square of interception middle section is can be, but not limited to, then by institute
Some figures are combined into one big figure.Various resolution problems can also be matched with this.Wherein, the image group opened for one group 10 can with but
It is not limited to conversion and is fused into 2 panoramic pictures for being respectively used to left eye and right eye viewing.
(6) image group is sent in video encoder, generates corresponding video frame, and then obtain finally being played
Virtual reality file.Virtual reality file can be, but not limited to using the solution ffmpeg that increases income.
By embodiment provided by the present application, the three-dimensional picture in three-dimensional scenic for rendering on reference position is obtained
Image group, wherein be included in multiple pictures that predetermined instant is got from multiple visual angles in one group of image group, to generate three dimensional field
The virtual reality media file that 3-D effect can be presented in scape, to reach abundant played virtual reality media file
The purpose of broadcasting content so that the side for playing virtual reality media file can see three on reference position from multiple visual angles
Picture is tieed up, and then realizes the effect for carrying out expansion of content to virtual reality media file.
As a kind of optional scheme, response generates request and includes according to predetermined policy acquisition image group：
S1, using reference position as reference center, opposite reference center builds cube；
S2, the picture that will be got on cubical each surface, as the image in image group, wherein cube
A surface correspond to a visual angle.
It specifically combines and is illustrated shown in Fig. 3, for example, reference position is by taking cube center shown in Fig. 3 as an example, relatively
After the reference center builds cube, the picture that will be got on cubical each surface is can be, but not limited to, such as six
Six pictures on a surface, as six images in image group, wherein a cubical surface corresponds to a visual angle.
That is, using the picture on a surface as the picture at a visual angle, as an image in the image group got.
By embodiment provided by the present application, by using reference position as reference center, opposite reference center structure cube
Body, as the image in image group, one is based on to generate to realize the picture that will be got on cubical each surface
The virtual reality media file of a reference position, to achieve the effect that the file content of rich-media file.
As a kind of optional scheme, response generates request and includes according to predetermined policy acquisition image group：
S1, using reference position as reference center, preset distance is reference radius, obtains circle of reference；
S2 uniformly obtains multiple collection points on circle of reference, wherein the field range of multiple collection points covers 360 degree entirely
Scape；
S3 obtains the picture within the scope of predetermined field-of-view angle on each collection point in multiple collection points respectively, as
Image in image group a, wherein collection point at least corresponds to a visual angle.
It specifically combines and is illustrated shown in Fig. 4, it is assumed that using O as reference center, preset distance r is with reference to half for reference position
Diameter obtains circle of reference, and uniformly obtains four collection points on circle of reference, as shown in figure 4, respectively collection point A, collection point B,
Collection point C and collection point D is with 90 degree wherein the field range of each collection point can be, but not limited to be more than or equal to 90 degree
Example.90 degree of pictures within the vision are obtained on each collection point in multiple collection points respectively.That is, one is adopted
Picture of the picture of collection point acquisition as a visual angle, as an image in the image group got.
For example it is assumed that left eye on A points, sees that the visual field for obtaining one 90 degree to A ' is imaged P1.Then the point centered on O
On mobile left eye to B points, see that the visual field that one 90 degree are obtained to B ' is imaged P2.Merge P1 and P2 and obtain P, P will be used as left eye from
A points are moved to image that B points are seen during this and are then moved to from the point of view of C to C`, are moved to from the point of view of D to D`, so that it may with
It obtains a left eye and is rotated by 360 ° the panoramic picture seen.Further, figure is counterclockwise taken with A, B, C, D, the right side can be obtained
360 degree of panoramic pictures seen of eye.
For example, for shown in Fig. 5, left eye in A points to E ' points, in B points, to E ' points, by eyes folded by right eye
Add viewing, then can obtain three-dimensional imaging effect of the eyes in three-dimensional scenic.
By embodiment provided by the present application, it is reference center to pass to reference position, and preset distance is reference radius, is obtained
Circle of reference, to realize by the picture that multiple collection points are got on circle of reference, as the image in image group, to realize base
Generate more accurate virtual reality media file in multiple collection points, to reach rich-media file file content effect
Fruit.
As a kind of optional scheme, predetermined field-of-view angle model is obtained on each collection point in multiple collection points respectively
Enclosing interior picture includes：
S1 rotates in the direction of the clock, by the picture within the scope of the predetermined field-of-view angle got on each collection point,
As the image in the first image set；And it rotates counterclockwise, the predetermined angle of visibility that will be got on each collection point
The picture in range is spent, as the image in the second image set；
S2 obtains image group according to the first image set and the second image set.
Optionally, in the present embodiment, obtaining image group according to the first image set and the second image set includes：To the first figure
Two images adjacent two-by-two execute image co-registration processing in image set, and are held to two images adjacent two-by-two in the second image set
Row image co-registration processing, wherein predetermined field-of-view angle is ranging from more than or equal to 90 degree.
It should be noted that when A sees and seen to A ', B to the image of B ', it is practical because being the imaging seen in different location
When fitting, two adjacent images will have the error of any two-by-two.It, in the present embodiment, can in order to reduce error
With but be not limited to field-of-view angle range being adjusted to 100 degree from 90 degree, and transitional region can be done based on Image Fusion
It is smoother.
Optionally, in the present embodiment, obtaining image group according to the first image set and the second image set includes：By the first figure
Image in image set merges into the first panoramic picture, and the image in the second image set is merged into the second panoramic picture, wherein
Image group includes the first panoramic picture and the second panoramic picture.
It specifically combines and is illustrated shown in Fig. 6, it is assumed that the first image set is based on left eye the image collected, the second image
Collection is, based on right eye the image collected, in the present embodiment, can be, but not limited in the server will be in the first image set
Image merges to obtain the first panoramic picture, the panoramic picture as shown in above Fig. 6, merges to obtain the by the image in the second image set
Two panoramic pictures, the panoramic picture as shown in below Fig. 6.Using above-mentioned first panoramic picture and the second panoramic picture as in image group
Parts of images, include the virtual reality media file of three-dimensional picture to generate.To realize in imaging process, left eye viewing
First panoramic picture, right eye watch the second panoramic picture, to reach the mistake for playing virtual reality media file in three-dimensional scenic
Cheng Zhong, the more virtual reality contents of media files that can be obtained.
Optionally, in the present embodiment, image group further includes：Top image above circle of reference and under circle of reference
The base map picture of side.
It specifically combines and is illustrated shown in Fig. 7, it is assumed that still by taking four collection points on circle of reference as an example, eyes exist respectively
Four collection points obtain picture as the image in image group, for example, being rotated clockwise four collection points, to obtain left eye
Four view pictures, as shown in the left sides Fig. 7, front view, left view, rearview and the right view of left eye；It is inverse four collection points
Hour hands rotate, to obtain four view pictures of right eye, as shown on the right side of Fig. 7, the front view of right eye, left view, rearview and
Right view.Further, then the top image above circle of reference and the base map picture below circle of reference are obtained, is obtained to realize
Take ten images based on eyes as one group of image group.
By embodiment provided by the present application, by obtaining the first image set corresponding with right and left eyes and the second image respectively
Collection, to generate the virtual reality media file based on eyes, and it is further by being carried out to the first image and the second image set
Merging treatment is merged, so that the virtual reality media file generated is more accurate true.
As a kind of optional scheme, above-mentioned acquisition generates request and includes：Obtain the first client using the first account
The generation of transmission is asked；After generating virtual reality media file according to image group, further include：By virtual reality media file
It is pushed to the second account, so that the second account plays virtual reality media file, wherein the second account is to be associated with the first account
Account.
Optionally, after by virtual reality media file transmitting to the second account, further include：Use the of the second account
Two clients obtain virtual reality media file；Second client obtains and the second client from virtual reality media file
The picture that visual angle matches plays out.
It should be noted that above-mentioned second account can be, but not limited to close with the first account in the application for the first account institute
Good friend's account of connection, the virtual reality media file that the second account is pushed by playing the first account, wherein virtual reality matchmaker
Body file includes based on reference position, and the different pictures got with different view are three-dimensional to watch the first account place
Three-dimensional picture in scene.For example, the first account and application where the second account can be game application, to realize
Using interior shared virtual reality media file；In addition, in the present embodiment, above-mentioned second account can also but be not limited to and the
Account in the different application of application where one account, two kinds of applications have incidence relation, for example, application is awarded where the first account
The above-mentioned virtual reality media file of application plays where weighing the second account.For example, application where the first account can be trip
Play application, application where the second account can be to play application, wherein game application mandate plays application, allows to play and apply
Generated virtual reality media file is played, to realize cross-platform sharing media data.Above-mentioned is only a kind of example, this reality
It applies and does not do any restriction in example to this.
Optionally, in the present embodiment, it can be, but not limited to from virtual reality matchmaker using the second client of the second account
The picture to match with the visual angle of the second client is obtained in body file to play out.That is, the second account is regarded by broadcasting
Angle is limited, and the picture to match with visual angle will be played.It should be noted that as the second account plays the change at visual angle, broadcast
The picture put can change therewith, and the different pictures got with different view in traversal virtual reality media file may be implemented.
By embodiment provided by the present application, the second account can obtain the void of the first account push by the second client
Quasi- reality media file, to realize the shared of media data, in addition, the second account can watch the by the second client
Virtual reality media file of one account in three-dimensional scenic will attract more users to participate in, improve the attention rate of application.
It should be noted that for each method embodiment above-mentioned, for simple description, therefore it is all expressed as a series of
Combination of actions, but those skilled in the art should understand that, the present invention is not limited by the described action sequence because
According to the present invention, certain steps can be performed in other orders or simultaneously.Secondly, those skilled in the art should also know
It knows, embodiment described in this description belongs to preferred embodiment, and involved action and module are not necessarily of the invention
It is necessary.
Through the above description of the embodiments, those skilled in the art can be understood that according to above-mentioned implementation
The method of example can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but it is very much
In the case of the former be more preferably embodiment.Based on this understanding, technical scheme of the present invention is substantially in other words to existing
The part that technology contributes can be expressed in the form of software products, which is stored in a storage
In medium (such as ROM/RAM, magnetic disc, CD), including some instructions are used so that a station terminal equipment (can be mobile phone, calculate
Machine, server or network equipment etc.) execute method described in each embodiment of the present invention.
Embodiment 2
According to embodiments of the present invention, it additionally provides a kind of for implementing the above-mentioned virtual reality based on virtual reality scenario
The virtual reality media file generating means based on virtual reality scenario of media file generation method, as shown in figure 8, the device
Including：
1) first acquisition unit 802 generate request for obtaining, wherein generate request for requesting to generate virtual reality
Media file is generated and is carried in request and the matched reference by location mark of virtual reality media file；
2) second acquisition unit 804 generate request according to predetermined policy acquisition image group, wherein a group picture for responding
It is used to indicate on the reference position in three-dimensional scenic in predetermined instant indicated by the reference identification of position as group, is obtained from multiple visual angles
The multiple pictures got, every image are at least used to indicate the picture that a visual angle is got；
3) generation unit 806, for generating virtual reality media file according to image group.
Optionally, in the present embodiment, above-mentioned virtual reality media file generating means can be, but not limited to be applied to not
It is same to have in the application of virtual reality scenario, and the application can provide three-dimensional picture material.For example, above application may include
But it is not limited to：Game application, shopping application etc..For example, the above-mentioned virtual reality media file based on virtual reality scenario generates
Method can be, but not limited to be applied in the game application with virtual reality scenario, acquires and joins in the three-dimensional scenic of game application
The three-dimensional picture material (such as image group) on position is examined, to generate the process for the virtual reality media file that 3-D effect is presented
In, that is to say, that the game video that 3-D effect is presented in three-dimensional scenic can be recorded).Above-mentioned is only a kind of example, this implementation
Any restriction is not done to this in example.
It should be noted that after getting generation request, wherein carried in generation request and virtual reality media are literary
The matched reference by location mark of part, obtains the image group for generating virtual reality media file, wherein one according to predetermined policy
The group image group is used to indicate on the reference position in three-dimensional scenic in predetermined instant indicated by the reference identification of position, from multiple
Multiple pictures that visual angle is got, every image are at least used to indicate the picture that a visual angle is got；It is upper to utilize
It states image group and generates corresponding virtual reality media file.That is, obtaining on the reference position in three-dimensional scenic for being in
The image group of existing three-dimensional picture, wherein one group of image group includes being got from multiple visual angles in predetermined instant in three-dimensional scenic
Multiple pictures played with generating the virtual reality media file that 3-D effect in three-dimensional scenic is presented to reach abundant
Virtual reality media file broadcasting content purpose so that play virtual reality media file a side can be regarded from multiple
The three-dimensional picture on reference position is seen at angle, and then realizes the effect that expansion of content is carried out to virtual reality media file.
Optionally, in the present embodiment, above-mentioned generation request can be, but not limited to use the first client of the first account
The generation request that end is sent, requested virtual reality media file can be, but not limited to have incidence relation with the first account,
For example, the above-mentioned position indicated with the matched reference by location mark of virtual reality media file can include but is not limited to：Three
Tie up the position in scene where virtual portrait role used in the first account, the fixation predeterminated position in three-dimensional scenic.It is above-mentioned
Only it is a kind of example, any restriction is not done to this in the present embodiment.
Optionally, in the present embodiment, further include：Push unit, for generating virtual reality media according to image group
After file, virtual reality media file transmitting is given to the second account, so that the second account plays virtual reality media file,
In, the second account is associated account number with the first account.For example, the second account and the first account are the good friend's account paid close attention to mutually,
Or the associated account number with mandate, any restriction is not done to this in the present embodiment.
It should be noted that above-mentioned second account can be, but not limited to close with the first account in the application for the first account institute
Good friend's account of connection, the virtual reality media file that the second account is pushed by playing the first account, wherein virtual reality matchmaker
Body file includes based on reference position, and the different pictures got with different view are three-dimensional to watch the first account place
Three-dimensional picture in scene.For example, the first account and application where the second account can be game application, to realize
Using interior shared virtual reality media file；In addition, in the present embodiment, above-mentioned second account can also but be not limited to and the
Account in the different application of application where one account, two kinds of applications have incidence relation, for example, application is awarded where the first account
The above-mentioned virtual reality media file of application plays where weighing the second account.For example, application where the first account can be trip
Play application, application where the second account can be to play application, wherein game application mandate plays application, allows to play and apply
Generated virtual reality media file is played, to realize cross-platform sharing media data.Above-mentioned is only a kind of example, this reality
It applies and does not do any restriction in example to this.
Optionally, in the present embodiment, it can be, but not limited to from virtual reality matchmaker using the second client of the second account
The picture to match with the visual angle of the second client is obtained in body file to play out.That is, the second account is regarded by broadcasting
Angle is limited, and the picture to match with visual angle will be played.It should be noted that as the second account plays the change at visual angle, broadcast
The picture put can change therewith, and the different pictures got with different view in traversal virtual reality media file may be implemented.
Optionally, in the present embodiment, respond generation request includes according to predetermined policy acquisition image group：
1) in the case where it is media data packet to generate the generated virtual reality media file of request instruction, according to predetermined
Strategy obtains multiple series of images group within a predetermined period of time, wherein the when a length of virtual reality media file of predetermined amount of time
Playing duration；And/or
2) in the case where it is Media Stream to generate the generated virtual reality media file of request instruction, according to predetermined policy
Real-time image acquisition group.
It should be noted that in the present embodiment, above-mentioned virtual reality media file can be, but not limited to as media data
Packet, for example, above-mentioned virtual reality media file can be the complete video resource being generated in advance.By obtaining predetermined amount of time
Interior multiple series of images group is playing end by broadcasting to generate complete video resource using above-mentioned multiple series of images group to realize
The acquisition request video resource is put, to play above-mentioned generated virtual reality media file；In addition, in the present embodiment, on
It states virtual reality media file and can also but be not limited to Media Stream, for example, above-mentioned virtual reality media file can be fluxion
According to.By obtaining the image group at corresponding moment in real time, to generate Media Stream, above-mentioned give birth to is broadcast live during live streaming to realize
At virtual reality media file.
Optionally, in the present embodiment, above-mentioned predetermined policy can include but is not limited at least one of：
1) simple eye strategy, using the indicated reference position of above-mentioned reference position mark as reference center, opposite reference center
Build cube；The picture that will be got on cubical each surface, as the image in image group, wherein cube
A surface correspond to a visual angle.
That is, using a reference position as the center of referring to, the cube that will be built centered on the reference position
Six surfaces on picture three-dimensional scenic is generated based on above-mentioned image group to realize as six images in image group
In based on simple eye virtual reality media file.
2) eyes strategy, using the indicated reference position of above-mentioned reference position mark as reference center, preset distance is ginseng
Radius is examined, circle of reference is obtained；Multiple collection points are uniformly obtained on circle of reference, wherein the field range of multiple collection points covers
360 degree of panoramas；The picture within the scope of predetermined field-of-view angle is obtained on each collection point in multiple collection points respectively, as figure
As the image in group, wherein a collection point at least corresponds to a visual angle.
That is, using the collection point on circle of reference as the reference of two eyes of left eye and right eye, left eye is existed respectively
The picture within the scope of predetermined field-of-view angle got on each collection point, gets on each collection point respectively with right eye
Picture within the scope of predetermined field-of-view angle, and the top image above circle of reference and the base map picture below circle of reference,
As the image in image group, the virtual reality media based on eyes in three-dimensional scenic are generated based on above-mentioned image group to realize
File.
Optionally, in the present embodiment, predetermined field-of-view angle is obtained respectively on each collection point in multiple collection points
Picture in range includes：It rotates in the direction of the clock, it will be within the scope of the predetermined field-of-view angle that got on each collection point
Picture, as the image in the first image set；And rotate counterclockwise, it is predetermined by what is got on each collection point
Picture within the scope of field-of-view angle, as the image in the second image set；Figure is obtained according to the first image set and the second image set
As group.Wherein, above-mentioned multiple collection points can be, but not limited to as equally distributed four collection points on circle of reference, each deformity point
Predetermined field-of-view angle range can be, but not limited to be more than or equal to 90 degree.Above-mentioned is only a kind of example, and the present embodiment does not do this
Any restriction.
Optionally, in the present embodiment, second acquisition unit 804 includes：Processing module, for following by repeating
Step, to obtain all images in one group of image group；
S1 obtains the picture in current visual angle as an image in image group；
S2 judges whether to get all images in image group；
S3 adjusts visual angle, to obtain in next visual angle in the case of all images during image group has not been obtained
Picture is as next image in image group.
It should be noted that can be, but not limited to automatically switch visual angle in the present embodiment, to obtain in different visual angles
Picture is as the image in image group, after all images in obtaining one group of image group, can push to broadcasting end and be broadcast
It puts.
It is specifically illustrated in conjunction with following example, repeats following steps, can presented three in three-dimensional scenic with generating
Tie up the VR virtual reality media files of effect：
(1) mouse and/or keyboard operation, the mouse-keyboard event that shielding mouse and/or keyboard operation are generated are obtained.Example
Such as, corresponding input source is window message, directx input etc..When changing due to visual angle, on screen the mapping of 2D to 3D changed
Become, the mouse-keyboard event that this when responds mouse and/or keyboard operation is generated, it may occur that unexpected behavior, because
And in the present embodiment, actively do not obtain user's operation by the message for intercepting shielding user's operation or in current period
Message.
(2) modification adjustment visual angle.It is to need to generate based on simple eye virtual reality media file, still according to current strategies
Virtual reality media file based on eyes, must constantly change current visual angle in current period, for example, based on simple eye
Virtual reality media file will adjust separately obtain designated position (such as reference position) before, it is right, rear, left, upper and lower, six regard
The corresponding view picture in angle, the field-of-view angle at each visual angle can be, but not limited to be 90 degree respectively；Alternatively, based on the virtual of eyes
Real media file will adjust separately obtain designated position (such as reference position) in front of eye left, front is eyed right, right to the left
See, right is eyed right, rear is eyed left, rear is eyed right, left is eyed left, left is eyed right, above and below, each visual angle regards
Wild angle can be, but not limited to be 100 degree.In this way, the image group got will can cover the entire 3D generation based on reference position
The picture on boundary.Find the place at setting visual angle, in the present embodiment, can be, but not limited to actively by the interface of directx such as
D3DXMatrixLookAtLH, D3DXMatrixPerspectiveFovLH, SetTransform etc. modify, or game
Interface help modification is provided.
(3) drafting of 2D contents is shielded.Wherein, 2D contents may include：Prompt message, chat message etc..At this
In embodiment, it can be, but not limited to be shielded by the entrance that 2D is rendered, or do not render 2D elements in current period.
(4) it obtains game the 3D section and corresponds to the 2D images projected into, be not rendered into screen.Calling similar directx
Corresponding 2D images can be generated after EndScene interfaces, image data can be taken out by similar lock interfaces
Come.But these pictures are not shown on screen, can be accomplished by shielding the methods of Present.
(5) it can be, but not limited to obtain for generating virtual reality media file using two kinds of strategies in the present embodiment,
Wherein, the image group that simple eye strategy opens generation based on cubical one group six, to generate virtual reality media file, eyes plan
One group of 10 image group opened will slightly be generated.In the present embodiment, the square of interception middle section is can be, but not limited to, then by institute
Some figures are combined into one big figure.Various resolution problems can also be matched with this.Wherein, the image group opened for one group 10 can with but
It is not limited to conversion and is fused into 2 panoramic pictures for being respectively used to left eye and right eye viewing.
(6) image group is sent in video encoder, generates corresponding video frame, and then obtain finally being played
Virtual reality file.Virtual reality file can be, but not limited to using the solution ffmpeg that increases income.
By embodiment provided by the present application, the three-dimensional picture in three-dimensional scenic for rendering on reference position is obtained
Image group, wherein be included in multiple pictures that predetermined instant is got from multiple visual angles in one group of image group, to generate three dimensional field
The virtual reality media file that 3-D effect can be presented in scape, to reach abundant played virtual reality media file
The purpose of broadcasting content so that the side for playing virtual reality media file can see three on reference position from multiple visual angles
Picture is tieed up, and then realizes the effect for carrying out expansion of content to virtual reality media file.
As a kind of optional scheme, second acquisition unit 804 includes：
1) the first acquisition module, for being media data packet generating the generated virtual reality media file of request instruction
In the case of, obtain multiple series of images group within a predetermined period of time according to predetermined policy, wherein the when a length of void of predetermined amount of time
The playing duration of quasi- reality media file；And/or
2) the second acquisition module, for generating the feelings that the generated virtual reality media file of request instruction is Media Stream
Under condition, according to predetermined policy real-time image acquisition group.
It specifically combines and is illustrated shown in Fig. 3, for example, reference position is by taking cube center shown in Fig. 3 as an example, relatively
After the reference center builds cube, the picture that will be got on cubical each surface is can be, but not limited to, such as six
Six pictures on a surface, as six images in image group, wherein a cubical surface corresponds to a visual angle.
That is, using the picture on a surface as the picture at a visual angle, as an image in the image group got.
By embodiment provided by the present application, by using reference position as reference center, opposite reference center structure cube
Body, as the image in image group, one is based on to generate to realize the picture that will be got on cubical each surface
The virtual reality media file of a reference position, to achieve the effect that the file content of rich-media file.
As a kind of optional scheme, second acquisition unit 804 includes：
1) module is built, for using reference position as reference center, opposite reference center to build cube；
2) third acquisition module, the picture for will be got on cubical each surface, as in image group
Image, wherein a cubical surface corresponds to a visual angle.
It specifically combines and is illustrated shown in Fig. 4, it is assumed that using O as reference center, preset distance r is with reference to half for reference position
Diameter obtains circle of reference, and uniformly obtains four collection points on circle of reference, as shown in figure 4, respectively collection point A, collection point B,
Collection point C and collection point D is with 90 degree wherein the field range of each collection point can be, but not limited to be more than or equal to 90 degree
Example.90 degree of pictures within the vision are obtained on each collection point in multiple collection points respectively.That is, one is adopted
Picture of the picture of collection point acquisition as a visual angle, as an image in the image group got.
For example it is assumed that left eye on A points, sees that the visual field for obtaining one 90 degree to A ' is imaged P1.Then the point centered on O
On mobile left eye to B points, see that the visual field that one 90 degree are obtained to B ' is imaged P2.Merge P1 and P2 and obtain P, P will be used as left eye from
A points are moved to image that B points are seen during this and are then moved to from the point of view of C to C`, are moved to from the point of view of D to D`, so that it may with
It obtains a left eye and is rotated by 360 ° the panoramic picture seen.Further, figure is counterclockwise taken with A, B, C, D, the right side can be obtained
360 degree of panoramic pictures seen of eye.
For example, for shown in Fig. 5, left eye in A points to E ' points, in B points, to E ' points, by eyes folded by right eye
Add viewing, then can obtain three-dimensional imaging effect of the eyes in three-dimensional scenic.
By embodiment provided by the present application, it is reference center to pass to reference position, and preset distance is reference radius, is obtained
Circle of reference, to realize by the picture that multiple collection points are got on circle of reference, as the image in image group, to realize base
Generate more accurate virtual reality media file in multiple collection points, to reach rich-media file file content effect
Fruit.
As a kind of optional scheme, second acquisition unit 804 includes：
1) the 4th acquisition module is used for using reference position as reference center, and preset distance is reference radius, obtains reference
Circle；
2) the 5th acquisition module, for uniformly obtaining multiple collection points on circle of reference, wherein the visual field of multiple collection points
Range covers 360 degree of panoramas；
3) the 6th acquisition module obtains predetermined field-of-view angle model respectively on each collection point in multiple collection points
Interior picture is enclosed, as the image in image group, wherein a collection point at least corresponds to a visual angle.
Optionally, in the present embodiment, the 6th acquisition module includes：
(1) first acquisition submodule predetermined is regarded for rotating in the direction of the clock by what is got on each collection point
Picture in wild angular range, as the image in the first image set；And rotate counterclockwise, it will be on each collection point
The picture within the scope of predetermined field-of-view angle got, as the image in the second image set；
(2) second acquisition submodules, for obtaining image group according to the first image set and the second image set.
Optionally, in the present embodiment, the second acquisition submodule is realized by following steps according to the first image set and the
Two image sets obtain image group：Image co-registration processing is executed to two images adjacent two-by-two in the first image set, and to second
Two images adjacent two-by-two execute image co-registration processing in image set, wherein predetermined field-of-view angle is ranging from more than or equal to 90
Degree.
It should be noted that when A sees and seen to A ', B to the image of B ', it is practical because being the imaging seen in different location
When fitting, two adjacent images will have the error of any two-by-two.It, in the present embodiment, can in order to reduce error
With but be not limited to field-of-view angle range being adjusted to 100 degree from 90 degree, and transitional region can be done based on Image Fusion
It is smoother.
Optionally, in the present embodiment, the second acquisition submodule is realized by following steps according to the first image set and the
Two image sets obtain image group：Image in first image set is merged into the first panoramic picture, and will be in the second image set
Image merges into the second panoramic picture, wherein image group includes the first panoramic picture and the second panoramic picture.
It specifically combines and is illustrated shown in Fig. 6, it is assumed that the first image set is based on left eye the image collected, the second image
Collection is, based on right eye the image collected, in the present embodiment, can be, but not limited in the server will be in the first image set
Image merges to obtain the first panoramic picture, the panoramic picture as shown in above Fig. 6, merges to obtain the by the image in the second image set
Two panoramic pictures, the panoramic picture as shown in below Fig. 6.Using above-mentioned first panoramic picture and the second panoramic picture as in image group
Parts of images, include the virtual reality media file of three-dimensional picture to generate.To realize in imaging process, left eye viewing
First panoramic picture, right eye watch the second panoramic picture, to reach the mistake for playing virtual reality media file in three-dimensional scenic
Cheng Zhong, the more virtual reality contents of media files that can be obtained.
Optionally, in the present embodiment, image group further includes：Top image above circle of reference and under circle of reference
The base map picture of side.
It specifically combines and is illustrated shown in Fig. 7, it is assumed that still by taking four collection points on circle of reference as an example, eyes exist respectively
Four collection points obtain picture as the image in image group, for example, being rotated clockwise four collection points, to obtain left eye
Four view pictures, as shown in the left sides Fig. 7, front view, left view, rearview and the right view of left eye；It is inverse four collection points
Hour hands rotate, to obtain four view pictures of right eye, as shown on the right side of Fig. 7, the front view of right eye, left view, rearview and
Right view.Further, then the top image above circle of reference and the base map picture below circle of reference are obtained, is obtained to realize
Take ten images based on eyes as one group of image group.
By embodiment provided by the present application, by obtaining the first image set corresponding with right and left eyes and the second image respectively
Collection, to generate the virtual reality media file based on eyes, and it is further by being carried out to the first image and the second image set
Merging treatment is merged, so that the virtual reality media file generated is more accurate true.
As a kind of optional scheme, first acquisition unit includes：7th acquisition module uses the first account for obtaining
The first client send generation request；Push unit is used for after generating virtual reality media file according to image group,
Virtual reality media file transmitting is given to the second account, so that the second account plays virtual reality media file..
Optionally, after by virtual reality media file transmitting to the second account, further include：Use the of the second account
Two clients obtain virtual reality media file；Second client obtains and the second client from virtual reality media file
The picture that visual angle matches plays out.
It should be noted that above-mentioned second account can be, but not limited to close with the first account in the application for the first account institute
Good friend's account of connection, the virtual reality media file that the second account is pushed by playing the first account, wherein virtual reality matchmaker
Body file includes based on reference position, and the different pictures got with different view are three-dimensional to watch the first account place
Three-dimensional picture in scene.For example, the first account and application where the second account can be game application, to realize
Using interior shared virtual reality media file；In addition, in the present embodiment, above-mentioned second account can also but be not limited to and the
Account in the different application of application where one account, two kinds of applications have incidence relation, for example, application is awarded where the first account
The above-mentioned virtual reality media file of application plays where weighing the second account.For example, application where the first account can be trip
Play application, application where the second account can be to play application, wherein game application mandate plays application, allows to play and apply
Generated virtual reality media file is played, to realize cross-platform sharing media data.Above-mentioned is only a kind of example, this reality
It applies and does not do any restriction in example to this.
Optionally, in the present embodiment, it can be, but not limited to from virtual reality matchmaker using the second client of the second account
The picture to match with the visual angle of the second client is obtained in body file to play out.That is, the second account is regarded by broadcasting
Angle is limited, and the picture to match with visual angle will be played.It should be noted that as the second account plays the change at visual angle, broadcast
The picture put can change therewith, and the different pictures got with different view in traversal virtual reality media file may be implemented.
By embodiment provided by the present application, the second account can obtain the void of the first account push by the second client
Quasi- reality media file, to realize the shared of media data, in addition, the second account can watch the by the second client
Virtual reality media file of one account in three-dimensional scenic will attract more users to participate in, improve the attention rate of application.
Embodiment 3
According to embodiments of the present invention, it additionally provides a kind of for implementing the above-mentioned virtual reality matchmaker based on virtual reality scenario
The virtual reality media file based on virtual reality scenario of body document generating method generates server, as shown in figure 9, the service
Device includes：
1) communication interface 902 are set as obtaining generating and ask, wherein generate request for requesting to generate virtual reality matchmaker
Body file is generated and is carried in request and the matched reference by location mark of virtual reality media file；
2) processor 904 are connect with communication interface 902, are set as response and are generated request according to predetermined policy acquisition image
Group, wherein one group of image group is used to indicate the reference position in three-dimensional scenic in predetermined instant indicated by the reference identification of position
On, the multiple pictures got from multiple visual angles, every image is at least used to indicate the picture that a visual angle is got；Also
It is set as generating virtual reality media file according to image group.
3) memory 906 are connect with communication interface 902, processor 904, are set as storage image group and virtual reality matchmaker
Body file.
Optionally, the specific example in the present embodiment can refer to showing described in above-described embodiment 1 and embodiment 2
Example, details are not described herein for the present embodiment.
Embodiment 4
The embodiments of the present invention also provide a kind of storage mediums.Optionally, in the present embodiment, above-mentioned storage medium can
With at least one of multiple network equipments in network network equipment.
Optionally, in the present embodiment, storage medium is arranged to store the program code for executing following steps：
S1 is obtained and is generated request, wherein is generated request for requesting to generate virtual reality media file, is generated in request
It carries and is identified with the matched reference by location of virtual reality media file；
S2, response generate request and obtain image group according to predetermined policy, wherein one group of image group is used to indicate three-dimensional scenic
In in predetermined instant on reference position indicated by the reference identification of position, the multiple pictures got from multiple visual angles, every
Image is at least used to indicate the picture that a visual angle is got；
S3 generates virtual reality media file according to image group.
Optionally, in the present embodiment, above-mentioned storage medium can include but is not limited to：USB flash disk, read-only memory (ROM,
Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disc or
The various media that can store program code such as CD.
Optionally, the specific example in the present embodiment can refer to showing described in above-described embodiment 1 and embodiment 2
Example, details are not described herein for the present embodiment.
The embodiments of the present invention are for illustration only, can not represent the quality of embodiment.
If the integrated unit in above-described embodiment is realized in the form of SFU software functional unit and as independent product
Sale in use, can be stored in the storage medium that above computer can be read.Based on this understanding, skill of the invention
Substantially all or part of the part that contributes to existing technology or the technical solution can be with soft in other words for art scheme
The form of part product embodies, which is stored in a storage medium, including some instructions are used so that one
Platform or multiple stage computers equipment (can be personal computer, server or network equipment etc.) execute each embodiment institute of the present invention
State all or part of step of method.
In the above embodiment of the present invention, all emphasizes particularly on different fields to the description of each embodiment, do not have in some embodiment
The part of detailed description may refer to the associated description of other embodiment.
In several embodiments provided herein, it should be understood that disclosed client, it can be by others side
Formula is realized.Wherein, the apparatus embodiments described above are merely exemplary, for example, the unit division, only one
Kind of division of logic function, formula that in actual implementation, there may be another division manner, such as multiple units or component can combine or
It is desirably integrated into another system, or some features can be ignored or not executed.Another point, it is shown or discussed it is mutual it
Between coupling, direct-coupling or communication connection can be INDIRECT COUPLING or communication link by some interfaces, unit or module
It connects, can be electrical or other forms.
The unit illustrated as separating component may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, you can be located at a place, or may be distributed over multiple
In network element.Some or all of unit therein can be selected according to the actual needs to realize the mesh of this embodiment scheme
's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it can also
It is that each unit physically exists alone, it can also be during two or more units be integrated in one unit.Above-mentioned integrated list
The form that hardware had both may be used in member is realized, can also be realized in the form of SFU software functional unit.
The above is only a preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art
For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered
It is considered as protection scope of the present invention.
Claims (15)
1. a kind of virtual reality media file generation method, which is characterized in that including：
It obtains and generates request, wherein the generation request is for requesting to generate virtual reality media file, in the generation request
It carries and is identified with the matched reference by location of the virtual reality media file；
It responds the generation request and obtains image group according to predetermined policy, wherein one group of described image group is used to indicate three dimensional field
It is identified on indicated reference position in the reference by location in predetermined instant in scape, the multiple pictures got from multiple visual angles
Face, every image are at least used to indicate the picture that a visual angle is got；
The virtual reality media file is generated according to described image group
Wherein, the response generations request includes according to predetermined policy acquisition image group：It is reference with the reference position
Center, the relatively described reference center build cube；The picture that will be got on cubical each surface, as institute
State the image in image group, wherein a cubical surface corresponds to a visual angle；Or
The response generation request obtains image group according to predetermined policy and includes：Using the reference position as reference center,
Preset distance is reference radius, obtains circle of reference；Multiple collection points are uniformly obtained on the circle of reference, wherein the multiple
The field range of collection point covers 360 degree of panoramas；Predetermined regard is obtained on each collection point in the multiple collection point respectively
Picture in wild angular range, as the image in described image group a, wherein collection point at least corresponds to a visual angle.
2. according to the method described in claim 1, it is characterized in that, the response generation request is obtained according to predetermined policy
Image group includes：
In the case where the virtual reality media file that the generation request instruction is generated is media data packet, according to institute
State predetermined policy and obtain multigroup described image group within a predetermined period of time, wherein the predetermined amount of time when it is a length of described
The playing duration of virtual reality media file；And/or
In the case where the virtual reality media file that the generation request instruction is generated is Media Stream, according to described pre-
Fixed strategy obtains described image group in real time.
3. according to the method described in claim 1, it is characterized in that, on each collection point in the multiple collection point
The picture obtained respectively within the scope of predetermined field-of-view angle includes：
It rotates in the direction of the clock, the picture within the scope of the predetermined field-of-view angle got on each collection point is made
For the image in the first image set；And rotate counterclockwise, it is described predetermined by what is got on each collection point
Picture within the scope of field-of-view angle, as the image in the second image set；
Described image group is obtained according to described first image collection and second image set.
4. according to the method described in claim 3, it is characterized in that, described according to described first image collection and second image
Collection obtains described image group：
Two adjacent two-by-two images are concentrated to execute image co-registration processing described first image, and in second image set
Two adjacent images execute image co-registration processing two-by-two, wherein the predetermined field-of-view angle is ranging from more than or equal to 90 degree.
5. according to the method described in claim 4, it is characterized in that, described according to described first image collection and second image
Collection obtains described image group：
The image that described first image is concentrated is merged into the first panoramic picture, and the image in second image set is merged
For the second panoramic picture, wherein described image group includes first panoramic picture and second panoramic picture.
6. according to the method described in claim 1, any one of 3 to 5, which is characterized in that described image group further includes：Positioned at institute
State the top image above circle of reference and the base map picture below the circle of reference.
7. according to the method described in claim 1, it is characterized in that, the response generation request is obtained according to predetermined policy
Image group includes：
By repeating following steps, to obtain all images in one group of described image group；
The picture in current visual angle is obtained as an image in described image group；
Judge whether to get all images in described image group；
In the case of all images during described image group has not been obtained, visual angle is adjusted, to obtain the picture in next visual angle
Face is as next image in described image group.
8. according to the method described in claim 1, it is characterized in that,
The acquisition generates request：The generation sent using the first client of the first account is obtained to ask；
After the virtual reality media file according to the generation of described image group, further include：By the virtual reality matchmaker
Body file push gives the second account, so that second account plays the virtual reality media file.
9. a kind of virtual reality media file generating means, which is characterized in that including：
First acquisition unit generates request for obtaining, wherein the generation request is for requesting to generate virtual reality media text
Part is carried in the generation request and is identified with the matched reference by location of the virtual reality media file；
Second acquisition unit obtains image group, wherein one group of described image for responding the generation request according to predetermined policy
Group is used to indicate in three-dimensional scenic in predetermined instant on the indicated reference position of reference by location mark, from multiple visual angles
The multiple pictures got, every image are at least used to indicate the picture that a visual angle is got；
Generation unit, for generating the virtual reality media file according to described image group；
Wherein, the second acquisition unit includes：Module is built, is used for using the reference position as reference center, it is relatively described
Reference center builds cube；Third acquisition module, the picture for will be got on cubical each surface are made
For the image in described image group, wherein a cubical surface corresponds to a visual angle；Or
The second acquisition unit includes：4th acquisition module, for using the reference position as reference center, preset distance to be
Reference radius obtains circle of reference；5th acquisition module, for uniformly obtaining multiple collection points on the circle of reference, wherein institute
The field range for stating multiple collection points covers 360 degree of panoramas；6th acquisition module, in each of the multiple collection point
The picture within the scope of predetermined field-of-view angle is obtained on collection point respectively, as the image in described image group, wherein an acquisition
Point at least corresponds to a visual angle.
10. device according to claim 9, which is characterized in that the second acquisition unit includes：
First acquisition module, for being media data in the virtual reality media file for asking instruction to be generated that generates
In the case of packet, multigroup described image group within a predetermined period of time is obtained according to the predetermined policy, wherein the pre- timing
Between section when a length of virtual reality media file playing duration；And/or
Second acquisition module, for generating the virtual reality media file that request instruction is generated described as Media Stream
In the case of, described image group is obtained in real time according to the predetermined policy.
11. device according to claim 9, which is characterized in that the 6th acquisition module includes：
First acquisition submodule, for rotating in the direction of the clock, the predetermined visual field that will be got on each collection point
Picture in angular range, as the image in the first image set；And rotate counterclockwise, it will be in each collection point
On picture within the scope of the predetermined field-of-view angle that gets, as the image in the second image set；
Second acquisition submodule, for obtaining described image group according to described first image collection and second image set.
12. according to the devices described in claim 11, which is characterized in that second acquisition submodule is realized by following steps
Described image group is obtained according to described first image collection and second image set：
Two adjacent two-by-two images are concentrated to execute image co-registration processing described first image, and in second image set
Two adjacent images execute image co-registration processing two-by-two, wherein the predetermined field-of-view angle is ranging from more than or equal to 90 degree.
13. according to the devices described in claim 11, which is characterized in that second acquisition submodule is realized by following steps
Described image group is obtained according to described first image collection and second image set：
The image that described first image is concentrated is merged into the first panoramic picture, and the image in second image set is merged
For the second panoramic picture, wherein described image group includes first panoramic picture and second panoramic picture.
14. device according to claim 9, which is characterized in that the second acquisition unit includes：
Processing module, for by repeating following steps, to obtain all images in one group of described image group；
The picture in current visual angle is obtained as an image in described image group；
Judge whether to get all images in described image group；
In the case of all images during described image group has not been obtained, visual angle is adjusted, to obtain the picture in next visual angle
Face is as next image in described image group.
15. device according to claim 9, which is characterized in that further include：
The first acquisition unit includes：7th acquisition module is used to obtain the first client transmission for using the first account
The generation request；
Push unit is used for after the virtual reality media file according to the generation of described image group, will be described virtual
Real media file transmitting gives the second account, so that second account plays the virtual reality media file.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710288923.5A CN107103645B (en) | 2017-04-27 | 2017-04-27 | virtual reality media file generation method and device |
| PCT/CN2018/083401 WO2018196658A1 (en) | 2017-04-27 | 2018-04-17 | Virtual reality media file generation method and device, storage medium, and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710288923.5A CN107103645B (en) | 2017-04-27 | 2017-04-27 | virtual reality media file generation method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107103645A CN107103645A (en) | 2017-08-29 |
| CN107103645B true CN107103645B (en) | 2018-07-20 |
Family
ID=59656694
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710288923.5A Active CN107103645B (en) | 2017-04-27 | 2017-04-27 | virtual reality media file generation method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107103645B (en) |
| WO (1) | WO2018196658A1 (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107103645B (en) * | 2017-04-27 | 2018-07-20 | 腾讯科技（深圳）有限公司 | virtual reality media file generation method and device |
| CN120151387A (en) * | 2017-09-29 | 2025-06-13 | 索尼公司 | Information processing apparatus and method, electronic device, and computer-readable medium |
| CN108364353A (en) * | 2017-12-27 | 2018-08-03 | 广东鸿威国际会展集团有限公司 | The system and method for guiding viewer to watch the three-dimensional live TV stream of scene |
| CN108419090A (en) * | 2017-12-27 | 2018-08-17 | 广东鸿威国际会展集团有限公司 | Three-dimensional live TV stream display systems and method |
| WO2020181090A1 (en) | 2019-03-07 | 2020-09-10 | Alibaba Group Holding Limited | Method, apparatus, medium, and device for processing multi-angle free-perspective image data |
| CN111669569A (en) * | 2019-03-07 | 2020-09-15 | 阿里巴巴集团控股有限公司 | Video generation method and device, medium and terminal |
| CN111080759B (en) * | 2019-12-03 | 2022-12-27 | 深圳市商汤科技有限公司 | Method and device for realizing split mirror effect and related product |
| CN111654737B (en) * | 2020-06-24 | 2022-07-12 | 北京嗨动视觉科技有限公司 | Program synchronization management method and device |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102884490A (en) * | 2010-03-05 | 2013-01-16 | 索尼电脑娱乐美国公司 | Maintaining multiple views on a shared stable virtual space |
| CN105487660A (en) * | 2015-11-25 | 2016-04-13 | 北京理工大学 | Immersion type stage performance interaction method and system based on virtual reality technology |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150312561A1 (en) * | 2011-12-06 | 2015-10-29 | Microsoft Technology Licensing, Llc | Virtual 3d monitor |
| US20160344999A1 (en) * | 2013-12-13 | 2016-11-24 | 8702209 Canada Inc. | SYSTEMS AND METHODs FOR PRODUCING PANORAMIC AND STEREOSCOPIC VIDEOS |
| CN104935829A (en) * | 2015-06-02 | 2015-09-23 | 无锡天脉聚源传媒科技有限公司 | Image processing method and apparatus |
| CN107316273B (en) * | 2016-04-27 | 2021-05-18 | 深圳看到科技有限公司 | Panoramic image acquisition device and acquisition method |
| CN106412555A (en) * | 2016-10-18 | 2017-02-15 | 网易（杭州）网络有限公司 | Game recording method and device, and virtual reality device |
| CN107103645B (en) * | 2017-04-27 | 2018-07-20 | 腾讯科技（深圳）有限公司 | virtual reality media file generation method and device |
-
2017
- 2017-04-27 CN CN201710288923.5A patent/CN107103645B/en active Active
-
2018
- 2018-04-17 WO PCT/CN2018/083401 patent/WO2018196658A1/en active Application Filing
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102884490A (en) * | 2010-03-05 | 2013-01-16 | 索尼电脑娱乐美国公司 | Maintaining multiple views on a shared stable virtual space |
| CN105487660A (en) * | 2015-11-25 | 2016-04-13 | 北京理工大学 | Immersion type stage performance interaction method and system based on virtual reality technology |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107103645A (en) | 2017-08-29 |
| WO2018196658A1 (en) | 2018-11-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107103645B (en) | virtual reality media file generation method and device | |
| US9818228B2 (en) | Mixed reality social interaction | |
| T HELD et al. | Using blur to affect perceived distance and size | |
| Kasahara et al. | JackIn head: immersive visual telepresence system with omnidirectional wearable camera for remote collaboration | |
| Fairchild et al. | A mixed reality telepresence system for collaborative space operation | |
| JP4059513B2 (en) | Method and system for communicating gaze in an immersive virtual environment | |
| US9998664B1 (en) | Methods and systems for non-concentric spherical projection for multi-resolution view | |
| CN106385576A (en) | Three-dimensional virtual reality live method and device, and electronic device | |
| WO2018000609A1 (en) | Method for sharing 3d image in virtual reality system, and electronic device | |
| CN115830199B (en) | Ubiquitous training campus construction method, system and storage medium based on XR technology | |
| CN109901710A (en) | Treating method and apparatus, storage medium and the terminal of media file | |
| CN109640070A (en) | A kind of stereo display method, device, equipment and storage medium | |
| CN107911737A (en) | Methods of exhibiting, device, computing device and the storage medium of media content | |
| CN108845670A (en) | A kind of online virtual fitness entertainment systems and method based on somatosensory device | |
| Debarba et al. | Content format and quality of experience in virtual reality | |
| CN106201259A (en) | A kind of method and apparatus sharing full-view image in virtual reality system | |
| Lincoln et al. | Animatronic shader lamps avatars | |
| CN106887033A (en) | The rendering intent and device of scene | |
| Shvetsov et al. | When holographic communication meets metaverse: Applications, challenges and future trends | |
| Aykut et al. | A stereoscopic vision system with delay compensation for 360 remote reality | |
| Thatte et al. | Depth augmented stereo panorama for cinematic virtual reality with focus cues | |
| CN106648067A (en) | Panoramic video information interaction method and system | |
| CN114866760A (en) | Virtual reality display method, equipment, system and readable storage medium | |
| KR20190031220A (en) | System and method for providing virtual reality content | |
| CN117315203A (en) | XR combined scene experience picture generation method, system, terminal and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |