[go: up one dir, main page]

CN109615958A - The processing method and VR of interactive VR image - Google Patents

The processing method and VR of interactive VR image Download PDF

Info

Publication number
CN109615958A
CN109615958A CN201811476227.8A CN201811476227A CN109615958A CN 109615958 A CN109615958 A CN 109615958A CN 201811476227 A CN201811476227 A CN 201811476227A CN 109615958 A CN109615958 A CN 109615958A
Authority
CN
China
Prior art keywords
image information
image
whole body
head
superimposed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811476227.8A
Other languages
Chinese (zh)
Inventor
王海涛
周璇玲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Nuxin Communication Technology Co Ltd
Original Assignee
Shenzhen Nuxin Communication Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Nuxin Communication Technology Co Ltd filed Critical Shenzhen Nuxin Communication Technology Co Ltd
Priority to CN201811476227.8A priority Critical patent/CN109615958A/en
Publication of CN109615958A publication Critical patent/CN109615958A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/08Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
    • G09B5/14Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Human Computer Interaction (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The embodiment of the invention discloses the processing methods and equipment of a kind of interactive mode VR image, and described method includes following steps: VR glasses obtain the VR image of interactive scene in online education;VR glasses receive the picture of teaching teacher, and the head image information of teaching teacher is extracted from picture, which is superimposed upon in preset whole body images and is shown in the VR image;VR glasses obtain the operation information of student, extract the head image information of the student, after the head image information of student is superimposed upon in another preset whole body images, is superimposed upon in the VR image and sends after adjusting according to operation information to another whole body images.Technical solution provided by the invention has the advantages that user experience is high.

Description

The processing method and VR of interactive VR image
Technical field
The present invention relates to field of virtual reality, more particularly to the processing method and VR of interactive mode VR image.
Background technique
Present VR all-in-one machine or VR box (main body is mobile phone), the ARM kernel CPU collocation intelligence for being all of dependence The host of Android system or apple IOS system.Such machine itself be have certain graph image processing capacity and The game of system collocation operation therewith, video content resource.More popular to say, here it is the ecological problems of software.It is with Google The IOS in first Android camp and apple has the game ecology of oneself.Can not be restored in existing VR online education teacher with The interaction of student, user experience are low.
Summary of the invention
The technical problem to be solved by the embodiment of the invention is that providing a kind of processing method of interactive mode VR image.It mentions High user experience.
In order to solve the above-mentioned technical problem, the embodiment of the invention provides a kind of processing method of interactive mode VR image, institutes The method of stating includes the following steps:
VR glasses obtain the VR image of interactive scene in online education;
VR glasses receive the picture of teaching teacher, and the head image information of teaching teacher is extracted from picture, which is believed Breath is superimposed upon in preset whole body images to be shown in the VR image;
VR glasses obtain the operation information of student, extract the head image information of the student, the head image information of student is superimposed upon After in another preset whole body images, it is superimposed upon in the VR image and sends out after being adjusted according to operation information to another whole body images It send.
Optionally, the head image information that teaching teacher is extracted from picture specifically includes:
The photo of teaching teacher is shot, the head portrait that teaching teacher is extracted from the photo obtains the head image information.
Optionally, the head portrait that teaching teacher is extracted from the photo obtains the head image information, comprising:
Gray value in the photo is extracted to be superimposed the image information in the image information of skin gray value setting range and set Hair pattern after obtain the head image information.
Optionally, the foundation operation information is superimposed upon to send in the VR image after adjusting another whole body images and wrap It includes:
When such as the operation information is voice data, speech recognition is carried out to the voice data and obtains operating characteristics, determining should Whether comprising the operating characteristics such as comprising the operating characteristics position of another whole body images is then superimposed upon this in VR image Position near operating characteristics, and the gesture for adjusting another whole body images is directed toward the operating characteristics.
Second aspect provides a kind of VR equipment, comprising:
Acquiring unit, for obtaining the VR image of interactive scene in online education;
Transmit-Receive Unit, for receiving the picture of teaching teacher;
The head image information is superimposed upon default by processing unit for extracting the head image information of teaching teacher from picture Whole body images in shown in the VR image;The operation information for obtaining student, extracts the head image information of the student, by the head of student After picture information superposition is in another preset whole body images, this is superimposed upon after adjusting according to operation information to another whole body images It is sent in VR image.
Optionally, the processing unit, the head portrait specifically for extracting teaching teacher from the photo obtain the head portrait Information.
Optionally, the processing unit include: extract the photo in gray value skin gray value setting range image Information will obtain the head image information after the hair pattern of image information superposition setting.
Optionally, the processing unit carries out the voice data when specifically for being voice data such as the operation information Speech recognition obtains operating characteristics, determines in the VR image whether then should comprising the operating characteristics such as comprising the operating characteristics The position of another whole body images is superimposed upon position near the operating characteristics, and the gesture for adjusting another whole body images is directed toward and is somebody's turn to do Operating characteristics.
The third aspect, provides a kind of computer readable storage medium, and storage is used for the computer journey of electronic data interchange Sequence, wherein the computer program makes computer execute method described in first aspect.
Fourth aspect provides a kind of computer program product, which is characterized in that the computer program product includes storage The non-transient computer readable storage medium of computer program, the computer program are operable to make computer to execute the Method described in one side.
Those of ordinary skill in the art will understand that although following detailed description carries out referenced in schematic embodiment, attached drawing, But the present invention is not limited to these embodiments.But the scope of the present invention is extensive, and is intended to only through appended right It is required that limiting the scope of the invention.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with It obtains other drawings based on these drawings.
Fig. 1 is a kind of flow diagram of the processing method of interactive mode VR image provided by the invention.
Fig. 2 is the structural schematic diagram of VR provided by the invention a kind of.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
Description and claims of this specification and term " first " in above-mentioned attached drawing, " second " etc. are for distinguishing Different objects, are not use to describe a particular order.In addition, term " includes " and " having " and their any deformations, it is intended that It is to cover and non-exclusive includes.Such as the process, method, system, product or equipment for containing a series of steps or units do not have It is defined in listed step or unit, but optionally further comprising the step of not listing or unit, or optionally also wrap Include other step or units intrinsic for these process, methods, product or equipment.
Referenced herein " embodiment " is it is meant that a particular feature, structure, or characteristic described can wrap in conjunction with the embodiments Containing at least one embodiment of the present invention.Each position in the description occur the phrase might not each mean it is identical Embodiment, nor the independent or alternative embodiment with other embodiments mutual exclusion.Those skilled in the art explicitly and Implicitly understand, embodiment described herein can be combined with other embodiments.
For VR, application especially in online education is but existing so that viewing personnel have the feeling attended class of scene The image of some online education viewings is based on existing broadcasting and plays back content that is, based on broadcasting content, in student to this When image is answered, the voice data for being also based on student's reply gives teaching teacher, and teaching teacher can not watch student's Image, the in this way interaction between influence academics and students influence lacking for user experience so it is low with Interactive Experience degree Point.
Refering to fig. 1, the embodiment of the present invention provides a kind of processing method of interactive mode VR image, and this method is as shown in Figure 1, packet Include following steps:
Step S101, VR glasses obtain the VR image of interactive scene in online education.
Step S102, VR glasses receive the picture of teaching teacher, and the head image information of teaching teacher is extracted from picture, will The head image information is superimposed upon in preset whole body images to be shown in the VR image.
Step S103, VR glasses obtain the operation information of student, extract the head image information of the student, and the head portrait of student is believed After breath is superimposed upon in another preset whole body images, VR figure is superimposed upon after adjusting according to operation information to another whole body images It is sent as in.
Technical solution provided by the invention, which is realized, executes VR interactive operation to student terminal and teaching teacher's terminal, also Former true realization scene, so it has the advantages that user experience is high.
Optionally, the above-mentioned head image information that teaching teacher is extracted from picture specifically includes:
The photo of teaching teacher is shot, the head portrait that teaching teacher is extracted from the photo obtains the head image information.
Concrete implementation method extracts gray value in the photo in the image information of skin gray value setting range, by this The hair pattern of image information superposition setting obtains the head image information later.
Optionally, above-mentioned foundation operation information is superimposed upon the reality sent in the VR image after adjusting to another whole body images Existing mode can be with are as follows:
When such as the operation information is voice data, speech recognition is carried out to the voice data and obtains operating characteristics, determining should Whether comprising the operating characteristics such as comprising the operating characteristics position of another whole body images is then superimposed upon this in VR image Position near operating characteristics, and the gesture for adjusting another whole body images is directed toward the operating characteristics.
The technical solution location information of another whole body images is adjusted according to the information of the voice data and The adjustment to posture is provided to restore the mode of operation of the student, improves the Experience Degree of user.
It is when such as the operation information is gesture data, the stance adjustment of another whole body images is identical as the gesture data Posture, dynamically change another whole body images to realize, preferably realize reduction for online education.
A kind of VR equipment (such as VR glasses) is provided refering to Fig. 2, comprising:
Acquiring unit 201, for obtaining the VR image of interactive scene in online education;
Transmit-Receive Unit 202, for receiving the picture of teaching teacher;
The head image information is superimposed upon pre- by processing unit 203 for extracting the head image information of teaching teacher from picture If whole body images in shown in the VR image;The operation information for obtaining student, extracts the head image information of the student, by student's After head image information is superimposed upon in another preset whole body images, it is superimposed upon after being adjusted according to operation information to another whole body images It is sent in the VR image.
Optionally, the processing unit, the head portrait specifically for extracting teaching teacher from the photo obtain the head portrait Information.
Optionally, the processing unit include: extract the photo in gray value skin gray value setting range image Information will obtain the head image information after the hair pattern of image information superposition setting.
Optionally, the processing unit carries out the voice data when specifically for being voice data such as the operation information Speech recognition obtains operating characteristics, determines in the VR image whether then should comprising the operating characteristics such as comprising the operating characteristics The position of another whole body images is superimposed upon position near the operating characteristics, and the gesture for adjusting another whole body images is directed toward and is somebody's turn to do Operating characteristics
The specific embodiment of the invention provides a kind of computer readable storage medium, and storage is for electronic data interchange Computer program, wherein the computer program executes computer as the method for figure 1.
The specific embodiment of the invention provides a kind of computer program product, which is characterized in that the computer program produces Product include the non-transient computer readable storage medium for storing computer program, and the computer program is operable to make to count Calculation machine executes as the method for figure 1.
Above disclosed is only a preferred embodiment of the present invention, cannot limit the power of the present invention with this certainly Sharp range, those skilled in the art can understand all or part of the processes for realizing the above embodiment, and weighs according to the present invention Benefit requires made equivalent variations, still belongs to the scope covered by the invention.

Claims (10)

1. a kind of processing method of interactive mode VR image, which is characterized in that described method includes following steps:
VR glasses obtain the VR image of interactive scene in online education;
VR glasses receive the picture of teaching teacher, and the head image information of teaching teacher is extracted from picture, which is folded It is added in preset whole body images and is shown in the VR image;
VR glasses obtain the operation information of student, extract the head image information of the student, the head image information of student are superimposed upon another After in preset whole body images, it is superimposed upon in the VR image and sends after being adjusted according to operation information to another whole body images.
2. the method according to claim 1, wherein the head image information for extracting teaching teacher from picture It specifically includes:
The photo of teaching teacher is shot, the head portrait that teaching teacher is extracted from the photo obtains the head image information.
3. according to the method described in claim 2, it is characterized in that, the head portrait for extracting teaching teacher from the photo obtains To the head image information, comprising:
Extract image information of the gray value in skin gray value setting range, the head that image information superposition is set in the photo Hair pattern obtains the head image information later.
4. the method according to claim 1, wherein described adjust another whole body images according to operation information After be superimposed upon in the VR image send include:
When such as the operation information is voice data, speech recognition is carried out to the voice data and obtains operating characteristics, determines that the VR schemes Whether comprising the operating characteristics such as comprising the operating characteristics position of another whole body images is then superimposed upon the operation as in Position near feature, and the gesture for adjusting another whole body images is directed toward the operating characteristics.
5. a kind of VR equipment characterized by comprising
Acquiring unit, for obtaining the VR image of interactive scene in online education;
Transmit-Receive Unit, for receiving the picture of teaching teacher;
The head image information is superimposed upon preset complete by processing unit for extracting the head image information of teaching teacher from picture It is shown in body image in the VR image;The operation information for obtaining student, extracts the head image information of the student, and the head portrait of student is believed After breath is superimposed upon in another preset whole body images, VR figure is superimposed upon after adjusting according to operation information to another whole body images It is sent as in.
6. VR equipment according to claim 5, which is characterized in that the processing unit, specifically for being mentioned from the photo The head portrait of teaching teacher is taken to obtain the head image information.
7. equipment according to claim 6, which is characterized in that the processing unit includes: to extract gray value in the photo In the image information of skin gray value setting range, head portrait letter will be obtained after the hair pattern of image information superposition setting Breath.
8. equipment according to claim 5, which is characterized in that the processing unit is specifically for such as operation information When voice data, speech recognition is carried out to the voice data and obtains operating characteristics, whether determined in the VR image comprising the operation The position of another whole body images is then superimposed upon position near the operating characteristics, and adjust such as comprising the operating characteristics by feature The gesture of whole another whole body images is directed toward the operating characteristics.
9. a kind of computer readable storage medium, which is characterized in that it stores the computer program for being used for electronic data interchange, In, the computer program makes computer execute method according to any of claims 1-4.
10. a kind of computer program product, which is characterized in that the computer program product includes storing computer program Non-transient computer readable storage medium, the computer program are operable to that computer is made to execute such as claim 1-4 Method described in one.
CN201811476227.8A 2018-12-04 2018-12-04 The processing method and VR of interactive VR image Pending CN109615958A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811476227.8A CN109615958A (en) 2018-12-04 2018-12-04 The processing method and VR of interactive VR image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811476227.8A CN109615958A (en) 2018-12-04 2018-12-04 The processing method and VR of interactive VR image

Publications (1)

Publication Number Publication Date
CN109615958A true CN109615958A (en) 2019-04-12

Family

ID=66006343

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811476227.8A Pending CN109615958A (en) 2018-12-04 2018-12-04 The processing method and VR of interactive VR image

Country Status (1)

Country Link
CN (1) CN109615958A (en)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1971615A (en) * 2006-11-10 2007-05-30 中国科学院计算技术研究所 Method for generating cartoon portrait based on photo of human face
CN105913495A (en) * 2016-03-31 2016-08-31 联想(北京)有限公司 Information processing method and electronic equipment
CN106096857A (en) * 2016-06-23 2016-11-09 中国人民解放军63908部队 Augmented reality version interactive electronic technical manual, content build and the structure of auxiliary maintaining/auxiliary operation flow process
CN106781755A (en) * 2017-01-18 2017-05-31 广州远大信息发展有限公司 A kind of tutoring system and method based on virtual reality
CN106843150A (en) * 2017-02-28 2017-06-13 清华大学 A kind of industry spot simulation method and device
CN107158695A (en) * 2017-06-16 2017-09-15 苏州蜗牛数字科技股份有限公司 A kind of reality mixes the method and system showed with virtual scene
CN107194995A (en) * 2017-07-11 2017-09-22 王刚 A kind of method of rapid build true three-dimension person model
CN107451207A (en) * 2017-07-11 2017-12-08 河南书网教育科技股份有限公司 Interactive books interaction systems and method
CN107657955A (en) * 2017-11-09 2018-02-02 温州大学 A kind of interactive voice based on VR virtual classrooms puts question to system and method
CN108304072A (en) * 2018-02-09 2018-07-20 北京北行科技有限公司 A kind of VR virtual worlds role's expression implanted device and method for implantation
CN108874363A (en) * 2018-07-03 2018-11-23 百度在线网络技术(北京)有限公司 Object control method, apparatus, equipment and storage medium for AR scene

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1971615A (en) * 2006-11-10 2007-05-30 中国科学院计算技术研究所 Method for generating cartoon portrait based on photo of human face
CN105913495A (en) * 2016-03-31 2016-08-31 联想(北京)有限公司 Information processing method and electronic equipment
CN106096857A (en) * 2016-06-23 2016-11-09 中国人民解放军63908部队 Augmented reality version interactive electronic technical manual, content build and the structure of auxiliary maintaining/auxiliary operation flow process
CN106781755A (en) * 2017-01-18 2017-05-31 广州远大信息发展有限公司 A kind of tutoring system and method based on virtual reality
CN106843150A (en) * 2017-02-28 2017-06-13 清华大学 A kind of industry spot simulation method and device
CN107158695A (en) * 2017-06-16 2017-09-15 苏州蜗牛数字科技股份有限公司 A kind of reality mixes the method and system showed with virtual scene
CN107194995A (en) * 2017-07-11 2017-09-22 王刚 A kind of method of rapid build true three-dimension person model
CN107451207A (en) * 2017-07-11 2017-12-08 河南书网教育科技股份有限公司 Interactive books interaction systems and method
CN107657955A (en) * 2017-11-09 2018-02-02 温州大学 A kind of interactive voice based on VR virtual classrooms puts question to system and method
CN108304072A (en) * 2018-02-09 2018-07-20 北京北行科技有限公司 A kind of VR virtual worlds role's expression implanted device and method for implantation
CN108874363A (en) * 2018-07-03 2018-11-23 百度在线网络技术(北京)有限公司 Object control method, apparatus, equipment and storage medium for AR scene

Similar Documents

Publication Publication Date Title
EP3929703A1 (en) Animation image driving method based on artificial intelligence, and related device
US10475225B2 (en) Avatar animation system
CN111738220A (en) Three-dimensional human body posture estimation method, device, equipment and medium
CN113946211A (en) Method for interacting multiple objects based on metauniverse and related equipment
CN106200960A (en) The content display method of electronic interactive product and device
JP6683864B1 (en) Content control system, content control method, and content control program
CN105763829A (en) Image processing method and electronic device
KR20170002100A (en) Method for providng smart learning education based on sensitivity avatar emoticon, and smart learning education device for the same
CN113082703B (en) Cursor display method, device and medium
CN109151597A (en) information display method and device
CN106162358A (en) A kind of VR plays control method and the equipment of video progress
CN105955452A (en) Virtual reality equipment and method and device for improving reading experience employing same
WO2023240999A1 (en) Virtual reality scene determination method and apparatus, and system
CN112907702A (en) Image processing method, image processing device, computer equipment and storage medium
CN106502401B (en) Image control method and device
CN105931204B (en) Picture restoring method and system
CN112508772B (en) Image generation method, device and storage medium
CN109615958A (en) The processing method and VR of interactive VR image
CN112619138A (en) Method and device for displaying skill special effect in game
CN109587035B (en) Head portrait display method and device of session interface, electronic equipment and storage medium
CN110751026A (en) Video processing method and related device
CN110363136A (en) Method, apparatus, electronic equipment and the medium of eyes setting feature for identification
CN111275610A (en) Method and system for processing face aging image
CN105224910A (en) A kind of system and method for training common notice
CN109068069A (en) Video generation method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190412

RJ01 Rejection of invention patent application after publication