[go: up one dir, main page]

CN107070784A - A kind of 3D instant communicating systems based on WebGL and VR technologies - Google Patents

A kind of 3D instant communicating systems based on WebGL and VR technologies Download PDF

Info

Publication number
CN107070784A
CN107070784A CN201710446488.4A CN201710446488A CN107070784A CN 107070784 A CN107070784 A CN 107070784A CN 201710446488 A CN201710446488 A CN 201710446488A CN 107070784 A CN107070784 A CN 107070784A
Authority
CN
China
Prior art keywords
module
user
control module
equipment
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710446488.4A
Other languages
Chinese (zh)
Inventor
李云
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201710446488.4A priority Critical patent/CN107070784A/en
Publication of CN107070784A publication Critical patent/CN107070784A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/10Multimedia information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a kind of 3D instant communicating systems based on WebGL and VR technologies, include the user terminal of interconnection, user terminal, including input equipment, output equipment, model creation module, model memory module, control module, communication module;Input equipment includes microphone, expression and catches equipment, real-time 3D modeling module, and expression catches the expression that equipment is used to catch user, and real-time 3D modeling module carries out shooting to the head of user by camera and realizes real-time 3D modeling;Output equipment includes earphone, immersion VR output equipments;Model creation module is the 3D model creation modules based on WebGL technologies, and 3D models are created for user;Model memory module, has the 3D models by model creation module creation;Control module is used to control user terminal to the information sent with other users end and the display content of immersion VR output equipments;Communication module is communicated for user terminal with other users end.The display effect of three-dimensional can be presented in the present invention in instant communication process.

Description

A kind of 3D instant communicating systems based on WebGL and VR technologies
Technical field
The present invention relates to communication technique field, more particularly to a kind of 3D instant communicating systems based on WebGL and VR technologies.
Background technology
Current MSN, such as QQ, wechat, YY voices, skype, are entered using word, voice or video Row real-time communication, greatly facilitates the information interchange of people.But the image of its video is confined in the plane of screen, shortly When communicating, personage's head portrait, stage property etc. lack three-dimensional sensation true to nature.There is presently no the instant of 3-D effect can be presented Communication system.
Accordingly, it would be desirable to which a kind of instant communicating system, can be presented the display effect of three-dimensional in instant communication process.
The content of the invention
The present invention provides a kind of 3D instant communicating systems based on WebGL and VR technologies, in instant communication process Three-dimensional display effect is presented.
A kind of 3D instant communicating systems based on WebGL and VR technologies that the present invention is provided, include the user of interconnection End, including:
User terminal, including input equipment, output equipment, model creation module, model memory module, control module, communication Module;
Input equipment includes microphone, expression and catches equipment, real-time 3D modeling module, and expression seizure equipment, which is used to catch, to be used The expression at family, real-time 3D modeling module carries out shooting to the head of user by camera and realizes real-time 3D modeling;Output equipment Including earphone, immersion VR output equipments;Model creation module is the 3D model creation modules based on WebGL technologies, for using Family creates 3D models;Model memory module, has the 3D models by model creation module creation;Control module is used to control user Hold to the information and the display content of immersion VR output equipments sent with other users end;Communication module be used for user terminal with Other users end is communicated;
User is by model creation module creation 3D models and is stored in model memory module;Communication module sets up user terminal Between communication;Microphone, expression catch sound, expression and the real-time 3D head portraits that equipment, real-time 3D modeling module catch user And send its data to control module;Control module receives the data from input equipment and read from model memory module and used The 3D models that family is created, and by default rule processing data, treated data are sent to other by communication module and used Family end;The data that other users end is transmitted by communication module are sent to control module, and control module, which is received, comes from communication module Data and after model memory module reads the 3D models that user creates, will be treated and by default rule processing data Data send to output equipment, corresponding content output is carried out by earphone and immersion VR output equipments.
It is preferred that, the immersion VR output equipments, to wear mobile phone box.
It is preferred that, the model creation module:
For creating 3D head portraits, 3D virtual portraits and 3D backgrounds, and by the 3D head portraits created, 3D virtual portraits and 3D backgrounds are according to head portrait class, visual human's species, background classes classification deposit model memory module.
It is preferred that, the input module, in addition to:
Gesture identification equipment, for recognizing the gesture of user, and sends it to control module, for according to default hand The display of gesture rule control output end, including switching 3D backgrounds, switch 3D virtual portraits, switch 3D head portraits;
Motion capture equipment, the action for catching user, and send to control module, action is carried out by control module Simplify after processing, sent by communication module to other users end.
It is preferred that, the control module receives the data from communication module and reads user from model memory module and creates 3D models after, and by default rule processing data, treated data are sent to output equipment, including:
Control module receives the data from communication module;
Control module finds the special value in the data from communication module, when finding special value, according to The default rule of correspondence switches corresponding 3D backgrounds, 3D virtual portraits, 3D head portraits;
Control module sends the 3D backgrounds switched, 3D virtual portraits, 3D head portraits to output equipment.
It is preferred that, the 3D head portraits, in addition to 3D expressions.
It is preferred that, the 3D backgrounds, in addition to 3D stage properties.
It is preferred that, the control module is used to control user terminal to the information and immersion VR sent with other users end The display content of output equipment, including:
Control module is then forwarded to output equipment after being deformed 3D head portraits, 3D stage properties and exported.
A kind of 3D instant communicating systems based on WebGL and VR technologies that the present invention is provided, can be in instant communication process It is middle that three-dimensional display effect is presented.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages can be by the explanations write Specifically noted structure is realized and obtained in book, claims and accompanying drawing.
Below by drawings and examples, technical scheme is described in further detail.
Brief description of the drawings
Accompanying drawing is used for providing a further understanding of the present invention, and constitutes a part for specification, the reality with the present invention Applying example is used to explain the present invention together, is not construed as limiting the invention.In the accompanying drawings:
Fig. 1 is a kind of schematic diagram of the 3D instant communicating systems based on WebGL and VR technologies in the embodiment of the present invention.
Embodiment
The preferred embodiments of the present invention are illustrated below in conjunction with accompanying drawing, it will be appreciated that preferred reality described herein Apply example to be merely to illustrate and explain the present invention, be not intended to limit the present invention.
As shown in figure 1, being a kind of signal of the 3D instant communicating systems based on WebGL and VR technologies in the embodiment of the present invention Figure, includes the user terminal of interconnection, including:
User terminal, including input equipment, output equipment, model creation module, model memory module, control module, communication Module;
Input equipment includes microphone, expression and catches equipment, real-time 3D modeling module, and expression seizure equipment, which is used to catch, to be used The expression at family, real-time 3D modeling module carries out shooting to the head of user by camera and realizes real-time 3D modeling;Output equipment Including earphone, immersion VR output equipments;Model creation module is the 3D model creation modules based on WebGL technologies, for using Family creates 3D models;Model memory module, has the 3D models by model creation module creation;Control module is used to control user Hold to the information and the display content of immersion VR output equipments sent with other users end;Communication module be used for user terminal with Other users end is communicated;
User is by model creation module creation 3D models and is stored in model memory module;Communication module sets up user terminal Between communication;Microphone, expression catch sound, expression and the real-time 3D head portraits that equipment, real-time 3D modeling module catch user And send its data to control module;Control module receives the data from input equipment and read from model memory module and used The 3D models that family is created, and by default rule processing data, treated data are sent to other by communication module and used Family end;The data that other users end is transmitted by communication module are sent to control module, and control module, which is received, comes from communication module Data and after model memory module reads the 3D models that user creates, will be treated and by default rule processing data Data send to output equipment, corresponding content output is carried out by earphone and immersion VR output equipments.
The system provided by the present invention, can be presented the display effect of three-dimensional in instant communication process.
In one embodiment of the invention, immersion VR output equipments, to wear mobile phone box.Head-wearing mobile phone box Compared with circumscribed head-mounted display and integral type head-mounted display, it is only cheap, and more flexibly pass through mobile phone 3G, 4G, wifi, bluetooth etc. are connected with control module, are realized more convenient.
In one embodiment of the invention, model creation module:
For creating 3D head portraits, 3D virtual portraits and 3D backgrounds, and by the 3D head portraits created, 3D virtual portraits and 3D backgrounds are according to head portrait class, visual human's species, background classes classification deposit model memory module, by by 3D head portraits, 3D visual humans Thing and the storage of 3D background class, for same storage, when classification storage is controlled control module, are patrolled from realization Collect upper easily realization transferring and after-treatment to 3D models.
In one embodiment of the invention, input module, in addition to:
Gesture identification equipment, for recognizing the gesture of user, and sends it to control module, for according to default hand The display of gesture rule control output end, including switching 3D backgrounds, switch 3D virtual portraits, switch 3D head portraits;
Motion capture equipment, the action for catching user, and send to control module, action is carried out by control module Simplify after processing, sent by communication module to other users end.
By the use of gesture identification equipment and motion capture equipment, the flexibility to display control is added, but also The output equipment of communication other side can be further set to show action interaction.
In one embodiment of the invention, control module receives the data from communication module and from model memory module Read after the 3D models that user creates, and by default rule processing data, treated data are sent to output equipment, bag Include:
Control module receives the data from communication module;
Control module finds the special value in the data from communication module, when finding special value, according to The default rule of correspondence switches corresponding 3D backgrounds, 3D virtual portraits, 3D head portraits;
Control module sends the 3D backgrounds switched, 3D virtual portraits, 3D head portraits to output equipment.
By 3D backgrounds, 3D virtual portraits, 3D head portraits switching, more suitably display effect, drop can be realized local The identification difficulty expressed one's feelings to other side etc. during low communication.
In one embodiment of the invention, 3D head portraits, in addition to 3D expressions.The display expressed one's feelings by 3D strengthens communication During the change expressed one's feelings, input equipment is caught excessively trickle expression shape change, so as to reduce the technology of input equipment Difficulty, it is easier to realization expression communication.
In one embodiment of the invention, 3D backgrounds, in addition to 3D stage properties.By the use of 3D stage properties, there is provided reality In the stage property that does not have, add the interactive of system.
In one embodiment of the invention, control module is used to control user terminal to the information sent with other users end And the display content of immersion VR output equipments, including:
Control module is then forwarded to output equipment after being deformed 3D head portraits, 3D stage properties and exported.By to 3D heads Picture, 3D stage properties carry out deformation and used, and reduce the size for the data that storage is needed in model memory module, a 3D model data Different display shapes can be realized by modes such as stretching, rotation, distortions, and can by by stretching, rotation, distortion Operation is transferred to another user terminal by communication module, without transmitting the data after whole 3D model deformations, reduces Requirement to data transfer, and then the delay (because the data volume to be transmitted diminishes) of data transfer is reduced, add friendship Mutual property.
A kind of 3D instant communicating systems based on WebGL and VR technologies provided in an embodiment of the present invention, can not only be in sight When communication process in present three-dimensional display effect, moreover it is possible to increase the interactivity of communication two party, reduce the cost of whole system And technical difficulty.
The present invention is on conventional " system+user " instant messaging framework, in figure image, personage's interaction, stage property table Drill, 3D elements are added in terms of chatting facial expression.User can be individual by using or changing between this immediate communication platform and good friend People virtual 3D images, using or change 3D stage properties, using or change 3D expressions etc. carry out more lively interaction, be instant messaging Platform adds interactive and recreational.
It should be understood by those skilled in the art that, embodiments of the invention can be provided as method, system or computer program Product.Therefore, the present invention can be using the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware Apply the form of example.Moreover, the present invention can be used in one or more computers for wherein including computer usable program code The shape for the computer program product that usable storage medium is implemented on (including but is not limited to magnetic disk storage and optical memory etc.) Formula.
The present invention is the flow with reference to method according to embodiments of the present invention, equipment (system) and computer program product Figure and/or block diagram are described.It should be understood that can be by every first-class in computer program instructions implementation process figure and/or block diagram Journey and/or the flow in square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided The processor of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce A raw machine so that produced by the instruction of computer or the computing device of other programmable data processing devices for real The device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may be alternatively stored in, can guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which is produced, to be included referring to Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that in meter Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, thus in computer or The instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one The step of function of being specified in individual square frame or multiple square frames.
Obviously, those skilled in the art can carry out the essence of various changes and modification without departing from the present invention to the present invention God and scope.So, if these modifications and variations of the present invention belong to the scope of the claims in the present invention and its equivalent technologies Within, then the present invention is also intended to comprising including these changes and modification.

Claims (8)

1. a kind of 3D instant communicating systems based on WebGL and VR technologies, include the user terminal of interconnection, it is characterised in that Including:
User terminal, including input equipment, output equipment, model creation module, model memory module, control module, communication module;
Input equipment includes microphone, expression and catches equipment, real-time 3D modeling module, and expression, which catches equipment, to be used to catch user's Expression, real-time 3D modeling module carries out shooting to the head of user by camera and realizes real-time 3D modeling;Output equipment includes Earphone, immersion VR output equipments;Model creation module is the 3D model creation modules based on WebGL technologies, for user's wound Build 3D models;Model memory module, has the 3D models by model creation module creation;Control module be used for control user terminal to The information and the display content of immersion VR output equipments sent with other users end;Communication module is used for user terminal and other User terminal is communicated;
User is by model creation module creation 3D models and is stored in model memory module;Communication module is set up between user terminal Communication;Microphone, expression catch equipment, the sound of real-time 3D modeling module seizure user, expression and real-time 3D head portraits and will Its data is sent to control module;Control module receives the data from input equipment and reads user's wound from model memory module The 3D models built, and by default rule processing data, treated data are sent to other users end by communication module; The data that other users end is transmitted by communication module are sent to control module, and control module receives the data from communication module And after model memory module reads the 3D models that user creates, and by default rule processing data, by treated data Send to output equipment, corresponding content output is carried out by earphone and immersion VR output equipments.
2. system according to claim 1, it is characterised in that the immersion VR output equipments, to wear mobile phone box.
3. system according to claim 1, it is characterised in that the model creation module:
Carried on the back for creating 3D head portraits, 3D virtual portraits and 3D backgrounds, and by the 3D head portraits created, 3D virtual portraits and 3D Scape is according to head portrait class, visual human's species, background classes classification deposit model memory module.
4. system according to claim 3, it is characterised in that the input module, in addition to:
Gesture identification equipment, for recognizing the gesture of user, and sends it to control module, for being advised according to default gesture The then display of control output end, including switching 3D backgrounds, switch 3D virtual portraits, switch 3D head portraits;
Motion capture equipment, the action for catching user, and send to control module, action is simplified by control module After processing, sent by communication module to other users end.
5. system according to claim 4, it is characterised in that the control module receives the data from communication module simultaneously After model memory module reads the 3D models that user creates, and by default rule processing data, treated data are sent out Output equipment is delivered to, including:
Control module receives the data from communication module;
Control module finds the special value in the data from communication module, when finding special value, according to default The rule of correspondence switch corresponding 3D backgrounds, 3D virtual portraits, 3D head portraits;
Control module sends the 3D backgrounds switched, 3D virtual portraits, 3D head portraits to output equipment.
6. system according to claim 3, it is characterised in that the 3D head portraits, in addition to 3D expressions.
7. system according to claim 3, it is characterised in that the 3D backgrounds, in addition to 3D stage properties.
8. according to any described systems of claim 6-7, it is characterised in that the control module be used to controlling user terminal to Information and the display content of immersion VR output equipments that other users end is sent, including:
Control module is then forwarded to output equipment after being deformed 3D head portraits, 3D stage properties and exported.
CN201710446488.4A 2017-06-14 2017-06-14 A kind of 3D instant communicating systems based on WebGL and VR technologies Pending CN107070784A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710446488.4A CN107070784A (en) 2017-06-14 2017-06-14 A kind of 3D instant communicating systems based on WebGL and VR technologies

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710446488.4A CN107070784A (en) 2017-06-14 2017-06-14 A kind of 3D instant communicating systems based on WebGL and VR technologies

Publications (1)

Publication Number Publication Date
CN107070784A true CN107070784A (en) 2017-08-18

Family

ID=59593904

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710446488.4A Pending CN107070784A (en) 2017-06-14 2017-06-14 A kind of 3D instant communicating systems based on WebGL and VR technologies

Country Status (1)

Country Link
CN (1) CN107070784A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109284456A (en) * 2018-08-30 2019-01-29 广州越维信息科技有限公司 Space-location method and AR system of the webpage control in AR
CN109740476A (en) * 2018-12-25 2019-05-10 北京琳云信息科技有限责任公司 Instant communication method, device and server
CN110493215A (en) * 2019-08-15 2019-11-22 苏州兆见智能科技有限公司 A kind of more people's immersion spatial interaction systems based on local area network

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140253546A1 (en) * 2011-11-11 2014-09-11 Google Inc. Side-by-Side and Synchronized Displays for Three-Dimensional (3D) Object Data Models
CN104811650A (en) * 2014-01-26 2015-07-29 吴健辉 Image acquisition system
CN105516705A (en) * 2015-12-04 2016-04-20 邓燕方 3D online video interactive device
CN106302132A (en) * 2016-09-14 2017-01-04 华南理工大学 A kind of 3D instant communicating system based on augmented reality and method
CN206133464U (en) * 2016-08-18 2017-04-26 北京洛斯达数字遥感技术有限公司 A device for being directed at VR glasses carry out gesture to be controlled
CN106657060A (en) * 2016-12-21 2017-05-10 惠州Tcl移动通信有限公司 VR communication method and system based on reality scene

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140253546A1 (en) * 2011-11-11 2014-09-11 Google Inc. Side-by-Side and Synchronized Displays for Three-Dimensional (3D) Object Data Models
CN104811650A (en) * 2014-01-26 2015-07-29 吴健辉 Image acquisition system
CN105516705A (en) * 2015-12-04 2016-04-20 邓燕方 3D online video interactive device
CN206133464U (en) * 2016-08-18 2017-04-26 北京洛斯达数字遥感技术有限公司 A device for being directed at VR glasses carry out gesture to be controlled
CN106302132A (en) * 2016-09-14 2017-01-04 华南理工大学 A kind of 3D instant communicating system based on augmented reality and method
CN106657060A (en) * 2016-12-21 2017-05-10 惠州Tcl移动通信有限公司 VR communication method and system based on reality scene

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
彭宇承: "《虚拟现实与交互设计》", 31 July 2015 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109284456A (en) * 2018-08-30 2019-01-29 广州越维信息科技有限公司 Space-location method and AR system of the webpage control in AR
CN109740476A (en) * 2018-12-25 2019-05-10 北京琳云信息科技有限责任公司 Instant communication method, device and server
CN110493215A (en) * 2019-08-15 2019-11-22 苏州兆见智能科技有限公司 A kind of more people's immersion spatial interaction systems based on local area network

Similar Documents

Publication Publication Date Title
US11303850B2 (en) Communication using interactive avatars
CN101690071B (en) Methods and terminals that control avatars during videoconferencing and other communications
CN110418095B (en) Virtual scene processing method and device, electronic equipment and storage medium
CN103368816A (en) Instant communication method based on virtual character and system
CN110401810B (en) Virtual picture processing method, device and system, electronic equipment and storage medium
CN112839196B (en) Method, device and storage medium for realizing online conference
KR20130022434A (en) Apparatus and method for emotion content service of communication terminal device, apparatus and method for emotion recognition therefor, apparatus and method for generating and matching emotion content using same
CN111815666B (en) Image processing method and device, computer-readable storage medium and electronic equipment
CN105915766B (en) Control method based on virtual reality and device
CN105554430B (en) A kind of video call method, system and device
WO2022252866A1 (en) Interaction processing method and apparatus, terminal and medium
CN112634413B (en) Method, apparatus, device and storage medium for generating model and generating 3D animation
CN113014960B (en) Method, device and storage medium for online video production
US12217368B2 (en) Extended field of view generation for split-rendering for virtual reality streaming
KR20200092207A (en) Electronic device and method for providing graphic object corresponding to emotion information thereof
CN107070784A (en) A kind of 3D instant communicating systems based on WebGL and VR technologies
WO2022062554A1 (en) Multi-lens video recording method and related device
CN109039851B (en) Interactive data processing method and device, computer equipment and storage medium
JP2023067360A (en) Terminal, information processing method, program, and recording medium
CN110413109A (en) Method, device, system, electronic device and storage medium for generating virtual content
JP2023184000A (en) Information processing system, information processing method and computer program
CN113176827A (en) AR interaction method and system based on expressions, electronic device and storage medium
US20100073399A1 (en) Methods and devices for controlling a presentation of an object
TWI846600B (en) Companion robot with three-dimensional display and application method thereof
CN107704166A (en) A kind of method and system, terminal and storage device for realizing interconnection operation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170818