CN105488837B - Real-time off screen rendering method based on cloud computing, apparatus and system - Google Patents
Real-time off screen rendering method based on cloud computing, apparatus and system Download PDFInfo
- Publication number
- CN105488837B CN105488837B CN201510827310.5A CN201510827310A CN105488837B CN 105488837 B CN105488837 B CN 105488837B CN 201510827310 A CN201510827310 A CN 201510827310A CN 105488837 B CN105488837 B CN 105488837B
- Authority
- CN
- China
- Prior art keywords
- rendering
- user
- resource
- client
- cloud
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000009877 rendering Methods 0.000 title claims abstract description 559
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000004891 communication Methods 0.000 claims description 49
- 238000012795 verification Methods 0.000 claims description 29
- 230000006835 compression Effects 0.000 claims description 17
- 238000007906 compression Methods 0.000 claims description 17
- 238000012546 transfer Methods 0.000 claims description 7
- 230000003139 buffering effect Effects 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 abstract 1
- 238000007726 management method Methods 0.000 description 91
- 238000010586 diagram Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011176 pooling Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
Landscapes
- Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The real-time off screen rendering method based on cloud computing that the invention discloses a kind of, apparatus and system, its method includes after receiving the cloud rendering service request of client transmission, it enables rendering resources and creates the direct connected link of client terminal and rendering resources, rendering resources are made directly to handle cloud rendering service request, rendering resources carry out real-time rendering and the rendering result generated in real time are sent directly to client, make client terminal real-time reception rendering result and picture is shown according to rendering result, it can not only support while online client device is more, the rendering service request of the client device of magnanimity can be carried, and, all online rendering tasks are mutually indepedent, alleviate the traffic load in cloud, reduce the time delay of cloud rendering service.
Description
Technical Field
The invention relates to the field of cloud rendering, in particular to a real-time off-screen rendering method, device and system based on cloud computing.
Background
With the development of client terminal operating systems, the mobile phones and tablet computers have reached relatively comprehensive intellectualization, the mobile phones and tablet computers based on IOS, android and Windows operating systems are more and more popular in the lives of people, and the powerful functions of the smart phones and the tablet computers also bring numerous convenience to people. However, the size, power consumption and portability of the smart phone and the tablet computer are limited, the processor (such as a calculating and rendering processor) capabilities of the smart phone and the tablet computer are not powerful enough, and people cannot render and display large-scale 3D high-dynamic scenes on mobile portable terminal devices such as a mobile phone or a tablet computer.
Meanwhile, with the rapid development of cloud computing and the requirement of people on low cost of IT operation and maintenance, various cloud computing related services appear, such as Iaas (infrastructure as a service), Paas (platform as a service) and Saas (software as a service), and the general principle is that the powerful virtualization technology of cloud computing is utilized to perform pooling management on computing, storage and network resources, so that the resources are randomly divided, high availability of the computing, storage and network resources is realized, and the utilization rate of the resources is integrally improved. In the traditional IT industry, 3D large-scale high-dynamic scene rendering business is always a requirement of numerous industries, and cloud rendering services are naturally born by popularization of cloud computing services and the requirement of large-scale 3D scene rendering.
Existing cloud rendering is roughly divided into two main categories: the first is online rendering, and the second is offline rendering. The two types of methods adopt cloud rendering, the implementation method in the prior art can only provide a delayed rendering result, the method is mainly suitable for movie special effects and animation rendering, the real-time interoperation requirement of a mobile device on a 3D large-scale high-dynamic scene rendering picture cannot be met, the displayed 3D special effect image quality is poor, and good user experience of high-dynamic 3D real-time scene service cannot be provided for a user at a client terminal.
The Chinese invention patent (application publication No. CN103313120A) discloses a method for displaying pictures, which comprises the following steps: acquiring picture information of a rendering entity; sending the picture information to a cloud end, and rendering the rendering entity through the cloud end according to the picture information to obtain a rendering result; and acquiring a rendering result returned by the cloud end, and displaying a picture according to the rendering result.
According to the invention, the requirement on the self processing capacity of the portable client terminal is reduced by performing rendering operation on the cloud, the method is applicable to various types of terminals, even a low-end client terminal is also applicable, and the cloud rendering display of the 3D scene can be performed on the client terminal equipment by means of the strong processing capacity of the cloud.
However, for a large 3D scene, in the two processes of sending the image information of the rendering entity to the cloud and receiving the rendering result returned by the cloud, since the amount of data transmitted is increased, the time consumed under the condition of the same network bandwidth is increased, that is, the time delay is increased. Moreover, the number of clients which support simultaneous online is reduced, and once the communication load of the cloud reaches a critical value, the rendering tasks of the exceeding clients are suspended, so that the delay is more serious.
Disclosure of Invention
The invention aims to overcome the defects in the prior art, and provides a real-time off-screen rendering method based on cloud computing, which can support more client devices on line at the same time, can bear massive rendering service requests of the client devices, and has independent rendering tasks on line, thereby not only reducing the communication load of a cloud terminal, but also reducing the time delay of cloud rendering service.
According to an aspect of the present invention, there is provided a real-time off-screen rendering method based on cloud computing, including:
after a cloud rendering service request sent by a client is received, rendering resources are started, and a direct link between the rendering resources and the client is established;
after the direct link is successfully established, rendering resources are rendered in real time according to the cloud rendering service request, and a rendering result generated in real time is sent to the client through the direct link;
and after the rendering result is received in real time, the client displays the picture in real time according to the rendering result.
According to a specific implementation mode, after a cloud rendering service request sent by a client is received, a rendering resource list is firstly accessed, and whether available rendering resources exist is inquired;
if so, starting the optimal rendering resource; and otherwise, returning the information of the unavailable rendering resources to the client.
According to a specific implementation manner, when the rendering resource is enabled, the address of the rendering resource is obtained and allocated to one communication port of the client, and the address of the rendering resource is bound with the communication port of the client, so as to create the direct link between the rendering resource and the client.
According to a specific implementation manner, after the direct link is successfully created, according to a rendering entity described in the cloud rendering service request, the rendering resource first downloads resource data of the rendering entity;
after the resource data of the rendering entity is downloaded, rendering the resource data of the rendering entity in real time by the rendering resource according to the rendering content described in the cloud rendering request, and generating a rendering result in real time in a frame cache of the rendering resource;
and obtaining the rendering result in the frame cache in real time, compressing and encoding the rendering result, and sending the result to the client through the direct connection link.
According to a specific implementation manner, the sending frequency of the rendering result is adjusted in real time according to the communication condition on the direct link and the operation of the client.
According to a specific implementation manner, before receiving the cloud rendering service request sent by the client, a user verification request sent by the client is received;
analyzing the user identity information contained in the user verification request, and verifying whether the user identity information is consistent with the pre-bound user identity information;
and if the identification information is consistent with the heartbeat connection request message, returning the identification information to the client and establishing the heartbeat connection with the client, otherwise, not returning the identification information to the client.
According to a specific implementation mode, after the identification information is returned to the client, if a heartbeat packet sent by the client is received, the heartbeat connection is judged to be successfully established, and a user is added into a user online list; if the heartbeat packet sent by the client is not received, judging that the heartbeat connection is failed to be established, and taking the user off line;
and after the heartbeat connection is successfully established, if an offline request sent by the client is received, disconnecting the heartbeat connection, removing the user from the user online list, and releasing the created direct connection link and the enabled rendering resource.
According to a specific implementation mode, after heartbeat connection with the client is established, heartbeat packets sent by the client according to a certain frequency are received to monitor the login state of a user, and timing is started from zero immediately after each heartbeat packet is received;
and if the timing time is greater than or equal to the disconnection threshold time, removing the user from the user online list, and releasing the created direct connection link and the enabled rendering resource.
According to a specific embodiment, a certain amount of rendering resources are turned on in advance during the client online peak period, and a certain amount of rendering resources are turned off during the client online valley period.
According to an aspect of the present invention, there is also provided a real-time off-screen rendering apparatus based on cloud computing, including:
the communication transfer unit is used for receiving a cloud rendering service request sent by a client;
the rendering resource unit is used for providing rendering resources for rendering service;
a resource management unit for managing and enabling the rendering resources;
and the service scheduling unit is used for creating a direct link between the rendering resource and the client.
According to a specific embodiment, the resource management unit includes:
a rendering resource list subunit, configured to store addresses of the rendering resources in the rendering resource unit, count the working states of the rendering resources according to a certain frequency, and establish a rendering resource list according to a result of the counting;
a rendering resource starting subunit, configured to query whether there is an available rendering resource in the rendering resource list, and when there is an available rendering resource, start an optimal rendering resource in the rendering resource list, otherwise, return information of no available rendering resource to the client;
and the rendering resource address sending subunit is configured to send the address of the rendering resource started by the rendering resource starting subunit to the service scheduling unit, so that the address is used by the service scheduling unit when the direct link is created.
According to a specific embodiment, the service scheduling unit includes:
and the communication link management subunit is configured to allocate a communication port to the client, and after receiving the address of the rendering resource sent by the rendering resource address sending subunit, bind the address of the rendering resource with the communication port of the client to create the direct connection link between the rendering resource and the client.
According to a particular embodiment, the rendering resources include:
a resource data downloading subunit, configured to request to download resource data of the rendering entity according to the rendering entity described in the cloud rendering service request, and execute downloading of the resource data;
the rendering execution subunit is used for rendering the resource data in real time according to the rendering content described in the cloud rendering request;
the frame buffer subunit is used for buffering the rendering result generated by the rendering execution subunit in real time;
the compression coding subunit is used for acquiring the rendering result in the frame buffer subunit in real time and performing compression coding on the rendering result;
and the rendering result sending subunit is used for sending the rendering result processed by the compression coding subunit to the client through the direct link in real time and adjusting the sending frequency of the rendering result in real time according to the communication condition of the direct link and the operation of the client.
According to a particular embodiment, the device further comprises:
the storage unit is used for storing rendering entity resource data of a user in advance;
and the database management unit is used for managing rendering entity resource data of a user and sending the storage address of the resource data in the storage unit to the rendering resource when the rendering resource requests to download the resource data so that the rendering resource can download the resource data.
According to a particular embodiment, the device comprises a user management unit, and,
the communication transfer unit is further configured to receive a user verification request and an offline request sent by the client;
the database management unit is also used for managing the identity information of the user and storing the user identity information bound by the user in advance;
the service scheduling unit is further configured to forward the user verification request and the offline request to the user management unit.
According to a specific embodiment, the user management unit includes:
the identity information verification subunit is used for analyzing the user identity information contained in the user verification request, sending the user identity information to the database management unit for comparison, and verifying whether the user identity information is consistent with the pre-bound user identity information;
the heartbeat connection subunit is used for returning identification information to the client and establishing heartbeat connection with the client according to whether the user identity information is consistent with the pre-bound user identity information or not; after the identification information is returned to the client, receiving a heartbeat packet sent by the client, if the heartbeat packet is received, judging that the heartbeat connection is established successfully, and if the heartbeat packet is not received, judging that the heartbeat connection fails and the user is off-line; after the heartbeat connection is successfully established, when the offline request sent by the client is received, the heartbeat connection is disconnected;
the user online list management subunit is used for establishing a user online list and adding a user to the user online list when the heartbeat connection is successfully established; and when the offline request sent by the client is received, removing the user from the user online list, and releasing the created direct link and the enabled rendering resource.
According to a specific implementation manner, the heartbeat connection subunit is further configured to start timing from zero after receiving one heartbeat packet, and send user offline information to the user online list management subunit when the timing time is greater than the offline threshold time, so that the user online list management subunit removes the user from the user online list, and releases the created direct connection link and the enabled rendering resource.
According to a particular embodiment, the device further comprises:
and the intelligent management unit is used for starting a certain amount of rendering resources in advance in the online peak period of the user and closing a certain amount of rendering resources in the online valley period of the user.
According to one aspect of the invention, the real-time off-screen rendering system based on cloud computing is further provided, and the system is characterized by comprising a client, a public network and a plurality of user resource pools, wherein the user resource pools are respectively bound with unique public network IPs, and the client accesses the user resource pools by being linked to the public network IPs;
the user resource pool comprises a router, a rendering resource server, a resource management server and a service scheduling server; wherein,
the router is used for receiving a cloud rendering service request sent by the client and forwarding the cloud rendering service request to the service scheduling server;
the service scheduling server is used for creating a direct link between the rendering resource and the client, and forwarding the cloud rendering service request to the rendering resource server and the resource management server;
the rendering resource server is used for providing rendering resources to perform rendering service;
the resource management server is used for managing and starting the rendering resources.
According to a specific implementation mode, the resource management server stores the addresses of the rendering resources in the rendering resource server, counts the working states of the rendering resources according to a certain frequency, and establishes a rendering resource list according to the counting result;
the resource management server receives the cloud rendering service request forwarded by the service scheduling server, inquires whether available rendering resources exist in the rendering resource list, if so, starts the optimal rendering resources, otherwise, returns information of no available resources to the client;
and the resource management server starts rendering resources and sends addresses of the rendering resources to the service scheduling server so as to be used when the service scheduling server creates the direct connection link.
According to a specific implementation manner, the service scheduling server receives an address sent by the resource management server, allocates the address to a communication port of the client, and binds the address of the rendering resource with the communication port of the client to create the direct link between the rendering resource and the client.
According to a specific embodiment, the rendering resource downloads resource data of the rendering entity according to the rendering entity described in the cloud rendering service request; rendering the downloaded resource data in real time according to the rendering content described in the cloud rendering request, and generating a rendering result in real time in a frame buffer;
the rendering resource performs compression coding on the rendering result in the frame buffer; and sending the rendering result after compression coding to the client through the direct connection link, and adjusting the sending frequency of the rendering result in real time according to the communication condition of the direct connection link and the operation of the client.
According to a specific embodiment, the system comprises a database server and a storage server; the user resource pool shares the database server and the storage server; wherein,
the storage server is used for storing rendering entity resource data of a user in advance;
the database management server is used for managing rendering entity resource data of a user and sending the storage address of the resource data in the storage server to the rendering resource when the rendering resource requests to download the resource data, so that the rendering resource can download the resource data.
According to a particular embodiment, the system comprises: the user manages the server, and,
the router is further used for receiving a user verification request sent by the client;
the database management server is also used for managing the identity information of the user and storing the user identity information bound by the user in advance;
the service scheduling server is further configured to forward the user authentication request to the user management server.
According to a specific implementation manner, the user management server receives a user authentication request forwarded by the service scheduling server, analyzes user identity information contained in the user authentication request, sends the user identity information to the database management unit for comparison, and verifies whether the user identity information is consistent with pre-bound user identity information;
the user management server returns identification information to the client according to whether the user identity information is consistent with pre-bound user identity information or not, so that the client establishes heartbeat connection with the user management server;
after the identification information is returned to the client, the user management server receives a heartbeat packet sent by the client, judges that the heartbeat connection is successfully established, and adds the user into a user online list; if the user management server does not receive the heartbeat connection, judging that the heartbeat connection fails and the user is offline;
after the heartbeat connection is successfully established, the user management server receives the offline request sent by the client, disconnects the heartbeat connection, removes the user from the user online list, and releases the created direct connection link and deactivates the activated rendering resources.
According to a specific embodiment, after receiving one heartbeat packet, the user management server starts timing from zero;
and if the timing time is greater than the offline threshold time, the user management server removes the user from the user online list, releases the created direct link and deactivates the enabled rendering resources.
According to a particular embodiment, the system comprises:
the intelligent management server is used for starting a certain amount of rendering resources in advance in the online peak period of the user and closing a certain amount of rendering resources in the online valley period of the user.
Compared with the prior art, the invention has the beneficial effects that:
according to the cloud rendering service request processing method and device, after the cloud rendering service request sent by the client is received, the rendering resources are started, the direct link between the client terminal and the rendering resources is established, the rendering resources directly process the cloud rendering service request, the rendering resources are rendered in real time, the rendering result generated in real time is directly sent to the client, the client terminal receives the rendering result in real time and displays a picture according to the rendering result, the client terminal can support multiple client devices which are online at the same time, the large number of rendering service requests of the client devices can be borne, all online rendering tasks are independent of each other, the communication load of the cloud is reduced, and the time delay of the cloud rendering service is reduced.
Meanwhile, the sending frequency of the rendering result is dynamically adjusted in real time and the rendering result is compressed to different degrees according to the communication condition on the direct connection link and the operation of the client, so that the time delay of the rendering service is further reduced, the real-time interoperation between the user and the large-scale 3D scene can be realized, and the good user experience of the high-dynamic 3D real-time scene service is provided for the user at the client terminal equipment.
Moreover, the method and the system can also record the time law of requesting the cloud rendering service by the user, reasonably control the standby number of the rendering resources according to the time law, reduce energy consumption under the condition of ensuring sufficient user resources, and save energy and protect environment.
Drawings
FIG. 1 is a basic flow diagram of a cloud rendering service according to the method of the present invention;
FIG. 2 is a flow chart illustrating rendering resource activation by the method of the present invention;
FIG. 3 is a schematic flow chart of the method for rendering real-time rendering of resources;
FIG. 4 is a schematic diagram of a basic flow of the method for verifying user identity information;
FIG. 5 is a flow chart illustrating a method for managing heartbeat connections according to the present invention;
FIG. 6 is a schematic flow chart of the user login status determination of the method of the present invention;
FIG. 7 is a schematic structural view of a first embodiment of the apparatus of the present invention;
FIG. 8 is a schematic structural view of a second embodiment of the apparatus of the present invention;
FIG. 9 is a schematic structural view of a third embodiment of the apparatus of the present invention;
FIG. 10 is a schematic structural view of a fourth embodiment of the apparatus of the present invention;
FIG. 11 is a schematic structural view of a fifth embodiment of the apparatus of the present invention;
FIG. 12 is a schematic structural view of a sixth embodiment of the apparatus of the present invention;
FIG. 13 is a schematic block diagram of a first embodiment of the system of the present invention;
FIG. 14 is a schematic block diagram of a second embodiment of the system of the present invention;
fig. 15 is a schematic structural diagram of a third embodiment of the system of the present invention.
Detailed Description
The present invention will be described in further detail with reference to specific embodiments. It should be understood that the scope of the above-described subject matter is not limited to the following examples, and any techniques implemented based on the disclosure of the present invention are within the scope of the present invention.
With reference to fig. 1, a basic flow diagram of a cloud rendering service according to the method of the present invention is shown; on a client of an application having a 3D scene, a user performs certain related operations on the application of the 3D scene, such as rotation, movement, scaling operations and the like on a rendering entity, and when the related operations are identified by the 3D scene application, a cloud rendering service request containing related rendering content and rendering entity information is generated. Therefore, after the user completes the relevant operation on the client, the client sends the relevant cloud rendering service request to request the cloud rendering service.
The real-time off-screen rendering method based on cloud computing comprises the following steps:
and after receiving a cloud rendering service request sent by the client, starting rendering resources and creating a direct link between the rendering resources and the client.
And after the direct link is successfully established, rendering resources according to the cloud rendering service request in real time, and sending a rendering result generated in real time to the client through the direct link.
And after the rendering result is received in real time, the client displays the picture in real time according to the rendering result.
According to the method and the system, the direct link between the rendering resource and the client is created, so that all online rendering tasks are mutually independent, the communication load of the cloud is reduced, and the time delay of the cloud rendering service is reduced.
FIG. 2 is a flow chart illustrating the method of the present invention for enabling rendering resources; after receiving a cloud rendering service request sent by a client, firstly accessing a rendering resource list and inquiring whether available rendering resources exist.
If so, starting the optimal rendering resource; otherwise, returning the information of the unavailable rendering resources to the client.
Specifically, when the rendering resource list has available rendering resources, because the rendering resources are distributed on different physical machines and the relative use frequency of some rendering resources is slightly higher, the optimal rendering resource is started, that is, the physical machine with the lower operation load is determined, and the rendering resource with the relatively lower use frequency is started on the physical machine, which is favorable for balancing the use of the rendering resources, reasonably planning the starting of the rendering resources, and avoiding the idle of the rendering resources.
And when the rendering resources are enabled, the addresses of the rendering resources are also obtained and allocated to one communication port of the client, and the addresses of the rendering resources are bound with the communication port of the client to create a direct link between the rendering resources and the client.
And when no available rendering resource exists in the rendering resource list, suspending the cloud rendering service request, and when available rendering resource exists, providing the rendering service.
The flow chart of the resource real-time rendering by the method of the invention shown in FIG. 3 is combined; and after the direct link is successfully established, the rendering resources firstly download the resource data of the rendering entity according to the rendering entity described in the cloud rendering service request.
And after the resource data of the rendering entity is downloaded, rendering the resource data of the rendering entity in real time by the rendering resource according to the rendering content described in the cloud rendering request, and generating a rendering result in real time in a frame cache of the rendering resource.
And obtaining a rendering result in the frame cache in real time, compressing and encoding the rendering result, and sending the result to the client through the direct link.
Specifically, the rendering resources are resources with GPU hardware, and rendering of data is mainly accomplished by the GPU. The data rendering process may be a conventional rendering pipeline process or a programmable rendering pipeline process, and the final rendering result is placed in the frame buffer.
And when the rendering result is sent to the client, the sending frequency of the rendering result is adjusted in real time according to the communication condition of the direct link and the operation of the client. When the communication condition on the direct connection link is not good, the sending frequency of the rendering result is reduced so as to avoid data congestion and communication overload when the client receives the data and avoid influencing user experience. Through the processing mode, the time delay of the rendering service is reduced, the real-time interoperation between the user and the large-scale 3D scene can be realized, and the good user experience of the high-dynamic 3D real-time scene service is provided for the user at the client terminal equipment.
The basic flow chart of the method for verifying the user identity information in the invention shown in fig. 4 is shown; before receiving a cloud rendering service request sent by a client, receiving a user verification request sent by the client.
And verifying whether the user identity information is consistent with the pre-bound user identity information or not by analyzing the user identity information contained in the user verification request and comparing the user identity information with the pre-bound user identity information.
If the identification information is consistent with the heartbeat connection information, returning the identification information to the client and establishing the heartbeat connection with the client, otherwise, not returning the identification information to the client.
FIG. 5 is a schematic flow chart of managing heartbeat connections according to the method of the present invention; after the identification information is returned to the client, if a heartbeat packet sent by the client is received, judging that the heartbeat connection is successfully established, and adding the user into the user online list; if the heartbeat packet sent by the client is not received, judging that the heartbeat connection is failed to be established, and taking the user off line;
and after the heartbeat connection is successfully established, if an offline request sent by the client is received, the heartbeat connection is disconnected, the user is removed from the user online list, and the created direct connection link and the enabled rendering resource are released.
With reference to fig. 6, a schematic flow chart of the user login state determination according to the method of the present invention is shown; after the heartbeat connection with the client is established, the heartbeat packet sent by the client according to a certain frequency is received to monitor the login state of the user, and timing is started from zero immediately after each heartbeat packet is received.
And if the timing time is greater than or equal to the offline threshold time, the user is considered to be offline, the user is removed from the online list of the user, and the created direct link and the enabled rendering resource are released.
The real-time off-screen rendering method based on the cloud computing also starts a certain amount of rendering resources in advance in the online peak period of the client according to the rule that the client is added into the online list of the user, and closes the certain amount of rendering resources in the online valley period of the client.
Based on the same invention concept, the invention also provides a real-time off-screen rendering device based on cloud computing. With reference to fig. 7, a schematic structural view of a first embodiment of the device of the present invention is shown; the invention discloses a real-time off-screen rendering device based on cloud computing, which comprises: the system comprises a communication transfer unit, a rendering resource unit, a resource management unit and a service scheduling unit.
The communication transfer unit is used for receiving the cloud rendering service request sent by the client and forwarding the received cloud rendering service request to the service scheduling unit. The service scheduling unit forwards the cloud rendering service request to the resource management unit, the resource management unit manages and starts rendering resources, the rendering resources are provided by the rendering resource unit, the service scheduling unit creates a direct link between the rendering resources and the client, and the rendering service is performed through the rendering resources.
With reference to fig. 8, a schematic structural view of a second embodiment of the device of the present invention is shown; wherein, the resource management unit includes: the system comprises a rendering resource list subunit, a rendering resource starting subunit and a rendering resource address sending subunit.
The rendering resource list subunit stores the addresses of the rendering resources in the rendering resource unit, counts the working states of the rendering resources according to a certain frequency, and establishes a rendering resource list according to the statistical result.
And the rendering resource starting subunit is used for inquiring whether available rendering resources exist in the rendering resource list or not, starting the optimal rendering resources when the available rendering resources exist, and returning the information of the unavailable rendering resources to the client side if the available rendering resources do not exist.
And the rendering resource address sending subunit is used for sending the address of the rendering resource started by the rendering resource starting subunit to the service scheduling unit so as to be used when the service scheduling unit establishes the direct link.
And the service scheduling unit comprises a communication link management subunit, when the direct link is created, the communication link management subunit allocates a communication port to the client, and after receiving the address of the rendering resource sent by the rendering resource address sending subunit, binds the address of the rendering resource with the communication port of the client to create the direct link between the rendering resource and the client.
FIG. 9 is a schematic structural view of a third embodiment of the apparatus of the present invention; the real-time off-screen rendering device based on cloud computing further comprises a storage unit and a database management unit. The storage unit is used for storing rendering entity resource data of a user in advance; and the database management unit is used for managing rendering entity resource data of the user and sending the storage address of the resource data in the storage unit to the rendering resource when the rendering resource requests to download the resource data so as to enable the rendering resource to download the resource data.
In addition, in this embodiment, the rendering resource includes a resource data downloading subunit, a rendering execution subunit, a frame buffering subunit, a compression coding subunit, and a rendering result sending subunit.
The resource data downloading subunit is configured to request to download the resource data of the rendering entity according to the rendering entity described in the cloud rendering service request, and execute downloading of the resource data.
And the rendering execution subunit is used for rendering the resource data in real time according to the rendering content described in the cloud rendering request.
And the frame buffer subunit is used for buffering the rendering result generated by the rendering execution subunit in real time.
And the compression coding subunit is used for acquiring the rendering result in the frame buffering subunit in real time and performing compression coding on the rendering result.
And the rendering result sending subunit is used for sending the rendering result processed by the compression coding subunit to the client through the direct link in real time and adjusting the sending frequency of the rendering result in real time according to the communication condition of the direct link and the operation of the client.
FIG. 10 is a schematic structural view of a fourth embodiment of the apparatus of the present invention; the real-time off-screen rendering device based on cloud computing further comprises a user management unit, and the communication transfer unit is further used for receiving a user verification request and an off-line request sent by the client; the database management unit is also used for managing the identity information of the user and storing the user identity information bound by the user in advance; and the service scheduling unit is also used for forwarding the user verification request and the offline request to the user management unit.
With reference to fig. 11, a schematic structural view of a fifth embodiment of the apparatus of the present invention is shown; the user management unit includes:
and the identity information verification subunit is used for analyzing the user identity information contained in the user verification request, sending the user identity information to the database management unit for comparison, and verifying whether the user identity information is consistent with the pre-bound user identity information.
The heartbeat connection subunit returns identification information to the client according to whether the user identity information is consistent with the pre-bound user identity information or not, and establishes heartbeat connection with the client; after the identification information is returned to the client, a heartbeat packet sent by the client is received, if the heartbeat packet is received, the heartbeat connection is judged to be successfully established, and if the heartbeat packet is not received, the heartbeat connection is judged to be failed, and the user is offline; and after the heartbeat connection is successfully established, when an offline request sent by the client is received, the heartbeat connection is disconnected.
The user online list management subunit is used for establishing a user online list and adding the user to the user online list when the heartbeat connection is successfully established; and when an offline request sent by the client is received, removing the user from the user online list, and releasing the created direct link and the enabled rendering resource.
In this embodiment, the heartbeat connection subunit is further configured to start timing from zero after receiving a heartbeat packet, and send the user offline information to the user online list management subunit when the timing time is greater than the offline threshold time, so that the user online list management subunit removes the user from the user online list, and releases the created direct link and the enabled rendering resource.
With reference to fig. 12, a schematic structural view of a sixth embodiment of the device of the present invention is shown; the real-time off-screen rendering device based on cloud computing further comprises an intelligent management unit.
The intelligent management unit is used for starting a certain amount of rendering resources in advance in the online peak period of the user and closing a certain amount of rendering resources in the online valley period of the user according to the rule that the user joins the online list of the user.
Based on the same inventive concept, the invention also provides a real-time off-screen rendering system based on cloud computing, which is combined with the structural schematic diagram of the first embodiment of the system shown in fig. 13; the real-time off-screen rendering system based on cloud computing comprises a client, a public network and a plurality of user resource pools, wherein unique public network IPs are respectively bound to the user resource pools, and the client is connected to the public network IPs through links and is accessed to the user resource pools.
And the user resource pool comprises a router, a rendering resource server, a resource management server and a service scheduling server.
The router is used for receiving a cloud rendering service request sent by a client side and forwarding the cloud rendering service request to the service scheduling server.
And the service scheduling server is used for creating a direct link between the rendering resources and the client, and forwarding the cloud rendering service request to the rendering resource server and the resource management server.
And the rendering resource server is used for providing rendering resources to perform rendering service.
And the resource management server is used for managing and starting rendering resources.
Specifically, the resource management server stores the address of each rendering resource in the rendering resource server, counts the working state of each rendering resource according to a certain frequency, and establishes a rendering resource list according to the statistical result.
And the resource management server receives the cloud rendering service request forwarded by the service scheduling server, inquires whether available rendering resources exist in the rendering resource list, if so, starts the optimal rendering resources, and otherwise, returns information of no available resources to the client.
And the resource management server starts the rendering resources and sends the addresses of the rendering resources to the service scheduling server for the service scheduling server to use when creating the direct link.
And the service scheduling server receives the address sent by the resource management server, allocates the address to a communication port of the client, and binds the address of the rendering resource with the communication port of the client to create a direct link between the rendering resource and the client.
With reference to fig. 14, a schematic diagram of a second embodiment of the system of the present invention; the real-time off-screen rendering system based on cloud computing further comprises a database server and a storage server.
The user resource pool shares the database server and the storage server, and the storage server is used for storing rendering entity resource data of the user in advance.
And the database management server is used for managing rendering entity resource data of the user and sending the storage address of the resource data in the storage server to the rendering resource when the rendering resource requests to download the resource data so as to allow the rendering resource to download the resource data.
With reference to the schematic structural diagram of the third embodiment of the system of the present invention shown in fig. 15, the real-time off-screen rendering system based on cloud computing of the present invention includes: a user management server and an intelligent management server.
Specifically, the router is configured to receive a user authentication request sent by a client.
And the database management server is used for managing the identity information of the user and storing the user identity information bound by the user in advance.
And the service scheduling server is used for forwarding the user verification request to the user management server.
The user management server receives the user verification request forwarded by the service scheduling server, analyzes user identity information contained in the user verification request, sends the user identity information to the database management unit for comparison, and verifies whether the user identity information is consistent with pre-bound user identity information;
the user management server returns identification information to the client according to whether the user identity information is consistent with the pre-bound user identity information or not, so that the client establishes heartbeat connection with the user management server;
after the identification information is returned to the client, the user management server receives the heartbeat packet sent by the client, judges that the heartbeat connection is successfully established and adds the user into the user online list; if the user management server does not receive the heartbeat connection, judging that the heartbeat connection fails, and taking the user off-line;
after the heartbeat connection is successfully established, the user management server receives an offline request sent by the client, disconnects the heartbeat connection, removes the user from the user online list, and releases the created direct connection link and deactivates the enabled rendering resources.
And after the heartbeat connection between the user management server and the client is successfully established, the client sends a heartbeat packet to the user management server according to a certain frequency, and the user management server starts timing from zero after receiving one heartbeat packet.
And if the timing time is greater than the offline threshold time, the user management server removes the user from the user online list, releases the created direct link and deactivates the enabled rendering resources.
And the intelligent management server is used for starting a certain amount of rendering resources in advance in the online peak period of the user and closing a certain amount of rendering resources in the online valley period of the user according to the rule that the user joins the online list of the user.
To further explain the cloud computing-based real-time off-screen rendering method, device and system of the present invention, the following describes the present invention in more detail by using an example of real-time rendering of a rendering physical teapot.
And the user uses the client to send a user authentication request to a user resource pool corresponding to the user through a TCP/IP protocol. In the user resource pool, after receiving the user verification request, the router immediately forwards the user verification request to the service scheduling server, and then the service scheduling server forwards the user verification request to the user management server.
After receiving the user verification request, the user management server analyzes the user identity information in the user verification request, compares the user identity information with the user information pre-bound in the database management server, and verifies whether the user identity information is consistent with the pre-bound user identity information.
And if the identification information is consistent with the identification information, the user management server returns the unique identification information to the client through the service scheduling server and the router. And the client establishes heartbeat connection with the user management server according to the identification information, and the user management server adds the user into the user online list if the user management server receives the heartbeat packet sent by the client and indicates that the heartbeat connection is successfully established.
Then, after the user joins the user online list, the client can send a corresponding cloud rendering service request to the user resource pool through real-time operation, and after the router receives the cloud rendering service request, the router immediately forwards the user verification request to the service scheduling server, and then the service scheduling server forwards the user verification request to the resource management server.
After receiving the cloud rendering service request, the resource management server inquires whether available rendering resources exist in a resource list of the cloud rendering service request, and selects rendering resources with low operation load and relatively low use frequency to be enabled on a physical machine for responding to the cloud rendering service request.
And when the rendering resources are started, the resource management server forwards the addresses of the started rendering resources to the service scheduling server, and meanwhile, the service scheduling server allocates one communication port to the client and binds the addresses of the rendering resources with the communication port, so that a direct link between the rendering resources and the client is established.
After the direct link is successfully established, the rendering resource requests the database management server to download the resource data of the rendering entity teapot according to the rendering entity teapot described in the cloud rendering service request, the database management server sends the storage address of the resource data of the rendering entity teapot in the storage server to the rendering resource, and the rendering resource downloads the resource data of the rendering entity teapot according to the storage address of the resource data of the rendering entity teapot in the storage server.
And after the resource data of the rendering entity teapot is downloaded, rendering the rendering entity teapot in real time according to the rendering content of the cloud rendering service request, such as rotation, movement, scaling and the like of the rendering entity teapot, and generating a rendering result in a frame buffer of the rendering resource. And extracting the rendering result in the frame cache in real time, carrying out compression coding on the rendering result, and directly sending the rendering result to the client through the direct link after the compression coding.
Specifically, in the process of rendering the rendering entity teapot, if the timing time of the user management server after receiving each heartbeat packet is greater than or equal to the offline threshold time, the user is removed from the user online list, and the created direct link and the enabled rendering resource are released. And if the client sends an offline request, the user management server disconnects the heartbeat connection, removes the user from the user online list, and releases the created direct connection link and the enabled rendering resource.
And in the step of sending the rendering result after the compression coding to the client, the rendering resource also adjusts the sending frequency of the rendering result in real time according to the communication condition on the direct link and the operation of the client. The real-time operation of the client is described in the rendering content requested by the cloud rendering service correspondingly.
According to the method and the device, through reasonable management and starting of rendering resources, not only can a plurality of client devices which are online at the same time be supported, and massive rendering service requests of the client devices can be borne, but also all online rendering tasks are independent, so that the communication load of a cloud is reduced, and the time delay of cloud rendering services is reduced.
Meanwhile, the invention also dynamically adjusts the sending frequency of the rendering result in real time and compresses the rendering result to different degrees according to the communication condition on the direct connection link and the operation of the user at the client, further reduces the time delay of the rendering service, can realize the real-time interoperation between the user and the large-scale 3D scene, and provides the user with good user experience of the high-dynamic 3D real-time scene service at the client terminal equipment.
While the present invention has been described in detail with reference to the embodiments shown in the drawings, the present invention is not limited to the above embodiments, and various modifications or alterations can be made by those skilled in the art without departing from the spirit and scope of the claims of the present application.
Claims (18)
1. A real-time off-screen rendering method based on cloud computing is characterized by comprising the following steps:
after receiving a cloud rendering service request sent by a client, firstly accessing a rendering resource list and inquiring whether available rendering resources exist; if so, starting the optimal rendering resource; otherwise, returning the information of the unavailable rendering resources to the client; when the rendering resources are enabled, acquiring addresses of the rendering resources, allocating the addresses to one communication port of the client, and binding the addresses of the rendering resources and the communication port of the client to create a direct link between the rendering resources and the client;
after the direct link is successfully established, according to a rendering entity described in the cloud rendering service request, the rendering resource first downloads resource data of the rendering entity; after the resource data of the rendering entity is downloaded, rendering the resource data of the rendering entity in real time by the rendering resource according to the rendering content described in the cloud rendering request, and generating a rendering result in real time in a frame cache of the rendering resource; the rendering result in the frame cache is obtained in real time, compressed and encoded, and then sent to the client through the direct link;
and after the rendering result is received in real time, the client displays the picture in real time according to the rendering result.
2. The cloud-computing-based real-time off-screen rendering method of claim 1, wherein a sending frequency of the rendering result is adjusted in real-time according to a communication condition on the direct link and an operation of the client.
3. The cloud-computing-based real-time off-screen rendering method of claim 1, wherein a user authentication request sent by the client is received before the cloud rendering service request sent by the client is received;
analyzing the user identity information contained in the user verification request, and verifying whether the user identity information is consistent with the pre-bound user identity information;
and if the identification information is consistent with the heartbeat connection request message, returning the identification information to the client and establishing the heartbeat connection with the client, otherwise, not returning the identification information to the client.
4. The real-time off-screen rendering method based on cloud computing of claim 3, wherein after the identification information is returned to the client, if a heartbeat packet sent by the client is received, it is determined that the heartbeat connection is established successfully, and a user is added to a user online list; if the heartbeat packet sent by the client is not received, judging that the heartbeat connection is failed to be established, and taking the user off line;
and after the heartbeat connection is successfully established, if an offline request sent by the client is received, disconnecting the heartbeat connection, removing the user from the user online list, and releasing the created direct connection link and the enabled rendering resource.
5. The real-time off-screen rendering method based on cloud computing of claim 4, wherein after a heartbeat connection with the client is established, a heartbeat packet sent by the client at a certain frequency is received to monitor a login state of a user, and timing is started from zero immediately after each heartbeat packet is received;
and if the timing time is greater than or equal to the offline threshold time, removing the user from the user online list, and releasing the created direct link and the enabled rendering resource.
6. The cloud-computing-based real-time off-screen rendering method of claim 4, wherein a certain amount of rendering resources are turned on in advance during the client online peak period and turned off during the client online valley period.
7. A real-time off-screen rendering device based on cloud computing, comprising:
the communication transfer unit is used for receiving a cloud rendering service request sent by a client;
the rendering resource unit is used for providing rendering resources for rendering service;
a resource management unit for managing and enabling the rendering resources;
a service scheduling unit, configured to create a direct link between the rendering resource and the client;
wherein the resource management unit includes:
a rendering resource list subunit, configured to store addresses of the rendering resources in the rendering resource unit, count the working states of the rendering resources according to a certain frequency, and establish a rendering resource list according to a result of the counting;
a rendering resource starting subunit, configured to query whether there is an available rendering resource in the rendering resource list, and when there is an available rendering resource, start an optimal rendering resource in the rendering resource list, otherwise, return information of no available rendering resource to the client;
a rendering resource address sending subunit, configured to send an address of a rendering resource started by the rendering resource starting subunit to the service scheduling unit, so that the address is used by the service scheduling unit when the direct link is created;
the service scheduling unit comprises:
a communication link management subunit, configured to allocate a communication port to the client, and after receiving the address of the rendering resource sent by the rendering resource address sending subunit, bind the address of the rendering resource with the communication port of the client, so as to create the direct link between the rendering resource and the client;
the rendering resources include:
a resource data downloading subunit, configured to request to download resource data of the rendering entity according to the rendering entity described in the cloud rendering service request, and execute downloading of the resource data;
the rendering execution subunit is used for rendering the resource data in real time according to the rendering content described in the cloud rendering request;
the frame buffer subunit is used for buffering the rendering result generated by the rendering execution subunit in real time;
the compression coding subunit is used for acquiring the rendering result in the frame buffer subunit in real time and performing compression coding on the rendering result;
and the rendering result sending subunit is used for sending the rendering result processed by the compression coding subunit to the client through the direct link in real time and adjusting the sending frequency of the rendering result in real time according to the communication condition of the direct link and the operation of the client.
8. The cloud computing-based real-time off-screen rendering apparatus of claim 7, wherein the apparatus further comprises:
the storage unit is used for storing rendering entity resource data of a user in advance;
and the database management unit is used for managing rendering entity resource data of a user and sending the storage address of the resource data in the storage unit to the rendering resource when the rendering resource requests to download the resource data so that the rendering resource can download the resource data.
9. The cloud computing-based real-time off-screen rendering apparatus of claim 8, wherein the apparatus includes a user management unit, and,
the communication transfer unit is further configured to receive a user verification request and an offline request sent by the client;
the database management unit is also used for managing the identity information of the user and storing the user identity information bound by the user in advance;
the service scheduling unit is further configured to forward the user verification request and the offline request to the user management unit.
10. The cloud computing-based real-time off-screen rendering apparatus of claim 9, wherein the user management unit comprises:
the identity information verification subunit is used for analyzing the user identity information contained in the user verification request, sending the user identity information to the database management unit for comparison, and verifying whether the user identity information is consistent with the pre-bound user identity information;
the heartbeat connection subunit is used for returning identification information to the client and establishing heartbeat connection with the client according to whether the user identity information is consistent with the pre-bound user identity information or not; after the identification information is returned to the client, receiving a heartbeat packet sent by the client, if the heartbeat packet is received, judging that the heartbeat connection is established successfully, and if the heartbeat packet is not received, judging that the heartbeat connection fails and the user is off-line; after the heartbeat connection is successfully established, when the offline request sent by the client is received, the heartbeat connection is disconnected;
the user online list management subunit is used for establishing a user online list and adding a user to the user online list when the heartbeat connection is successfully established; and when the offline request sent by the client is received, removing the user from the user online list, and releasing the created direct link and the enabled rendering resource.
11. The cloud-computing-based real-time off-screen rendering apparatus according to claim 10, wherein the heartbeat connection subunit is further configured to start timing from zero after receiving one heartbeat packet, and send user offline information to the user online list management subunit when the timing time is greater than a offline threshold time, so that the user online list management subunit removes the user from the user online list, and releases the created direct link and the enabled rendering resource.
12. The cloud computing-based real-time off-screen rendering apparatus of claim 9, wherein the apparatus further comprises:
and the intelligent management unit is used for starting a certain amount of rendering resources in advance in the online peak period of the user and closing a certain amount of rendering resources in the online valley period of the user.
13. A real-time off-screen rendering system based on cloud computing is characterized by comprising a client, a public network and a plurality of user resource pools, wherein unique public network IPs are respectively bound to the user resource pools, and the client is connected to the public network IPs through links and accesses the user resource pools;
the user resource pool comprises a router, a rendering resource server, a resource management server and a service scheduling server; wherein,
the router is used for receiving a cloud rendering service request sent by the client and forwarding the cloud rendering service request to the service scheduling server;
the service scheduling server is used for creating a direct link between the rendering resource and the client, and forwarding the cloud rendering service request to the rendering resource server and the resource management server;
the rendering resource server is used for providing rendering resources to perform rendering service;
the resource management server is used for managing and starting the rendering resources;
the resource management server stores the address of each rendering resource in the rendering resource server, counts the working state of each rendering resource according to a certain frequency, and establishes a rendering resource list according to the counting result; the resource management server receives the cloud rendering service request forwarded by the service scheduling server, inquires whether available rendering resources exist in the rendering resource list, if so, starts the optimal rendering resources, otherwise, returns information of no available resources to the client; enabling rendering resources by the resource management server, and sending addresses of the rendering resources to the service scheduling server for the service scheduling server to use when creating the direct link;
the service scheduling server receives the address sent by the resource management server, allocates the address to a communication port of the client, and binds the address of the rendering resource with the communication port of the client to create the direct link between the rendering resource and the client;
the rendering resource downloads resource data of the rendering entity according to the rendering entity described in the cloud rendering service request; rendering the downloaded resource data in real time according to the rendering content described in the cloud rendering request, and generating a rendering result in real time in a frame buffer; the rendering resource performs compression coding on the rendering result in the frame buffer; and sending the rendering result after compression coding to the client through the direct connection link, and adjusting the sending frequency of the rendering result in real time according to the communication condition of the direct connection link and the operation of the client.
14. The cloud computing-based real-time off-screen rendering system of claim 13, wherein the system comprises a database server and a storage server; the user resource pool shares the database server and the storage server; wherein,
the storage server is used for storing rendering entity resource data of a user in advance;
the database management server is used for managing rendering entity resource data of a user and sending the storage address of the resource data in the storage server to the rendering resource when the rendering resource requests to download the resource data, so that the rendering resource can download the resource data.
15. The cloud computing-based real-time off-screen rendering system of claim 13, wherein the system comprises: the user manages the server, and,
the router is further used for receiving a user verification request sent by the client;
the database management server is also used for managing the identity information of the user and storing the user identity information bound by the user in advance;
the service scheduling server is further configured to forward the user authentication request to the user management server.
16. The cloud-computing-based real-time off-screen rendering system of claim 15, wherein the user management server receives a user authentication request forwarded by the service scheduling server, parses user identity information contained in the user authentication request, sends the user identity information to the database management unit for comparison, and verifies whether the user identity information is consistent with pre-bound user identity information;
the user management server returns identification information to the client according to whether the user identity information is consistent with pre-bound user identity information or not, so that the client establishes heartbeat connection with the user management server;
after the identification information is returned to the client, the user management server receives a heartbeat packet sent by the client, judges that the heartbeat connection is successfully established, and adds the user into a user online list; if the user management server does not receive the heartbeat connection, judging that the heartbeat connection fails and the user is offline;
after the heartbeat connection is successfully established, the user management server receives the offline request sent by the client, disconnects the heartbeat connection, removes the user from the user online list, and releases the created direct connection link and deactivates the activated rendering resources.
17. The cloud computing-based real-time off-screen rendering system of claim 16, wherein the user management server starts timing from zero after receiving one of the heartbeat packets;
and if the timing time is greater than the offline threshold time, the user management server removes the user from the user online list, releases the created direct link and stops the enabled rendering resources.
18. The cloud computing-based real-time off-screen rendering system of claim 15, wherein the system comprises:
and the intelligent management server is used for starting a certain amount of rendering resources in advance in the online peak period of the user and closing a certain amount of rendering resources in the online valley period of the user.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510827310.5A CN105488837B (en) | 2015-11-24 | 2015-11-24 | Real-time off screen rendering method based on cloud computing, apparatus and system |
| PCT/CN2016/088767 WO2017088484A1 (en) | 2015-11-24 | 2016-07-06 | Cloud computing based real-time off-screen rendering method, apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510827310.5A CN105488837B (en) | 2015-11-24 | 2015-11-24 | Real-time off screen rendering method based on cloud computing, apparatus and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105488837A CN105488837A (en) | 2016-04-13 |
| CN105488837B true CN105488837B (en) | 2019-06-04 |
Family
ID=55675801
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510827310.5A Active CN105488837B (en) | 2015-11-24 | 2015-11-24 | Real-time off screen rendering method based on cloud computing, apparatus and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105488837B (en) |
| WO (1) | WO2017088484A1 (en) |
Families Citing this family (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105488837B (en) * | 2015-11-24 | 2019-06-04 | 成都云创互联信息技术有限公司 | Real-time off screen rendering method based on cloud computing, apparatus and system |
| CN105677240B (en) | 2015-12-30 | 2019-04-23 | 上海联影医疗科技有限公司 | Data-erasure method and system |
| CN106202927A (en) * | 2016-05-31 | 2016-12-07 | 武汉联影医疗科技有限公司 | The rendering intent of medical image and system |
| CN107483390B (en) * | 2016-06-08 | 2020-10-16 | 成都云创互联信息技术有限公司 | Cloud rendering network deployment subsystem, system and cloud rendering platform |
| CN106127844A (en) * | 2016-06-22 | 2016-11-16 | 民政部零研究所 | Mobile phone users real-time, interactive access long-range 3D scene render exchange method |
| CN106126148B (en) * | 2016-06-30 | 2020-05-26 | 联想(北京)有限公司 | Display control method and electronic equipment |
| CN108074210B (en) * | 2016-11-10 | 2021-05-11 | 成都云创互联信息技术有限公司 | Object acquisition system and method for cloud rendering |
| CN106598514B (en) * | 2016-12-01 | 2020-06-09 | 惠州Tcl移动通信有限公司 | Method and system for switching virtual reality mode in terminal equipment |
| CN108648257B (en) * | 2018-04-09 | 2020-12-29 | 腾讯科技（深圳）有限公司 | Panoramic picture acquisition method and device, storage medium and electronic device |
| CN108924587A (en) * | 2018-06-27 | 2018-11-30 | 深圳市炬力北方微电子有限公司 | A kind of rendering method and system based on cloud server |
| CN109218402A (en) * | 2018-08-02 | 2019-01-15 | 胡雄风 | Hold cloud integrative solution |
| CN110264550B (en) * | 2019-06-19 | 2023-03-21 | 深圳市瑞云科技有限公司 | Simulation display system and method for firework college performance based on CG real-time rendering |
| CN111080768A (en) * | 2019-10-16 | 2020-04-28 | 重庆灏漫科技有限公司 | Multi-class terminal acquisition modeling system and modeling method |
| CN110913202B (en) * | 2019-11-26 | 2022-01-07 | 深圳英伦科技股份有限公司 | Three-dimensional display cloud rendering method and system |
| CN111260540B (en) * | 2020-01-13 | 2023-06-13 | 成都卓影科技股份有限公司 | 2.5D conversion engine of 2D-3D under 5G network |
| CN111494936A (en) * | 2020-02-12 | 2020-08-07 | 阿里巴巴集团控股有限公司 | Picture rendering method, device, system and storage medium |
| CN113516774A (en) * | 2020-03-27 | 2021-10-19 | 华为技术有限公司 | Rendering quality adjustment method and related equipment |
| WO2021190651A1 (en) * | 2020-03-27 | 2021-09-30 | 华为技术有限公司 | Rendering quality adjustment method and related device |
| CN114281515A (en) * | 2020-09-18 | 2022-04-05 | 华为云计算技术有限公司 | Rendering resource allocation method and device, computer equipment and storage medium |
| CN112132942B (en) * | 2020-09-30 | 2022-03-18 | 深圳星寻科技有限公司 | Three-dimensional scene roaming real-time rendering method |
| CN112565818B (en) * | 2020-11-30 | 2022-01-11 | 中国矿业大学(北京) | Two-three-dimensional integrated operation station platform construction method and electronic equipment |
| CN112486620A (en) * | 2020-12-03 | 2021-03-12 | 广州虎牙科技有限公司 | Cross-process off-screen rendering method and device, electronic equipment and storage medium |
| CN113382221A (en) * | 2021-05-14 | 2021-09-10 | 异现实科技(成都)有限公司 | Single-instance multi-terminal cloud rendering system and method thereof |
| CN113453073B (en) * | 2021-06-29 | 2023-01-06 | 北京百度网讯科技有限公司 | Image rendering method and device, electronic equipment and storage medium |
| CN113572971B (en) * | 2021-06-30 | 2023-06-23 | 杭州群核信息技术有限公司 | Exposure control method and system for real-time high dynamic range image based on cloud rendering platform |
| CN113946399B (en) * | 2021-10-28 | 2023-07-21 | 上海数慧系统技术有限公司 | Space data loading method and device |
| CN114374726B (en) * | 2022-01-07 | 2024-10-11 | 阿里巴巴（中国）有限公司 | Cloud desktop processing method and system |
| CN114596397B (en) * | 2022-03-10 | 2025-04-29 | 元能星泰(广州)数字科技有限公司 | Energy industry metaverse ultra-large grid cloud rendering model loading system and method |
| CN116132498B (en) * | 2022-12-22 | 2025-03-07 | 北京蔚领时代科技有限公司 | Cloud rendering scheduling method, system and storage medium suitable for application update period |
| CN116415321B (en) * | 2022-12-28 | 2024-06-21 | 浙江华东工程数字技术有限公司 | Cloud CAD processing system and construction method thereof |
| CN115865518B (en) * | 2023-01-30 | 2023-05-16 | 天云融创数据科技（北京）有限公司 | Cloud platform data processing method and system based on big data |
| CN116405709A (en) * | 2023-03-03 | 2023-07-07 | 支付宝(杭州)信息技术有限公司 | A cloud rendering method and related equipment |
| CN116449961B (en) * | 2023-06-14 | 2023-10-10 | 蔚来汽车科技(安徽)有限公司 | Input event control methods, systems, electronic devices, storage media and vehicles |
| CN116563085B (en) * | 2023-07-06 | 2023-09-01 | 湖南马栏山视频先进技术研究院有限公司 | Large-scale parallel processing method and system for offline rendering |
| CN117395454A (en) * | 2023-12-08 | 2024-01-12 | 南京维赛客网络科技有限公司 | Method, system and storage medium for changing virtual scene resources by using cloud rendering end |
| CN117456113B (en) * | 2023-12-26 | 2024-04-23 | 山东山大华天软件有限公司 | Cloud offline rendering interactive application implementation method and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102571900A (en) * | 2010-12-08 | 2012-07-11 | 中国电信股份有限公司 | System and method for implementing far-end real-time control |
| CN102592315A (en) * | 2011-01-12 | 2012-07-18 | 上海库达数字信息技术有限公司 | 3D rendering platform based on GPU cloud cluster |
| CN103247067A (en) * | 2013-04-02 | 2013-08-14 | 深圳市瑞云科技有限公司 | Remote rendering method and cloud rendering platform |
| WO2014093641A1 (en) * | 2012-12-13 | 2014-06-19 | Microsoft Corporation | Asynchronous cloud rendered video delivery |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105488837B (en) * | 2015-11-24 | 2019-06-04 | 成都云创互联信息技术有限公司 | Real-time off screen rendering method based on cloud computing, apparatus and system |
-
2015
- 2015-11-24 CN CN201510827310.5A patent/CN105488837B/en active Active
-
2016
- 2016-07-06 WO PCT/CN2016/088767 patent/WO2017088484A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102571900A (en) * | 2010-12-08 | 2012-07-11 | 中国电信股份有限公司 | System and method for implementing far-end real-time control |
| CN102592315A (en) * | 2011-01-12 | 2012-07-18 | 上海库达数字信息技术有限公司 | 3D rendering platform based on GPU cloud cluster |
| WO2014093641A1 (en) * | 2012-12-13 | 2014-06-19 | Microsoft Corporation | Asynchronous cloud rendered video delivery |
| CN103247067A (en) * | 2013-04-02 | 2013-08-14 | 深圳市瑞云科技有限公司 | Remote rendering method and cloud rendering platform |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2017088484A1 (en) | 2017-06-01 |
| CN105488837A (en) | 2016-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105488837B (en) | Real-time off screen rendering method based on cloud computing, apparatus and system | |
| US11889133B2 (en) | Burst traffic processing method, computer device and readable storage medium | |
| EP4223379A1 (en) | Cloud gaming processing method, apparatus and device, and storage medium | |
| CN104468649B (en) | Server, terminal, data delivery system and data push method | |
| CN102307153A (en) | Virtual desktop transmission device and method | |
| CN103440202B (en) | A kind of communication means based on RDMA, system and communication equipment | |
| CN106713485A (en) | Cloud computing mobile terminal and working method thereof | |
| WO2012065415A1 (en) | Terminal, system and service providing method based on virtualization techniques | |
| CN104601534A (en) | Method and system for processing CDN system images | |
| CN105872858A (en) | Video sharing method and system, video processing system and client side | |
| WO2015120766A1 (en) | Video optimisation system and method | |
| CN108234659B (en) | Data processing method, device and system | |
| CN106453668A (en) | Reverse file uploading method and system | |
| CN116319790A (en) | Rendering method, device, equipment and storage medium of true scene | |
| CN107396136A (en) | A kind of video data acquisition methods, device, server and medium | |
| CN111477229B (en) | Voice recognition request processing method and device | |
| CN106790623B (en) | A control method, controller and control system for virtual reality equipment to obtain services | |
| CN103220347B (en) | CRP cloud exchange method | |
| CN115445194A (en) | Rendering method, device and equipment of game and storage medium | |
| CN105357260B (en) | Realize system, VDI data cache method and the VDI buffer memory device of virtual desktop | |
| CN114416275A (en) | Method and system for synchronizing virtual machine states by multiple management clients | |
| CN110740337B (en) | Live broadcast method and device, electronic equipment and storage medium | |
| CN115086425B (en) | Message transmission method, device, program product, medium and electronic equipment | |
| WO2017185632A1 (en) | Data transmission method and electronic device | |
| CN106657256A (en) | Resource acquisition processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 610042 No. 846, south section, Tianfu Road, Huayang street, Tianfu New District, Sichuan, Chengdu Applicant after: Chengdu Hermes Polytron Technologies Inc Address before: 610042 No. 846, south section, Tianfu Road, Huayang street, Tianfu New District, Sichuan, Chengdu Applicant before: CHENGDU HERMES TECHNOLOGY CO., LTD. |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20180620 Address after: 610000 China (Sichuan) free trade pilot zone, 5 floor, 5 building, 99, west section of lakeside road, Tianfu New District, Chengdu. Applicant after: Chengdu Yun Chuang interconnected Information Technology Co., Ltd. Address before: 610042 846, southern section of Tianfu Avenue, Huayang street, Tianfu New District, Chengdu, Sichuan Applicant before: Chengdu Hermes Polytron Technologies Inc |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |