WO2018072386A1

WO2018072386A1 - Rendering method and apparatus

Info

Publication number: WO2018072386A1
Application number: PCT/CN2017/077141
Authority: WO
Inventors: 扶宇琳; 陈双龙
Original assignee: 广州视源电子科技股份有限公司; 广州视臻信息科技有限公司
Priority date: 2016-10-18
Filing date: 2017-03-17
Publication date: 2018-04-26
Also published as: CN110427236A; CN106502667B; CN106502667A; CN110427236B

Abstract

Provided are a rendering method and an apparatus. The method comprises: configuring a first view and a second view on a canvas of a writing software (S11), wherein both the first view and the second view cover the canvas, and both backgrounds of the first view and the second view are made transparent; selecting a rendering mode according to a to-be-drawn object (S12); if a first rendering mode is selected, drawing a specified object on the first view by using the first rendering mode (S13); and if a second rendering mode is selected, then drawing the specified object on the second view by using the second rendering mode (S14). According to requirements, one part of the to-be-drawn object can be drawn by using the first rendering mode, the other part thereof can be drawn by using the second rendering mode, achieving ideal rendering effect both for the to-be-drawn objects with high requirement of smoothing effect and for the to-be-drawn objects with high requirement of rendering speed, and overcoming the limitation due to defects of a single rendering mode.

Description

Rendering method and device

Technical field

The present invention relates to the field of computer technologies, and in particular, to a rendering method and apparatus.

Background technique

In the writing software of Android system, there are two commonly used rendering methods: SurfaceView rendering and OpenGL rendering. Among them, the SurfaceView rendering is well supported by the API (Application Programming Interface), and the handwriting can achieve a good smoothing effect. Therefore, it is often used to follow and depict writing strokes, and to insert pictures in the canvas, but when writing When the continuous handwriting or picture is moved and scaled in the canvas of the software, the speed of the SurfaceView cannot keep up with the speed of the operation, which may cause the phenomenon of the carton and affect the user experience. Especially when performing global movement and zooming, it is necessary to traverse each handwriting or picture, and draw and update one by one on the SurfaceView view. The whole rendering speed becomes slower as the number of handwriting or pictures increases, and the picture becomes more and more card. pause.

And OpenGL renders very fast, and is widely used in games and some gorgeous animation applications. When rendering with OpenGL, the rendering speed of moving, zooming, or drawing is at least 10 times faster (increasing the number of handwriting and images, the effect is more obvious, even reaching the rendering speed, OpenGL is a millisecond level, and SurfaceView rendering is a second level) . Especially for OpenGL rendering of images, the texture data of the image is stored in the video memory, and it takes almost no time to perform OpenGL rendering. So OpenGL rendering doesn't feel like a stuck. However, OpenGL also has its limitations. OpenGL has no smooth effect on lines. When the line is very thick, the drawing shape is unacceptable.

Therefore, in the prior art, a single rendering mode is adopted, and the beneficial effects of different rendering modes cannot be simultaneously achieved, and the defect limitation of the single rendering mode cannot be overcome. Limited to the operating system's API support, you can't use two rendering methods on one view.

Summary of the invention

It is an object of the present invention to provide a rendering method and apparatus that can use two rendering modes, and at the same time have the beneficial effects of different rendering modes, and overcome the defect limitation of a single rendering mode.

In order to achieve the above object, an aspect of the present invention provides a rendering method, including:

Configuring a first view and a second view on a canvas of the writing software; wherein the first view and the second view both cover the canvas, and the backgrounds of the first view and the second view are both set to be transparent ;

Select the rendering mode according to the object to be drawn;

If the first rendering mode is selected to be used, drawing the specified object by using the first rendering manner on the first view;

If the second rendering mode is selected to be used, the specified object is drawn on the second view using the second rendering mode.

The implementation of the present invention has the following beneficial effects:

The invention configures the first view and the second view on the canvas of the writing software. Since the view background is transparent, the two views are superimposed, and the user can simultaneously see the content rendered by the two views. According to the requirements, part of the object to be drawn is drawn in the first rendering mode, and the other part is drawn in the second rendering mode, so that the object to be drawn with high smoothing effect and the object to be drawn with high rendering speed can achieve ideal rendering. The effect of overcoming the limitations of the single rendering approach.

In one embodiment, the selecting a rendering manner according to an object to be drawn includes:

Determining an attribute of the object to be drawn by a current working mode of the writing software; wherein, when the writing software is in the writing mode, the object to be drawn is an object generated according to a user's touch operation; the writing software is in a moving mode or zooming In the mode, the object to be drawn is an object that is moved or scaled according to a touch operation of the user;

If the object to be drawn is an object generated according to a user's touch operation, then the first rendering mode is selected;

If the object to be drawn is an object that is moved or scaled according to a user's touch operation, then the second rendering mode is selected.

Further, if the first rendering mode is selected, the specified rendering object is drawn by using the first rendering manner on the first view, specifically:

If the first rendering mode is selected, the second object data is recorded, and the second view is cleared; wherein the second object data is data corresponding to all objects on the current second view;

Drawing, on the first view, an object corresponding to the second object data by using a first rendering manner;

Listening to a user's touch operation, on the first view, drawing an object generated according to the touch operation using a first rendering manner;

If the second rendering mode is selected, the specified object is drawn by using the second rendering manner on the second view, which includes:

If the second rendering mode is selected, the first object data is recorded, and the first view is cleared; wherein the first object data is data corresponding to all objects on the current first view;

And drawing, on the second view, an object corresponding to the first object data by using a second rendering manner;

A user's touch operation is listened to, and on the second view, an object moved or scaled according to the touch operation is drawn using a second rendering manner.

Further, the first rendering mode is a SurfaceView rendering, and the second rendering mode is an OpenGL rendering.

Further, the object includes a picture and a handwriting; when the specified object is drawn by using the second rendering manner on the second view, if the object is a handwriting, the second rendering mode is used to draw the preset line width. Handwriting.

In one of the embodiments, when the writing software is in the writing mode, the writing of the writing hand or the insertion of the picture following the user's touch operation is not high in rendering speed, and the SurfaceView rendering with good smoothing effect and normal rendering speed can achieve the desired performance. Rendering effect; when moving, zooming, or other objects, use OpenGL rendering with fast rendering speed, avoiding the rendering speed and the speed of the operation, causing the card to achieve the desired rendering effect. The same object needs to be drawn in different rendering modes on two views in different working modes. When switching the working mode, switching all objects to another view can avoid the problem of image overlap error.

In the further scheme, when using OpenGL to render the handwriting, since the OpenGL rendering does not have a good rendering effect on the thick lines, drawing the handwriting with a fixed line width can achieve a smoother effect.

In another embodiment, the selecting a rendering manner according to the object to be drawn includes:

If the object to be drawn is a zoom handle, the first rendering mode is selected; wherein the zoom handle is defined as a handle for controlling the size of the image generated on the edge of the image according to a click operation of the user;

If the object to be drawn is a picture, then the second rendering mode is selected.

In another embodiment, the rendering mode is determined directly based on the type of drawing object. When drawing an object as a picture, since the image insertion, scaling, or movement is faster than the speed requirement, a rendering method with a fast rendering speed can be used, and the zoom control point generated on the edge of the image is relatively low due to the requirement of the hand, so the speed is adopted. Generally, other rendering methods with good rendering can meet the requirements. Different rendering methods are used according to actual needs, which is beneficial to balance the running speed and effect of writing software.

Another aspect of the present invention provides a rendering apparatus, including:

a view configuration module, configured to configure a first view and a second view on a canvas of the writing software; wherein the first view and the second view both cover the canvas, and the first view and the second view The background is set to be transparent;

a rendering selection module for selecting a rendering mode according to the object to be drawn;

a first rendering module, configured to draw a specified object using the first rendering manner on the first view if the first rendering mode is selected to be used;

And a second rendering module, configured to draw the specified object by using the second rendering manner on the second view if the second rendering mode is selected to be used.

In one embodiment, the rendering selection module includes:

a mode confirmation unit, configured to determine, by the current working mode of the writing software, an attribute of the object to be drawn; wherein, when the writing software is in the writing mode, the object to be drawn is an object generated according to a user's touch operation; The software is in a moving mode or a zoom mode, and the object to be drawn is an object that is moved or scaled according to a touch operation of the user;

a first selecting unit, configured to use the first rendering mode if the object to be drawn is an object generated according to a user's touch operation;

And a second selecting unit, configured to use the second rendering mode if the object to be drawn is an object that is moved or scaled according to a touch operation of the user.

Further, the first rendering module includes:

a first clearing view unit, configured to: when the first rendering mode is selected to be used, record the second object data, and clear the second view; wherein the second object data is corresponding to all objects on the current second view The data;

a first copy view unit, configured to draw an object corresponding to the second object data by using a first rendering manner on the first view;

a writing generating unit, configured to monitor a touch operation of the user, and, on the first view, draw an object generated according to the touch operation by using a first rendering manner;

The second rendering module includes:

And a second clearing view unit, configured to: when the second rendering mode is selected, record the first object data, and clear the first view; wherein the first object data is corresponding to all objects on the current first view The data;

a second copy view unit, configured to draw an object corresponding to the first object data by using a second rendering manner on the second view;

And a mobile scaling unit, configured to monitor a user's touch operation, and on the second view, draw an object moved or scaled according to the touch operation using a second rendering manner.

In another embodiment, the rendering selection module includes:

a zoom control point rendering unit, configured to use a first rendering mode if the object to be drawn is a zoom handle; wherein the zoom handle is defined as a size of the image generated on the edge of the image according to a click operation of the user Control point

The picture rendering unit is configured to select the second rendering mode if the object to be drawn is a picture.

DRAWINGS

1 is a flowchart of Embodiment 1 of a rendering method provided by the present invention;

2 is a specific flowchart of step S2 of Embodiment 1 of the rendering method provided by the present invention;

3 is a specific flowchart of step S2 of Embodiment 2 of the rendering method provided by the present invention;

4 is a specific flowchart of Embodiment 3 of the rendering method provided by the present invention;

FIG. 5 is a structural block diagram of a rendering apparatus provided by the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

Referring to FIG. 1 , it is a flowchart of Embodiment 1 of a rendering method provided by the present invention. In the first embodiment, the rendering method includes:

S1, configuring a first view and a second view on the canvas of the writing software; wherein the first view and the second view both cover the canvas, and the backgrounds of the first view and the second view are both set Transparent

S2, selecting a rendering mode according to the object to be drawn;

S3. If the first rendering mode is selected to be used, drawing the specified object by using the first rendering manner on the first view;

S4. If the second rendering mode is selected, the specified object is drawn by using the second rendering manner on the second view.

In the first embodiment of the rendering method provided by the present invention, the first view and the second view are configured on the canvas of the writing software. Since the view background is transparent, the two views are superimposed, and the user can simultaneously view the content rendered by the two views. . According to the requirements, part of the object to be drawn is drawn in the first rendering mode, and the other part is drawn in the second rendering mode, so that the object to be drawn with high smoothing effect and the object to be drawn with high rendering speed can achieve ideal rendering. The effect of overcoming the limitations of the single rendering approach.

Referring to FIG. 2, it is a specific flowchart of step S2 of Embodiment 1 of the rendering method provided by the present invention. Step S2 in the first embodiment specifically includes:

S211. Determine, by the current working mode of the writing software, an attribute of the object to be drawn; wherein, when the writing software is in the writing mode, the object to be drawn is an object generated according to a user's touch operation; and the writing software is in a moving mode. Or in the zoom mode, the object to be drawn is based on the user Touch operation to move or scale the object;

S212. If the object to be drawn is an object generated according to a user's touch operation, select to use the first rendering mode;

S213. If the object to be drawn is an object that is moved or scaled according to a touch operation of the user, then the second rendering mode is selected to be used.

It should be noted that the working mode of the writing software of the touch screen terminal includes a writing mode, a moving mode, and a zooming mode. It can be known by those skilled in the art that in the writing mode, the user performs a touch operation on the touch screen terminal according to the trajectory of the touch operation. The handwriting object can be generated, and the user can also insert a picture on the touch screen terminal; in the mobile mode, the user performs a touch operation on the touch screen terminal, and according to the track of the touch operation, the object corresponding to the touch point can be moved; In the mode, the user performs a touch operation on the edge of the object on the touch screen terminal, and the object can be scaled according to the trajectory of the touch operation; in addition, the movement mode and the zoom mode can be set to the same mode.

Writing software can be triggered into different working modes in a variety of ways. For example, in the writing software on the touch screen terminal, the writing software enters the writing mode by default when starting, and can enter the moving and zooming mode with a specific gesture. The specific gesture can be three-point triggering, that is, when the user presses three fingers simultaneously, Entering the moving and zooming mode, the object to be drawn is switched to the object moved or zoomed according to the user's touch operation, that is, the object is updated according to the moving and zooming operation; when the user finishes moving and zooming, when the user raises the hand, the writing mode is entered. . In addition, a mode selection bar may also be set on the toolbar of the writing software, and the user switches the working mode by operating the mode selection bar.

Step S3 specifically includes:

S311, if the first rendering mode is selected, the second object data is recorded, and the second view is cleared; wherein the second object data is data corresponding to all objects on the current second view;

S312. On the first view, the object corresponding to the second object data is drawn by using a first rendering manner;

S313. Listen to a touch operation of the user, and draw, on the first view, an object generated according to the touch operation by using a first rendering manner;

Step S4 specifically includes:

S411, if the second rendering mode is selected, the first object data is recorded, and the first view is cleared; wherein the first object data is data corresponding to all objects on the current first view;

S412. On the second view, the object corresponding to the first object data is drawn by using a second rendering manner;

S413. Listen to a user's touch operation, and on the second view, draw an object moved or scaled according to the touch operation using a second rendering manner.

When the writing software is in the writing mode, since the writing stroke or the inserted picture is not required for the rendering speed following the user's touch operation, a rendering method with a good smoothing effect and a general rendering speed can be used to achieve an ideal rendering effect; When moving or zooming an object such as a handwriting or a picture, another rendering method with a fast rendering speed can avoid the rendering speed and the speed of the operation, resulting in an ideal rendering effect. On the Android system, the rendering method with good smoothing effect is preferably SurfaceView rendering. The rendering method with fast rendering speed is preferably OpenGL rendering, that is, the first rendering mode is preferably SurfaceView rendering, and the second rendering mode is preferably OpenGL rendering. On other operating systems, other rendering modes can be selected as the first rendering mode and the second rendering mode.

When drawing a handwriting using OpenGL, since OpenGL rendering does not work well for thick lines, drawing a handwriting with a fixed line width can achieve a smoother effect. which is:

The same object needs to be drawn in different rendering modes on two views in different working modes. When switching the working mode, switching all objects to another view can avoid the problem of image overlap error.

Embodiment 2 of the rendering method provided by the present invention, the rendering method includes:

S2, selecting a rendering mode according to the object to be drawn;

FIG. 3 is a specific flowchart of step S2 of Embodiment 2 of the rendering method provided by the present invention. Step S2 specifically includes:

S221: If the object to be drawn is a zoom handle, select to use a first rendering manner; wherein the zoom handle is defined as a handle for controlling a size of the image generated on an edge of the image according to a click operation of the user;

S222. If the object to be drawn is a picture, select to use the second rendering mode.

In the second embodiment, in the Android system, the first rendering mode is preferably a SurfaceView rendering, and the second rendering mode is preferably an OpenGL rendering. On other operating systems, other rendering modes can be selected as the first rendering mode and the second rendering mode. Embodiment 2 selects a rendering mode according to the type of the drawing object. For example, when the picture object in the writing software is selected, eight control points for controlling the image size are generated on the edge of the picture, and the picture can be scaled by the control point. At this time, the eight handles can be rendered by using SurfaceView. Because the control points are relatively low, the SurfaceView rendering is easier to draw; the scaling of the image is drawn using OpenGL rendering to avoid stuttering. Under the premise that the view is transparent, what the user sees is the content superimposed by the two views. In addition, the handwriting object can also be rendered using SurfaceView rendering, to avoid the rendering effect of the handwriting of OpenGL rendering is not good, that is, step S2 also includes:

S223. If the object to be drawn is a handwriting, select to use the first rendering mode.

Embodiment 3 of the rendering method provided by the present invention, the rendering method includes:

S2, selecting a rendering mode according to the object to be drawn;

S3. If the first rendering mode is selected, the first rendering mode is used on the first view. Designated object;

Referring to FIG. 4, it is a specific flowchart of the third step S2 of the third embodiment of the present invention.

Step S2 includes:

S231. Determine, according to whether a page turning instruction that jumps from the currently open page to the target page is received, determine a target page of whether the object to be drawn has a page turning effect;

S232. If the object to be drawn is not the target page of the page turning effect, select to use the first rendering mode;

S233. If the object to be drawn is a target page of a page turning effect, select to use a second rendering mode;

Step S3 is specifically: if the first rendering is selected to be used, the object generated, moved, or scaled by the touch operation of the user is drawn on the first view by using the first rendering manner;

Step S4 is specifically: if the second rendering mode is selected to be used, the first view is cleared, and the target page is drawn on the second view by using a second rendering manner.

In the third embodiment, in the Android system, the first rendering mode is preferably a SurfaceView rendering, and the second rendering mode is preferably an OpenGL rendering. On other operating systems, other rendering modes can be selected as the first rendering mode and the second rendering mode. The third embodiment of the page turning effect uses OpenGL rendering to improve the speed of page turning.

Referring to FIG. 5, it is a structural block diagram of a rendering apparatus provided by the present invention. Another aspect of the present invention provides a rendering apparatus, including:

a view configuration module 1 configured to configure a first view and a second view on a canvas of the writing software; wherein the first view and the second view both cover the canvas, and the first view and the second view The background of the view is set to be transparent;

a rendering selection module 2, configured to select a rendering mode according to the object to be drawn;

a first rendering module 3, configured to draw a specified object using the first rendering manner on the first view if the first rendering mode is selected to be used;

The second rendering module 4 is configured to draw the specified object by using the second rendering manner on the second view if the second rendering mode is selected to be used.

In one embodiment, the rendering selection module includes:

Further, the first rendering module includes:

The second rendering module includes:

In another embodiment, the rendering selection module includes:

The above is a preferred embodiment of the present invention, and it should be noted that those skilled in the art can also make several improvements and modifications without departing from the principles of the present invention. The scope of protection of the invention.

Claims

A rendering method, comprising:

Configuring a first view and a second view on a canvas of the writing software; wherein the first view and the second view both cover the canvas, and the backgrounds of the first view and the second view are both set to be transparent ;

Select the rendering mode according to the object to be drawn;

If the first rendering mode is selected to be used, drawing the specified object by using the first rendering manner on the first view;

If the second rendering mode is selected to be used, the specified object is drawn on the second view using the second rendering mode.
The rendering method according to claim 1, wherein the selecting a rendering manner according to the object to be drawn comprises:

Determining an attribute of the object to be drawn by a current working mode of the writing software; wherein, when the writing software is in the writing mode, the object to be drawn is an object generated according to a user's touch operation; the writing software is in a moving mode or zooming In the mode, the object to be drawn is an object that is moved or scaled according to a touch operation of the user;

If the object to be drawn is an object generated according to a user's touch operation, then the first rendering mode is selected;

If the object to be drawn is an object that is moved or scaled according to a user's touch operation, then the second rendering mode is selected.
The rendering method of claim 2, wherein if the first rendering mode is selected, the specified rendering object is drawn by using the first rendering manner on the first view, specifically:

If the first rendering mode is selected, the second object data is recorded, and the second view is cleared; wherein the second object data is data corresponding to all objects on the current second view;

Drawing, on the first view, an object corresponding to the second object data by using a first rendering manner;

Listening to the user's touch operation, and using the first rendering method to draw the basis according to the first view The object generated by the touch operation writing;

If the second rendering mode is selected, the specified object is drawn by using the second rendering manner on the second view, which includes:

If the second rendering mode is selected, the first object data is recorded, and the first view is cleared; wherein the first object data is data corresponding to all objects on the current first view;

And drawing, on the second view, an object corresponding to the first object data by using a second rendering manner;

A user's touch operation is listened to, and on the second view, an object moved or scaled according to the touch operation is drawn using a second rendering manner.
The rendering method according to any one of claims 1 to 3, wherein the first rendering mode is a SurfaceView rendering, and the second rendering mode is an OpenGL rendering.
The rendering method according to claim 4, wherein the object includes a picture and a handwriting; and when the specified object is drawn using the second rendering mode on the second view, if the object is a handwriting, the first The second rendering mode draws the handwriting according to a preset line width.
The rendering method according to claim 1, wherein the selecting a rendering mode according to the object to be drawn comprises:

If the object to be drawn is a zoom handle, the first rendering mode is selected; wherein the zoom handle is defined as a handle for controlling the size of the image generated on the edge of the image according to a click operation of the user;

If the object to be drawn is a picture, then the second rendering mode is selected.
A rendering device, comprising:

a view configuration module, configured to configure a first view and a second view on a canvas of the writing software; wherein the first view and the second view both cover the canvas, and the first view and the second view The background is set to be transparent;

a rendering selection module for selecting a rendering mode according to the object to be drawn;

a first rendering module, configured to draw a specified object using the first rendering manner on the first view if the first rendering mode is selected to be used;

And a second rendering module, configured to draw the specified object by using the second rendering manner on the second view if the second rendering mode is selected to be used.
The rendering apparatus of claim 7, wherein the rendering selection module comprises:

a mode confirmation unit, configured to determine, by the current working mode of the writing software, an attribute of the object to be drawn; wherein, when the writing software is in the writing mode, the object to be drawn is an object generated according to a user's touch operation; The software is in a moving mode or a zoom mode, and the object to be drawn is an object that is moved or scaled according to a touch operation of the user;

a first selecting unit, configured to use the first rendering mode if the object to be drawn is an object generated according to a user's touch operation;

And a second selecting unit, configured to use the second rendering mode if the object to be drawn is an object that is moved or scaled according to a touch operation of the user.
The rendering device of claim 8, wherein the first rendering module comprises:

a first clearing view unit, configured to: when the first rendering mode is selected to be used, record the second object data, and clear the second view; wherein the second object data is corresponding to all objects on the current second view The data;

a first copy view unit, configured to draw an object corresponding to the second object data by using a first rendering manner on the first view;

a writing generating unit, configured to monitor a touch operation of the user, and, on the first view, draw an object generated according to the touch operation by using a first rendering manner;

The second rendering module includes:

And a second clearing view unit, configured to: when the second rendering mode is selected, record the first object data, and clear the first view; wherein the first object data is corresponding to all objects on the current first view The data;

a second copy view unit, configured to draw an object corresponding to the first object data by using a second rendering manner on the second view;

And a mobile scaling unit, configured to monitor a user's touch operation, and on the second view, draw an object moved or scaled according to the touch operation using a second rendering manner.
The rendering apparatus of claim 7, wherein the rendering selection module comprises:

a zoom control point rendering unit, configured to use a first rendering mode if the object to be drawn is a zoom handle; wherein the zoom handle is defined as a size of the image generated on the edge of the image according to a click operation of the user Control point

The picture rendering unit is configured to select the second rendering mode if the object to be drawn is a picture.