CN106873851A - Method, device and terminal that 3D regards the Widget imitated are created in interactive interface - Google Patents

Abstract

The invention discloses a method, a device and a terminal for creating a Widget with 3D visual effects in an interactive interface. The method includes the following steps: creating a view control in the interactive interface; drawing a 3D view in the view control; inputting the 3D view to the interactive interface, and combine it with the view of the interactive interface to form a Widget. Through the present invention, the effect of creating a Widget with 3D visual effect by using self-defined controls in the interactive interface is realized, the three-dimensional sense of the Widget in the interactive interface is enhanced, the content of the interactive interface is enriched, and the functions that the Widget can realize are increased, so that the Widget can be realized. The types of applications implemented are wider and the user experience is optimized.

Description

Method, device and terminal for creating 3D visual effect Widget in interactive interface

【Technical field】

The invention relates to the field of computer software, in particular a method, a device and a terminal for creating a 3D visual effect Widget in an interactive interface.

【Background technique】

Widget is an application widget, which is a miniature application view, which can be embedded in other applications (such as the system desktop) and receive periodic updates. Nowadays, Widget has become a very popular technology on mobile phones, and various small applications based on Widget on mobile terminals are also emerging, which can bring users a good mobile Internet experience and obtain useful information anytime and anywhere, such as weather forecasts, stock information, headlines etc. However, existing Android desktops can only display Widgets drawn by 2D user interface controls. How to create Widgets with 3D visual effects on Android desktops is a technical difficulty. In addition, the drawing of Widgets in the existing Android desktop can only be carried out using several fixed view controls (View) provided by Android, instead of using custom Views for drawing, but these native Views are not enough to satisfy users' requirements for software functions. Diversified requirements limit the application scope of Widget.

【Content of invention】

The object of the present invention is to provide a method for drawing a Widget with 3D visual effects in an interactive interface and a corresponding device thereof, so as to draw a Widget with 3D visual effects in an interactive interface.

Correspondingly, another object of the present invention is to provide a terminal for running the method described in the previous object.

To achieve this goal, the present invention adopts following technical scheme:

A method for creating a Widget with 3D visual effects in an interactive interface, the method includes the following steps:

Create view controls in the interactive interface;

Draw a 3D view in the view control;

Inputting the 3D view into the interactive interface, and merging it with the view of the interactive interface to form a Widget.

Further, the creating a view control in the interactive interface includes:

Read the creation information of the view control;

generating a view control through reflection based on the creation information;

Place the view control on the target position of the interactive interface.

Preferably, the creation information is included in the code of the Widget application.

Specifically, after reading the creation information of the view control, it also includes:

Acquiring size information of the view control included in the creation information;

A display area of a corresponding size is divided at the target position of the interactive interface based on the size information.

Further, after the 3D view is drawn in the view control, the 3D view is displayed in the display area.

Optionally, after displaying the 3D view in the display area, the method further includes: arranging a touch event in the display area.

Further, the drawing the 3D view in the view control includes:

Receive view data for drawing in the Widget application;

Call the view drawing interface;

A 3D view is drawn in the view control based on the view data.

Optionally, the view drawing interface is OpenGL.

Specifically, after the 3D view is drawn in the view control, the 3D view is saved in the video memory.

Further, the inputting the 3D view to the interactive interface includes: inputting the 3D view from the video memory to the interactive interface.

Preferably, the view control is Textureview.

Further, the interactive interface is an Android system desktop.

The device for creating the Widget of 3D visual effect in the interactive interface is characterized in that it comprises the following units:

Create a unit for creating view controls in the interactive interface;

a drawing unit, configured to draw a 3D view in the view control;

The display unit is configured to input the 3D view into the interactive interface, and combine it with the view of the interactive interface to form a Widget.

Further, the creation unit includes:

The reading unit is used to read the creation information of the view control;

a generating unit, configured to generate a view control through reflection based on the creation information;

The position unit is used to place the view control on the target position of the interactive interface.

Preferably, the creation information is included in the code of the Widget application.

Specifically, it also includes: an acquisition unit, configured to acquire the size information of the view control contained in the creation information;

A division unit, configured to divide a display area of a corresponding size at the target position of the interactive interface based on the size information.

Further, a video memory is also included, and after the drawing of the 3D view is completed, the 3D view is displayed in the display area.

Optionally, further comprising: an event arranging unit, configured to arrange touch events in the display area.

Further, the drawing the 3D view in the view control includes:

A receiving unit, configured to receive view data for drawing in the Widget application;

The calling unit is used to call the view drawing interface;

A rendering unit, configured to render the view data into a 3D view.

Optionally, the view drawing interface is OpenGL.

Specifically, it also includes a video memory for saving the 3D view.

Further, the 3D view is input from the video memory to the interactive interface.

Preferably, the view control is Textureview.

Further, the interactive interface is an Android system desktop.

A Widget terminal for creating 3D visual effects in an interactive interface, which includes: a display for displaying a user interactive interface; a memory; one or more processors for executing programs stored in the memory; one or more An application program, wherein the one or more application programs are stored in the memory and executed by the one or more processors; the one or more application programs are used to perform the above method.

Compared with the prior art, the present invention has the following beneficial effects: the method, device and terminal for creating a Widget with 3D visual effects in the interactive interface provided by the present invention first create a view control in the interactive interface, and then create a view control in the view control The 3D view is drawn in, and finally the 3D view is input to the interactive interface, and synthesized with the view of the interactive interface. Realized the use of custom controls to create Widgets with 3D visual effects in the interactive interface, enhanced the three-dimensional sense of the Widget in the interactive interface, enriched the content of the user interactive interface, and increased the functions that the Widget can realize, thereby optimizing the user experience. Wider range of application types that can be realized by Widget.

【Description of drawings】

FIG. 1 is a schematic flowchart of Embodiment 1 of a method for creating a 3D visual effect Widget in an interactive interface according to the present invention.

FIG. 2 is a schematic flowchart of Embodiment 2 of the method for creating a 3D visual effect Widget in an interactive interface according to the present invention.

FIG. 3 is a schematic flowchart of a further solution of Embodiment 2 of the method for creating a Widget with 3D visual effects in an interactive interface according to the present invention.

Fig. 4 is a schematic flow chart of Embodiment 3 of the method for creating a Widget with 3D visual effects in an interactive interface according to the present invention

FIG. 5 is a schematic flowchart of Embodiment 4 of the method for creating a 3D visual effect Widget in an interactive interface according to the present invention,

FIG. 6 is a schematic flowchart of drawing steps in Embodiment 1 of the method for creating a 3D visual effect Widget in an interactive interface according to the present invention.

FIG. 7 is a schematic flowchart of display steps in Embodiment 1 of the method for creating a 3D visual effect Widget in an interactive interface of the present invention.

FIG. 8 is a schematic flowchart of Embodiment 5 of the method for creating a 3D visual effect Widget in an interactive interface according to the present invention, which shows the steps of using the matrix operation interface.

FIG. 9 is a schematic diagram of the principle of Embodiment 6 of the device for creating a 3D visual effect Widget in an interactive interface according to the present invention.

FIG. 10 is a schematic diagram of the principle of Embodiment 7 of the device for creating a 3D visual effect Widget in an interactive interface according to the present invention.

FIG. 11 is another schematic schematic diagram of Embodiment 7 of the device for creating a 3D visual effect Widget in an interactive interface according to the present invention.

FIG. 12 is a schematic schematic diagram of Embodiment 8 of the device for creating a 3D visual effect Widget in an interactive interface according to the present invention.

FIG. 13 is a schematic diagram of the principle of Embodiment 9 of the device for creating a 3D visual effect Widget in an interactive interface according to the present invention.

FIG. 14 is another schematic diagram of the principle of Embodiment 6 of the device for creating a 3D visual effect Widget in an interactive interface according to the present invention.

FIG. 15 is a schematic schematic diagram of Embodiment 10 of the device for creating a 3D visual effect Widget in an interactive interface according to the present invention.

FIG. 16 is a schematic structural diagram of a Widget terminal capable of creating 3D visual effects in an interactive interface according to the present invention.

【detailed description】

In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention.

In some processes described in the specification and claims of the present invention and the above-mentioned drawings, a plurality of operations appearing in a specific order are contained, but it should be clearly understood that these operations may not be performed in the order in which they appear herein Execution or parallel execution, the sequence number of the operation, such as S11, S12, etc., is only used to distinguish different operations, and the sequence number itself does not represent any execution order. Additionally, these processes can include more or fewer operations, and these operations can be performed sequentially or in parallel.

Those skilled in the art can understand that the "terminal" and "terminal equipment" used here not only include wireless signal receiver equipment, which only has wireless signal receiver equipment without transmission capabilities, but also include receiving and transmitting hardware. A device having receive and transmit hardware capable of bi-directional communication over a bi-directional communication link. Such equipment may include: cellular or other communication equipment, which has a single-line display or a multi-line display or a cellular or other communication equipment without a multi-line display; PCS (Personal Communications Service, personal communication system), which can combine voice, data Processing, facsimile and/or data communication capabilities; PDA (Personal Digital Assistant, Personal Digital Assistant), which may include radio frequency receiver, pager, Internet/Intranet access, web browser, notepad, calendar and/or GPS (Global Positioning System (Global Positioning System) receiver; a conventional laptop and/or palmtop computer or other device having and/or including a radio frequency receiver. As used herein, a "terminal", "terminal device" may be portable, transportable, installed in a vehicle (air, sea, and/or land), or adapted and/or configured to operate locally, and/or In distributed form, the operation operates at any other location on Earth and/or in space. The "terminal" and "terminal equipment" used here can also be a communication terminal, an Internet terminal, a music/video player terminal, such as a PDA, MID10 (Mobile Internet Device, mobile Internet device) and/or a music/video player Functional mobile phones, smart TVs, set-top boxes and other devices.

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts fall within the protection scope of the present invention.

The view control (View) referred to in the present invention refers to a very important class in Android. View is the base class used to build user interface components (Button, Textfields, etc.), and is an intuitive embodiment of the application interface. ViewGroup is equivalent to a container for placing View. Its responsibility is to calculate the recommended width, height and measurement mode for the View in it, and to determine the position of these Views. The responsibility of View is to calculate the recommended width according to the measurement mode and ViewGroup. And height, calculate your own width and height, and a more important responsibility is to draw your own shape in the area specified by ViewGroup. Generally, the application interface can be regarded as composed of Views. A View occupies a rectangular area on the screen and is responsible for interface drawing and event handling. The Android desktop is a ViewGroup. In this ViewGroup, many Views for implementing various functions are arranged, and the Widget application is also one of the Views. The Android system comes with many native Views to achieve user interface interaction, but the built-in View types and functions are limited, so it needs to be extended through custom views. Usually, Android implements custom controls in three ways: Inherit the existing Controls, to expand the functions of its controls; combine existing controls to achieve more powerful controls; rewrite View to achieve brand new controls. Among them, generally when the native control cannot meet the existing needs of the user, it is necessary to rewrite the View to implement a new control. The basic process of creating a new View to implement a custom control is as follows: Ⅰ. In the OnMeasure() method , to measure the size of the custom control, so that the custom control can adapt to various needs of the layout. Ⅱ. In the OnDraw() method, use the Canvas and Paint to draw the content to be displayed. Ⅲ. Determine the display position of the control in the OnLayout() method. Ⅳ. Handle the touch event of the control in the OnTouchEvent() method.

The OpenGL (full-written Open Graphics Library) referred to in the present invention refers to a professional graphics program interface that defines a cross-programming language and cross-platform programming interface specification. It is used for three-dimensional images (two-dimensional ones are also acceptable), and it is a powerful and easy-to-call underlying graphics library. OpenGL commands were originally described using C language functions. OpenGL is independent of the window system and operating system, and the application program developed based on it can be easily transplanted among various platforms; OpenGL can be closely interfaced with Visual C++, which is convenient for realizing the calculation and graphics algorithms of the manipulator, and can ensure the accuracy of the algorithm. Correctness and reliability; OpenGL is easy to use and efficient. It has seven functions: (1) Modeling: In addition to providing basic point, line, and polygon drawing functions, the OpenGL graphics library also provides complex three-dimensional objects (balls, cones, polyhedrons, teapots, etc.) and complex curves and Surface drawing functions. (2) Transformation: The transformation of the OpenGL graphics library includes basic transformation and projection transformation. There are four basic transformations: translation, rotation, and ratio mirroring. Projective transformations include parallel projection (also known as orthographic projection) and perspective projection. The transformation method is beneficial to reduce the running time of the algorithm and improve the display speed of three-dimensional graphics. (3) Color mode setting: There are two OpenGL color modes, namely RGBA mode and color index (Color Index). (4) Lighting and material settings: OpenGL light includes Emitted Light, Ambient Light, Diffuse Light and Specular Light. Materials are represented by light reflectance. The color of the object in the scene (Scene) that is finally reflected to the human eye is the color formed by multiplying the red, green, and blue components of light and the reflectance of the red, green, and blue components of the material. (5) Texture Mapping. Using the OpenGL texture mapping function can express the details of the object surface very realistically. (6) Bitmap display and image enhancement In addition to basic copying and pixel reading and writing, the image function also provides special image processing such as blending, antialiasing and fog. The above three items can make the simulated object more realistic and enhance the effect of graphic display. (7) Double Buffering (Double Buffering) Double buffering refers to the front buffer and the background buffer. In short, the background buffer calculates the scene and generates the picture, and the front buffer displays the picture that the background buffer has drawn. In addition, special effects such as depth cue and motion blur can be realized by using OpenGL. The basic process of OpenGL drawing is: clear the buffer, set the current color, draw geometric primitives, and output graphics.

Embodiment one

Please refer to Fig. 1, the drawing method of the Widget of 3D visual effect in the desktop provided by the present invention, it comprises the following steps:

S10, create a view control in the interactive interface;

S20, draw a 3D view in the view control;

S30. Input the 3D view into the interactive interface, and combine it with the view of the interactive interface to form a Widget.

User interaction interface (UI) generally refers to the user's operation interface, and UI design mainly refers to the style and aesthetics of the interface. In terms of use, the overall design of the human-computer interaction, operation logic, and beautiful interface of the software is another equally important approach. A good UI not only makes the software individual and tasteful, but also makes the operation of the software comfortable, simple, and free, fully reflecting the positioning and characteristics of the software. Generally, the interactive interface can be regarded as a Viewgroup, and several Views are arranged inside it according to its functional requirements. In an Android mobile phone, the Android system desktop is one of the most frequently used interactive interfaces. In the prior art, in the existing Android desktop, the Widget application can only be drawn for 2D UI controls, and its display is only for 2D visual effects.

In step S10, a view control is created in the interactive interface. 3D rendering cannot be performed directly in the interactive interface, and it is necessary to create a view control capable of 3D rendering in the interactive interface, and use the view control to draw a 3D view of 3D visual effects. Therefore, creating a view control in the interactive interface is a necessary prerequisite for the subsequent steps.

In step S20, a 3D view is drawn in the view control. After the view control is created, the 3D view of the 3D visual effect can be drawn in the view control by calling the drawing interface.

In step S30, the 3D view is input into the interactive interface, and combined with the view of the interactive interface to form a Widget. After the 3D view drawing is completed in the view control, the 3D rendering of the Widget display view is completed. At this time, all that needs to be done is to output the drawn 3D view to the interactive interface, and combine the 3D view with the interactive interface. Interface views are merged. The merging refers to processing methods such as splicing, overlaying, covering, etc. between views. The purpose of merging is to integrate the Widget of the 3D view into the view of the interactive interface, so that the two can be displayed together in the interactive interface. So far, the drawing of the Widget with 3D visual effect is completed.

The present invention creates a custom view control in the interactive interface, draws a 3D view in the view control, and finally combines the 3D view with the view of the interactive interface, thereby creating a 3D visual effect in the interactive interface. Widget.

Embodiment two

Please refer to FIG. 2, the step S10 in the first embodiment reads the creation information of the view control, and its specific implementation is as follows:

S11, reading the creation information of the view control;

S12. Create a view control through reflection based on the creation information;

S13. Place the view control on the target position of the interactive interface.

In step S11, the creation information of the view control is read. The creation information includes information such as creation code, creation function, calling class, and size of the control of the view control, and its function is to provide control information required for creating the control.

Further, the creation information is included in the code of the Widget application. What the Widget reflects is the content of the Widget application, the content of which is derived from the update of the Widget application, and there is a direct relationship between the Widget and the Widget application. Therefore, the creation information of the view control exists in the code of the Widget application, so that the Widget can directly call the creation information.

In step S12, the view control is created through reflection based on the creation information. The reflection refers to the ability of a program to access, detect and modify its own state or behavior. It uses another method to call to obtain some information about the application or program components. This application can be running or can be It is not running yet, as long as it is a file that can be called by .NET, you can use reflection to obtain file information, such as dll, exe, com components, etc. can use reflection to obtain file information, and you can also use reflection to call these components or programs. Simply put, "reflection" is actually using the metadata information of the assembly. Assemblies contain modules, and modules contain types, which in turn contain members. Reflection provides objects that encapsulate assemblies, modules, and types. Through reflection, dynamically create instances of types, bind types to existing objects, or obtain types from existing objects. Then, you can call methods of types or access its fields and properties. During the running of the program, based on the read view control creation information, the view control is created by reflection. At this time, the parameters such as the size, boundary, layout, and attributes of the view control are all defined.

In step S13, the view control is placed on the target position of the interactive interface. The target position should refer to the size of the view control, and finally be determined according to the settings of the user. It should be noted that there should also be a space judgment mechanism during the placing process to prompt the user where the Widget can be placed. For example, when placing a calendar widget on the desktop, it is first necessary to judge whether the current desktop interface has enough space according to the size of the interface space that the calendar widget needs to occupy. If the remaining space of the current desktop interface is not enough to place the calendar widget, it should Prompt the user that the current page does not have enough space to place the Widget; when the remaining space on the current desktop interface is sufficient to place the Calendar Widget, wait for further instructions from the user, and create the Calendar Widget after the indicated location is determined. At this point, the Widget generation location designated by the user is the target location of the view control referred to in the present invention.

Further, please refer to FIG. 3. After the view control is created, it needs to be displayed in the interactive interface. Therefore, step S15 is also required to divide a correspondingly sized display area at the target position of the interactive interface based on the size information, so as to pre-set the interactive interface. The display area of the view control is divided in the interface.

After reading the creation information of the view control, the creation information includes the size information of the view control, and step S14 is also included to acquire the size information of the view control included in the creation information, and the view control After the target position is determined, the view of the interactive interface can be divided based on the size information at the target position, so as to divide the area for displaying the view control. Wherein, step S14 obtains the size information of the view control contained in the creation information, and can start after reading the creation information of the view control in step S11, and step S12 creates the view control based on the creation information through reflection There is no sequence relationship, but before the view control is placed on the target position of the interactive interface in step S13, after step S13 and step S14 are both completed, go to step S15.

Combining all the features of Embodiment 1 and Embodiment 2, Embodiment 3 as shown in Figure 4 can be obtained, which includes the following steps:

S11, reading the creation information of the view control;

S12. Create a view control through reflection based on the creation information;

S13, placing the view control on the target position of the interactive interface;

Wherein, step S14 is also included after S11, obtaining the size information of the view control contained in the creation information;

Step S15 is also included after S13 and S14, dividing a display area of a corresponding size at the target position of the interactive interface based on the size information;

S20, draw a 3D view in the view control;

S30' displaying the 3D view into the display area.

Further, please refer to Fig. 5, Embodiment 4, when it is necessary to make the created Widget have a touch response, after step S30 in Embodiment 2 displays the 3D view, it should also include step S40 in the display area Layout touch events. For example, the created Widget is a small window display interface of a game with 3D visual effect, so that the user can watch video, video chat and other multi-threaded operations while playing the game. The touch event includes basic operations such as a single click event, a long press event, a focus change event, a keyboard event, and a menu event. For example, when a certain area in the Widget is clicked, the application corresponding to the Widget is started in response to the click operation, and when the area in the Widget is long pressed, the application corresponding to the Widget is updated with the latest information from the cloud , and display the latest information. The processing model for the touch event may be time processing based on authentication interface or event processing based on callback.

Please refer to Fig. 6, in the first embodiment, the specific steps of drawing a 3D view in the view control in step S20 include:

S21, receiving view data for drawing in the Widget application;

S22, call the view drawing interface;

S23. Draw a 3D view in the view control based on the view data.

The view content that needs to be presented in the Widget comes from the Widget application, so first obtain the view data needed to draw the 3D view from the Widget application; then call the view drawing interface, which is used to drive the drawing of the view, and the view drawing interface It contains a view drawing function, which can render the view data into a 3D view with 3D visual effects; finally, use the view drawing interface as a tool to draw in the view control. The view data may be text, 2D image, texture view and other data. Preferably, the view drawing interface uses opengl.

Please refer to FIG. 7 , in the first embodiment, step S30 inputs the 3D view into the interactive interface, and merges it with the view of the interactive interface to form a Widget. The 3D view is drawn in the view control, and the drawing result needs to be displayed on the interactive interface, which needs to be realized through video memory. The specific steps are:

S31. The 3D view is stored in the video memory after being drawn;

S32. Obtain the 3D view from the video memory;

S33. Display the 3D view on an interactive interface.

The video memory is used to store rendering data processed or to be extracted by the graphics card chip, and is a component used to store graphics information to be processed.

Further, in the above embodiment, the view control is preferably Textureview. The application's video or opengl content is usually displayed in a SurfaceView. The way SurfaceView works is to create a new window placed behind the application window. This method is very efficient, because the SurfaceView window does not need to redraw the application window when the SurfaceView window is refreshed (the view drawing mechanism of Android ordinary windows is layer by layer. Layer, any child element or partial refresh will cause the entire view structure to be redrawn once, so the efficiency is very low, but it is more than enough to meet the needs of ordinary application interfaces), but SurfaceView also has some very inconvenient limitations. Because the SurfaceView's content is not on the app window, transformations (translation, scaling, rotation, etc.) cannot be used. Compared with SurfaceView, TextureView does not create a separate Surface for drawing, which allows it to perform some transformation operations, set transparency, etc. like a normal View. In addition, Textureview must be in a window with hardware acceleration turned on. The use of TextureView is very simple, the only thing to do is to get the SurfaceTexture used to render the content. SurfaceTexture was added from Android 3.0 (API level 11). Its processing of image streams is not directly displayed, but converted to GL external textures, so it can be used for secondary processing of image stream data (such as Camera filters, desktop special effects, etc.) .

For example, the preview data of Camera can be handed over to GLSurfaceView for direct display after being turned into a texture, or it can be handed over to TextureView through SurfaceTexture as a hardware acceleration layer in View heirachy for display. First, SurfaceTexture obtains frame data from the image stream (from Camera preview, video decoding, GL drawing scene, etc.). When updateTexImage() is called, the GL texture object corresponding to SurfaceTexture is updated according to the latest image in the content stream. Next, just It can be manipulated like a normal GL texture.

By synthesizing the steps in the above-mentioned embodiments, the method for creating a Widget with 3D visual effects on an interactive interface can be obtained as in Embodiment 5 shown in FIG. 8 .

It includes the following steps:

S11, reading the creation information of the view control;

S12. Create a view control through reflection based on the creation information;

S13, placing the view control on the target position of the interactive interface;

Wherein, step S14 is also included after S11, obtaining the size information of the view control contained in the creation information;

Step S15 is also included after S13 and S14, dividing a display area of a corresponding size at the target position of the interactive interface based on the size information;

S21, receiving view data for drawing in the Widget application;

S22, call the view drawing interface;

S23. Draw a 3D view in the view control based on the view data.

S31. The 3D view is stored in the video memory after being drawn;

S32. Obtain the 3D view from the video memory;

S33. Display the 3D view on an interactive interface.

S33', display the 3D view in the display area.

Embodiment six

Please refer to Fig. 9, the drawing device of the Widget of 3D visual effect in the desktop provided by the present invention, it comprises the following units:

The creating unit 10 is used to create a view control in the interactive interface;

A drawing unit 20, configured to draw a 3D view in the view control;

The display unit 30 is configured to input the 3D view into the interactive interface, and combine it with the view of the interactive interface to form a Widget.

User interaction interface (UI) generally refers to the user's operation interface, and UI design mainly refers to the style and aesthetics of the interface. In terms of use, the overall design of the human-computer interaction, operation logic, and beautiful interface of the software is another equally important approach. A good UI not only makes the software individual and tasteful, but also makes the operation of the software comfortable, simple, and free, fully reflecting the positioning and characteristics of the software. Generally, the interactive interface can be regarded as a Viewgroup, and several Views are arranged inside it according to its functional requirements. In an Android mobile phone, the Android system desktop is one of the most frequently used interactive interfaces. In the prior art, in the existing Android desktop, the Widget application can only be drawn for 2D UI controls, and its display is only for 2D visual effects.

The creating unit 10 is used for creating view controls in the interactive interface. 3D rendering cannot be performed directly in the interactive interface, and it is necessary to create a view control capable of 3D rendering in the interactive interface, and use the view control to draw a 3D view of 3D visual effects. Therefore, creating a view control in the interactive interface is a necessary prerequisite for the subsequent steps.

The drawing unit 20 is used for drawing a 3D view in the view control. After the view control is created, the 3D view of the 3D visual effect can be drawn in the view control by calling the drawing interface.

The display unit 30 is configured to input the 3D view into the interactive interface, and combine it with the view of the interactive interface to form a Widget. After the 3D view drawing is completed in the view control, the 3D rendering of the Widget display view is completed. At this time, all that needs to be done is to output the drawn 3D view to the interactive interface, and combine the 3D view with the interactive interface. Interface views are merged. The merging refers to processing methods such as splicing, overlaying, covering, etc. between views. The purpose of merging is to integrate the Widget of the 3D view into the view of the interactive interface, so that the two can be displayed together in the interactive interface. So far, the drawing of the Widget with 3D visual effect is completed.

The present invention creates a custom view control in the interactive interface, draws a 3D view in the view control, and finally combines the 3D view with the view of the interactive interface, thereby creating a 3D visual effect in the interactive interface. Widget.

Embodiment 7, please refer to FIG. 10 , the creation unit 10 in Embodiment 6 includes:

A reading unit 11, configured to read the creation information of the view control;

A generating unit 12, configured to create a view control through reflection based on the creation information;

The position unit 13 is configured to place the view control on the target position of the interactive interface.

The reading unit 11 is used for reading creation information of the view control. The creation information includes information such as creation code, creation function, calling class, and size of the control of the view control, and its function is to provide control information required for creating the control.

Further, the creation information is included in the code of the Widget application. What the Widget reflects is the content of the Widget application, the content of which is derived from the update of the Widget application, and there is a direct relationship between the Widget and the Widget application. Therefore, the creation information of the view control exists in the code of the Widget application, so that the Widget can directly call the creation information.

The generating unit 12 is configured to create a view control through reflection based on the creation information. The reflection refers to the ability of a program to access, detect and modify its own state or behavior. It uses another method to call to obtain some information about the application or program components. This application can be running or can be It is not running yet, as long as it is a file that can be called by .NET, you can use reflection to obtain file information, such as dll, exe, com components, etc. can use reflection to obtain file information, and you can also use reflection to call these components or programs. Simply put, "reflection" is actually using the metadata information of the assembly. Assemblies contain modules, and modules contain types, which in turn contain members. Reflection provides objects that encapsulate assemblies, modules, and types. Through reflection, dynamically create instances of types, bind types to existing objects, or obtain types from existing objects. Then, you can call methods of types or access its fields and properties. During the running of the program, based on the read view control creation information, the view control is created by reflection. At this time, the parameters such as the size, boundary, layout, and attributes of the view control are all defined.

The position unit 13 is used to place the view control on the target position of the interactive interface. The target position should refer to the size of the view control, and finally be determined according to the settings of the user. It should be noted that there should also be a space judgment mechanism during the placing process to prompt the user where the Widget can be placed. For example, when placing a calendar widget on the desktop, it is first necessary to determine whether the current desktop interface has enough space according to the size of the interface space that the calendar widget needs to occupy. If the remaining space of the current desktop interface is not enough to place the calendar widget, it should Prompt the user that the current page does not have enough space to place the Widget; when the remaining space on the current desktop interface is sufficient to place the Calendar Widget, wait for further instructions from the user, and create the Calendar Widget after the indicated location is determined. At this point, the Widget generation location designated by the user is the target location of the view control referred to in the present invention.

Further, please refer to FIG. 11 , after the view control is created, it needs to be displayed in the interactive interface, so a dividing unit 15 for dividing a display area of a corresponding size at the target position of the interactive interface based on the size information is also required, The display area of the view control is divided in advance in the interactive interface.

After reading the creation information of the view control, the creation information includes the size information of the view control, and an acquisition unit 14 for obtaining the size information of the view control contained in the creation information is also required. After the target position of the view control is determined, the view of the interactive interface can be divided based on the size information at the target position, so as to divide an area for displaying the view control. Wherein, the calling unit 14 is after the calling unit 11 , and there is no call sequence relationship with the unit 12 , but it is before the calling unit 13 .

Combining all the features of Embodiment 6 and Embodiment 7, Embodiment 8 as shown in Figure 12 can be obtained, which includes the following units:

A reading unit 11, configured to read the creation information of the view control;

A generating unit 12, configured to create a view control through reflection based on the creation information;

A position unit 13, configured to place the view control on the target position of the interactive interface;

Wherein, an acquisition unit 14 is also included, configured to acquire the size information of the view control included in the creation information;

It also includes a division unit 15, configured to divide a display area of a corresponding size at the target position of the interactive interface based on the size information;

A drawing unit 20, configured to draw a 3D view in the view control;

The display unit 30 is configured to display the 3D view in the display area.

Further, please refer to FIG. 13 , in the ninth embodiment, when the created Widget needs to have a touch response, after the calling unit 30 in the seventh embodiment, an event arrangement unit 40 for arranging touch events in the display area should also be included . For example, the created Widget is a small window display interface of a game with 3D visual effects, so as to enable the user to watch video, video chat and other multi-threaded operations while playing the game. The touch event includes basic operations such as a single click event, a long press event, a focus change event, a keyboard event, and a menu event. For example, when a certain area in the Widget is clicked, the application corresponding to the Widget is started in response to the click operation, and when the area in the Widget is long pressed, the application corresponding to the Widget is updated with the latest information from the cloud , and display the latest information. The processing model for the touch event may be time processing based on authentication interface or event processing based on callback.

Please refer to Fig. 14, in the sixth embodiment, the drawing unit 20 includes:

A receiving unit 21, configured to receive view data for drawing in the Widget application;

The calling unit 22 is used to call the view drawing interface;

The rendering unit 23 is configured to render the view data into a 3D view.

The view content that needs to be presented in the Widget comes from the Widget application, so first obtain the view data needed to draw the 3D view from the Widget application; then call the view drawing interface, which is used to drive the drawing of the view, and the view drawing interface It includes a view drawing function, which can render the view data into a 3D view with 3D visual effects; finally, use the view drawing interface as a tool to draw in the view control. The view data may be text, 2D image, texture view and other data. Preferably, the view drawing interface uses opengl.

In Embodiment 6, the display unit includes a video memory, the 3D view is drawn in the view control, and the drawing result needs to be displayed on the interactive interface, which needs to be realized through the video memory. The video memory is used to store rendering data processed or to be extracted by the graphics card chip, and is a component used to store graphics information to be processed.

Further, in the above embodiment, the view control is preferably Textureview. The application's video or opengl content is usually displayed in a SurfaceView. The way SurfaceView works is to create a new window placed behind the application window. This method is very efficient, because the SurfaceView window does not need to redraw the application window when the SurfaceView window is refreshed (the view drawing mechanism of Android ordinary windows is layer by layer. Layer, any child element or partial refresh will cause the entire view structure to be redrawn once, so the efficiency is very low, but it is more than enough to meet the needs of ordinary application interfaces), but SurfaceView also has some very inconvenient limitations. Because the SurfaceView's content is not on the app window, transformations (translation, scaling, rotation, etc.) cannot be used. Compared with SurfaceView, TextureView does not create a separate Surface for drawing, which allows it to perform some transformation operations, set transparency, etc. like a normal View. In addition, Textureview must be in a window with hardware acceleration turned on. The use of TextureView is very simple, the only thing to do is to get the SurfaceTexture used to render the content. SurfaceTexture was added from Android 3.0 (API level 11). Its processing of image streams is not directly displayed, but converted to GL external textures, so it can be used for secondary processing of image stream data (such as Camera filters, desktop special effects, etc.) .

For example, the preview data of Camera can be handed over to GLSurfaceView for direct display after being turned into a texture, or it can be handed over to TextureView through SurfaceTexture as a hardware acceleration layer in View heirachy for display. First, SurfaceTexture obtains frame data from the image stream (from Camera preview, video decoding, GL drawing scene, etc.). When updateTexImage() is called, the GL texture object corresponding to SurfaceTexture is updated according to the latest image in the content stream. Next, just It can be manipulated like a normal GL texture.

By synthesizing the steps in the foregoing embodiments, Embodiment 10 can be obtained, as shown in FIG. 15 , a method for creating a 3D visual effect Widget on an interactive interface. It includes the following units:

A reading unit 11, configured to read the creation information of the view control;

A generating unit 12, configured to create a view control through reflection based on the creation information;

A position unit 13, configured to place the view control on the target position of the interactive interface;

Wherein, an acquisition unit 14 is also included, configured to acquire the size information of the view control included in the creation information;

It also includes a division unit 15, configured to divide a display area of a corresponding size at the target position of the interactive interface based on the size information;

A receiving unit 21, configured to receive view data for drawing in the Widget application;

The calling unit 22 is used to call the view drawing interface;

a rendering unit 23, configured to render the view data into a 3D view;

The display unit 30 is configured to display the 3D view in the display area.

The embodiment of the present invention also provides a terminal for drawing a 3D visual effect Widget in an interactive interface, which has a structure such as that referred to in the subsequent introduction of the present invention. As shown in FIG. 16 , for the convenience of description, only the parts related to the embodiment of the present invention are shown. For specific technical details not disclosed, please refer to the method part of the embodiment of the present invention. The terminal can be any terminal device including mobile phone, tablet computer, PDA (Personal Digital Assistant, personal digital assistant), POS (Point of Sales, sales terminal), vehicle-mounted computer, etc. Taking the terminal as a mobile phone as an example:

FIG. 16 is a block diagram showing a partial structure of a mobile phone related to the terminal provided by the embodiment of the present invention. 16, the mobile phone includes: a radio frequency (Radio Frequency, RF) circuit 1510, a memory 1520, an input unit 1530, an image unit 1540, a sensor 1550, an audio circuit 1560, a wireless fidelity (wireless fidelity, WiFi) module 1570 (that is, a WiFi chip module), processor 1580, and power supply 1590 and other components. Those skilled in the art can understand that the structure of the mobile phone shown in FIG. 16 does not constitute a limitation to the mobile phone, and may include more or less components than shown in the figure, or combine certain components, or arrange different components.

The following is a specific introduction to each component of the mobile phone in conjunction with Figure 16:

The RF circuit 1510 can be used for sending and receiving information or receiving and sending signals during a call. In particular, after receiving the downlink information from the base station, it is processed by the processor 1580; in addition, the designed uplink data is sent to the base station. Generally, the RF circuit 1510 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (Low Noise Amplifier, LNA), a duplexer, and the like. In addition, RF circuitry 1510 may also communicate with networks and other devices via wireless communications. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile Communication (Global System of Mobile communication, GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access) , CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (Long Term Evolution, LTE), email, Short Messaging Service (Short Messaging Service, SMS), etc.

The memory 1520 can be used to store software programs and modules, and the processor 1580 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 1520 . Memory 1520 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.) and the like; Data created by the use of mobile phones (such as audio data, phonebook, etc.), etc. In addition, the memory 1520 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

The input unit 1530 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the mobile phone. Specifically, the input unit 1530 may include a touch panel 1531 and other input devices 1532 . The touch panel 1531, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 1531 or near the touch panel 1531). operation), and drive the corresponding connection device according to the preset program. Optionally, the touch panel 1531 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the to the processor 1580, and can receive and execute commands sent by the processor 1580. In addition, the touch panel 1531 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1531 , the input unit 1530 may also include other input devices 1532 . Specifically, other input devices 1532 may include but not limited to one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), trackball, mouse, joystick, and the like.

The image unit 1540 may be used to display information input by or provided to the user and various menus of the mobile phone. The image unit 1540 may include a display panel 1541. Optionally, the display panel 1541 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like. Furthermore, the touch panel 1531 may cover the display panel 1541, and when the touch panel 1531 detects a touch operation on or near it, it transmits to the processor 1580 to determine the type of the touch event, and then the processor 1580 determines the type of the touch event according to the The type provides a corresponding visual output on the display panel 1541 . Although in FIG. 16 , the touch panel 1531 and the display panel 1541 are used as two independent components to realize the input and input functions of the mobile phone, in some embodiments, the touch panel 1531 and the display panel 1541 can be integrated to form a mobile phone. Realize the input and output functions of the mobile phone.

The handset may also include at least one sensor 1550, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1541 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 1541 and/or when the mobile phone is moved to the ear. or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used to identify the application of mobile phone posture (such as horizontal and vertical screen switching, related Games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc.; as for other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. repeat.

The audio circuit 1560, the speaker 1561, and the microphone 1562 can provide an audio interface between the user and the mobile phone. The audio circuit 1560 can transmit the electrical signal converted from the received audio data to the speaker 1561, and the speaker 1561 converts it into an audio signal for output; After being received, it is converted into audio data, and then the audio data is processed by the output processor 1580, and then sent to another mobile phone through the RF circuit 1510, or the audio data is output to the memory 1520 for further processing.

WiFi is a short-distance wireless transmission technology. The mobile phone can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 1570. It provides users with wireless broadband Internet access. Although Fig. 16 shows a WiFi module 1570, it can be understood that it is not an essential component of the mobile phone, and can be completely omitted according to needs without changing the essence of the invention.

The processor 1580 is the control center of the mobile phone. It uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and/or modules stored in the memory 1520, and calling data stored in the memory 1520, Execute various functions of the mobile phone and process data, so as to monitor the mobile phone as a whole. Optionally, the processor 1580 may include one or more processing units; preferably, the processor 1580 may integrate an application processor and a modem processor, wherein the application processor mainly processes operating systems, user interfaces, and application programs, etc. , the modem processor mainly handles wireless communications. It can be understood that the foregoing modem processor may not be integrated into the processor 1580 .

The mobile phone also includes a power supply 1590 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 1580 through the power management system, so that functions such as charging, discharging, and power consumption management can be realized through the power management system.

Although not shown, the mobile phone may also include a camera, a Bluetooth module, etc., which will not be repeated here.

Adapting to the portable control terminal device, in the embodiment of the present invention, the processor 1580 included in the terminal also has the functions realized by various embodiments of the above-mentioned method/apparatus for drawing a Widget with 3D visual effects.

Adapting to the portable access terminal device, in an embodiment of the present invention, the processor 1580 included in the terminal also has the functions realized in various embodiments of the aforementioned method/apparatus for drawing a Widget with 3D visual effect Function.

Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium can include: Read Only Memory (ROM, Read Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk, etc.

Those of ordinary skill in the art can understand that all or part of the steps in the method of the above-mentioned embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the above-mentioned storage The medium can be read-only memory, magnetic or optical disk, etc.

The series of solutions provided by the present invention have been introduced in detail above. For those of ordinary skill in the art, according to the ideas of the embodiments of the present invention, there will be changes in the specific implementation and application range. In summary, this The content of the description should not be construed as limiting the present invention.

In summary, the technical solution provided by the present invention is as follows:

A1. The method for creating a Widget with 3D visual effects in an interactive interface, which includes the following steps:

Create view controls in the interactive interface;

Draw a 3D view in the view control;

Inputting the 3D view into the interactive interface, and merging it with the view of the interactive interface to form a Widget.

A2. The method according to A1, wherein said creating a view control in the interactive interface includes:

Read the creation information of the view control;

generating a view control through reflection based on the creation information;

Place the view control on the target position of the interactive interface.

A3. The method according to A2, wherein the creation information is included in the code of the Widget application.

A4. The method according to A2, wherein, after reading the creation information of the view control, it also includes:

Acquiring size information of the view control included in the creation information;

A display area of a corresponding size is divided at the target position of the interactive interface based on the size information.

A5. The method according to A4, wherein after the 3D view is drawn in the view control, the 3D view is displayed in the display area.

A6. The method according to A5, wherein after displaying the 3D view in the display area, further comprising: arranging a touch event in the display area.

A7. The method according to A1, wherein said drawing a 3D view in said view control includes:

Receive view data for drawing in the Widget application;

Call the view drawing interface;

A 3D view is drawn in the view control based on the view data.

A8. The method according to A7, wherein the view drawing interface is OpenGL.

A9. The method according to A1, wherein after the 3D view is drawn in the view control, the 3D view is saved in the video memory.

A10. The method according to A9, wherein the inputting the 3D view to the interactive interface includes: inputting the 3D view from the video memory to the interactive interface.

A11. The method according to A1, wherein the view control is Textureview.

A12. The method according to any one of A1-A11, wherein the interactive interface is an Android system desktop.

A13. A device for creating a Widget with 3D visual effects in an interactive interface, including the following units:

Create a unit for creating view controls in the interactive interface;

a drawing unit, configured to draw a 3D view in the view control;

The display unit is configured to input the 3D view into the interactive interface, and combine it with the view of the interactive interface to form a Widget.

A14. The device according to A13, wherein the creating unit includes:

The reading unit is used to read the creation information of the view control;

a generating unit, configured to generate a view control through reflection based on the creation information;

The position unit is used to place the view control on the target position of the interactive interface.

A15. The device according to A14, wherein the creation information is included in the code of the Widget application.

A16. The device according to A14, further comprising:

an acquisition unit, configured to acquire the size information of the view control included in the creation information;

A division unit, configured to divide a display area of a corresponding size at the target position of the interactive interface based on the size information.

A17. The device according to A16, further comprising a video memory, and displaying the 3D view in the display area after the drawing of the 3D view is completed.

A18. The device according to A17, further comprising: an event arrangement unit, configured to arrange touch events in the display area.

A19. The device according to A13, wherein said drawing a 3D view in said view control comprises:

A receiving unit, configured to receive view data for drawing in the Widget application;

The calling unit is used to call the view drawing interface;

A rendering unit, configured to render the view data into a 3D view.

A20. The device according to A19, wherein the view rendering interface is OpenGL.

A21. The device according to A13, further comprising a video memory for storing the 3D view.

A22. The device according to A21, wherein the 3D view is input from the video memory to the interactive interface.

A23. The device according to A13, wherein the view control is Textureview.

A24. The device according to any one of A13-A23, wherein the interactive interface is an Android system desktop.

A25. A terminal for creating a Widget with 3D visual effects in an interactive interface, comprising: a display for displaying a user interactive interface; a memory; one or more processors for executing programs stored in the memory; a or a plurality of application programs, wherein the one or more application programs are stored in the memory and executed by the one or more processors; the one or more application programs are used to execute any of A1 to A12 method described in the item.

Claims (10)

1. The method for creating the Widget of 3D visual effect in the interactive interface is characterized in that, comprising the following steps: Create view controls in the interactive interface; Draw a 3D view in the view control; Inputting the 3D view into the interactive interface, and merging it with the view of the interactive interface to form a Widget. 2. The method according to claim 1, wherein said creating a view control in the interactive interface comprises: Read the creation information of the view control; generating a view control through reflection based on the creation information; Place the view control on the target position of the interactive interface. 3. The method according to claim 2, wherein the creation information is included in the code of the Widget application. 4. The method according to claim 2, further comprising: after reading the creation information of the view control: Acquiring size information of the view control included in the creation information; A display area of a corresponding size is divided at the target position of the interactive interface based on the size information. 5. The method according to claim 4, characterized in that, after the 3D view is drawn in the view control, the 3D view is displayed in the display area. 6. The method according to claim 1, wherein said drawing a 3D view in said view control comprises: Receive view data for drawing in the Widget application; Call the view drawing interface; A 3D view is drawn in the view control based on the view data. 7. The method according to claim 1, characterized in that, after the 3D view is drawn in the view control, the 3D view is saved in video memory. 8. The method according to claim 7, wherein the inputting the 3D view to the interactive interface comprises: inputting the 3D view from the video memory to the interactive interface. 9. The device for creating the Widget of 3D visual effect in the interactive interface is characterized in that, comprising the following units: Create a unit for creating view controls in the interactive interface; a drawing unit, configured to draw a 3D view in the view control; The display unit is configured to input the 3D view into the interactive interface, and combine it with the view of the interactive interface to form a Widget. 10. A terminal for creating a Widget with 3D visual effects in an interactive interface, comprising: a display for displaying a user interactive interface; a memory; one or more processors for executing programs stored in the memory; a or more application programs, wherein said one or more application programs are stored in said memory and executed by said one or more processors; said one or more application programs are used to perform claims 1 to 8 any one of the methods described.