CN111651079A - Handwriting display method, device, equipment and computer storage medium - Google Patents
Handwriting display method, device, equipment and computer storage medium Download PDFInfo
- Publication number
- CN111651079A CN111651079A CN202010421736.1A CN202010421736A CN111651079A CN 111651079 A CN111651079 A CN 111651079A CN 202010421736 A CN202010421736 A CN 202010421736A CN 111651079 A CN111651079 A CN 111651079A
- Authority
- CN
- China
- Prior art keywords
- webpage
- writing
- handwriting
- client
- point data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 74
- 238000003860 storage Methods 0.000 title claims abstract description 18
- 238000009877 rendering Methods 0.000 claims abstract description 82
- 230000008569 process Effects 0.000 claims abstract description 25
- 230000006870 function Effects 0.000 claims description 24
- 230000003111 delayed effect Effects 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 4
- 230000000875 corresponding effect Effects 0.000 description 29
- 238000010586 diagram Methods 0.000 description 10
- 230000002452 interceptive effect Effects 0.000 description 8
- 230000015572 biosynthetic process Effects 0.000 description 7
- 238000013515 script Methods 0.000 description 7
- 238000003786 synthesis reaction Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 238000005070 sampling Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 238000009826 distribution Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000008034 disappearance Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000010926 purge Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Information Transfer Between Computers (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a handwriting display method, a handwriting display device, handwriting display equipment and a computer storage medium, wherein a webpage end is loaded through a webpage rendering control of a client, and the method comprises the following steps: if the client side obtains touch point data generated in the writing operation process of the webpage side, the touch point data are distributed to the webpage side through a preset interface; and displaying the client-side writing on the webpage-side writing in a superposition manner, writing the bitmap obtained from the touch point data into a frame buffer area through the client-side writing, and rendering the touch point data by the webpage-side writing in a webpage rendering manner. Because the writing delay in the mode of directly writing the frame buffer area is smaller than the writing delay in the mode of adopting the page rendering, and the writing handwriting of the client side covers the writing handwriting of the webpage side, a user can think that the writing handwriting of the client side is the handwriting which is being drawn by the user in the sense, and the phenomenon that the writing handwriting does not follow the writing of the user and is correspondingly and synchronously displayed is avoided.
Description
Technical Field
The invention relates to the technical field of intelligent equipment, in particular to a handwriting display method, a handwriting display device, handwriting display equipment and a computer storage medium.
Background
A user can open the writing software of the web page version (referred to as a web page end for short) through the browser and perform writing operation by using the web page end. In practical application, because the script needs to be rendered through the script at the webpage end, the efficiency is low when the script is analyzed, and particularly on equipment with poor performance, because the time delay of webpage rendering is long, the phenomenon that the handwriting is not displayed synchronously corresponding to the writing of a user can occur.
Disclosure of Invention
The invention provides a writing handwriting display method, a writing handwriting display device, writing handwriting display equipment and a computer storage medium, which aim to overcome the defect that in the prior art, writing handwriting is not displayed synchronously corresponding to writing of a user.
According to a first aspect of embodiments of the present invention, a handwriting display method is provided, where a web page end is loaded through a web page rendering control of a client, and the method includes:
if the client side obtains touch point data generated in the writing operation process of the webpage side, the touch point data are distributed to the webpage side through a preset interface;
and displaying the client-side handwriting on the webpage-side handwriting in a superposition manner, wherein the client-side handwriting is obtained by writing a bitmap obtained from the touch point data into a frame buffer area through the client, and the webpage-side handwriting is obtained by rendering the touch point data through a webpage rendering control in a webpage rendering manner.
In one embodiment, the client communicates with the web page terminal through the preset interface provided by the browser kernel.
In one embodiment, the method further comprises:
and after the webpage end starts the writing function, the client end is informed to start the writing drawing function of the client end through the preset interface.
In one embodiment, the touch point data is distributed to a webpage end through a first sub-thread provided by a webpage rendering control.
In one embodiment, the drawing of the writing of the client is executed on a second sub-thread of the client, and the drawing of the writing of the webpage end is executed on a main thread of the client.
In one embodiment, the displaying the client-side handwriting on the webpage-side handwriting in an overlapping manner includes:
and writing a bitmap obtained by the touch point data into a frame buffer area corresponding to the main interface layer so as to enable the writing handwriting of the client to be superposed on the writing handwriting of the webpage end of the main interface layer.
In one embodiment, the displaying the client-side handwriting on the webpage-side handwriting in an overlapping manner includes:
writing a bitmap obtained from the touch point data into a frame buffer area corresponding to a mouse layer, and overlapping the mouse layer on a main interface layer, wherein the main interface layer comprises webpage end writing handwriting.
In one embodiment, the method further comprises:
and clearing the writing handwriting of the client after the writing operation is finished and a first preset time is delayed, wherein the first preset time is a preset difference value used for indicating the writing handwriting drawing completion time of the webpage end and the writing handwriting drawing completion time of the client.
In one embodiment, the determining process of the end of the writing operation includes:
when a touch lifting event is detected, judging that the writing operation is finished; or the like, or, alternatively,
and judging that the writing operation is finished when the touch lifting event is detected and the touch falling event of the same touch body or different touch bodies is not detected within a second preset time after the touch lifting event.
In one embodiment, the client is a client writing software, and the webpage end is a webpage version writing software.
According to a second aspect of the embodiments of the present invention, there is provided a handwriting display apparatus, where a web page end is loaded through a web page rendering control of a client, the apparatus including:
the data transmission module is used for distributing touch point data to the webpage end through a preset interface if the client obtains the touch point data generated in the writing operation process of the webpage end;
and the handwriting display module is used for displaying the client-side handwriting on the webpage-side handwriting in a superposition manner, the client-side handwriting is obtained by writing the bitmap obtained from the touch point data into a frame buffer area through the client, and the webpage-side handwriting is obtained by rendering the touch point data through a webpage rendering control in a webpage rendering manner.
In one embodiment, the client communicates with the web page terminal through the preset interface provided by the browser kernel.
In one embodiment, the client starts the writing drawing function of the client, and the webpage end notifies the writing drawing function through the preset interface after the webpage end starts the writing function.
In one embodiment, the touch point data is distributed to the webpage end through a first sub thread provided by the webpage rendering control.
In one embodiment, the drawing of the writing of the client is executed on a second sub-thread of the client, and the drawing of the writing of the webpage end is executed on a main thread of the client.
In one embodiment, the handwriting display module is specifically configured to:
and writing a bitmap obtained by the touch point data into a frame buffer area corresponding to the main interface layer so as to enable the writing handwriting of the client to be superposed on the writing handwriting of the webpage end of the main interface layer.
In one embodiment, the handwriting display module is specifically configured to:
writing a bitmap obtained from the touch point data into a frame buffer area corresponding to a mouse layer, and overlapping the mouse layer on a main interface layer, wherein the main interface layer comprises webpage end writing handwriting.
In one embodiment, the apparatus further comprises a data purge module to:
and clearing the writing handwriting of the client after the writing operation is finished and a first preset time is delayed, wherein the first preset time is a preset difference value used for indicating the writing handwriting drawing completion time of the webpage end and the writing handwriting drawing completion time of the client.
In one embodiment, the data clearing module is specifically configured to:
when a touch lifting event is detected, judging that the writing operation is finished; or the like, or, alternatively,
and judging that the writing operation is finished when the touch lifting event is detected and the touch falling event of the same touch body or different touch bodies is not detected within a second preset time after the touch lifting event.
In one embodiment, the client is a client writing software, and the webpage end is a webpage version writing software.
According to a third aspect of embodiments of the present invention, there is provided an electronic apparatus, including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor implements the following method when executing the program:
if the client side obtains touch point data generated in the writing operation process of the webpage side, the touch point data are distributed to the webpage side through a preset interface; the webpage end is loaded through a webpage rendering control of the client;
and displaying the client-side handwriting on the webpage-side handwriting in a superposition manner, wherein the client-side handwriting is obtained by writing a bitmap obtained from the touch point data into a frame buffer area through the client, and the webpage-side handwriting is obtained by rendering the touch point data through a webpage rendering control in a webpage rendering manner.
According to a fourth aspect of the embodiments of the present invention, there is provided a computer storage medium having a computer program stored thereon, the program, when executed by a processor, implementing the steps of the handwriting display method of any one of the above.
The technical scheme provided by the embodiment of the invention can have the following beneficial effects:
by applying the embodiment of the invention, the client-side handwriting is obtained by writing the bitmap obtained by the touch point data into the frame buffer area through the client-side, the webpage-side handwriting is obtained by rendering the touch point data in a webpage rendering mode, the writing delay in the mode of directly writing into the frame buffer area is smaller than the writing delay in the mode of adopting the page rendering, and the client-side handwriting is superposed and displayed on the webpage-side handwriting, so that the client-side handwriting can be considered as the handwriting being drawn by the user in the sense of the user, the phenomenon that the handwriting is not displayed synchronously corresponding to the writing of the user is avoided, and the user experience is greatly improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
FIG. 1 is a flow chart illustrating a handwriting display method according to an exemplary embodiment of the present invention.
FIG. 2A is a schematic diagram of another handwriting display method according to an exemplary embodiment of the present invention.
FIG. 2B is a schematic diagram of another handwriting display method in accordance with an exemplary embodiment of the present invention.
FIG. 3 is a flow chart illustrating another handwriting display method in accordance with an exemplary embodiment of the present invention.
FIG. 4 is a block diagram of a handwriting display apparatus according to an exemplary embodiment of the present invention.
FIG. 5 is a hardware configuration diagram of an electronic device in which the handwriting display apparatus of the present invention is installed.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, these information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present invention. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
In an application scenario where a web page is loaded by a client for writing, the handwriting from touch to rendering by the web page may be: by distributing the touch event on the main thread, when the touch event is distributed to a webpage rendering control (such as WebView), handwriting is rendered on Canvas on the main thread through a webpage end, and finally a writing rendering process of a touch point is completed. However, when a track is drawn, sampling is performed through the touch device, and a writing rendering process of a single touch point is completed for each touch point. For the equipment with poor performance, due to the fact that the time delay of webpage rendering is long, the phenomenon that writing handwriting does not follow the writing of a user and is correspondingly and synchronously displayed can occur.
The inventor finds that rendering of canvas on a webpage is difficult to improve efficiency on low-performance equipment, and in view of the above, the invention carries out optimization on user experience by rendering real-time handwriting on a client and utilizing the obtained mode that the handwriting on the client blocks the handwriting on the webpage.
The handwriting display method provided by the embodiment can be implemented through software, or can be implemented through combination of software and hardware, or through hardware implementation, and the related hardware can be composed of two or more physical entities, or can be composed of one physical entity. The method of the embodiment can be applied to the electronic equipment with the touch function. The electronic device may be an intelligent writing device such as an intelligent interactive tablet, a tablet, or a smart phone, an intelligent learning machine, a tablet, a notebook, a desktop, a PDA (Personal Digital Assistant) and the like with a touch function.
In one embodiment, the smart interactive tablet is exemplified. The execution subject of the embodiment of the invention can be an intelligent interaction panel, and can also be a program in the intelligent interaction panel.
The intelligent interactive panel, also called an interactive intelligent panel, may be an integrated device that controls content displayed on a display panel and implements human-computer interaction operations through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a screen, a sound, a television, a video conference terminal, and the like. Furthermore, the interactive smart tablet can also establish data connection with at least one external device. Among these, external devices include, but are not limited to: a touch pen, a mobile phone, a notebook computer, a USB flash disk, a tablet computer, a desktop computer, and the like. The embodiment of the communication mode of the data connection between the external device and the interactive intelligent tablet is not limited, and the communication mode can be a USB connection mode, an internet mode, a local area network mode, a Bluetooth mode, a Wi-Fi mode or a ZigBee mode and the like.
Next, an embodiment of the present invention will be described by way of example with reference to the accompanying drawings.
As shown in fig. 1, which is a flowchart illustrating a handwriting display method according to an exemplary embodiment of the present invention, a web page is loaded through a web page rendering control of a client, and the method may include steps 102 to 104:
in step 102, if the client obtains touch point data generated in the writing operation process of the webpage end, the touch point data is distributed to the webpage end through a preset interface;
in step 104, the client-side handwriting is displayed on the webpage-side handwriting in an overlapping manner, the client-side handwriting is obtained by writing the bitmap obtained from the touch point data into a frame buffer area through the client, and the webpage-side handwriting is obtained by rendering the touch point data through a webpage rendering control in a webpage rendering manner.
The client may be application software installed on the electronic device, and may also be referred to as APP. Further, in order to render real-time handwriting quickly, in one example, the client may be client software for writing, which may also be referred to as client writing software. For example, the software may be whiteboard software, drawing software, annotation software, and the like, which can provide a writing function and can be installed on the electronic device. The webpage end depends on the client end and can be loaded through the webpage rendering control of the client end. For example, the web page end may be web page version writing software.
The following description is mainly given by taking the handwriting display process of the Android system as an example, and certainly, the operation process of the handwriting display method on other operating systems such as a window system is similar to that on the Android system, and is not repeated herein. In an Android system, a webpage rendering control is WebView, so that a webpage end can be loaded by using a WebView kernel and communicated. For example, after the client is started, the web page is loaded in WebView of the client, and the android webkit provides a relevant interface for communication between the client and the web page (which may be referred to as a preset interface for short).
The webpage rendering control of the client can load a webpage end, and after the webpage end starts a writing function, the client can be informed to start a handwriting drawing function of the client through a preset interface, wherein the function can also be called a real-time drawing function and can be used for drawing the handwriting of the client. The client and the webpage end can communicate through the preset interface provided by a browser kernel (webkit). For example, in Android, a real-time rendering function of a client can be opened through a preset interface. Furthermore, handwriting attributes of the web page end, such as thickness and color, can be configured, and the handwriting attributes of the web page end are synchronized to the client through the preset interface, so that the client has the same handwriting attributes as the web page end, and the client handwriting drawn by the client is the same as the web page end handwriting under the condition that the touch point data is the same.
And if the fact that the user performs writing operation on the writing interface of the webpage end is detected, the Android touch distribution mechanism can distribute the touch point data to WebView. The client side can intercept touch point data generated by a user in the process of writing operation of the webpage side after obtaining the touch point data.
On one hand, the client side can draw handwriting of the client side because the client side starts a real-time drawing function. As an example, the client-side handwriting is obtained by the client-side writing to a frame buffer. The display screen of the Android device is abstracted to a frame buffer (FrameBuffer), and the surfefinger service in the Android system can draw the user interface of the application by writing contents to this frame buffer. The FrameBuffer is usually used as a driver of an LCD controller or other display devices, the FrameBuffer driver is a character device, a device node is/dev/fbX, the number of the main device may be 29, the number of the secondary device is incremented, a user may regard the FrameBuffer as an image of a display memory, and after the image is mapped to a process address space, the user may directly perform a read-write operation, and the write operation may be immediately reflected on a screen.
On the other hand, in order to ensure that the touch point distributed by the client is consistent with the webpage end, the touch point data obtained by the client can be distributed to the webpage end through the preset interface, so that handwriting of the webpage end can be drawn through the webpage rendering control at the webpage end. The preset interface can be a js interface, touch point data can be transmitted to the webpage end through the js interface, data on two sides can be guaranteed to be consistent, and the problem that the handwriting of the webpage end cannot be completely covered by the handwriting of the client end is avoided. In addition, the touch event is not consumed in the main thread, and the problems that the touch data cannot be distributed to the webpage end and further buttons on the webpage end cannot be clicked due to the fact that the touch data are intercepted by the client are avoided.
Because the WebView is drawn in a webpage rendering mode, the efficiency is lower than that of a client which is directly written in the FrameBuffer, the delay of handwriting of the client is smaller than that of handwriting of a webpage end, and because the handwriting of the client is covered above the handwriting of the webpage end, the user basically only thinks that the handwriting of the client is the handwriting which is being drawn. In the whole process, the writing delay of the user sense is the writing delay of the client, the writing delay is far smaller than the writing delay of directly drawing by using WebView, the phenomenon that writing handwriting does not follow the writing of the user and corresponds to synchronous display can be avoided, and the user experience is greatly improved. And meanwhile, the condition that the sampling point is lost can not be caused.
In one example, to prevent the main thread from blocking, the touch point data obtained by the webpage end can be distributed to the webpage end through the first sub-thread provided by the webpage rendering control. For example, in the Android system, the touch point data is distributed to the webpage end through a js interface, which can be realized through a JSBridge thread (also a child thread) provided by a WebView kernel. According to the embodiment, the touch point data is transmitted to the webpage end through the JSP bridge thread, so that too many tasks can be prevented from being executed on the main thread, and the condition that touch point information is lost due to the blockage of the main thread when the touch point is transmitted through the main thread is avoided.
In practical application, not only can the main thread be blocked and stuck when the main thread executes too many tasks, but also for a device with poor performance, if the rendering process of a single point is long and exceeds the sampling period of a touch device, the loss of a sampling point can be caused. In order to avoid this situation, in an embodiment, the main thread may be implemented to be only used for providing the web page rendering control for performing web page end handwriting drawing, so as to avoid performance consumption. And if so, the drawing of the writing of the client is executed on a second sub-thread of the client, and the drawing of the writing of the webpage end is executed on a main thread of the client. The second sub-thread and the first sub-thread are different sub-threads and are distinguished by different names. Because the rendering of the handwriting of the client occurs in the sub-thread, and because the FrameBuffer is directly operated, the efficiency is higher than that of the webpage rendering, and the method is not limited by vertical synchronization (vsync), the problem of loss of sampling points can be solved.
Regarding how to draw the webpage-side handwriting, for example, the webpage-side handwriting is obtained by a webpage rendering control in a webpage rendering manner, that is, the webpage-side handwriting is obtained by a general webpage rendering process.
When each operating system (such as a window system, an Android system or a Linux system) displays windows, the window management service of the operating system comes from different components and windows of the system. Taking an Android system as an example, the Android window management service manages different Activities (an Activities is an application program component, a screen is provided, and a user can use the Activities to interact with each other to complete a certain task), each window corresponds to one Surface object (Surface is essentially a memory area), each Surface object corresponds to one Layer value (level), and if the Layer value is larger, the corresponding window is displayed on the larger side to block other windows.
And when the rendering program in each operating system updates the display screen, the WebView can execute the js script first, then render the js script to the main thread according to the js script and render the handwriting on the webpage end. For example, the WebView kernel may execute JavaScript scripts to parse and render into corresponding Activity. All Surface objects corresponding to all display windows on a display screen are superposed into a bitmap (bitmap file, for example, a standard format graphic file) with the same size as the display screen according to the size of the Layer of the Surface objects, the bitmap file defines an image as being composed of points (pixels), each point can be represented by multiple colors), the bitmap is rendered and written into an idle Framebuffer, and a vsync signal (vertical synchronization signal) is waited, so that a rendering program takes the idle Framebuffer as the currently displayed Framebuffer according to the vsync signal, and the screen is displayed on a display, and the rendering and updating of the display screen are completed.
For convenience of distinction, the layer where the handwriting on the webpage end is located may be referred to as a main interface layer. The main interface layer can be a media layer or a common view layer, and is specifically determined by a webpage rendering control. And executing a webpage rendering process, waiting for the vsync signal, and writing data into a FrameBuffer corresponding to the main interface layer according to the vsync signal to obtain the webpage end handwriting. Specifically, writing of the FrameBuffer corresponding to the main interface layer may be implemented by writing of a device file corresponding to the main interface layer. The device file of FrameBuffer corresponding to the main interface layer can be/dev/fb 0 or/dev/graphics/fb 0.
Two examples are provided below to illustrate how to draw client-side handwriting.
In one embodiment, in order to improve rendering efficiency of the client-side handwriting, a bitmap obtained from the touch point data may be written into a frame buffer corresponding to the main interface layer, so that the client-side handwriting is superimposed on the web page-side handwriting of the main interface layer. For convenience of understanding, FIG. 2A is a schematic diagram of another handwriting display method according to an exemplary embodiment of the present invention. In the schematic diagram, the JSbridge thread provided by the WebView kernel can be used for distributing the touch point information to the webpage end, and the handwriting of the webpage end is drawn on the main thread in a webpage rendering mode. The main interface FrameBuffer is written by directly writing fb () (/ dev/fb0huo/dev/graphics/fb0) by JSBridge sub-thread operation and then rendered by FrameBuffer onto the screen by the GPU. Because the process of executing JavaScript rendering canvas, the step of superimposing, synthesizing and waiting for the vsync signal of the writing handwriting of the surface object can be skipped, and the handwriting is directly drawn into the main interface FrameBuffer, the efficiency is higher than that of webpage rendering, the writing delay time of the client is shorter than that of using webview for drawing, and the user experience is improved.
In another embodiment, some devices are further provided with other layers different from the main interface layer, for example, a mouse layer, for this purpose, the client-side handwriting can be displayed on the other layers by writing the client-side handwriting into the frame buffer, the web-side handwriting can be displayed on the main interface layer by the web-rendering control in the web-rendering manner, and the other layers are superimposed (overlaid) on the main interface layer, so that the client-side handwriting can be superimposed and displayed on the web-side handwriting. Because the writing delay time corresponding to the direct writing frame buffer area is less than the writing delay time corresponding to the webpage rendering, and other layers are superposed on the main interface layer, the phenomenon of handwriting display delay on the main interface layer is solved, the display of the handwriting is accelerated, the phenomenon that the handwriting follows the hands of a user in the visual effect is realized, and the use experience of the user is improved.
Taking the other Layer as a mouse Layer as an example, the mouse Layer may be referred to as a mouse cursor Layer (hardware cursor Layer). The content on the main interface Layer needs to be displayed by software synthesis, namely, the multiple display windows corresponding to the surface object on the main interface Layer superpose respective bitmap files (bitmaps) according to the size and position of the Layer of the display window to synthesize a bitmap file (bitmap), the bitmap file is synthesized in a mode of occupying a CPU, and the bitmap file is rendered and written into an idle Framebuffer, which is called Framebuffer corresponding to the main interface Layer for short. The content on the mouse layer is displayed in a synthesis mode (hardware combination abstraction layer, HWComposer), the content displayed on the mouse layer is synthesized and displayed through a hardware synthesis mode, the content displayed by the mouse layer is synthesized on the Framebuffer corresponding to the device file through the HWComposer layer of one or more special synthesis chips, then the Framebuffer synthesized by the software display layer and Framebuffers on different hardware layers are displayed on the display in a superposition and fusion mode through the hardware synthesis mode when the current writing interface is refreshed and displayed, the superposition display of all layers on the display screen is completed, namely the display processing of the content on the main interface layer needs the soft layer synthesized by the GPU, the result is delivered to the HWComposer for display, the display content on the mouse layer is displayed after being processed by the HWComposer, and the synthesis of the display content on the mouse layer does not influence on the synthesis of the main interface layer. And drawing the client-side handwriting by using a mouse layer FrameBuffer, wherein the layer is not coupled with the FrameBuffer rendering the main picture, so that mutual influence is avoided, and the client-side handwriting can cover the webpage-side handwriting.
Correspondingly, the displaying the client-side handwriting on the webpage-side handwriting in an overlapping manner includes: writing a bitmap obtained from the touch point data into a frame buffer area corresponding to a mouse layer, and overlapping the mouse layer on a main interface layer, wherein the main interface layer comprises webpage end writing handwriting.
For convenience of understanding, FIG. 2B is a schematic diagram of another handwriting display method according to an exemplary embodiment of the present invention. In the schematic diagram, the JSbridge thread provided by the WebView kernel can be used for distributing the touch point information to the webpage end, and the handwriting of the webpage end is drawn on the main thread in a webpage rendering mode. The mouse layer FrameBuffer is written by JSbridge sub-thread direct write dev/fb3 or/dev/graphics/fb 3 drive to update the mouse layer interface. At the moment, handwriting can be drawn on a bitmap by the mouse layer through a sub-thread, and the bitmap is written into a FrameBuffer mode of the mouse layer through driving of fb3, so that the handwriting of a user can be drawn in real time. Because the series of drawing flows are operated in the sub-thread, and simultaneously, the client distributes the touch points to the webpage end one by one through JSbridge, the consistency of the touch points distributed by the client and the webpage end is ensured, the main thread is prevented from being blocked, and the main thread is only used for providing the WebView for writing and drawing the handwriting on the webpage end, thereby avoiding performance consumption. Because the WebView is drawn in a webpage rendering mode, the efficiency of the WebView is lower than that of a client which is directly written in a FrameBuffer, the display speed of handwriting of the client is higher than that of handwriting of a webpage end, and because the handwriting of the client is covered above the handwriting of the WebView end, the user basically only thinks that the handwriting of the client is the handwriting which is being drawn.
It should be understood that other ways may also be adopted to display the client handwriting on the webpage end handwriting in an overlapping manner, which are not described herein again.
In some application scenarios, all writing is ultimately expected to act on the web, and handwriting needs to be entered into a web page, and for this purpose, in one embodiment, the method further comprises: and clearing the writing handwriting of the client after the writing operation is finished and the first preset time is delayed. The first preset time may be a preset difference value used for indicating the drawing completion time of the handwriting at the webpage end and the drawing completion time of the handwriting at the client end. For example, the first preset time may be obtained according to statistics of delay time of the web page end writing trace compared with the client end writing trace in the history, or may be an empirical value, and the like, for example, the first preset time may be 500 ms. The method aims to wait for completion of drawing of webview and avoid the situation that the blocked client-side writing handwriting disappears because the webpage-side writing handwriting is not drawn yet. And directly clearing the writing handwriting of the client aiming at the condition that the bitmap obtained by the touch point data is written into the frame buffer zone corresponding to the main interface layer. The data written in the mouse layer can be cleared according to the condition that the bitmap obtained by the touch point data is written in the frame buffer area corresponding to the mouse layer, and further, after the handwriting of the client is cleared, the transparency of the mouse layer can be adjusted to hide the mouse layer and display the main interface layer.
Regarding the determination process of the writing operation ending, since the touch event may include a touch DOWN event (ACTION _ DOWN), a plurality of consecutive touch MOVE events (ACTION _ MOVE), and a touch UP event (ACTION _ UP), in one example, when the touch UP event is detected, it may be determined that the writing operation is ended. In practical application, the handwriting may be short, so in another embodiment, when the time difference between two times of writing is less than the second preset time, all the handwriting are not disappeared until the hand-raising time exceeds the time delay disappearance time, and all the handwriting are disappeared at the same time.
Correspondingly, when a touch lifting event is detected and a touch falling event of the same touch body or different touch bodies is not detected within a second preset time after the touch lifting event, the writing operation is judged to be finished. The touch object may be a finger, a palm, a stylus pen, or the like that is recognized by the screen. Only a single touch may be implemented in some devices, while multiple touches may be implemented in some devices. The multi-point touch realizes a touch screen or a touch pad, and simultaneously receives input information from a plurality of touch points on the screen, namely, the multi-point or multi-user interactive operation can be simultaneously completed on the same display interface. For example, the touch screen of the electronic device may be, but is not limited to, a multi-touch screen such as a multi-touch capacitive touch screen. The multi-touch screen allows for the detection of multiple finger touches simultaneously, as well as other non-finger touch modalities such as palm, face, fist, etc. For a device supporting single-point touch, as long as a touch up event is detected and no touch down event is detected within a second preset time after the touch up event, it may be determined that the writing operation is ended. For the device supporting multi-point touch, if a touch lifting event is detected, it can be judged that a touch falling event of the same touch body or different touch bodies is not detected within a second preset time after the touch lifting event, and if the touch falling event is not detected, the writing operation can be considered to be finished, so that the resource waste caused by the fact that the handwriting of the client is cleared under the condition that the handwriting is short and short is avoided.
The various technical features in the above embodiments can be arbitrarily combined, so long as there is no conflict or contradiction between the combinations of the features, but the combination is limited by the space and is not described one by one, and therefore, any combination of the various technical features in the above embodiments also belongs to the scope disclosed in the present specification.
One of the combined embodiments is illustrated. FIG. 3 is a flow chart illustrating another handwriting display method according to an exemplary embodiment of the present invention, the method comprising:
step 301: client writing software (app) is launched.
Step 302: the webpage-side writing software is loaded in WebView of the client-side writing software, and the android webkit provides a relevant interface for communication between the client-side writing software and the webpage-side writing software (hereinafter referred to as js interface).
Step 303: when the writing function of the webpage-side writing software is opened, the mouse layer with the rendered client-side writing handwriting can be also called a real-time handwriting layer through the mouse layer of the js interface operating system UI.
Step 304: when a user starts to write a touch screen, a touch distribution mechanism of Android distributes touch point data to WebView.
Step 305: after the client writing software acquires the touch point data, the client writing handwriting is drawn on the mouse layer through the mouse layer FrameBuffer drive in the sub-thread. Meanwhile, touch point data is distributed to webpage end writing software through a js interface to perform handwriting rendering. A mouse layer is superimposed on the main interface layer.
Thus, although the webpage rendering speed is slow, handwriting has large delay, and the method is particularly obvious on a low-performance machine. But the user cannot perceive this delay because the real-time handwriting layer of the client writing software is overlaid on top of WebView. On the other hand, sub-thread drawing and js interface passing touch points also avoid performing too many tasks on the main thread, thereby avoiding stuck and touch point loss. And the touch point is transmitted to the webpage end writing software through the js interface, so that the consistency of data on two sides can be ensured, and the problem that the webpage end writing cannot be completely covered by the client end writing is avoided. In addition, touch events are not consumed in the main thread, and the problems that touch data cannot be distributed to webpage end writing software and buttons on the webpage end cannot be clicked due to the fact that the touch data are intercepted by the real-time handwriting layer are avoided. The reason for using the mouse layer FrameBuffer to draw the handwriting in real time is that the layer is not coupled with the FrameBuffer rendering the main picture, so that mutual influence is caused, and the real-time drawing layer can cover the webpage end to write the handwriting.
Step 306: and after the webpage end writing software acquires the touch point data issued by the client, the webpage end writing handwriting is synchronously drawn in the main thread. And displaying the handwriting at the webpage end on the main interface layer.
Step 307: and clearing the handwriting of the client after the writing operation is finished and the first preset time is delayed.
When writing is finished and the user lifts his hand, the real-time handwriting layer does not disappear immediately, and the flickering phenomenon caused by the fact that the webpage end is not drawn completely is avoided. So the FrameBuffer of the mouse layer can be emptied again when there is no new touch event within the first preset time. For example, the first preset time may be 500 ms. Through the scheme, the writing experience of the user on the webpage whiteboard software can be greatly improved, the writing delay is extremely low, and the handwriting follows the hand.
It is understood that fig. 3 is the same as the related art in fig. 1, and the description thereof is not repeated herein.
The example is illustrated by taking a client as whiteboard software, after the whiteboard software is started, the WebView of the whiteboard software loads webpage writing software, and the whiteboard software and the webpage writing software can provide a related interface (js interface for short) for communication through an Android webkit. And when the writing function of the webpage writing software is started, the real-time drawing function of the whiteboard software is started through the js interface. And the handwriting attribute of the webpage version writing software can be sent to the whiteboard software through the js interface, so that the client-side writing handwriting drawn by the whiteboard software is the same as the webpage-side writing handwriting under the condition that the touch point data is the same. When a user writes on an interface of the webpage version writing software, the data acquisition module can distribute touch data to the whiteboard software, and writes a bitmap obtained from the touch point data into a frame buffer area corresponding to a mouse layer on a sub-thread of the whiteboard software to obtain the writing handwriting of the client. The whiteboard software distributes the touch data to the webpage edition writing software through a JSbridge thread provided by the WebView kernel, renders the touch point data on a main thread of the whiteboard software in a webpage rendering mode to obtain webpage end writing, and then covers the client end writing on the webpage end writing for displaying. Like this, through this embodiment, improvement user that can be very big is experienced to the writing of webpage whiteboard software, and writing delay is extremely low, improves handwriting and experiences with the hand.
The invention also provides an embodiment of the handwriting display device, an electronic device applied by the handwriting display device and a computer storage medium, corresponding to the embodiment of the handwriting display method.
As shown in fig. 4, which is a block diagram of a handwriting display apparatus according to an exemplary embodiment of the present invention, a web page is loaded through a web page rendering control of a client, and the apparatus includes:
the data transmission module 42 is configured to, if the client obtains touch point data generated in a webpage writing operation process, distribute the touch point data to the webpage through a preset interface;
and the handwriting display module 44 is configured to display the client-side writing handwriting on the webpage-side writing handwriting in a superimposed manner, where the client-side writing handwriting is obtained by writing a bitmap obtained from the touch point data into a frame buffer area through the client, and the webpage-side writing is obtained by rendering the touch point data through a webpage rendering control in a webpage rendering manner.
In one embodiment, the client communicates with the web page terminal through the preset interface provided by the browser kernel.
Further, the client starts the writing drawing function of the client, and the writing function is started by the webpage end and then notified by the webpage end through the preset interface.
In one embodiment, the touch point data is distributed to the webpage end through a first sub thread provided by the webpage rendering control.
In one embodiment, the drawing of the writing of the client is executed on a second sub-thread of the client, and the drawing of the writing of the webpage end is executed on a main thread of the client.
In one embodiment, the handwriting display module is specifically configured to:
and writing a bitmap obtained by the touch point data into a frame buffer area corresponding to the main interface layer so as to enable the writing handwriting of the client to be superposed on the writing handwriting of the webpage end of the main interface layer.
In one embodiment, the handwriting display module is specifically configured to:
writing a bitmap obtained from the touch point data into a frame buffer area corresponding to a mouse layer, and overlapping the mouse layer on a main interface layer, wherein the main interface layer comprises webpage end writing handwriting.
In one embodiment, the apparatus further comprises a data clearing module (not shown in fig. 4) configured to:
and clearing the writing handwriting of the client after the writing operation is finished and a first preset time is delayed, wherein the first preset time is a preset difference value used for indicating the writing handwriting drawing completion time of the webpage end and the writing handwriting drawing completion time of the client.
In one embodiment, the data clearing module is specifically configured to:
when a touch lifting event is detected, judging that the writing operation is finished; or the like, or, alternatively,
and judging that the writing operation is finished when the touch lifting event is detected and the touch falling event of the same touch body or different touch bodies is not detected within a second preset time after the touch lifting event.
In one embodiment, the client is a client writing software, and the webpage end is a webpage version writing software.
Correspondingly, the embodiment of the invention also provides electronic equipment, which comprises a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the steps of any of the handwriting display methods described above.
Correspondingly, the embodiment of the invention also provides a computer storage medium, on which a computer program is stored, and the program is executed by a processor to implement the steps of any one of the handwriting display methods.
The present invention may take the form of a computer program product embodied on one or more storage media including, but not limited to, disk storage, CD-ROM, optical storage, and the like, having program code embodied therein. Computer-usable storage media include permanent and non-permanent, removable and non-removable media, and information storage may be implemented by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of the storage medium of the computer include, but are not limited to: phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technologies, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic tape storage or other magnetic storage devices, or any other non-transmission medium, may be used to store information that may be accessed by a computing device.
The specific details of the implementation process of the functions and actions of each module in the device are referred to the implementation process of the corresponding step in the method, and are not described herein again.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, wherein the modules described as separate parts may or may not be physically separate, and the parts displayed as modules may or may not be physical modules, may be located in one place, or may be distributed on a plurality of network modules. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the invention. One of ordinary skill in the art can understand and implement it without inventive effort.
The embodiment of the handwriting display device can be applied to electronic equipment. The device embodiments may be implemented by software, or by hardware, or by a combination of hardware and software. Taking a software implementation as an example, as a logical device, the device is formed by reading, by a processor of the electronic device where the device is located, a corresponding computer program instruction in the nonvolatile memory into the memory for operation. From a hardware aspect, as shown in fig. 5, it is a hardware structure diagram of an electronic device where the device 532 for displaying writing according to the present invention is located, except for the processor 510, the network interface 520, the memory 530, and the nonvolatile memory 540 shown in fig. 5, the electronic device where the device 532 is located in the embodiment may also include other hardware according to the actual function of the electronic device, which is not described again.
As one embodiment, the electronic device may be a smart interactive tablet.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (11)
1. A handwriting display method is characterized in that a webpage end is loaded through a webpage rendering control of a client, and the method comprises the following steps:
if the client side obtains touch point data generated in the writing operation process of the webpage side, the touch point data are distributed to the webpage side through a preset interface;
and displaying the client-side handwriting on the webpage-side handwriting in a superposition manner, wherein the client-side handwriting is obtained by writing a bitmap obtained from the touch point data into a frame buffer area through the client, and the webpage-side handwriting is obtained by rendering the touch point data through a webpage rendering control in a webpage rendering manner.
2. The method according to claim 1, wherein the client communicates with the web page through the preset interface provided by a browser kernel; the method further comprises the following steps:
and after the webpage end starts the writing function, the client end is informed to start the writing drawing function of the client end through the preset interface.
3. The method according to claim 1, wherein the touch point data is distributed to a webpage end through a first sub-thread provided by a webpage rendering control, the drawing of the writing of the client end is executed on a second sub-thread of the client end, and the drawing of the writing of the webpage end is executed on a main thread of the client end.
4. The method of claim 1, wherein displaying the client-side handwriting superimposed on the webpage-side handwriting comprises:
and writing a bitmap obtained by the touch point data into a frame buffer area corresponding to the main interface layer so as to enable the writing handwriting of the client to be superposed on the writing handwriting of the webpage end of the main interface layer.
5. The method of claim 1, wherein displaying the client-side handwriting superimposed on the webpage-side handwriting comprises:
writing a bitmap obtained from the touch point data into a frame buffer area corresponding to a mouse layer, and overlapping the mouse layer on a main interface layer, wherein the main interface layer comprises webpage end writing handwriting.
6. The method according to any one of claims 1 to 5, further comprising:
and clearing the writing handwriting of the client after the writing operation is finished and a first preset time is delayed, wherein the first preset time is a preset difference value used for indicating the writing handwriting drawing completion time of the webpage end and the writing handwriting drawing completion time of the client.
7. The method according to claim 6, wherein the determining process of the end of the writing operation comprises:
when a touch lifting event is detected, judging that the writing operation is finished; or the like, or, alternatively,
and judging that the writing operation is finished when the touch lifting event is detected and the touch falling event of the same touch body or different touch bodies is not detected within a second preset time after the touch lifting event.
8. The method according to any one of claims 1 to 5, wherein the client is a client writing software, and the webpage end is a webpage version writing software.
9. A handwriting display device is characterized in that a webpage end is loaded through a webpage rendering control of a client, and the handwriting display device comprises:
the data transmission module is used for distributing touch point data to the webpage end through a preset interface if the client obtains the touch point data generated in the writing operation process of the webpage end;
and the handwriting display module is used for displaying the client-side handwriting on the webpage-side handwriting in a superposition manner, the client-side handwriting is obtained by writing the bitmap obtained from the touch point data into a frame buffer area through the client, and the webpage-side handwriting is obtained by rendering the touch point data through a webpage rendering control in a webpage rendering manner.
10. An electronic device, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor implements the following method when executing the program:
if the client side obtains touch point data generated in the writing operation process of the webpage side, the touch point data are distributed to the webpage side through a preset interface; the webpage end is loaded through a webpage rendering control of the client;
and displaying the client-side handwriting on the webpage-side handwriting in a superposition manner, wherein the client-side handwriting is obtained by writing a bitmap obtained from the touch point data into a frame buffer area through the client, and the webpage-side handwriting is obtained by rendering the touch point data through a webpage rendering control in a webpage rendering manner.
11. A computer storage medium on which a computer program is stored, which program, when being executed by a processor, is adapted to carry out the steps of the method of any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010421736.1A CN111651079B (en) | 2020-05-18 | 2020-05-18 | Handwriting display method, device, equipment and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010421736.1A CN111651079B (en) | 2020-05-18 | 2020-05-18 | Handwriting display method, device, equipment and computer storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111651079A true CN111651079A (en) | 2020-09-11 |
| CN111651079B CN111651079B (en) | 2023-09-29 |
Family
ID=72352750
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010421736.1A Active CN111651079B (en) | 2020-05-18 | 2020-05-18 | Handwriting display method, device, equipment and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111651079B (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112783346A (en) * | 2021-01-19 | 2021-05-11 | 深圳市皓丽智能科技有限公司 | Handwriting data processing method and system, computer equipment and storage medium |
| CN113934394A (en) * | 2021-10-19 | 2022-01-14 | 河北师达教育科技有限公司 | Method and device for realizing memory display in display screen and terminal equipment |
| CN114201251A (en) * | 2021-10-18 | 2022-03-18 | 深圳市鸿合创新信息技术有限责任公司 | Method, apparatus, device and medium for reducing writing trace display delay |
| CN114217730A (en) * | 2021-12-27 | 2022-03-22 | 科大讯飞股份有限公司 | A writing display method, device, equipment, system and storage medium |
| CN114510159A (en) * | 2021-12-30 | 2022-05-17 | 锐捷网络股份有限公司 | Writing track display method, device and storage medium |
| CN114579032A (en) * | 2022-02-15 | 2022-06-03 | 长沙朗源电子科技有限公司 | OCR-based intelligent hand-drawn graphic method, device and equipment for electronic whiteboard |
| CN114610188A (en) * | 2022-02-09 | 2022-06-10 | 广东能龙教育股份有限公司 | Interface handwriting writing method and system, control device and storage medium |
| WO2022134180A1 (en) * | 2020-12-25 | 2022-06-30 | 安徽鸿程光电有限公司 | Handwriting display method and apparatus, electronic device, and storage medium |
| CN114900641A (en) * | 2022-04-29 | 2022-08-12 | 安徽听见科技有限公司 | Data storage and backtracking method, device and system |
| CN114972558A (en) * | 2021-02-25 | 2022-08-30 | 广州视源电子科技股份有限公司 | Handwriting drawing method, device, medium and interactive panel |
| CN115639920A (en) * | 2021-12-24 | 2023-01-24 | 荣耀终端有限公司 | Drawing method, electronic device and readable storage medium |
| TWI823584B (en) * | 2022-08-11 | 2023-11-21 | 大陸商環勝電子(深圳)有限公司 | Handwritten data processing method and handwritten data processing system |
| WO2024040383A1 (en) * | 2022-08-22 | 2024-02-29 | 广州视源电子科技股份有限公司 | Writing display method, writing response method and apparatus, terminal device, and server |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH02191018A (en) * | 1989-01-20 | 1990-07-26 | Tokyo Electric Power Co Inc:The | Input device and picture processor |
| CN105677107A (en) * | 2016-01-11 | 2016-06-15 | 福州瑞芯微电子股份有限公司 | Method and system for optimizing screen handwriting following performance |
| CN108364324A (en) * | 2018-01-22 | 2018-08-03 | 广州市动景计算机科技有限公司 | Image processing method, device and electric terminal |
| CN109144382A (en) * | 2018-07-10 | 2019-01-04 | 广州视源电子科技股份有限公司 | Handwriting display method and device based on dual systems, terminal equipment and storage medium |
| CN110580125A (en) * | 2018-06-07 | 2019-12-17 | 广州视源电子科技股份有限公司 | partial refreshing method, device, equipment and medium for display interface |
| CN110597444A (en) * | 2018-06-12 | 2019-12-20 | 广州视源电子科技股份有限公司 | Handwriting display method and device, terminal device and storage medium |
-
2020
- 2020-05-18 CN CN202010421736.1A patent/CN111651079B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH02191018A (en) * | 1989-01-20 | 1990-07-26 | Tokyo Electric Power Co Inc:The | Input device and picture processor |
| CN105677107A (en) * | 2016-01-11 | 2016-06-15 | 福州瑞芯微电子股份有限公司 | Method and system for optimizing screen handwriting following performance |
| CN108364324A (en) * | 2018-01-22 | 2018-08-03 | 广州市动景计算机科技有限公司 | Image processing method, device and electric terminal |
| CN110580125A (en) * | 2018-06-07 | 2019-12-17 | 广州视源电子科技股份有限公司 | partial refreshing method, device, equipment and medium for display interface |
| CN110597444A (en) * | 2018-06-12 | 2019-12-20 | 广州视源电子科技股份有限公司 | Handwriting display method and device, terminal device and storage medium |
| CN109144382A (en) * | 2018-07-10 | 2019-01-04 | 广州视源电子科技股份有限公司 | Handwriting display method and device based on dual systems, terminal equipment and storage medium |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022134180A1 (en) * | 2020-12-25 | 2022-06-30 | 安徽鸿程光电有限公司 | Handwriting display method and apparatus, electronic device, and storage medium |
| CN112783346A (en) * | 2021-01-19 | 2021-05-11 | 深圳市皓丽智能科技有限公司 | Handwriting data processing method and system, computer equipment and storage medium |
| CN112783346B (en) * | 2021-01-19 | 2024-11-29 | 深圳市皓丽智能科技有限公司 | Handwriting data processing method, system, computer equipment and storage medium |
| CN114972558A (en) * | 2021-02-25 | 2022-08-30 | 广州视源电子科技股份有限公司 | Handwriting drawing method, device, medium and interactive panel |
| CN114201251A (en) * | 2021-10-18 | 2022-03-18 | 深圳市鸿合创新信息技术有限责任公司 | Method, apparatus, device and medium for reducing writing trace display delay |
| CN113934394A (en) * | 2021-10-19 | 2022-01-14 | 河北师达教育科技有限公司 | Method and device for realizing memory display in display screen and terminal equipment |
| CN113934394B (en) * | 2021-10-19 | 2024-05-03 | 河北师达教育科技有限公司 | Method, device and terminal equipment for realizing memory display in display screen |
| CN115639920A (en) * | 2021-12-24 | 2023-01-24 | 荣耀终端有限公司 | Drawing method, electronic device and readable storage medium |
| CN115639920B (en) * | 2021-12-24 | 2023-12-22 | 荣耀终端有限公司 | Drawing method, electronic device, and readable storage medium |
| CN114217730A (en) * | 2021-12-27 | 2022-03-22 | 科大讯飞股份有限公司 | A writing display method, device, equipment, system and storage medium |
| CN114510159A (en) * | 2021-12-30 | 2022-05-17 | 锐捷网络股份有限公司 | Writing track display method, device and storage medium |
| CN114610188B (en) * | 2022-02-09 | 2024-02-13 | 广东能龙教育股份有限公司 | Interface handwriting writing method and system, control device and storage medium |
| CN114610188A (en) * | 2022-02-09 | 2022-06-10 | 广东能龙教育股份有限公司 | Interface handwriting writing method and system, control device and storage medium |
| CN114579032A (en) * | 2022-02-15 | 2022-06-03 | 长沙朗源电子科技有限公司 | OCR-based intelligent hand-drawn graphic method, device and equipment for electronic whiteboard |
| CN114900641A (en) * | 2022-04-29 | 2022-08-12 | 安徽听见科技有限公司 | Data storage and backtracking method, device and system |
| TWI823584B (en) * | 2022-08-11 | 2023-11-21 | 大陸商環勝電子(深圳)有限公司 | Handwritten data processing method and handwritten data processing system |
| WO2024040383A1 (en) * | 2022-08-22 | 2024-02-29 | 广州视源电子科技股份有限公司 | Writing display method, writing response method and apparatus, terminal device, and server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111651079B (en) | 2023-09-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111651079B (en) | Handwriting display method, device, equipment and computer storage medium | |
| CN110597444B (en) | Handwriting display method and device, terminal device and storage medium | |
| KR102307163B1 (en) | Cross-platform rendering engine | |
| US20140082518A1 (en) | Variable Refresh Rates for Portions of Shared Screens | |
| WO2016095728A1 (en) | Multi-window display method and device | |
| US20130057572A1 (en) | Multiple Display Device Taskbars | |
| US20150163281A1 (en) | Moving objects of a remote desktop in unstable network environments | |
| CN103455292A (en) | Business data display and processing method and device and user equipment | |
| US20220391084A1 (en) | Information display method, reader, computer storage medium, ink screen reading device and screen projection display system | |
| US20160378272A1 (en) | Systems and methods for providing multi-focus to applications for collaboration | |
| CN114237482A (en) | Handwriting display processing method, device, system, equipment and storage medium | |
| US7053905B2 (en) | Screen display processing apparatus, screen display processing method and computer program | |
| JP2008269615A (en) | Method and apparatus for displaying mouse pointer simultaneously on a plurality of display screen areas | |
| CN114501108A (en) | A display device and split-screen display method | |
| WO2022087981A1 (en) | Handwriting displaying method and apparatus based on android system, and storage medium | |
| JP2014002436A (en) | Information processing apparatus, information processing method, and information processing program | |
| CN112462989A (en) | Operation method and device of intelligent interaction panel, intelligent interaction panel and medium | |
| CN115639920B (en) | Drawing method, electronic device, and readable storage medium | |
| JP2009116727A (en) | Image input display | |
| CN109960562B (en) | Information display method and device and computer readable storage medium | |
| CN116339900B (en) | Multi-window fusion display method for cross-operating environment | |
| US9483171B1 (en) | Low latency touch input rendering | |
| CN114510159B (en) | Writing trajectory display method, device and storage medium | |
| CN115016671A (en) | Touch display control device, touch display device, device and method | |
| CN114546173A (en) | Electronic whiteboard and writing acceleration method, system and storage medium thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |