TW201917554A - Information display method and apparatus - Google Patents

Abstract

Disclosed in the present application are an information display method and apparatus: acquiring a screenshot of a program interface and displaying a pair of pointers or a cursor; when monitoring an operation executed by the user on the pair of pointers or the cursor, determining the position of each pointer in the pair of pointers or the position of the cursor; for the pair of pointers, further determining the element boundaries corresponding respectively to each pointer, respectively moving each executed pointer to the boundary, and displaying the distance between the pair of pointers; for the cursor, further determining the colour corresponding to the cursor; on the basis of the cursor boundary and the determined colour, determining a character boundary; and thereby determining the character size and displaying same.

Description

Information display method and device

The invention relates to the field of information technology, in particular to a method and device for displaying information.

At present, when measuring the size of elements or characters in the program interface of a mobile terminal, it is usually measured by using a tool for measuring the size. Among them, the element size usually refers to the size of the buttons, windows and other areas designed in the interface, and the character size is usually the size of the text in the interface, as shown in FIG. 1. In the prior art, the size measuring tool in the mobile terminal needs to drag the cursor through the user's finger, and only displays the distance between the cursors. However, the size measurement of elements and characters usually needs to be accurate to the pixel level. It can be seen that a method for accurately displaying the element size and the character size on the mobile terminal is needed. Based on the existing technology, this specification provides a new information display method.

The embodiments of the present specification provide an information display method and device, which are used to solve the problem that it is difficult for the prior art to conveniently and accurately determine the element size and character size of the program interface on the mobile terminal. The following technical solutions are used in the embodiments of this specification: An information display method, which includes: obtaining a screenshot of the program interface of the mobile terminal, displaying at least one pair of cursors, and monitoring the operation of the user; for each pair of cursors, when the user When performing operations on the cursors, determine the positions corresponding to the cursors where the operations are performed; according to the corresponding positions of the cursors, determine the selection range corresponding to the cursors in the screenshot; according to the preset boundary algorithm, In the selection range corresponding to each cursor, determine the boundary of the element in the programming interface; move each cursor to be operated to the boundary of the element determined separately; display the pair of cursors the distance between. An information display method, including: obtaining a screenshot of a program interface of a mobile terminal, displaying at least one cursor, and monitoring a user's operation; when the user is detected to perform an operation on any cursor, determining the position of the cursor being executed; Determine the color at the position in the screenshot; determine the character boundary according to the cursor boundary and the color; determine the size of the character covered by the cursor according to the determined character boundary, And display. An information display device includes: obtaining a display and monitoring module, obtaining a screenshot of a program interface of a mobile terminal, displaying at least a pair of cursors, and monitoring user operations; a first determining module, for each pair of cursors, when a user is monitored When performing an operation on the pair of cursors, determine the positions corresponding to the cursors where the operations are performed; the second determining module, according to the corresponding positions of the cursors, determine the selection range corresponding to the cursors in the screenshot; 3. Determine the module, according to the preset boundary algorithm, determine the boundary of the elements in the programming interface respectively within the selection range corresponding to each cursor; Fourth, determine the module, which will perform the operation Each cursor moves to the boundary of the element respectively determined; the display module displays the distance between the pair of cursors. An information display device includes: obtaining a display and monitoring module, obtaining a screenshot of a program interface of a mobile terminal, displaying at least one cursor, and monitoring a user's operation; a first determining module, when the user is monitored to perform an operation on any cursor , Determine the position of the cursor on which the operation is performed; the second determination module, determine the color at the position in the screenshot; the third determination module, based on the boundary of the cursor and the color, Determine the character boundary; the display module determines the size of the character covered by the cursor according to the determined character boundary and displays it. A mobile terminal includes: one or more processors and memory, and the program is configured to be executed by one or more processors to obtain the following steps: obtain a screenshot of the program interface of the mobile terminal, display at least one pair of cursors, And monitor the operation of the user; for each pair of cursors, when it is detected that the user performs an operation on the pair of cursors, determine the positions of the cursors corresponding to the operations performed; according to the corresponding positions of the cursors, determine in the screenshot The selection range corresponding to each cursor; according to the preset boundary algorithm, within the selection range corresponding to each cursor, respectively determine the boundary of the element in the programming interface; each cursor to be executed Move to the boundary of the element determined separately; display the distance between the pair of cursors. A mobile terminal includes: one or more processors and a memory, and the program is configured to be executed by one or more processors to take the following steps: obtain a screenshot of the program interface of the mobile terminal, display at least one cursor, and Monitor the operation of the user; when it is detected that the user performs an operation on any cursor, determine the location of the cursor being executed; determine the color at the location in the screenshot; according to the boundary and location of the cursor Determine the character boundary according to the color; determine the size of the character covered by the cursor according to the determined character boundary and display it. The above-mentioned at least one technical solution adopted in the embodiments of the present specification can achieve the following beneficial effects: Through the method provided in the present specification, by taking screenshots on the program interface and monitoring user operations on the cursor, the cursor is adsorbed to the determined element boundary , So that it is not necessary to accurately move the cursor line to the element boundary, you can determine the accurately measured element size. Similarly, by determining the boundary of the cursor and the color of the cursor location, the character boundary is determined, and the character size is accurately determined, so that the character size can be obtained by simply covering the character with the cursor. Therefore, on the mobile terminal, even if the user's finger cannot move the cursor or the cursor accurately, the accurate element size and character size are obtained, which makes up for the shortcomings of the prior art that it is difficult to accurately measure the element size and character size on the mobile terminal. Therefore, the size of elements and characters in the program interface can be conveniently and accurately determined on the mobile terminal.

In the prior art, When developing applications on mobile terminals, To enable the application to provide a better user experience, Usually an interactive designer, Visual designers and programmers work together to develop applications.     The process of application development is usually, First, the interactive designer, The interface of the visual designer (hereinafter referred to as the designer for convenience), Design with interactive logic, Determine the design draft of the application (eg, Interface style, Dialogue mode, etc.), Afterwards, the program developers will follow the design draft, Write application.     among them, When program developers write programs based on design drafts, It is necessary to restore the content of the design draft as far as possible visually. but, Because the developers and designers have a certain deviation in the understanding of the design draft, It is often difficult to accurately recreate the visual effects in the design draft. Therefore, designers also need to accept the written application, Determine whether there is content that does not meet the design requirements. If yes, propose amendments to the program developer, Then the program developers modify it, This is repeated until the application meets the design requirements. The above-mentioned acceptance and modification process is usually called visual restoration.     among them, When designers accept the visual effects, Mainly for the color of the program interface, Accept the element size and character size. and, The element is usually a rectangle formed by parallel lines and vertical lines in the programming interface. The size is usually based on pixels (pixel, px) is determined, E.g, Density-independent pixels in the Android system, dp) represents the element size, Scale-independent pixels (Scale-independent Pixels, sp) represents the character size.     But in the prior art, The measurement tool on the mobile terminal generally displays the distance between a pair of cursors, When users need to measure the size of elements or characters, Use your finger to move the cursor to the boundary of the element on the screen, And the distance between the cursors displayed by the size measurement tool, As element or character size. However, due to the low accuracy of human fingers on the screen, It is difficult to guarantee the accuracy of measurement.     Or in the prior art, After the designer takes a screenshot of the application interface, Sent to a personal computer, With a larger screen (eg, (Enlarge the screenshot on the monitor screen), Then accurately measure the size of the element or character. But it will lead to cumbersome operations, Problems such as low measurement efficiency.     therefore, The embodiments of the present specification provide an information display method and device, It is difficult to solve the existing technology, The problem of accurately determining the element size and character size of the program interface on the mobile terminal.     For the purpose of this manual, The technical solutions and advantages are more clear, The technical solutions of the present invention will be clear below with reference to specific embodiments of the specification and corresponding drawings Describe it completely. Obviously, The described embodiments are only a part of the embodiments of the present invention, Not all embodiments. Based on the examples in the specification, All other embodiments obtained by those of ordinary skill in the art without making progressive labor, All belong to the protection scope of the present invention.     The following in conjunction with the drawings, The technical solutions provided by the embodiments of the present invention are described in detail.     FIG. 2 is a process of displaying information provided by an embodiment of the specification, It can include the following steps:     S100: Get a screenshot of the program interface of the mobile terminal, Display at least one pair of cursors, And monitor user operations.     Because the method provided in this specification is used to solve the problem that it is difficult to accurately measure the size of elements and characters in the application program interface on the mobile terminal, So it can be done by the mobile terminal itself or the program installed on the mobile terminal, Perform the information display process provided by the embodiments of this specification.     among them, The mobile terminal can be a mobile phone, Tablets and other devices, This manual does not limit this. And if the information display process is executed through the program installed on the mobile terminal, Then the program may be a program installed in the system of the mobile terminal, And run the program to perform the above information display process. at this time, The program interface of the mobile terminal, It is the programming interface for the size of the element to be measured. The program corresponding to the program interface to be measured is a third-party program. Such as, System program (then, At this time, the program interface is the system interface) or other programs installed in the system program, As shown in Figure 3a.     specific, Whether the information display process is executed through the mobile terminal itself or through the program installed on the mobile terminal, Both need to obtain a screenshot of the program interface to be measured and display at least a pair of cursors, To monitor the user's follow-up operations on the cursor pair. among them, This manual does not limit the shape of the cursor, For the convenience of description, The following description uses the cursor as a line segment as an example. specific, Each pair of cursors can be parallel to each other, And the length of the line segment can be set as needed. E.g, The line segment of the cursor may be a line segment through the floating window, It can also be a line segment with a preset length, As shown in Figure 3b.     3a is a schematic diagram of a program interface to be measured provided by an embodiment of the present specification, FIG. 3b is a schematic diagram of displaying cursor lines and cursors on a program interface provided by an embodiment of the present specification.     further, The cursor can be displayed in a floating window (Float Window). Then the floating window is the interface of the program that executes the information display process, The floating window may be a transparent window. and, The window Z order of the floating window is higher than the window Z order of the program interface. then, When the floating window is displayed, Although the window Z sequence of the floating window is above the program interface, But it will not obscure the contents of the program interface. and, Since the cursor is displayed in the floating window, So when the user operates on the cursor, Do not accidentally touch the elements of the program interface to be measured (eg, button).     In addition, Through the schematic diagram of the program interface shown in Figure 1, The elements visible in the programming interface are usually rectangular. therefore, In order to easily determine the vertical and horizontal lengths of the elements, Two pairs of cursors can be displayed in this manual. among them, A pair of cursors is on a horizontal line segment, Another pair of cursors are vertical line segments, As shown in Figure 3c.     further, In this manual, Get screenshots, There is no order of execution between displaying cursor pairs and monitoring user operations. You can get the screenshot first, Then display the cursor and finally monitor the user's operation, You can also monitor user operations first, Then take a screenshot and finally display the cursor, This manual does not limit this.     specific, When the user input instruction is monitored, The floating window is displayed. E.g, The program corresponding to the floating window can display a floating button after starting, The window Z sequence of the floating button is higher than the window Z sequence of the program interface to be measured. Then after the subsequent program to be measured is started, The program interface will not block the floating button. therefore, When it is detected that the user performs a click operation on the floating button (ie, When monitoring user input command), Display the floating window on the program interface. The above process can be shown in Figures 4a to 4d.     FIG. 4a is a schematic diagram of a system interface of a mobile terminal provided by this specification. among them, APP1 in the system interface is the program corresponding to the floating window, When the user starts the program, a floating button can be displayed. Figure 4b shows the program corresponding to the floating window, A schematic diagram of floating buttons is displayed on the system interface. among them, APP4 in the system interface is the program corresponding to the program interface to be measured, When the user starts APP4, the program interface can be displayed. Figure 4c shows the program corresponding to the program interface to be measured after it is started. A schematic diagram of floating buttons is displayed on the program interface. among them, The window Z order of the floating keys is higher than the window Z order of the program interface, So it will not be blocked by the program interface. When it is detected that the user performs a click operation on the floating button, The floating window can be displayed. Figure 4d is after monitoring that the user performs a click operation on the floating button, Show the schematic diagram of the floating window on the program interface. among them, Two pairs of cursors are displayed in the floating window. and, Since the floating window is a transparent window, So it will not obscure the content in the program interface.     further, In the embodiment of the present specification, a screenshot of the program interface can also be obtained when a user input command is detected. The command to take a screenshot and the command to display a floating window can be the same command, Then when monitoring the user input instruction, Can display floating windows and get screenshots. or, You can also display screenshot buttons in the floating window, When it is detected that the user clicks the screenshot button, Determine user input instructions, And get a screenshot of the program interface.     S102: For each pair of cursors, When it is detected that the user performs an operation on the pair of cursors, Determine the positions corresponding to the cursors where the operations are performed.     In the embodiments of this specification, For each pair of cursors, When it is detected that the user performs an operation on the pair of cursors, The positions corresponding to the cursors of the executed operations can be further determined. For ease of description, In this manual, a cursor in a pair of cursors is used as an example for description.     specific, Since the cursor is usually used for dragging, Therefore, the operation may be a drag operation. Therefore, when the drag operation performed by the user on the cursor is monitored, Determine the position corresponding to the cursor. of course, This manual does not limit what kind of operation this operation is. Can be set as needed. E.g, It can also be monitored when the user clicks on the cursor, When you double-click and so on, Determine the position corresponding to the cursor.     In addition, In this manual, For example, a monitoring user performs a drag operation on a cursor. Since the user is performing a drag operation on the cursor, The position of the cursor may be constantly changing, So you can monitor the end of the drag operation, Then determine the position of the cursor. To reduce the number of times to determine the position of the cursor, Reduce resource consumption.     It should be noted, The position of the cursor determined at this time, It is the position of the cursor on the screen of the mobile terminal. and, Since the screenshot of the obtained program interface is also displayed on the screen of the mobile terminal, So it can also be seen as, The determined position of the cursor is the position of the cursor in the program interface.     S104: According to the position of each cursor, The selection range corresponding to each cursor is determined in the screenshot.     In the embodiments of this specification, Continue to use one cursor in a pair of cursors as an example. After the position corresponding to the cursor is determined in step S102, Further in the screenshots obtained, Determine the selection range corresponding to the location. In other words, Determine the selection range corresponding to the location of each cursor. In order to follow the preset boundary algorithm, Within the determined range of choices, Determine the boundaries of elements in the program interface, To perform the next steps.     specific, Since there are usually multiple elements in the programming interface, And the elements farther away from the cursor, Obviously, the user is less likely to measure the size of the element. In other words, Usually the user will move the cursor near the boundary of the element, To measure element size. therefore, In order to avoid determining the boundary of the wrong element, After determining the position of the cursor, The selection range corresponding to the position can be determined first. and, Regard the boundary of the elements within the selection range as the boundary to be selected, Then, step S106 determines the boundary. among them, The length unit of the selection range can be expressed in dp. Such as, The selection range is within 10dp from the cursor.     among them, The value of this selection range can be set as required, This manual does not limit this. and, When the cursor is a line segment, The length of the line segment can also be set as needed, Such as, As shown in Figure 3b. therefore, The selection range may include a vertical range and / or a horizontal range. E.g, When the cursor is a horizontal line that runs through the screen of the mobile terminal, The selection range may be only the vertical range. When the cursor is a vertical line that runs through the screen of the mobile terminal, The selection range may be only the horizontal range. When the cursor is a line segment with a length of 10dp, The selection range may include both vertical and horizontal ranges.     S106: According to the preset boundary algorithm, Within the selection range corresponding to each cursor, Determine the boundaries of the elements in the programming interface, respectively.     In the embodiments of this specification, When the selection range corresponding to the cursor is determined, You can continue to use the preset boundary algorithm, Determine the boundary of the element.     specific, In this specification, the first method for determining the boundary of an element is provided. First of all, According to the preset boundary algorithm, Determine the boundary of each element in the program interface. after that, Then determine the boundary within the selection range corresponding to the cursor. At last, Then from the boundaries within the selection range, Select the border closest to the cursor. among them, The preset boundary algorithm may be the Sobel edge detection algorithm, Roberts operands, etc., This manual does not limit this.     In addition, In the second method for determining the boundary of an element provided in this specification, The cursor can be a line segment. First of all, Can determine the position of the cursor, The colors displayed in the program interface, As the base color. after that, Within this selection range, Make sure the line segment parallel to the cursor, At least one line segment that exceeds the preset length and the color is different from the basic color. At last, From the determined line segments, Select the line segment closest to the cursor as the determined boundary. The preset length can be set as needed, This manual does not limit this.     E.g, Assume that the cursor is a horizontal line that runs through the screen. First of all, The basic color corresponding to the cursor can be determined first. Then use the line segment where the cursor is located as the starting point, Up or down, Line by line determines the line segment whose length exceeds the preset length and is not the base color. At last, The line segment with the smallest vertical distance from the line segment is used as the boundary.     It should be noted, For the elements in the programming interface, The element boundary can be regarded as the above-mentioned line segment in this specification. E.g, Assume that the 10 × 10 color block shown in FIG. 5 is an element in the programming interface. Then the boundary of the 1 × 10 color block enclosed by the dotted frame is the line segment of the specification. In other words, if the color blocks are all within the selection range corresponding to a cursor, The color patch can be determined as 10 line segments.     S108: Move each cursor on which the operation is performed to the boundary of the element determined separately.     S110: Displays the distance between the pair of cursors.     In the embodiments of this specification, Take a cursor in a pair of cursors as an example, When the boundary corresponding to the cursor is determined, You can move the cursor line to the determined boundary. Then for each pair of cursors being operated on, Each cursor in the pair of cursors can determine the boundary of the corresponding element through the above steps S102 to S106. Then through step S108, Each cursor in the pair of cursors can move to its corresponding element boundary. Then when displaying the distance between the pair of cursors at this time, Since the cursor has moved to the boundary of the element, So the display distance is accurate.     specific, In step S102, for each pair of cursors, Users can usually only perform operations on the cursors of the pair of cursors. So when displaying the distance between the cursor pair in step S110, One of the cursors in the pair moves to the boundary of the element, The other cursor line does not move to the boundary of the element. Then at this time, The distance between the cursor pair can also be displayed, But the displayed distance is not the size of the element (as shown in Figures 6a and 6b). And after the user performs an operation on another cursor, Repeat the above steps, Then another cursor can also move to the determined element boundary. Thus, the distance between the displayed cursor pairs is the exact element size (eg, 6c and 6d). among them, The above distance can be displayed in units of dp.     Through the above information display process, It can be seen that there is no need to accurately move the cursor to the element boundary. By determining the selection range corresponding to the cursor, Then determine the boundary of the element. Then move the cursor to the determined boundary, Thereby determining the accurately measured element size. Solve the problem that the size of the element cannot be accurately measured on the mobile terminal.     In addition, In this manual, It is not necessary to obtain the screenshot in step S100, Instead, a screenshot is obtained in step S102 of this specification. specific, You can monitor the user to perform operations on the cursor, The user input instructions as monitored. then, When it is detected that the user performs a drag operation on the cursor, Get a screenshot of the program interface.     further, Due to the low accuracy of the user ’s finger operation, Therefore, after dragging the cursor multiple times, Only move the cursor near the boundary of the element to be measured. Then every time the user is monitored to perform an operation on the cursor, Taking a screenshot once may result in too many screenshots. Caching of the terminal causes greater storage pressure. And further cause the terminal to implement a garbage collection mechanism (Garbage Collection, GC) increased.     therefore, In this manual, in order to reduce the cache pressure and reduce the number of GCs, When it is detected that the user performs a drag operation on the cursor, You can first determine whether a screenshot has been saved within a preset time period, if, Then call the stored screenshot, If not, Then perform a screenshot operation on the program interface, Take a screenshot and save it. among them, The screenshot obtained after the screenshot operation is performed on the program interface can be stored in the cache of the mobile terminal.     specific, The preset time period corresponds to the preset duration, The duration can be set as required. When it is detected that the user performs a drag operation, Back to the preset duration, Determine the preset time period. Then perform the steps of subsequent judgment. In other words, When the mobile terminal performs a screenshot operation on the program interface, After saving the screenshot. No matter how many times the user performs drag operation within the preset time, All screenshots stored in the cache can be used. Without having to monitor the drag operation every time, All perform screenshot operations on the program interface.     go a step further, In the program interface, Elements may not display element boundaries when displayed. E.g, The elements are patterns drawn on a transparent background. Then through the existing method of determining the boundary, Only the boundaries of the pattern can be determined. then, In order to facilitate the determination of element boundaries, Before taking a screenshot of the program interface, You can also start the existing interface layout boundary display tool, To show the boundaries of elements in the program interface.     E.g, It is assumed that FIG. 7a is a case where each element does not display the boundary of the element. After starting the interface layout display tool, Element boundaries as shown in Figure 7b can be displayed. It should be noted, The program corresponding to the program interface, The program that executes the information display process and the interface layout boundary display tool can be three different independent programs.     It should be noted, The execution body of each step of the method provided in the embodiment of the present invention may be the same device, or, This method is also performed by different devices. E.g, The execution subject of steps S102 and S104 may be the device 1, The execution subject of step S106 and step S108 may be device 2; Another example, The execution subject of steps S102 and S106 may be the device 2, The execution subject of steps S104 and S108 may be the device 1; and many more. The foregoing describes specific embodiments of the present specification. Other embodiments are within the scope of the attached patent application. In some cases, The actions or steps described in the scope of the patent application may be performed in a different order than in the embodiment and still achieve the desired result. In addition, The processes depicted in the drawings do not necessarily require the particular order shown or sequential order to achieve the desired results. In some embodiments, Multiplexing and parallel processing are also possible or may be advantageous.     Based on the information display method shown in Figure 2, Embodiments of this specification also provide an information display method, As shown in Figure 8.     FIG. 8 is an information display process provided by an embodiment of this specification, It can include the following steps:     S200: Get a screenshot of the program interface of the mobile terminal, Display at least one cursor, And monitor user operations.     S202: When it is detected that the user performs an operation on any cursor, Determine the position of the cursor where the operation was performed.     In the embodiments of this specification, The information display process is used to display the size of characters in the mobile terminal. Similar to the information display process shown in Figure 2, The information display process can be executed by the mobile terminal itself or the installed program.     specific, Since the size of characters in the programming interface is usually smaller than the size of elements, Therefore, there are difficulties in measuring characters through the cursor. Therefore, in this manual, When measuring the character size, At least one cursor can be displayed. And display the character size of the character covered by the cursor through the subsequent steps. among them, In the embodiments of this specification, The shape of the cursor may be rectangular. The size of the cursor can be set as needed.     In addition, For other operations in the step, refer to the description in step S100 and step S102, This manual will not repeat them here.     S204: The color at the location is determined in the screenshot.     S206: According to the border of the cursor and the color, Determine character boundaries.     In the embodiments of this specification, After determining the position of the cursor, Also in the screenshots obtained, Determine the color at that location. Then, based on the boundary of the cursor and the determined color, Determine the character boundaries.     specific, In the embodiments of this specification, The cursor can partially cover the character to be measured, Then, in step S204, when the color at the position of the cursor is determined, The color of the characters and the background color can be determined. And in the subsequent step S206, According to the color of the determined character, The determined background color and cursor boundary, Determine the boundary of the characters covered by the cursor.     and, Since the size of a character can only be determined by the height of the character or the width of the character, So when determining the boundaries of characters, The upper and lower boundaries of the cursor and / or the left and right boundaries of the cursor can be determined first. of course, Since the height of the character is usually used as the size of the character in the prior art, So in this manual, determine the height of the cursor as an example for subsequent description.      First of all, Determine the upper and lower boundaries of the cursor. after that, According to the color determined in step S204, Further determine the color corresponding to the upper border of the cursor, And the color corresponding to the lower border of the cursor. among them, The color corresponding to the upper boundary of the cursor includes the color of the character and the background color corresponding to the upper boundary, The color corresponding to the lower boundary of the cursor includes the color of the character and the background color corresponding to the lower boundary. then, Determine the rows of pixels between the extension lines of the left and right borders of the cursor, Using the cursor's upper boundary as the starting line, move up, From the determined rows of pixels, Select a row of pixels that are not exactly the same color as the pixels in the next row, As the upper boundary of the character. Similarly, For the lower boundary of the cursor, Use the same method to determine the lower boundary of the character boundary. When determining the upper and lower boundaries of the character boundary, Take the distance between the upper and lower boundaries as the height of the character boundary.     For example, the process of determining the upper and lower boundaries of the character boundary shown in FIG. 9. In Figure 9, The cursor is overlaid on the "person" character, The color of the cursor position can be determined as black and white. In step S206, You can start from the upper and lower boundaries of the cursor, Determine whether there is a color that is not exactly the same as the position of the cursor line by line, When judging a line other than the character "人", There is only white in this row, Then the boundary of the character in the previous line that has been judged can be determined, Thereby determining the upper and lower boundaries of the character boundary. Furthermore, the distance between the upper and lower boundaries is taken as the height of the character boundary.     Similarly, In the embodiments of this specification, The columns of pixels between the extension lines of the upper and lower boundaries of the cursor can also be determined. And starting from the left border of the cursor to the left, From the determined columns of pixels, Select a column of pixels that is not exactly the same color as the next column of pixels, As the left border of the character. Using the right border of the cursor as the starting column, turn to the right, From the determined columns of pixels, Select a column of pixels that is not exactly the same color as the next column of pixels, As the right border of the character. Let the distance between the left and right boundaries of the character boundary be the width of the character boundary.     S208: According to the determined character boundary, Determine the size of the characters covered by the cursor, And display.     In the embodiments of this specification, Due to different mobile terminal screen sizes, Pixel density, etc. are not exactly the same, So the character size usually set, And the actual character size displayed in the program interface (e.g., The height of the character boundary or the width of the character boundary cannot be consistent. E.g, The character size set by the program developer is 12px, However, the character size displayed in the program interface is 10px. therefore, The height or width of the character boundary does not accurately determine the character size from time to time.     then, In this manual, According to the fitting formula obtained in advance, Determine the character size corresponding to the character boundary, And display.     specific, The mobile terminal itself or the program that executes the information display process, Send the device information of the mobile terminal to the server in advance (eg, Device model, Screen size, Pixel density, etc.), After that, the fitting formula corresponding to the device information returned by the server is received and stored. Then after determining the height or width of the character boundary, You can enter the height or width into the fitting formula, So as to get the corresponding character size.     among them, The server can pre-determine the corresponding fitting formulas of different equipment information, When receiving device information, Determine the corresponding fitting formula and return. E.g, The server can target each type of mobile terminal, Collect the character size set in the mobile terminal, And its corresponding actual display character size, Commonly control the sample. Determine the fitting curve of the set character size and the actual displayed character size by least square method, Get the fitting formula corresponding to the fitting curve, As shown in Figure 10.     Through the fitting formula corresponding to the fitting curve shown in Figure 10, The mobile terminal can determine the distance from the upper and lower boundaries of the character (ie, The character size actually displayed corresponds to the character size (ie, Set the character size).     Through the information display process shown in Figure 8, It can be seen that only the cursor needs to be covered on the character to be measured, You can get the exact character size. Solve the problem that it is difficult to measure the character size on the mobile terminal.     In addition, In the embodiments of this specification, The character size needs to be determined by covering the character with the cursor. but, There may be larger characters or smaller characters in the program interface. Therefore, a cursor of a single size may be inconvenient for measuring the size of characters. therefore, Multiple cursors can be displayed in step S200, And the size of each cursor may not be the same, To meet the measurement needs of characters of different sizes.     further, In the embodiments of this specification, The information display methods shown in FIG. 2 and FIG. 8 can coexist. So in this manual, The element size can be displayed in the middle of each pair of cursors, Character size can be displayed next to the cursor, Such as, As shown in Figure 11. of course, The specific how the distance and size are displayed in this manual is not limited.     Based on the information display method shown in Figure 2, An embodiment of this specification also provides an information display device, As shown in Figure 12.     12 is a schematic structural diagram of an information display device provided by an embodiment of the present specification, include:     Obtain display and monitoring module 300, Get a screenshot of the program interface of the mobile terminal, Display at least one pair of cursors, And monitor the user's operation;     The first determining module 302, For each pair of cursors, When it is detected that the user performs an operation on the pair of cursors, Determine the positions corresponding to the cursors where the operations are performed;     Second determination module 304, According to the position of each cursor, Determine the selection range corresponding to each cursor in the screenshot;     The third determination module 306, According to the preset boundary algorithm, Within the selection range corresponding to each cursor, Determine the boundaries of the elements in the programming interface respectively;     The fourth determination module 308, Move each cursor on which the operation is performed to the boundary of the element determined separately;     Display module 310, Displays the distance between the pair of cursors.     Obtain display and monitoring module 300, Show floating window, Displaying at least one pair of cursors in the floating window, among them, The floating window is a transparent window, The floating window is displayed on the upper layer of the programming interface.     Obtain display and monitoring module 300, Displaying two pairs of cursors on the screen of the mobile terminal, among them, A pair of cursors is on a horizontal line segment, The other pair of cursors are vertical line segments.     Obtain display and monitoring module 300, When the user input instruction is monitored, Display the floating window and / or obtain a screenshot of the program interface.     The third determination module 306, For each cursor in the pair of cursors, Determine the color of the program interface displayed on the position of the cursor, As the basic color, Within the selection range corresponding to the cursor, Determine that the line segment parallel to the cursor, A line segment that exceeds a preset length and has a color different from the basic color, As the determined boundary.     The third determination module 306, Within the selection range corresponding to the cursor, Determine that the line segment parallel to the cursor, At least one line segment exceeding a preset length and having a color different from the basic color, From at least one line segment determined, Select the line segment closest to the cursor, As the determined boundary.     Obtain display and monitoring module 300, Before taking a screenshot of the program interface on the mobile terminal, Start the interface layout display tool, Displays the boundaries of the elements in the programming interface.     Based on the information display method shown in Figure 8, An embodiment of this specification also provides an information display device, As shown in Figure 13.     13 is a schematic structural diagram of an information display device provided by an embodiment of the present specification, include:     Obtain the display and monitoring module 400, Get a screenshot of the program interface of the mobile terminal, Display at least one cursor, And monitor the user's operation;     The first determination module 402, When it is detected that the user performs an operation on any cursor, Determine the position of the cursor on which the operation is performed;     Second determination module 404, Determine the color at the location in the screenshot;     The third determining module 406, According to the border of the cursor and the color, Determine character boundaries;     Display module 408, According to the determined character boundary, Determine the size of the characters covered by the cursor, And display.     The shape of the cursor is rectangular;     The third determining module 406, Determine the upper and lower boundaries of the cursor and / or the left and right boundaries of the cursor, According to the color, Determining in the screenshot the colors corresponding to the upper and lower boundaries of the cursor and / or the colors corresponding to the left and right boundaries of the cursor According to the colors corresponding to the upper and lower boundaries of the cursor, Determine the height of the character boundary, And / or colors corresponding to the left and right borders of the cursor, Determine the width of the character boundary.     The third determining module 406, Determine each row of pixels between the extension lines of the left and right borders of the cursor, Using the upper boundary of the cursor as the starting line, go up in sequence, From the determined rows of pixels, Select a row of pixels that are not exactly the same color as the pixels in the next row, As the upper boundary of the character, Taking the lower boundary of the cursor as the starting line and going down, From the determined rows of pixels, Select a row of pixels that are not exactly the same color as the pixels in the next row, As the lower boundary of the character, The distance between the upper and lower boundaries of the character boundary is taken as the height of the character boundary.     The third determining module 406, Determine the columns of pixels between the extension lines of the upper and lower boundaries of the cursor, Using the left border of the cursor as the starting column, turn left From the determined columns of pixels, Select a column of pixels that is not exactly the same color as the next column of pixels, As the left boundary of the character, Using the right border of the cursor as the starting column, turn to the right, From the determined columns of pixels, Select a column of pixels that is not exactly the same color as the next column of pixels, As the right boundary of the character, The distance between the left and right boundaries of the character boundary is taken as the width of the character boundary.     Display module 408, According to the fitting formula obtained in advance, Determining the size corresponding to the height of the character boundary and / or determining the size corresponding to the width of the character boundary.     Display module 408, Send the device information of the mobile terminal to the server in advance, The fitting formula corresponding to the device information returned by the server is received and stored.     Based on the information display method shown in Figure 2, The embodiments of this specification also provide another mobile terminal, As shown in Figure 14.     14 is a schematic structural diagram of a terminal according to an embodiment of the present specification, The terminal, include: One or more processors and memory, The program is configured to perform the following steps by one or more processors:     Obtain a screenshot of the program interface of the mobile terminal, Display at least one pair of cursors, And monitor the user's operation;     For each pair of cursors, When it is detected that the user performs an operation on the pair of cursors, Determine the positions corresponding to the cursors where the operations are performed;     According to the position of each cursor, Determine the selection range corresponding to each cursor in the screenshot;     According to the preset boundary algorithm, Within the selection range corresponding to each cursor, Determine the boundaries of the elements in the programming interface respectively;     Move each cursor on which the operation is performed to the boundary of the element determined separately;     Displays the distance between the pair of cursors.     Based on the information display method shown in Figure 8, The embodiments of this specification also provide another mobile terminal, As shown in Figure 15.     15 is a schematic structural diagram of a terminal according to an embodiment of the present specification, The terminal, include: One or more processors and memory, The program is configured to perform the following steps by one or more processors:     Obtain a screenshot of the program interface of the mobile terminal, Display at least one cursor, And monitor the user's operation;     When it is detected that the user performs an operation on any cursor, Determine the position of the cursor on which the operation is performed;     Determine the color at the location in the screenshot;     According to the border of the cursor and the color, Determine character boundaries;     According to the determined character boundary, Determine the size of the characters covered by the cursor, And display.     It should be noted, Each embodiment in this specification is described in a progressive manner, The same or similar parts between the various embodiments may refer to each other, Each embodiment focuses on the differences from other embodiments. especially, For the mobile terminal and the server provided by the embodiments of the present invention, Since it is basically similar to the method embodiment, So the description is relatively simple, For the relevant parts, please refer to the description of the method embodiments.     In the 1990s, Improvements in a technology can be clearly distinguished as improvements in hardware (for example, For diodes, Transistor, The improvement of circuit structures such as switches) is also an improvement in software (improvement of method flow). however, with the development of technology, Many of today's method and process improvements can already be regarded as direct improvements in the hardware circuit structure. Designers almost get the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. therefore, It can't be said that the improvement of a method and process cannot be realized by hardware physical modules. E.g, Programmable Logic Device (Programmable Logic Device,  PLD) (such as Field Programmable Gate Array, FPGA)) is such an integrated circuit, Its logical function is determined by the user programming the device. Designed by the designer to "integrate" a digital system on a PLD, There is no need to ask chip manufacturers to design and manufacture special integrated circuit chips. and, now, Instead of manually making integrated circuit chips, This kind of programming is also mostly implemented with "logic compiler" software. It is similar to the software compiler used in the development of the program, And the original code to be compiled must also be written in a specific programming language, This is called the hardware description language (Hardware Description Language, HDL), And HDL is not the only one, But there are many kinds, Such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc., Currently the most commonly used are VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should also be clear, Only need to use the above hardware description languages for logic programming and programming into integrated circuits. It is easy to get the hardware circuit that implements this logic method flow.     The controller can be implemented in any suitable way, E.g, The controller may be, for example, a microprocessor or processor and a computer-readable medium storing computer-readable program code (such as software or firmware) executable by the (micro) processor, Logic gate, switch, Application Specific Integrated Circuit (Application Specific Integrated Circuit, ASIC), Programmable logic controllers and embedded microcontrollers, Examples of controllers include but are not limited to the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320, The memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art also know that In addition to implementing the controller in pure computer readable code, It is entirely possible to program the method steps by logic programming to make the controller switch, Dedicated integrated circuit, Logic controllers and embedded microcontrollers can be programmed to achieve the same function. So this controller can be considered as a hardware component, The devices included therein for realizing various functions can also be regarded as structures within the hardware components. Or even, The device for realizing various functions can be regarded as both a software module of an implementation method and a structure in a hardware component.     The system illustrated in the above embodiment, Device, Module or unit, It can be realized by computer chip or entity, Or it can be realized by a product with a certain function. A typical implementation device is a computer. specific, The computer can be, for example, a personal computer, Laptop, Cellular phone, Camera phone, Smart phone, Personal digital assistant, Media player, Navigation equipment, Email equipment, Game console, tablet, Wearable devices or any combination of these devices.     For the convenience of description, When describing the above devices, the functions are divided into various units and described separately. of course, When implementing the present invention, the functions of each unit can be implemented in one or more software and / or hardware.     Those skilled in the art should understand that Embodiments of the present invention can be provided as methods, system, Or computer program products. therefore, The present invention can use a complete hardware embodiment, Complete software embodiment, Or a combination of software and hardware. and, The present invention may use one or more computer-usable storage media (including but not limited to disk memory, CD-ROM, The form of computer program products implemented on optical memory, etc.).     The present invention refers to the method according to the embodiment of the present invention, Equipment (system), It is described by the flow chart and / or block diagram of the computer program product. It should be understood that each flow and / or block in the flowchart and / or block diagram can be implemented by computer program instructions, And a combination of processes and / or blocks in flowcharts and / or block diagrams. These computer program instructions can be provided to general-purpose computers, Dedicated computer, Embedded processor or other programmable data processing equipment processor to produce a machine, A device that causes instructions executed by a processor of a computer or other programmable data processing device to generate functions specified in a block or blocks of a flowchart or a flow and / or a block diagram.     These computer program instructions can also be stored in computer readable memory that can guide the computer or other programmable data processing equipment to work in a specific way. Causing instructions stored in the computer-readable memory to produce a manufactured product including an instruction device, The instruction device implements the functions specified in one block or multiple blocks in one flow or multiple processes in the flowchart and / or one block in the block diagram.     These computer program instructions can also be loaded onto a computer or other programmable data processing equipment, Allows a series of operating steps to be performed on a computer or other programmable device to produce computer-implemented processing The instructions executed on the computer or other programmable equipment thus provide steps for implementing the functions specified in one block or multiple blocks of one flow or multiple flows in the flowchart and / or one block or multiple block diagrams.     In a typical configuration, The computing device includes one or more processors (CPU), Input / output interface, Network interface and memory.     Memory may include non-permanent memory in computer-readable media, Random access memory (RAM) and / or non-volatile memory, etc., Such as read only memory (ROM) or flash memory (flash RAM). Memory is an example of computer-readable media.     Computer-readable media includes permanent and non-permanent, Removable and non-removable media can be stored by any method or technology. Information can be computer readable instructions, Data structure, Program modules or other data. Examples of computer storage media include, But not limited to phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), Other types of random access memory (RAM), Read only memory (ROM), Electrically erasable and programmable read-only memory (EEPROM), Flash memory or other memory technology, CD-ROM, CD-ROM, Digital Versatile Disc (DVD) or other optical storage, Magnetic cassette tape, Magnetic tape storage or other magnetic storage devices or any other non-transmission media, It can be used to store information that can be accessed by computing devices. According to the definition in this article, Computer-readable media does not include temporary computer-readable media (transitory media), Such as modulated data signals and carrier waves.     It should also be noted that The term "including", "Contains" or any other variation thereof is intended to cover non-exclusive inclusions, So that the process including a series of elements, method, Goods or equipment includes not only those elements, And also includes other elements that are not explicitly listed, Or is it also included for this process, method, Elements inherent in goods or equipment. Without more restrictions, Elements defined by the sentence "include a ...", Does not exclude the process of including the elements, method, There are other identical elements in goods or equipment.     Those skilled in the art should understand that Embodiments of the present invention can be provided as methods, System or computer program products. therefore, The present invention can use a complete hardware embodiment, A complete software embodiment or a form of embodiment combining software and hardware. and, The present invention may use one or more computer-usable storage media (including but not limited to disk memory, CD-ROM, The form of computer program products implemented on optical memory, etc.).     The invention can be described in the general context of computer executable instructions executed by a computer, For example, program modules. normally, Program modules include routines that perform specific tasks or implement specific abstract data types, Program, object, element, Data structure, etc. The invention can also be practiced in a distributed computing environment, In these distributed computing environments, The tasks are performed by remote processing equipment connected through the communication network. In a distributed computing environment, Program modules can be located in local and remote computer storage media including storage devices.     Each embodiment in this specification is described in a progressive manner, The same or similar parts between the various embodiments may refer to each other, Each embodiment focuses on the differences from other embodiments. especially, For the system embodiment, Since it is basically similar to the method embodiment, So the description is relatively simple, For the relevant parts, please refer to the description of the method embodiments.     The above is only an embodiment of the present invention, It is not intended to limit the invention. For those skilled in the art, The present invention can have various modifications and changes. Any modification made within the spirit and principle of the present invention, Equivalent replacement, Improvement, etc., All should be included in the scope of the patent application of the present invention.

S100-S110‧‧‧Step

S200-S208‧‧‧Step

300‧‧‧ Get display and monitoring module

302‧‧‧ First confirmation module

304‧‧‧ second confirmation module

306‧‧‧ third confirmation module

308‧‧‧The fourth module

310‧‧‧Display module

400‧‧‧Get display and monitoring module

402‧‧‧ First confirmation module

404‧‧‧ second confirmation module

406‧‧‧ third confirmation module

408‧‧‧Display module

The drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present invention. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an undue limitation on the present invention. In the drawings: FIG. 1 is a schematic diagram of the element size and character size of an existing programming interface; FIG. 2 is a process of displaying information provided by an embodiment of the specification; FIG. 3a is a schematic diagram of the programming interface provided by an embodiment of the specification; 3b is a schematic diagram showing different cursor pairs in a program interface provided by an embodiment of the specification; FIG. 3c is a schematic diagram showing cursor pairs in another program interface provided by an embodiment of the specification; FIGS. 4a to 4d are provided by an embodiment of the specification A schematic diagram of a process of displaying cursor lines and cursors in a floating window; FIG. 5 is a schematic diagram of line segments provided by embodiments of the specification; FIGS. 6a to 6d are schematic diagrams of processes for accurately determining the size of elements provided by the embodiments of the specification; FIGS. 7a and 7b are A schematic diagram of a process of displaying a boundary of an element provided by an embodiment of the specification; FIG. 8 is another process of displaying information provided by an embodiment of the specification; FIG. 9 is a schematic diagram of determining a boundary of a character provided by an embodiment of the specification. FIG. 10 is an embodiment of the specification Provide a schematic diagram of the fitting curve; Figure 11 A schematic diagram of the display element size and the character size provided by the embodiment of the Mingshu; FIG. 12 is a schematic structural diagram of an information display device provided by the embodiment of the specification; FIG. 13 is a schematic structural diagram of another information display device provided by the embodiment of the specification FIG. 14 is a schematic structural diagram of a mobile terminal provided by an embodiment of the specification; FIG. 15 is a schematic structural diagram of another mobile terminal provided by an embodiment of the specification.

Claims (18)

A method for displaying information, including: Obtain a screenshot of the program interface of the mobile terminal, display at least one pair of cursors, and monitor the user's operation; For each pair of cursors, when it is detected that the user performs operations on the pair of cursors, determine the location The corresponding positions of the cursors in the above operations; According to the corresponding positions of the cursors, determine the selection range corresponding to each cursor in the screenshot; According to the preset boundary algorithm, within the selection range corresponding to each cursor , Respectively determine the boundary of the elements in the programming interface; Move each cursor to be executed to the boundary of the element respectively determined; Display the distance between the pair of cursors. According to the method described in item 1 of the patent application scope, displaying at least a pair of cursors includes: displaying a floating window; displaying at least a pair of cursors in the floating window, wherein the floating window is a transparent window, and the floating The window is displayed on the upper layer of the program interface. According to the method described in item 1 of the patent application scope, displaying at least one pair of cursors includes: displaying two pairs of cursors on the screen of the mobile terminal, where one pair of cursors is on a horizontal line segment and the other pair of cursors is Vertical line segment. According to the method described in item 2 of the patent application scope, displaying a floating window on the program interface includes: When a user input command is detected, displaying the floating window and / or obtaining a screenshot of the program interface. According to the method described in Item 3 of the patent application scope, the boundary of the element in the programming interface is determined within the selection range corresponding to the pair of cursors respectively according to a preset boundary algorithm, which specifically includes: for the pair of cursors For each cursor in, determine the color of the program interface displayed on the cursor's position as the basic color; Within the selection range corresponding to the cursor, determine the line segment parallel to the cursor, exceeding the preset length and color The line segment different from the basic color is used as the determined boundary. According to the method described in item 5 of the patent application scope, within the selection range corresponding to the cursor, a line segment parallel to the line segment of the cursor, exceeding a preset length, and having a color different from the basic color is determined The specified boundary includes: Within the selection range corresponding to the cursor, determine at least one line segment parallel to the line segment of the cursor, exceeding a preset length, and having a color different from the basic color; From the determined at least one line segment Among the line segments, the line segment closest to the cursor is selected as the determined boundary. As in the method described in item 1 of the patent application scope, before obtaining a screenshot of the program interface on the mobile terminal, the method further includes: Starting the interface layout boundary display tool to display the boundary of each element in the program interface. An information display method including: Obtaining a screenshot of the program interface of the mobile terminal, displaying at least one cursor, and monitoring the user's operation; When the user is detected to perform an operation on any cursor, determining the location of the cursor being executed; Determine the color at the position in the screenshot; determine the character boundary according to the cursor boundary and the color; determine the size of the character covered by the cursor according to the determined character boundary, And display. According to the method described in item 8 of the patent application scope, the shape of the cursor is rectangular; Determine the character boundary according to the boundary of the cursor and the color, specifically including: Determine the upper and lower boundaries of the cursor and / Or the left and right borders of the cursor; According to the color, determine the colors corresponding to the upper and lower borders of the cursor and / or the colors corresponding to the left and right borders of the cursor in the screenshot; according to the upper and lower borders of the cursor The colors corresponding to each determine the height of the character boundary, and / or the width of the character boundary according to the colors corresponding to the left and right boundaries of the cursor, respectively. According to the method described in item 9 of the patent application scope, determining the height of the character boundary according to the colors corresponding to the upper and lower boundaries of the cursor respectively includes: Determine the lines between the extension lines of the left and right boundaries of the cursor Pixels; using the upper boundary of the cursor as the starting line in turn upwards, from the determined rows of pixels, select a row of pixels that are not exactly the same color as the pixels of the next row as the upper boundary of the character; The lower boundary of the cursor is the starting line in turn, and from the determined pixels of each line, select a line of pixels that is not exactly the same color as the pixel of the next line as the lower boundary of the character; The distance between the upper and lower boundaries serves as the height of the character boundary. According to the method described in item 9 of the patent application scope, determining the width of the character boundary according to the colors corresponding to the left and right boundaries of the cursor respectively includes: Determining each of the extension lines between the upper and lower boundaries of the cursor Column pixels; using the left border of the cursor as the starting column to the left, and from the determined columns of pixels, select a column of pixels that are not exactly the same color as the next column of pixels as the left border of the character; Using the right border of the cursor as the starting column, turn to the right, and from the determined columns of pixels, select a column of pixels that is not exactly the same color as the next column of pixels as the right border of the character; The distance between the left and right boundaries of the character boundary serves as the width of the character boundary. According to the method described in item 9 of the patent application scope, the size of the character is determined according to the determined character boundary, which specifically includes: According to the pre-obtained fitting formula, determine the height of the character boundary corresponding to The size and / or the size corresponding to the width of the character boundary. According to the method described in item 12 of the patent application scope, obtaining the fitting formula in advance includes: sending the device information of the mobile terminal to the server in advance; receiving the fitting returned by the server corresponding to the device information Formula and save. According to the method described in item 9 of the patent application scope, there are multiple cursors, and the sizes of the cursors are not completely the same. An information display device includes: Obtaining a display and monitoring module, obtaining a screenshot of the program interface of a mobile terminal, displaying at least a pair of cursors, and monitoring user operations; The first determining module, for each pair of cursors, when a user is detected When performing operations on the pair of cursors, determine the positions corresponding to the cursors where the operations are performed; The second determination module, based on the corresponding positions of the cursors, determine the selection range corresponding to the cursors in the screenshot; 第Three determination modules, according to the preset boundary algorithm, within the selection range corresponding to each cursor, respectively determine the boundary of the elements in the program interface; The fourth determination module, the operation will be performed Each cursor moves to the boundary of the element respectively determined; display module, which displays the distance between the pair of cursors. An information display device includes: acquisition display and monitoring module, obtaining screenshots of the program interface of the mobile terminal, displaying at least one cursor, and monitoring user's operation; first determining module, when the user is detected to perform operations on any cursor Determine the position of the cursor on which the operation is performed; the second determination module, determine the color at the position in the screenshot; third determination module, based on the boundary of the cursor and the color, Determine the character boundary; display module, according to the determined character boundary, determine the size of the character covered by the cursor, and display. A mobile terminal includes: one or more processors and a memory, and the program is configured to be executed by one or more processors to perform the following steps: Take a screenshot of the program interface of the mobile terminal, display at least a pair of cursors, And monitor the operation of the user; for each pair of cursors, when it is detected that the user performs an operation on the pair of cursors, determine the positions of the cursors corresponding to the operations performed; The selection range corresponding to each cursor; According to the preset boundary algorithm, within the selection range corresponding to each cursor, respectively determine the boundaries of the elements in the program interface; The cursors to be executed Move to the boundaries of the elements determined separately; displays the distance between the pair of cursors. A mobile terminal includes: one or more processors and a memory, and the program is configured to be executed by one or more processors to: take a screenshot of the program interface of the mobile terminal, display at least one cursor, and Monitor the user's operation; When it is detected that the user performs an operation on any cursor, determine the location of the cursor being executed; Determine the color at the location in the screenshot; According to the boundary and location of the cursor According to the color, determine the character boundary; According to the determined character boundary, determine the size of the character covered by the cursor and display it.