CN104516632B - Determine and touch the method and device that character scans for - Google Patents

Abstract

The invention discloses a method and device for searching by determining touch characters, and relates to the field of search technology. The invention receives a user's touch operation on the mask, and according to the touch operation on the mask Select the interface area to be searched; identify the character set contained in the interface area to be searched, and obtain the attributes of one or more user interface UI components in the current interface display area of the terminal, based on the character set and the UI component The matching relationship of attributes determines the touch characters, and searches according to the touch characters, which not only omits the cumbersome process of the user inputting keywords into the search box, makes the search more convenient, but also avoids the problem of inaccurate touch characters, improving user experience.

Description

Method and device for determining touch characters to search

technical field

The invention relates to the field of search technology, in particular to a method and device for determining touch characters to search.

Background technique

The search service on the terminal (for example: smartphone) is based on the input of the search box. The user needs to input keywords into the search box cumbersomely, so that the search engine can display the search results related to the keyword on the terminal display interface. , but the efficiency of this search method is very low, and the search experience is very poor.

Especially in the process of using the terminal, when the user has an immediate search demand for the characters on the terminal display interface, he needs to open the search application first, and then enter the keyword in the search box after the application pops up the search box. Very inconvenient.

Contents of the invention

In view of the above problems, the present invention is proposed to provide a method for determining a touch character for searching and a corresponding device for determining a touch character for searching, which overcome the above problems or at least partially solve the above problems.

According to one aspect of the present invention, a method for determining a touch character to search is provided, the method comprising:

When the user triggers an interface touch search request, a mask covering the terminal interface display area is generated in the current interface display area of the terminal;

receiving a user's touch operation on the mask, and selecting an interface area to be searched on the mask according to the touch operation;

Identify the character set contained in the interface area to be searched, and obtain the attributes of one or more user interface UI components in the current interface display area of the terminal, and determine based on the matching relationship between the character set and the attributes of the UI components Touch the character and search based on the touched character.

Optionally, the attributes of the UI component include: text content of the UI component.

Optionally, the determining the touch character based on the matching relationship between the character set and the attribute of the UI component further includes:

Traversing the UI component, comparing the character set with the text content of the UI component traversed, judging whether the character set is a sub-set of the text content in the UI component, if so, then determining that the character set is the same as the text content of the UI component The text content of the UI component is successfully matched, and the subset is used as the touch character.

Optionally, if after traversing the UI components, the character set does not match the text content of the UI component successfully, the character set is corrected by natural language processing NLP technology, and according to the corrected character set to search.

Optionally, the generating a mask covering the terminal interface display area in the current interface display area of the terminal further includes:

Taking a screenshot of the current interface display area of the terminal to obtain a screenshot of the current interface display area of the terminal, and using the screenshot as a mask covering the display area of the terminal interface;

Optionally, using the screenshot as a mask covering the display area of the terminal interface further includes:

The screenshot is used as a mask in a translucent state covering the display area of the terminal interface.

Optionally, receiving a user's touch operation on the mask, and selecting an interface area to be searched on the mask according to the touch operation further includes:

Detecting the touch track generated based on the user's touch operation on the mask, displaying the interface area to be searched corresponding to the touch track on the mask, the display mode of the interface area to be searched is different from that of Other areas on the mask.

Optionally, the display mode of the interface area to be searched is highlighted or fully transparent;

and / or,

Other areas on the mask are displayed in grayscale, blurred, or translucent.

Optionally, the searching according to the touch characters further includes:

removing the mask, and pushing the touch characters to the search box located in the display area of the terminal interface;

If the user clicks on the first icon set in the display area of the terminal interface, a search is performed according to the touched characters.

Optionally, before the identifying the character set contained in the interface area to be searched, further includes:

If the user clicks on the second icon set in the mask, it triggers recognition of the character set included in the area of the interface to be searched.

Optionally, after the searching according to the touch character, it also includes:

Displaying search result items related to the touched character in the display area of the terminal interface.

Optionally, displaying search result items related to the touched character in the display area of the terminal interface further includes:

The search result items related to the touched characters are displayed in the display area of the terminal interface in the form of application cards, text entries, and a combination of graphics and text.

Optionally, the character set includes: at least one of characters and symbols.

According to another aspect of the present invention, there is provided a device for determining a touch character for searching, the device comprising:

The mask generator is adapted to generate a mask covering the terminal interface display area in the current interface display area of the terminal when the user triggers an interface touch search request;

A touch receiver, adapted to receive a user's touch operation on the mask, and select an interface area to be searched on the mask according to the touch operation;

An identification searcher, adapted to identify the character set contained in the interface area to be searched, and obtain the attributes of one or more user interface UI components in the current interface display area of the terminal, based on the character set and the UI component The matching relationship of the attributes determines the touch character, and searches according to the touch character.

Optionally, the attributes of the UI component include: text content of the UI component.

Optionally, the recognition searcher is further adapted to traverse the UI component, compare the character set with the text content of the UI component traversed, and determine whether the character set is part of the text content in the UI component. If it is a sub-set, then it is determined that the character set matches the text content of the UI component successfully, and the sub-set is used as the touch character.

Optionally, the recognition searcher is further adapted to perform a natural language processing (NLP) technique on the character set if the character set does not match the text content of the UI component after traversing the UI component. Correct, and search against the corrected set of characters.

Optionally, the mask generator is further adapted to take a screenshot of the current interface display area of the terminal to obtain a screenshot of the current interface display area of the terminal, and use the screenshot as a mask covering the display area of the terminal interface plate;

Optionally, the mask generator is further adapted to use the screenshot as a mask in a translucent state covering the display area of the terminal interface.

Optionally, the touch receiver is further adapted to detect a touch track generated based on the user's touch operation on the mask, and display an interface to be searched corresponding to the touch track on the mask area, the display mode of the interface area to be searched is different from other areas on the mask.

Optionally, the display mode of the interface area to be searched is highlighted or fully transparent;

and / or,

Other areas on the mask are displayed in grayscale, blurred, or translucent.

Optionally, the recognition searcher is further adapted to remove the mask, and push the touch character to a search box located in the display area of the terminal interface;

When the user clicks on the first icon provided in the display area of the terminal interface, the recognition searcher is further adapted to search according to the touched characters.

Optionally, when the user clicks on the second icon provided in the mask, the recognition searcher is further adapted to trigger recognition of the character set contained in the interface area to be searched.

Optionally, the device further includes: a search displayer, adapted to display search result items related to the touched character in a display area of the terminal interface.

Optionally, the search displayer is further adapted to display search result items related to the touched character in the form of application cards, text entries, and a combination of graphics and text in the display area of the terminal interface.

Optionally, the character set includes: at least one of characters and symbols.

The present invention receives the user's touch operation on the mask, and selects the interface area to be searched on the mask according to the touch operation; identifies the character set contained in the interface area to be searched, and obtains The attributes of one or more user interface UI components in the current interface display area of the terminal, determine the touch character based on the matching relationship between the character set and the attributes of the UI component, and search according to the touch character, not only omitting The cumbersome process of users entering keywords into the search box makes the search more convenient, avoids the problem of inaccurate touch characters, and improves user experience.

Description of drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiment. The drawings are only for the purpose of illustrating a preferred embodiment and are not to be considered as limiting the invention. Also throughout the drawings, the same reference numerals are used to designate the same components. In the attached picture:

Fig. 1 is a flow chart of the steps of a method for determining a touch character for searching according to an embodiment of the present invention;

Fig. 2 is a flow chart of steps of a method for determining a touch character for searching according to an embodiment of the present invention;

Fig. 3 is a flow chart of steps of a method for determining a touch character for searching according to an embodiment of the present invention;

Fig. 4 is a structural block diagram of a device for determining touch characters for searching according to an embodiment of the present invention;

Fig. 5 is a structural block diagram of an apparatus for determining touch characters for searching according to an embodiment of the present invention.

detailed description

The specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.

Fig. 1 is a flow chart of the steps of a method for determining touch characters to search according to an embodiment of the present invention; referring to Fig. 1, the method includes:

S101: When the user triggers an interface touch search request, generate a mask covering the terminal interface display area in the current interface display area of the terminal;

It should be noted that the user can trigger the interface touch search request in a variety of ways, for example, the user can trigger the search floating window on the screen, or trigger the interface touch search request through some shortcuts such as buttons or gestures. The example does not limit this.

S102: Receive a user's touch operation on the mask, and select an interface area to be searched on the mask according to the touch operation;

It is understandable that the user's touch operation on the mask, such as the user touching the touch point controlled by the screen with a finger or a sensor pen, can be selected by sliding the finger/stylus on the screen, or delineating and so on, so as to select the interface area to be searched and so on.

S103: Identify the character set contained in the interface area to be searched, and obtain the attributes of one or more user interface UI components in the current interface display area of the terminal, based on the matching of the character set and the attributes of the UI components Relationships identify touch characters and perform searches based on the touch characters.

The type of the character set includes but not limited to: characters and symbols.

It should be noted that, when identifying the character set contained in the interface area to be searched, there are many ways to identify it, and the most commonly used method is to use OCR optical character recognition technology to identify the character set contained in the interface area to be searched. Character set, but the recognition of character set is very prone to errors, which affects user experience. Therefore, in this embodiment, by obtaining the attributes of one or more user interface UI components in the current interface display area of the terminal, based on the character The matching relationship between the set and the attribute of the UI component determines the touch character, and searches are performed according to the touch character, thereby improving the recognition accuracy.

Understandably, in this embodiment, different systems adopt different acquisition UI component attributes. For the android system, the screenshot operation of the monitoring system can be directly monitored through the FileObserver service of the android system, or the UIautomater control can be used to obtain the UI component. Attributes. Of course, the scope of protection of the present invention also covers the utilization of UI component attributes in other operating systems, which is not limited in this embodiment.

It can be understood that the touch operation received in step S102 may be single or multiple times. When the touch operation is multiple times, the interface area to be searched is selected on the mask according to the multiple touch operations , the general processing method is to take the multiple touch operations on the mask as a whole, but this selection method will cause redundant characters to be included in the interface area to be searched, which will affect the accuracy of the search. In this embodiment, multiple touch operations by the user on the mask are received, and an interface area to be searched is selected on the mask according to the degree of overlap between the multiple touch operations, and the area to be searched is identified. The character set included in the interface area is searched according to the touched characters, which avoids redundant characters included in the interface area to be searched, and improves the search accuracy.

It should be noted that when selecting the interface area to be searched on the mask according to the coincidence degree between the multiple touch operations, various methods can be adopted, and in this embodiment, two interface areas to be searched are determined Whether the coincidence degree between is less than the coincidence threshold, if not less than, the two interface areas to be searched are merged into one interface area to be searched, otherwise the two interface areas to be searched are regarded as two independent interface areas to be searched, It further avoids redundant characters contained in the interface area to be searched, and improves the search accuracy.

Fig. 2 is a flow chart of the steps of a method for determining touch characters to search according to an embodiment of the present invention; referring to Fig. 2 , the method includes:

S201: Screenshot the current interface display area of the terminal to obtain a screenshot of the current interface display area of the terminal, and use the screenshot as a mask covering the terminal interface display area;

It is understandable that firstly taking a screenshot of the display area of the current interface of the terminal, and then using the screenshot as a mask covering the display area of the terminal interface, so that the applications or programs running in the background of the terminal will not be affected, and after the entire search interaction ends, the screen will be displayed again. It can return to the original browsing interface, thereby improving the user experience to a certain extent.

Of course, if the screenshot is only used as a pure transparent mask covering the display area of the terminal interface, since the mask is consistent with the content displayed in the display area of the terminal interface, the user may mistakenly believe that the terminal has not responded. In order to avoid this problem, in this embodiment, the mask is set to a translucent state, which can effectively prompt the user.

S202: Detect the touch track generated based on the user's touch operation on the mask, and display the interface area to be searched corresponding to the touch track on the mask, and the display modes of the interface area to be searched are different other areas on the mask;

It should be noted that, when selecting an interface area to be searched on the mask, if the display mode of the interface area to be searched is not distinguished from other areas on the mask, it will make it difficult for the user to determine the interface area to be searched. The set of characters in the interface area. In order to avoid this problem, in this embodiment, the display mode of the interface area to be searched is different from that of other areas on the mask.

Of course, in order to realize the difference in display methods, many display methods can be used. In this embodiment, the display method of the interface area to be searched can be displayed in a highlighted or fully transparent form, while other display methods on the mask The area can still be displayed in a semi-transparent form, or it can be displayed in a grayscale or blurred form. Other areas on the mask are displayed in a grayscale form, and the interface area to be searched is fully transparent. For presentation, of course, other ways may also be used to realize the difference in presentation manners, which is not limited in this embodiment of the present invention.

Therefore, step S202 is essentially a preferred implementation of step S102 in the embodiment shown in FIG. 1 .

S203: Identify the character set contained in the interface area to be searched, remove the mask, and acquire the text content of one or more user interface UI components in the current interface display area of the terminal, traverse the UI components, and The character set is compared with the text content of the UI component traversed to determine whether the character set is a subset of the text content in the UI component, and if so, then it is determined that the character set matches the text content of the UI component Success, using the subset as a touch character, push the touch character to the search box located in the display area of the terminal interface; if the user clicks on the first icon located in the display area of the terminal interface, then according to the Touch the above characters to search.

It should be noted that after the touch character is determined, the touch character needs to be pushed to the search box located in the display area of the terminal interface. If the mask is still retained, it is difficult for the user to see the touch character pushed to the search box. The touch characters in , so the mask needs to be removed.

It is understandable that errors may occur in both the recognized character set and the text content of the UI component. In this embodiment, the text content of one or more user interface UI components in the current interface display area of the terminal is acquired, and all The UI component compares the character set with the text content of the UI component traversed, and judges whether the character set is a sub-set of the text content in the UI component, and if so, then determines that the character set is not the same as the UI component. The text content of the component is successfully matched, and the sub-set is used as the touch character, which improves the accuracy rate.

If after traversing the UI components, the character set does not match the text content of the UI component successfully, it can be understood that there is an error in the character set or the text content of the UI component. In this embodiment, in order to solve this problem, through natural The language processing NLP technology corrects the character set, and searches according to the corrected character set.

Therefore, step S203 is essentially a preferred implementation of step S103 in the embodiment shown in FIG. 1 .

It can be understood that, since the touch character needs to be pushed to the search box located in the display area of the terminal interface, a search box needs to be popped up in the display area of the terminal interface first.

In order to facilitate the user to search after confirming the touch character, after the user clicks the first icon that triggers the search, the search is realized based on the touch character.

It should be noted that, in order to avoid identifying redundant characters as much as possible, in this embodiment, the minimum rectangular frame where each interface area to be searched is selected on the mask is used to identify the characters contained in the minimum rectangular frame. The mode of the first character set.

When identifying the character set contained in the rectangular frame, the boundary of the rectangular frame can be determined first, and then the four coordinate points of the left, right, upper, and lower sides of the rectangular frame can be determined, and finally the rectangular frame determined by the four coordinate points can be identified. The set of characters contained within.

Fig. 3 is a flow chart of the steps of a method for determining touch characters to search according to an embodiment of the present invention; referring to Fig. 3 , the method includes:

S301: When the user triggers an interface touch search request, generate a mask covering the terminal interface display area in the current interface display area of the terminal;

S302: Receive a user's touch operation on the mask, and select an interface area to be searched on the mask according to the touch operation;

S303: Identify the character set contained in the interface area to be searched, and obtain the attributes of one or more user interface UI components in the current interface display area of the terminal, based on the matching of the character set and the attributes of the UI components The relationship determines the touch characters, and searches based on the touch characters;

It should be noted that steps S301 to S303 are basically the same as steps S101 to S103 in the embodiment shown in FIG. 1 , so they will not be repeated here.

S304: Display search result items related to the touched character in the display area of the terminal interface.

It should be noted that the search result items can be displayed in various forms. In this embodiment, in the display area of the terminal interface, the items related to the touched characters are displayed in the form of application cards, text entries, and a combination of graphics and text. Of course, other forms may also be used to display the search result items, which is not limited in this embodiment of the present invention.

It can be understood that, in order to facilitate the user to confirm the interface area to be searched, and then identify the character set contained in the interface area to be searched, optionally, on the basis of the embodiments shown in Figures 1, 2, and 3, Before the identifying the character set included in the interface area to be searched, it further includes: if the user clicks on the second icon set in the mask, triggering the identification of the character set included in the interface area to be searched.

Of course, other icons can also be set in the mask, such as a repaint icon for reselecting the interface area to be searched, a return icon for exit, etc., which can be added as needed. This is not limited.

It can be understood that the execution subjects of the methods in the embodiments shown in Figures 1, 2, and 3 are all terminals, and the terminals can be devices such as desktop computers, notebooks, mobile phones, and tablet computers with touch screens. There is no restriction on this.

For the method embodiment, for the sake of simple description, it is expressed as a series of action combinations, but those skilled in the art should know that the embodiment of the present invention is not limited by the described action order, because according to the embodiment of the present invention , certain steps may be performed in other order or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

Fig. 4 is a structural block diagram of a device for searching based on a terminal interface touch operation according to an embodiment of the present invention; referring to Fig. 4 , the device includes:

The mask generator 401 is adapted to generate a mask covering the terminal interface display area in the current interface display area of the terminal when the user triggers an interface touch search request;

The touch receiver 402 is adapted to receive a user's touch operation on the mask, and select an interface area to be searched on the mask according to the touch operation;

The identification searcher 403 is adapted to identify the character set contained in the interface area to be searched, and obtain the attributes of one or more user interface UI components in the current interface display area of the terminal, based on the character set and the UI The matching relationship of the attributes of the components determines the touch characters, and searches are performed according to the touch characters.

In an optional embodiment of the present invention, the attributes of the UI component include: text content of the UI component.

In an optional embodiment of the present invention, the recognition searcher is further adapted to traverse the UI component, compare the character set with the text content of the UI component traversed, and determine whether the character set is is a subset of the text content in the UI component, and if so, it is determined that the character set matches the text content of the UI component successfully, and the subset is used as the touch character.

In an optional embodiment of the present invention, the recognition searcher is further adapted to perform natural language processing if the character set does not match the text content of the UI component after traversing the UI component. The NLP technology corrects the character set, and searches according to the corrected character set.

In an optional embodiment of the present invention, the mask generator is further adapted to take a screenshot of the display area of the current interface of the terminal to obtain a screenshot of the display area of the current interface of the terminal, and use the screenshot as an overlay The mask of the display area of the terminal interface;

In an optional embodiment of the present invention, the mask generator is further adapted to use the screenshot as a mask in a translucent state covering the display area of the terminal interface.

In an optional embodiment of the present invention, the touch receiver is further adapted to detect a touch track generated based on the user's touch operation on the mask, and display on the mask the corresponding The interface area to be searched corresponding to the touch track, the display mode of the interface area to be searched is different from other areas on the mask.

In an optional embodiment of the present invention, the display mode of the interface area to be searched is highlighted or fully transparent;

and / or,

Other areas on the mask are displayed in grayscale, blurred, or translucent.

In an optional embodiment of the present invention, the identification searcher is further adapted to remove the mask, and push the touch character to a search box located in the display area of the terminal interface;

When the user clicks on the first icon provided in the display area of the terminal interface, the recognition searcher is further adapted to search according to the touched characters.

In an optional embodiment of the present invention, when the user clicks on the second icon set in the mask, the recognition searcher is further adapted to trigger recognition of the character set contained in the interface area to be searched .

Fig. 5 is a structural block diagram of a device for searching based on a terminal interface touch operation according to an embodiment of the present invention; referring to Fig. 5 , the device includes:

The mask generator 501 is adapted to generate a mask covering the terminal interface display area in the current interface display area of the terminal when the user triggers an interface touch search request;

The touch receiver 502 is adapted to receive a user's touch operation on the mask, and select an interface area to be searched on the mask according to the touch operation;

The identification searcher 503 is adapted to identify the character set contained in the interface area to be searched, and obtain the attributes of one or more user interface UI components in the current interface display area of the terminal, based on the character set and the UI The matching relationship of the attributes of the components determines the touch characters, and searches are performed according to the touch characters.

The search displayer 504 is adapted to display search result items related to the touched character in the display area of the terminal interface.

In an optional embodiment of the present invention, the search display device is further adapted to display the search related to the touched character in the form of application cards, text entries, and a combination of graphics and text in the display area of the terminal interface. result item.

In an optional embodiment of the present invention, the character set includes: at least one of characters and symbols.

As for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for the related parts, please refer to the part of the description of the method embodiment.

It should be noted that among the various components of the system of the present invention, the components are logically divided according to the functions to be realized, but the present invention is not limited thereto, and each component can be re-divided as required Or combined, for example, some components can be combined into a single component, or some components can be further broken down into more subcomponents.

The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all functions of some or all components in the system according to the embodiments of the present invention. The present invention can also be implemented as an apparatus or an apparatus program (for example, a computer program and a computer program product) for performing a part or all of the methods described herein. Such a program for realizing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet site, or provided on a carrier signal, or provided in any other form.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names.

The above embodiments are only used to illustrate the present invention, but not to limit the present invention. Those of ordinary skill in the relevant technical field can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, all Equivalent technical solutions also belong to the category of the present invention, and the scope of patent protection of the present invention should be defined by the claims.

Claims (22)

1. one kind determines based on UI component property and to touch the method that scans for of character, it is characterised in that described method includes:

When user triggers interface touch-control searching request, generate the described terminal interface of covering in terminal current interface viewing area and show Show the mask in region；

Receive user's touch control operation in described mask, and in described mask, select boundary to be searched according to described touch control operation Region, face；

The character set comprised in identifying described interface zone to be searched, and obtain in described terminal current interface viewing area one Individual or the attribute of multiple user interface UI assembly, matching relationship based on described character set with the attribute of described UI assembly determines Touch character, and scan for according to described touch character；

Wherein, the attribute of described UI assembly includes: the content of text of UI assembly；

The described mask generating the described terminal interface viewing area of covering in terminal current interface viewing area, farther includes:

Terminal current interface viewing area is carried out screenshotss, to obtain the sectional drawing of described terminal current interface viewing area, and will Described sectional drawing is as the mask covering described terminal interface viewing area.

2. the method for claim 1, it is characterised in that described attribute based on described character set Yu described UI assembly Matching relationship determine touch character, farther include:

Travel through described UI assembly, the content of text of described character set with the UI assembly traversed is compared, it is judged that described Whether character set is the subclass of this UI assembly Chinese version content, the most then assert described character set and described UI assembly Content of text the match is successful, and using described subclass as described touch character.

3. method as claimed in claim 2, it is characterised in that if having traveled through described UI assembly, described character set is with described The match is successful for the content of text of UI assembly, then corrected described character set by natural language processing NLP technology, and Scan for according to the character set after corrigendum.

4. the method as according to any one of claim 1-3, it is characterised in that described using described sectional drawing as cover described end The mask of end interface display region, farther includes:

Using described sectional drawing as the mask being in translucent covering described terminal interface viewing area.

5. method as claimed in claim 4, it is characterised in that described reception user touch control operation in described mask, and In described mask, select interface zone to be searched according to described touch control operation, farther include:

Detecting based on touch track produced by user's touch control operation in described mask, in described mask, display is with described The corresponding interface zone to be searched of touch track, the exhibition method of described interface zone to be searched be different from described mask its His region.

6. method as claimed in claim 5, it is characterised in that the exhibition method of described interface zone to be searched is highlighted or complete Transparent form is shown；

And/or,

Other regions in described mask are shown with gray scale, obfuscation or translucent form.

7. the method as according to any one of claim 1-3, it is characterised in that described search according to described touch character Rope, farther includes:

Remove described mask, push to described touch character be positioned in the search box of described terminal interface viewing area；

If user clicks on and is located at the first icon in described terminal interface viewing area, then search according to described touch character Rope.

8. method as claimed in claim 7, it is characterised in that the character comprised in the described interface zone to be searched of described identification Before set, also include:

If user clicks on the second icon being located in described mask, then trigger the word comprised in identifying described interface zone to be searched Symbol set.

9. the method as according to any one of claim 1-3, it is characterised in that described scan for according to described touch character Afterwards, also include:

The search result items relevant to described touch character is shown in described terminal interface viewing area.

10. method as claimed in claim 9, it is characterised in that described displaying and institute in described terminal interface viewing area State and touch the search result items that character is relevant, farther include:

The form combined with application card, textual entry and picture and text in described terminal interface viewing area is shown and described touch The search result items that character is relevant.

11. methods as according to any one of claim 1-3, it is characterised in that described character set includes: word and symbol In at least one.

12. 1 kinds determine based on UI component property and to touch the device that scans for of character, it is characterised in that described device includes:

Mask maker, is suitable to when user triggers interface touch-control searching request, generates in terminal current interface viewing area and covers Cover the mask of described terminal interface viewing area；

Touch-control receptor, is suitable to receive user's touch control operation in described mask, and according to described touch control operation in described illiteracy Interface zone to be searched is selected on plate；

Identify searcher, the character set comprised in being suitable to identify described interface zone to be searched, and it is current to obtain described terminal The attribute of one or more user interface UI assemblies in interface display region, genus based on described character set Yu described UI assembly The matching relationship of property determines touch character, and scans for according to described touch character；

Wherein, the attribute of described UI assembly includes: the content of text of UI assembly；

Described mask maker, is further adapted for terminal current interface viewing area is carried out screenshotss, works as prezone obtaining described terminal The sectional drawing of viewing area, face, and using described sectional drawing as the mask covering described terminal interface viewing area.

13. devices as claimed in claim 12, it is characterised in that described identification searcher, are further adapted for traveling through described UI assembly, The content of text of described character set with the UI assembly traversed is compared, it is judged that whether described character set is this UI group The subclass of part Chinese version content, the most then the match is successful to assert the content of text of described character set and described UI assembly, and Using described subclass as described touch character.

14. devices as claimed in claim 13, it is characterised in that described identification searcher, if being further adapted for having traveled through described UI The match is successful for the content of text of assembly, described character set and described UI assembly, then by natural language processing NLP technology pair Described character set is corrected, and scans for according to the character set after corrigendum.

15. devices as according to any one of claim 12-14, it is characterised in that described mask maker, are further adapted for institute State sectional drawing as the mask being in translucent covering described terminal interface viewing area.

16. devices as claimed in claim 15, it is characterised in that described touch-control receptor, are further adapted for detection and exist based on user Touch track produced by touch control operation in described mask, in described mask, display is corresponding with described touch track waits to search Rope interface zone, the exhibition method of described interface zone to be searched is different from other regions in described mask.

17. devices as claimed in claim 16, it is characterised in that the exhibition method of described interface zone to be searched be highlighted or The form of all-transparent is shown；

And/or,

Other regions in described mask are shown with gray scale, obfuscation or translucent form.

18. devices as according to any one of claim 12-14, it is characterised in that described identification searcher, are further adapted for removing Described mask, pushes to described touch character be positioned in the search box of described terminal interface viewing area；

When user clicks on and is located at the first icon in described terminal interface viewing area, described identification searcher, it is further adapted for root Scan for according to described touch character.

19. devices as claimed in claim 18, it is characterised in that when user clicks on the second icon being located in described mask Time, described identification searcher, the character set comprised in being further adapted for triggering the described interface zone to be searched of identification.

20. devices as according to any one of claim 12-14, it is characterised in that described device also includes: search is shown Device, is suitable to show the search result items relevant to described touch character in described terminal interface viewing area.

21. devices as claimed in claim 20, it is characterised in that described search display device, are further adapted at described terminal interface The form combined with application card, textual entry and picture and text in viewing area shows the Search Results relevant to described touch character ?.

22. devices as according to any one of claim 12-14, it is characterised in that described character set includes: word and symbol At least one in number.