CN108874262A - Information interacting method, device, electronic equipment and computer readable storage medium - Google Patents
Information interacting method, device, electronic equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN108874262A CN108874262A CN201810582696.1A CN201810582696A CN108874262A CN 108874262 A CN108874262 A CN 108874262A CN 201810582696 A CN201810582696 A CN 201810582696A CN 108874262 A CN108874262 A CN 108874262A
- Authority
- CN
- China
- Prior art keywords
- action
- preset
- search
- preset action
- detecting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 230000009471 action Effects 0.000 claims abstract description 335
- 230000004044 response Effects 0.000 claims abstract description 44
- 230000003993 interaction Effects 0.000 claims abstract description 37
- 238000001514 detection method Methods 0.000 claims description 13
- 230000000875 corresponding effect Effects 0.000 description 54
- 238000010586 diagram Methods 0.000 description 15
- 238000004891 communication Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 238000011982 device technology Methods 0.000 description 2
- 239000004615 ingredient Substances 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
本公开实施例公开了一种信息交互方法、装置、电子设备及计算机可读存储介质,所述方法包括:响应于检测到对于屏幕的第一预设动作,识别所述第一预设动作对应的第一动作对象;锁定所述第一动作对象,并将锁定的第一动作对象设置为可编辑对象;响应于检测到对于所述可编辑对象的第二预设动作,识别所述第二预设动作对应的第二动作对象,并基于所述第二动作对象执行相应的预设操作。该方案能够实现更为精准的搜索对象选择,从而为用户提供更多的更有价值的信息,进而能够大大提高用户的操作效率,节省用户宝贵的时间,为用户的使用带来极大的便利。
An embodiment of the present disclosure discloses an information interaction method, device, electronic device, and computer-readable storage medium. The method includes: in response to detecting a first preset action on the screen, identifying that the first preset action corresponds to the first action object; lock the first action object, and set the locked first action object as an editable object; in response to detecting a second preset action on the editable object, identify the second Preset a second action object corresponding to the action, and execute a corresponding preset operation based on the second action object. This solution can realize more accurate search object selection, thereby providing users with more and more valuable information, which can greatly improve the user's operation efficiency, save the user's precious time, and bring great convenience to the user's use .
Description
技术领域technical field
本公开涉及信息处理技术领域,具体涉及一种信息交互方法、装置、电子设备及计算机可读存储介质。The present disclosure relates to the technical field of information processing, and in particular to an information interaction method, device, electronic equipment, and computer-readable storage medium.
背景技术Background technique
随着互联网、电子设备技术的发展,越来越多的事情都可以在电子设备上完成,比如:浏览新闻、查看文档、听音乐、观看视频等等,当用户浏览到一段文字或者一幅图片时,经常对于该段文字或者图片产生兴趣,想要得到更多的相关的信息,目前现有技术已经能够实现基于给定文字或者给定图片的搜索,但目前的图片识别搜索仅限于进行整体图片内容相似度的搜索,无法对于图片内容进行选择性的精细搜索。With the development of the Internet and electronic equipment technology, more and more things can be done on electronic equipment, such as browsing news, viewing documents, listening to music, watching videos, etc. When users browse a piece of text or a picture , often become interested in this paragraph of text or pictures, and want to get more relevant information. At present, the existing technology can realize the search based on a given text or a given picture, but the current picture recognition search is limited to the overall The search for the similarity of the image content cannot perform selective fine-grained search for the image content.
发明内容Contents of the invention
本公开实施例提供一种信息交互方法、装置、电子设备及计算机可读存储介质。Embodiments of the present disclosure provide an information interaction method, device, electronic equipment, and computer-readable storage medium.
第一方面,本公开实施例中提供了一种信息交互方法。In a first aspect, the embodiments of the present disclosure provide an information interaction method.
具体的,所述信息交互方法,包括:Specifically, the information interaction method includes:
响应于检测到对于屏幕的第一预设动作,识别所述第一预设动作对应的第一动作对象;Responding to detecting a first preset action on the screen, identifying a first action object corresponding to the first preset action;
锁定所述第一动作对象,并将锁定的第一动作对象设置为可编辑对象;Locking the first action object, and setting the locked first action object as an editable object;
响应于检测到对于所述可编辑对象的第二预设动作,识别所述第二预设动作对应的第二动作对象,并基于所述第二动作对象执行相应的预设操作。In response to detecting a second preset action on the editable object, identifying a second action object corresponding to the second preset action, and performing a corresponding preset operation based on the second action object.
结合第一方面,本公开在第一方面的第一种实现方式中,所述响应于检测到对于屏幕的第一预设动作,识别所述第一预设动作对应的第一动作对象,包括:With reference to the first aspect, in the first implementation manner of the first aspect of the present disclosure, the identifying the first action object corresponding to the first preset action in response to detecting the first preset action on the screen includes :
检测对于屏幕的第一预设动作;detecting a first preset action on the screen;
响应于检测到所述第一预设动作,获取所述第一预设动作对应的候选第一动作对象;In response to detecting the first preset action, acquiring a candidate first action object corresponding to the first preset action;
获取所述候选第一动作对象所在的区域;Obtain the area where the candidate first action object is located;
将与所述第一预设动作发生点之间的距离最近的候选第一动作对象确定为所述第一动作对象。A candidate first action object with the shortest distance to the first preset action occurrence point is determined as the first action object.
结合第一方面和第一方面的第一种实现方式,本公开在第一方面的第二种实现方式中,所述响应于检测到对于所述可编辑对象的第二预设动作,识别所述第二预设动作对应的第二动作对象,并基于所述第二动作对象执行相应的预设操作,包括:With reference to the first aspect and the first implementation manner of the first aspect, in the second implementation manner of the first aspect of the present disclosure, in response to detecting a second preset action on the editable object, identifying the The second action object corresponding to the second preset action, and perform the corresponding preset operation based on the second action object, including:
检测对于所述可编辑对象的第二预设动作;detecting a second preset action on the editable object;
响应于检测到所述第二预设动作,识别所述第二预设动作对应的第二动作对象,并将所述第二动作对象确定为搜索对象;In response to detecting the second preset action, identifying a second action object corresponding to the second preset action, and determining the second action object as a search object;
基于所述搜索对象执行搜索操作。A search operation is performed based on the search object.
结合第一方面、第一方面的第一种实现方式和第一方面的第二种实现方式,本公开在第一方面的第三种实现方式中,所述响应于检测到对于所述可编辑对象的第二预设动作,识别所述第二预设动作对应的第二动作对象,并基于所述第二动作对象执行相应的预设操作,包括:With reference to the first aspect, the first implementation of the first aspect, and the second implementation of the first aspect, in the third implementation of the first aspect of the present disclosure, the response to detecting that the editable The second preset action of the object, identifying the second action object corresponding to the second preset action, and performing a corresponding preset operation based on the second action object, including:
检测对于所述可编辑对象的第二预设动作;detecting a second preset action on the editable object;
响应于检测到所述第二预设动作,识别所述第二预设动作对应的第二动作对象;In response to detecting the second preset action, identifying a second action object corresponding to the second preset action;
将所述可编辑对象中除所述第二动作对象外的对象确定为搜索对象;determining objects in the editable objects other than the second action object as search objects;
基于所述搜索对象执行搜索操作。A search operation is performed based on the search object.
结合第一方面、第一方面的第一种实现方式、第一方面的第二种实现方式和第一方面的第三种实现方式,本公开在第一方面的第四种实现方式中,所述基于所述搜索对象执行搜索操作,包括:In combination with the first aspect, the first implementation of the first aspect, the second implementation of the first aspect, and the third implementation of the first aspect, in the fourth implementation of the first aspect of the present disclosure, the Performing a search operation based on the search object includes:
确定搜索命令显示区域,所述搜索命令显示区域与所述搜索对象所在区域之间的距离小于预设距离阈值;determining a search command display area, the distance between the search command display area and the area where the search object is located is less than a preset distance threshold;
在所述搜索命令显示区域中显示搜索命令;displaying a search command in the search command display area;
响应于对于所述搜索命令的触发,基于所述搜索对象执行搜索操作。In response to triggering of the search command, a search operation is performed based on the search object.
结合第一方面、第一方面的第一种实现方式、第一方面的第二种实现方式、第一方面的第三种实现方式和第一方面的第四种实现方式,本公开在第一方面的第五种实现方式中,所述基于所述搜索对象执行搜索操作之后,还包括:Combining the first aspect, the first implementation of the first aspect, the second implementation of the first aspect, the third implementation of the first aspect and the fourth implementation of the first aspect, the present disclosure is based on the first In the fifth implementation manner of the aspect, after performing the search operation based on the search object, it further includes:
获取搜索结果;Get search results;
计算所述搜索结果与所述搜索对象之间的相似度;calculating the similarity between the search result and the search object;
按照所述相似度从大到小的顺序对于所述搜索结果进行排序;sorting the search results in descending order of the similarity;
根据排序结果显示所述搜索结果。The search results are displayed according to sorted results.
第二方面,本公开实施例中提供了一种信息交互装置。In a second aspect, embodiments of the present disclosure provide an information interaction device.
具体的,所述信息交互装置,包括:Specifically, the information interaction device includes:
识别模块,被配置为响应于检测到对于屏幕的第一预设动作,识别所述第一预设动作对应的第一动作对象;An identification module configured to, in response to detecting a first preset action on the screen, identify a first action object corresponding to the first preset action;
设置模块,被配置为锁定所述第一动作对象,并将锁定的第一动作对象设置为可编辑对象;A setting module configured to lock the first action object, and set the locked first action object as an editable object;
执行模块,被配置为响应于检测到对于所述可编辑对象的第二预设动作,识别所述第二预设动作对应的第二动作对象,并基于所述第二动作对象执行相应的预设操作。An execution module configured to, in response to detecting a second preset action on the editable object, identify a second action object corresponding to the second preset action, and execute a corresponding preset action based on the second action object. set operation.
结合第二方面,本公开在第二方面的第一种实现方式中,所述识别模块包括:With reference to the second aspect, in the first implementation manner of the second aspect of the present disclosure, the identification module includes:
第一检测子模块,被配置为检测对于屏幕的第一预设动作;The first detection submodule is configured to detect a first preset action on the screen;
第一获取子模块,被配置为响应于检测到所述第一预设动作,获取所述第一预设动作对应的候选第一动作对象;The first acquiring submodule is configured to acquire a candidate first action object corresponding to the first preset action in response to detecting the first preset action;
第二获取子模块,被配置为获取所述候选第一动作对象所在的区域;The second acquisition submodule is configured to acquire the area where the candidate first action object is located;
第一确定子模块,被配置为将与所述第一预设动作发生点之间的距离最近的候选第一动作对象确定为所述第一动作对象。The first determining submodule is configured to determine a candidate first action object with the shortest distance to the first preset action occurrence point as the first action object.
结合第二方面和第二方面的第一种实现方式,本公开在第二方面的第二种实现方式中,所述执行模块包括:Combining the second aspect and the first implementation manner of the second aspect, in the second implementation manner of the second aspect of the present disclosure, the execution module includes:
第二检测子模块,被配置为检测对于所述可编辑对象的第二预设动作;A second detection submodule configured to detect a second preset action on the editable object;
第二确定子模块,被配置为响应于检测到所述第二预设动作,识别所述第二预设动作对应的第二动作对象,并将所述第二动作对象确定为搜索对象;The second determining submodule is configured to, in response to detecting the second preset action, identify a second action object corresponding to the second preset action, and determine the second action object as a search object;
第一执行子模块,被配置为基于所述搜索对象执行搜索操作。The first execution submodule is configured to execute a search operation based on the search object.
结合第二方面、第二方面的第一种实现方式和第二方面的第二种实现方式,本公开在第二方面的第三种实现方式中,所述执行模块包括:Combining the second aspect, the first implementation manner of the second aspect, and the second implementation manner of the second aspect, in the third implementation manner of the second aspect of the present disclosure, the execution module includes:
第三检测子模块,被配置为检测对于所述可编辑对象的第二预设动作;A third detection submodule configured to detect a second preset action on the editable object;
识别子模块,被配置为响应于检测到所述第二预设动作,识别所述第二预设动作对应的第二动作对象;An identification submodule configured to, in response to detecting the second preset action, identify a second action object corresponding to the second preset action;
第三确定子模块,被配置为将所述可编辑对象中除所述第二动作对象外的对象确定为搜索对象;The third determining submodule is configured to determine objects in the editable objects other than the second action object as search objects;
第二执行子模块,被配置为基于所述搜索对象执行搜索操作。The second execution submodule is configured to execute a search operation based on the search object.
结合第二方面、第二方面的第一种实现方式、第二方面的第二种实现方式和第二方面的第三种实现方式,本公开在第二方面的第四种实现方式中,所述第二执行子模块包括:Combining the second aspect, the first implementation of the second aspect, the second implementation of the second aspect, and the third implementation of the second aspect, in the fourth implementation of the second aspect of the present disclosure, the The second execution submodule includes:
第四确定子模块,被配置为确定搜索命令显示区域,所述搜索命令显示区域与所述搜索对象所在区域之间的距离小于预设距离阈值;The fourth determining submodule is configured to determine a search command display area, and the distance between the search command display area and the area where the search object is located is less than a preset distance threshold;
第一显示子模块,被配置为在所述搜索命令显示区域中显示搜索命令;A first display submodule configured to display a search command in the search command display area;
第三执行子模块,被配置为响应于对于所述搜索命令的触发,基于所述搜索对象执行搜索操作。The third execution submodule is configured to execute a search operation based on the search object in response to the trigger of the search command.
结合第二方面、第二方面的第一种实现方式、第二方面的第二种实现方式、第二方面的第三种实现方式和第二方面的第四种实现方式,本公开在第二方面的第五种实现方式中,还包括:Combining the second aspect, the first implementation of the second aspect, the second implementation of the second aspect, the third implementation of the second aspect and the fourth implementation of the second aspect, the present disclosure is in the second In the fifth implementation mode of the aspect, it also includes:
第三获取子模块,被配置为获取搜索结果;The third obtaining submodule is configured to obtain search results;
计算子模块,被配置为计算所述搜索结果与所述搜索对象之间的相似度;a calculation submodule configured to calculate the similarity between the search result and the search object;
排序子模块,被配置为按照所述相似度从大到小的顺序对于所述搜索结果进行排序;The sorting submodule is configured to sort the search results in descending order of the similarity;
第二显示子模块,被配置为根据排序结果显示所述搜索结果。The second display submodule is configured to display the search results according to the sorting results.
第三方面,本公开实施例提供了一种电子设备,包括存储器和处理器,所述存储器用于存储一条或多条支持信息交互装置执行上述第一方面中信息交互方法的计算机指令,所述处理器被配置为用于执行所述存储器中存储的计算机指令。所述信息交互装置还可以包括通信接口,用于信息交互装置与其他设备或通信网络通信。In a third aspect, an embodiment of the present disclosure provides an electronic device, including a memory and a processor, the memory is used to store one or more computer instructions that support the information interaction device to execute the information interaction method in the first aspect above, the The processor is configured to execute computer instructions stored in said memory. The information interaction device may also include a communication interface for the information interaction device to communicate with other devices or a communication network.
第四方面,本公开实施例提供了一种计算机可读存储介质,用于存储信息交互装置所用的计算机指令,其包含用于执行上述第一方面中信息交互方法为信息交互装置所涉及的计算机指令。In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium for storing computer instructions used by an information interaction device, which includes a computer used to execute the information interaction method in the first aspect as the information interaction device involved instruction.
本公开实施例提供的技术方案可以包括以下有益效果:The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:
上述技术方案,通过设置第一预设动作和第二预设动作,当检测到对于屏幕的第一预设动作时,识别所述第一预设动作对应的第一动作对象,锁定并将所述第一动作对象设置为可编辑对象;当检测到对于所述可编辑对象的第二预设动作时,识别所述第二预设动作对应的第二动作对象,并基于所述第二动作对象执行相应的预设操作,来实现更为精准的搜索对象选择,从而为用户提供更多的更有价值的信息,进而能够大大提高用户的操作效率,节省用户宝贵的时间,为用户的使用带来极大的便利。In the above technical solution, by setting the first preset action and the second preset action, when the first preset action on the screen is detected, the first action object corresponding to the first preset action is identified, locked and The first action object is set as an editable object; when a second preset action on the editable object is detected, the second action object corresponding to the second preset action is identified, and based on the second action Objects perform corresponding preset operations to achieve more accurate search object selection, thereby providing users with more and more valuable information, which can greatly improve the user's operation efficiency, save users' precious time, and provide users with more valuable information. Bring great convenience.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本公开。It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.
附图说明Description of drawings
结合附图,通过以下非限制性实施方式的详细描述,本公开的其它特征、目的和优点将变得更加明显。在附图中:Other features, objects and advantages of the present disclosure will become more apparent through the following detailed description of non-limiting embodiments in conjunction with the accompanying drawings. In the attached picture:
图1示出根据本公开一实施方式的信息交互方法的流程图;FIG. 1 shows a flowchart of an information interaction method according to an embodiment of the present disclosure;
图2示出根据图1所示实施方式的信息交互方法的步骤S101的流程图;FIG. 2 shows a flow chart of step S101 of the information interaction method according to the embodiment shown in FIG. 1;
图3示出根据图1所示实施方式的信息交互方法的步骤S103的流程图;FIG. 3 shows a flow chart of step S103 of the information interaction method according to the embodiment shown in FIG. 1;
图4示出根据另一实施方式的信息交互方法的步骤S103的流程图;FIG. 4 shows a flowchart of step S103 of an information interaction method according to another embodiment;
图5示出根据图3或图4所示实施方式的信息交互方法的步骤S303或者步骤S404的流程图;FIG. 5 shows a flowchart of step S303 or step S404 of the information interaction method according to the embodiment shown in FIG. 3 or FIG. 4;
图6示出根据另一实施方式的信息交互方法的步骤S303或者步骤S404的流程图;FIG. 6 shows a flow chart of step S303 or step S404 of an information interaction method according to another embodiment;
图7示出根据本公开一实施方式的信息交互装置的结构框图;Fig. 7 shows a structural block diagram of an information interaction device according to an embodiment of the present disclosure;
图8示出根据图7所示实施方式的信息交互装置的识别模块701的结构框图;FIG. 8 shows a structural block diagram of the identification module 701 of the information interaction device according to the embodiment shown in FIG. 7;
图9示出根据图7所示实施方式的信息交互装置的执行模块703的结构框图;FIG. 9 shows a structural block diagram of the execution module 703 of the information interaction device according to the embodiment shown in FIG. 7;
图10示出根据另一实施方式的信息交互装置的执行模块703的结构框图;Fig. 10 shows a structural block diagram of an execution module 703 of an information interaction device according to another embodiment;
图11示出根据图9或图10所示实施方式的信息交互装置的第一执行子模块903或第二执行子模块1004的结构框图;Fig. 11 shows a structural block diagram of the first execution sub-module 903 or the second execution sub-module 1004 of the information interaction device according to the embodiment shown in Fig. 9 or Fig. 10;
图12示出根据另一实施方式的信息交互装置的第一执行子模块903或第二执行子模块1004的结构框图;Fig. 12 shows a structural block diagram of the first execution sub-module 903 or the second execution sub-module 1004 of the information interaction device according to another embodiment;
图13示出根据本公开一实施方式的电子设备的结构框图;Fig. 13 shows a structural block diagram of an electronic device according to an embodiment of the present disclosure;
图14是适于用来实现根据本公开一实施方式的信息交互方法的计算机系统的结构示意图。Fig. 14 is a schematic structural diagram of a computer system suitable for implementing an information interaction method according to an embodiment of the present disclosure.
具体实施方式Detailed ways
下文中,将参考附图详细描述本公开的示例性实施方式,以使本领域技术人员可容易地实现它们。此外,为了清楚起见,在附图中省略了与描述示例性实施方式无关的部分。Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement them. Also, for clarity, parts not related to describing the exemplary embodiments are omitted in the drawings.
在本公开中,应理解,诸如“包括”或“具有”等的术语旨在指示本说明书中所公开的特征、数字、步骤、行为、部件、部分或其组合的存在,并且不欲排除一个或多个其他特征、数字、步骤、行为、部件、部分或其组合存在或被添加的可能性。In the present disclosure, it should be understood that terms such as "comprising" or "having" are intended to indicate the presence of features, numbers, steps, acts, components, parts or combinations thereof disclosed in the specification, and are not intended to exclude one or a plurality of other features, numbers, steps, acts, parts, parts or combinations thereof exist or are added.
另外还需要说明的是,在不冲突的情况下,本公开中的实施例及实施例中的特征可以相互组合。下面将参考附图并结合实施例来详细说明本公开。In addition, it should be noted that, in the case of no conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other. The present disclosure will be described in detail below with reference to the accompanying drawings and embodiments.
本公开实施例提供的技术方案通过设置第一预设动作和第二预设动作,当检测到对于屏幕的第一预设动作时,识别所述第一预设动作对应的第一动作对象,锁定并将所述第一动作对象设置为可编辑对象;当检测到对于所述可编辑对象的第二预设动作时,识别所述第二预设动作对应的第二动作对象,并基于所述第二动作对象执行相应的预设操作,来实现更为精准的搜索对象选择,从而为用户提供更多的更有价值的信息,进而能够大大提高用户的操作效率,节省用户宝贵的时间,为用户的使用带来极大的便利。In the technical solution provided by the embodiments of the present disclosure, by setting the first preset action and the second preset action, when the first preset action on the screen is detected, the first action object corresponding to the first preset action is identified, Locking and setting the first action object as an editable object; when detecting a second preset action on the editable object, identifying the second action object corresponding to the second preset action, and based on the The above-mentioned second action object executes corresponding preset operations to achieve more accurate search object selection, thereby providing users with more and more valuable information, which can greatly improve the user's operation efficiency and save the user's precious time. It brings great convenience to users.
图1示出根据本公开一实施方式的信息交互方法的流程图。如图1所示,所述信息交互方法包括以下步骤S101-S103:Fig. 1 shows a flowchart of an information interaction method according to an embodiment of the present disclosure. As shown in Figure 1, the information interaction method includes the following steps S101-S103:
在步骤S101中,响应于检测到对于屏幕的第一预设动作,识别所述第一预设动作对应的第一动作对象;In step S101, in response to detecting a first preset action on the screen, identifying a first action object corresponding to the first preset action;
在步骤S102中,锁定所述第一动作对象,并将锁定的第一动作对象设置为可编辑对象;In step S102, lock the first action object, and set the locked first action object as an editable object;
在步骤S103中,响应于检测到对于所述可编辑对象的第二预设动作,识别所述第二预设动作对应的第二动作对象,并基于所述第二动作对象执行相应的预设操作。In step S103, in response to detecting a second preset action on the editable object, identify a second action object corresponding to the second preset action, and execute a corresponding preset based on the second action object operate.
上文提及,随着互联网、电子设备技术的发展,越来越多的事情都可以在电子设备上完成,比如:浏览新闻、查看文档、听音乐、观看视频等等,当用户浏览到一段文字或者一幅图片时,经常对于该段文字或者图片产生兴趣,想要得到更多的相关的信息,目前现有技术已经能够实现基于给定文字或者给定图片的搜索,但目前的图片识别搜索仅限于进行整体图片内容相似度的搜索,无法对于图片内容进行选择性的精细搜索。比如,现在越来越多的用户使用外卖平台选择外卖解决就餐问题,但外卖平台上的菜品图片往往是多元化的、复杂的,不仅包括不同的食材,也包括不同菜品的组合,用户在浏览图片进行选择时,随时可能基于这些图片内容信息激发搜索其他相关菜品的需求,目前的外卖平台技术无法满足这一需求,更不用说当用户只对菜品组合中的一部分感兴趣,想要就搜索图片中的一部分内容进行精细搜索了。As mentioned above, with the development of the Internet and electronic device technology, more and more things can be done on electronic devices, such as: browsing news, viewing documents, listening to music, watching videos, etc. When users browse to a When viewing text or a picture, I often become interested in the text or picture and want to get more relevant information. At present, the existing technology can realize the search based on the given text or a given picture, but the current picture recognition The search is limited to the search for the similarity of the overall picture content, and it is not possible to conduct selective fine-grained search for the picture content. For example, more and more users use takeaway platforms to choose takeaway to solve their dining problems, but the pictures of dishes on the takeaway platform are often diversified and complex, including not only different ingredients, but also combinations of different dishes. Users browse When selecting pictures, the need to search for other related dishes may be triggered at any time based on the content information of these pictures. The current takeaway platform technology cannot meet this demand, let alone when users are only interested in a part of the dish combination, just search Part of the content in the picture has been refined.
考虑到上述缺陷,在该实施方式中,提出一种信息交互方法,该方法首先检测对于屏幕的第一预设动作,当检测到对于屏幕的第一预设动作时,识别所述第一预设动作对应的第一动作对象;然后锁定所述第一动作对象,将其设置为可编辑对象;然后检测对于所述可编辑对象的第二预设动作,当检测到对于所述可编辑对象的第二预设动作时,识别所述第二预设动作对应的第二动作对象,并基于所述第二动作对象执行相应的预设操作。该方案能够实现更为精准的搜索对象选择,从而为用户提供更多的更有价值的信息,进而能够大大提高用户的操作效率,节省用户宝贵的时间,为用户的使用带来极大的便利。Considering the above defects, in this embodiment, an information interaction method is proposed, the method first detects the first preset action on the screen, and when the first preset action on the screen is detected, the first preset action is identified. Set the first action object corresponding to the action; then lock the first action object and set it as an editable object; then detect the second preset action for the editable object, when it is detected that the editable object When the second preset action is performed, a second action object corresponding to the second preset action is identified, and a corresponding preset operation is performed based on the second action object. This solution can realize more accurate search object selection, thereby providing users with more and more valuable information, which can greatly improve the user's operation efficiency, save the user's precious time, and bring great convenience to the user's use .
其中,所述预设操作可以为检索、搜索、匹配等预设操作,下文以搜索操作为例对于本技术方案进行说明。Wherein, the preset operation may be a preset operation such as retrieval, search, and matching, and the technical solution will be described below by taking the search operation as an example.
在本实施例的一个可选实现方式中,如图2所示,所述步骤S101,即所述响应于检测到对于屏幕的第一预设动作,识别所述第一预设动作对应的第一动作对象的步骤,包括步骤S201-S204:In an optional implementation of this embodiment, as shown in FIG. 2 , the step S101 is to identify the first preset action corresponding to the first preset action in response to the detection of the first preset action on the screen. The steps of an action object include steps S201-S204:
在步骤S201中,检测对于屏幕的第一预设动作;In step S201, detecting a first preset action on the screen;
在步骤S202中,响应于检测到所述第一预设动作,获取所述第一预设动作对应的候选第一动作对象;In step S202, in response to detecting the first preset action, acquiring a candidate first action object corresponding to the first preset action;
在步骤S203中,获取所述候选第一动作对象所在的区域;In step S203, the area where the candidate first action object is located is acquired;
在步骤S204中,将与所述第一预设动作发生点之间的距离最近的候选第一动作对象确定为所述第一动作对象。In step S204, a candidate first action object with the shortest distance to the first preset action occurrence point is determined as the first action object.
考虑到屏幕显示内容区域大小不一,因此,在屏幕上产生的动作有可能会有意或无意地覆盖两个或两个以上的对象区域,为了准确识别用户想要搜索的目标对象的所在,保障后续搜索的准确率,在该实施方式中,当检测到对于屏幕的第一预设动作时,首先获取所述第一预设动作对应的一个或多个候选第一动作对象,然后获取所述候选第一动作对象所在的区域,与所述第一预设动作发生点的距离最近的候选第一动作对象可认为是用户想要搜索的目标对象,因此可将该候选第一动作对象确定为所述第一动作对象。Considering that the size of the content area displayed on the screen is different, the actions generated on the screen may intentionally or unintentionally cover two or more object areas. In order to accurately identify the location of the target object that the user wants to search, it is guaranteed The accuracy rate of the subsequent search. In this embodiment, when the first preset action on the screen is detected, one or more candidate first action objects corresponding to the first preset action are first obtained, and then the In the area where the candidate first action object is located, the candidate first action object with the closest distance to the first preset action occurrence point can be considered as the target object that the user wants to search, so the candidate first action object can be determined as The first action object.
其中,所述第一预设动作可以为单指长按、双指长按、多指长按、单击、双击、连续多击、单指滑动、双指滑动、多指滑动等动作,具体可根据实际应用的需要进行设置。另外,所述第一预设动作可预先进行设置,也可后续根据用户的使用习惯进行个性化设置。Wherein, the first preset action may be actions such as single-finger long press, two-finger long press, multi-finger long press, single-click, double-click, continuous multi-tap, single-finger slide, two-finger slide, multi-finger slide, etc. It can be set according to the needs of practical applications. In addition, the first preset action can be set in advance, or can be personalized later according to the usage habits of the user.
在本实施例的一个可选实现方式中,所述步骤S102中,锁定所述第一动作对象,并将锁定的第一动作对象设置为可编辑对象,指的是,只将所述第一预设动作对应的第一动作对象设置为可编辑对象,将所述屏幕上、除第一动作对象外的其他显示对象均设置为非可编辑对象,以提高用户目标对象识别的准确率。In an optional implementation of this embodiment, in the step S102, the first action object is locked, and the locked first action object is set as an editable object, which means that only the first action object The first action object corresponding to the preset action is set as an editable object, and all other display objects on the screen except the first action object are set as non-editable objects, so as to improve the accuracy of user target object recognition.
在本实施例的一个可选实现方式中,如图3所示,所述步骤S103,即响应于检测到对于所述可编辑对象的第二预设动作,识别所述第二预设动作对应的第二动作对象,并基于所述第二动作对象执行相应的预设操作的步骤,包括步骤S301-S303:In an optional implementation of this embodiment, as shown in FIG. 3 , in step S103, in response to detecting a second preset action on the editable object, identify the corresponding The second action object, and the step of performing a corresponding preset operation based on the second action object, including steps S301-S303:
在步骤S301中,检测对于所述可编辑对象的第二预设动作;In step S301, detecting a second preset action on the editable object;
在步骤S302中,响应于检测到所述第二预设动作,识别所述第二预设动作对应的第二动作对象,并将所述第二动作对象确定为搜索对象;In step S302, in response to detecting the second preset action, identifying a second action object corresponding to the second preset action, and determining the second action object as a search object;
在步骤S303中,基于所述搜索对象执行搜索操作。In step S303, a search operation is performed based on the search object.
获取可编辑对象后,可利用第二预设动作来精确确定后续搜索所针对的搜索对象,即在该实施方式中,在检测到对于所述可编辑对象的第二预设动作时,识别所述第二预设动作对应的第二动作对象,将所述第二动作对象确定为搜索对象执行搜索操作。After the editable object is obtained, the second preset action can be used to accurately determine the search object for the subsequent search, that is, in this embodiment, when the second preset action on the editable object is detected, the A second action object corresponding to the second preset action is determined, and the second action object is determined as a search object to perform a search operation.
进一步地,在所述步骤S302中确定了搜索对象之后,还可对于所述搜索对象进行预设方式显示,比如将所述搜索对象进行高亮显示,将所述屏幕上、可编辑对象中除所述搜索对象外的其他对象进行非高亮或者灰度显示,以对所述搜索对象进行突出显示,引起用户的注意,便于用户进一步确定搜索对象的选择是否准确。Further, after the search object is determined in the step S302, the search object can also be displayed in a preset manner, such as highlighting the search object, and removing the editable object on the screen. Objects other than the search object are non-highlighted or displayed in gray scale to highlight the search object to attract the attention of the user, so as to facilitate the user to further determine whether the selection of the search object is accurate.
在本实施例的一个可选实现方式中,如图4所示,所述步骤S103,即所述响应于检测到对于所述可编辑对象的第二预设动作,识别所述第二预设动作对应的第二动作对象,并基于所述第二动作对象执行相应的预设操作的步骤,包括步骤S401-S404:In an optional implementation of this embodiment, as shown in FIG. 4 , the step S103 is to identify the second preset action in response to detecting the second preset action on the editable object. The steps of actuating the corresponding second action object and performing corresponding preset operations based on the second action object include steps S401-S404:
在步骤S401中,检测对于所述可编辑对象的第二预设动作;In step S401, detecting a second preset action on the editable object;
在步骤S402中,响应于检测到所述第二预设动作,识别所述第二预设动作对应的第二动作对象;In step S402, in response to detecting the second preset action, identifying a second action object corresponding to the second preset action;
在步骤S403中,将所述可编辑对象中除所述第二动作对象外的对象确定为搜索对象;In step S403, determining objects in the editable objects other than the second action object as search objects;
在步骤S404中,基于所述搜索对象执行搜索操作。In step S404, a search operation is performed based on the search object.
考虑到在有些情况下,比如当想要搜索的目标对象范围较大,至少大于不想要搜索的对象时,用户会产生通过反选确定搜索目标对象的需求,因此,在该实施方式中,实现基于反选策略来确定最终的搜索对象的目的。与上一实施方式类似,在该实施方式中,首先要检测对于所述可编辑对象的第二预设动作,然后识别所述第二预设动作对应的第二动作对象,但与上一实施方式不同的是,所述第二动作对象与上一实施方式中的第二动作对象不同,该实施方式中的第二动作对象是用户不想要进行后续搜索的对象,因此,在识别得到第二动作对象后,将所述可编辑对象中除所述第二动作对象外的对象确定为搜索对象,并基于所述搜索对象执行搜索操作。Considering that in some cases, for example, when the target object to be searched has a large range, at least larger than the object not to be searched, the user will have the need to determine the search target object through inverse selection, therefore, in this embodiment, the implementation is based on Anti-selection strategy to determine the purpose of the final search object. Similar to the previous implementation, in this implementation, the second preset action on the editable object must be detected first, and then the second action object corresponding to the second preset action should be identified, but the same as the previous implementation The difference is that the second action object is different from the second action object in the previous embodiment. The second action object in this embodiment is an object that the user does not want to perform subsequent searches. Therefore, after the recognition of the second After the action object, an object in the editable object other than the second action object is determined as a search object, and a search operation is performed based on the search object.
其中,为了更为精确地确定后续搜索所针对的搜索对象,可为所述第二预设动作设置相应的动作要求,比如可要求所述第二预设动作为一种闭合动作,比如,单指或多指划出的闭合的圆圈等等;或者所述第二预设动作最终可形成一种闭合图形,比如,用户进行涂抹动作,最后可对涂抹区域进行边缘识别,形成边缘闭合图形。Wherein, in order to more accurately determine the search object for the subsequent search, corresponding action requirements can be set for the second preset action, for example, the second preset action can be required to be a closing action, for example, a single A closed circle drawn by one or more fingers; or the second preset action can finally form a closed figure, for example, the user performs a smear action, and finally can perform edge recognition on the smeared area to form a closed figure.
进一步地,当检测到所述第二预设动作未达到所述动作要求,则将所述第二预设动作认定为无效动作。Further, when it is detected that the second preset action does not meet the action requirement, the second preset action is identified as an invalid action.
需要注意的是,所述第二预设动作不同于所述第一预设动作。另外,与所述第一预设动作类似,所述第二预设动作可预先进行设置,也可后续根据用户的使用习惯进行个性化设置。It should be noted that the second preset action is different from the first preset action. In addition, similar to the first preset action, the second preset action can be set in advance, or can be personalized later according to the user's usage habits.
在本实施例的一个可选实现方式中,如图5所示,所述步骤S303或者步骤S404,即所述基于所述搜索对象执行搜索操作的步骤,包括步骤S501-S503:In an optional implementation of this embodiment, as shown in FIG. 5, the step S303 or step S404, that is, the step of performing a search operation based on the search object, includes steps S501-S503:
在步骤S501中,确定搜索命令显示区域,所述搜索命令显示区域与所述搜索对象所在区域之间的距离小于预设距离阈值;In step S501, a search command display area is determined, and the distance between the search command display area and the area where the search object is located is smaller than a preset distance threshold;
在步骤S502中,在所述搜索命令显示区域中显示搜索命令;In step S502, displaying a search command in the search command display area;
在步骤S503中,响应于对于所述搜索命令的触发,基于所述搜索对象执行搜索操作。In step S503, in response to triggering of the search command, a search operation is performed based on the search object.
为了进一步方便用户的操作,在该实施方式中,在所述搜索对象所在区域附近的位置处设置搜索命令显示区域,用来显示搜索命令,其中,所述搜索命令显示区域可以为一个显示搜索字样的区域、一个搜索按钮、一个搜索控件等;然后响应于用户对于所述搜索命令的触发,基于之前已经确定的搜索对象执行搜索操作。In order to further facilitate the user's operation, in this embodiment, a search command display area is set at a position near the area where the search object is located to display the search command, wherein the search command display area can be a search word area, a search button, a search control, etc.; then, in response to the triggering of the search command by the user, a search operation is performed based on the previously determined search object.
在本实施例的一个可选实现方式中,为了对搜索对象的确定进行及时的响应,但又不致让用户等待太长的时间,因此,在确定所述搜索对象之后的一预设时间后,在所述搜索命令显示区域中显示搜索命令,其中,所述预设时间比如可设置为2秒、3秒等时间。In an optional implementation of this embodiment, in order to respond to the determination of the search object in a timely manner without causing the user to wait too long, after a preset time after the search object is determined, The search command is displayed in the search command display area, wherein the preset time can be set as 2 seconds, 3 seconds, etc., for example.
在本实施例的一个可选实现方式中,如图6所示,所述步骤S303或者步骤S404,即所述基于所述搜索对象执行搜索操作的步骤之后,包括步骤S601-S604:In an optional implementation of this embodiment, as shown in FIG. 6, the step S303 or step S404, that is, after the step of performing the search operation based on the search object, includes steps S601-S604:
在步骤S601中,获取搜索结果;In step S601, obtain search results;
在步骤S602中,计算所述搜索结果与所述搜索对象之间的相似度;In step S602, calculating the similarity between the search result and the search object;
在步骤S603中,按照所述相似度从大到小的顺序对于所述搜索结果进行排序;In step S603, the search results are sorted in descending order of the similarity;
在步骤S604中,根据排序结果显示所述搜索结果。In step S604, the search results are displayed according to the sorting results.
考虑到搜索结果数量比较大,为了给用户提供更符合其期望的搜索结果,在该实施方式中,首先计算所述搜索结果与所述搜索对象之间的相似度,然后按照所述相似度从大到小的顺序对于所述搜索结果进行排序,最后根据排序结果依次显示所述搜索结果供用户选择。Considering that the number of search results is relatively large, in order to provide users with search results more in line with their expectations, in this embodiment, first calculate the similarity between the search results and the search object, and then calculate the similarity from The search results are sorted in descending order, and finally the search results are displayed sequentially according to the sorting results for the user to choose.
下述为本公开装置实施例,可以用于执行本公开方法实施例。The following are device embodiments of the present disclosure, which can be used to implement the method embodiments of the present disclosure.
图7示出根据本公开一实施方式的信息交互装置的结构框图,该装置可以通过软件、硬件或者两者的结合实现成为电子设备的部分或者全部。如图7所示,所述信息交互装置包括:Fig. 7 shows a structural block diagram of an information interaction device according to an embodiment of the present disclosure. The device can be implemented as part or all of an electronic device through software, hardware or a combination of the two. As shown in Figure 7, the information interaction device includes:
识别模块701,被配置为响应于检测到对于屏幕的第一预设动作,识别所述第一预设动作对应的第一动作对象;The identifying module 701 is configured to, in response to detecting a first preset action on the screen, identify a first action object corresponding to the first preset action;
设置模块702,被配置为锁定所述第一动作对象,并将锁定的第一动作对象设置为可编辑对象;A setting module 702 configured to lock the first action object, and set the locked first action object as an editable object;
执行模块703,被配置为响应于检测到对于所述可编辑对象的第二预设动作,识别所述第二预设动作对应的第二动作对象,并基于所述第二动作对象执行相应的预设操作。The execution module 703 is configured to, in response to detecting a second preset action on the editable object, identify a second action object corresponding to the second preset action, and execute a corresponding action based on the second action object Default action.
上文提及,随着互联网、电子设备技术的发展,越来越多的事情都可以在电子设备上完成,比如:浏览新闻、查看文档、听音乐、观看视频等等,当用户浏览到一段文字或者一幅图片时,经常对于该段文字或者图片产生兴趣,想要得到更多的相关的信息,目前现有技术已经能够实现基于给定文字或者给定图片的搜索,但目前的图片识别搜索仅限于进行整体图片内容相似度的搜索,无法对于图片内容进行选择性的精细搜索。比如,现在越来越多的用户使用外卖平台选择外卖解决就餐问题,但外卖平台上的菜品图片往往是多元化的、复杂的,不仅包括不同的食材,也包括不同菜品的组合,用户在浏览图片进行选择时,随时可能基于这些图片内容信息激发搜索其他相关菜品的需求,目前的外卖平台技术无法满足这一需求,更不用说当用户只对菜品组合中的一部分感兴趣,想要就搜索图片中的一部分内容进行精细搜索了。As mentioned above, with the development of the Internet and electronic device technology, more and more things can be done on electronic devices, such as: browsing news, viewing documents, listening to music, watching videos, etc. When users browse to a When viewing text or a picture, I often become interested in the text or picture and want to get more relevant information. At present, the existing technology can realize the search based on the given text or a given picture, but the current picture recognition The search is limited to the search for the similarity of the overall picture content, and it is not possible to conduct selective fine-grained search for the picture content. For example, more and more users use takeaway platforms to choose takeaway to solve their dining problems, but the pictures of dishes on the takeaway platform are often diversified and complex, including not only different ingredients, but also combinations of different dishes. Users browse When selecting pictures, the need to search for other related dishes may be triggered at any time based on the content information of these pictures. The current takeaway platform technology cannot meet this demand, let alone when users are only interested in a part of the dish combination, just search Part of the content in the picture has been refined.
考虑到上述缺陷,在该实施方式中,提出一种信息交互装置,该装置当检测到对于屏幕的第一预设动作时,通过识别模块701识别所述第一预设动作对应的第一动作对象;设置模块702锁定所述第一动作对象,将其设置为可编辑对象;当检测到对于所述可编辑对象的第二预设动作时,执行模块703识别所述第二预设动作对应的第二动作对象,并基于所述第二动作对象执行相应的预设操作。该方案能够实现更为精准的搜索对象选择,从而为用户提供更多的更有价值的信息,进而能够大大提高用户的操作效率,节省用户宝贵的时间,为用户的使用带来极大的便利。Considering the above defects, in this embodiment, an information interaction device is proposed. When the device detects the first preset action on the screen, it uses the identification module 701 to identify the first action corresponding to the first preset action object; the setting module 702 locks the first action object and sets it as an editable object; when detecting a second preset action for the editable object, the execution module 703 identifies that the second preset action corresponds to the second action object, and execute the corresponding preset operation based on the second action object. This solution can realize more accurate search object selection, thereby providing users with more and more valuable information, which can greatly improve the user's operation efficiency, save the user's precious time, and bring great convenience to the user's use .
其中,所述预设操作可以为检索、搜索、匹配等预设操作,下文以搜索操作为例对于本技术方案进行说明。Wherein, the preset operation may be a preset operation such as retrieval, search, and matching, and the technical solution will be described below by taking the search operation as an example.
在本实施例的一个可选实现方式中,如图8所示,所述识别模块701包括:In an optional implementation of this embodiment, as shown in FIG. 8, the identification module 701 includes:
第一检测子模块801,被配置为检测对于屏幕的第一预设动作;The first detection submodule 801 is configured to detect a first preset action on the screen;
第一获取子模块802,被配置为响应于检测到所述第一预设动作,获取所述第一预设动作对应的候选第一动作对象;The first acquiring submodule 802 is configured to acquire a candidate first action object corresponding to the first preset action in response to detecting the first preset action;
第二获取子模块803,被配置为获取所述候选第一动作对象所在的区域;The second acquiring submodule 803 is configured to acquire the area where the candidate first action object is located;
第一确定子模块804,被配置为将与所述第一预设动作发生点之间的距离最近的候选第一动作对象确定为所述第一动作对象。The first determining submodule 804 is configured to determine a candidate first action object with the shortest distance to the first preset action occurrence point as the first action object.
考虑到屏幕显示内容区域大小不一,因此,在屏幕上产生的动作有可能会有意或无意地覆盖两个或两个以上的对象区域,为了准确识别用户想要搜索的目标对象的所在,保障后续搜索的准确率,在该实施方式中,当第一检测子模块801检测到对于屏幕的第一预设动作时,第一获取子模块802获取所述第一预设动作对应的一个或多个候选第一动作对象,第二获取子模块803获取所述候选第一动作对象所在的区域,与所述第一预设动作发生点的距离最近的候选第一动作对象可认为是用户想要搜索的目标对象,因此第一确定子模块804将该候选第一动作对象确定为所述第一动作对象。Considering that the size of the content area displayed on the screen is different, the actions generated on the screen may intentionally or unintentionally cover two or more object areas. In order to accurately identify the location of the target object that the user wants to search, it is guaranteed The accuracy rate of the subsequent search. In this embodiment, when the first detection submodule 801 detects the first preset action on the screen, the first acquisition submodule 802 acquires one or more candidate first action object, the second acquisition submodule 803 acquires the area where the candidate first action object is located, and the candidate first action object with the shortest distance to the first preset action occurrence point can be considered as the one that the user wants The searched target object, so the first determining submodule 804 determines the candidate first action object as the first action object.
其中,所述第一预设动作可以为单指长按、双指长按、多指长按、单击、双击、连续多击、单指滑动、双指滑动、多指滑动等动作,具体可根据实际应用的需要进行设置。另外,所述第一预设动作可预先进行设置,也可后续根据用户的使用习惯进行个性化设置。Wherein, the first preset action may be actions such as single-finger long press, two-finger long press, multi-finger long press, single-click, double-click, continuous multi-tap, single-finger slide, two-finger slide, multi-finger slide, etc. It can be set according to the needs of practical applications. In addition, the first preset action can be set in advance, or can be personalized later according to the usage habits of the user.
在本实施例的一个可选实现方式中,对于所述设置模块702,锁定所述第一动作对象,并将锁定的第一动作对象设置为可编辑对象,指的是,只将所述第一预设动作对应的第一动作对象设置为可编辑对象,将所述屏幕上、除第一动作对象外的其他显示对象均设置为非可编辑对象,以提高用户目标对象识别的准确率。In an optional implementation of this embodiment, for the setting module 702, the first action object is locked, and the locked first action object is set as an editable object, that is, only the first action object The first action object corresponding to a preset action is set as an editable object, and all other display objects on the screen except the first action object are set as non-editable objects, so as to improve the accuracy of user target object recognition.
在本实施例的一个可选实现方式中,如图9所示,所述执行模块703包括:In an optional implementation of this embodiment, as shown in FIG. 9, the execution module 703 includes:
第二检测子模块901,被配置为检测对于所述可编辑对象的第二预设动作;The second detection submodule 901 is configured to detect a second preset action on the editable object;
第二确定子模块902,被配置为响应于检测到所述第二预设动作,识别所述第二预设动作对应的第二动作对象,并将所述第二动作对象确定为搜索对象;The second determining submodule 902 is configured to, in response to detecting the second preset action, identify a second action object corresponding to the second preset action, and determine the second action object as a search object;
第一执行子模块903,被配置为基于所述搜索对象执行搜索操作。The first execution sub-module 903 is configured to execute a search operation based on the search object.
获取可编辑对象后,可利用第二预设动作来精确确定后续搜索所针对的搜索对象,即在该实施方式中,在第二检测子模块901检测到对于所述可编辑对象的第二预设动作时,第二确定子模块902识别所述第二预设动作对应的第二动作对象,第一执行子模块903将所述第二动作对象确定为搜索对象执行搜索操作。After the editable object is obtained, the second preset action can be used to accurately determine the search object for the subsequent search, that is, in this embodiment, the second detection submodule 901 detects the second preset action for the editable object. When an action is set, the second determination submodule 902 identifies a second action object corresponding to the second preset action, and the first execution submodule 903 determines the second action object as a search object to perform a search operation.
进一步地,在所述第二确定子模块902确定了搜索对象之后,还可对于所述搜索对象进行预设方式显示,比如将所述搜索对象进行高亮显示,将所述屏幕上、可编辑对象中除所述搜索对象外的其他对象进行非高亮或者灰度显示,以对所述搜索对象进行突出显示,引起用户的注意,便于用户进一步确定搜索对象的选择是否准确。Further, after the second determining submodule 902 determines the search object, it can also display the search object in a preset manner, such as highlighting the search object, and displaying the editable Objects in the objects other than the search object are displayed in non-highlight or in grayscale, so as to highlight the search object and draw the attention of the user, so as to facilitate the user to further determine whether the selection of the search object is accurate.
在本实施例的一个可选实现方式中,如图10所示,所述执行模块703包括:In an optional implementation of this embodiment, as shown in FIG. 10, the execution module 703 includes:
第三检测子模块1001,被配置为检测对于所述可编辑对象的第二预设动作;The third detection submodule 1001 is configured to detect a second preset action on the editable object;
识别子模块1002,被配置为响应于检测到所述第二预设动作,识别所述第二预设动作对应的第二动作对象;The identifying submodule 1002 is configured to, in response to detecting the second preset action, identify a second action object corresponding to the second preset action;
第三确定子模块1003,被配置为将所述可编辑对象中除所述第二动作对象外的对象确定为搜索对象;The third determining submodule 1003 is configured to determine objects in the editable objects except the second action object as search objects;
第二执行子模块1004,被配置为基于所述搜索对象执行搜索操作。The second execution sub-module 1004 is configured to execute a search operation based on the search object.
考虑到在有些情况下,比如当想要搜索的目标对象范围较大,至少大于不想要搜索的对象时,用户会产生通过反选确定搜索目标对象的需求,因此,在该实施方式中,实现基于反选策略来确定最终的搜索对象的目的。与上一实施方式类似,在该实施方式中,通过第三检测子模块1001检测对于所述可编辑对象的第二预设动作,通过识别子模块1002识别所述第二预设动作对应的第二动作对象,但与上一实施方式不同的是,所述第二动作对象与上一实施方式中的第二动作对象不同,该实施方式中的第二动作对象是用户不想要进行后续搜索的对象,因此,在识别子模块1002识别得到第二动作对象后,第三确定子模块1003将所述可编辑对象中除所述第二动作对象外的对象确定为搜索对象,第二执行子模块1004基于所述搜索对象执行搜索操作。Considering that in some cases, for example, when the target object to be searched has a large range, at least larger than the object not to be searched, the user will have the need to determine the search target object through inverse selection, therefore, in this embodiment, the implementation is based on Anti-selection strategy to determine the purpose of the final search object. Similar to the previous embodiment, in this embodiment, the third detection sub-module 1001 is used to detect the second preset action on the editable object, and the identification sub-module 1002 is used to identify the second default action corresponding to the second preset action. Two action objects, but different from the previous embodiment, the second action object is different from the second action object in the previous embodiment, the second action object in this embodiment is the user does not want to perform subsequent search object, therefore, after the identification sub-module 1002 identifies the second action object, the third determination sub-module 1003 determines the objects in the editable objects except the second action object as search objects, and the second execution sub-module 1004 Execute a search operation based on the search object.
其中,为了更为精确地确定后续搜索所针对的搜索对象,可为所述第二预设动作设置相应的动作要求,比如可要求所述第二预设动作为一种闭合动作,比如,单指或多指划出的闭合的圆圈等等;或者所述第二预设动作最终可形成一种闭合图形,比如,用户进行涂抹动作,最后可对涂抹区域进行边缘识别,形成边缘闭合图形。Wherein, in order to more accurately determine the search object for the subsequent search, corresponding action requirements can be set for the second preset action, for example, the second preset action can be required to be a closing action, for example, a single A closed circle drawn by one or more fingers; or the second preset action can finally form a closed figure, for example, the user performs a smear action, and finally can perform edge recognition on the smeared area to form a closed figure.
进一步地,当检测到所述第二预设动作未达到所述动作要求,则将所述第二预设动作认定为无效动作。Further, when it is detected that the second preset action does not meet the action requirement, the second preset action is identified as an invalid action.
需要注意的是,所述第二预设动作不同于所述第一预设动作。另外,与所述第一预设动作类似,所述第二预设动作可预先进行设置,也可后续根据用户的使用习惯进行个性化设置。It should be noted that the second preset action is different from the first preset action. In addition, similar to the first preset action, the second preset action can be set in advance, or can be personalized later according to the user's usage habits.
在本实施例的一个可选实现方式中,如图11所示,所述第一执行子模块903或者第二执行子模块1004包括:In an optional implementation of this embodiment, as shown in FIG. 11 , the first execution submodule 903 or the second execution submodule 1004 includes:
第四确定子模块1101,被配置为确定搜索命令显示区域,所述搜索命令显示区域与所述搜索对象所在区域之间的距离小于预设距离阈值;The fourth determination sub-module 1101 is configured to determine a search command display area, the distance between the search command display area and the area where the search object is located is less than a preset distance threshold;
第一显示子模块1102,被配置为在所述搜索命令显示区域中显示搜索命令;The first display submodule 1102 is configured to display a search command in the search command display area;
第三执行子模块1103,被配置为响应于对于所述搜索命令的触发,基于所述搜索对象执行搜索操作。The third execution sub-module 1103 is configured to execute a search operation based on the search object in response to the trigger of the search command.
为了进一步方便用户的操作,在该实施方式中,第四确定子模块1101在所述搜索对象所在区域附近的位置处设置搜索命令显示区域,用来提供给第一显示子模块1102显示搜索命令,其中,所述搜索命令显示区域可以为一个显示搜索字样的区域、一个搜索按钮、一个搜索控件等;第三执行子模块1103响应于用户对于所述搜索命令的触发,基于之前已经确定的搜索对象执行搜索操作。In order to further facilitate the user's operation, in this embodiment, the fourth determination submodule 1101 sets a search command display area near the area where the search object is located, to provide the first display submodule 1102 to display the search command, Wherein, the search command display area can be an area displaying search words, a search button, a search control, etc.; the third execution sub-module 1103 responds to the trigger of the search command by the user, based on the previously determined search object Perform a search operation.
在本实施例的一个可选实现方式中,为了对搜索对象的确定进行及时的响应,但又不致让用户等待太长的时间,因此,在确定所述搜索对象之后的一预设时间后,在所述搜索命令显示区域中显示搜索命令,其中,所述预设时间比如可设置为2秒、3秒等时间。In an optional implementation of this embodiment, in order to respond to the determination of the search object in a timely manner without causing the user to wait too long, after a preset time after the search object is determined, The search command is displayed in the search command display area, wherein the preset time can be set as 2 seconds, 3 seconds, etc., for example.
在本实施例的一个可选实现方式中,如图12所示,所述装置还包括:In an optional implementation of this embodiment, as shown in FIG. 12, the device further includes:
第三获取子模块1201,被配置为获取搜索结果;The third acquiring submodule 1201 is configured to acquire search results;
计算子模块1202,被配置为计算所述搜索结果与所述搜索对象之间的相似度;Calculation sub-module 1202, configured to calculate the similarity between the search result and the search object;
排序子模块1203,被配置为按照所述相似度从大到小的顺序对于所述搜索结果进行排序;The sorting submodule 1203 is configured to sort the search results in descending order of the similarity;
第二显示子模块1204,被配置为根据排序结果显示所述搜索结果。The second display submodule 1204 is configured to display the search results according to the sorting results.
考虑到搜索结果数量比较大,为了给用户提供更符合其期望的搜索结果,在该实施方式中,计算子模块1202计算第三获取子模块1201获取得到的搜索结果与所述搜索对象之间的相似度,排序子模块1203按照所述相似度从大到小的顺序对于所述搜索结果进行排序,第二显示子模块1204根据排序结果依次显示所述搜索结果供用户选择。Considering that the number of search results is relatively large, in order to provide users with search results more in line with their expectations, in this embodiment, the calculation submodule 1202 calculates the distance between the search results obtained by the third acquisition submodule 1201 and the search object The similarity sorting submodule 1203 sorts the search results in descending order of the similarity, and the second display submodule 1204 sequentially displays the search results for the user to choose according to the sorting results.
本公开还公开了一种电子设备,图13示出根据本公开一实施方式的电子设备的结构框图,如图13所示,所述电子设备1300包括存储器1301和处理器1302;其中,The present disclosure also discloses an electronic device. FIG. 13 shows a structural block diagram of an electronic device according to an embodiment of the present disclosure. As shown in FIG. 13 , the electronic device 1300 includes a memory 1301 and a processor 1302; wherein,
所述存储器1301用于存储一条或多条计算机指令,其中,所述一条或多条计算机指令被所述处理器1302执行以实现上述任一方法步骤。The memory 1301 is used to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor 1302 to implement any of the above method steps.
图14适于用来实现根据本公开实施方式的信息交互方法的计算机系统的结构示意图。Fig. 14 is a schematic structural diagram of a computer system suitable for implementing the information interaction method according to the embodiment of the present disclosure.
如图14所示,计算机系统1400包括中央处理单元(CPU)1401,其可以根据存储在只读存储器(ROM)1402中的程序或者从存储部分1408加载到随机访问存储器(RAM)1403中的程序而执行上述实施方式中的各种处理。在RAM1403中,还存储有系统1400操作所需的各种程序和数据。CPU1401、ROM1402以及RAM1403通过总线1404彼此相连。输入/输出(I/O)接口1405也连接至总线1404。As shown in FIG. 14 , a computer system 1400 includes a central processing unit (CPU) 1401, which can operate according to a program stored in a read-only memory (ROM) 1402 or a program loaded from a storage section 1408 into a random access memory (RAM) 1403 Instead, various processes in the above-described embodiments are executed. In the RAM 1403, various programs and data necessary for the operation of the system 1400 are also stored. The CPU 1401 , ROM 1402 , and RAM 1403 are connected to each other via a bus 1404 . An input/output (I/O) interface 1405 is also connected to the bus 1404 .
以下部件连接至I/O接口1405:包括键盘、鼠标等的输入部分1406;包括诸如阴极射线管(CRT)、液晶显示器(LCD)等以及扬声器等的输出部分1407;包括硬盘等的存储部分1408;以及包括诸如LAN卡、调制解调器等的网络接口卡的通信部分1409。通信部分1409经由诸如因特网的网络执行通信处理。驱动器1410也根据需要连接至I/O接口1405。可拆卸介质1411,诸如磁盘、光盘、磁光盘、半导体存储器等等,根据需要安装在驱动器1410上,以便于从其上读出的计算机程序根据需要被安装入存储部分1408。The following components are connected to the I/O interface 1405: an input section 1406 including a keyboard, a mouse, etc.; an output section 1407 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 1408 including a hard disk, etc. and a communication section 1409 including a network interface card such as a LAN card, a modem, or the like. The communication section 1409 performs communication processing via a network such as the Internet. A drive 1410 is also connected to the I/O interface 1405 as needed. A removable medium 1411 such as a magnetic disk, optical disk, magneto-optical disk, semiconductor memory, etc. is mounted on the drive 1410 as necessary so that a computer program read therefrom is installed into the storage section 1408 as necessary.
特别地,根据本公开的实施方式,上文描述的方法可以被实现为计算机软件程序。例如,本公开的实施方式包括一种计算机程序产品,其包括有形地包含在及其可读介质上的计算机程序,所述计算机程序包含用于执行所述信息交互方法的程序代码。在这样的实施方式中,该计算机程序可以通过通信部分1409从网络上被下载和安装,和/或从可拆卸介质1411被安装。In particular, according to an embodiment of the present disclosure, the methods described above can be implemented as a computer software program. For example, the embodiments of the present disclosure include a computer program product including a computer program tangibly embodied on its readable medium, the computer program including program code for executing the information interaction method. In such an embodiment, the computer program may be downloaded and installed from a network via communication portion 1409 and/or installed from removable media 1411 .
附图中的流程图和框图,图示了按照本公开各种实施方式的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,路程图或框图中的每个方框可以代表一个模块、程序段或代码的一部分,所述模块、程序段或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个接连地表示的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in a roadmap or block diagram may represent a module, program segment, or part of code that contains one or more Executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified functions or operations , or may be implemented by a combination of dedicated hardware and computer instructions.
描述于本公开实施方式中所涉及到的单元或模块可以通过软件的方式实现,也可以通过硬件的方式来实现。所描述的单元或模块也可以设置在处理器中,这些单元或模块的名称在某种情况下并不构成对该单元或模块本身的限定。The units or modules involved in the embodiments described in the present disclosure may be implemented by means of software or hardware. The described units or modules may also be set in the processor, and the names of these units or modules do not constitute limitations on the units or modules themselves in some cases.
作为另一方面,本公开还提供了一种计算机可读存储介质,该计算机可读存储介质可以是上述实施方式中所述装置中所包含的计算机可读存储介质;也可以是单独存在,未装配入设备中的计算机可读存储介质。计算机可读存储介质存储有一个或者一个以上程序,所述程序被一个或者一个以上的处理器用来执行描述于本公开的方法。As another aspect, the present disclosure also provides a computer-readable storage medium. The computer-readable storage medium may be the computer-readable storage medium included in the device described in the above-mentioned embodiments; A computer-readable storage medium assembled in a device. The computer-readable storage medium stores one or more programs, and the programs are used by one or more processors to execute the methods described in the present disclosure.
以上描述仅为本公开的较佳实施例以及对所运用技术原理的说明。本领域技术人员应当理解,本公开中所涉及的发明范围,并不限于上述技术特征的特定组合而成的技术方案,同时也应涵盖在不脱离所述发明构思的情况下,由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本公开中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。The above description is only a preferred embodiment of the present disclosure and an illustration of the applied technical principle. It should be understood by those skilled in the art that the scope of the invention involved in this disclosure is not limited to the technical solution formed by the specific combination of the above technical features, but also covers the technical solutions made by the above technical features without departing from the inventive concept. Other technical solutions formed by any combination of or equivalent features thereof. For example, a technical solution formed by replacing the above-mentioned features with technical features disclosed in this disclosure (but not limited to) having similar functions.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810582696.1A CN108874262A (en) | 2018-06-07 | 2018-06-07 | Information interacting method, device, electronic equipment and computer readable storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810582696.1A CN108874262A (en) | 2018-06-07 | 2018-06-07 | Information interacting method, device, electronic equipment and computer readable storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108874262A true CN108874262A (en) | 2018-11-23 |
Family
ID=64338515
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810582696.1A Pending CN108874262A (en) | 2018-06-07 | 2018-06-07 | Information interacting method, device, electronic equipment and computer readable storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108874262A (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106919326A (en) * | 2015-12-25 | 2017-07-04 | 阿里巴巴集团控股有限公司 | A kind of image searching method and device |
CN107515868A (en) * | 2016-06-15 | 2017-12-26 | 北京陌上花科技有限公司 | Searching method and device |
CN107515872A (en) * | 2016-06-15 | 2017-12-26 | 北京陌上花科技有限公司 | Searching method and device |
CN107515871A (en) * | 2016-06-15 | 2017-12-26 | 北京陌上花科技有限公司 | Searching method and device |
-
2018
- 2018-06-07 CN CN201810582696.1A patent/CN108874262A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106919326A (en) * | 2015-12-25 | 2017-07-04 | 阿里巴巴集团控股有限公司 | A kind of image searching method and device |
CN107515868A (en) * | 2016-06-15 | 2017-12-26 | 北京陌上花科技有限公司 | Searching method and device |
CN107515872A (en) * | 2016-06-15 | 2017-12-26 | 北京陌上花科技有限公司 | Searching method and device |
CN107515871A (en) * | 2016-06-15 | 2017-12-26 | 北京陌上花科技有限公司 | Searching method and device |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11157577B2 (en) | Method for searching and device thereof | |
US10198439B2 (en) | Presenting translations of text depicted in images | |
CN106484266B (en) | Text processing method and device | |
WO2022111249A1 (en) | Information presentation method, apparatus, and computer storage medium | |
US10254935B2 (en) | Systems and methods of providing content selection | |
US9239833B2 (en) | Presenting translations of text depicted in images | |
JP5947131B2 (en) | Search input method and system by region selection method | |
US20150339348A1 (en) | Search method and device | |
US11734370B2 (en) | Method for searching and device thereof | |
WO2022089594A1 (en) | Information display method and apparatus, and electronic device | |
WO2023087934A1 (en) | Voice control method, apparatus, device, and computer storage medium | |
EP2947584A1 (en) | Multimodal search method and device | |
CN113641638A (en) | Application management method, device, electronic device and storage medium | |
CN112882623A (en) | Text processing method and device, electronic equipment and storage medium | |
CN105824552A (en) | Text information recognition method and device | |
US11003830B2 (en) | Providing location-based font recommendations | |
CN114417169A (en) | Information recommendation optimization method, device, medium, and program product | |
CN102968266A (en) | Identification method and device | |
WO2015101945A1 (en) | Generating a news timeline and recommended news editions | |
CN113311973A (en) | Recommendation method and device | |
WO2020253368A1 (en) | Electronic reading display method, storage method, electronic device, computer device, and medium | |
US20110271174A1 (en) | Automatic Visual Preview of Non-Visual Data | |
WO2023061276A1 (en) | Data recommendation method and apparatus, electronic device, and storage medium | |
CN106919593B (en) | A search method and device | |
WO2024149183A1 (en) | Document display method and apparatus, and electronic device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181123 |