CN120653347A

CN120653347A - Information processing method and device

Info

Publication number: CN120653347A
Application number: CN202510727236.3A
Authority: CN
Inventors: 么锐锋; 李翔
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2025-05-30
Filing date: 2025-05-30
Publication date: 2025-09-16

Abstract

The present application discloses an information processing method and device, which includes: displaying a first window and a second window side by side in response to a target operation; wherein the first window and the second window belong to the same association group, the first window corresponds to a first application, the intelligent function of the first application has the ability to call an intelligent model to complete the intelligent function, and the second window corresponds to the second application; based on the association group, the processing object of the intelligent function of the first application comes from the display content of the second window.

Description

Information processing method and device

Technical Field

The present application relates to the field of artificial intelligence technologies, and in particular, to an information processing method and apparatus.

Background

In using applications such as documents, photo displays, or mailboxes, users often need to search, text translate, or otherwise process some of the display content in the application using smart models. In this case, the user may need to manually switch between the window interface of the application and the window interface corresponding to the intelligent model multiple times, so as to complete the purpose of processing the related content by means of the intelligent model, which results in higher complexity of information processing.

Disclosure of Invention

In one aspect, the present application provides an information processing method, including:

Responding to target operation, and displaying a first window and a second window side by side, wherein the first window and the second window belong to the same association group, the first window corresponds to a first application, an intelligent function of the first application has the capability of calling an intelligent model to complete the intelligent function, and the second window corresponds to a second application;

based on the association group, the processing object of the smart function of the first application comes from the display content of the second window.

In a possible implementation manner, the processing object of the intelligent function of the first application is from the display content of the second window based on the association group, including:

Acquiring target content of the second window based on the association group, wherein the target content belongs to at least part of page content output by the second window;

Based on the target content, at least one target smart function in the first application that can be used to process the target content is determined.

In yet another possible implementation manner, the determining, based on the target content, at least one target intelligent function in the first application that can be used to process the target content includes:

Based on the target content, an operational option of at least one target smart function that can be used to process the target content is displayed within a first window.

and based on the target content, displaying a processing result of at least one target intelligent function on the target content in the first window.

and switching a first window to a target display mode based on the target content, wherein in the target display mode, the first window displays association information associated with at least one target intelligent function, and the target intelligent function is an intelligent function which can be used for processing the target content in a first application.

In yet another possible implementation manner, the method further includes:

generating a suspension operation bar, and displaying the suspension operation bar in a position range corresponding to the second window, wherein operation options of the at least one target intelligent function are displayed in the suspension operation bar.

In yet another possible implementation manner, the displaying the first window and the second window side by side in response to the target operation includes:

Responding to a target operation for triggering at least one edge of a first window and a second window to be attached, determining that the first window and the second window belong to the same association group, and displaying the first window and the second window side by side;

Or displaying the first window and the second window side-by-side in response to a target operation for triggering presentation of at least one of the first window and the second window with which the association exists.

In yet another possible implementation manner, the method further includes:

in response to a first operation, disassociating the first window from the second window;

Or in response to a second operation in the second window, displaying a third window, adding the third window to the association group corresponding to the first window and the second window, and displaying the first window, the second window and the third window side by side;

or in response to a second operation in the second window, displaying a third window, determining that the third window and the first window are in the same association group, and displaying the first window and the third window side by side.

In yet another possible implementation manner, the method further includes:

And responding to the input operation input in the input box of the first window, obtaining the input content of the input operation, and processing the input content based on the intelligent function in the first application.

In still another aspect, the present application also provides an information processing apparatus, including:

The system comprises a window display unit, a first window display unit and a second window display unit, wherein the window display unit is used for responding to target operation and displaying a first window and a second window side by side, the first window and the second window belong to the same association group, the first window corresponds to a first application, an intelligent function of the first application has the capability of calling an intelligent model to complete the intelligent function, and the second window corresponds to a second application;

And the object determining unit is used for determining the processing object of the intelligent function of the first application from the display content of the second window based on the association group.

Drawings

The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.

FIG. 1 is a schematic flow chart of an information processing method according to the present application;

FIG. 2 is a schematic flow chart of another information processing method according to the present application;

FIG. 3 is a schematic flow chart of another information processing method according to the present application;

FIG. 4 illustrates an example diagram of a first window and a second window belonging to an association group and displayed side-by-side;

FIG. 5 is a schematic flow chart of another information processing method according to the present application;

FIG. 6 is a schematic flow chart of another information processing method according to the present application;

FIGS. 7 and 8 are diagrams respectively showing examples of the effect of the target smart function exhibited by the first window associated with the second different window;

FIG. 9 is a schematic flow chart of another information processing method according to the present application;

FIGS. 10 to 12 are diagrams showing an example of an implementation procedure for establishing an association group of a first window and a second window by a target operation;

FIG. 13 is a diagram showing an example of the operation of establishing an association group of a first window and a second window;

fig. 14 is a schematic view showing a constitution of an information processing apparatus provided by the present application;

fig. 15 shows a schematic diagram of a composition structure of an electronic device provided by the present application.

Detailed Description

Embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application. The terminology used in the description of the embodiments of the application herein is for the purpose of describing particular embodiments of the application only and is not intended to be limiting of the application. As one of ordinary skill in the art can know, with the development of technology and the appearance of new scenes, the technical scheme provided by the embodiment of the application is also applicable to similar technical problems.

The terms first, second and the like in the description and in the claims and in the above-described figures, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances and are merely illustrative of the manner in which embodiments of the application have been described in connection with the description of the objects having the same attributes. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of elements is not necessarily limited to those elements, but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.

Referring to fig. 1, a flow diagram of an information processing method provided by the present application is shown, where the method of the present embodiment may be applied to an electronic device, and the method of the present embodiment may include:

S101, in response to a target operation, displaying the first window and the second window side by side.

Wherein the first window and the second window belong to the same association group. For example, in response to a target operation, an association between the first window and the second window may be established, and it is determined that the first window and the second window belong to the same association group. For another example, if the first window and the second window have established an association belonging to the same association group before the target operation is detected, there is no need to repeatedly establish the association of the first window and the second window.

The first window corresponds to a first application, and an intelligent function of the first application has the capability of calling an intelligent model to complete the intelligent function. One or more intelligent models can be arranged in the first application, and in the running process of the first application, the first application can start one or more intelligent models to execute task processing according to actual needs, or the first application can call different intelligent models through call interfaces corresponding to the different intelligent models.

Wherein the first application may have at least one intelligent function. The smart function of the first application is a function that implements task reasoning by means of a smart model. For example, the intelligent function may be part or all of abstract extraction, text expansion, extracting image semantics, text graphs, translation, and the like. Wherein each intelligent function of the first application may be implemented by invoking one or more process models. Of course, the processing models invoked by different intelligent functions may be the same, partially the same, or completely different, without limitation.

The second window corresponds to a second application, the second application being different from the first application. For example, the second application may be an application that does not have the ability to invoke the smart model, e.g., the second application may be a word application, a browser, a presentation application.

The first window and the second window can be displayed horizontally side by side or vertically side by side, and the relative positions of the first window and the second window in the side by side display can be unrestricted. For example, the first window and the second window are displayed horizontally side by side with the first window being positioned on the left side of the second window, or alternatively, the first window and the second window are displayed vertically side by side with the first window being positioned on the right side of the second window.

In an alternative way, in order to more clearly show that the first window and the second window belong to the same association group, and distinguish the side-by-side display of the two windows which are not associated with each other conventionally, in the application, the first window and the second window can be displayed in parallel for the first window and the second window to be displayed side by side, and an edge is present between the second window and the second window to be mutually attached, so that the first window and the second window displayed side by side show the effect of mutually adsorbing to become an integral window.

S102, based on the association group, the processing object of the intelligent function of the first application comes from the display content of the second window.

For example, based on the association group, a processing object of the smart function of the first application is determined, the processing object being from the display content of the second window.

In the application, if the first window and the second window belong to the same association group, the first application to which the first window belongs can provide the service corresponding to the intelligent function for the second window. On the basis, if the first window and the second window are in a side-by-side display state, the display content of the second window can be automatically used as the display content which can be processed by the intelligent function of the first application, so that the effect that the second window of the second application which does not originally have the intelligent function can also have the intelligent function provided by the first application is realized.

It can be understood that, because the first window and the second window are displayed side by side, the first window and the second window are located on the same display level, after the display content of the second window is automatically used as the display content that can be processed by the intelligent function of the first application, the user can simultaneously see the display content of the second window, the processing of the display content in the second window by the first window, and the like, so that the user can intuitively feel the effect as if the second window supports the intelligent function.

In particular, if the first application has a plurality of interface windows, since the smart functions supported by the different interface windows are different, based on the association group, it may be that the processing object of the smart function provided by the first window of the first application is caused to come from the display content of the second window.

It should be noted that, in the present application, the operations in steps S101 and S102 may be performed in response to the target operation by the operating system of the electronic device, or the operations may be performed by the first application, which is not limited in particular

As can be seen from the above, in the present application, in response to the target operation, the first window and the second window are displayed side by side, and since the first window and the second window displayed side by side belong to the same association group, the processing object of the intelligent function of the first application can come from the display content of the second window, so that the display content in the second window can be processed directly by means of the intelligent function of the first application with the capability of calling the intelligent model, and therefore, even if the second application does not have the capability of calling the intelligent model, the display content of the second window does not need to be processed by calling the processing models in other applications through complex operations, and the complexity of information processing is reduced.

Wherein, the display content of the processing object of the intelligent function of the first application from the second window can be made to have multiple possibilities, and the following several possibilities are described.

As shown in fig. 2, which is a schematic flow chart of an information processing method provided by the present application, the method of this embodiment may include:

S201, in response to a target operation, displaying the first window and the second window side by side.

Wherein the first window and the second window belong to the same association group.

The first window corresponds to a first application, the intelligent function of the first application has the capability of calling the intelligent model to complete the intelligent function, and the second window corresponds to a second application.

S202, obtaining target content of the second window based on the association group.

In the application, the first window and the second window are displayed side by side in response to the target operation, and simultaneously or later, the target content which can be the processing object of the intelligent function in the first application is automatically displayed from the second window.

Wherein the target content belongs to at least part of the content of the page content output by the second window.

There are many possible implementations for obtaining the target content, and the following are illustrated in several implementations;

In one possible implementation, the target content may be obtained that is currently located within the display area of the second window.

It will be appreciated that the content within the second window that the user wishes to process by means of the smart model will be what the user can see, and therefore, the display content output by the second window and located within the display area of the second window may be targeted, while the content output by the second window that is not located within the display area may not be targeted.

For example, taking the second window as a document containing graphics and texts, if the display area of the second window is limited, it is possible that only part of the content of the document is presented and the other content is hidden, then only the content displayed in the display area of the second window in the document is determined to be the target content.

In yet another possible implementation, the page content of the page output within the second window may be obtained.

The page content of the page output in the second window not only includes the content in the display area of the second window presented in the page output in the second window, but also includes the content in the display area of the second window not presented currently in the page, that is, all page contents corresponding to the page output in the second window are obtained.

By means of the implementation mode, the situation that the content which the user wants to process by the intelligent model is not displayed and cannot be processed by the intelligent model due to the fact that the second window is zoomed can be reduced. For example, when a user wants to obtain an article to generate a summary, since the displayed display area of the second window is smaller, the content portion of the article that is presented in the display area of the second window is smaller, and if the summary is generated only on the article content that is in the display area of the second window, the generated summary content cannot fully reflect the entire content of the article, so that it is necessary to use both the display area of the article that is displayed in the second window and the portion of the article that is not presented in the display area of the second window as object content that can be processed by the smart function of the first application.

In yet another possible implementation, the present application may obtain the target content in the second window based on the smart functionality that the first window can provide. Wherein the target content belongs to object content that can be processed by the smart function provided by the first window.

In the present application, the first application may have at least one presentable interface window, and the intelligent functions supported by different interface windows may also be different.

For example, assume that a first application is an application that is capable of providing multi-modal data processing and of providing a plurality of different types of intelligent functions. On the basis, the first application can be provided with a plurality of window interfaces, different window interfaces can provide at least one intelligent function, and each intelligent function provided by the same window interface can belong to the same intelligent function or can be an intelligent function capable of processing data in the same mode or a plurality of modes. Correspondingly, different window icons in the main interface of the first application are triggered and displayed by clicking on the different window icons in the main interface of the first application.

For example, a first application having an "AI composition" window, an "AI drawing" window, and an "AI dialogue interaction" window, the kinds and data of the intelligent functions supported by the different windows may differ. Such as "AI authoring" windows support article generation, content summarization, content diffusion, translation, picture-to-text, etc. Moreover, the main interface of the first application may display three window icons of "AI writing", "AI drawing" and "AI dialogue interaction", and click on the corresponding window icon then enters the responsive window interface.

It follows that if a portion of the content within the second window does not belong to data that can be processed by the smart function provided by the first window, it is naturally impossible to process the portion of the content by means of the smart function provided by the first window. Based on the method, the device and the system, the intelligent function provided by the first window can be combined, and the content which can be processed by the intelligent function belonging to the first window is determined from the second window as the target content.

For example, the first window only supports translation, content scaling or abstract extraction of text content, so if the second window contains a picture, the picture cannot be processed by the intelligent function in the first window, and therefore, the application can only take the content belonging to the text in the page output by the second window (such as the content belonging to the text in the display area of the second window, or the page content belonging to the text in the page output by the second window) as the target content.

Of course, other implementations are possible to obtain the target content in practical applications, and there is no limitation to this.

S203, determining at least one target intelligent function capable of being used for processing the target content in the first application based on the target content.

The target intelligent function is an intelligent function capable of intelligently processing the target content by calling a processing model in the first application.

For example, the first application supports image semantic extraction, image optimization, image generation, text translation, text abstract extraction and the like, but the target content is a picture, and then only the image semantic and the image optimization are required to be used as target intelligent functions.

In particular, in the case of a first application having multiple interface windows, the target smart function pertains to a smart function that the first window is capable of providing. Wherein the at least one target smart function may be part or all of the smart functions that can be provided by the first window, in particular in relation to a content category of the target content, etc.

For example, if the target content is text and the first window can provide text semantic extraction, abstract extraction, image semantic extraction, and the like, since the target content text naturally cannot need to use the function of image semantic extraction, only the text semantic extraction and the abstract extraction are needed as the target intelligent function.

It can be appreciated that the target content is taken as the processing object of the intelligent function of the first application, and at least one target intelligent function which can be used for processing the target content in the first application is determined, so that the target content can be processed by the target intelligent function more accurately.

Wherein, determining at least one target intelligent function may be to provide the user with an operation option capable of processing the intelligent function in the target, or may be to generate a processing result of the at least one target intelligent function on the target content, and the two possibilities are described below.

First, referring to the case of providing the user with an operation option of a selectable intelligent function, as shown in fig. 3, a further flowchart of the information processing method provided by the present application is shown, where the method in this embodiment may include:

s301, in response to a target operation, displaying the first window and the second window side by side.

The first window corresponds to a first application and the second window corresponds to a second application. Wherein the smart function of the first application has the ability to invoke the smart model to complete the smart function.

S302, obtaining target content of the second window based on the association group.

The above steps S301 and S302 may be referred to the related description of the previous embodiments, and are not repeated here.

S303, based on the target content, displaying an operation option of at least one target smart function that can be used to process the target content in the first window.

It will be appreciated that in this embodiment, based essentially on the target content, at least one target smart function in the first application that can be used to process the target content is determined, and operational options for the at least one target function are displayed within the first window.

The operation options of the target intelligent function in the first window are used for triggering the execution of intelligent processing corresponding to the target intelligent function on the target content. For example, in response to a selection operation of an operation option of a certain target smart function in the first window, at least one processing model corresponding to the target smart function is called by the first application to execute smart processing corresponding to the target smart function on the target content. The selection operation may be a click, double click or a sliding operation on an operation option, particularly without limitation.

The specific display mode of the operation options of the target intelligent functions displayed in the first window is not limited, and the operation options of the target intelligent functions can be displayed in a suspended mode on the first window or embedded into the first window area through a display plug-in.

The display position of the operation options of each target smart function in the first window may be not limited, for example, the operation options of the target smart function may be displayed in an area above the input frame of the first window or in any one side area of the first window.

For ease of understanding, described in connection with fig. 4, fig. 4 shows an example diagram of a first window and a second window belonging to an association group and displayed side-by-side.

In fig. 4, a first window 401 of a first application and a second window 402 of a second application belong to the same association group and are displayed side by side. It is assumed that the english portion displayed in the display area of the second window 402 is used as the target content, and the intelligent functions supported by the first window include intelligent functions such as translation, content expansion, abstract extraction, and image-to-text, but since the target content does not belong to a picture, it can be determined that the target intelligent functions include "translation", "content expansion", and "abstract extraction". Accordingly, in the first window 401, there are a result display area 403 and an input box 404, and in the upper area of the input box, several operation options 405 of the target smart functions of "translation", "content expansion", and "abstract extraction" may be presented.

It should be noted that, in fig. 4, the heights of the first window and the second window are the same, but in practical applications, the heights of the first window and the second window may not be the same.

It can be understood that after the operation options of at least one target intelligent function capable of being used for processing the target content are displayed in the first window, if a user wishes to process the target content by using a certain target intelligent function, the operation options of the corresponding target intelligent function can be directly selected, and the first application can be triggered to call the corresponding processing model to execute the intelligent processing corresponding to the target intelligent function, so that the user does not need to input a description statement for describing the intelligent operation requirement in the input box, the intelligent processing result of the target content can be directly obtained, and the convenience of intelligent processing on the content in the second window can be greatly improved.

In the following, a case of directly outputting a processing result by means of a target intelligent function based on a target content will be described, and as shown in fig. 5, a further flowchart of the information processing method provided by the present application is shown, where the method of this embodiment may include:

S501, in response to a target operation, displaying the first window and the second window side by side.

S502, obtaining target content of the second window based on the association group.

The above steps S501 and S502 may be referred to the related description of the previous embodiments, and are not repeated here.

S503, based on the target content, displaying a processing result of at least one target intelligent function on the target content in the first window.

Wherein the at least one target smart function is at least one smart function in the first application that can be used to process the target content. In particular, where the first application is capable of presenting multiple window interfaces, at least one target smart function is provided for the first window and is capable of being used to process at least one smart function of the target content.

In this embodiment, based on at least one target intelligent function capable of being used for processing the target content in the first application, the target content is intelligently processed, and a processing result of the at least one target intelligent function on the target content is directly displayed in the first window, so that a user cannot perform other operations any more, a result of intelligently processing the target content in the second window can be directly obtained, and complexity of performing artificial intelligent processing on the content in the window without the intelligent function is further reduced.

The application is not limited to the specific implementation process of obtaining the processing result of the target content by the at least one target intelligent function.

For example, at least one intelligent function capable of being used for processing the target content in the first application can be determined based on the target content, and a processing model corresponding to the at least one intelligent function is called to process the target content, so that a processing result corresponding to the at least one intelligent function is obtained.

For another example, based on the target content, processing the target content by using each intelligent function provided by the first window of the first application to obtain a processing result of at least one target intelligent function capable of being used for processing the target content in the first window. In this way, the target intelligent function does not need to be determined first, but the target content can be processed directly based on the intelligent function provided by the first window, and accordingly, if a certain intelligent function in the first window cannot process the target content, a corresponding processing result is not obtained naturally, so that only the processing result of each target intelligent function for processing the target content can be obtained.

The processing result of the target content displayed in the first window may be that the processing result corresponding to the target content is displayed in a result display area of the first window. Of course, the processing result may be displayed in the preview area by loading the floating preview area in the first window, and the processing result is not particularly limited.

The first application or the first window of the first application may support multiple target intelligent functions for processing the target content, and in the case that multiple target intelligent functions exist, the method may output a processing result of each target intelligent function on the target content, or may output a processing result corresponding to only one target intelligent function, and display the processing results corresponding to other target intelligent functions as recommendation results that can be used as candidates in a recommendation area.

In yet another possible implementation manner, after obtaining the target content, the present application may further switch the display mode of the first window to a specific display mode, and provide a target intelligent function for processing the target content.

Fig. 6 is a schematic flow chart of another information processing method provided by the present application, where the embodiment may include:

S601, in response to a target operation, displaying the first window and the second window side by side.

S602, obtaining target content of the second window based on the association group.

S603, switching the first window to a target display mode based on the target content.

Wherein the target display mode is different from the basic display mode of the first window, and the basic display mode refers to the display mode of the first window when the first window does not join the association group (i.e. does not associate with other windows).

In the target display mode, association information associated with at least one target intelligent function is displayed in the first window. The target smart function is a smart function in the first application that can be used to process the target content, e.g., the target smart function is a smart function that can be provided by the first window to process the target content.

When the second window is different, the application type corresponding to the second window or the category of the display content in the second window is different, so that the related information related to the target intelligent function displayed in the first window is also different when the first window is in the target display mode.

The association information associated with the target intelligent function can be in various different situations:

for example, in one possible scenario, the association information associated with the at least one target smart function may include operational options associated with each of the at least one target smart function. In this possible case, in the target display mode where the first window is located, the user may select, according to actual needs, a target intelligent function for processing the target content, and the specific implementation is similar to the foregoing embodiment of fig. 3, and specific reference may be made to the foregoing related description, which is not repeated.

However, in this embodiment, after the first window is switched to the target display mode, although the first window also displays the selectable target smart function, the display effect of the first window in the target display mode is different from that of fig. 3, so as to implement an operation option that highlights the association of the target smart function in the first window.

As described above, when the second window is different, the number and kind of the target smart functions outputted by the first window may also be different when the first window is in the target presentation mode.

For ease of understanding, the following description is provided in connection with two examples. Fig. 7 and 8 are diagrams showing examples of the effect of the target smart function presented by the first window associated with the second different window.

The first window 11 in fig. 7 and the first window 21 in fig. 8 are both windows of the AI chat application.

In fig. 7, the second window 12 is a window of the document application, and as can be seen in fig. 7, some text strings are displayed in the second window 12. On this basis, the target intelligent functions for processing text strings, which can be provided by the first window 11 of the first application, may include three intelligent functions of translation, content expansion and abstract extraction. Accordingly, there are three operational options 13 for the target smart function displayed in the first window 11.

In addition, in fig. 7, in order to highlight the operation options of each target smart function, the original display mode of the first window is changed, as can be clearly seen by comparing the first window in fig. 4, in fig. 7, no input frame is provided in the first window 11, and the area of the result display area is also relatively reduced.

In fig. 8, the second window 22 is a window of a web application such as a browser, and as shown in fig. 8, a search bar, a news summary section, a link, and a picture (picture a) are displayed in the second window 22. On this basis, the target intelligent functions in the first window, which can be used for processing the display content of the second window, are different from those in fig. 7, as shown in fig. 8, the first window can provide four target intelligent functions, namely, abstract extraction, link content query, image semantic recognition and image optimization, and correspondingly, operation options 23 corresponding to the four target intelligent functions are displayed in the first window.

In yet another possible scenario, the association information associated with the at least one target smart function may include a result of processing the target content based on the at least one target smart function. In the target display mode, the specific display position and display manner of the processing result of the at least one target intelligent function on the target content in the first window may be referred to the related description in the embodiment of fig. 5, which is not described herein.

Of course, in practical application, the associated information associated with the at least one target intelligent function may also include both the above two situations, so that, in the case that the output processing result is not comprehensive or does not meet the requirements, the user may manually select another target intelligent function, so that the processing result corresponding to the other target intelligent function may be displayed in the first window.

It will be appreciated that the above embodiments of fig. 3 to 6 are described taking the display content of the second window as the processing object of the smart function of the first application, in the case where the second window remains unchanged. In practical application, in order to further facilitate the user to select the required intelligent function, the application can also prompt each intelligent function in the first application, which can be used for processing the display content of the second window, in the second window on the premise that the first window and the second window are displayed side by side. The following is a description with reference to fig. 9.

As shown in fig. 9, which is a schematic flow chart of an information processing method provided by the present application, the method of this embodiment may include:

S701, in response to a target operation, displaying the first window and the second window side by side.

S702, obtaining target content of the second window based on the association group.

S703 determining, based on the target content, at least one target smart function in the first application that can be used to process the target content.

The above steps can be referred to in the related operations of the previous embodiments, without limitation.

S704, generating a suspension operation bar, and displaying the suspension operation bar in a position range corresponding to the second window.

Wherein the floating operation bar displays operation options of the at least one target intelligent function.

If the operating system constructs a floating operation bar containing operation options of the at least one target intelligent function based on the operation options of the at least one target intelligent function in the first application, or the first application constructs the floating operation bar based on the at least one target intelligent function and calls a target interface of the operating system to display the floating operation bar in a position range corresponding to the second window.

The specific display position of the position range of the suspension operation bar in the second window can be determined according to the display range of the target content in the second window, and the specific display position is not limited. For example, the hover operation panel is displayed in a second sub-display area adjacent to the first sub-display area corresponding to the target content in the second window, or in an arbitrary area outside the first sub-display area corresponding to the target content in the second window.

Wherein, the action of the operation options of the target intelligent function in the suspension operation bar is the same as the action of the operation options of the target intelligent function displayed in the first window.

Based on the above, if the user wants to process the target content in the second window by using a certain target intelligent function, the user can select the operation option of the target intelligent function in the suspension operation column to trigger the process of executing the corresponding target intelligent function on the target content, thereby improving the convenience of intelligent processing on the content in the second window.

Correspondingly, in response to the selection operation of the operation option of a certain target intelligent function in the suspension operation column, intelligent processing corresponding to the target intelligent function is executed on the target content through the first application calling at least one processing model corresponding to the target intelligent function. Further, the processing result of the target intelligent function corresponding to the selection operation on the target content can be displayed in the first window.

In the above embodiment, the description has been given taking, as an example, the processing object of automatically acquiring the target content in the second window as the intelligent function of the first application based on the association group to which the first window and the second window belong.

In practical applications, it is also possible that the automatically determined target content is not the content that the user wishes to process with the smart model. Based on the above, in one possible case, in order to reduce the false recognition situation and improve the flexibility of intelligent processing on the display content of the second window, in the application, based on the association group, the processing object of the intelligent function of the first application is from the display content of the second window, and the processing object can also be that in response to the input operation in the interface of the second window, the target content associated with the input operation in the second window is determined, and based on the association group, at least one target intelligent function capable of being used for processing the target content in the first application is determined.

The input operation may be a content frame selection operation for selecting the display content in the second window, based on which the target content associated with the input operation is the target content selected for the content frame selection operation.

The input operation may also be a character input operation within the second window, and on the basis of this, the target content associated with the input operation may be a character string input by the character input operation, and may further include context information of the character string input by the character input operation.

The input operation may also be a cursor movement operation within the second window, and on the basis of this, the target content associated with the input operation may be display content within a set range of the current position of the cursor in the second window.

The determining of the at least one target intelligent function in the first application that can be used to process the target content may be any of the foregoing cases, for example, the specific case where the target display content may be directly output in the first window is not limited.

In particular, after determining the at least one target smart function, instead of displaying the operation options of the target smart function or the corresponding processing results in the first window, a hover operation field may be generated, where the hover operation field is displayed in a position range corresponding to the second window, as described above. The second sub-display area of the floating operation bar on the second window can be adjacent to the first sub-display area of the target content, so that along with the change of the target content, a floating operation frame can be displayed in the adjacent area of the target content, and a user can conveniently select a target intelligent function required by processing the target content.

It will be appreciated that in any of the above embodiments of the present application, the target operation may be an operation for triggering the first window and the second window belonging to the same association group to be displayed side by side, or an operation for triggering the second window and the second window to be divided into the same association group. These two cases are described below.

In one possible case, in response to a target operation for triggering the first window to be attached to at least one edge of the second window, determining that the first window and the second window belong to the same association group, and displaying the first window and the second window side by side.

Wherein determining that the first window and the second window belong to the same association group may be storing the first window and the second window as one association group. For example, the association relationship between the first window and the second window is stored, so that the first window and the second window belong to the same association group. The association relation between the first window and the second window can be stored by associating the window handle of the first window with the window handle of the second window.

The target operation for triggering the at least one edge of the first window and the second window to be attached can be set according to actual needs, and the following implementation modes are exemplified:

In one implementation, the target operation may be an operation of dragging the first window and attaching one edge of the first window to one edge of the second window, or an operation of dragging the second window and attaching one edge of the second window to one edge of the first window.

For ease of understanding, the description is provided in connection with an example, as shown in fig. 10-12. Fig. 10 to 12 show an example diagram of establishing an association group of a first window and a second window by a target operation.

As can be seen from fig. 10, a first window 801 of a first application, which is an AI application capable of providing an intelligent function, and a second window 802 of a second application, which is a document application without calling an intelligent model, are displayed in the display interface. Moreover, in fig. 10, the first window and the second window are on different levels of the display interface, and the second window is on the top layer of the display interface, and obscures a portion of the content of the first window.

On the basis of fig. 10, the display content in the second window is processed if necessary with the first application. Then, the corresponding display content needs to be selected and copied in the first window, then, the first window is manually switched from the second window to the first window 801, then, the corresponding display content is pasted in the input field of the first window 801, the processing requirement on the part of display content is edited, and then, the first application calling processing model is triggered to process the display content, so that the complexity is relatively high.

Based on the scheme of the application, on the basis of fig. 10, the user can drag the second window 802 to attach one edge of the second window to one edge of the first window 801, as shown in fig. 11. As can be seen from fig. 11, through a drag operation of a user on the second window, one edge of the first window 801 is attached to the second window 802, and on this basis, the electronic device determines that the first window and the second window conform to a condition for establishing association in response to the drag operation, and determines that the first window and the second window belong to the same association group.

Furthermore, in order to enable a user to visually confirm that the current operation can trigger the first window and the second window to establish the association relationship, the method and the device can be used for prompting a prompt identifier for establishing association between the first window and the second window after detecting the target operation meeting the target condition. In this implementation, the target condition may be that the first window is attached to at least one edge of the second window. As shown in fig. 11, by dragging the second window 802 so that one edge of the second window 802 is attached to one edge of the first window 801, the electronic device outputs a thickened frame 803 (which may be highlighted) that frames the first window and the second window, and the user sees the thickened frame 803 to confirm that the association between the first window and the second window has been established.

On the basis of fig. 11, the user ends the target operation, and the electronic device displays the first window 801 and the second window 802 side by side, as shown in fig. 12.

Of course, the target operation may also have other possibilities, and for the case that the target operation is other possibilities, the target condition may be that the association condition triggering the association of the first window and the second window is satisfied, which may specifically be set according to the actual needs, and this is not limited.

In still another implementation manner, if the user wishes to establish an association relationship between a second window of the second application and a first window that is not currently displayed in the first application, in the case that the first application has multiple different window interfaces displayed, the user may drag a window icon corresponding to the first window, and drag the window icon to attach to one edge of the second window. Correspondingly, the target operation may be an operation of dragging the window icon corresponding to the first window and dragging the window icon to be attached to one edge of the second window. On the basis, the first window is output through the first application, the first window and the second window are confirmed to belong to the same association group, and the first window and the second window are displayed side by side.

For ease of understanding, as shown in connection with fig. 13, it can be seen from fig. 13 that only the main interface 1101 of the first application is currently displayed in the display interface (as shown by the right vertical bar box in fig. 13), but the user actually wants to associate the first window corresponding to the window icon 1102 in the first application with the second window 1103. On this basis, the user only needs to drag the window icon 1102 to attach to one side of the second window 1103, and then the first window corresponding to the second window 1103 and the window icon 1102 can be triggered to determine that the second window 1103 is the same association group, as can be seen in fig. 13, when the window icon 1102 is dragged to attach to one side of the second window 1103, a thickened frame 1104 for prompting that the association group is established is displayed. Of course, the association relationship between the two windows can also be highlighted by setting the color of the thickened frame to a designated color, such as more obvious yellow or red, and the like. In addition, when the first window and the second window satisfy the condition of establishing the association group, the first window and the second window may be virtualized so that the user can see the thickened frame and can determine that the first window and the second window have satisfied the condition of establishing the association group.

On the basis of fig. 13, when the user releases the drag operation, the effect of displaying two windows side by side as shown in fig. 12 is exhibited.

It should be understood that the above is exemplified by the target operation for triggering the first window and the second window to belong to the same association group, and the target operation is used for making at least one edge of the first window and the second window fit, but it should be understood that other possible target operations, such as triggering the first window and the second window to belong to the same association group, may be specifically set according to actual needs, which is not limited.

It can be appreciated that in the case that the first window and the second window belong to the same association group, the user may switch to other windows except for the first window and the second window, and on the basis of this, the user may further trigger to display the first window and the second window through operation. Based on this, in the case where the first window and the second window belong to the same association group, the first window and the second window are displayed side by side in response to a target operation for triggering presentation of at least one of the first window and the second window in which the association exists.

For example, the target operation may be clicking on a window icon of any one of the first window and the second window.

Particularly, in the application, in response to the first window and the second window belonging to the same association group, the application can also establish association between the window icon of the first window and the window icon of the second window, for example, in the display task bar below the display interface, the window icon of the first window and the window icon of the second window are overlapped together, so if the user clicks the icon display area after overlapping the window icon of the first window and the window icon of the second window in the display task bar, the first window and the second window can be triggered and displayed. For another example, a taskbar is displayed below a display interface, a window icon of a first window and a window icon of a second window are placed in a box side by side, and clicking the box on the basis can trigger the first window and the second window to be displayed side by side.

It can be understood that in any of the above embodiments of the present application, the association group to which the first window and the second window belong may be released according to actual needs. For example, in response to a first operation, the association of the first window with the second window is released, so that the first window and the second window do not belong to the same association group. For example, deleting the association relationship or association group of the first window and the second window.

The first operation may also be implemented in various ways, and may be specifically required according to practical needs. For example, a release button for triggering the release of the association may be added to the first application, and then the first operation may be clicking on the release button, and in response to the first operation, the association between the first window and the second window may be released. For another example, the first operation may be an operation of closing the first window or the second window, and then the association between the first window and the second window is released. As another example, the first operation may be an operation of dragging the first window or the second window to separate the first window and the second window.

It will be appreciated that in the above embodiments, two windows are illustrated as being in the same association group. In practical applications, the association group may also include a plurality of windows.

For example, in response to a second operation in the second window, a third window is presented, the third window is added to the association group corresponding to the first window and the second window, and the first window, the second window and the third window are presented side by side.

The second operation may be clicking on a link or specific content in the second window to trigger a jump from the second window to some new window, i.e. the third window.

The third window may correspond to the second application, or may correspond to a third application other than the second application, or may be an application that does not have the capability of calling the smart model.

On the basis, after the third window is added to the association group, the processing object of the intelligent function of the first application can also come from the display content of the third window. The specific implementation is the same as the previous processing object of taking the display content of the second window as the intelligent function, and will not be repeated.

In yet another possible scenario, in response to a second operation within a second window, a third window is presented, the third window is determined to be in the same association group as the first window, and the first window and the third window are presented side-by-side. In this case, in response to a second operation within the second window, if a jump is made from the second window to the third window, the association group between the first window and the third window is established individually.

Of course, in this case, in the case that the first window and the third window are confirmed to be in the same association group, the association group between the first window and the second window may be maintained (i.e., reserved), or the association group between the first window and the second window may be released, which is not particularly limited.

In any of the above embodiments of the present application, in the case where the first window and the second window (or the third window) establish an association group, the user may still normally perform content input in the input box of the first window, and the first application may still perform intelligent processing on the content input in the input box. That is, in response to an input operation input within an input box of the first window, input content of the input operation is obtained, which is processed based on the smart function in the first application.

The specific process of the first application processing the input content is the same as the processing process of the first window under the condition that the association group is not established with the second window, which is not described herein.

In yet another aspect, the present application further provides an information processing apparatus.

As shown in fig. 14, which shows a further flowchart of the information processing apparatus provided by the present application, the apparatus of this embodiment may include:

A window display unit 1201, configured to display a first window and a second window side by side in response to a target operation, where the first window and the second window belong to a same association group, the first window corresponds to a first application, an intelligent function of the first application has a capability of calling an intelligent model to complete the intelligent function, and the second window corresponds to a second application;

An object determining unit 1202 is configured to determine, based on the association group, that a processing object of the smart function of the first application is from a display content of the second window.

In one possible implementation, the object determining unit includes:

A content determining subunit, configured to obtain, based on the association group, a target content of the second window, where the target content belongs to at least part of content of the page content output by the second window;

and the function determining subunit is used for determining at least one target intelligent function which can be used for processing the target content in the first application based on the target content.

In yet another possible implementation, the function determining subunit includes:

A function display subunit for displaying, based on the target content, an operation option of at least one target smart function that can be used to process the target content within a first window.

and the result display subunit is used for displaying the processing result of at least one target intelligent function on the target content in the first window based on the target content.

and the mode switching subunit is used for switching the first window to a target display mode based on the target content, wherein in the target display mode, the first window displays the associated information associated with at least one target intelligent function, and the target intelligent function is an intelligent function which can be used for processing the target content in the first application.

In a further possible implementation, in case the apparatus comprises a function determination subunit, the apparatus further comprises:

And the suspension display unit is used for generating a suspension operation bar, and displaying the suspension operation bar in a position range corresponding to the second window, wherein the suspension operation bar displays operation options of the at least one target intelligent function.

In yet another possible implementation, the window display unit includes:

the first window display subunit is used for responding to a target operation for triggering at least one edge of the first window and the second window to be attached, determining that the first window and the second window belong to the same association group, and displaying the first window and the second window side by side;

Or a second window display subunit for displaying the first window and the second window side by side in response to a target operation for triggering presentation of at least one of the first window and the second window for which association exists.

In yet another possible implementation, the apparatus further includes:

A relationship releasing subunit configured to release association of the first window and the second window in response to a first operation;

Or a first multi-window association unit, configured to respond to a second operation in a second window, and display a third window, and add the third window to an association group corresponding to the first window and the second window, and display the first window, the second window and the third window side by side;

Or a second multi-window association unit, configured to respond to a second operation in the second window, and reveal a third window, and determine that the third window and the first window are in the same association group, and reveal the first window and the third window side by side.

In yet another possible implementation, the apparatus further includes:

And the intelligent processing unit is used for responding to the input operation input in the input box of the first window, obtaining the input content of the input operation and processing the input content based on the intelligent function in the first application.

The embodiment of the application also provides electronic equipment. As shown in fig. 15, which shows a schematic structural diagram of the electronic device, the electronic device includes at least a processor 1501, an input module 1502, a display module 1503, a first storage module 1504 and a second storage module 1505.

Wherein the first storage module 1504 stores first program data of a first application capable of running in the processor and second program data of a second application, the program data of the first application including model data of at least one smart model or interface data of a call interface for calling the at least one smart model;

a second storage module 1505 for loading and caching the first program data of the first application and the second program data of the second application;

a processor 1501 for running a first application based on first program data stored in the second storage module and a second application based on second program data stored in the second storage module;

The input module is used for obtaining target operation;

The processor 1501 is further configured to output a first window of the first application and a second window of the second application to the display module 1503 in response to the target operation obtained by the input module 1502, control the display module 1503 to display the first window and the second window side by side, and process display content from the second window through an intelligent function of the first application based on the first window and the second window belonging to the same association group.

Of course, the electronic device may also have more or fewer components than in fig. 13, without limitation.

The embodiment of the application also provides a computer program product, which comprises computer readable instructions, wherein the computer readable instructions enable the electronic equipment to realize any information processing method provided by the embodiment of the application when the computer readable instructions are run on the electronic equipment.

The embodiment of the application also provides a computer readable storage medium, which carries one or more computer programs, and when the one or more computer programs are executed by the electronic device, the electronic device can realize any information processing method provided by the embodiment of the application.

It should be further noted that the above-described apparatus embodiments are merely illustrative, and that the units described as separate units may or may not be physically separate, and that units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. In addition, in the drawings of the embodiment of the device provided by the application, the connection relation between the modules represents that the modules have communication connection, and can be specifically implemented as one or more communication buses or signal lines.

From the above description of the embodiments, it will be apparent to those skilled in the art that the present application may be implemented by means of software plus necessary general purpose hardware, or of course by means of special purpose hardware including application specific integrated circuits, special purpose CPUs, special purpose memories, special purpose components, etc. Generally, functions performed by computer programs can be easily implemented by corresponding hardware, and specific hardware structures for implementing the same functions can be varied, such as analog circuits, digital circuits, or dedicated circuits. But a software program implementation is a preferred embodiment for many more of the cases of the present application. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a readable storage medium, such as a floppy disk, a usb disk, a removable hard disk, a ROM, a RAM, a magnetic disk or an optical disk of a computer, etc., comprising several instructions for causing a computer device (which may be a personal computer, a training device, a network device, etc.) to perform the method according to the embodiments of the present application.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product.

The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present application, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, training device, or data center to another website, computer, training device, or data center via a wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be stored by a computer or a data storage device such as a training device, a data center, or the like that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk (Solid STATE DISK, SSD)), etc.

Claims

1. An information processing method, comprising:

2. The information processing method according to claim 1, wherein the processing object of the smart function of the first application is from the display content of the second window based on the association group, comprising:

3. The information processing method according to claim 2, the determining, based on the target content, at least one target smart function in the first application that can be used to process the target content, comprising:

4. The information processing method according to claim 2, the determining, based on the target content, at least one target smart function in the first application that can be used to process the target content, comprising:

5. The information processing method according to claim 2, the determining, based on the target content, at least one target smart function in the first application that can be used to process the target content, comprising:

6. The information processing method according to claim 2, further comprising:

7. The information processing method according to claim 1, the displaying the first window and the second window side by side in response to a target operation, comprising:

8. The information processing method according to claim 1 or 7, further comprising:

9. The information processing method according to claim 1, further comprising:

10. An information processing apparatus comprising: