CN113672152A - Display method and device - Google Patents
Display method and device Download PDFInfo
- Publication number
- CN113672152A CN113672152A CN202110919973.5A CN202110919973A CN113672152A CN 113672152 A CN113672152 A CN 113672152A CN 202110919973 A CN202110919973 A CN 202110919973A CN 113672152 A CN113672152 A CN 113672152A
- Authority
- CN
- China
- Prior art keywords
- information
- interface
- call
- control
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 87
- 230000006854 communication Effects 0.000 claims abstract description 39
- 238000004891 communication Methods 0.000 claims abstract description 35
- 230000004044 response Effects 0.000 claims description 21
- 238000012545 processing Methods 0.000 claims description 11
- 230000008569 process Effects 0.000 description 33
- 230000006870 function Effects 0.000 description 16
- 238000010586 diagram Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000011982 device technology Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008719 thickening Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Telephone Function (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses a display method and a display device, and belongs to the technical field of communication. The method mainly comprises the steps of receiving a first input of a first control under the condition of communicating with a first object; responding to the first input, and acquiring call information for calling the first object; determining target information meeting preset conditions from the call information; and displaying a first interface corresponding to the first control, wherein the first interface displays the target information.
Description
Technical Field
The present application belongs to the field of communications technologies, and in particular, to a display method and apparatus.
Background
With the development of electronic device technology, people can use electronic devices to make calls, such as: video call, voice call. During the process of making a call through an electronic device, it is often encountered to record some call information, such as: telephone number, bank account number. Currently, users record information by means of paper pen recording or manual input based on electronic devices. However, these methods all require the user to manually record information during the communication process, thereby increasing user operations and reducing communication efficiency.
Disclosure of Invention
The embodiment of the application aims to provide a display method and a display device, which can solve the problems that a user records information manually in the conversation process at present, user operation is increased, and conversation efficiency is reduced.
In a first aspect, an embodiment of the present application provides a display method applied to an electronic device, where the method may include:
receiving a first input to a first control in the case of a call with a first object;
responding to the first input, and acquiring call information for calling the first object;
determining target information meeting preset conditions from the call information;
and displaying a first interface corresponding to the first control, wherein the first interface displays the target information.
In a second aspect, an embodiment of the present application provides a display device applied to an electronic device, where the display device may include:
the receiving module is used for receiving a first input of a first control under the condition of communicating with a first object;
the obtaining module is used for responding to the first input and obtaining the call information of the call with the first object;
the processing module is used for determining target information meeting preset conditions from the call information;
and the display module is used for displaying a first interface corresponding to the first control, and the first interface displays the target information.
In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, where the program or instructions, when executed by the processor, implement the steps of the display method as shown in the first aspect.
In a fourth aspect, the present application provides a readable storage medium, on which a program or instructions are stored, and when executed by a processor, the program or instructions implement the steps of the display method as shown in the first aspect.
In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the steps of the display method shown in the first aspect.
In the embodiment of the application, a first input that a user triggers a first control, such as a control for storing a telephone number, is received in the case of a call with a first object, the call information of the call with the first object is analyzed through voice recognition in response to the first input, target information, such as a contact name and a telephone number to be stored, is determined from the call information, then a first interface corresponding to the first control, such as a newly-built contact interface, is displayed, the newly-built contact interface comprises the contact name and the telephone number to be stored, which are related in the call information, and the target information is stored if the user confirms that the target information is correct. Therefore, the user does not need to manually record information in the call process, user operation is reduced, the efficiency and the convenience of recording the information by the user in the call process are improved, and the call efficiency is improved.
Drawings
Fig. 1 is a schematic diagram of a display architecture according to an embodiment of the present application;
fig. 2 is a schematic diagram of a display interface according to an embodiment of the present disclosure;
fig. 3 is a second schematic view of a display interface provided in the present embodiment;
fig. 4 is a third schematic view of a display interface provided in the present embodiment;
fig. 5 is a fourth schematic view of a display interface provided in the embodiment of the present application;
fig. 6 is a fifth schematic view of a display interface provided in the present embodiment;
fig. 7 is a sixth schematic view of a display interface provided in the present application;
FIG. 8 is a flowchart of a display method provided in an embodiment of the present application;
fig. 9 is a schematic structural diagram of a display device according to an embodiment of the present disclosure;
fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 11 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described clearly below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present disclosure.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
Based on this, the display method provided by the embodiment of the present application is described in detail below with reference to fig. 1 to fig. 6 through specific embodiments and application scenarios thereof.
The embodiment of the present application provides a display architecture, as shown in fig. 1, the display architecture may include an electronic device 10 and an electronic device 11 that establish a call connection. Among them, the electronic devices 10 and 11 support functions of recording sound, recording video, and performing voice recognition on audio thereof and image recognition on images. In addition, the electronic device 10 and the electronic device 11 also support a first control, and the first control is used for switching and displaying the functional interfaces of different applications or switching and displaying different functional interfaces of the same application during the call.
Based on this, in one possible embodiment, as shown in fig. 2, in the case that the user a has a call with the first object through the electronic device 11 via the electronic device 10, the electronic device 10 receives a first input that the user a triggers a first control, such as a control of an additional contact, in the call interface. The electronic device 10, in response to the first input, acquires call information during a call, parses the call information through voice recognition, and determines target information such as a contact name "AAAA" and a telephone number "456123" of the newly added contact from the call information. And then, switching the display interface from the call interface to a first interface corresponding to the first control, for example, switching from the call interface to a new contact interface, wherein the new contact interface comprises a contact name 'AAAA' and a telephone number '456123' of a new contact related in the call information, and if the user confirms that the new contact interface is correct, storing the contact name and the telephone number.
In another possible embodiment, as shown in fig. 3, in the case that the user a has a call with a first object through the electronic device 10 and the electronic device 11, the electronic device 10 receives a first input that the user a triggers a first control in the call interface, such as a control for calling with the object. The electronic device 10, in response to the first input, acquires call information during a call, parses the call information through voice recognition, and determines target information such as a telephone number "12345654321" from the call information. Then, the display interface is switched from the call interface with the first object to the first interface corresponding to the first control, for example, from the call interface with the first object to the call interface with the second object, the call interface with the second object includes a telephone number "12345654321" involved in the call information, if the user confirms that there is no error, an input that the user clicks the call control is received, and in response to the input, a call connection with the electronic device of the second object is established based on the telephone number. Here, the call interface with the first object and the call interface with the second object may belong to the same application, such as a call application, or, of course, may belong to different applications, for example, the call interface with the first object may be a call application, and the call interface with the second object may be an interface of another instant messaging application, in this case, the target information may further include a name of the application corresponding to the call interface with the second object, such as a communication number of the second object in the instant messaging application a, so as to establish a call connection with the second object.
It should be noted that, in the above embodiments as shown in fig. 2 and fig. 3, the obtained target information may be obtained in a targeted manner according to the type of the first control, and if the first control is a control for adding a new contact, consecutive digits that conform to the mobile phone number and names that correspond to the consecutive digits in the call information may be identified in a targeted manner.
In yet another possible embodiment, as shown in fig. 4, in the case where the user a has a call with the first object through the electronic device 11 via the electronic device 10, the electronic device 10 receives a first input that the user a triggers a first control, such as a control to send information, in the call interface. The electronic device 10, in response to the first input, acquires call information during a call, analyzes the call information through voice recognition, and determines target information, such as information a, such as a name, having a semantic similarity greater than a certain threshold with preset text information preset by a user based on professional attributes from the call information: zhang three, telephone number 123456789. Then, the display interface is switched from the call interface to a first interface corresponding to the first control, for example, the display interface is switched from the call interface to an interface for sending information with the first object in the short message application program, and the first interface includes information a such as name: three, telephone number 123456789, if confirmed by the user to be correct, sends information a to the first object, such as name: zhang three, telephone number 123456789. Certainly, the first interface may also be, for example, an interface that is switched from a call interface to an instant messaging application program and sends information to the first object, so that a channel for interaction between the first object and the multiple application programs can be provided for a user, and the efficiency of information interaction during a call process of the user is improved.
In addition to the possibility of sending the target information as content to the first object, as shown in fig. 5, the target information may be used as a receiving party in a case where the target information includes communication information of a third object, such as a phone number 987654321, so that the electronic device 10 may receive an input of inputting first information, such as "hello", in an interface of a short message application (or an interface of an instant messaging application), and then send the first information to the electronic device associated with the third object according to the communication information of the third object.
In yet another possible embodiment, as shown in fig. 6, in the case where the user a has a call with the first object through the electronic device 11 via the electronic device 10, the electronic device 10 receives a first input that the user a triggers a first control, such as an information-storing control, in the call interface. The electronic device 10 acquires call information during a call in response to the first input, parses the call information through voice recognition, and determines target information such as target information including time information and schedule information corresponding to the time information from the call information. And then, switching the display interface from the call interface to a first interface corresponding to the first control, such as switching from the call interface to a memo application program information storage interface or a schedule recording application program information storage interface, and if the display interface is confirmed by a user to be correct, storing target information so as to display prompt information under the condition that the system time of the electronic equipment is the same as the time corresponding to the time information, wherein the prompt information is used for prompting the schedule information corresponding to the time information. Or, determining target information such as information B with a semantic similarity value larger than a certain threshold value with preset text information preset by a user based on professional attributes from the call information, switching a display interface from the call interface to a first interface corresponding to a first control such as a call interface to a memo application program information storage interface or a schedule recording application program information storage interface, and if the target information is confirmed by the user, storing the target information.
It should be noted that, a plurality of functions represented by the first control may be simultaneously displayed in the call interface, and as shown in fig. 7, in order to ensure the simplicity of the call interface, a folder may be created, and a plurality of functions represented by the first control may be displayed in the folder. In addition, in order to ensure convenient operation of the user, the functions of the first control with high use frequency of the user can be displayed in the call interface, and other functions represented by other first controls are displayed in the folder, so that when the user clicks the control corresponding to the folder, a plurality of functions represented by the first control are displayed.
In summary, the embodiment of the present application provides a display method, where in a case of a call with a first object, a first input that a user triggers a first control, such as a control storing a phone number, is received, in response to the first input, call information of the call with the first object is analyzed through voice recognition, target information, such as a contact name and a phone number to be stored, is determined from the call information, and then a first interface corresponding to the first control, such as a new contact interface, is displayed, where the new contact interface includes the contact name and the phone number to be stored, and if the user confirms that the target information is correct, the target information is stored. Therefore, the user does not need to manually record information in the call process, user operation is reduced, the efficiency and the convenience of recording the information by the user in the call process are improved, and the call efficiency is improved.
In addition, based on multiple possibilities represented by the first control, the efficiency and convenience of recording information by the user in the call process can be improved under different use scenes, so that the call efficiency is improved, the user can quickly record the telephone number and the contact person, and the tedious operation process in the process of recording the telephone number is reduced. The method can also be directly displayed on a dialing interface, so that a user can conveniently and directly make a call. And can send or record important information in a short message or instant messaging mode. In the process of communication, important communication contents can be recorded and displayed through an application program for recording information, so that the important information can be conveniently arranged after communication, and the information recording efficiency of a user in the communication process can be improved.
It should be noted that the display method provided in the embodiment of the present application may be applied to any scenario that information needs to be recorded during a user call, in addition to the above scenario that information and a phone number of a contact person are recorded during a user call.
According to the above architecture and application scenario, the display method provided by the embodiment of the present application is described in detail below with reference to fig. 8.
Fig. 8 is a flowchart of a display method according to an embodiment of the present application.
As shown in fig. 8, the display method may be applied to the electronic device shown in fig. 1, and specifically may include the following steps based on this:
in step 810, a first input to a first control is received while talking to a first object. In response to the first input, call information for a call with the first object is obtained, step 820. Step 830, determining target information meeting a preset condition from the call information. And 840, displaying a first interface corresponding to the first control, wherein the first interface displays the target information.
In this way, by receiving a first input that a user triggers a first control such as a control for storing a telephone number in the case of a call with a first object, resolving call information for the call with the first object through voice recognition in response to the first input, determining target information such as a contact name and a telephone number to be stored from the call information, and then displaying a first interface corresponding to the first control such as a newly-built contact interface including the contact name and the telephone number to be stored, which are involved in the call information, if the target information is confirmed by the user, storing the target information. Therefore, the user does not need to manually record information in the call process, user operation is reduced, the efficiency and the convenience of recording the information by the user in the call process are improved, and the call efficiency is improved.
The above steps are described in detail below, specifically as follows.
First, the call in the embodiment of the present application may include two cases, namely, a voice call and a video call, and the following describes the step of determining the target information according to different call cases.
In one or more optional embodiments, in the case that the call with the first object is a voice call with the first object, the call information is first audio information, and the preset condition includes that the similarity value with the first preset text information is greater than or equal to a first preset threshold, step 830 may specifically include:
performing voice recognition on the first audio information to obtain first audio text information;
and determining the text information with the similarity value larger than or equal to a first preset threshold value in the first audio text information as the target information.
Illustratively, based on the language culture, it may appear that different words characterize the same meaning, such as the bank, simply ". line" may all be recorded as the same text, or as the audio "yao er" may be translated into "unitary", but for a cell phone number, the audio "yao er" may be translated into "12". Thus, here, the target information may be further determined in conjunction with the function characterized by the first control, and if the first control is a control communicating with the object, the audio "yao er" may be translated to "12".
In another or multiple alternative embodiments, in a case that the call with the first object is a video call with the first object, the call information is first video information, the preset condition includes that the similarity value with the first preset image information is greater than or equal to a second preset threshold, and the similarity value with the second preset text information is greater than or equal to a third preset threshold, step 730 may specifically include:
acquiring M images in the first video information and audio information corresponding to the M images, wherein M is an integer larger than 2;
carrying out image recognition on the Nth image in the M images to obtain a target object in the Nth image; performing voice recognition on second audio information corresponding to the Nth image to obtain second audio text information, wherein N is an integer greater than 1;
determining the target object as target information under the condition that the similarity value of the target object and the first preset image information is greater than or equal to a second preset threshold value; and determining text information with the similarity value with the second preset text information being greater than or equal to a third preset threshold value in the second audio text information as target information.
For example, if there are some appearing target objects in the M images, such as a contact name and a phone number corresponding to the contact name, or an identifier of a certain attraction, the image of the appearing target objects may be regarded as the nth image, and then the target objects and text information related to the introduction of the target objects may be determined as the target information based on the target objects in the image and the audio text information corresponding to the nth image. And if the target object is a contact name, identifying the audio text information of the audio information corresponding to the image, and determining the image and the text related to the contact name as the target information. Here, it should be noted that, in the processing of the audio text information, the above embodiments may be referred to, and are not described herein again.
It should be noted that the preset condition in the embodiment of the present application may include at least one of the following: based on the user occupation attribute determination, the first preset text information or the second preset text information in the preset condition comprises at least one of the following: the system comprises a communication number, a contact name, a bank account number, an instant messaging account number and a verification code.
Here, in order to improve the experience of the user, the users with different professional attributes can set preset conditions according to professional habits of the users, for example, the financial users can set the preset conditions to be bank accounts, and thus when the bank accounts appear in the audio information and the video information and are judged to be matched with the preset conditions, the bank accounts in the audio information and the video information are identified. Of course, the preset conditions provided in the embodiment of the present application may also be the basic communication number and the contact information.
Then, based on the first control with different functions, the first interface is also different, and thus, the operation of the user on the first interface is also different, and the following various examples are provided in the embodiment of the present application to describe the display method in detail.
In one or more alternative embodiments, in a case that the first control is a control for communicating with the object and the first interface is a communication interface of the first application program, after step 740, the display method may further include:
under the condition that the target information comprises communication information of a second object, sending a call request to electronic equipment of the second object according to the communication information of the second object; and under the condition of receiving the call permission information sent by the electronic equipment of the second object, establishing a call connection with the electronic equipment of the second object.
Exemplarily, referring to fig. 3, a first control is displayed on the call interface, the first control is a control for calling with the object, and the call interface, i.e., the dialing interface, with the second object is displayed. Therefore, the user sees the automatically displayed communication information, namely the telephone number, and can click the dialing control to establish the call connection with the electronic equipment of the second object if the telephone number is correct, so that the complicated process that the user invokes the telephone dialing key and the manual operation process of inputting the number can be reduced.
Here, it should be noted that, because the electronic device 10 and the electronic device 11 are in the process of a call, the electronic device 10 displays a call interface, and the first control is a control for calling an object, the first application may be an interface of a function different from that of the same application as the call application. At the moment, only interfaces with different functions under the same application program need to be switched, and another application program does not need to be triggered and started.
In another or more alternative embodiments, in a case that the first control is a control for adding a contact and the first interface is an interface for adding a contact of the second application, after step 740, the display method may further include:
receiving a second input of the target information in the newly-added contact person interface;
storing the target information in response to the second input;
and displaying a second interface, wherein the second interface comprises contact person list information, and the contact person list information comprises target information for displaying the information in the contact person list in a distinguishing manner.
Illustratively, referring to fig. 2, the first control is a control for adding a contact, and the first interface is an interface of the new contact of the second application. If the contact name 'AAAA' and the telephone number '456123' displayed on the newly-added contact interface are correct, the user can directly click and store the contact name 'AAAA' and the telephone number '456123'; on the contrary, if the contact person 'AAAA' and the telephone number '456123' displayed on the newly added contact person interface are incorrect, the user can modify the contact person, and after confirming that the modification is completed, the user clicks the saving control to save the target information. In addition, after the target information is stored, the user can directly jump to a second interface including contact list information in the address list, and the contact person 'AAAA' is displayed in a distinguishing mode, so that the user can conveniently search and make a call.
Through the method, the tedious operation of adding the name and the mobile phone number by the newly-built contact person of the user can be greatly reduced, and in addition, the font enlarging and thickening processing is carried out on the newly-added contact person for ensuring the convenience of searching the newly-added contact person. Therefore, the user can communicate by directly clicking the newly added contact person, operation steps in the original newly added contact person are reduced, the newly added contact person of the user in the communication process can conveniently communicate with the user, and the operation efficiency of the newly added contact person of the user in the communication process is improved.
It should be noted that, because the electronic device 10 and the electronic device 11 are in a call process, the electronic device 10 displays a call interface, and the first control is a control for adding a new contact, so that the application program for the call and the application program for the new contact belong to different application programs, and when receiving an input to the first control, the second application program can be triggered to be started, so as to quickly start the first interface.
In one or more alternative embodiments, in the case that the first control is a control for sending information, the first interface is an interface of a third application program, and the third application program includes an instant messaging application program or a short message application program, after step 740, the display method may further include:
receiving a third input of target information in an interface of a third application program;
in response to the third input, target information is transmitted to the electronic device of the first object.
Exemplarily, referring to fig. 4, the first control is a control for sending information, the first interface is an interface of a third application program, if the third application program is a short message application program, i.e. one party is a sender of information, and the first object is a receiver of information. After the user confirms the target information "name: zhang three, telephone number: 123456789 "if correct, click on the send control may send the target information to the electronic device of the first object. Additionally, it should be noted that in some possible embodiments, the user may click directly on the destination information phone number: 123456789 dials to make a call in zhang san. In addition, the user can also input target information, and in response to the input, the user can select to store the target information as a new contact.
In addition, in addition to the possibility of transmitting the target information as content to the first object as described above, the target information may be a recipient, i.e., a contact, based on which, in a case where the target information includes communication information of a third object, a fourth input of inputting the first information in an interface of a third application is received;
and responding to the fourth input, and sending the first information to the electronic equipment of the third object according to the communication information of the third object.
For example, referring to fig. 5, in the case that the destination information includes the communication information of the third object, such as the phone number 987654321, the destination information is taken as the receiving party, so that the electronic device 10 may receive an input of inputting the first information, such as "hello", in the interface of the short message application (or the interface of the instant messaging application), and then transmit the first information to the electronic device associated with the third object with the communication information of the third object, such as the phone number 987654321, as the receiving party.
In one or more alternative embodiments, in a case that the first control is a control for information storage, the first interface is an interface of a fourth application, and the fourth application includes a memo application or a calendar-recording application, after step 740, the display method may further include:
receiving a fifth input of target information;
in response to the fifth input, storing target information, the target information including time information and schedule information corresponding to the time information;
and displaying prompt information under the condition that the system time of the electronic equipment is the same as the time corresponding to the time information, wherein the prompt information is used for prompting schedule information corresponding to the time information.
Illustratively, when the first control is a control for information storage and the first interface is an interface of a note application, the target information can be displayed in a note and the user can directly read and support editing. Therefore, the method and the device solve the problem of single information acquisition mode which is too time-consuming to listen to the recorded sound and enrich the information acquisition mode of the user by providing the readable call content text for the user. In addition, the user can conveniently arrange important information after the call by recording the target information.
In addition, under the condition that the first control is a control for storing information, the first interface is an interface of an application program for recording schedules, and the target information comprises time information and schedule information corresponding to the time information, schedule prompt is automatically set, so that prompt information is displayed under the condition that the system time of the electronic equipment is the same as the time corresponding to the time information, and the prompt information is used for prompting the schedule information corresponding to the time information. Therefore, by automatically extracting the target information and automatically setting the schedule prompt based on the target information, the operation of setting the schedule prompt by the user is reduced, so that the user can quickly arrange the conversation content, and the efficiency and the convenience of recording information by the user in the conversation process are improved, thereby improving the conversation efficiency.
In summary, in the embodiment of the present application, a first input that a user triggers a first control, such as a control storing a phone number, is received when a call is made with a first object, call information of the call with the first object is analyzed through voice recognition in response to the first input, target information, such as a contact name and a phone number to be stored, is determined from the call information, then a first interface corresponding to the first control, such as a new contact interface, is displayed, the new contact interface includes the contact name and the phone number to be stored, which are related in the call information, and if the user confirms that the target information is correct, the target information is stored. Therefore, the user can quickly record target information such as telephone numbers, contact persons and the like, the complex operation process in the telephone number recording process is reduced, the hands of the user are liberated, the user does not need to manually record information in the call process, the user operation is reduced, the efficiency and the convenience of recording information in the call process are improved, and the call efficiency is improved.
In addition, the display method provided by the embodiment of the application can solve the problem of pain caused by complex and fussy flow when the telephone number and the contact name are recorded in the call process through different functions represented by the first control, and provides convenience for a user to record the telephone number in a common scene. In addition, in the process of communication, the number in communication can be automatically identified and displayed in a dialing interface, so that a user does not need to manually add a telephone number and can complete the communication scene only by directly clicking a dialing control. And by extracting and storing the contact name and the telephone number, the user can conveniently and directly click and dial the call, and the method is suitable for scenes and the like needing to record the contact information.
In the display method provided in the embodiment of the present application, the execution main body may be a display device, or a display module for executing the display method in the display device. In the embodiment of the present application, a display device executing a display method is taken as an example to describe the display device provided in the embodiment of the present application.
Based on the same inventive concept, the application also provides a display device. The details are described with reference to fig. 9.
Fig. 9 is a schematic structural diagram of a display device according to an embodiment of the present application.
As shown in fig. 9, the display device 90 is applied to the electronic device shown in fig. 1, and may specifically include:
a receiving module 901, configured to receive a first input to a first control in a case of communicating with a first object;
an obtaining module 902, configured to obtain, in response to a first input, call information for a call with a first object;
a processing module 903, configured to determine target information meeting a preset condition from the call information;
and a display module 904, configured to display a first interface corresponding to the first control, where the first interface displays the target information.
The display device 90 will be described in detail below, specifically as follows:
in one or more possible embodiments, the processing module 903 may be specifically configured to, when the call with the first object is a voice call with the first object, the call information is first audio information, and the preset condition includes that a similarity value with first preset text information is greater than or equal to a first preset threshold, perform voice recognition on the first audio information to obtain first audio text information;
and determining the text information with the similarity value larger than or equal to a first preset threshold value in the first audio text information as the target information.
In another or more possible embodiments, the processing module 903 may be specifically configured to, when the call with the first object is a video call with the first object, the call information is first video information, the preset condition includes that a similarity value with first preset image information is greater than or equal to a second preset threshold, and a similarity value with second preset text information is greater than or equal to a third preset threshold, acquire M images and audio information corresponding to the M images in the first video information, where M is an integer greater than 2;
carrying out image recognition on the Nth image in the M images to obtain a target object in the Nth image; performing voice recognition on second audio information corresponding to the Nth image to obtain second audio text information, wherein N is an integer greater than 1;
determining the target object as target information under the condition that the similarity value of the target object and the first preset image information is greater than or equal to a second preset threshold value; and determining text information with the similarity value with the second preset text information being greater than or equal to a third preset threshold value in the second audio text information as target information.
It should be noted that the preset condition in the embodiment of the present application is determined based on the user professional attribute;
or the first preset text information or the second preset text information in the preset condition includes at least one of the following: the system comprises a communication number, a contact name, a bank account number, an instant messaging account number and a verification code.
In one or more possible embodiments, the display device 90 may further include a first sending module and a creating module; wherein,
and the first sending module is used for sending a call request to the electronic equipment of the second object according to the communication information of the second object under the condition that the first control is a control used for communicating with the object, the first interface is a call interface of the first application program, and the target information comprises the communication information of the second object. Based on this, the establishing module is used for establishing the call connection with the electronic equipment of the second object under the condition of receiving the call permission information sent by the electronic equipment of the second object.
In another or more possible embodiments, the display device 90 may further include a first storage module; the receiving module 901 may be further configured to receive a second input of target information in the newly added contact interface when the first control is a control for a newly added contact and the first interface is the newly added contact interface of the second application program; a first storage module for storing target information in response to a second input; the display module 904 may be further configured to display a second interface, where the second interface includes contact list information, and the contact list information includes target information for displaying information in the contact list differently.
In yet another or more possible embodiments, the display device 90 may further include a second transmitting module; the receiving module 901 may be further configured to receive a third input of target information in an interface of a third application program when the first control is a control for sending information, the first interface is an interface of the third application program, and the third application program includes an instant messaging application program or a short message application program; and the second sending module is used for responding to the third input and sending the target information to the electronic equipment of the first object.
In yet another or more possible embodiments, the display device 90 may further include a second storage module; the receiving module 901 may be further configured to receive a fifth input of the target information when the first control is a control for information storage, the first interface is an interface of a fourth application, and the fourth application includes a memo application or an application for recording a schedule; the second storage module is used for responding to the fifth input and storing target information, and the target information comprises time information and schedule information corresponding to the time information; the display module 904 is further configured to display a prompt message for prompting schedule information corresponding to the time information when the system time of the electronic device is the same as the time corresponding to the time information.
The display device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in an electronic apparatus. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system (Android), an iOS operating system, or other possible operating systems, which is not specifically limited in the embodiments of the present application.
The display device provided in the embodiment of the present application can implement each process implemented by the method embodiments of fig. 1 to 8, and is not described here again to avoid repetition.
In the embodiment of the application, a first input that a user triggers a first control, such as a control for storing a telephone number, is received in the case of a call with a first object, the call information of the call with the first object is analyzed through voice recognition in response to the first input, target information, such as a contact name and a telephone number to be stored, is determined from the call information, then a first interface corresponding to the first control, such as a newly-built contact interface, is displayed, the newly-built contact interface comprises the contact name and the telephone number to be stored, which are related in the call information, and the target information is stored if the user confirms that the target information is correct. Therefore, the user does not need to manually record information in the call process, user operation is reduced, the efficiency and the convenience of recording the information by the user in the call process are improved, and the call efficiency is improved.
Optionally, as shown in fig. 10, an electronic device 100 is further provided in this embodiment of the present application, and includes a processor 1001, a memory 1002, and a program or an instruction stored in the memory 1002 and executable on the processor 1001, where the program or the instruction is executed by the processor 1001 to implement each process of the display method embodiment, and can achieve the same technical effect, and no further description is provided here to avoid repetition.
It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic device and the non-mobile electronic device described above.
Fig. 11 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.
The electronic device 1100 includes, but is not limited to: radio frequency unit 1101, network module 1102, audio output unit 1103, input unit 1104, sensor 1105, display unit 1106, user input unit 1107, interface unit 11011, memory 1109, processor 1110, and radio 1111.
Those skilled in the art will appreciate that the electronic device 1100 may further include a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 1110 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system. The electronic device structure shown in fig. 11 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is not repeated here.
In this embodiment, the user input unit 1107 is configured to receive a first input to the first control in a case of communicating with the first object. A processor 1110 configured to obtain call information for a call with a first object in response to a first input; and determining target information meeting preset conditions from the call information. A display unit 1106, configured to display a first interface corresponding to the first control, where the first interface displays the target information.
It is to be understood that the input Unit 1104 may include a Graphics Processing Unit (GPU) 11041 and a microphone 11042, the Graphics processor 11041 Processing image data of a still image or video obtained by an image capturing apparatus (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1106 may include a display panel 11061, and the display panel 11061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1107 includes a touch panel 11071 and other input devices 11072. A touch panel 11071, also called a touch screen. The touch panel 11071 may include two portions of a touch detection device and a touch display. Other input devices 11072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume display keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 1109 may be used for storing software programs and various data including, but not limited to, application programs and an operating system. Processor 1110 may integrate an application processor that handles primarily operating systems, user interfaces, applications, etc. and a modem processor that handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1110.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements the processes of the display method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
In addition, an embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the display method embodiment, and the same technical effect can be achieved.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, or a network device) to execute the method of the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (14)
1. A display method, comprising:
receiving a first input to a first control in the case of a call with a first object;
responding to the first input, and acquiring call information communicated with the first object;
determining target information meeting preset conditions from the call information;
and displaying a first interface corresponding to the first control, wherein the first interface displays the target information.
2. The method according to claim 1, wherein the call with the first object is a voice call with the first object, the call information is first audio information, and the preset condition includes that a similarity value with first preset text information is greater than or equal to a first preset threshold; the determining of the target information meeting the preset condition from the call information includes:
performing voice recognition on the first audio information to obtain first audio text information;
and determining text information with the similarity value with the first preset text information being greater than or equal to a first preset threshold value in the first audio text information as target information.
3. The method according to claim 1, wherein the call with the first object is a video call with the first object, the call information is first video information, the preset condition includes that the similarity value with the first preset image information is greater than or equal to a second preset threshold value, and the similarity value with the second preset text information is greater than or equal to a third preset threshold value; the determining of the target information meeting the preset condition from the call information includes:
acquiring M images in the first video information and audio information corresponding to the M images, wherein M is an integer larger than 2;
performing image recognition on the Nth image in the M images to obtain a target object in the Nth image; performing voice recognition on second audio information corresponding to the Nth image to obtain second audio text information, wherein N is an integer greater than 1;
determining the target object as target information under the condition that the similarity value of the target object and the first preset image information is greater than or equal to a second preset threshold value; and determining text information with the similarity value with the second preset text information being greater than or equal to a third preset threshold value in the second audio text information as target information.
4. The method of claim 1, wherein the first control is a control for communicating with an object, and the first interface is a communication interface of a first application; after the displaying of the first interface corresponding to the first control, the method further includes:
under the condition that the target information comprises communication information of a second object, sending a call request to electronic equipment of the second object according to the communication information of the second object;
and under the condition of receiving the call permission information sent by the electronic equipment of the second object, establishing call connection with the electronic equipment of the second object.
5. The method of claim 1, wherein the first control is a control for an additional contact, and the first interface is an additional contact interface of a second application; after the displaying of the first interface corresponding to the first control, the method further includes:
receiving a second input of target information in the newly-added contact person interface;
in response to the second input, storing the target information;
and displaying a second interface, wherein the second interface comprises contact person list information, and the contact person list information comprises target information for displaying the information in the contact person list in a distinguishing manner.
6. The method of claim 1, wherein the first control is a control for sending information, the first interface is an interface of a third application program, and the third application program comprises an instant messaging application program or a short message application program; after the displaying of the first interface corresponding to the first control, the method further includes:
receiving a third input of target information in an interface of the third application program;
in response to the third input, sending the target information to the electronic device of the first object.
7. The method of claim 1, wherein the first control is a control for information storage, the first interface is an interface of a fourth application, and the fourth application comprises a notes application or a calendar recording application; after the displaying of the first interface corresponding to the first control, the method further includes:
receiving a fifth input to the target information;
responding to the fifth input, and storing the target information, wherein the target information comprises time information and schedule information corresponding to the time information;
and displaying prompt information under the condition that the system time of the electronic equipment is the same as the time corresponding to the time information, wherein the prompt information is used for prompting schedule information corresponding to the time information.
8. A display device, comprising:
the receiving module is used for receiving a first input of a first control under the condition of communicating with a first object;
the acquisition module is used for responding to the first input and acquiring the call information of the call with the first object;
the processing module is used for determining target information meeting preset conditions from the call information;
and the display module is used for displaying a first interface corresponding to the first control, and the first interface displays the target information.
9. The apparatus according to claim 8, wherein the processing module is specifically configured to, when the call with the first object is a voice call with the first object, the call information is first audio information, and the preset condition includes that a similarity value with first preset text information is greater than or equal to a first preset threshold, perform voice recognition on the first audio information to obtain first audio text information;
and determining text information with the similarity value with the first preset text information being greater than or equal to a first preset threshold value in the first audio text information as target information.
10. The apparatus according to claim 8, wherein the processing module is specifically configured to, in a case that the call with the first object is a video call with the first object, the call information is first video information, the preset condition includes that a similarity value with first preset image information is greater than or equal to a second preset threshold, and a similarity value with second preset text information is greater than or equal to a third preset threshold, acquire M images in the first video information and audio information corresponding to the M images, where M is an integer greater than 2;
performing image recognition on the Nth image in the M images to obtain a target object in the Nth image; performing voice recognition on second audio information corresponding to the Nth image to obtain second audio text information, wherein N is an integer greater than 1;
determining the target object as target information under the condition that the similarity value of the target object and the first preset image information is greater than or equal to a second preset threshold value; and determining text information with the similarity value with the second preset text information being greater than or equal to a third preset threshold value in the second audio text information as target information.
11. The apparatus of claim 8, wherein the display apparatus further comprises a first sending module and a building module; wherein,
the first sending module is used for sending a call request to the electronic equipment of a second object according to the communication information of the second object under the condition that the first control is a control used for communicating with the object, the first interface is a call interface of a first application program, and the target information comprises the communication information of the second object;
the establishing module is used for establishing a call connection with the electronic equipment of the second object under the condition that the first control is a control used for communicating with the object, the first interface is a call interface of the first application program, and call permission information sent by the electronic equipment of the second object is received.
12. The device of claim 8, wherein the display device further comprises a first storage module; wherein,
the receiving module is further used for receiving second input of target information in the newly-added contact person interface under the condition that the first control is a control for newly-added contact persons and the first interface is the newly-added contact person interface of a second application program;
the first storage module is used for responding to the second input and storing the target information;
the display module is further configured to display a second interface, where the second interface includes contact list information, and the contact list information includes target information for displaying information in the contact list in a differentiated manner.
13. The apparatus of claim 8, wherein the display apparatus further comprises a second transmitting module; wherein,
the receiving module is further configured to receive a third input of target information in the interface of a third application program when the first control is a control for sending information, the first interface is an interface of the third application program, and the third application program includes an instant messaging application program or a short message application program;
the second sending module is configured to send the target information to the electronic device of the first object in response to the third input.
14. The device of claim 8, wherein the display device further comprises a second storage module; wherein,
the receiving module is further configured to receive a fifth input of the target information when the first control is a control for information storage, the first interface is an interface of a fourth application program, and the fourth application program includes a memo application program or a schedule-recording application program;
the second storage module is used for responding to the fifth input and storing the target information, and the target information comprises time information and schedule information corresponding to the time information;
the display module is further used for displaying prompt information under the condition that the system time of the electronic equipment is the same as the time corresponding to the time information, wherein the prompt information is used for prompting schedule information corresponding to the time information.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110919973.5A CN113672152B (en) | 2021-08-11 | 2021-08-11 | Display method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110919973.5A CN113672152B (en) | 2021-08-11 | 2021-08-11 | Display method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113672152A true CN113672152A (en) | 2021-11-19 |
CN113672152B CN113672152B (en) | 2024-08-09 |
Family
ID=78542314
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110919973.5A Active CN113672152B (en) | 2021-08-11 | 2021-08-11 | Display method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113672152B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114860127A (en) * | 2022-05-27 | 2022-08-05 | 维沃移动通信有限公司 | Information transmission method and information transmission device |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111369994A (en) * | 2020-03-16 | 2020-07-03 | 维沃移动通信有限公司 | Voice processing method and electronic equipment |
CN111884908A (en) * | 2020-06-23 | 2020-11-03 | 维沃移动通信有限公司 | Contact person identification display method and device and electronic equipment |
CN111970401A (en) * | 2019-05-20 | 2020-11-20 | 华为技术有限公司 | Call content processing method and electronic equipment |
CN112214251A (en) * | 2019-06-25 | 2021-01-12 | 阿里巴巴集团控股有限公司 | Method, device and equipment for conveniently inputting information in call |
CN112565912A (en) * | 2020-11-26 | 2021-03-26 | 维沃移动通信有限公司 | Video call method and device, electronic equipment and readable storage medium |
CN112866469A (en) * | 2021-01-19 | 2021-05-28 | 维沃移动通信(杭州)有限公司 | Method and device for recording call content |
-
2021
- 2021-08-11 CN CN202110919973.5A patent/CN113672152B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111970401A (en) * | 2019-05-20 | 2020-11-20 | 华为技术有限公司 | Call content processing method and electronic equipment |
CN112214251A (en) * | 2019-06-25 | 2021-01-12 | 阿里巴巴集团控股有限公司 | Method, device and equipment for conveniently inputting information in call |
CN111369994A (en) * | 2020-03-16 | 2020-07-03 | 维沃移动通信有限公司 | Voice processing method and electronic equipment |
CN111884908A (en) * | 2020-06-23 | 2020-11-03 | 维沃移动通信有限公司 | Contact person identification display method and device and electronic equipment |
CN112565912A (en) * | 2020-11-26 | 2021-03-26 | 维沃移动通信有限公司 | Video call method and device, electronic equipment and readable storage medium |
CN112866469A (en) * | 2021-01-19 | 2021-05-28 | 维沃移动通信(杭州)有限公司 | Method and device for recording call content |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114860127A (en) * | 2022-05-27 | 2022-08-05 | 维沃移动通信有限公司 | Information transmission method and information transmission device |
Also Published As
Publication number | Publication date |
---|---|
CN113672152B (en) | 2024-08-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101942308B1 (en) | Method for providing message function and an electronic device thereof | |
US9225831B2 (en) | Mobile terminal having auto answering function and auto answering method for use in the mobile terminal | |
US10091643B2 (en) | Method and apparatus for displaying associated information in electronic device | |
CN102999334B (en) | A kind of shortcut based on Android platform realizes method, device and terminal | |
US20140051399A1 (en) | Methods and devices for storing recognized phrases | |
US20070121909A1 (en) | Conference call dialing | |
US9172795B1 (en) | Phone call context setting | |
US20180240162A1 (en) | Conversational commerce platform | |
CN113055529B (en) | Recording control method and recording control device | |
CN113965614A (en) | Session creation method and device and electronic equipment | |
CN112866469A (en) | Method and device for recording call content | |
CN114374761B (en) | Information interaction method, device, electronic device and medium | |
KR101520896B1 (en) | Apparatus and method for managing data in portable terminal | |
CN113672152B (en) | Display method and device | |
CN112181351A (en) | Voice input method and device and electronic equipment | |
CN107846347B (en) | Communication content processing method and device and electronic equipment | |
CN106062764B (en) | A kind of method and apparatus for hiding personal information on call interface | |
CN113869011A (en) | Information auditing method and device and electronic equipment | |
CN107145286B (en) | Browsing interaction processing method and device | |
CN106303084A (en) | A kind of method and device of information record | |
CN111694999A (en) | Information processing method and device and electronic equipment | |
CN112996138A (en) | Communication establishing method, device and storage medium | |
CN111565246B (en) | Telephone number dialing method and device, computer equipment and storage medium | |
KR100679312B1 (en) | Method and apparatus for providing counterpart information display service using voice recording | |
CN114979060A (en) | Information transmission method and information transmission device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |