JP2003319085A - Voice information search device and voice information search method - Google Patents

Abstract

(57) [Summary] [Problem] A voice information search device capable of searching for information based on voice information and outputting a search result in a format according to a user's information processing terminal, without requiring complicated operations And a method for retrieving voice information. SOLUTION: A voice recognition unit 105 recognizes voice information emitted by a user and converts it into a character string of a search key. The information search unit 106, based on the search key converted to a character string,
Search the registration information database 106a. As a result of the search, when there is information corresponding to the search key, the mail editing unit 107 extracts the information from the registration information database 106a and edits it. The mail server 120 transmits the mail 107a edited by the mail editing unit 107 through the Internet 150 based on the mail address information stored in the mail address storage unit 102c.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a voice information search device and a voice information search method capable of searching a database by voice information.

[0002]

2. Description of the Related Art In recent years, information processing terminals capable of connecting to the Internet have been used remarkably along with the progress of IT technology so that information can be transmitted and received via the Internet not only in offices and homes but also on the move. Is becoming possible. For example, when it is desired to search for certain information on the Internet, first, an information processing terminal connected to the Internet is connected to a search-only system (service) called a search site, and the information to be searched is input to execute the search.

In recent years, the number of people who use the Internet service is increasing even from telephone devices such as portable telephones and fixed telephones which can be connected to the Internet. Generally, when you connect to a search site on the Internet from these telephone devices and enter the information you want to search, a series of actions from connecting to the Internet, entering the information, and executing the search are performed with the numeric keypad on the telephone device. It will be. In addition, as a method of searching for information using a telephone line, there is a method of making a call to a specific number, inputting necessary information with a push button on a telephone device according to voice guidance, and executing search. In the case of this search method, the information which is the search result is obtained by listening to the guidance of the voice guidance flowing from the telephone device or by receiving the facsimile.

[0004]

However, the following various problems may occur in information retrieval on the Internet. First of all, a certain level of device operation technology is required to connect to the Internet, and furthermore, connecting (accessing) to search sites also requires URL (Un
It is necessary to enter the information Resource Locators). In addition, on the connected search site, the keyword or category of the desired information is input by a predetermined operation method defined by the search site, for example, by changing the keyword delimiter depending on whether it is an AND condition or an OR condition. What you do will be different.
As described above, it has been difficult for those who are not accustomed to device operation to understand the input rules and the screen display and reach the target information through various operations in the information search via the Internet.

In addition, when it is desired to retrieve information on the Internet using a telephone device that can connect to the Internet,
Since it is necessary to input the character of the information to be searched by using the numeric keypad designed for the purpose of inputting a numerical value, it takes a long time to input the character and it is easy to make an input error.

On the other hand, in the method of making a call to a specific number to retrieve information by telephone operation, the relationship between the provided service and the push button number is read aloud by voice guidance. The user can proceed to the next search step by selecting a predetermined push button number according to this voice guidance. When you proceed to the next step, the operation is repeated, in which the user further makes selections with push buttons, and it becomes necessary to trace many layers of information up to the required information.
It takes time. Also, the information providing side by voice guidance cannot select too many options because it is a push button selection. Further, in such an information retrieval method using voice guidance, when obtaining information from the Internet, it is difficult to use it for searching for a desired information from a large amount of information.

Further, in the method using the voice guidance, even if the desired information is retrieved, the voice guidance is provided. Therefore, the user has to write down or memorize the information read out by the voice guidance. Further, even if the facsimile can be used, it is necessary to attach the facsimile function to the telephone device on the user side for receiving the facsimile, which causes a limitation. Therefore, the present invention has been made in view of the above circumstances, does not require a complicated operation,
Based on the voice information, a large amount of information is searched for the desired information, and the information obtained as the search result is used by the user's information processing terminal (Internet-enabled mobile phone, landline phone,
A voice information search device and a voice information search method capable of outputting in a format suitable for a PC terminal or the like).

[0008]

According to a first aspect of the present invention, there is provided a voice information retrieval device capable of transmitting / receiving information to / from another information processing terminal via a communication line, wherein voice information is transmitted from the other terminal device. Voice information acquisition means, information storage means for storing information provided according to the voice information, and voice information recognition means for recognizing the voice information acquired by the voice information acquisition means and converting it into a character string. An information retrieval means for retrieving the information stored in the information storage means using the character string converted by the voice information recognition means as a retrieval condition; and a result of the retrieval by the information retrieval means When the information matching the search conditions is stored, the information is extracted, and the information transmitting means for transmitting the information to the other information processing terminal is provided, thereby achieving the above object.

According to a second aspect of the present invention, there is provided a voice information search method capable of transmitting / receiving information to / from another information processing terminal via a communication line, wherein the voice information is acquired from the other terminal device. A step, a second step of storing information provided according to the voice information, and a third step of recognizing the voice information acquired in the first step and converting it into a character string.
Step, a fourth step of searching the information stored in the second step using the character string converted in the third step as a search condition, and a result of the search by the fourth step, When the information stored in the second step includes information that matches the search condition, the fifth step of extracting the information and transmitting it to the other information processing terminal allows Achieve the purpose.

[0010]

BEST MODE FOR CARRYING OUT THE INVENTION Preferred embodiments of a voice information retrieval apparatus and a voice information retrieval method of the present invention will be described in detail below with reference to FIGS. Figure 1
It is the figure which showed the audio | voice information search device 100 and user terminal 200 which concern on this Embodiment. As shown in FIG. 1, the voice information search device 100 transmits / receives information to / from a terminal device (hereinafter referred to as a user terminal) 200 of a user who performs voice information search via a communication line (telephone network 140 or the internet 150). Are connected as possible. In this embodiment, the telephone network 140 and the Internet 150 are described separately, but it is also possible that one network capable of IP connection is used. First, the voice information search device 100 will be described. The voice information search device 100 includes a voice recognition server 110 connected to a telephone line 140, a user database 102a, a registration information database 106a, a mail server 120 for transmitting information as search results, and an HTTP (connected to the Internet 150). Hyp
ertext Transfer Protocol)
The server 130 is provided.

The voice recognition server 110 includes a telephone number acquisition unit 101, a telephone number search unit 102, a voice response unit 102, a voice input unit 104, a voice recognition unit 105, and an information search unit 10.
6, the mail editing unit 107, and other units (not shown), a control unit that controls each unit 101 to 107, a storage unit that stores voice response information (voice guidance), a voice recognition program, an information search program, and edit It has a program section that stores programs such as programs. When an incoming call is received from the user terminal 200 to the voice recognition server 110 via the telephone network 140, the telephone number acquisition unit 101 acquires the telephone number of the incoming user terminal, that is, the caller number information from the telephone line. . Note that the caller number information is acquired by the telephone number acquisition unit 101 by a caller number notification service implemented by a communication service.

The telephone number retrieval unit 102 is connected to the user database 102a, and the telephone number acquisition unit 101.
The user database 102a is searched for mail address information of the user terminal 200, user terminal information, and the like based on the caller number information acquired by. In addition,
In the user database 102a, a telephone number storage unit 102b that stores the telephone number information of the user, a mail address to which the information that is the search result is sent, and the Internet used by the user can be connected. The mail address storage unit 102c in which the type of the information processing terminal (here, the user terminal 200) is registered is stored.

The voice response unit 103 is a storage unit when the voice recognition server 110 is connected to the user terminal 200 in response to an incoming call from the user terminal 200, that is, when a call with the user is started. It responds to the user terminal 200 based on the predetermined voice response information stored in advance. Voice input unit 104 functioning as voice information acquisition means
Is the user terminal 2 according to the voice guidance issued from the voice response unit 103 of the voice recognition server 110.
The voice information issued at 00 is acquired. Here, the voice information emitted by the user means various words as search conditions such as a keyword and a category of request information that the user desires to search. Further, the voice input unit 104 uses the voice information acquired from the user terminal 200 as the voice recognition unit 105.
Send to.

The voice recognition unit 105, which functions as a voice information recognition unit, recognizes the voice information transmitted from the voice input unit 104 and adds it to the character string of the search key (search condition) used in the information search unit 106. Do the conversion. Voice recognition unit 10
The conversion of the voice into the character string by 5 is performed according to the voice recognition program. For example, in a voice uttered by a user, meaningless words such as "that" and "er" are recognized as words that are not searched by a voice recognition program and are excluded without being converted into a character string. It has become.
The voice recognition unit 105 also transmits the search key converted into a character string to the information search unit 106.

Information retrieval unit 1 functioning as information retrieval means
06 searches the information in the registration information database 106a based on the character string of the search key transmitted from the voice recognition unit 105. The search method by the information search unit 106 is performed according to the information search program. The information search program sequentially narrows down the acquired plurality of search keys from the top, searches the caller number information of the user terminal 200 by adding the area code or city code to the search key, and the like. It is an algorithm that can efficiently retrieve the information required by. Information search section 1
The method of pulling out the search key by 06 follows the searchable items in the registration information database 106a, and differs depending on the registered content. The registration information database 106a that stores the transmission information stores a search key storage unit 106b and a registration information storage unit 106c. In addition, when the information corresponding to the search key is stored in the registered information database 106a, the information search unit 106 notifies the mail editing unit 107 to that effect.

The mail editing unit 107 extracts the search result information from the registration information database 106a in accordance with the editing program, edits it as transmission information to the user terminal 200, and transmits it to the mail server 120. The information editing work by the mail editing unit 107 is registered in the mail address information storage unit 102c of the user database 102a, and is performed based on the type of the information processing terminal or the like which the user is using and which can connect to the Internet. For example,
When the user terminal 200 used by the user is a terminal having a small screen size such as a mobile phone, the screen display size of the email to be transmitted is changed. Also, the mail editing unit 107
Can also change the editing pattern of information according to whether the information retrieval unit 106 has a large amount of information or a small amount of information. As a result, the user can send the transmitted search result information regardless of the amount of information to the user terminal 20.
It can be easily confirmed on 0.

The mail server 120, which functions as an information transmitting means, transmits the edited information as an electronic mail. The information sent by the mail server 120 includes the URL of the related information linked to the information extracted from the registration information database 106a, the telephone number and the mail address of the information provider side, and the like. As a result, the user selects the URL or the mail address described in the body of the mail displayed on the user terminal 200 (the information transmitted from the mail server 120) to automatically associate the URL. It is possible to jump to the Web page specified by the data to be displayed or the URL and display the corresponding data on the user terminal 200.

When the user terminal 200 is a mobile phone or a fixed phone capable of connecting to the Internet, a dial function is added to the telephone number portion in the mail text. As a result, when the user selects the telephone number described in the body of the mail displayed on the user terminal 200, it is possible to make an inquiry by telephone by auto dialing. As described above, the user who receives the information by the e-mail from the mail server 120 immediately selects the URL, the mail address, the telephone number, etc. in the body of the mail from the user terminal 200 that has received the mail. You can jump to a Web page that has related information, make a call, or send an email.

The HTTP server 130, which functions as an information storage unit, stores information acquired from a terminal of an information provider (not shown in FIG. 1) connected via the Internet 140 by Web page browsing software called a browser. It is stored in the registration information storage unit 106c of the registration information database 106a.

Next, the user terminal 200 will be described. The user terminal 200 includes a telephone function unit 201, a mail display unit 202, and other units (not shown).
A control unit for controlling 01 and 202, a storage unit, and the like are provided. In the present embodiment, the user terminal 200 will be described as a telephone device such as a mobile phone or a landline phone that has both a telephone call function and an Internet access function, but the present invention is not limited to this. For example, an information processing terminal having a call function and capable of connecting to the Internet may be used, or a telephone device having a call function and an information processing terminal capable of connecting to the Internet may be separately provided. In the case where the telephone device and the information processing terminal are separate, the voice information search device 110 is requested to search by voice information from the telephone device, and the information as the search result is received by the information processing terminal capable of connecting to the Internet. It may be performed. Further, there may be a plurality of user terminals 200 on the user side.

Next, the operation of voice search by the voice information search device will be described. FIG. 2 is a flowchart showing the operations of the user terminal 200 and the voice search information device 100 when performing voice information search. Here, as an example,
A user uses the user terminal 200 to retrieve the voice information retrieval device 100.
A case will be described in which a phone call is made to retrieve local information such as "Kichijoji movie theater in Tokyo". The information sent to the user terminal 200 as a search result includes an introduction, an address, and the like of a movie theater that meets the search conditions.
A telephone number, a guide map, a related URL, etc. are included.

First, when a user makes a call to the voice information search device 100 (telephone call) in the telephone function unit 201 of the user terminal 200, the voice information search device 200 is sent from the user terminal 200 via the telephone network 140. A line connection request is transmitted to (step S1). Voice information retrieval device 100
When the user receives a line connection request from the user terminal 200 via the telephone network 140 (incoming call) (step S2), the telephone number acquisition unit 101 causes the telephone number of the user terminal that received the telephone number,
That is, the sender number information is acquired from the telephone line (step S3).

When the telephone number acquisition unit 101 acquires the telephone number, the telephone number search unit 102 searches the user database 102a for information corresponding to the telephone number based on the acquired telephone number. . Here, if the telephone number matching the user's telephone number exists in the telephone number storage unit 102b, the telephone number search unit 102.
From the mail address storage unit 102c to the mail server 1
The mail address information used when 20 transmits the information of the search result is extracted and notified to the mail server 120 (step S4).

As described above, the telephone number storage unit 102b and the mail address storage unit 102 of the user database 102a.
It is assumed that the user's telephone number and mail address information corresponding to each telephone number are registered in advance in c. Note that the telephone number and email address information registered in the user database 102a is the telephone number and email address of the user himself when the user first requests to use the voice information search service by the voice information search device 100. May be registered. When the side of the user terminal 200 that provides the communication service provides the voice information search service by the voice information search device 100, when the user subscribes to the communication service by the user terminal 200 in the user database 102. You may make it register the subscription information registered into.

When the user terminal 200 and the voice recognition server 110 are connected, the voice response section 103 transmits a voice response (voice guidance) to the user terminal 200 based on the voice response information (step S5). . When the user follows the guidance of the voice guidance issued from the telephone function unit 201 of the user terminal 200, and responds with the area, category, keyword, etc. of the information to be searched (sought) by voice (FIG. 2).
Of the telephone network 1).
The voice information is transmitted to the voice recognition server 110 via 40 (step S6).

The voice input unit 104 of the voice recognition server 110
When voice information is input from the user terminal 200, the voice information is transmitted to the voice recognition unit 105. Upon receiving the voice information from the voice input unit 104, the voice recognition unit 105 recognizes the voice information according to the voice recognition program,
It is converted into a character string of a search key (step S7). The search key converted into this character string is transmitted to the information search unit 106.

The information search unit 106 uses the search key converted into a character string as a keyword for information search of the registered information database 106a according to the information search program, and collates it with the search key storage unit 106b. A search is performed as to whether or not the user has information to be searched (step S8). Here, as shown in FIG. 2, the keywords for the search are "Kichijoji", "Aigakan",
Since it is “ABC (ABC)”, the information search unit 106 performs a narrowing search such as narrowing down the area, narrowing down by store type such as a movie theater, and narrowing down by the screening title. As described above, in addition to the voice keyword acquired from the user terminal 200, the telephone number search unit 102 uses the area code or city code of the user's telephone number already acquired as a search keyword. You may do it.

When the information search unit 106 determines that the information corresponding to the search key is stored as a result of the search on the registered information database 106a, it notifies the mail editing unit 107 of that fact. Upon receiving the notification from the information search unit 106, the mail editing unit 107 extracts the information that is the search result from the registration information database 106a according to the editing program and edits it as the mail 107a for sending to the user terminal 200 ( Step S9).

3 and 4 are diagrams showing an example of the mail 107a transmitted by the mail editing unit 107. As shown in FIG.
For example, when the information search unit 106 determines that there is not much information corresponding to the search key, the detailed information transmission mail 20 of FIG.
The mail content as shown in 2a is transmitted to the user terminal 200. On the other hand, when the information search unit 106 determines that there is a large amount of information corresponding to the search key, the mail content as shown in the summary (summary) information transmission mail 202b in FIG. 4 is transmitted to the user terminal 200. In this way, the mail editing unit 107 can also select the display method of the mail content according to the number of information items in the search result by the information search unit 106. In addition, as described above, the mail editing unit 107 determines the mail display unit 2 according to the type of the user terminal 200.
The screen display size of the mail 107a to be transmitted is changed according to the screen size of 02.

The mail server 120 includes the mail editing unit 10
The mail 107a edited by No. 7 is transmitted through the Internet 150 based on the mail address information acquired by the telephone number search unit 102 (step S1).
0). The user terminal 200 uses the mail 107a transmitted from the mail server 120 of the voice information search device 100.
When the message is received (step S11), the mail display unit 202
Displays the mail 107a.

In the case where the user terminal 200 is a mobile phone or a fixed phone capable of connecting to the Internet as in the present embodiment, the user can confirm the telephone number and mail based on the mail 107a displayed by the mail display unit 202. When the cursor is moved to a display portion such as an address or a URL and a function key or the like is pressed, a jump to a related Web page or automatic dialing of a telephone number is performed. Further, in the case of a fixed-line telephone having a facsimile function and capable of connecting to the Internet, the mail 107a received by the attached facsimile printer can also be printed out. The user can also store the information received by the user terminal 200 in a storage unit such as a hard disk of the user terminal 200.

Next, registration of information such as "cinema theater in Kichijoji in Tokyo" stored in the registration information database 106a of the voice information retrieval apparatus 100 will be described. Figure 5
FIG. 6 is a diagram for explaining information registration by an information provider in a registration information database. Here, the information provider who wants to register information in the registration information database 106a is, for example, a manager of a movie theater or a manager of a coffee shop,
It is assumed that one person is the person who wants to provide the information that he or she has acquired or to advertise or advertise. Further, the information processing terminal 300 of the information provider is assumed to be a personal computer or the like capable of connecting to the Internet.

First, the information provider uses the Internet 15
0 through the information processing terminal 300 of the information provider itself,
It connects to the HTTP server 130 of the voice information search device 100. In this connection, the information provider makes the information processing terminal 300
In, at launching the browsing software called browser,
It is executed by designating the URL of the HTTP server 130.

The information processing terminal 300 of the information provider and the HT
When the TP server 130 is connected, the information processing terminal 30
The registration information input screen 301 is displayed on the image display means (display) 0 by the browsing software. The information provider inputs predetermined information on the registration information input screen 301,
When the send button is selected, the information on the registration information input screen 301 (hereinafter referred to as registration information) is sent to the HTTP server 130 via the Internet. For example, if the information provider is a business owner who wants to advertise information about the retail store he or she owns, on this registration information input screen 301, as a search key, the introduction of the store that the user wants to advertise,
A related page (URL), a mail address, a telephone number, a map or a photograph, a recognition keyword, etc. are input. Further, since the voice information search device 100 converts the voice information of the user into a character string and uses it as a search key, it is assumed that the registration of the search key also registers the reading by "Hiragana".

The HTTP server 130 is the information processing terminal 3
When the registration information is acquired from 00, it is stored in the registration information database 106a. Here, the registration information is a search key in the search key storage unit 106b searched by the information search unit 106, or a mail extracted by the mail server 120 from the registration information storage unit 106c and sent (see FIGS. 3 and 4). Means the content described in.

As described above, in the information search by the voice information search device 100, the voice recognition unit 105 converts the voice information from the user terminal 200 into the character string of the search key,
It is performed based on this character string. When this search is executed, the character string used as the search key is based on the voice (pronunciation) uttered by the user, so the search key stored in the search key storage unit 106b of the registration information database 106a is also, for example, For "Kichijoji," you should register in hiragana for each item such as region and store type, such as "Kichijoji". In addition, when writing in Kanji, there may be multiple readings in “Ibaraki” such as “Ibaragi” and “Ibaraki”. Therefore, when registering with Hiragana, each item in the search key storage unit 106b In, a plurality of readings may be registered for a predetermined keyword.

Although one embodiment of the present invention has been described above, the present invention is not limited to the above embodiment. For example, the voice information search device 100 according to the present embodiment.
Is not only a computer system including a personal computer and word processor, but also LA
It can also be configured by an N (local area network) server, a computer (personal computer) communication host, a computer system connected to the Internet, and the like. In addition, by distributing the functions to the devices on the network, the voice information retrieval device 1
It is also possible to configure 00.

Further, in this embodiment, the mail server 120 and the HTTP server 130 are provided in the voice information search device 100.
However, the present invention is not limited to this. For example, a voice information search device 100 having a mail server 120 having a mail transmission function is used.
Alternatively, the information may be installed separately, and the information edited by the mail editing unit 107 may be sent to the user terminal 200 when it is sent to the separately installed mail function part. Further, for example, the registration information registered by the information provider may be product information, a coupon ticket, or a discount ticket. Further, when the user inputs the route of the transportation from the user terminal 200 as voice information, information such as train time, time, cost (train fare), etc. may be transmitted by mail.

As described above, according to the voice information search device and the voice information search method according to the present embodiment, voice information is converted into a character string and the database is searched based on this character string. Requires no complicated work to connect to the Internet, and you only have to utter the information you want to retrieve, and you can expand the use of information retrieval. Further, according to the voice information search device and the voice information search method according to the present embodiment, since the information search is performed based on the character string that is the search key, the user can trace the hierarchical menu structure for many layers. Instead, it is only necessary to directly indicate the information desired by one's own voice, and the information can be easily retrieved (obtained).

Further, according to the voice information search apparatus and the voice information search method according to the present embodiment, since the search result information is sent by mail via the Internet or the like in a mail format suitable for the user terminal, The user can easily save, print, transfer to another person, access related information, and the like. Further, according to the voice information search device and the voice information search method according to the present embodiment,
Since information is searched based on voice information, the user only needs to make a phone call and utter the information to be searched.
It can be easily used by people such as elderly people and homemakers who are unfamiliar with device operation. As a result, on the side of the information provider who transmits information on the Internet, the target of information transmission can be expanded.

[0041]

As described above, the voice information retrieval apparatus and the voice information retrieval method of the present invention recognize the instruction by the telephone voice from the user and convert it into a character string to retrieve information. The person can obtain the requested information by making a call without performing a complicated operation. Further, in the voice information search device and the voice information search method of the present invention, when the information as the search result is transmitted by e-mail, for example, the user can easily save the acquired information, and further, the search result. You can easily access the information on the Internet related to the above information.

[Brief description of drawings]

FIG. 1 is a diagram showing a voice information search device and a user terminal according to the present embodiment.

FIG. 2 is a flowchart showing operations of a user terminal and a voice search information device when performing voice information search.

FIG. 3 is a diagram showing an example of an email transmitted by an email editing unit.

FIG. 4 is a diagram showing an example of a mail transmitted by a mail editing unit.

FIG. 5 is a diagram illustrating information registration by an information provider in a registration information database.

[Explanation of symbols]

100 voice information retrieval device 101 Telephone number acquisition unit 102 Phone number search section 102a user database 102b Telephone number storage 102c Email address storage 103 Voice response unit 104 voice input section 105 voice recognition unit 106 Information Retrieval Department 106a registration information database 106b Search key storage unit 106c Registration information storage unit 107 Mail editor 107a mail 110 Speech recognition server 120 mail server 130 HTTP server 140 telephone network 150 Internet 200 user terminals 201 Telephone Function Department 202 Mail display

Continued front page    (72) Inventor Maki Nakamori             2-1-1, Nishishinjuku, Shinjuku-ku, Tokyo             Nutty Advance Technology Co., Ltd.             Inside the company (72) Inventor Kazuo Hakoda             2-1-1, Nishishinjuku, Shinjuku-ku, Tokyo             Nutty Advance Technology Co., Ltd.             Inside the company (72) Inventor Yoshikatsu Maruo             Stock Market Association 1-3-6 Sekiguchi, Bunkyo-ku, Tokyo             Company M.R.O. F term (reference) 5B075 PP07 PQ02 UU24                 5D015 KK02 KK03                 5K101 KK02 KK16 LL00 LL01 MM07                       NN08 NN13 NN18 NN21 RR05

Claims (2)

[Claims] 1. A voice information retrieval device capable of transmitting and receiving information to and from another information processing terminal via a communication line, the voice information acquiring means acquiring voice information from the other terminal device, and the voice information. Information storage means for storing information provided in accordance with the above, voice information recognition means for recognizing voice information acquired by the voice information acquisition means, and converting it into a character string, and characters converted by the voice information recognition means. Information retrieval means for retrieving information stored in the information storage means using a column as a retrieval condition, and as a result of retrieval by the information retrieval means, information matching the retrieval condition is stored in the information storage means. ,
A voice information search device comprising: an information transmitting unit that extracts the information and transmits the information to the other information processing terminal. 2. A voice information search method capable of transmitting and receiving information to and from another information processing terminal via a communication line, comprising: a first step of obtaining voice information from the other terminal device; A second step of storing information provided according to the third step, a third step of recognizing the voice information acquired in the first step and converting the voice information into a character string, and a third step converted in the third step. A fourth step of searching the information stored in the second step using a character string as a search condition, and the information stored in the second step as the search condition as a result of the search in the fourth step. If the matching information is included, a fifth step of extracting the information and transmitting the extracted information to the other information processing terminal is included.