KR102137155B1 - Telecommunication service system and method using speech recognition technology - Google Patents

Abstract

The call service system using voice recognition according to the present invention includes a service using device for a service user, and a service server communicating with the service using device through a network to provide a call service to the service using device. The service using apparatus includes a microphone, a speaker, a display unit, a communication unit communicating with a service server via a network, and a control unit. The service server includes a communication unit communicating with a service using device through a network, an STT converting unit converting voice received from the service using device into text, a storage unit storing text converted by the STT converting unit, and a storage unit It has a TA analysis unit for analyzing the text stored in the, analysis result DB for recording the analysis results of the TA analysis unit, and a control unit. The text converted by the STT conversion unit is provided to the service using device and displayed in real time on the display unit.

Description

Telephony service system and method using voice recognition {TELECOMMUNICATION SERVICE SYSTEM AND METHOD USING SPEECH RECOGNITION TECHNOLOGY}

The present invention relates to a call service system, and more specifically, recognizes a user's voice during a call, converts it into text, and provides or analyzes the converted text in real time to the user using voice recognition to provide various additional services. It relates to a call service system and method.

2. Description of the Related Art With the recent development of information and communication technology, the spread of various communication terminals with communication functions such as smartphones, tablet PCs, and smart home appliances has become popular.

A user can use a communication terminal to call or send messages to or receive messages from other people regardless of place and time, access the Internet to search for desired information, and share the location with others using the location sensor mounted on the communication terminal. Various services such as can be provided.

In the early days, communication terminals were limited in performing multiple applications at the same time due to limitations in hardware performance, but recently, as hardware performance of communication terminals has improved, information processing speed has increased and memory capacity has increased. Multitasking, which allows applications to run concurrently, is now possible.

These communication terminals provide convenience for users by providing more various functions according to the needs of users, away from the traditional voice call service and text service as the development of communication technology and the use of users increase. For example, a conference call service capable of making a one-to-one call through a communication terminal as well as a call between a plurality of users has been provided in various forms.

Conference call service refers to a call service between users of a plurality of wired and wireless communication terminals. Such a call service has an advantage of saving time and money because a plurality of users in different regions can conduct a meeting or a meeting through a wired or wireless communication terminal without having to gather in the same place.

When a conference call service is used for a voice call or a video call using a general communication terminal, the contents of a call exchanged by the talker are simply transmitted to each other, and a method for recording them separately is not provided. Therefore, in order to keep the contents of the call as a record, there is a inconvenience in that the user needs to manually record or record the necessary information during the call.

Published Patent Publication No. 2013-0092369 (2013. 08. 20)

The present invention has been devised in view of the above-mentioned points, and recognizes a user's voice during a call, converts and stores the text, and provides or analyzes the converted text in real time to provide relevant information, and stores information It is an object to provide a call service system and method using voice recognition that can create a new revenue model using.

A call service system using voice recognition according to the present invention for solving the above object includes: a service using device for a service user; And a service server communicating with the service using device through a network to provide a call service to the service using device, wherein the service using device includes: a microphone, a speaker, a display unit, and the network. A communication unit for communicating with a service server, a microphone, the speaker, the display unit, and a control unit electrically connected to the communication unit, the service server, the communication unit for communicating with the service using device through the network And, STT conversion unit for converting the voice received from the service using device to text, a storage unit for storing the text converted by the STT conversion unit, a TA analysis unit for analyzing the text stored in the storage unit, It has an analysis result DB for recording the analysis result of the TA analysis unit, the STT conversion unit, the storage unit, the TA analyzer, and a control unit electrically connected to the analysis result DB, the STT conversion unit Characterized in that the converted text is provided to the service using device and displayed in real time on the display unit.

The service server may include a question answer generator for generating a database by generating a specific question and an expected answer matching it from data stored in the analysis result DB.

When the text corresponding to the question stored in the question answer generator is generated among the text converted by the STT converter, the service server provides an expected answer matching the question among the expected answers stored in the question answer generator. It can be provided to the service using device to be displayed on the display unit.

The service server may include an evaluation recording unit that receives a result of the evaluation performed by a consultant authorized to evaluate the call content and evaluates the call content stored in the storage unit and records the evaluation result of the consultant.

The service server may provide the evaluation result stored in the evaluation recording unit to the user when the user requests the consultant's evaluation of the contents of his or her call.

The service server includes a consultant management unit capable of managing and providing information of consultants authorized to evaluate the contents of calls stored in the storage unit to the service using apparatus, and the service using apparatus is configured by the consultant management unit. It can provide an interface to receive information from the stunts and allow the user to select a consultant who can be evaluated on the contents of their calls.

The service server includes a payment unit for payment of service costs, and when a user requests a consultant's evaluation of the contents of his/her call, the payment is confirmed in the evaluation record only when the payment is made through the payment unit Stored evaluation results can be provided to the user.

The call service system using voice recognition according to the present invention includes: a consulting use device that communicates with the service server through the network and provides an interface through which a consultant can perform evaluation on call contents stored in the storage unit; It can contain.

The service using apparatus may provide an interface through which a user can select text displayed on the display unit, and display translated text for text selected by the user on the display unit.

The service using apparatus may include an input unit, and display the translated text obtained by translating text input through the input unit into another language.

On the other hand, the call service method using a voice recognition according to the present invention for solving the above-described object, (a) a plurality of users, each using a service using the device to access the service server through the network; (b) the service server receiving a voice from the plurality of service using devices; (c) converting the voice received by the STT converter of the service server into text; (d) the service server stores text converted by the STT conversion unit in a storage unit provided in the service server, and provides each to the plurality of service use devices, and is provided in each of the plurality of service use devices Displaying in real time on the display unit; (e) analyzing a text stored in the storage unit by a TA analysis unit provided in the service server; And (f) the analysis result DB provided in the service server, recording the results analyzed by the TA analysis unit by category.

In the call service method using voice recognition according to the present invention, after the step (f), (g) the question answer generation unit of the service server generates a specific question and an expected answer matching it from data stored in the analysis result DB Databaseization; may include.

In the call service method using voice recognition according to the present invention, after step (g), (h) the service server receives the voices from the plurality of service use devices, and receives the voices through the STT converter. Converting to text, and repeating the process of analyzing the text converted by the STT conversion unit to the TA analysis unit, distinguishing the questioner and the answerer among the plurality of users, and answering the question among the text converted by the STT conversion unit When the text corresponding to the question stored in the generating unit is generated, the expected answer matching the corresponding question among the expected answers stored in the question answer generating unit is provided to an answerer's service using device among the plurality of service using devices to use the corresponding service It may include a; to be displayed on the display unit of the device.

In the call service method using voice recognition according to the present invention, after the step (d), (i) the evaluation recorder of the service server, from a consultant authorized to evaluate the call content to the call content stored in the storage unit Inputting an evaluation result to the user and recording the evaluation result; And (j) when the user requests the consultant's evaluation of the content of his or her call through the service using device, the service server retrieves the evaluation result for the user from the evaluation record data. And providing the user's service using device.

In the call service method using voice recognition according to the present invention, before step (i), (k) the consultant management unit of the service server stores information of authorized consultants to evaluate the call content, and a list of stored consultants Providing information and information to the service using device; And (l) when the user selects a specific consultant from the list of consultants provided to the service using apparatus and requests the service server to evaluate the contents of his or her call through the service using apparatus, the service server receives the consultant management unit. It may include the step of notifying to the contact information of the consultant registered in, and receiving an evaluation of the call content of the user requesting the evaluation from the consultant.

The call service method using voice recognition according to the present invention provides, after step (d), (m) an interface for a user to select text displayed on the display unit, and for text selected by the user. And displaying the translated text on the display unit.

The call service method using voice recognition according to the present invention may include the steps of receiving text through the service using apparatus and displaying the translated text in which the text is translated into another language on the display unit.

According to the present invention, for various purposes such as remote interviews, teleconferences, and the like, a voice call or video call, one-to-one call, one-to-many call, multiple-to-many call, etc. are provided. While, it is possible to convert conversations between users into text and provide them to users in real time. Therefore, it enables a more smooth and accurate call between users.

In addition, according to the present invention, by storing the conversation contents between users by converting it into text, it is possible to provide a recording record to a user without creating a separate recording record by a manpower.

In addition, according to the present invention, it is possible to classify and categorize and categorize different words or phrases related to a specific word or phrase for a specific word or phrase by analyzing the stored text and storing the converted text. have. Such data can be provided as big data that can be usefully utilized in various fields.

In addition, according to the present invention, the service server can provide an expected answer to a specific question to a user in need while a call between users is in progress. Therefore, it can be useful for users who need to answer during a remote interview or a meeting conducted in a foreign language.

In addition, according to the present invention, it is possible to provide a translated text in which text displayed on the service using device is translated into another language during a call between users. Therefore, a user who is not familiar with a foreign language can conveniently use a remote meeting or a remote interview conducted in a foreign language, and enables a smooth remote meeting or a remote interview with a foreigner.

In addition, according to the present invention, the user can receive consulting from a professional consultant on the content of his or her call. In other words, the user can obtain information about his/her lacking part by receiving a consultant's evaluation on a remote interview or a remote foreign language meeting he has conducted in the past.

1 schematically shows a call service system using voice recognition according to an embodiment of the present invention.
2 is a block diagram showing a service using apparatus of a call service system using voice recognition according to an embodiment of the present invention.
3 is a block diagram showing a service server of a call service system using voice recognition according to an embodiment of the present invention.
4 is a block diagram showing a consulting service apparatus for a call service system using voice recognition according to an embodiment of the present invention.
5 is a flowchart illustrating a call service method using voice recognition using a call service system using voice recognition according to an embodiment of the present invention.
6 to 8 illustrate exemplary screens displayed on a display unit provided in a service using apparatus of a call service system using voice recognition according to an embodiment of the present invention.
9 is a flow chart for explaining a call content consulting method using a call service system using voice recognition according to an embodiment of the present invention.
10 shows a modification of the service using device.

Hereinafter, a call service system and method using voice recognition according to the present invention will be described in detail with reference to the drawings.

1 is a block diagram schematically showing a call service system using voice recognition according to an embodiment of the present invention, and FIG. 2 is a block diagram showing a service using apparatus of a call service system using voice recognition according to an embodiment of the present invention. 3 is a block diagram showing a service server of a call service system using voice recognition according to an embodiment of the present invention, and FIG. 4 is consulting use of a call service system using voice recognition according to an embodiment of the present invention It is a block diagram showing the device.

As shown in the figure, the call service system 100 using voice recognition according to an embodiment of the present invention provides a service using apparatus 200 for a service user and a service using the service using apparatus 200 It includes a service server 300 and a consulting use device 400 for a consultant. The service server 300 is communicatively connected to the service use device 200 and the consulting use device 400 through the network 500, respectively. Here, the network 500 may be a wired network or a wireless network.

The call service system 100 using voice recognition according to an embodiment of the present invention provides a call service to users, recognizes the voices of users, and uses big data services through conversation analysis of users, such as English or Chinese. It can provide various services such as real-time translation of foreign languages. Here, speech recognition is a process of mapping an acoustic speech signal into text, and refers to a process of converting an acoustic signal obtained through a microphone into a word, a word set, or a sentence. The call service of the call service system 100 using voice recognition according to an embodiment of the present invention may include both a voice call service and a video call service.

1 and 2, the service using apparatus 200 includes a microphone 210 for voice input, a speaker 220 for outputting sound, a display unit 215 for outputting a screen, and a network ( It includes a communication unit 205 and the control unit 225 to communicate with the service server 300 through 500.

The speaker 220 may output various sounds, such as a user's voice or a user's voice. As the speaker 220, a variety of things that can output sound, such as a wired speaker or a Bluetooth wireless speaker, can be used.

The display unit 215 may display various information visually recognizable by the user. The display unit 215 may be used for a variety of visual information, such as text converted by the service server, text translated by the user, or GUI for user input when the user makes a call. have.

The communication unit 205 transmits a signal or data to an external device such as the service server 300, and performs a function of receiving a signal or data from the external device. A variety of wired communication or wireless communication functions may be used as the communication unit 205.

The control unit 225 is electrically connected to the microphone 210, the speaker 220, the display unit 215, and the communication unit 205, and controls the overall operation of the service using apparatus 200.

In addition, the service using apparatus 200 may include an input unit 230, a storage unit 235, and a printing unit 240. The input unit 230 may be provided in various forms in which a user can input information or select information. When using the service, the user may be provided with translated text translated into another language by inputting text through the input unit 230. The storage unit 235 may store various information such as voice information input through the microphone 210, information input through the input unit 230, text transmitted from the service server 300, and voice. The printing unit 240 may output data generated by the service using apparatus 200, data transmitted from the service server 300, data stored in the storage unit 235, and the like, and provide it to the user.

The service using apparatus 200 is communicatively connected to the service server 300 to enable a user to communicate with other users, and to display text transmitted from the service server 300 through the display unit 215, It provides an interface that enables information input or selection by users. The user may be provided with a translation service for text by selecting the text displayed on the display unit 215 through an interface provided by the service using apparatus 200.

The service using device 200 can provide a communication function, a voice output function, a display function, and a user input interface, such as a personal portable terminal, a PC, a notebook computer, a tablet PC, a netbook computer, a digital wearable device, and a digital TV. Various types can be used. An app for using a service may be installed in the service using device 200.

1 and 3, the service server 300 is communicatively connected to the service usage apparatus 200 and the consulting usage apparatus 400 through a network 500 to provide communication services. The service server 300 includes a communication unit 305, an STT conversion unit 310, a storage unit 315, a TA analysis unit 320, an analysis result DB 325, and a question answer generation unit 330 And a translation unit 335, an evaluation recording unit 340, a user management unit 345, a consultant management unit 350, a payment unit 355, and a control unit 360. The service server 300 may be connected to a plurality of service use devices 200 and a network 500 to provide a call service to a plurality of users. That is, the service server 300 relays communication between the plurality of service use devices 200 and receives voice or video signals from each service use device 200 to convert voice to text to provide various services to users. Can provide.

The communication unit 305 connects to the network 500 to perform a communication function, transmits a signal or data to the service using device 200 or the consulting using device 400, and uses the service using device 200 or the consulting using device ( 400) can receive a signal or data. As the communication unit 305, a variety of wired communication or wireless communication functions can be used.

The STT conversion unit 310 serves to convert the voice received from the service using device 200 into text. The STT converter 310 converts the voice in a call to text in real time while users are making a call through the service using device 200. The text converted to the STT conversion unit 310 is transmitted to the service use devices 200 of the respective call target users, displayed on the display unit 215 of each service use device 200, and stored in the storage unit 315 Can be.

The storage unit 315 may store text converted by the STT conversion unit 310, voice received from the service using apparatus 200, and other information or data. As the storage unit 315 stores conversations between users, the service server 300 may provide a recording function. That is, when the user requests the content of his or her call to the service using device 200, the service using device 200 searches for the content of the call stored in the storage unit 315 and retrieves the content of the call requested by the user. It can be provided to the service using device 200.

The TA analysis unit 320 serves to analyze text stored in the storage unit 315. The TA analysis unit 320 may analyze the content of calls between users by using the text converted by the STT conversion unit 310. That is, the TA analysis unit 320 may organize text converted by the STT conversion unit 310 into categories by a method such as word analysis or phrase analysis. For example, the TA analysis unit 320 may organize and organize related contents into a specific category when a specific question and an answer thereto exist in the text.

The analysis result DB 325 records the results analyzed by the TA analysis unit 320. That is, the analysis result DB 325 may organize and record and analyze the results analyzed by the TA analysis unit 320 by category.

As various users receive communication services through the service server 300, the TA analysis unit 320 analyzes various conversations between users, and the analysis result DB 325 analyzes the TA analysis unit 320 Content can be continuously upgraded. Therefore, it is possible to construct a wide range of databases by matching various words or phrases related to a specific word or phrase.

The question answer generation unit 330 may generate and database a specific question and an expected answer matching the result from data stored in the analysis result DB 325. That is, the question answer generation unit 330 may generate an expected answer for a specific question from a specific question and answers related to the analysis result DB 325.

The information generated by the question and answer generator 330 may be provided during a call between users. That is, when text corresponding to a question stored in the question answer generation unit 330 is generated among texts converted by the STT conversion unit 310 during a call between users, the service server 300 generates a question answer Among the expected answers stored in the unit 330, an expected answer matching the corresponding question may be provided to the service using apparatus 200. This expected answer function can be useful for users who need to answer during a remote interview or a meeting conducted in a foreign language.

The translation unit 335 translates text converted by the STT conversion unit 310 or text input through the input unit 230 of the service using apparatus 200. When the user requests translation of the text while using the communication service, the translation unit 335 translates the text requested by the user into various foreign languages such as English and Chinese, or translates the user's native language into English or Chinese. One text may be displayed on the display unit 215 of the corresponding service using device 200. Here, the translated text may be provided in various forms required by the user, such as words and sentences.

For such a translation service, the service using apparatus 200 may provide an interface for selecting text displayed on the display unit 215. When the user selects a specific text through the interface of the service using apparatus 200 during a call, the translation unit 335 displays the translated text for the text selected by the user on the display unit 215 of the service using apparatus 200. Can. The interface for selecting the text displayed on the display unit 215 may be implemented in various ways such as selection through text touch and selection by mouse click.

The evaluation recording unit 340 has a function of receiving a result of a consultant performing evaluation on the contents of a call stored in the storage unit 315 and recording the evaluation result of the consultant, and the service server 300 has an evaluation recording unit 340 ), it is possible to provide an evaluation service for the contents of the call to the user. That is, the service server 300 receives the evaluation of the call content of the user from the consultant, and when the user requests the evaluation of the consultant about the content of the call, the service server 300 provides the evaluation result stored in the evaluation recording unit 340 to the user can do.

The consultant may be an expert who has been previously authenticated and registered so that the contents of the call stored in the storage unit 315 can be evaluated. For professional consulting for various categories, the call service system 100 using voice recognition according to the present invention can provide services by registering various experts with expertise in various fields as consultants.

For example, when a remote interview is made between users, the consultant performs evaluation on the interview contents and stores it in the evaluation recorder 340, and the user can request and receive an interview evaluation performed by the consultant. In addition, when a foreign language meeting is conducted, the consultant performs evaluation on the user's foreign language conversation and stores it in the evaluation recorder 340, and the user can request and receive an evaluation for the foreign language meeting conducted by the consultant. Therefore, the user can conveniently receive expert consulting on their skills, attitudes, and areas to be supplemented.

The user management unit 345 stores and manages information of service users. The personal information registered by the user for use of the service may be managed by the user management unit 345.

The consultant management unit 350 manages information of certified consultants. In addition, the consultant management unit 350 may provide information of certified consultants to the service using apparatus 200 according to a preset procedure. When the consultant management unit 350 provides the consultant's information to the service use device 200, the user can check the information of the consultants provided by the consultant management unit 350 and designate a specific consultant to be consulted to receive consulting. have.

The payment unit 355 is for payment of the service cost of the user, and the user can pay the basic cost or additional service cost for using the service through the payment unit 355.

Consulting services of consultants on the contents of calls can be provided to users only if they have paid for additional services. In this case, the service server 300 checks whether or not payment is made through the payment unit 355 when the user requests the consultant's evaluation of the contents of his/her call, and only when the payment is made, the evaluation server 340 Stored evaluation results can be provided to the user.

The control unit 360 includes a communication unit 305, an STT conversion unit 310, a storage unit 315, a TA analysis unit 320, an analysis result DB 325, and a question and answer generation unit 330. , The translation unit 335, the evaluation recording unit 340, the user management unit 345, the consultant management unit 350, and the payment unit 355 is electrically connected, and controls the overall operation of the service server 300 do.

As shown in FIGS. 1 and 4, the consulting usage device 400 provides an interface through which a consultant can perform evaluation on the contents of a call stored in the storage unit 315 of the service server 300. 405), a display unit 410, an input unit 415, a storage unit 420, and a control unit 425.

The communication unit 405 transmits a signal or data to an external device such as the service server 300, and performs a function of receiving a signal or data from the external device. A variety of wired communication or wireless communication functions may be used as the communication unit 405.

The display unit 410 may display various information visually recognizable by the consultant. The display unit 410 includes various data provided by the service server 300, such as text data stored in the storage unit 315 of the service server 300, and various visual information such as a GUI for input. Can be used.

The input unit 415 may be provided in various forms in which a consultant can input information or select information.

The storage unit 420 may receive various information such as data provided from the service server 300, various data transmitted to the consulting using device 400, such as evaluation results performed by a consultant, or data input by the input unit 415. Can be saved.

The control unit 425 is electrically connected to the communication unit 405, the display unit 410, the input unit 415, and the storage unit 420, and controls the overall operation of the consulting usage device 400.

Hereinafter, a call service method using voice recognition using a call service system using voice recognition according to an embodiment of the present invention as described above will be described.

5 is a flowchart illustrating a call service method using voice recognition using a call service system using voice recognition according to an embodiment of the present invention.

As shown in the figure, the call service method using voice recognition according to an embodiment of the present invention includes a service registration step (S11), a user authentication step (S12), a dialing step (S13), and real-time STT conversion. And a storage step (S14).

The service registration step S11 is a step in which a user who wants to use the service provides his/her user information to the service server 300 and applies for service use. At this stage, the user can access the service application webpage to sign up for membership, install the app, and perform the service registration process. The information provided by the user in the service registration step S11 may be recorded and managed in the user management unit 345 of the service server 300.

In the user authentication step (S12), when the service subscription user accesses the service server 300 through the network 500 using his/her service using apparatus 200, the service server 300 records in the user management unit 345 It is a step of inquiring the user information and confirming the user.

The user authenticated in the user authentication step (S12) can make a call with another user who wants to make a call by performing the phone call in the dialing step (S13). In this case, the call may be made in various forms such as a voice call or a video call, a one-to-one call, a one-to-many call, a multi-to-many call for various purposes such as a remote interview and a remote meeting.

During a call between users, a real-time STT conversion and storage step (S14) is executed. The service server 300 connects to the service server 300 to receive voices from a plurality of service use devices 200 receiving a call service, and converts voices received through the STT converter 310 into text. At this time, the text converted by the STT conversion unit 310 is stored in the storage unit 315 of the service server 300 and provided to each of a plurality of service use devices 200 to be displayed on each service use device 200 Can be.

The text provided to each service using device 200 may be displayed in real time on the text display area 216 of the display unit 215 provided in each service using device 200 in the form shown in FIG. You can check the contents of the call in text. In addition to the converted text, the user's display unit 215 may display a counterpart user, his or her appearance, or various other information.

In addition to the text converted by the STT converter 310 in the storage unit 315 of the service server 300 while a call is being made between users, voices of users may also be stored. In addition, text and voice stored in the storage unit 315 of the service server 300 may be stored in the storage unit 235 of the user service use apparatus 200 in the same way.

After the STT conversion and storage step (S14), a TA analysis and storage step (S16) and an expected answer providing step (S17) may be performed.

In the TA analysis and storage step (S16), the text converted by the STT conversion unit 310 and stored in the storage unit 315 is analyzed by the TA analysis unit 320, and the analysis result of the TA analysis unit 320 is displayed. The analysis results are recorded in DB 325. In this step, the TA analysis unit 320 organizes the text converted by the STT conversion unit 310 into categories by word analysis or phrase analysis, and the analysis result DB 325 analyzes the TA analysis unit 320 ) The results of analysis are organized by category to record and database. At this time, for a specific word or phrase, other words or phrases related to this may be extensively matched and databased, and the question answer generator 330 predicts matching with a specific question from data stored in the analysis result DB 325 You can create an answer and database it.

The expected answer providing step (S17) is a step in which the service server 300 provides an expected answer to a specific question to the user while a call is made between users. The service using device 200 receives a voice from a plurality of service using devices 200 during a call, converts the received voice into text through the STT converter 310, and sends it to the STT converter 310. While performing the process of analyzing the text converted by the TA analysis unit 320, it is possible to distinguish between the questioner and the answerer among a plurality of users. In addition, if text corresponding to the question stored in the question answer generator 330 is generated among the text converted by the STT converter 310, the corresponding question is matched among the expected answers stored in the question answer generator 330 The expected answer can be provided to the service use device 200 of the answerer who needs to answer the question among the plurality of service use devices 200.

The predicted answer provided to the respondent's service using apparatus 200 may be displayed on the expected answer display area 217 of the display unit 215 provided in the service using apparatus 200, as shown in FIG. 7. Accordingly, the user may respond to the other party's question by referring to the expected answer recommended by the service using apparatus 200 to the other party's question while using the call service.

If the call between users is a remote interview, the expected answer may be an answer to an interview question. In addition, when the call between users is a foreign language meeting, the expected answer may be a foreign language answer to a foreign language question.

Meanwhile, a user may receive a translation service for text displayed on his/her display unit 215 during a call service. When the text provided to the user's service using apparatus 200 is a foreign language, the user may select text that needs to be translated through an input interface provided by the service using apparatus 200. At this time, the translation unit 335 performs the translation function for the text converted by the STT conversion unit 310, so that the translation text can be displayed on the display unit 215 of the service using apparatus 200. In addition, when the text provided to the user's service using apparatus 200 is the user's native language, the user can be provided with various foreign language translated texts. To this end, the user can receive text translated from the service server 300 by selecting text that needs to be translated and a foreign language desired to be translated through the input interface provided by the service using apparatus 200.

The translated text may be displayed on the translated text display area 218 of the display unit 215 provided in the service using apparatus 200 as shown in FIG. 8. Therefore, the user can interpret the foreign language text without difficulty during the use of the call service. The translation display area 218 may be formed in various forms that can be distinguished from the text display area 216, such as a speech bubble shape as illustrated.

The translation service may be provided using a function of the service using device 200 itself, not the service server 300. In this case, a translation service for text may be provided by operating a dictionary program or an app installed in the service using device 200 or a translation program or app.

In addition, the call service method using voice recognition according to an embodiment of the present invention may include a step for providing a consulting service for the content of the call to the user.

That is, in the call service method using voice recognition according to an embodiment of the present invention, as shown in FIG. 9, in order to provide a consulting service for the contents of a call to a user, a conversation list selection step (S21) and a consultant selection step ( S22), a payment step (S23), an evaluation step (S24), and an evaluation result providing step (S25).

The conversation list selection step (S21) is a step in which the user checks the conversation list that he or she has called in the past through his service use apparatus 200, and selects the conversation content that he or she wants to be evaluated by a consultant. To this end, the user can access the service server 300 through his/her service using device 200 and search his/her past conversation list and contents, or the user's conversation list stored in the service server 300 and Content may be provided to the service using device 200.

The consultant selection step (S22) is a step in which the user selects a consultant who wishes to be evaluated. To this end, a user can access the service server 300 through his/her service using device 200 and search for a list and information of consultants stored in the consultant management unit 350 of the service server 300, or a consultant A list and information of consultants stored in the management unit 350 may be provided to the service using device 200.

The payment step S23 is a step in which the user pays for the use of the consulting service. The user may access the service server 300 through the service using device 200 to pay the cost, or pay in various other ways. At this time, the payment unit 355 of the service server 300 records and manages payment information.

The evaluation step S24 is a step in which the consultant selected by the user performs evaluation on the specific currency content of the user who has completed the payment. When the user selects a currency list and a consultant who wants to be evaluated and completes the payment, the service server 300 notifies the consultant. The service server 300 may notify the consultant of the consulting request to the consultant designated as the contact number (conversion number, email, SNS, etc.) of the consultant registered in advance in the consultant management unit 350.

The consultant who has been requested to consult may access the service server 300 through his/her consulting use device 400 and perform evaluation on the user's call content. To this end, a consultant can access the service server 300 through his/her consulting use device 400 to search the user's conversation list and contents, or the user's conversation list and contents stored in the service server 300 It can be provided to the consulting using device 400. The evaluation results performed by the consultant are recorded in the evaluation recording unit 340.

The evaluation result providing step (S25) is a step for providing the evaluation result of the consultant to the user. The service server 300 may provide the evaluation result stored in the evaluation recording unit 340 to the user's service using device 200.

In the call service method using voice recognition according to an embodiment of the present invention, storage of text or voice for conversation content, text analysis, evaluation of call content, etc., are limited to users who agree to this among service users. Can be performed.

As described above, according to the present invention, users can make various types of calls, such as voice calls or video calls, one-to-one calls, one-to-many calls, many-to-many calls, for various purposes such as remote interviews and teleconferencing. While providing a call service, the conversation between users can be converted into text and provided to users in real time. Therefore, it enables a more smooth and accurate call between users.

In addition, according to the present invention, by storing the conversation contents between users by converting it into text, it is possible to provide a recording record to a user without creating a separate recording record by a manpower.

In addition, according to the present invention, the text in which the content of the call is converted is stored, and the service server analyzes the stored text to broadly match other words or phrases related to a specific word or phrase and classify and categorize them into categories. have. Such data can be provided as big data that can be usefully utilized in various fields.

In addition, according to the present invention, the service server can provide an expected answer to a specific question to a user in need while a call between users is in progress. Therefore, it can be useful for users who need to answer during a remote interview or a meeting conducted in a foreign language.

Further, according to the present invention, it is possible to provide a translation text for text displayed on the service using apparatus while a call between users is in progress.

In addition, according to the present invention, the user can receive consulting from a professional consultant on the content of his or her call. In other words, the user can obtain information about his/her shortage by receiving a consultant's evaluation on a remote interview or a remote foreign language meeting that he/she conducted in the past.

The present invention has been described as a preferred example, but the scope of the present invention is not limited to the form described and illustrated above.

For example, the user service use device 200 or the consulting use device 400 is not limited to the illustrated structure and may be variously changed. For example, as shown in FIG. 10, the user service use apparatus 600 may include a display unit 215, a speaker 220, and a portable terminal 610. The display unit 215 and the speaker 220 may be wired or wirelessly connectable. The service using apparatus 600 may perform functions such as call, input, and translation by utilizing various functions of the mobile terminal 610.

In addition, previously, it has been shown that the consultant using the consulting device 400 for accessing the service server 300 through the network 500 is separately provided for the consultant to evaluate the call content of the user, but the consulting using device ( 400) may be omitted. In this case, the service server 300 provides an interface through which the consultant can perform evaluation, so that the consultant can evaluate the user's call content through the service server 300.

Above, the present invention has been shown and described in connection with a preferred embodiment for illustrating the principles of the present invention, but the present invention is not limited to the configuration and operation as shown and described. Rather, those skilled in the art will appreciate that many changes and modifications to the present invention are possible without departing from the spirit and scope of the appended claims.

100: call service system using voice recognition
200, 600: service use device 205, 305, 405: communication unit
210: microphone 215, 410: display unit
220: speaker 225, 360, 425: control unit
230, 415: input unit 235, 315, 420: storage unit
240: printing unit 300: service server
310: STT conversion unit 320: TA analysis unit
325: Analysis result DB 330: Question answer generator
335: translation unit 340: evaluation record book
345: User management department 350: Consultant management department
355: payment unit 400: consulting using device
500: network 610: mobile terminal

Claims (17)

A plurality of service use devices for service users; And
It includes; a service server for communicating with the plurality of service use devices through a network to provide a call service to the plurality of service use devices; includes,
The service using device,
A microphone, a speaker, a display unit, a communication unit communicating with the service server via the network, a microphone, the speaker, the display unit, and a control unit electrically connected to the communication unit are provided.
The service server,
A communication unit communicating with the service using device through the network, an STT converting unit converting voice received from the service using device into text, a storage unit storing text converted by the STT converting unit, and the storage A TA analysis unit for analyzing text stored in the unit, an analysis result DB for recording the analysis result of the TA analysis unit, the STT conversion unit, the storage unit, the TA analysis unit, and the analysis result DB And a question answer generator that generates a database by generating a specific question and expected answers matching it from data stored in the analysis result DB.
The text converted by the STT conversion unit is provided to the service using device and displayed in real time on the display unit,
The storage unit stores the voice and other information or data received from the service using device,
When a service user requests his/her call content stored in the storage unit through the service using device, the service server searches for the call content stored in the storage unit and provides the call content requested by the user to the service using device and,
The service server repeats the process of receiving a voice from the plurality of service use devices, converting the received voice into text through the STT converter, and analyzing the text converted by the STT converter into the TA analyzer While distinguishing the questioner and the answerer among the plurality of users, if the text corresponding to the question stored in the question answer generating unit is generated among the text converted by the STT conversion unit, among the expected answers stored in the question answer generating unit A call service system using voice recognition, characterized in that the predicted answer matching the question is provided to the service use device of the answerer among the plurality of service use devices and displayed on the display unit of the service use device.
delete delete According to claim 1,
The service server,
A call service using voice recognition, characterized in that it includes an evaluation recording unit that receives a result of the evaluation performed by the consultant who is authorized to evaluate the call contents and evaluates the call contents stored in the storage unit and records the evaluation result of the consultant. system.
The method of claim 4,
The service server,
When the user requests the consultant's evaluation of the content of his or her call, a call service system using voice recognition, characterized in that the user provides the evaluation result stored in the evaluation recording unit.
The method of claim 5,
The service server,
It includes a consultant management unit that can manage the information of authorized consultants to evaluate the contents of calls stored in the storage unit and provide the information to the service using device,
The service use apparatus receives the information of consultants from the consultant management unit and provides an interface through which a user can select a consultant who can be evaluated for the contents of his or her call, a call service system using voice recognition. .
The method of claim 5,
The service server,
Includes a payment unit for payment of service costs,
When the user requests the consultant's evaluation of the contents of his or her call, the voice recognition is characterized in that the user checks the payment through the payment unit and provides the evaluation result stored in the evaluation recording unit to the user only when payment is made. Call service system used.
The method of claim 4,
A communication service system using voice recognition, comprising: a consulting service device that communicates with the service server through the network and provides an interface through which a consultant can perform evaluation on the contents of calls stored in the storage unit. .
According to claim 1,
The service using device provides an interface through which a user can select text displayed on the display unit,
A call service system using speech recognition, characterized in that the display unit displays translated text obtained by translating text selected by a user into another language.
According to claim 1,
The service using device has an input unit,
A call service system using speech recognition, characterized in that the display unit displays translated text translated from another text through the input unit into another language.
(a) a plurality of users each accessing a service server through a network using a service using device;
(b) the service server receiving a voice from the plurality of service using devices;
(c) converting the voice received by the STT converter of the service server into text;
(d) the service server stores text converted by the STT conversion unit, voice received from the service using apparatus, and other information or data in a storage unit provided in the service server, and stores the plurality of services. Providing each to a use device and displaying in real time on a display unit provided in each of the plurality of service use devices;
(e) analyzing a text stored in the storage unit by a TA analysis unit provided in the service server;
(f) the analysis result DB provided in the service server, and records the results analyzed by the TA analysis unit by category;
(g) the step of generating a database by generating a question answer prediction unit matching the specific question from the data stored in the analysis result DB by the question answer generation unit of the service server;
(h) the service server receives voice from the plurality of service use devices, converts the received voice into text through the STT conversion unit, and analyzes the text converted by the STT conversion unit into the TA analysis unit When repeating a process, a questioner and an answerer are distinguished among the plurality of users, and if text corresponding to a question stored in the question answer generator is generated among texts converted by the STT converter, stored in the question answer generator Providing an expected answer matching the corresponding question among the expected answers to the service utilization device of the answerer among the plurality of service utilization devices to be displayed on the display unit of the corresponding service utilization device; And
When a service user requests his/her call content stored in the storage unit through the service using device, the service server searches for the call content stored in the storage unit and provides the call content requested by the user to the service using device Calling method using a voice recognition, characterized in that it comprises a.
delete delete The method of claim 11,
After step (d),
(i) an evaluation record unit of the service server, receiving an evaluation result for the call content stored in the storage unit from a consultant authorized to evaluate the call content, and recording the evaluation result; And
(j) When the user requests the evaluation of the consultant for the contents of his/her call to the service server through his/her service using device, the service server retrieves the evaluation result for the user from the data of the evaluation record and applies Providing to the user's service using device; Call service method using voice recognition comprising a.
The method of claim 14,
Before step (i),
(k) storing information of authorized consultants so that the consultant management unit of the service server can evaluate a call, and providing a list and information of the stored consultants to the service using device; And
(l) When a user selects a specific consultant from a list of consultants provided to the service using device and requests evaluation of his/her call content to the service server through his/her service using device, the service server requests the consultant management unit And notifying the contact information of the registered consultant, and receiving an evaluation of the call content of the user requesting the evaluation from the consultant, a call service method using voice recognition.
The method of claim 11,
After step (d),
(m) providing an interface through which a user can select text displayed on the display unit, and displaying translated text for the text selected by the user on the display unit. Call service method used.
The method of claim 11,
(n) receiving text through the service using device, and displaying the translated text in which the text is translated into another language on the display unit.

Images