KR20190136224A - System for voice call service using distal assistance device, method thereof and non-transitory computer readable medium having computer program recorded thereon - Google Patents

Abstract

Disclosed are a voice call service system using a digital assistance device, a method thereof, and a non-volatile recording medium having a computer program recorded thereon. That is, the voice call service system of the present invention performs a call between the digital assistance device and a receiving terminal through a voice command of a caller, and utilizes a calling terminal when the call between the digital assistance device and the receiving terminal is connected, wherein an actual call is not allowed to pass through the calling terminal. Through intermediation of a service server, the calling terminal makes a call to the receiving terminal with a predetermined number, but the receiving terminal confirms the telephone number of the calling terminal as a caller, and the service server stores communication contents between the digital assistance device and the receiving terminal and provides at least some or all of the stored communication contents between the digital assistant device and the receiving terminal to the calling terminal. Accordingly, any user can easily check contents of conversation exchanged using the digital assistance device between the receiving terminals through the calling terminal.

Description

System for voice call service using distal assistance device, method approximately and non-transitory computer readable medium having computer program recorded thereon}

The present invention relates to a voice call service system using a digital auxiliary device, a method and a nonvolatile recording medium on which a computer program is recorded. In particular, a digital auxiliary device performs a call between a digital auxiliary device and a called terminal through a voice command of a caller. When the call is connected between the device and the called terminal, the calling terminal is used, but the actual call does not go through the calling terminal, and the calling terminal makes a call to the called terminal with a preset number by intermediary of the service server, but the called terminal calls the calling terminal. Voice using a digital auxiliary device that checks the number as a caller, stores the contents of the call between the digital auxiliary device and the called terminal in the service server, and provides at least some or all of the contents of the call between the stored digital auxiliary device and the called terminal to the calling terminal. Call service system, method and computer It relates to non-volatile recording medium on which the program is recorded.

As home automation using digital auxiliary devices such as AI (Artificial Intelligence) speakers is becoming more common and digital auxiliary devices are becoming more popular as new home appliances called AI speakers, digital assistants can be used to make voice calls with the targets. The need to perform is increasing.

In the case of a voice call using an existing digital auxiliary device, a method of performing a voice call using a digital auxiliary device as a real phone when the digital auxiliary device has a telephone function and subscribes to a voice call service is known.

However, in order to do this, it is necessary to configure a telephone function in the digital auxiliary device, and there is a problem in that it is necessary to subscribe to a voice call service which is continuously incurred high cost and cumbersome subscription.

In addition, even in the case of a manufacturer of a digital auxiliary device or providing a service, there is a problem that a user must be authenticated as a device for voice call or a communication service provider for providing a service.

As another method, a method of utilizing a voice call terminal possessed by a user is also known, in which a digital auxiliary device and a voice call terminal are connected in a wired / wireless communication manner to interface only an input and an output of a voice.

That is, after the digital auxiliary device including the speaker and the microphone is connected to the voice call terminal through a short-range communication method such as Bluetooth, and the call of the actual voice call terminal and the called terminal is connected, the microphone and speaker of the voice call terminal are replaced. In the way that the microphone and speaker of the digital auxiliary device replaces, the voice call terminal and the digital auxiliary device must be close to each other, and the operation subject such as a call or termination becomes a voice call terminal, so it is inconvenient to operate the terminal. There is a limit that cannot be managed by a service server for providing a digital auxiliary service based on the voice call contents.

Korean Patent No. 10-1824815 [Name: Method and system for secure call connection between users of the app]

An object of the present invention is to utilize the calling terminal when the call connection between the digital auxiliary device and the called terminal under the overall control of the service server, so that the actual call does not go through the calling terminal, the incoming call with the digital auxiliary device through the caller's voice command A voice call service system using a digital auxiliary device for performing a call between terminals, a method and a computer program are provided.

Another object of the present invention is to maintain the call connection between the calling terminal and the called terminal in parallel when the call connection between the digital auxiliary device and the called terminal by the overall control of the service server, the service server and / or carrier server of the calling terminal The present invention provides a voice call service system using a digital auxiliary device that provides an incoming call notification to a called terminal using a telephone number as a calling number, a method thereof, and a nonvolatile recording medium on which a computer program is recorded.

It is still another object of the present invention to store voice content between a digital auxiliary device and a called terminal in a service server, and to provide a calling terminal with at least some or all of the stored call contents between the digital auxiliary device and the called terminal. The present invention provides a non-volatile recording medium on which a call service system, a method and a computer program are recorded.

According to an embodiment of the present invention, a voice call service method using a digital auxiliary device is based on a voice command transmitted from a digital auxiliary device, identification information of a digital auxiliary device, and a call origination request signal by a service server. Requesting a call origination to the originating terminal corresponding to the identification information; Identifying, by the service server, the digital auxiliary device related to a special number and caller information included in a call processing request signal transmitted from a communication company server; Confirming, by the service server, called party information on the basis of the voice command received from the confirmed digital auxiliary device, and performing a call connection function with the digital auxiliary device; Requesting, by the service server, an incoming call connection with a called terminal corresponding to the called party information based on the identified called party information to the communication company server; Maintaining, by the service server, a call path between the digital assistant and the called terminal formed through the telecommunication company server in response to the requested incoming call connection; And storing, by the service server, call information until the end of the call between the digital assistant and the called terminal.

As an example related to the present invention, when a call path between the digital auxiliary device and the called terminal is formed via the service server and the communication server, another call path between the calling terminal and the called terminal is established by the communication company server. It may further comprise the step of forming in parallel.

As an example related to the present invention, when the call between the digital auxiliary device and the called terminal is terminated, the method further includes releasing, by the telecommunication company server, a connection state between the calling terminal and the called terminal to another call. Can be.

The storing of the call information as an example related to the present invention may include: storing voice information transmitted and received between the digital auxiliary device and the called terminal and matching date information; Storing the stored voice information into text information; Performing voice recognition on the stored voice information to store voice information separately for each user; And converting and storing the voice information separately stored for each user into information in a text form for each user.

As an example related to the present invention, when receiving a call information request signal transmitted from the calling terminal, the method may further include providing, by the service server, call information stored in association with the calling terminal to the calling terminal. have.

As an example related to the present invention, the providing of the stored call information with respect to the calling terminal to the calling terminal includes information for requesting transmission of part or all included in the call information request signal and information on a processing form. Based on the voice call information, the call information of the text form, the call information of any one form of the call information in the form of voice separated by user and the call information in the form of text separated by user can be provided to the calling terminal. have.

A computer program for performing the method according to the above-described embodiments may be stored in a computer-readable nonvolatile recording medium having recorded thereon a program according to an embodiment of the present invention.

According to an embodiment of the present invention, a voice call service system using a digital auxiliary device includes: a digital auxiliary device in which a received voice command of a caller forms a first communication path with a called terminal based on a voice command for call connection; A service server requesting a call origination to a calling terminal associated with the digital auxiliary device to form the first communication path, and storing call information transmitted and received through the first communication path; In response to a call origination request of the service server, a call origination request signal is transmitted using a special number set in advance, and the call origination request signal is transmitted to the service server to receive call information stored in the service server. Terminal; A called terminal which checks a special number and caller information based on the call origination request signal, transmits a call processing request signal including the special number and caller information to the service server, and is transmitted in response to the call processing request signal A communication server configured to form a first call path between the digital assistant and the called terminal based on an incoming call connection request with the caller, and to form a second call path between the calling terminal and the called terminal; And the called terminal, which forms a first communication path with the digital auxiliary device by intermediation of the communication company server, and forms a second communication path with the calling terminal.

As an example related to the present invention, the service server includes voice call information and text call information based on information for requesting transmission of a part or all included in the call information request signal, and information on a processing form. The call information may be provided to the calling terminal in any one form of call information divided by user and call information in text form separated by user.

The present invention utilizes the calling terminal when the call is connected between the digital auxiliary device and the called terminal by the overall control of the service server, but does not pass the actual call through the calling terminal, and between the digital auxiliary device and the called terminal through the caller's voice command. By performing the call, the caller can freely make a call with the called terminal through the digital auxiliary device in a state in which the operation or control of the calling terminal is unnecessary, thereby improving convenience of use.

In addition, the present invention maintains the call connection between the calling terminal and the called terminal in parallel when the call connection between the digital auxiliary device and the called terminal by the overall control of the service server, the call of the calling terminal in the service server and / or the carrier server By providing the incoming call notification to the called terminal using the number as the calling number, the calling terminal checks the information on the called party, such as the calling number, while making a call through the other party's digital auxiliary device, and provides various services based on the subscription information of the calling terminal. These devices can be used even if the calling terminal is not in the vicinity of the user, so that the same calling terminal can be utilized as if one or more digital auxiliary devices exist.

In addition, the present invention stores any call between the digital auxiliary device and the called terminal in the service server, and provides at least some or all of the stored call contents between the digital auxiliary device and the called terminal to the calling terminal, so that any user can use the digital auxiliary device. By using the sender has an effect that can easily check the contents of the conversation exchanged between the receiving terminal using the calling terminal.

1 is a block diagram showing the configuration of a voice call service system using a digital auxiliary device according to an embodiment of the present invention.
2 is a block diagram showing the configuration of a calling terminal according to an embodiment of the present invention.
3 is a block diagram showing the configuration of a voice call service system using another type of digital auxiliary device according to an embodiment of the present invention.
4 to 5 are flowcharts illustrating a voice call service method using a digital auxiliary device according to a first embodiment of the present invention.
6 to 7 are flowcharts illustrating a voice call service method using a digital auxiliary device according to a second embodiment of the present invention.

It should be noted that the technical terms used in the present invention are merely used to describe specific embodiments, and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be interpreted as meanings generally understood by those skilled in the art unless the present invention is defined in any other meaning in the present invention, and is excessively comprehensive. It should not be interpreted in the sense of or in the sense of being excessively reduced. In addition, when a technical term used in the present invention is an incorrect technical term that does not accurately express the spirit of the present invention, it should be replaced with a technical term that can be understood by those skilled in the art. In addition, the general terms used in the present invention should be interpreted as defined in the dictionary or according to the context before and after, and should not be interpreted in an excessively reduced sense.

Also, the singular forms used in the present invention include plural forms unless the context clearly indicates otherwise. Terms such as “consisting of” or “comprising” in the present invention should not be construed as necessarily including all of the various components or steps described in the invention, and some of the components or some steps may not be included. It should be construed that it may further include, or further include, additional components or steps.

In addition, terms including ordinal numbers such as first and second used in the present invention may be used to describe components, but the components should not be limited by the terms. The terms are used only to distinguish one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, and the same or similar components will be given the same reference numerals regardless of the reference numerals, and redundant description thereof will be omitted.

In addition, in describing the present invention, when it is determined that the detailed description of the related known technology may obscure the gist of the present invention, the detailed description thereof will be omitted. In addition, it should be noted that the accompanying drawings are only for easily understanding the spirit of the present invention and should not be construed as limiting the spirit of the present invention by the accompanying drawings.

1 is a block diagram showing the configuration of a voice call service system 10 using a digital assistant according to an embodiment of the present invention.

As shown in FIG. 1, the voice call service system 10 includes a digital assistant device 100, a service server 200, a calling terminal 300, a communication company server 400, and a called terminal 500. Not all components of the voice call service system 10 shown in FIG. 1 are essential components, and the voice call service system 10 may be implemented by more components than those shown in FIG. 1, The voice call service system 10 may also be implemented by fewer components.

When the digital auxiliary device 100 related to the calling terminal 300 requests the service server 200 or the calling terminal 300 to call a connection with the called terminal 500, the calling server 300 from the service server 200. Checks the called terminal 500 based on the special number associated with the < RTI ID = 0.0 > and < / RTI > the voice command transmitted from the digital auxiliary device 100, and the digital auxiliary device 100 and the called terminal 500 by interworking with the communication company server 400. Connect the communication path (or communication path) between, and to connect the communication path between the originating terminal 300 and the communication company server 400 and the destination terminal 500 in parallel and independently for charge. Thereafter, the service server 300 records (or stores) call information between the digital assistant 100 connected to the called terminal 500 in real time, and the digital assistant 100 recorded in the calling terminal 300 and the like. When the call information between the called terminal 500 is requested, call information between the corresponding recorded digital auxiliary device 100 and the called terminal 500 is provided.

The digital auxiliary device 100 includes an AI (Artificial Intelligence) speaker / microphone, a microcontroller (or a controller) (not shown), a communication unit (not shown), a storage unit (not shown), and the like.

In addition, the digital auxiliary device 100 communicates with the service server 200, the preset calling terminal 300, and the like through a wired / wireless communication method. Here, the calling terminal 300 may log in to the corresponding digital auxiliary device 100 in advance and register information (or caller information) related to the calling terminal 300 in the digital auxiliary device 100.

In addition, when the voice command (or voice) of the caller received by the digital auxiliary device 100 is a voice command for call connection for the call with the called terminal 500, the digital auxiliary device 100 may correspond to the corresponding voice command, The identification information, the call origination request signal, etc. of the digital assistant 100 is transmitted to the service server 200. Here, the identification information of the digital auxiliary device 100 includes a mobile IP, a mobile MAC, a serial number, and the like.

That is, the digital assistant 100 receives a voice through the caller (or the user) and performs a voice recognition function for the received voice. At this time, the digital assistant 100 checks whether the received voice is a voice of a pre-registered user (or user authentication), and if the received voice corresponds to a voice of a pre-registered user, The voice recognition function may be performed. Here, the speech recognition function may be performed using various known techniques.

In addition, the digital assistant 100 determines whether a voice command for call connection is included in the result of performing the voice recognition function.

As a result of the determination, when the result of performing the voice recognition function includes a voice command for performing another control function related to the digital auxiliary device 100, the digital auxiliary device 100 corresponds to the digital auxiliary device corresponding to the voice command. Perform another control function with respect to 100.

For example, when the determination result includes the voice command “NUGU, increase the volume one step” in the result of performing the speech recognition function, the digital auxiliary device 100 outputs the speaker of the digital auxiliary device 100. To increase by 1 preset level. Here, "NUGU" may be identification information (or identification name) for the corresponding digital auxiliary device 100.

In addition, when the determination result indicates that the voice command for call connection is included in the result of performing the voice recognition function, the digital auxiliary device 100 corresponds to the voice command, identification information of the digital auxiliary device 100, and call origination request signal. Etc. are transmitted to the service server 200.

In addition, when the voice command (or voice) of the caller received by the digital auxiliary device 100 is a voice command for call connection for the call with the called terminal 500, the digital auxiliary device 100 may correspond to the corresponding voice command, Identification information of the digital auxiliary device 100, a call origination request signal, and the like are transmitted to the calling terminal 300 registered in advance in the digital auxiliary device 100 in association with the corresponding digital auxiliary device 100.

That is, when the determination result indicates that the voice command for call connection is included in the result of performing the voice recognition function, the digital auxiliary device 100 identifies the originating terminal 300 registered in advance in the digital auxiliary device 100. The information is checked and the corresponding voice command, identification information of the digital auxiliary device 100, a call origination request signal, and the like are transmitted to the originating terminal 300 corresponding to the identified identification information of the originating terminal 300. Here, the identification information of the calling terminal 300 includes a mobile directory number (MDN), a mobile IP, a mobile MAC, a subscriber identity module (SIM) card unique information, a serial number, and the like.

In this case, when the digital auxiliary device 100 requests a call origination from the calling terminal 300, the digital auxiliary device 100 calls a dedicated app pre-installed in the calling terminal 300, and then the digital auxiliary device 100. In the state in which the corresponding dedicated app is running on the calling terminal 300, the calling terminal 300 may request a call.

In addition, when a call connection with a specific called terminal 500 fails in response to a call origination request signal, the digital assistant 100 receives information indicating that a call connection transmitted from the service server 200 has failed.

In addition, the digital assistant 100 outputs information indicating that the received call connection failed.

As such, when the call connection fails, the digital auxiliary device 100 may request input of an additional voice command from the user, and may attempt to connect the call again based on the additional voice command input from the user.

In addition, when a voice connection for call connection is included in the result of performing the voice recognition function, call connection (or call connection) is required, the digital auxiliary device 100 controls the service server 200 or the caller terminal 300. Performs a call connection (or call connection) function.

In addition, when the communication path with the called terminal 500 is normally connected under the control of the service server 200 or the calling terminal 300, the digital auxiliary device 100 connects the service server 200 and the communication company server 400. Performs a call function with the called terminal 500 connected via communication.

In addition, when the call between the digital auxiliary device 100 and the called terminal 500 ends, the digital auxiliary device 100 terminates the call connection with the called terminal 500 previously formed under the control of the service server 200. do.

The service server 200 communicates with the digital auxiliary device 100, the calling terminal 300, the communication company server 400, the called terminal 500, and the like.

In addition, the service server 200 matches (or manages) identification information of the digital auxiliary device 100 with identification information of a terminal (for example, the originating terminal 300, etc.) related to the digital auxiliary device 100. )do.

In addition, the service server 200 provides (or installs) a dedicated app for call origination (or call connection) to the calling terminal 300.

In addition, the service server 200 stores a plurality of called party information transmitted from the calling terminal 300. Here, the called party information (or recipient information) includes a name (or nickname / nickname), a telephone number, an email address, social network account information, and the like.

In addition, the service server 200 stores information about the digital auxiliary device 100 corresponding to the special number associated with the calling terminal 300. Through this, when the carrier server 400 wants to check the telephone number of the called terminal 500 by using the special number transmitted from the calling terminal 300, the service server 200 is a digital auxiliary device associated with the special number. In operation 100, the phone number of the called terminal 500 may be confirmed by using the voice command transmitted from the digital assistant device 100 (or the voice command associated with the confirmed digital assistant device 100). .

In addition, the service server 200 receives a voice command transmitted from the digital auxiliary device 100, identification information of the digital auxiliary device 100, a call origination request signal, and the like.

In addition, the service server 200 confirms identification information of the calling terminal 300 corresponding to the identification information of the digital auxiliary device 100 previously received among identification information of the calling terminal for each identification information of the plurality of digital auxiliary devices stored in advance. do. Here, the identification information of the calling terminal 300 includes MDN, mobile IP, mobile MAC, Sim (subscriber identification module) card unique information, serial number and the like.

In addition, the service server 200 requests a call origination to the calling terminal 300 corresponding to the identification information of the confirmed calling terminal 300.

At this time, when the service server 200 requests the call origination terminal 300, after the service server 200 calls a dedicated app pre-installed on the calling terminal 300, the service server 200 is calling terminal The call may be requested to the calling terminal 300 while the corresponding dedicated app is running at 300.

In addition, the service server 200 receives a call processing request signal including a special number, a voice command, caller information, and the like transmitted from the communication company server 400.

In addition, the service server 200 checks the digital auxiliary device 100 related to the special number and / or caller information based on the special number and caller information included in the received call processing request signal.

That is, the service server 200 confirms that the call processing request signal is a signal in response to the call origination request previously transmitted to the originating terminal 300, and digitally assists with the call origination request transmitted to the originating terminal 300. Check the device 100.

In this case, the service server 200 may be configured such that the service server 200 of the digital auxiliary device 100 corresponding to the caller information (or special number) previously received among identification information of the digital auxiliary device for each caller information (or for each special number) stored in advance is stored. You can also check the identification information.

In addition, the service server 200 confirms the called party information based on the confirmed voice command received from the digital auxiliary device 100. Here, the called party information includes a name (or nickname / nickname), a telephone number, an email address, social network account information, and the like.

That is, the service server 200 may include a name / listed in a voice command previously received from among a plurality of phone numbers (eg, name / nickname / nickname, phone number, etc.) registered in advance with respect to the corresponding calling terminal 300. Check the called party information, the telephone number corresponding to the nickname / nickname.

In this case, the service server 200 may check the called party information based on the voice command included in the call processing request signal.

That is, the service server 200 is included in the call processing request signal previously received among a plurality of phone numbers (eg, name / nickname / nickname, phone number, etc.) registered in advance with respect to the corresponding calling terminal 300. Check the called party information, the telephone number corresponding to the name / nickname / nickname included in the voice command.

As a result of the check, when the phone number (or called party information) corresponding to the name / nickname / nickname included in the voice command is not checked among the plurality of phone numbers registered in advance with respect to the calling terminal 300, the service server ( 200 transmits the information indicating that the called party information is not confirmed to the communication company server 400, and transmits the information indicating that the call connection failed to the digital auxiliary device 100.

In addition, as a result of the check, when the phone number corresponding to the name / nickname / nickname included in the voice command among the plurality of phone numbers registered in advance with respect to the calling terminal 300 is confirmed, the service server 200 corresponds to In order to perform a call connection function through the service server 200, a call connection (or call connection) function is performed between the service server 200 and the digital auxiliary device 100.

In addition, the service server 200 is an incoming call connection (or incoming call) with the destination terminal 500 corresponding to the called party information based on the called party information previously identified in response to the call processing request signal of the preceding communication company server 400. Connection signal) to the carrier server 400 (or transmitted).

In addition, when the call connection function between the destination terminal 500 and the service server 200 is normally performed by the corresponding communication company server 400 according to the call processing request signal transmitted to the communication company server 400, the service server 200. May form (or configure) a call path between the digital assistant 100 and the destination terminal 500 via the communication company server 400.

In addition, the call is terminated between the digital auxiliary device 100 and the called terminal 500 with respect to the call path formed between the digital auxiliary device 100 and the called terminal 500 via the service server 200 and the communication company server 400. If so, the call (or call connection state) may be terminated (or released / terminated).

In addition, the service server 200 is voice information (or call) transmitted / received between the digital auxiliary device 100 and the called terminal 500 while the call connection is maintained between the digital auxiliary device 100 and the called terminal 500. History / call information) is matched with date information (e.g., date and time information) and stored. In this case, the service server 200 stores call information for the entire talk time from the start of the call connection between the digital auxiliary device 100 and the called terminal 500 to the end of the call connection.

That is, the service server 200 may transmit voice information transmitted / received between the digital auxiliary device 100 and the called terminal 500 while the call connection is maintained between the digital auxiliary device 100 and the called terminal 500. Call recording function (or call information storage function) is performed by matching with.

In addition, the service server 200 may convert and store voice information recorded (or stored) in real time into information (or recording) in the form of text.

In addition, the service server 200 may perform a voice recognition function on the recorded (or stored) voice information, and may separate and store the voice information for each user (for example, by caller, called party, and the like).

In addition, the service server 200 may convert and store voice information separately stored for each user into information in a text form for each user.

As such, the service server 200 not only stores call information between terminals, but also converts call information in a voice form into call information in a text form so as to easily grasp corresponding call information, or calls per user. Information can be stored separately (or managed).

In addition, the service server 200 receives a call information request signal transmitted from the calling terminal 300.

In addition, the service server 200 may be configured to obtain voice information related to the calling terminal 300 (or voice information between the digital assistant 100 and the called terminal 500 related to the calling terminal 300) from among the stored voice information. The caller terminal 300 transmits the call information in the form of voice or text by processing (or converting / converting) the confirmed voice information based on the information on the processing form of the voice information included in the corresponding call information request signal. To transmit. In this case, when there is a plurality of voice information associated with the corresponding calling terminal 300, the service server 200 may check (or select) one or more voice information satisfying a preset condition. Here, the preset condition may include a state which is the latest in chronological order.

That is, the service server 200 may be any one of voice call information, text call information, voice call information divided by user, and text call information separated by user based on the call information request signal. The call information of the form is transmitted to the calling terminal 300.

As such, the service server 200 may increase the convenience of the user by providing the corresponding call information in the form requested by the corresponding terminal in response to a request of the terminal that wants to receive the recorded call information.

The calling terminal (or sending terminal) 300 and the called terminal (or receiving terminal) 500 are a smart phone, a portable terminal, a mobile terminal, and a personal digital assistant. : PDA), PMP (Portable Multimedia Player) Terminal, Telematics Terminal, Navigation Terminal, Personal Computer, Notebook Computer, Slate PC, Tablet PC, Tablet PC (ultrabook), wearable device (e.g., watch type terminal (Smartwatch), glass type terminal (Smart Glass), HMD (Head Mounted Display), etc.), Wibro terminal, IPTV (Internet Protocol Television) Terminal, Smart TV, Digital Broadcasting Terminal, Television, 3D Television, Home Theater System, AVN (Audio Video Navigation) Terminal, A / V (Audio / Video) System, Flexible Terminal Such as It can be applied to various devices.

As shown in FIG. 2, the calling terminal 300 includes a communication unit 310, a storage unit 320, a display unit 330, a voice output unit 340, and a controller 350. Not all components of the originating terminal 300 illustrated in FIG. 2 are essential components, and the originating terminal 300 may be implemented by more components than those illustrated in FIG. 2, and fewer components are provided. The calling terminal 300 may also be implemented.

The communication unit 310 communicates with any component inside or any at least one terminal outside through a wired / wireless communication network. In this case, any external terminal may include the digital auxiliary device 100, the service server 200, the communication company server 400, the called terminal 500, and the like. Here, the wireless Internet technologies include Wireless LAN (WLAN), Digital Living Network Alliance (DLNA), Wireless Broadband (Wibro), WiMAX (World Interoperability for Microwave Access (Wimax), HSDPA (High Speed Downlink Packet Access). ), HSUPA (High Speed Uplink Packet Access), IEEE 802.16, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless Mobile Broadband Service (WMBS), etc. The communication unit 310 transmits and receives data according to at least one wireless Internet technology in a range including the Internet technologies not listed above. In addition, near field communication technologies include Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and Near Field Communication (NFC). Ultrasound Communication (USC), Visible Light Communication (VLC), Wi-Fi, Wi-Fi Direct, and the like may be included. In addition, the wired communication technology may include power line communication (PLC), USB communication, Ethernet, serial communication, serial communication, optical / coaxial cable, and the like.

In addition, the communication unit 310 may mutually transmit information with any terminal through a universal serial bus (USB).

In addition, the communication unit 310 may include technical standards or communication schemes (eg, Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), and EV-) for mobile communication. Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (DO), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), LTE-A ( Long Term Evolution-Advanced) and the like transmit and receive radio signals to the base station, the digital auxiliary device 100, the service server 200, the carrier server 400, the destination terminal 500 and the like.

In addition, the communication unit 310 receives a dedicated app for call origination (or call connection) with any destination terminal 500 transmitted from the service server 200.

The storage unit 320 (or a memory) stores various user interfaces (UIs), graphical user interfaces (GUIs), and the like.

In addition, the storage unit 320 stores data and programs necessary for the originating terminal 300 to operate.

That is, the storage unit 320 may store a plurality of application programs (application programs or applications), data for operation, and instructions that are driven in the calling terminal 300. At least some of these applications may be downloaded from an external service providing apparatus through wireless communication. In addition, at least some of these application programs may exist in the calling terminal 300 from the time of shipment for basic functions (for example, a call receiving / outgoing function and a message sending / receiving function). Meanwhile, the application program may be stored in the storage 320 and installed in the calling terminal 300 to be driven by the controller 350 to perform an operation (or a function).

In addition, the storage unit 320 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory). Etc.), magnetic memory, magnetic disk, optical disk, random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EPM), PROM It may include at least one storage medium of (Programmable Read-Only Memory). In addition, the originating terminal 300 may operate a web storage that performs a storage function of the storage 320 on the Internet, or may operate in connection with the web storage.

In addition, the storage 320 installs a dedicated app for call origination (or call connection) with any destination terminal 500 received through the communication unit 310 under the control of the control unit 350.

The display unit 330 may display various contents such as various menu screens by using a user interface and / or a graphic user interface stored in the storage 320 under the control of the controller 350. Here, the content displayed on the display unit 330 includes a menu screen including various text or image data (including various information data) and data such as icons, list menus, combo boxes, and the like. In addition, the display unit 330 may be a touch screen.

In addition, the display unit 330 may include a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display ( The display device may include at least one of a flexible display, a 3D display, an e-ink display, and a light emitting diode (LED).

In addition, the display unit 330 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

The stereoscopic display unit may be a three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glasses-free method), a projection method (holographic method).

In addition, the display unit 330 displays an execution result screen of the dedicated app installed in the calling terminal 300 under the control of the controller 350.

The voice output unit 340 outputs voice information included in a signal processed by the controller 350 by a predetermined signal. Here, the voice output unit 340 may include a receiver, a speaker, a buzzer, and the like.

In addition, the voice output unit 340 outputs the guide voice generated by the control unit 350.

In addition, the voice output unit 340 outputs voice information corresponding to the execution result screen of the dedicated app installed in the calling terminal 300 by the control unit 350.

The controller 350 executes an overall control function of the calling terminal 300. In this case, the controller 350 may be a processor or an engine.

In addition, the controller 350 executes an overall control function by using the program and data stored in the storage 320. The controller 350 may include a RAM, a ROM, a CPU, a GPU, a bus, and the RAM, a ROM, a CPU, a GPU, and the like may be connected to each other through a bus. The CPU may access the storage 320 to perform booting using the O / S stored in the storage 320, and various operations using various programs, contents, and data stored in the storage 320 may be performed. Can be performed.

In addition, the controller 350 accesses the digital auxiliary device 100 through the communication unit 310. In this case, the controller 350 may perform a login function for the corresponding digital auxiliary device 100 based on login information (eg, ID, password, etc.) according to a user input.

In addition, the controller 350 interoperates with the digital auxiliary device 100 and registers information (or caller information) related to the calling terminal 300 to the digital auxiliary device 100.

In addition, the control unit 350 accesses the service server 200 through the communication unit 310.

In addition, the controller 350 controls the communication unit 310 to receive a dedicated app for call origination (or call connection) with any destination terminal 500 transmitted from the service server 200.

In addition, the controller 350 installs the received dedicated app in the corresponding calling terminal 300.

In addition, the controller 350 registers one or more called party information according to the user's selection from the phone book stored in the storage 320 in the service server 200. Here, the called party information includes a name (or nickname / nickname), a telephone number, an email address, social network account information, and the like.

In addition, the controller 350 registers information (or identification information of the digital auxiliary device 100) corresponding to the special number associated with the corresponding calling terminal 300 to the service server 200. . Through this, when the communication unit 310 receives the call origination request from the service server 200, even if the control unit 350 does not know the called party information associated with the destination terminal 500, the communication company server 400 By transmitting to the service server 200 via the service, the service server 200 is a digital auxiliary device corresponding to the special number among the information on the digital auxiliary device for each special number registered in advance in the service server 200 ( 100, the caller information may be checked based on the confirmed voice command related to the digital auxiliary device 100 to perform a call connection between the digital auxiliary device 100 and the called terminal 500.

In addition, when the digital auxiliary device 100 transmits a call origination request signal to the service server 200, the communication unit 310 receives a call origination request transmitted from the service server 200.

In this case, the control unit 350 receives a dedicated app call signal pre-installed in the corresponding calling terminal 300 from the service server 200 through the communication unit 310 and based on the received dedicated app calling signal, the corresponding calling terminal 300. After executing the dedicated app pre-installed in the), it may be possible to receive a call origination request transmitted from the service server 200 while the dedicated app is running.

In addition, the controller 350 controls the communication unit 310 to receive a voice command transmitted from the digital auxiliary device 100, identification information of the digital auxiliary device 100, a call origination request signal, and the like.

In this case, the control unit 350 receives a dedicated app call signal pre-installed in the corresponding calling terminal 300 from the digital auxiliary device 100 through the communication unit 310 and based on the received dedicated app calling signal (the corresponding calling terminal ( After executing the dedicated app pre-installed at 300, the voice command transmitted from the digital auxiliary device 100, the identification information of the digital auxiliary device 100, the call origination request signal, etc., can be received while the dedicated app is running. It may be.

In addition, the controller 350 may respond to the call origination terminal 300 through a dedicated app running on the call originating terminal 300 in response to the call origination request of the received service server 200 or the digital auxiliary device 100. Using the preset special number (or special number), the carrier server 400 requests a call origination (or transmits a call origination request signal).

That is, the control unit 350 responds to the call origination request of the service server 200 or the digital auxiliary device 100 by using a special number preset in correspondence with the corresponding originating terminal 300 and the originating terminal 300. Call transmission request signal including identification information (or a phone number of the calling terminal 300) and the like through the communication unit 310 to the communication company server 400. Here, the special number may be a unique number set in advance in order to attempt a call connection using the corresponding calling terminal 300.

In addition, when a communication path is formed between the digital auxiliary device 100 and the service server 200, the communication company server 400, and the called terminal 500 by mediation (or relay) of the communication company server 400, the communication unit 310. ) Forms another communication path between the calling terminal 300 and the communication company server 400 and the called terminal 500 in parallel with the preceding communication path by the mediation of the communication company server 400. In this case, another call between the calling terminal 300 and the called terminal 500 may be in a state formed to pay a cost according to a call between the digital auxiliary device 100 and the called terminal 500. When the call between 100 and the called terminal 500 ends, the call is terminated with another call, and the cost settlement according to the call between the corresponding digital auxiliary device 100 and the called terminal 500 is performed by the communication company server 400. Can be performed.

In addition, while the call state between the digital auxiliary device 100 and the called terminal 500 is maintained or the call state between the digital auxiliary device 100 and the called terminal 500 is terminated, the calling terminal 300 In order to check call information (or text information obtained by converting voice information / voice information into text form) between the digital auxiliary device 100 and the called terminal 500, the control unit 350 is connected to the digital auxiliary device 100. The call information request signal for requesting call information between the destination terminals 500 is transmitted to the service server 200 through the communication unit 310. In this case, the call information request signal may include information for requesting transmission of some or all (or all) of the recorded voice information to the service server 200, information on the processing form of the voice information, identification information of the calling terminal 300, and the like. It includes. Here, the information on the processing form of the voice information includes the original voice information request stored in the service server 200, the information request to convert the original voice information into text form, the voice information request divided by user, the voice information separated by user It includes information about the request for information converted into text form.

In addition, the controller 350 may include call information (or voice or text call information) between the digital assistant 100 and the called terminal 500 transmitted from the service server 200 in response to the previously transmitted call information request signal. ) Is received through the communication unit 310. Here, the call information may be all voice information recorded in the service server 200 according to the preceding call information request signal, or information corresponding to some voice information among the recorded voice information.

That is, the controller 350 may include voice call information, text call information, and the like, between the digital auxiliary device 100 and the called terminal 500 transmitted from the service server 200 in response to the previously transmitted call information request signal. The communication information 310 receives the call information of any one type of call information divided by each user and call information separated by each user through the communication unit 310.

In addition, the controller 350 outputs the received call information between the digital auxiliary apparatus 100 and the called terminal 500 through the display unit 330 and / or the voice output unit 340.

The communication company server 400 communicates with the service server 200, the calling terminal 300, the called terminal 500, and the like.

In addition, the communication company server 400 may include a configuration of the communication unit 310, the storage unit 320, the display unit 330, the voice output unit 340, and the control unit 350 included in the calling terminal 300. have.

In addition, the communication company server 400 stores (or manages) caller information related to the calling terminal 300 which is registered as a member of the corresponding communication company server 400.

In addition, the communication company server 400 receives a call origination request signal transmitted from the originating terminal 300.

That is, the communication company server 400 transmits a call origination request signal including a special number transmitted from the calling terminal 300, identification information of the calling terminal 300 (or a phone number of the calling terminal 300), a voice command, and the like. Receive.

In addition, the communication company server 400 checks the special number and the caller information based on the received call origination request signal.

That is, the communication company server 400 checks the caller information corresponding to the identification information of the calling terminal 300 previously received among the caller information corresponding to the identification information of the calling terminal stored in advance. Here, the sender information (or sender information) includes a name (or nickname / nickname), a telephone number, an email address, social network account information, and the like.

In addition, the communication company server 400 is a call processing request signal including a special number, a voice command, confirmed caller information, etc., in order to confirm the telephone number of the called terminal 500 for call connection with the calling terminal 300. To the service server 200.

In addition, when the called party information is not confirmed in the service server 200 in response to the call processing request signal previously transmitted, the communication company server 400 may indicate that the called party information transmitted from the service server 200 is not confirmed. Receive

In addition, the service server 200 outputs information indicating that the received called party information is not confirmed, and provides the calling terminal 300 with information indicating that the received called party information is not confirmed.

In addition, the communication company server 400 based on the incoming call connection (or incoming call connection request) with the called terminal 500 requested from the service server 200 in response to the call processing request signal transmitted previously (the called terminal ( 500 to perform a call connection function between the service server 200. As such, when the call connection between the destination terminal 500 and the service server 200 is normally performed by the communication company server 400, the destination terminal 500, the communication company server 400, and the service server 200 are digitally assisted. The call path between the devices 100 may be normally connected.

Here, when the communication company server 400 performs a call connection function between the called terminal 500 and the service server 200 on the basis of the incoming call connection with the called terminal 500 requested from the service server 200, The telecommunication company server 400 (or the service server 200) receives the caller information (including a phone number of the caller terminal 300, etc.) related to the caller terminal 300 based on the caller information identified above. 500, the destination terminal 500 may check the caller information before the call connection.

In addition, while the digital auxiliary device 100 and the called terminal 500 are connected through the service server 200 and the communication company server 400, the service server 200 (or the communication company server 400) is parallel. As such, the calling terminal 300 and the called terminal 500 may be configured to maintain a connection state through the communication server server 400. Here, the caller terminal 300 is not connected to the caller terminal 500 by using the telephone number associated with the caller terminal 500, the caller terminal by using a special number preset in the caller terminal 300 It may stay connected to the call 500.

In this case, as shown in FIG. 3, when the calling terminal 300 and the called terminal 500 are subscribed to different communication companies, a plurality of different communication companies are connected between the calling terminal 300 and the called terminal 500. Each of the servers 400 is configured, and the originating terminal 300 and the plurality of different communication company servers 400 and the destination terminal 500 are interlocked (or interconnected with each other) by a plurality of different communication company servers 400. May be maintained.

In addition, when the call connection between the digital auxiliary device 100 and the called terminal 500 is terminated, the communication company server 400 is connected to the digital auxiliary device 100 and the service server 200 and the communication company server 400 in parallel. And the connection between the communication path between the called terminal 500 and the communication terminal between the calling terminal 300 and the communication company server 400 and the called terminal 500, respectively.

That is, when the call connection between the digital auxiliary device 100 and the called terminal 500 is terminated, the communication company server 400 may include the digital auxiliary device 100, the service server 200, the communication company server 400, and the called terminal ( End the call connection between 500, and terminates the call connection between the calling terminal 300, the communication company server 400 and the called terminal 500 after the call connection ends.

In addition, after the entire call connection type, the communication company server 400 charges the call charges related to the call connection to the calling terminal 300 and / or the called terminal 500.

The called terminal 500 communicates with the digital auxiliary device 100, the service server 200, the calling terminal 300, and the communication company server 400.

In addition, the called terminal 500 may include a configuration of the communication unit 310, the storage unit 320, the display unit 330, the voice output unit 340 and the control unit 350 included in the calling terminal 300. have.

In addition, the receiving terminal 500 forms a communication path with the digital auxiliary device 100 by interworking with the service server 200 by intermediation of the communication company server 400, and in parallel with the corresponding communication path, the calling terminal 300. And other communication paths.

At this time, before forming the communication path with the digital auxiliary device 100 by the mediation of the communication company server 400, the destination terminal 500 is the corresponding digital auxiliary transmitted from the communication company server 400 (or service server 200). By outputting caller information about the calling terminal 300 associated with the device 100, the called party of the called terminal 500 may be configured to check the caller information requested to call.

In addition, the called terminal 500 performs an actual voice call function with the digital auxiliary device 100 and performs other corresponding communication in the background state with the calling terminal 300 while the call function with the digital auxiliary device 100 is maintained. You can keep the furnace.

In addition, when the call between the called terminal 500 and the digital auxiliary device 100 ends, the called terminal 500 terminates the call with the calling terminal 300 under the control of the communication company server 400.

In the embodiment of the present invention, when the call between the digital auxiliary device 100 and the called terminal 500, a voice call is described by way of example, but is not limited thereto. In addition to the voice call, the digital auxiliary device 100 When the display unit (not shown) is provided, a video call (or video call) may be performed between the digital assistant 100 and the called terminal 500.

In addition to a voice call and / or a video call, an e-mail sending function between the digital auxiliary device 100 and an e-mail server (not shown), and the corresponding calling terminal 300 between the digital auxiliary device 100 and a social network server (not shown) are provided. You can also perform post / comment registration functions on social network accounts related to this.

In an exemplary embodiment of the present invention, the call information stored in the service server 200 is provided to the calling terminal 300. However, the present invention is not limited thereto. In addition to the calling terminal 300, digital information related to the actual recorded call information may be used. When the auxiliary device 100 and / or the called terminal 500 requests the transmission of the recorded call information to the service server 200, the service server 200 may transmit the digital auxiliary device 100 and / or the called terminal ( It is determined whether the 500 is a terminal associated with the actual recorded call information, and as a result of the determination, when the digital auxiliary device 100 and / or the called terminal 500 is a terminal associated with the actually recorded call information, the corresponding service server 200 Call information recorded in the call) may be provided to the corresponding digital auxiliary device 100 and / or the called terminal 500.

Also, the calling terminal 300 and / or the called terminal 500 may include an interface unit (not shown) which serves as an interface with all external devices connected to the calling terminal 300 and / or the called terminal 500. It may further include. For example, the interface unit may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio I / O ( Input / Output) port, video I / O (Input / Output) port, earphone port, and the like. Here, the identification module is a chip that stores various information for authenticating the use authority of the originating terminal 300, and includes a user identity module (UIM), a subscriber identity module (SIM), and universal user authentication. And a module (Universal Subscriber Identity Module (USIM)). In addition, the device equipped with the identification module may be manufactured in the form of a smart card. Therefore, the identification module may be connected to the calling terminal 300 and / or the called terminal 500 through the port. Such an interface unit receives data from an external device or receives power and transmits the data to each component inside the calling terminal 300 and / or the called terminal 500 or inside the calling terminal 300 and / or the called terminal 500. Data is transmitted to an external device.

In addition, when the source terminal 300 and / or the destination terminal 500 is connected to an external cradle, the interface unit has a passage through which power from the cradle is supplied to the corresponding source terminal 300 and / or the destination terminal 500. Alternatively, the various command signals input from the cradle by the user may be a passage for transmitting to the corresponding calling terminal 300 and / or the called terminal 500. Various command signals or corresponding power input from the cradle may be operated as signals for recognizing that the calling terminal 300 and / or the called terminal 500 are correctly mounted in the cradle.

In addition, the calling terminal 300 and / or the called terminal 500 may be a command generated by an operation such as receiving a signal according to a button operation or a function selection by a user, or touching / scrolling a displayed screen, or It may further include an input unit (not shown) for receiving a control signal.

The input unit is a means for receiving at least one of a user's command, selection, data, and information, and may include a plurality of input keys and function keys for receiving numeric or text information and setting various functions.

In addition, the input unit includes a key pad, a dome switch, a touch pad (static pressure / capacitance), a touch screen, a jog wheel, a jog switch, a jog shuttle, and a mouse. Various devices such as a stylus pen, a touch pen, and the like may be used. In particular, when the display unit 330 is formed in the form of a touch screen, some or all of the input functions may be performed through the display unit 330.

In addition, each component (or module) of the calling terminal 300 may be software stored in the memory (or storage) of the calling terminal 300 and / or the called terminal 500. The memory may be an internal memory of the calling terminal 300 and / or the called terminal 500 and may be an external memory or another type of storage device. The memory may also be a nonvolatile memory. Software stored on the memory may include a set of instructions that, when executed, cause the originating terminal 300 and / or the terminating terminal 500 to perform a particular operation.

In addition, the service server 200 and the communication company server 400 may be implemented in the form of a web server, a database server, a proxy server. In addition, the service server 200 and the carrier server 400 may be equipped with a network load balancing mechanism, or one or more of various software for allowing the service server 200 and the carrier server 400 to operate on the Internet or another network. It may be implemented as a computerized system through this. The network may also be an http network, and may be a private line, an intranet, or any other network. Further, the connection between the service server 200 and the communication server server 400 and the originating terminal 300 and / or the terminating terminal 500 is connected to a secure network so that data is not attacked by any hacker or another third party. Can be connected. In addition, the service server 200 and the carrier server 400 may include a plurality of database servers, which may be connected to the service server 200 and the carrier server through any type of network connection, including a distributed database server architecture. It may be implemented in a manner that is connected separately from the (400).

In addition, the processor mounted in the digital auxiliary device 100, the service server 200, the originating terminal 300, the telecommunications company server 400 and the destination terminal 500 according to the present invention for executing the method according to the present invention; Program instructions can be processed. In one implementation, this processor may be a single-threaded processor, and in other implementations, the processor may be a multi-threaded processor. Furthermore, the processor is capable of processing instructions stored in memory or storage devices.

As such, when the call is connected between the digital auxiliary device and the called terminal by the overall control of the service server, the calling terminal is utilized, but the actual call does not go through the calling terminal. You can make a call.

In this way, when the call is connected between the digital auxiliary device and the called terminal by the overall control of the service server, the call connection between the calling terminal and the called terminal is maintained in parallel, and the call of the calling terminal is performed by the service server and / or the communication company server. The call notification can be provided to the called terminal using the number as the calling number.

In this way, the service server may store the contents of the call between the digital auxiliary device and the called terminal and provide at least some or all of the stored contents of the call between the digital auxiliary device and the called terminal to the calling terminal.

Hereinafter, a voice call service method using a digital auxiliary device according to the present invention will be described in detail with reference to FIGS. 1 to 7.

4 to 5 are flowcharts illustrating a voice call service method using a digital auxiliary device according to a first embodiment of the present invention.

First, when the voice command (or voice) of the caller received from the digital auxiliary device 100 is a voice command for call connection for a call with the called terminal 500, the digital auxiliary device 100 may correspond to the corresponding voice command, The identification information, the call origination request signal, etc. of the digital assistant 100 is transmitted to the service server 200. Here, the identification information of the digital auxiliary device 100 includes a mobile IP, a mobile MAC, a serial number, and the like.

That is, the digital assistant 100 receives a voice through the caller (or the user) and performs a voice recognition function for the received voice. At this time, the digital assistant 100 checks whether the received voice is a voice of a pre-registered user (or user authentication), and if the received voice corresponds to a voice of a pre-registered user, The voice recognition function may be performed.

In addition, the digital assistant 100 determines whether a voice command for call connection is included in the result of performing the voice recognition function.

As a result of the determination, when a voice command for call connection is included in the result of performing the voice recognition function, the digital auxiliary device 100 receives the voice command, identification information of the digital auxiliary device 100, a call origination request signal, and the like. It transmits to the service server 200.

At this time, when the determination result, the voice recognition function execution result includes a voice command for performing another control function related to the digital auxiliary device 100, the digital auxiliary device 100 is a digital corresponding to the voice command Other control functions related to the auxiliary device 100 are performed.

For example, the first digital assistant 100 receives a first voice (eg, “NUGU, call my husband”) through the caller, and performs a voice recognition function on the received first voice. .

In addition, the first digital auxiliary apparatus determines whether a voice command for call connection is included in the result of performing the voice recognition function, and as a result of the determination, the first destination terminal 500 owned by the husband in the result of performing the voice recognition function is determined. The first voice command, the identification information of the first digital auxiliary device, the first voice command when it is determined that the first voice command (for example, " Call My Husband ") is included. The call origination request signal 1 is transmitted to the service server 200 (S410).

Thereafter, the service server 200 receives a voice command transmitted from the digital auxiliary device 100, identification information of the digital auxiliary device 100, a call origination request signal, and the like.

In addition, the service server 200 confirms identification information of the calling terminal 300 corresponding to the identification information of the digital auxiliary device 100 previously received among identification information of the calling terminal for each identification information of the plurality of digital auxiliary devices stored in advance. do. Here, the identification information of the calling terminal 300 includes MDN, mobile IP, mobile MAC, Sim (subscriber identification module) card unique information, serial number and the like.

In addition, the service server 200 requests a call origination to the calling terminal 300 corresponding to the identification information of the confirmed calling terminal 300.

At this time, when the service server 200 requests the call origination terminal 300, after the service server 200 calls a dedicated app pre-installed on the calling terminal 300, the service server 200 is calling terminal The call may be requested to the calling terminal 300 while the corresponding dedicated app is running at 300.

For example, the service server 200 may include a first voice command (for example, "call my husband") transmitted from the first digital auxiliary device, identification information of the first digital auxiliary device, a first call request signal, and the like. Receive

In addition, the service server 200 confirms identification information of the first calling terminal corresponding to the identification information of the first digital auxiliary apparatus previously received among identification information of the calling terminal for each identification information of the plurality of digital auxiliary apparatuses stored in advance.

In addition, the service server 200 calls a dedicated app pre-installed on the first calling terminal in association with the first calling terminal corresponding to the identification information of the first calling terminal, and executes the dedicated app on the first calling terminal. The first call request is made to the first calling terminal in the busy state (S420).

Thereafter, the originating terminal 300 receives a call origination request transmitted from the service server 200, and responds to a call origination request of the service server 200 through a dedicated app running in the corresponding originating terminal 300. In response to the calling terminal 300, a call request is made to the telecommunication company server 400 (or a call originating request signal) by using a special number (or special number) set in advance.

That is, in response to the call origination request from the service server 200, the originating terminal 300 uses a special number preset in correspondence with the corresponding originating terminal 300, and identification information of the originating terminal 300 (or The call origination request signal including the call number of the calling terminal 300) is transmitted to the communication company server 400. Here, the special number may be a unique number set in advance in order to attempt a call connection using the corresponding calling terminal 300.

For example, in response to a first call origination request transmitted from the service server 200, the first caller terminal may be configured with a first special number (eg, "010-9999") set in advance in order to attempt a call connection with the first caller terminal. -8888 "), and transmits the first call origination request signal including the telephone number (eg," 010-1234-5678 ") of the first originating terminal to the communication company server 400 (S430).

Thereafter, the communication company server 400 receives the call origination request signal transmitted from the originating terminal 300 and checks the special number and the caller information based on the received call origination request signal.

That is, the communication company server 400 receives a call origination request signal including a special number transmitted from the calling terminal 300 and identification information of the calling terminal 300.

In addition, the communication company server 400 checks the caller information corresponding to the identification information of the caller terminal 300 previously received from the caller information corresponding to the identification information of the caller terminal previously stored. Here, the sender information includes a name (or nickname / nickname), a telephone number, an email address, social network account information, and the like.

In addition, the communication company server 400, the service server to the call processing request signal including a special number, confirmed caller information, etc. in order to confirm the telephone number of the destination terminal 500 for the call connection with the calling terminal 300 Transmit to 200.

For example, the communication company server 400 may include a first special number (for example, "010-9999-8888") transmitted from the first calling terminal, and a phone number of the first calling terminal (for example, "010-1234-5678". Receiving a first call origination request signal, including the "), and among the caller information corresponding to the identification information of the calling terminal previously stored, the first caller information corresponding to the identification information of the first calling terminal (e.g. 1 Check the telephone number (010-1234-5678, etc.) corresponding to the calling terminal.

In addition, the communication company server 400 transmits a first call processing request signal including a first special number (eg, "010-9999-8888"), confirmed first caller information, and the like to the service server 200. (S440).

Thereafter, the service server 200 receives a call processing request signal including a special number and caller information transmitted from the communication company server 400.

In addition, the service server 200 checks the digital auxiliary device 100 related to the special number and / or caller information based on the special number and caller information included in the received call processing request signal.

That is, the service server 200 confirms that the call processing request signal is a signal in response to the call origination request previously transmitted to the originating terminal 300, and digitally assists with the call origination request transmitted to the originating terminal 300. Check the device 100.

In addition, the service server 200 confirms the called party information based on the confirmed voice command received from the digital auxiliary device 100. Here, the called party information includes a name (or nickname / nickname), a telephone number, an email address, social network account information, and the like.

That is, the service server 200 may include a name / listed in a voice command previously received from among a plurality of phone numbers (eg, name / nickname / nickname, phone number, etc.) registered in advance with respect to the corresponding calling terminal 300. Check the called party information, the telephone number corresponding to the nickname / nickname.

In addition, the service server 200 performs a call connection (or call connection) function between the service server 200 and the digital auxiliary device 100 to perform a call connection function through the corresponding service server 200.

For example, the service server 200 receives a first call processing request signal including a first special number (for example, "010-9999-8888"), a first caller information, and the like transmitted from the communication company server 400. do.

In addition, the service server 200 identifies the first digital auxiliary device related to the first calling terminal based on the first special number, the first calling party information, etc. included in the received first call processing request signal.

In addition, the service server 200 may include a first voice command (for example, "Call a husband") received from the first digital auxiliary apparatus identified above among a plurality of phone numbers registered in advance with respect to the first calling terminal. The first called party information corresponding to "husband" included in (for example, including a husband and a telephone number (010-9876-5432) corresponding to the first called terminal associated with the husband) is checked.

In addition, the service server 200 performs a call connection function with the identified first digital auxiliary device (S450).

Subsequently, the service server 200 connects the incoming call (or the incoming call) with the called terminal 500 corresponding to the called party information based on the called party information previously identified in response to the call processing request signal of the preceding communication company server 400. Connection signal) to the carrier server 400 (or transmitted).

As an example, the service server 200 requests the communication company server 400 for an incoming call connection with the first called terminal corresponding to the confirmed first called party information (S460).

Thereafter, the communication company server 400 based on the incoming call connection (or the incoming call connection request) with the called terminal 500 requested from the service server 200 in response to the call processing request signal transmitted previously (the called terminal ( 500 to perform a call connection function between the service server 200. As such, when the call connection between the destination terminal 500 and the service server 200 is normally performed by the communication company server 400, the destination terminal 500, the communication company server 400, and the service server 200 are digitally assisted. The call path between the devices 100 may be normally connected.

Here, when the communication company server 400 performs a call connection function between the called terminal 500 and the service server 200 on the basis of the incoming call connection with the called terminal 500 requested from the service server 200, The telecommunication company server 400 (or the service server 200) receives the caller information (including a phone number of the caller terminal 300, etc.) related to the caller terminal 300 based on the caller information identified above. 500, the destination terminal 500 may check the caller information before the call connection.

In addition, while the digital auxiliary device 100 and the called terminal 500 are connected through the service server 200 and the communication company server 400, the service server 200 (or the communication company server 400) is parallel. As such, the calling terminal 300 and the called terminal 500 may be configured to maintain a connection state through the communication server server 400. Here, the caller terminal 300 is not connected to the caller terminal 500 by using the telephone number associated with the caller terminal 500, the caller terminal by using a special number preset in the caller terminal 300 It may stay connected to the call 500.

In this case, when the calling terminal 300 and the called terminal 500 are joined to different communication companies, a plurality of different communication company servers 400 are respectively configured between the calling terminal 300 and the called terminal 500. By the mutual interworking (or mutual communication connection) of a plurality of different communication company servers 400, a call connection between the calling terminal 300 and the plurality of different communication company servers 400 and the called terminal 500 may be maintained. It may be.

For example, the communication company server 400 may transmit a corresponding first destination terminal and a service server based on an incoming call connection with the first destination terminal requested from the service server 200 in response to the first call processing request signal transmitted previously. 200) performs a call connection function. Accordingly, a first call path between the first digital auxiliary device, the service server 200, the communication company server 400, and the first destination terminal may be formed (or configured).

In addition, the telecommunication company server 400 may execute the first calling terminal and the first in parallel immediately after the first call path between the first digital auxiliary apparatus, the service server 200, the telecommunication company server 400, and the first called terminal is formed. A second call path between the called terminals is formed (S470).

Thereafter, the service server 200 transmits / receives voice information (or a call) between the digital auxiliary device 100 and the called terminal 500 while the call connection is maintained between the digital auxiliary device 100 and the called terminal 500. History / call information) is matched with date information (e.g., date and time information) and stored.

That is, the service server 200 may transmit voice information transmitted / received between the digital auxiliary device 100 and the called terminal 500 while the call connection is maintained between the digital auxiliary device 100 and the called terminal 500. Perform call recording function by matching with.

In addition, the service server 200 may convert and store voice information recorded (or stored) in real time into information (or recording) in the form of text.

In addition, the service server 200 may perform a voice recognition function on the recorded voice information, and may separate and store voice information for each user (for example, by caller, called party, and the like).

In addition, the service server 200 may convert and store voice information separately stored for each user into information in a text form for each user.

For example, the service server 200 records voice information according to a call between the first digital auxiliary device and the first called terminal in real time while the call connection between the first digital auxiliary device and the first called terminal is maintained.

In addition, the service server 200 may transmit voice information recorded in real time through a voice recognition function to at least one or more users input through the first digital auxiliary device, and at least another input input through the first called terminal. Separate and store voice information about one or more users. In this case, the service server 200 may convert and store the voice information for each user separately stored for each corresponding terminal (for example, including the first digital auxiliary device and the first destination terminal) into information in a text form for each user (S480). ).

Then, when the call connection between the digital auxiliary device 100 and the called terminal 500 is terminated, the communication company server 400 is connected to the digital auxiliary device 100 and the service server 200 and the communication company server 400 in parallel. Terminates (or releases) the connection (or call connection) between the communication path between the communication terminal and the called terminal 500 and the calling terminal 300, the communication company server 400, and the called terminal 500, respectively.

That is, when the call connection between the digital auxiliary device 100 and the called terminal 500 is terminated, the communication company server 400 may include the digital auxiliary device 100, the service server 200, the communication company server 400, and the called terminal ( End the call connection between 500, and terminates the call connection between the calling terminal 300, the communication company server 400 and the called terminal 500 after the call connection ends.

In addition, after the entire call connection type, the communication company server 400 charges the call charges related to the call connection to the calling terminal 300 and / or the called terminal 500.

For example, when the call connection between the first digital auxiliary device and the first called terminal is terminated, the communication company server 400 terminates the call connection through the first call path between the first digital auxiliary device and the first called terminal, The telephone call is terminated in the second call path between the first calling terminal and the first called terminal (S490).

Subsequently, in a state in which a call state between the digital auxiliary apparatus 100 and the called terminal 500 is maintained or in a state where a call state between the digital auxiliary apparatus 100 and the called terminal 500 is terminated, the calling terminal 300 In the case where it is desired to check call information (or text information obtained by converting voice information / voice information into a text form) between the digital auxiliary device 100 and the called terminal 500, the calling terminal 300 is the digital auxiliary device 100. And a call information request signal for requesting call information between the called terminal 500 and the service server 200. In this case, the call information request signal may include information for requesting transmission of some or all (or all) of the recorded voice information to the service server 200, information on the processing form of the voice information, identification information of the calling terminal 300, and the like. It includes. Here, the information on the processing form of the voice information includes the original voice information request stored in the service server 200, the information request to convert the original voice information into text form, the voice information request divided by user, the voice information separated by user It includes information about the request for information converted into text form.

That is, the service server 200 may be any one of voice call information, text call information, voice call information divided by user, and text call information separated by user based on the call information request signal. The call information of the form is transmitted to the calling terminal 300.

For example, in a state where a call state between the first digital auxiliary device and the first called terminal is maintained, the first calling terminal receives original voice information for three minutes immediately after the call connection between the first digital auxiliary device and the first called terminal. The requesting first call information request signal is transmitted to the service server 200.

As another example, in a state in which a call state between the first digital auxiliary device and the first called terminal is terminated, the first calling terminal is divided into voice information for each user about the entire call content between the first digital auxiliary device and the first called terminal. The second call information request signal for requesting the information converted into the text form is transmitted to the service server 200 (S500).

Thereafter, the service server 200 receives a call information request signal transmitted from the calling terminal 300.

In addition, the service server 200 may be configured to obtain voice information related to the calling terminal 300 (or voice information between the digital assistant 100 and the called terminal 500 related to the calling terminal 300) from among the stored voice information. The caller terminal 300 transmits the call information in the form of voice or text by processing (or converting / converting) the confirmed voice information based on the information on the processing form of the voice information included in the corresponding call information request signal. To transmit. In this case, when there is a plurality of voice information associated with the corresponding calling terminal 300, the service server 200 may check (or select) one or more voice information satisfying a preset condition. Here, the preset condition may include a state which is the latest in chronological order.

That is, the service server 200 may be any one of voice call information, text call information, voice call information divided by user, and text call information separated by user based on the call information request signal. The call information of the form is transmitted to the calling terminal 300.

For example, the service server 200 receives the first call information request signal transmitted from the first calling terminal, and among the plurality of voice information stored in the service server 200, the first digital auxiliary device related to the first calling terminal; Confirm the first voice information between the first called terminals and immediately after the call connection among the first voice information previously identified based on the original voice information for 3 minutes from immediately after the call connection included in the previously received first call information request signal; First 1-1 voice information corresponding to the original voice information for 3 minutes from the user, and extracts the extracted 1-1 voice information to the first calling terminal.

As another example, the service server 200 receives the second call information request signal transmitted from the first calling terminal, and among the plurality of voice information stored in the service server 200, the first digital auxiliary device related to the first calling terminal. And the second voice information between the first and the first called terminal, and previously identified based on the information obtained by converting voice information, which is separated for each user, into text form with respect to the entire call content included in the second call information request signal received earlier. After dividing the entire second voice information for each user, a second recording (or text-by-user recording) in which the voice information separated for each user is converted into a text form is transmitted to the first calling terminal (S510).

Thereafter, the calling terminal 300 calls information (or voice or text call) between the digital auxiliary device 100 and the called terminal 500 transmitted from the service server 200 in response to the previously transmitted call information request signal. Information). Here, the call information may be all voice information recorded in the service server 200 according to the preceding call information request signal, or information corresponding to some voice information among the recorded voice information.

That is, the calling terminal 300 is voice information between the digital auxiliary device 100 transmitted from the service server 200 and the called terminal 500 in response to the previously transmitted call information request signal, and call information in text form. For example, the receiver may receive the call information of any one type of call information separated by each user and call information separated by each user.

In addition, the calling terminal 300 outputs call information between the received digital auxiliary device 100 and the called terminal 500.

For example, the first calling terminal transmits original voice information for three minutes immediately after a call connection between the first digital auxiliary apparatus and the first called terminal transmitted from the service server 200 in response to the previously transmitted first call information request signal. Receives 1-1 voice information corresponding to and outputs the received 1-1 voice information.

As another example, the first calling terminal may separate voice for each user regarding the entire call content between the first digital auxiliary device and the first called terminal transmitted from the service server 200 in response to the previously transmitted second call information request signal. A second recording (or text recording for each user) in which the information is converted into a text form is received, and a second recording for each user in the text form is output (S520).

As such, although the actual call is performed between the digital auxiliary device 100 and the called terminal 500, as the calling terminal 300 associated with the digital auxiliary device 100 maintains a communication state with the called terminal 500, The telecommunication company server 400 may provide a charging function according to a call between the corresponding digital auxiliary device 100 and the called terminal 500 (or a call charge payment function according to a call between the digital auxiliary device 100 and the called terminal 500). This may be performed through the calling terminal 300.

6 to 7 are flowcharts illustrating a voice call service method using a digital auxiliary device according to a second embodiment of the present invention.

First, when the voice command (or voice) of the caller received from the digital auxiliary device 100 is a voice command for call connection for a call with the called terminal 500, the digital auxiliary device 100 may correspond to the corresponding voice command, Identification information of the digital auxiliary device 100, a call origination request signal, and the like are transmitted to the calling terminal 300 registered in advance in the digital auxiliary device 100 in association with the corresponding digital auxiliary device 100. Here, the identification information of the digital auxiliary device 100 includes a mobile IP, a mobile MAC, a serial number, and the like.

That is, the digital assistant 100 receives a voice through the caller (or the user) and performs a voice recognition function for the received voice. At this time, the digital assistant 100 checks whether the received voice is a voice of a pre-registered user (or user authentication), and if the received voice corresponds to a voice of a pre-registered user, The voice recognition function may be performed.

In addition, the digital assistant 100 determines whether a voice command for call connection is included in the result of performing the voice recognition function.

As a result of determination, when a voice command for call connection is included in the result of performing the speech recognition function, the digital auxiliary device 100 receives identification information of the calling terminal 300 registered in advance in the digital auxiliary device 100. A call is requested to the calling terminal 300 corresponding to the identification information of the checked calling terminal 300. Here, the identification information of the calling terminal 300 includes MDN, mobile IP, mobile MAC, Sim (subscriber identification module) card unique information, serial number and the like.

In this case, when the digital auxiliary device 100 requests a call origination from the calling terminal 300, the digital auxiliary device 100 calls a dedicated app pre-installed in the calling terminal 300, and then the digital auxiliary device 100. In the state in which the corresponding dedicated app is running on the calling terminal 300, the calling terminal 300 may request a call.

In addition, when the determination result indicates that the voice command for performing another control function related to the digital auxiliary device 100 is included in the result of performing the corresponding voice recognition function, the digital auxiliary device 100 corresponds to a digital command corresponding to the voice command. Other control functions related to the auxiliary device 100 are performed.

For example, the first digital auxiliary device 100 receives a first voice (eg, “NUGU, call my son”) through the caller and performs a voice recognition function on the received first voice. .

In addition, the first digital auxiliary device determines whether a voice command for call connection is included in the result of performing the voice recognition function, and as a result of the determination, the first called terminal 500 owned by the son in the result of performing the voice recognition function is determined. When it is determined that the first voice command (for example, "call the son") for the call connection for the call with the call), the first calling terminal 300 registered in advance in the first digital auxiliary device (300) Check the identification information of).

In addition, the first digital auxiliary device calls a dedicated app pre-installed on the first calling terminal in cooperation with the first calling terminal corresponding to the identified identification information of the first calling terminal, and runs the dedicated app on the first calling terminal. The first voice command, the identification information of the first digital auxiliary device, the first call request signal, etc. are transmitted to the corresponding first call terminal in the busy state (S610).

Thereafter, the calling terminal 300 receives a voice command transmitted from the digital auxiliary device 100, identification information of the digital auxiliary device 100, a call origination request signal, and the like.

In addition, the calling terminal 300 in response to the call originating request signal of the digital auxiliary device 100 received a special number preset in response to the calling terminal 300 through the dedicated app running in the calling terminal 300 (Or a special number) is used to request a call origination (or transmit a call origination request signal) to the communication company server 400.

That is, in response to the call origination request signal of the digital auxiliary device 100, the originating terminal 300 uses a special number preset in correspondence with the corresponding originating terminal 300, and identification information of the originating terminal 300. (Or a telephone number of the calling terminal 300), a call origination request signal including a voice command and the like is transmitted to the communication company server 400. Here, the special number may be a unique number set in advance in order to attempt a call connection using the corresponding calling terminal 300.

For example, the first originating terminal receives a first voice command transmitted from the first digital auxiliary device, identification information of the first digital auxiliary device, a first call request signal, and the like, and is configured in advance to attempt to connect the call. 1 special number (e.g. "010-9999-8888"), the telephone number of the first calling terminal (e.g. "010-1234-5678"), the first voice command (e.g. "Call your son" The first call origination request signal including ") is transmitted to the communication company server 400 (S620).

Thereafter, the communication company server 400 receives the call origination request signal transmitted from the originating terminal 300 and checks the special number and the caller information based on the received call origination request signal.

That is, the communication company server 400 receives a call origination request signal including a special number transmitted from the originating terminal 300, identification information of the originating terminal 300, and a voice command.

In addition, the communication company server 400 checks the caller information corresponding to the identification information of the caller terminal 300 previously received from the caller information corresponding to the identification information of the caller terminal previously stored. Here, the sender information includes a name (or nickname / nickname), a telephone number, an email address, social network account information, and the like.

In addition, the communication company server 400 is a call processing request signal including a special number, a voice command, confirmed caller information, etc., in order to confirm the telephone number of the called terminal 500 for call connection with the calling terminal 300. To the service server 200.

For example, the carrier server 400 may include a first special number (for example, "010-9999-8888") transmitted from the first calling terminal, a first voice command (for example, "call the son"), Receiving a first call origination request signal including a telephone number of the first originating terminal (for example, "010-1234-5678") and the like, and among the caller information corresponding to the identification information of the previously stored originating terminal, the first originating terminal. First caller information (eg, Hong-gil-dong, telephone number corresponding to the first caller terminal (010-1234-5678), etc.) corresponding to the identification information of the terminal is checked.

In addition, the carrier server 400 may send the first special number (for example, "010-9999-8888"), the first voice command (for example, "Call a son"), the confirmed first caller information, and the like. The first call processing request signal is transmitted to the service server 200 (S630).

Thereafter, the service server 200 receives a call processing request signal including a special number, a voice command, caller information, and the like transmitted from the communication company server 400.

In addition, the service server 200 checks the digital auxiliary device 100 related to the special number and / or caller information based on the special number and caller information included in the received call processing request signal.

That is, the service server 200 of the digital auxiliary device 100 corresponding to the caller information (or special number) previously received among the identification information of the digital auxiliary device for each caller information (or for each special number) stored in advance. Check the identification information.

In addition, the service server 200 confirms the called party information based on the voice command included in the call processing request signal. Here, the called party information includes a name (or nickname / nickname), a telephone number, an email address, social network account information, and the like.

That is, the service server 200 is included in the call processing request signal previously received among a plurality of phone numbers (eg, name / nickname / nickname, phone number, etc.) registered in advance with respect to the corresponding calling terminal 300. Check the called party information, the telephone number corresponding to the name / nickname / nickname included in the voice command.

In addition, the service server 200 performs a call connection (or call connection) function between the service server 200 and the digital auxiliary device 100 to perform a call connection function through the corresponding service server 200.

For example, the service server 200 may include a first special number (for example, "010-9999-8888") and a first voice command (for example, "call the son") transmitted from the carrier server 400. Receive a first call processing request signal including a first caller information, and the like.

In addition, the service server 200 identifies the first digital auxiliary device related to the first calling terminal based on the first special number, the first calling party information, etc. included in the received first call processing request signal.

In addition, the service server 200 may include a first voice command (for example, "call the son") included in the first call processing request signal previously received among a plurality of phone numbers registered in advance with respect to the first calling terminal. The first called party information corresponding to " son " (including, for example, son, telephone number (010-7777-1234), etc. corresponding to the first called terminal associated with the son).

In addition, the service server 200 performs a call connection function with the identified first digital auxiliary device (S640).

Subsequently, the service server 200 connects the incoming call (or the incoming call) with the called terminal 500 corresponding to the called party information based on the called party information previously identified in response to the call processing request signal of the preceding communication company server 400. Connection signal) to the carrier server 400 (or transmitted).

As an example, the service server 200 requests the communication company server 400 for an incoming call connection with the first called terminal corresponding to the confirmed first called party information (S650).

Thereafter, the communication company server 400 based on the incoming call connection (or the incoming call connection request) with the called terminal 500 requested from the service server 200 in response to the call processing request signal transmitted previously (the called terminal ( 500 to perform a call connection function between the service server 200. As such, when the call connection between the destination terminal 500 and the service server 200 is normally performed by the communication company server 400, the destination terminal 500, the communication company server 400, and the service server 200 are digitally assisted. The call path between the devices 100 may be normally connected.

Here, when the communication company server 400 performs a call connection function between the called terminal 500 and the service server 200 on the basis of the incoming call connection with the called terminal 500 requested from the service server 200, The telecommunication company server 400 (or the service server 200) receives the caller information (including a phone number of the caller terminal 300, etc.) related to the caller terminal 300 based on the caller information identified above. 500, the destination terminal 500 may check the caller information before the call connection.

In addition, while the digital auxiliary device 100 and the called terminal 500 are connected through the service server 200 and the communication company server 400, the communication company server 400 receives the call with the calling terminal 300 in parallel. The terminal 500 may be configured to maintain a connection state through the communication company server 400. Here, the caller terminal 300 is not connected to the caller terminal 500 by using the telephone number associated with the caller terminal 500, the caller terminal by using a special number preset in the caller terminal 300 It may stay connected to the call 500.

In this case, when the calling terminal 300 and the called terminal 500 are joined to different communication companies, a plurality of different communication company servers 400 are respectively configured between the calling terminal 300 and the called terminal 500. By the mutual interworking (or mutual communication connection) of a plurality of different communication company servers 400, a call connection between the calling terminal 300 and the plurality of different communication company servers 400 and the called terminal 500 may be maintained. It may be.

For example, the communication company server 400 may transmit a corresponding first destination terminal and a service server based on an incoming call connection with the first destination terminal requested from the service server 200 in response to the first call processing request signal transmitted previously. 200) performs a call connection function. Accordingly, a first call path between the first digital auxiliary device, the service server 200, the communication company server 400, and the first destination terminal may be formed (or configured).

In addition, the telecommunication company server 400 may execute the first calling terminal and the first in parallel immediately after the first call path between the first digital auxiliary apparatus, the service server 200, the telecommunication company server 400, and the first called terminal is formed. A second call path between the called terminals is formed (S660).

Thereafter, the service server 200 transmits / receives voice information (or a call) between the digital auxiliary device 100 and the called terminal 500 while the call connection is maintained between the digital auxiliary device 100 and the called terminal 500. History / call information) is matched with date information (e.g., date and time information) and stored.

That is, the service server 200 may transmit voice information transmitted / received between the digital auxiliary device 100 and the called terminal 500 while the call connection is maintained between the digital auxiliary device 100 and the called terminal 500. Perform call recording function by matching with.

In addition, the service server 200 may convert and store voice information recorded in real time into information (or recording) in the form of text.

In addition, the service server 200 may perform a voice recognition function on the recorded voice information, and may separate and store voice information for each user (for example, by caller, called party, and the like).

In addition, the service server 200 may convert and store voice information separately stored for each user into information in a text form for each user.

For example, the service server 200 records voice information according to a call between the first digital auxiliary device and the first called terminal in real time while the call connection between the first digital auxiliary device and the first called terminal is maintained.

In addition, the service server 200 may transmit voice information recorded in real time through a voice recognition function to at least one or more users input through the first digital auxiliary device, and at least another input input through the first called terminal. Separate and store voice information about one or more users. In this case, the service server 200 may convert and store voice information for each user separately stored for each corresponding terminal (for example, including the first digital auxiliary device and the first destination terminal) into information in a text form for each user (S670). ).

Then, when the call connection between the digital auxiliary device 100 and the called terminal 500 is terminated, the communication company server 400 is connected to the digital auxiliary device 100 and the service server 200 and the communication company server 400 in parallel. Terminates (or releases) the connection (or call connection) between the communication path between the communication terminal and the called terminal 500 and the calling terminal 300, the communication company server 400, and the called terminal 500, respectively.

That is, when the call connection between the digital auxiliary device 100 and the called terminal 500 is terminated, the communication company server 400 may include the digital auxiliary device 100, the service server 200, the communication company server 400, and the called terminal ( End the call connection between 500, and terminates the call connection between the calling terminal 300, the communication company server 400 and the called terminal 500 after the call connection ends.

In addition, after the entire call connection type, the communication company server 400 charges the call charges related to the call connection to the calling terminal 300 and / or the called terminal 500.

For example, when the call connection between the first digital auxiliary device and the first called terminal is terminated, the communication company server 400 terminates the call connection through the first call path between the first digital auxiliary device and the first called terminal, The call communication connection is terminated in the second call path between the first calling terminal and the first called terminal (S680).

Subsequently, in a state in which a call state between the digital auxiliary apparatus 100 and the called terminal 500 is maintained or in a state where a call state between the digital auxiliary apparatus 100 and the called terminal 500 is terminated, the calling terminal 300 In the case where it is desired to check call information (or text information obtained by converting voice information / voice information into a text form) between the digital auxiliary device 100 and the called terminal 500, the calling terminal 300 is the digital auxiliary device 100. And a call information request signal for requesting call information between the called terminal 500 and the service server 200. In this case, the call information request signal may include information for requesting transmission of some or all (or all) of the recorded voice information to the service server 200, information on the processing form of the voice information, identification information of the calling terminal 300, and the like. It includes. Here, the information on the processing form of the voice information includes the original voice information request stored in the service server 200, the information request to convert the original voice information into text form, the voice information request divided by user, the voice information separated by user It includes information about the request for information converted into text form.

For example, in a state where a call state between the first digital auxiliary device and the first called terminal is maintained, the first calling terminal receives original voice information for three minutes immediately after the call connection between the first digital auxiliary device and the first called terminal. The requesting first call information request signal is transmitted to the service server 200.

As another example, in a state in which a call state between the first digital auxiliary device and the first called terminal is terminated, the first calling terminal is divided into voice information for each user about the entire call content between the first digital auxiliary device and the first called terminal. The second call information request signal for requesting the information converted into the text form is transmitted to the service server 200 (S690).

Thereafter, the service server 200 receives a call information request signal transmitted from the calling terminal 300.

In addition, the service server 200 may be configured to obtain voice information related to the calling terminal 300 (or voice information between the digital assistant 100 and the called terminal 500 related to the calling terminal 300) from among the stored voice information. The caller terminal 300 transmits the call information in the form of voice or text by processing (or converting / converting) the confirmed voice information based on the information on the processing form of the voice information included in the corresponding call information request signal. To transmit. In this case, when there is a plurality of voice information associated with the corresponding calling terminal 300, the service server 200 may check (or select) one or more voice information satisfying a preset condition. Here, the preset condition may include a state which is the latest in chronological order.

For example, the service server 200 receives the first call information request signal transmitted from the first calling terminal, and among the plurality of voice information stored in the service server 200, the first digital auxiliary device related to the first calling terminal; Confirm the first voice information between the first called terminals and immediately after the call connection among the first voice information previously identified based on the original voice information for 3 minutes from immediately after the call connection included in the previously received first call information request signal; First 1-1 voice information corresponding to the original voice information for 3 minutes from the user, and extracts the extracted 1-1 voice information to the first calling terminal.

As another example, the service server 200 receives the second call information request signal transmitted from the first calling terminal, and among the plurality of voice information stored in the service server 200, the first digital auxiliary device related to the first calling terminal. And the second voice information between the first and the first called terminal, and previously identified based on the information obtained by converting voice information, which is separated for each user, into text form with respect to the entire call content included in the second call information request signal received earlier. After separating the entire second voice information for each user, a second recording (or text recording for each user in the form of text) converted from the voice information separated for each user is transmitted to the first calling terminal (S700).

Thereafter, the calling terminal 300 calls information (or voice or text call) between the digital auxiliary device 100 and the called terminal 500 transmitted from the service server 200 in response to the previously transmitted call information request signal. Information). Here, the call information may be all voice information recorded in the service server 200 according to the preceding call information request signal, or information corresponding to some voice information among the recorded voice information.

That is, the calling terminal 300 is voice information between the digital auxiliary device 100 transmitted from the service server 200 and the called terminal 500 in response to the previously transmitted call information request signal, and call information in text form. For example, the receiver may receive the call information of any one type of call information separated by each user and call information separated by each user.

In addition, the calling terminal 300 outputs call information between the received digital auxiliary device 100 and the called terminal 500.

For example, the first calling terminal transmits original voice information for three minutes immediately after a call connection between the first digital auxiliary apparatus and the first called terminal transmitted from the service server 200 in response to the previously transmitted first call information request signal. Receives 1-1 voice information corresponding to and outputs the received 1-1 voice information.

As another example, the first calling terminal may separate voice for each user regarding the entire call content between the first digital auxiliary device and the first called terminal transmitted from the service server 200 in response to the previously transmitted second call information request signal. A second recording (or text recording for each user) in which the information is converted into a text form is received, and a second recording for each user in the text form is output (S710).

A voice call service system using a digital auxiliary device according to an embodiment of the present invention can be created by a computer program, and codes and code segments constituting the computer program can be easily inferred by a computer programmer in the art. In addition, the computer program is stored in a computer readable media, and read by a computer or a digital auxiliary device, a service server, a calling terminal, a communication company server, a called terminal, or the like according to an embodiment of the present invention. By doing so, the voice call service system using the digital auxiliary device can be implemented.

The information storage medium includes a magnetic recording medium, an optical recording medium and the like. The computer program implementing the voice call service system using the digital auxiliary device according to an embodiment of the present invention may be stored and installed in an internal memory such as a digital auxiliary device, a service server, a calling terminal, a telecommunication company server, a called terminal, and the like. Alternatively, an external memory such as a smart card storing and installing a computer program for implementing a voice call service system using a digital auxiliary device according to an embodiment of the present invention may be installed in a voice call service system using a digital auxiliary device. It may be.

As described above, the embodiment of the present invention utilizes the calling terminal when the call is connected between the digital auxiliary device and the called terminal by the overall control of the service server, but does not allow the actual call to go through the calling terminal. By performing a call between the digital auxiliary device and the called terminal through the caller, the caller can freely make a call with the called terminal through the digital auxiliary device in a state where manipulation or control of the calling terminal is unnecessary, thereby improving convenience of use.

In addition, as described above, the embodiment of the present invention maintains the call connection between the calling terminal and the called terminal in parallel when the call is connected between the digital auxiliary device and the called terminal by the overall control of the service server. And / or the telecommunications server provides an incoming call notification to the called terminal with the calling number of the calling terminal as the calling number, and the calling terminal checks information about the called party such as the calling number while making a call through the other party's digital auxiliary device. Based on the subscription information of the terminal, various services can be used even if the calling terminal is not in the vicinity of the user, so that the same calling terminal can be utilized as if one or more digital auxiliary devices exist.

In addition, the embodiment of the present invention, as described above, in the service server stores the call content between the digital auxiliary device and the called terminal, and provides at least some or all of the stored call content between the digital auxiliary device and the called terminal to the calling terminal. Thus, any user can easily check the contents of conversations between the called terminals using the digital auxiliary device using the calling terminal.

The above description may be modified and modified by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

The present invention performs a call between the digital auxiliary device and the called terminal through a voice command of the caller, and utilizes the calling terminal when a call is connected between the digital auxiliary device and the called terminal, but does not allow the actual call to go through the calling terminal. By the intermediary, the calling terminal makes a call to the called terminal with a preset number, but the called terminal checks the telephone number of the calling terminal as the calling party, stores the contents of the call between the digital auxiliary device and the called terminal in the service server, and stores the stored digital auxiliary device. By providing at least some or all of the contents of the call between the called party and the called terminal to the calling terminal, any user can easily check the contents of the conversation between the called terminals using the digital auxiliary device using the calling terminal. Wide range of services, call field, terminal field, server field, etc. Can be used for this purpose.

10: voice call service system 100: digital auxiliary device
200: service server 300: calling terminal
400: communication company server 500: destination terminal
310: communication unit 320: storage unit
330: display unit 340: audio output unit
350: control unit

Claims (9)

Requesting, by the service server, a call origination to the calling terminal corresponding to the identification information of the digital auxiliary device based on the voice command transmitted from the digital auxiliary device, the identification information of the digital auxiliary device and the call origination request signal;
Identifying, by the service server, the digital auxiliary device related to a special number and caller information included in a call processing request signal transmitted from a communication company server;
Confirming, by the service server, called party information on the basis of the voice command received from the confirmed digital auxiliary device, and performing a call connection function with the digital auxiliary device;
Requesting, by the service server, an incoming call connection with a called terminal corresponding to the called party information based on the identified called party information to the communication company server;
Maintaining, by the service server, a call path between the digital assistant and the called terminal formed through the telecommunication company server in response to the requested incoming call connection; And
And storing, by the service server, call information until the end of the call between the digital assistant and the called terminal. The method of claim 1,
When the communication path between the digital auxiliary device and the called terminal is formed via the service server and the communication company server, forming another call path between the calling terminal and the called terminal in parallel by the communication company server. Voice call service method using a digital auxiliary device further comprising. The method of claim 2,
When the call between the digital assistant and the called terminal ends, disconnecting a connection state between the calling terminal and the called terminal by another communication server. Voice call service method using. The method of claim 1,
The step of storing the call information,
Storing voice information transmitted / received between the digital assistant and the called terminal and matching the date information;
Storing the converted voice information into text information;
Performing voice recognition on the stored voice information and separating and storing the voice information for each user; And
And converting and storing the voice information separately stored for each user into information in a text form for each user. The method of claim 1,
And receiving, by the service server, call information stored in association with the calling terminal to the calling terminal when receiving a call information request signal transmitted from the calling terminal. Voice call service method used. The method of claim 5,
Providing the stored call information with respect to the calling terminal to the calling terminal,
Voice call information, text call information, voice call information separated for each user, and user based on information for requesting transmission of a part or all included in the call information request signal and information on a processing form The voice call service method using the digital auxiliary device, characterized in that for providing the call information of any one type of call information in separate text form to the calling terminal. A non-transitory computer-readable recording medium having recorded thereon a program for performing the method according to any one of claims 1 to 6. A digital auxiliary device in which the received voice command of the originator forms a first communication path with the called terminal based on the voice command for call connection;
A service server requesting a call origination to a calling terminal associated with the digital auxiliary device to form the first communication path, and storing call information transmitted and received through the first communication path;
In response to the call origination request of the service server, a call origination request signal is transmitted using a special number set in advance, and the call origination request signal is transmitted to the service server in order to receive call information stored in the service server. Terminal;
A called terminal which checks a special number and caller information based on the call origination request signal, transmits a call processing request signal including the special number and caller information to the service server, and is transmitted in response to the call processing request signal A communication server configured to form a first call path between the digital assistant and the called terminal based on an incoming call connection request with the caller, and to form a second call path between the calling terminal and the called terminal; And
A voice call service system using a digital auxiliary device comprising the called terminal forming a first call path with the digital auxiliary device by the mediation of the communication company server and forming a second call path with the calling terminal. The method of claim 8,
The service server,
Voice call information, text call information, voice call information separated for each user, and user based on information for requesting transmission of a part or all included in the call information request signal and information on a processing form The voice call service system using the digital auxiliary device, characterized in that for providing the call information of any one type of call information in separate text form to the calling terminal.

Images