KR102399457B1 - System for voice call service using distal assistance device, method thereof and non-transitory computer readable medium having computer program recorded thereon - Google Patents

Abstract

Disclosed are a voice call service system using a digital assistant, a method thereof, and a nonvolatile recording medium on which a computer program is recorded. That is, the present invention performs a call between the digital auxiliary device and the called terminal through the caller's voice command, and utilizes the calling terminal when connecting a call between the digital auxiliary device and the called terminal, but prevents the actual call from going through the calling terminal. The calling terminal makes a call to the called terminal with a preset special number by the intermediary of the server, but the called terminal identifies the calling terminal's phone number as the caller, and the service server stores the call details between the digital assistant and the called terminal, and stores the stored digital By providing at least some or all of the contents of the call between the auxiliary device and the called terminal to the calling terminal, any user can easily check the contents of the conversation exchanged between the called terminals using the digital assistant using the calling terminal.

Description

A voice call service system using a digital assistance device, a method thereof, and a non-volatile recording medium on which a computer program is recorded

The present invention relates to a voice call service system using a digital assistant, a method thereof, and a nonvolatile recording medium on which a computer program is recorded. When a call is connected between the device and the called terminal, the calling terminal is utilized, but the actual call does not go through the calling terminal. Voice using a digital assistant device that identifies the number as the caller, stores the call details between the digital assistant and the called terminal in the service server, and provides at least some or all of the stored call details between the digital assistant and the called terminal to the calling terminal To a non-volatile recording medium in which a call service system, a method thereof, and a computer program are recorded.

In a situation where home automation using digital assistant devices such as AI (Artificial Intelligence) speakers is common, and digital assistants are spreading like a new home appliance called AI speakers, you can use digital assistants to make a voice call with a desired target. There is a growing need to do so.

In case of a voice call using an existing digital assistant, a method of performing a voice call using the digital assistant as an actual phone is known when the corresponding digital assistant has a telephone function and subscribes to a voice call service.

However, for this purpose, it is necessary to configure the phone function in the digital assistant, and there is a problem in that the user has to subscribe to the voice call service, which is continuously expensive and cumbersome to subscribe.

In addition, there is a problem in that even in the case of an operator that manufactures a digital assistant device or provides a service, it must be authenticated as a device for a voice call or as a communication operator for providing a service.

As another method, as a method of utilizing a voice call terminal possessed by a user, there is also known a case in which a digital auxiliary device and a voice call terminal are connected to each other through wired/wireless communication to interface only input and output of voice.

That is, after a digital assistant having a speaker and a microphone is connected to a voice call terminal using a known short-distance communication method for voice calls such as Bluetooth, when a call between the real voice call terminal and the called terminal is connected, instead of the microphone and speaker of the voice call terminal In a way that the microphone and speaker of the digital assistant take the place of the microphone and the speaker, there is a limitation that the voice call terminal and the digital assistant must be in close proximity, and the subject of the call or termination becomes the voice call terminal, so it is inconvenient to operate the terminal There is a limit that a service server for providing a digital assistant service based on the corresponding voice call cannot manage.

Korean Patent Registration No. 10-1824815 [Name: Method and system for secure call connection between app users]

An object of the present invention is to utilize the calling terminal when a call is connected between the digital assistant and the called terminal by the overall control of the service server, but the actual call does not go through the calling terminal, and the digital assistant device and the incoming terminal through the caller's voice command An object of the present invention is to provide a voice call service system using a digital assistant for performing a call between terminals, a method thereof, and a nonvolatile recording medium on which a computer program is recorded.

Another object of the present invention is to maintain a call connection between a calling terminal and a called terminal in parallel when a call is connected between a digital auxiliary device and a called terminal by the overall control of the service server, and An object of the present invention is to provide a voice call service system using a digital assistant that provides an incoming notification to a called terminal using a phone number as a calling number, a method therefor, and a nonvolatile recording medium on which a computer program is recorded.

Another object of the present invention is to store the call details between the digital assistant and the called terminal in a service server and provide at least some or all of the stored call details between the digital assistant and the called terminal to the calling terminal. An object of the present invention is to provide a non-volatile recording medium on which a call service system, a method thereof, and a computer program are recorded.

In the method of providing a voice call service using a digital auxiliary device according to an embodiment of the present invention, the service server provides a voice command transmitted from the digital auxiliary device, the identification information of the digital auxiliary device, and a call originating request signal. requesting a call origination to an originating terminal corresponding to the identification information; checking, by the service server, the digital auxiliary device related to a special number and caller information included in a call processing request signal transmitted from a communication company server; checking, by the service server, the called party information based on the voice command received from the identified digital auxiliary device, and performing a call connection function with the digital auxiliary device; requesting, by the service server, an incoming call connection with the called terminal corresponding to the called party information from the communication company server based on the confirmed called party information; maintaining, by the service server, a call path between the digital assistant and the called terminal established through the communication company server in response to the requested incoming call connection; and storing, by the service server, call information until the call between the digital assistant and the called terminal is terminated.

As an example related to the present invention, when a call path is established between the digital assistant and the called terminal via the service server and the communication company server, another call is made between the calling terminal and the called terminal by the communication company server It may further include the step of forming in parallel.

As an example related to the present invention, when the call between the digital assistant and the called terminal is terminated, the method may further include, by the communication company server, releasing a connection state to another call between the calling terminal and the called terminal. can

As an example related to the present invention, the storing of the call information may include: storing voice information transmitted and received between the digital assistant and the called terminal to match date information; converting the stored voice information into text information and storing; performing a voice recognition function on the stored voice information to separate and store voice information for each user; and converting the voice information separately stored for each user into text-type information for each user and storing the converted voice information.

As an example related to the present invention, when receiving a call information request signal transmitted from the calling terminal, the method may further include, by the service server, providing, by the service server, call information stored in relation to the calling terminal to the calling terminal. there is.

As an example related to the present invention, the step of providing the call information stored in relation to the calling terminal to the calling terminal includes information for requesting transmission of part or all of the call information included in the call information request signal, and information on the processing form Call information in any one of voice call information, text call information, voice call information separated for each user, and text call information separated for each user can be provided to the calling terminal based on there is.

A computer program for performing the method according to the above-described embodiment may be stored in a computer-readable non-volatile recording medium in which the program according to the embodiment of the present invention is recorded.

A voice call service system using a digital assistant according to an embodiment of the present invention comprises: a digital assistant in which a received caller's voice command forms a first communication path with a called terminal based on a voice command for call connection; a service server for requesting a call origination from an originating terminal related to the digital auxiliary device to form the first communication path, and storing call information transmitted and received through the first communication path; In response to the call origination request of the service server, a call origination request signal is transmitted using a preset special number, and the call information request signal is transmitted to the service server in order to receive the call information stored in the service server. terminal; A called terminal that confirms a special number and caller information based on the call origination request signal, transmits a call processing request signal including the special number and caller information to the service server, and is transmitted in response to the call processing request signal a communication company server that establishes a first communication path between the digital assistant and the called terminal based on an incoming call connection request with the communication company server, and forms a second communication path between the calling terminal and the called terminal; and the called terminal forming a first communication path with the digital assistant through the intermediary of the communication company server and forming a second communication path with the calling terminal.

As an example related to the present invention, the service server may include, based on information on requesting transmission of part or all of the call information included in the call information request signal, and information on a processing form, call information in voice form and call information in text form. , call information in the form of voice separated for each user and call information in the form of text separated for each user may be provided to the calling terminal.

The present invention utilizes the calling terminal when a call is connected between the digital assistant and the called terminal under the overall control of the service server, but the actual call does not go through the calling terminal, and between the digital assistant and the called terminal through the caller's voice command By making a call, the caller can freely make a call with the called terminal through the digital assistant in a state where manipulation or control of the calling terminal is unnecessary, thereby increasing the convenience of use.

In addition, the present invention maintains the call connection between the calling terminal and the called terminal in parallel when a call is connected between the digital assistant and the called terminal by the overall control of the service server, By providing an incoming notification to the called terminal using the number as the calling number, the calling terminal checks information about the other party, such as the calling number, while making a call through the digital assistant of the other party, and provides various services based on the subscription information of the calling terminal It is effective to use the same calling terminal even if the calling terminal is not near the user, as if the same calling terminal exists where one or more digital auxiliary devices are located.

In addition, according to the present invention, the service server stores the contents of a call between the digital auxiliary device and the called terminal and provides at least some or all of the stored call contents between the digital auxiliary device and the called terminal to the calling terminal, so that any user can use the digital auxiliary device There is an effect that it is possible to easily check the contents of a conversation exchanged between the called terminals using the calling terminal.

1 is a block diagram showing the configuration of a voice call service system using a digital assistant according to an embodiment of the present invention.
2 is a block diagram showing the configuration of an originating terminal according to an embodiment of the present invention.
3 is a block diagram showing the configuration of a voice call service system using another type of digital assistant according to an embodiment of the present invention.
4 to 5 are flowcharts illustrating a voice call service method using a digital assistant according to the first embodiment of the present invention.
6 to 7 are flowcharts illustrating a voice call service method using a digital assistant according to a second embodiment of the present invention.

It should be noted that the technical terms used in the present invention are only used to describe specific embodiments, and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be interpreted as meanings generally understood by those of ordinary skill in the art to which the present invention belongs, unless otherwise specifically defined in the present invention, and excessively comprehensive It should not be construed in the meaning of a human being or in an excessively reduced meaning. In addition, when the technical term used in the present invention is an incorrect technical term that does not accurately express the spirit of the present invention, it should be understood by being replaced with a technical term that can be correctly understood by those skilled in the art. In addition, the general terms used in the present invention should be interpreted according to the definition in the dictionary or according to the context before and after, and should not be interpreted in an excessively reduced meaning.

Also, the singular expression used in the present invention includes the plural expression unless the context clearly dictates otherwise. In the present invention, terms such as “consisting of” or “comprising” should not be construed as necessarily including all of the various components or various steps described in the invention, and some components or some steps may not be included. It should be construed that it may further include additional components or steps.

Also, terms including ordinal numbers such as first, second, etc. used in the present invention may be used to describe the elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

Hereinafter, a preferred embodiment according to the present invention will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numerals regardless of reference numerals, and redundant description thereof will be omitted.

In addition, in the description of the present invention, if it is determined that a detailed description of a related known technology may obscure the gist of the present invention, the detailed description thereof will be omitted. In addition, it should be noted that the accompanying drawings are only for easy understanding of the spirit of the present invention, and should not be construed as limiting the spirit of the present invention by the accompanying drawings.

1 is a block diagram showing the configuration of a voice call service system 10 using a digital assistant according to an embodiment of the present invention.

As shown in FIG. 1 , the voice call service system 10 includes a digital assistant 100 , a service server 200 , a calling terminal 300 , a communication company server 400 , and a called terminal 500 . Not all of the components of the voice call service system 10 shown in FIG. 1 are essential components, and the voice call service system 10 may be implemented by more components than the components shown in FIG. The voice call service system 10 may be implemented with fewer components.

When the digital assistant 100 related to the calling terminal 300 requests the service server 200 or the calling terminal 300 for a call connection with the called terminal 500, the service server 200 sends the calling terminal 300 ) and the called terminal 500 based on the voice command transmitted from the digital auxiliary device 100, and the digital assistant 100 and the called terminal 500 by interworking with the communication company server 400 A communication path (or call path) is connected between each other, and the communication path between the calling terminal 300 , the communication company server 400 , and the called terminal 500 is connected independently and in parallel for billing. Thereafter, the service server 300 records (or stores) call information between the communication-connected digital assistant 100 and the called terminal 500 in real time, and the When the call information between the called terminal 500 is requested, the recorded call information between the digital assistant 100 and the called terminal 500 is provided.

The digital assistant 100 includes an artificial intelligence (AI) speaker/microphone, a microcontroller (or control unit) (not shown), a communication unit (not shown), and a storage unit (not shown).

In addition, the digital assistant 100 communicates with the service server 200 , the preset calling terminal 300 , and the like through a wired/wireless communication method. Here, the calling terminal 300 may log in to the corresponding digital auxiliary device 100 in advance and register information (or caller information) related to the calling terminal 300 in the digital auxiliary device 100 .

In addition, when the caller's voice command (or voice) received from the digital auxiliary device 100 is a voice command for call connection for a call with the called terminal 500, the digital auxiliary device 100 provides the corresponding voice command, It transmits identification information of the digital assistant 100 , a call origination request signal, and the like to the service server 200 . Here, the identification information of the digital auxiliary device 100 includes a mobile IP, a mobile MAC, a serial number, and the like.

That is, the digital assistant 100 receives a voice from a caller (or user) and performs a voice recognition function on the received voice. At this time, the digital assistant 100 checks whether the received voice is the voice of the pre-registered user (or user authentication), and if the received voice corresponds to the voice of the pre-registered user, the received voice is It is also possible to perform a voice recognition function for Here, the voice recognition function may be performed using various known techniques.

Also, the digital assistant 100 determines whether a voice command for call connection is included in the result of performing the voice recognition function.

As a result of the determination, when a voice command for performing another control function related to the corresponding digital auxiliary device 100 is included in the result of performing the corresponding voice recognition function, the digital auxiliary device 100 is a digital auxiliary device corresponding to the corresponding voice command. Perform other control functions related to (100).

For example, as a result of the determination, when the voice command "NUGU, turn up the volume by one level" is included in the result of performing the corresponding voice recognition function, the digital assistant 100 outputs the speaker of the corresponding digital assistant 100 is increased by one preset level and output. Here, “NUGU” may be identification information (or identification name) for the corresponding digital assistant 100 .

In addition, as a result of the determination, if the voice command for connecting the call is included in the result of performing the corresponding voice recognition function, the digital auxiliary device 100 displays the corresponding voice command, identification information of the digital auxiliary device 100, and a call request signal. and so on to the service server 200 .

In addition, when the caller's voice command (or voice) received from the digital auxiliary device 100 is a voice command for call connection for a call with the called terminal 500, the digital auxiliary device 100 provides the corresponding voice command, The identification information of the digital auxiliary device 100 and a call origination request signal are transmitted to the calling terminal 300 previously registered in the digital auxiliary device 100 in relation to the corresponding digital auxiliary device 100 .

That is, as a result of the determination, when the voice command for call connection is included in the result of performing the voice recognition function, the digital auxiliary device 100 identifies the calling terminal 300 registered in advance with the corresponding digital auxiliary device 100 . The information is checked, and a corresponding voice command, identification information of the digital assistant 100, a call origination request signal, etc. are transmitted to the calling terminal 300 corresponding to the identified identification information of the calling terminal 300 . Here, the identification information of the calling terminal 300 includes a mobile directory number (MDN), mobile IP, mobile MAC, subscriber identity module (Sim) card unique information, serial number, and the like.

In this case, when the digital assistant 100 requests a call to the calling terminal 300 , the digital assistant 100 calls the dedicated app pre-installed in the calling terminal 300 and then the digital assistant 100 may request a call origination from the calling terminal 300 while the corresponding dedicated app is running in the calling terminal 300 .

Also, when the call connection with the specific called terminal 500 fails in response to the call origination request signal, the digital assistant 100 receives information indicating that the call connection has failed from the service server 200 .

Also, the digital assistant 100 outputs information indicating that the received call connection has failed.

In this way, when the call connection fails, the digital assistant 100 may request an input of an additional voice command from the user and try to connect the call again based on the voice command additionally input from the user.

In addition, when a call connection (or call connection) is required because a voice command for connecting a call is included in the result of performing the corresponding voice recognition function, the digital assistant 100 is provided to the control of the service server 200 or the calling terminal 300 . It performs a call connection (or call connection) function by

In addition, when the communication path with the called terminal 500 is normally connected under the control of the service server 200 or the calling terminal 300 , the digital assistant 100 connects the service server 200 and the communication company server 400 to the It performs a call function with the called terminal 500 connected via communication.

Also, when the call between the digital assistant 100 and the called terminal 500 is terminated, the digital assistant 100 terminates the call connection with the called terminal 500 previously formed under the control of the service server 200 . do.

The service server 200 communicates with the digital assistant 100 , the calling terminal 300 , the communication company server 400 , the called terminal 500 , and the like.

In addition, the service server 200 matches and stores (or manages) the identification information of the digital auxiliary device 100 with the identification information of a terminal (eg, including the calling terminal 300 ) related to the corresponding digital auxiliary device 100 . )do.

In addition, the service server 200 provides (or installs) a dedicated app for call origination (or call connection) to the originating terminal 300 .

In addition, the service server 200 stores a plurality of called party information transmitted from the calling terminal 300 . Here, the recipient information (or recipient information) includes a name (or nickname/nickname), a phone number, an email address, social network account information, and the like.

In addition, the service server 200 stores information about the digital assistant 100 corresponding to the special number related to the calling terminal 300 . Through this, when the communication company server 400 wants to check the phone number of the called terminal 500 by using the special number transmitted from the calling terminal 300, the service server 200 is a digital auxiliary device related to the special number. (100), the phone number of the called terminal 500 can be confirmed using a voice command transmitted from the verified digital auxiliary device 100 (or a voice command related to the verified digital auxiliary device 100). .

Also, the service server 200 receives a voice command transmitted from the digital auxiliary device 100 , identification information of the digital auxiliary device 100 , a call origination request signal, and the like.

In addition, the service server 200 checks identification information of the calling terminal 300 corresponding to the previously received identification information of the digital auxiliary device 100 from among the identification information of the calling terminal for each identification information of the plurality of digital auxiliary devices stored in advance. do. Here, the identification information of the calling terminal 300 includes MDN, mobile IP, mobile MAC, Sim (subscriber identification module) card unique information, serial number, and the like.

In addition, the service server 200 requests a call to the calling terminal 300 corresponding to the identified identification information of the calling terminal 300 .

At this time, when the service server 200 requests to send a call to the calling terminal 300 , after the service server 200 calls the dedicated app pre-installed in the calling terminal 300 , the service server 200 is the calling terminal At 300 , a call may be requested from the calling terminal 300 while the corresponding dedicated app is running.

Also, the service server 200 receives a call processing request signal including a special number, a voice command, and caller information transmitted from the communication company server 400 .

In addition, the service server 200 checks the digital assistant 100 related to the special number and/or caller information based on the special number and caller information included in the received call processing request signal.

That is, the service server 200 confirms that the corresponding call processing request signal is a signal in response to the call origination request transmitted to the calling terminal 300 previously, and digital assistance related to the call origination request transmitted to the calling terminal 300 . Check the device 100 .

At this time, the service server 200 determines the number of the digital auxiliary device 100 corresponding to the previously received caller information (or special number) among the previously stored identification information of the digital auxiliary device for each caller information (or for each special number). Identification information may also be checked.

Also, the service server 200 checks the called party information based on the voice command received from the verified digital assistant 100 . Here, the called party information includes a name (or nickname/nickname), a phone number, an email address, social network account information, and the like.

That is, the service server 200 includes a name/included in the previously received voice command from among a plurality of phone numbers (eg, name/nickname/nickname, phone number, etc.) registered in advance in relation to the calling terminal 300. Check the called party information, which is the phone number corresponding to the nickname/nickname.

In this case, the service server 200 may check the called party information based on the voice command included in the call processing request signal.

That is, the service server 200 is included in the previously received call processing request signal from among a plurality of phone numbers (eg, name/nickname/nickname, phone number, etc.) registered in advance in relation to the calling terminal 300. Check the called party information, which is a phone number corresponding to the name/nickname/nickname included in the voice command.

As a result of the check, if a phone number (or called party information) corresponding to the name/nickname/nickname included in the voice command among a plurality of phone numbers registered in advance with respect to the calling terminal 300 is not confirmed, the service server ( 200) transmits information indicating that the called party information is not confirmed to the communication company server 400, and transmits information indicating that the call connection has failed to the digital assistant 100.

In addition, as a result of the check, if a phone number corresponding to the name/nickname/nickname included in the corresponding voice command is identified from among a plurality of phone numbers registered in advance in relation to the calling terminal 300, the service server 200 is In order to perform a call connection function via the service server 200 , a call connection (or call connection) function is performed between the service server 200 and the digital assistant 100 .

In addition, the service server 200 connects an incoming call with the called terminal 500 corresponding to the corresponding called party information based on the previously confirmed called party information in response to the call processing request signal of the communication company server 400 (or the incoming call) connection signal) is requested (or transmitted) to the communication company server 400 .

In addition, when the call connection function between the called terminal 500 and the service server 200 is normally performed by the corresponding communication company server 400 according to the call processing request signal transmitted to the communication company server 400, the service server 200 may establish (or configure) a call path between the digital assistant 100 and the called terminal 500 via the communication company server 400 .

In addition, with respect to a call path formed between the digital assistant 100 and the called terminal 500 via the service server 200 and the communication company server 400 , the call is terminated between the digital assistant 100 and the called terminal 500 . In this case, the corresponding call (or call connection state) may be terminated (or released/cancelled).

In addition, the service server 200 maintains the voice information (or call) transmitted/received between the digital auxiliary device 100 and the called terminal 500 while the call connection is maintained between the digital auxiliary device 100 and the called terminal 500 . history/call information) is matched with date information (eg, including date and time information) and stored. In this case, the service server 200 stores call information for the entire call time from the start of the call connection between the digital assistant 100 and the called terminal 500 to the end of the call connection.

That is, the service server 200 records voice information transmitted/received between the digital auxiliary device 100 and the called terminal 500 as date information while the call connection is maintained between the digital auxiliary device 100 and the called terminal 500 . It performs a call recording function (or a call information storage function) by matching with .

Also, the service server 200 may convert real-time recorded (or stored) voice information into text information (or transcript) and store it.

In addition, the service server 200 may perform a voice recognition function on recorded (or stored) voice information to separate and store voice information for each user (including, for example, each caller, each called party, etc.).

In addition, the service server 200 may convert and store the separately stored voice information for each user into information in the form of text for each user.

In this way, the service server 200 not only simply stores the call information between terminals, but also converts the call information in the voice form into the call information in the text form so that the call information can be easily identified, or calls for each user. Information can be stored (or managed) separately.

Also, the service server 200 receives a call information request signal transmitted from the calling terminal 300 .

In addition, the service server 200 receives voice information related to the calling terminal 300 (or voice information between the digital assistant 100 and the called terminal 500 related to the calling terminal 300) from among the plurality of stored voice information. Confirmation, and processing (or converting / converting) the confirmed voice information based on the information on the processing form of the voice information included in the call information request signal to send the call information in the form of voice or text to the calling terminal 300 send to In this case, when there are a plurality of voice information related to the calling terminal 300 , the service server 200 may check (or select) one or more voice information satisfying a preset condition. Here, the preset condition may include the most recent state in the order of date.

That is, the service server 200 determines any one of call information in voice form, call information in text form, call information in voice form separated for each user, and call information in text form separated for each user based on the corresponding call information request signal. The call information in the form of is transmitted to the calling terminal 300 .

In this way, the service server 200 may increase user convenience by providing the call information in the format requested by the terminal according to the request of the terminal that wants to receive the recorded call information.

The calling terminal (or sending terminal) 300 and the called terminal (or receiving terminal) 500 are a smart phone, a portable terminal, a mobile terminal, and a personal digital assistant. : PDA), PMP (Portable Multimedia Player) terminal, telematics terminal, navigation terminal, personal computer, notebook computer, slate PC, tablet PC, ultrabook (ultrabook), wearable devices (including, for example, watch-type terminals (Smartwatch), glass-type terminals (Smart Glass), HMD (Head Mounted Display), etc.), Wibro (Wibro) terminal, IPTV (Internet Protocol Television) ) terminal, smart TV, digital broadcasting terminal, television, 3D television, home theater system, AVN (Audio Video Navigation) terminal, A/V (Audio/Video) system, flexible terminal It can be applied to various terminals such as

As shown in FIG. 2 , the calling terminal 300 includes a communication unit 310 , a storage unit 320 , a display unit 330 , a voice output unit 340 , and a control unit 350 . Not all of the components of the calling terminal 300 shown in FIG. 2 are essential components, and the calling terminal 300 may be implemented by more components than the components shown in FIG. 2, and fewer components. The calling terminal 300 may also be implemented by

The communication unit 310 communicates with any internal component or at least one external terminal through a wired/wireless communication network. In this case, any external terminal may include the digital assistant 100 , the service server 200 , the communication company server 400 , the called terminal 500 , and the like. Here, as wireless Internet technologies, wireless LAN (WLAN), DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband: Wibro), Wimax (World Interoperability for Microwave Access: Wimax), HSDPA (High Speed Downlink Packet Access) ), High Speed Uplink Packet Access (HSUPA), IEEE 802.16, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless Mobile Broadband Service (WMBS), etc. In this case, the communication unit 310 transmits and receives data according to at least one wireless Internet technology within a range including Internet technologies not listed above. In addition, short-range communication technologies include Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and Near Field Communication (NFC). , Ultra Sound Communication (USC), Visible Light Communication (VLC), Wi-Fi (Wi-Fi), Wi-Fi Direct (Wi-Fi Direct), etc. may be included. In addition, the wired communication technology may include Power Line Communication (PLC), USB communication, Ethernet, serial communication, optical/coaxial cable, and the like.

Also, the communication unit 310 may mutually transmit information with an arbitrary terminal through a Universal Serial Bus (USB).

In addition, the communication unit 310 is a technical standard or communication method for mobile communication (eg, GSM (Global System for Mobile communication), CDMA (Code Division Multi Access), CDMA2000 (Code Division Multi Access 2000), EV- Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (DO), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), LTE-A (LTE-A) Long Term Evolution-Advanced (Long Term Evolution-Advanced, etc.)) transmits and receives radio signals to and from the base station, the digital assistant 100, the service server 200, the communication company server 400, the called terminal 500, and the like.

In addition, the communication unit 310 receives a dedicated app for call origination (or call connection) with an arbitrary called terminal 500 transmitted from the service server 200 .

The storage unit 320 (or memory) stores various user interfaces (UIs), graphic user interfaces (GUIs), and the like.

In addition, the storage unit 320 stores data and programs necessary for the calling terminal 300 to operate.

That is, the storage unit 320 may store a plurality of application programs (application programs or applications) driven in the calling terminal 300, data for operation, and commands. At least some of these application programs may be downloaded from an external service providing device through wireless communication. In addition, at least some of these application programs may exist in the calling terminal 300 from the time of shipment for basic functions (eg, a phone incoming/outgoing function, a message sending/receiving function). Meanwhile, the application program may be stored in the storage unit 320 , installed in the calling terminal 300 , and driven to perform an operation (or function) by the control unit 350 .

In addition, the storage unit 320 is a flash memory type (Flash Memory Type), a hard disk type (Hard Disk Type), a multimedia card micro type (Multimedia Card Micro Type), a card type memory (eg, SD or XD memory) etc.), magnetic memory, magnetic disk, optical disk, RAM (Random Access Memory: RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory: ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) may include at least one storage medium. In addition, the calling terminal 300 may operate a web storage that performs a storage function of the storage unit 320 on the Internet, or may operate in connection with the web storage.

In addition, the storage unit 320, under the control of the control unit 350, installs a dedicated app for call origination (or call connection) with any called terminal 500 received through the communication unit 310.

The display unit 330 may display various contents such as various menu screens using a user interface and/or a graphic user interface stored in the storage unit 320 under the control of the control unit 350 . Here, the content displayed on the display unit 330 includes various text or image data (including various information data) and a menu screen including data such as icons, list menus, and combo boxes. Also, the display unit 330 may be a touch screen.

In addition, the display unit 330 includes a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display ( It may include at least one of a flexible display), a three-dimensional display (3D display), an e-ink display, and a light emitting diode (LED).

Also, the display unit 330 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glasses-free method), or a projection method (holographic method) may be applied to the stereoscopic display unit.

In addition, the display unit 330 displays the execution result screen of the dedicated app installed in the calling terminal 300 under the control of the control unit 350 .

The audio output unit 340 outputs audio information included in a signal processed by the control unit 350 . Here, the audio output unit 340 may include a receiver, a speaker, a buzzer, and the like.

In addition, the voice output unit 340 outputs a guide voice generated by the control unit 350 .

Also, the voice output unit 340 outputs voice information corresponding to the execution result screen of the dedicated app installed in the calling terminal 300 by the control unit 350 .

The control unit 350 executes an overall control function of the calling terminal 300 . In this case, the controller 350 may be a processor or an engine.

In addition, the control unit 350 executes the overall control function using the program and data stored in the storage unit 320 . The controller 350 may include RAM, ROM, CPU, GPU, and a bus, and the RAM, ROM, CPU, GPU, etc. may be connected to each other through a bus. The CPU may access the storage unit 320 to perform booting using the O/S stored in the storage unit 320 , and various operations using various programs, contents, data, etc. stored in the storage unit 320 . can be performed.

In addition, the control unit 350 connects to the digital auxiliary device 100 through the communication unit 310 . In this case, the controller 350 may perform a login function for the corresponding digital assistant 100 based on login information (eg, ID, password, etc. included) according to a user input.

In addition, the controller 350 registers information (or caller information) related to the calling terminal 300 in the digital auxiliary device 100 by interworking with the digital auxiliary device 100 .

In addition, the control unit 350 accesses the service server 200 through the communication unit 310 .

In addition, the control unit 350 controls the communication unit 310 to receive a dedicated app for a call origination (or call connection) with an arbitrary called terminal 500 transmitted from the service server 200 .

In addition, the control unit 350 installs the received dedicated app in the calling terminal 300 .

Also, the control unit 350 registers one or more called party information according to a user's selection from the phone book stored in the storage unit 320 to the service server 200 . Here, the called party information includes a name (or nickname/nickname), a phone number, an email address, social network account information, and the like.

In addition, the control unit 350 registers information on the digital auxiliary device 100 (or identification information of the digital auxiliary device 100 ) corresponding to the special number related to the calling terminal 300 in the service server 200 . . Through this, when the communication unit 310 receives a call origination request from the service server 200, the control unit 350 transmits the special number to the communication company server 400 even without knowing the called party information related to the called terminal 500. By transmitting to the service server 200 via 100), and by checking the called party information based on the confirmed voice command related to the digital auxiliary device 100, a call connection between the digital auxiliary device 100 and the called terminal 500 may be performed.

Also, when the digital assistant 100 transmits a call origination request signal to the service server 200 , the communication unit 310 receives the call origination request transmitted from the service server 200 .

At this time, the control unit 350 receives the dedicated app call signal pre-installed in the calling terminal 300 from the service server 200 through the communication unit 310, and based on the received dedicated app call signal, the calling terminal 300 ), after running the dedicated app, may receive a call outgoing request transmitted from the service server 200 while the dedicated app is running.

Also, the control unit 350 controls the communication unit 310 to receive a voice command transmitted from the digital auxiliary apparatus 100 , identification information of the digital auxiliary apparatus 100 , a call origination request signal, and the like.

At this time, the control unit 350 receives the dedicated app call signal pre-installed in the calling terminal 300 from the digital assistant 100 through the communication unit 310, and based on the received dedicated app call signal, the calling terminal ( 300), after executing the dedicated app pre-installed in the dedicated app, it is possible to receive a voice command transmitted from the digital auxiliary device 100, identification information of the digital auxiliary device 100, a call origination request signal, etc. while the dedicated app is running. may be

In addition, the control unit 350 responds to the received call origination request of the service server 200 or the digital assistant 100 through the dedicated app running in the originating terminal 300 in response to the calling terminal 300 in response to A call origination request (or call origination request signal is transmitted) to the communication company server 400 using a preset special number (or special number).

That is, in response to the call origination request of the service server 200 or the digital assistant device 100 , the control unit 350 uses a special number preset in response to the originating terminal 300 to provide a special number and the originating terminal 300 . ) transmits a call origination request signal including identification information (or a phone number of the calling terminal 300 ) to the communication company server 400 through the communication unit 310 . Here, the special number may be a unique number preset in order to attempt a call connection using the corresponding calling terminal 300 .

In addition, when a communication path is formed between the digital assistant 100 and the service server 200 and the communication company server 400 and the called terminal 500 by the mediation (or relay) of the communication company server 400, the communication unit 310 ) forms another call path between the calling terminal 300 and the communication company server 400 and the called terminal 500 in parallel with the previous call path by the mediation of the communication company server 400 . In this case, the other currency between the calling terminal 300 and the called terminal 500 may be in a state formed to pay for a call between the digital auxiliary device 100 and the called terminal 500, and the corresponding digital auxiliary device ( When the call between 100) and the called terminal 500 is terminated, the corresponding other call is also terminated, and the cost settlement according to the call between the corresponding digital assistant 100 and the called terminal 500 is performed by the communication company server 400 can be performed.

In addition, in a state in which the call state between the digital auxiliary apparatus 100 and the called terminal 500 is maintained or in a state in which the call state between the digital auxiliary apparatus 100 and the called terminal 500 is terminated, the calling terminal 300 When it is desired to check call information (or text information obtained by converting voice information/voice information into text form) between the digital auxiliary device 100 and the called terminal 500, the control unit 350 communicates with the digital auxiliary device 100 A call information request signal for requesting call information between the called terminals 500 is transmitted to the service server 200 through the communication unit 310 . In this case, the call information request signal includes information requesting transmission of part or all (or all) of the recorded voice information to the service server 200 , information on the processing form of voice information, identification information of the calling terminal 300 , etc. includes Here, the information on the processing form of the voice information includes a request for original voice information stored in the service server 200, a request for information obtained by converting the original voice information into text form, a request for voice information separated for each user, and voice information separated for each user. It includes information about information requests, etc. converted into text format.

In addition, the controller 350 transmits call information between the digital assistant 100 and the called terminal 500 (or call information in voice or text form) transmitted from the service server 200 in response to the previously transmitted call information request signal. ) through the communication unit 310 . Here, the call information may be all voice information recorded in the service server 200 according to the previous call information request signal, or information corresponding to some voice information among all the recorded voice information.

That is, the control unit 350 transmits the call information in the voice form between the digital assistant 100 and the called terminal 500 and the call information in the text form transmitted from the service server 200 in response to the previously transmitted call information request signal, The communication unit 310 receives call information in any one of the voice type call information separated for each user and the text type call information separated for each user.

In addition, the control unit 350 outputs the received call information between the digital assistant 100 and the called terminal 500 through the display unit 330 and/or the voice output unit 340 .

The communication company server 400 communicates with the service server 200 , the calling terminal 300 , the called terminal 500 , and the like.

In addition, the communication company server 400 may include a configuration for the communication unit 310 , the storage unit 320 , the display unit 330 , the voice output unit 340 and the control unit 350 included in the calling terminal 300 . there is.

In addition, the communication company server 400 stores (or manages) caller information related to the calling terminal 300 subscribed as a member to the corresponding communication company server 400 .

Also, the communication company server 400 receives a call origination request signal transmitted from the originating terminal 300 .

That is, the communication company server 400 transmits a call request signal including a special number transmitted from the calling terminal 300, identification information of the calling terminal 300 (or a phone number of the calling terminal 300), a voice command, and the like. receive

In addition, the communication company server 400 checks the special number and caller information based on the received call origination request signal.

That is, the communication company server 400 checks the sender information corresponding to the previously received identification information of the calling terminal 300 from among the caller information corresponding to the previously stored identification information of the calling terminal. Here, the sender information (or sender information) includes a name (or nickname/nickname), a phone number, an email address, social network account information, and the like.

In addition, the communication company server 400 is a call processing request signal including a special number, a voice command, the confirmed caller information, etc. in order to confirm the phone number of the called terminal 500 for a call connection with the calling terminal 300. is transmitted to the service server 200 .

In addition, when the called party information is not confirmed by the service server 200 in response to the previously transmitted call processing request signal, the communication company server 400 information indicating that the called party information transmitted from the service server 200 is not confirmed receive

In addition, the service server 200 outputs information indicating that the received called party information is in an unconfirmed state, and provides information indicating that the received called party information is in an unconfirmed state to the calling terminal 300 .

In addition, the communication company server 400 responds to the previously transmitted call processing request signal, and based on the incoming call connection (or incoming call connection request) with the called terminal 500 requested from the service server 200, the corresponding called terminal ( 500) and the service server 200 performs a call connection function. In this way, when the call connection between the called terminal 500 and the service server 200 is normally performed by the communication company server 400 , the called terminal 500 , the communication company server 400 , the service server 200 and the digital assistant A call path between the devices 100 may be normally connected.

Here, when the communication company server 400 performs a call connection function between the corresponding called terminal 500 and the service server 200 based on the incoming call connection with the called terminal 500 requested from the service server 200, The telecommunication company server 400 (or service server 200) transmits caller information related to the calling terminal 300 (including, for example, the phone number of the calling terminal 300, etc.) based on the previously confirmed caller information to the called terminal ( 500), the called terminal 500 may check caller information before connecting the call.

In addition, in a state in which the digital assistant 100 and the called terminal 500 are connected to each other via the service server 200 and the communication company server 400 , the service server 200 (or the communication company server 400 ) is connected in parallel. In this way, the calling terminal 300 and the called terminal 500 may be configured to maintain a state in which a call is connected via the communication company server 400 . Here, the calling terminal 300 is not connected to the called terminal 500 by using a phone number related to the called terminal 500, but using a special number preset in the calling terminal 300 to the corresponding called terminal. It is possible to maintain a call-connected state with the 500 .

At this time, as shown in FIG. 3 , when the calling terminal 300 and the called terminal 500 are subscribed to different communication companies, a plurality of different communication companies between the calling terminal 300 and the called terminal 500 . The servers 400 are each configured, and by the mutual interworking (or mutual communication connection) of the plurality of different communication company servers 400 , the calling terminal 300 , the plurality of different communication company servers 400 , and the called terminal 500 . ) may be maintained.

In addition, when the call connection between the digital auxiliary device 100 and the called terminal 500 is terminated, the communication company server 400 connects the digital auxiliary device 100, the service server 200, and the communication company server 400 in parallel. The communication path between the and the called terminal 500 and the communication path between the calling terminal 300 and the communication company server 400 and the called terminal 500 are respectively terminated.

That is, when the call connection between the digital auxiliary device 100 and the called terminal 500 is terminated, the communication company server 400 provides the digital auxiliary device 100, the service server 200, the communication company server 400 and the called terminal ( 500) and terminates the call connection between the calling terminal 300, the communication company server 400, and the called terminal 500 after the call connection is terminated.

In addition, after all call connection types, the communication company server 400 charges a call fee related to the corresponding call connection to the calling terminal 300 and/or the called terminal 500 .

The called terminal 500 communicates with the digital assistant 100 , the service server 200 , the calling terminal 300 , the communication company server 400 , and the like.

In addition, the called terminal 500 may include a configuration for the communication unit 310 , the storage unit 320 , the display unit 330 , the voice output unit 340 and the control unit 350 included in the calling terminal 300 . there is.

In addition, the called terminal 500 forms a communication path with the digital assistant 100 by interworking with the service server 200 by intermediary of the communication company server 400, and the calling terminal 300 is parallel with the communication path. and other communication channels.

At this time, before forming a communication path with the digital assistant device 100 by the mediation of the communication company server 400, the called terminal 500 transmits the corresponding digital assistant transmitted from the communication company server 400 (or the service server 200). By outputting caller information about the calling terminal 300 related to the device 100, the called party of the corresponding called terminal 500 may check the calling party information that has requested a call connection.

In addition, the called terminal 500 performs an actual voice call function with the digital auxiliary device 100 and communicates with the calling terminal 300 in a background state while the call function with the digital auxiliary device 100 is maintained. can keep the

Also, when the call between the called terminal 500 and the digital assistant 100 is terminated, the called terminal 500 ends the call with the calling terminal 300 under the control of the communication company server 400 .

In the embodiment of the present invention, a voice call is exemplified when a call is connected between the digital assistant 100 and the called terminal 500, but the present invention is not limited thereto. When a display unit (not shown) is provided, a video call (or video call) may be performed between the digital assistant 100 and the called terminal 500 .

In addition, in addition to voice calls and/or video calls, an email sending function between the digital assistant 100 and an email server (not shown), and a corresponding calling terminal 300 between the digital assistant 100 and a social network server (not shown) It is also possible to perform a function to register a post/comment in a related social network account.

In the embodiment of the present invention, it is described that the call information stored in the service server 200 is provided to the calling terminal 300, but is not limited thereto, and in addition to the calling terminal 300, digital information related to the actual recorded call information When the auxiliary device 100 and/or the called terminal 500 requests transmission of the recorded call information to the service server 200, the service server 200 sends the corresponding digital auxiliary device 100 and/or the called terminal ( It is determined whether 500) is a terminal related to the actual recorded call information, and as a result of the determination, if the digital assistant 100 and/or the called terminal 500 is a terminal related to the actual recorded call information, the corresponding service server 200 ), the recorded call information may be provided to the corresponding digital assistant 100 and/or the called terminal 500 .

In addition, the calling terminal 300 and/or the called terminal 500 is an interface unit (not shown) that serves as an interface with all external devices connected to the calling terminal 300 and/or the called terminal 500. It may include more. For example, the interface unit includes a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting devices equipped with an identification module, and audio I/O ( Input/Output) port, video I/O (Input/Output) port, earphone port, etc. may be configured. Here, the identification module is a chip storing various information for authenticating the use authority of the calling terminal 300 , and includes a user authentication module (UIM), a subscriber identity module (SIM), and universal user authentication. It may include a module (Universal Subscriber Identity Module: USIM) and the like. In addition, the device provided with the identification module may be manufactured in the form of a smart card. Accordingly, the identification module may be connected to the calling terminal 300 and/or the called terminal 500 through the port. Such an interface unit receives data or power from an external device and transmits it to each component inside the calling terminal 300 and/or the called terminal 500, or inside the calling terminal 300 and/or the called terminal 500 data is transmitted to an external device.

In addition, the interface unit provides a path through which power from the cradle is supplied to the calling terminal 300 and/or the called terminal 500 when the calling terminal 300 and/or the called terminal 500 is connected to an external cradle. Alternatively, various command signals input from the cradle by the user may be a path through which the calling terminal 300 and/or the called terminal 500 are transmitted. Various command signals or corresponding power input from the cradle may be operated as signals for recognizing that the calling terminal 300 and/or the called terminal 500 are correctly mounted in the cradle.

In addition, the calling terminal 300 and/or the called terminal 500 receives a signal according to a button operation by a user or an arbitrary function selection, or a command generated by an operation such as touching/scrolling a displayed screen or It may further include an input unit (not shown) for receiving the control signal.

The input unit is a means for receiving at least one of a user's command, selection, data, and information, and may include a plurality of input keys and function keys for receiving numeric or character information and setting various functions.

In addition, the input unit includes a key pad, a dome switch, a touch pad (static pressure/capacitance), a touch screen, a jog wheel, a jog switch, a jog shuttle, and a mouse. , various devices such as a stylus pen, a touch pen, and the like may be used. In particular, when the display unit 330 is formed in the form of a touch screen, some or all of the input functions may be performed through the display unit 330 .

In addition, each component (or module) of the calling terminal 300 may be software stored in a memory (or storage) of the calling terminal 300 and/or the called terminal 500 . The memory may be an internal memory of the calling terminal 300 and/or the called terminal 500, and may be an external memory or other type of storage device. Also, the memory may be a non-volatile memory. The software stored in the memory may include a set of instructions that, when executed, cause the calling terminal 300 and/or the called terminal 500 to perform a specific operation.

In addition, the service server 200 and the communication company server 400 may be implemented in the form of a web server, a database server, a proxy server, and the like. In addition, the service server 200 and the communication company server 400 may be installed with one or more of a network load balancing mechanism, or various software that enables the service server 200 and the communication company server 400 to operate on the Internet or other networks. and can be implemented as a computerized system through this. Also, the network may be an http network, and may be a private line, an intranet, or any other network. Furthermore, the connection between the service server 200 and the communication company server 400 and the calling terminal 300 and/or the called terminal 500 is a secure network so that data is not attacked by any hackers or other third parties. can be connected In addition, the service server 200 and the communication company server 400 may include a plurality of database servers, and these database servers are connected to the service server 200 and the communication company server through any type of network connection including a distributed database server architecture. It may be implemented in a way that is separately connected to 400 .

In addition, the processor mounted on the digital assistant device 100 , the service server 200 , the calling terminal 300 , the communication company server 400 and the called terminal 500 according to the present invention is for executing the method according to the present invention. Can process program commands. In one implementation, the processor may be a single-threaded processor, and in another implementation, the processor may be a multi-threaded processor. Furthermore, the processor may process instructions stored in a memory or a storage device.

In this way, when a call is connected between the digital assistant and the called terminal under the overall control of the service server, the calling terminal is utilized, but the actual call does not go through the calling terminal, and the digital assistant device and the called terminal are connected through the caller's voice command. You can make calls.

In addition, when a call is connected between the digital assistant and the called terminal by the overall control of the service server as described above, the call connection between the calling terminal and the called terminal is maintained in parallel, and the call of the calling terminal from the service server and/or the communication company server An incoming notification may be provided to the called terminal by using the number as the calling number.

Also, as described above, the service server may store the contents of a call between the digital auxiliary device and the called terminal, and provide at least some or all of the stored call contents between the digital auxiliary device and the called terminal to the calling terminal.

Hereinafter, a voice call service method using a digital assistant according to the present invention will be described in detail with reference to FIGS. 1 to 7 .

4 to 5 are flowcharts illustrating a voice call service method using a digital assistant according to the first embodiment of the present invention.

First, when the caller's voice command (or voice) received from the digital auxiliary device 100 is a voice command for call connection for a call with the called terminal 500, the digital auxiliary device 100 provides the corresponding voice command, It transmits identification information of the digital assistant 100 , a call origination request signal, and the like to the service server 200 . Here, the identification information of the digital auxiliary device 100 includes a mobile IP, a mobile MAC, a serial number, and the like.

That is, the digital assistant 100 receives a voice from a caller (or user) and performs a voice recognition function on the received voice. At this time, the digital assistant 100 checks whether the received voice is the voice of the pre-registered user (or user authentication), and if the received voice corresponds to the voice of the pre-registered user, the received voice is It is also possible to perform a voice recognition function for

Also, the digital assistant 100 determines whether a voice command for call connection is included in the result of performing the voice recognition function.

As a result of the determination, when a voice command for connecting a call is included in the result of performing the corresponding voice recognition function, the digital assistant 100 transmits the corresponding voice command, identification information of the digital assistant 100, and a call request signal. It is transmitted to the service server 200 .

At this time, if it is determined as a result of performing the voice recognition function that a voice command for performing another control function related to the corresponding digital auxiliary device 100 is included, the digital auxiliary device 100 performs a digital function corresponding to the corresponding voice command. Other control functions related to the auxiliary device 100 are performed.

As an example, the first digital assistant 100 receives a first voice (eg, “NUGU, call your husband”) through the caller, and performs a voice recognition function on the received first voice. .

In addition, the first digital assistant determines whether a voice command for call connection is included in the result of performing the voice recognition function, and as a result of the determination, the result of performing the voice recognition function includes the first called terminal 500 owned by the husband ), when it is determined that the first voice command for call connection (eg, "Call my husband") is included, the first voice command, the identification information of the first digital assistant, the second A call originating request signal, etc. is transmitted to the service server 200 (S410).

Thereafter, the service server 200 receives a voice command transmitted from the digital auxiliary apparatus 100 , identification information of the digital auxiliary apparatus 100 , a call origination request signal, and the like.

In addition, the service server 200 checks identification information of the calling terminal 300 corresponding to the previously received identification information of the digital auxiliary device 100 from among the identification information of the calling terminal for each identification information of the plurality of digital auxiliary devices stored in advance. do. Here, the identification information of the calling terminal 300 includes MDN, mobile IP, mobile MAC, Sim (subscriber identification module) card unique information, serial number, and the like.

In addition, the service server 200 requests a call to the calling terminal 300 corresponding to the identified identification information of the calling terminal 300 .

At this time, when the service server 200 requests to send a call to the calling terminal 300 , after the service server 200 calls the dedicated app pre-installed in the calling terminal 300 , the service server 200 is the calling terminal At 300 , a call may be requested from the calling terminal 300 while the corresponding dedicated app is running.

As an example, the service server 200 may include a first voice command (eg, “Call your husband”) transmitted from the first digital auxiliary device, identification information of the first digital auxiliary device, a first call outgoing request signal, etc. receive

Also, the service server 200 checks the identification information of the first calling terminal corresponding to the previously received identification information of the first digital auxiliary device from among the previously stored identification information of the calling terminal for each identification information of the plurality of digital auxiliary devices.

In addition, the service server 200 interworks with the first calling terminal corresponding to the identified identification information of the first calling terminal to call the dedicated app pre-installed in the first calling terminal, and the dedicated app is executed in the first calling terminal In the current state, a first call origination is requested to the corresponding first originating terminal (S420).

Thereafter, the calling terminal 300 receives the call origination request transmitted from the service server 200, and in response to the received call origination request of the service server 200, through the dedicated app running on the calling terminal 300 A call origination request (or a call origination request signal is transmitted) is requested to the communication company server 400 by using a special number (or special number) preset in response to the originating terminal 300 .

That is, the calling terminal 300 responds to the call origination request of the service server 200, using a special number preset in response to the calling terminal 300, a special number, identification information of the calling terminal 300 (or It transmits a call origination request signal including a phone number of the originating terminal 300 ) to the communication company server 400 . Here, the special number may be a unique number preset in order to attempt a call connection using the corresponding calling terminal 300 .

For example, the first calling terminal responds to the first call origination request transmitted from the service server 200, and in order to attempt a call connection with the corresponding first calling terminal, a first special number (eg, "010-9999") -8888"), and transmits a first call outgoing request signal including a phone number of the first calling terminal (eg, "010-1234-5678") to the communication company server 400 (S430).

Thereafter, the communication company server 400 receives the call origination request signal transmitted from the originating terminal 300 , and checks a special number and caller information based on the received call origination request signal.

That is, the communication company server 400 receives a call origination request signal including a special number transmitted from the originating terminal 300 , identification information of the originating terminal 300 , and the like.

In addition, the communication company server 400 checks the sender information corresponding to the previously received identification information of the calling terminal 300 from among the caller information corresponding to the previously stored identification information of the calling terminal. Here, the sender information includes a name (or nickname/nickname), a phone number, an email address, social network account information, and the like.

In addition, the communication company server 400 transmits a call processing request signal including a special number and confirmed caller information to the service server in order to confirm the phone number of the called terminal 500 for call connection with the calling terminal 300 . Send to 200.

As an example, the communication company server 400 includes a first special number (eg, "010-9999-8888") transmitted from the first calling terminal, a phone number of the first calling terminal (eg, "010-1234-5678") "), and the like, and receive the first caller information corresponding to the identification information of the first calling terminal among the caller information corresponding to the previously stored identification information of the calling terminal (eg, Gildong Hong, the first caller information 1 Check the phone number (010-1234-5678, etc.) corresponding to the calling terminal.

In addition, the communication company server 400 transmits a first call processing request signal including a first special number (eg, "010-9999-8888"), the first confirmed caller information, etc. to the service server 200 (S440).

Thereafter, the service server 200 receives a call processing request signal including a special number and caller information transmitted from the communication company server 400 .

In addition, the service server 200 checks the digital assistant 100 related to the special number and/or caller information based on the special number and caller information included in the received call processing request signal.

That is, the service server 200 confirms that the corresponding call processing request signal is a signal in response to the call origination request transmitted to the calling terminal 300 previously, and digital assistance related to the call origination request transmitted to the calling terminal 300 . Check the device 100 .

Also, the service server 200 checks the called party information based on the voice command received from the verified digital assistant 100 . Here, the called party information includes a name (or nickname/nickname), a phone number, an email address, social network account information, and the like.

That is, the service server 200 includes a name/included in the previously received voice command from among a plurality of phone numbers (eg, name/nickname/nickname, phone number, etc.) registered in advance in relation to the calling terminal 300. Check the called party information, which is the phone number corresponding to the nickname/nickname.

In addition, the service server 200 performs a call connection (or call connection) function between the service server 200 and the digital assistant 100 in order to perform a call connection function via the corresponding service server 200 .

For example, the service server 200 receives a first call processing request signal including a first special number (eg, "010-9999-8888"), first caller information, etc. transmitted from the communication company server 400 . do.

In addition, the service server 200 identifies the first digital assistant related to the first calling terminal based on the first special number and the first caller information included in the received first call processing request signal.

In addition, the service server 200 may include a first voice command (eg, "Call your husband") received from the previously identified first digital assistant among a plurality of phone numbers registered in advance in relation to the first calling terminal. First called party information corresponding to the "husband" included in the .

Also, the service server 200 performs a call connection function with the identified first digital assistant (S450).

Thereafter, the service server 200 connects an incoming call with the called terminal 500 corresponding to the corresponding called party information based on the previously confirmed called party information in response to the call processing request signal of the preceding communication company server 400 (or an incoming call) connection signal) is requested (or transmitted) to the communication company server 400 .

For example, the service server 200 requests the communication company server 400 for an incoming call connection with the first called terminal corresponding to the checked first called party information (S460).

Thereafter, the communication company server 400 responds to the previously transmitted call processing request signal, and based on the incoming call connection (or incoming call connection request) with the called terminal 500 requested from the service server 200, the corresponding called terminal ( 500) and the service server 200 performs a call connection function. In this way, when the call connection between the called terminal 500 and the service server 200 is normally performed by the communication company server 400 , the called terminal 500 , the communication company server 400 , the service server 200 and the digital assistant A call path between the devices 100 may be normally connected.

Here, when the communication company server 400 performs a call connection function between the corresponding called terminal 500 and the service server 200 based on the incoming call connection with the called terminal 500 requested from the service server 200, The telecommunication company server 400 (or service server 200) transmits caller information related to the calling terminal 300 (including, for example, the phone number of the calling terminal 300, etc.) based on the previously confirmed caller information to the called terminal ( 500), the called terminal 500 may check caller information before connecting the call.

In addition, in a state in which the digital assistant 100 and the called terminal 500 are connected to each other via the service server 200 and the communication company server 400 , the service server 200 (or the communication company server 400 ) is connected in parallel. In this way, the calling terminal 300 and the called terminal 500 may be configured to maintain a state in which a call is connected via the communication company server 400 . Here, the calling terminal 300 is not connected to the called terminal 500 by using a phone number related to the called terminal 500, but using a special number preset in the calling terminal 300 to the corresponding called terminal. It is possible to maintain a call-connected state with the (500).

At this time, when the calling terminal 300 and the called terminal 500 are subscribed to different communication companies, a plurality of different communication company servers 400 are configured between the calling terminal 300 and the called terminal 500, respectively. , the call connection between the calling terminal 300 and the plurality of different communication company servers 400 and the called terminal 500 is maintained by the mutual interworking (or mutual communication connection) of the plurality of different communication company servers 400 . may be

As an example, the communication company server 400 responds to the previously transmitted first call processing request signal and based on the incoming call connection with the first called terminal requested from the service server 200, the corresponding first called terminal and the service server ( 200) to perform a call connection function. Accordingly, a first communication path may be formed (or configured) between the first digital assistant, the service server 200 , the communication company server 400 , and the first called terminal.

In addition, the communication company server 400 immediately after the first call path is formed between the first digital assistant device, the service server 200, the communication company server 400, and the first called terminal, in parallel with the first calling terminal and the first A second communication path is established between the called terminals (S470).

Thereafter, the service server 200 maintains the voice information (or call) transmitted/received between the digital auxiliary device 100 and the called terminal 500 while the call connection is maintained between the digital auxiliary device 100 and the called terminal 500 . history/call information) is matched with date information (eg, including date and time information) and stored.

That is, the service server 200 records voice information transmitted/received between the digital auxiliary device 100 and the called terminal 500 as date information while the call connection is maintained between the digital auxiliary device 100 and the called terminal 500 . It performs call recording function by matching with .

Also, the service server 200 may convert real-time recorded (or stored) voice information into text information (or transcript) and store it.

In addition, the service server 200 may perform a voice recognition function on the recorded voice information, and separate and store voice information for each user (eg, for each caller, each called party, etc.).

In addition, the service server 200 may convert and store the separately stored voice information for each user into information in the form of text for each user.

For example, while the call connection between the first digital auxiliary device and the first called terminal is maintained, the service server 200 records voice information according to the call between the first digital auxiliary device and the first called terminal in real time.

In addition, the service server 200 may provide voice information recorded in real time through the voice recognition function to voice information of at least one user input through the first digital assistant and at least other voice information input through the first receiving terminal. Separately store voice information for one or more users. In this case, the service server 200 may convert and store the user-specific voice information separately stored for each corresponding terminal (including, for example, the first digital assistant device, the first called terminal, etc.) into information in the form of text for each user (S480). ).

Thereafter, when the call connection between the digital auxiliary device 100 and the called terminal 500 is terminated, the communication company server 400 connects the digital auxiliary device 100 and the service server 200 and the communication company server 400 connected in parallel. The connection (or call connection) of the communication path between the and the called terminal 500 and the communication path between the calling terminal 300 and the communication company server 400 and the called terminal 500 is terminated (or disconnected), respectively.

That is, when the call connection between the digital auxiliary device 100 and the called terminal 500 is terminated, the communication company server 400 provides the digital auxiliary device 100, the service server 200, the communication company server 400 and the called terminal ( 500) and terminates the call connection between the calling terminal 300, the communication company server 400, and the called terminal 500 after the call connection is terminated.

In addition, after all call connection types, the communication company server 400 charges a call fee related to the corresponding call connection to the calling terminal 300 and/or the called terminal 500 .

For example, when the call connection between the first digital auxiliary device and the first called terminal is terminated, the communication company server 400 terminates the call connection through the first call path between the first digital auxiliary device and the first called terminal, The second call path between the first calling terminal and the first called terminal is terminated (S490).

Thereafter, in a state in which the call state between the digital auxiliary apparatus 100 and the called terminal 500 is maintained or in a state in which the call state between the digital auxiliary apparatus 100 and the called terminal 500 is terminated, the calling terminal 300 When it is desired to check call information (or text information obtained by converting voice information/voice information into text form) between the digital auxiliary device 100 and the called terminal 500, the calling terminal 300 sends the digital auxiliary device 100 A call information request signal for requesting call information between the and the called terminal 500 is transmitted to the service server 200 . In this case, the call information request signal includes information requesting transmission of part or all (or all) of the recorded voice information to the service server 200 , information on the processing form of voice information, identification information of the calling terminal 300 , etc. includes Here, the information on the processing form of the voice information includes a request for original voice information stored in the service server 200, a request for information obtained by converting the original voice information into text form, a request for voice information separated for each user, and voice information separated for each user. It includes information about information requests, etc. converted into text format.

That is, the service server 200 determines any one of call information in voice form, call information in text form, call information in voice form separated for each user, and call information in text form separated for each user based on the corresponding call information request signal. The call information in the form of is transmitted to the calling terminal 300 .

For example, in a state in which the call state between the first digital auxiliary device and the first called terminal is maintained, the first calling terminal transmits the original voice information for 3 minutes immediately after the call connection between the first digital auxiliary device and the first called terminal It transmits a requesting first call information request signal to the service server 200 .

As another example, in a state in which the call state between the first digital auxiliary device and the first called terminal is terminated, the first calling terminal provides separate voice information for each user with respect to the entire call between the first digital auxiliary device and the first called terminal A second call information request signal for requesting information converted into text form is transmitted to the service server 200 (S500).

Thereafter, the service server 200 receives a call information request signal transmitted from the calling terminal 300 .

In addition, the service server 200 receives voice information related to the calling terminal 300 (or voice information between the digital assistant 100 and the called terminal 500 related to the calling terminal 300) from among the plurality of stored voice information. Confirmation, and processing (or converting / converting) the confirmed voice information based on the information on the processing form of the voice information included in the call information request signal to send the call information in the form of voice or text to the calling terminal 300 send to In this case, when there are a plurality of voice information related to the calling terminal 300 , the service server 200 may check (or select) one or more voice information satisfying a preset condition. Here, the preset condition may include the most recent state in the order of date.

That is, the service server 200 determines any one of call information in voice form, call information in text form, call information in voice form separated for each user, and call information in text form separated for each user based on the corresponding call information request signal. The call information in the form of is transmitted to the calling terminal 300 .

For example, the service server 200 receives the first call information request signal transmitted from the first calling terminal, and from among a plurality of voice information stored in the service server 200 , a first digital assistant related to the first calling terminal; Check the first voice information between the first called terminals, and immediately after the call connection among the first voice information identified above based on the original voice information for 3 minutes from immediately after the call connection included in the previously received first call information request signal 1-1 voice information corresponding to the original voice information for 3 minutes is extracted, and the extracted 1-1 voice information is transmitted to the first calling terminal.

As another example, the service server 200 receives the second call information request signal transmitted from the first calling terminal, and among a plurality of voice information stored in the service server 200 , the first digital assistant related to the first calling terminal The second voice information between the and the first called terminal is checked, and based on the information obtained by converting the voice information separated for each user into text form for the entire call included in the previously received second call information request signal, the previously confirmed After separating the entire second voice information for each user, a second transcript (or a transcript for each user in text format) obtained by converting the separated voice information for each user into text form is transmitted to the first calling terminal (S510).

Thereafter, the calling terminal 300 transmits call information (or a call in voice or text format) between the digital auxiliary device 100 and the called terminal 500 transmitted from the service server 200 in response to the previously transmitted call information request signal. information) is received. Here, the call information may be all voice information recorded in the service server 200 according to the previous call information request signal, or information corresponding to some voice information among all the recorded voice information.

That is, the calling terminal 300 transmits call information in the form of voice and text information between the digital assistant 100 and the called terminal 500 transmitted from the service server 200 in response to the previously transmitted call information request signal. , receives call information in any one of the voice call information separated for each user and the text call call information separated for each user.

In addition, the calling terminal 300 outputs the received call information between the digital assistant 100 and the called terminal 500 .

As an example, the first calling terminal responds to the previously transmitted first call information request signal, and is transmitted from the service server 200, and the original voice information for 3 minutes immediately after the call connection between the first digital assistant and the first called terminal Receives the 1-1th voice information corresponding to , and outputs the received 1-1th voice information.

As another example, the first calling terminal is a voice separated for each user with respect to the entire call content between the first digital assistant and the first called terminal transmitted from the service server 200 in response to the second call information request signal transmitted earlier. A second transcript (or a transcript for each user in text format) obtained by converting information into text format is received, and the received second transcript for each user in text format is output ( S520 ).

In this way, the actual call is performed between the digital auxiliary device 100 and the called terminal 500, but as the calling terminal 300 related to the digital auxiliary device 100 maintains communication with the corresponding called terminal 500, The telecommunication company server 400 provides a function of charging a charge according to a call between the corresponding digital auxiliary device 100 and the called terminal 500 (or a function of paying a charge for a call according to a call between the digital auxiliary device 100 and the called terminal 500). This may be performed through the corresponding calling terminal 300 .

6 to 7 are flowcharts illustrating a voice call service method using a digital assistant according to a second embodiment of the present invention.

First, when the caller's voice command (or voice) received from the digital auxiliary device 100 is a voice command for call connection for a call with the called terminal 500, the digital auxiliary device 100 provides the corresponding voice command, The identification information of the digital auxiliary device 100 and a call origination request signal are transmitted to the calling terminal 300 previously registered in the digital auxiliary device 100 in relation to the corresponding digital auxiliary device 100 . Here, the identification information of the digital auxiliary device 100 includes a mobile IP, a mobile MAC, a serial number, and the like.

That is, the digital assistant 100 receives a voice from a caller (or user) and performs a voice recognition function on the received voice. At this time, the digital assistant 100 checks whether the received voice is the voice of the pre-registered user (or user authentication), and if the received voice corresponds to the voice of the pre-registered user, the received voice is It is also possible to perform a voice recognition function for

Also, the digital assistant 100 determines whether a voice command for call connection is included in the result of performing the voice recognition function.

As a result of the determination, if a voice command for call connection is included in the result of performing the corresponding voice recognition function, the digital assistant 100 receives the identification information of the calling terminal 300 registered in advance in the corresponding digital assistant 100 Check and request a call to the calling terminal 300 corresponding to the identified identification information of the calling terminal 300 . Here, the identification information of the calling terminal 300 includes MDN, mobile IP, mobile MAC, Sim (subscriber identification module) card unique information, serial number, and the like.

In this case, when a call origination request is made from the digital auxiliary device 100 to the calling terminal 300 , the digital auxiliary device 100 calls a dedicated app pre-installed in the calling terminal 300 and then the digital auxiliary device 100 may request a call origination from the calling terminal 300 while the corresponding dedicated app is running in the calling terminal 300 .

In addition, as a result of the determination, if the voice command for performing another control function related to the digital auxiliary device 100 is included in the result of performing the corresponding voice recognition function, the digital auxiliary device 100 performs a digital function corresponding to the corresponding voice command. Other control functions related to the auxiliary device 100 are performed.

As an example, the first digital assistant 100 receives a first voice (eg, “NUGU, call my son”) through the caller, and performs a voice recognition function on the received first voice. .

In addition, the first digital assistant determines whether a voice command for call connection is included in the result of performing the voice recognition function, and as a result of the determination, the result of performing the voice recognition function includes the first called terminal 500 owned by the son ), when it is determined that a first voice command (for example, "Call my son") for a call connection is included, the first calling terminal 300 registered in advance with the first digital assistant ) to check the identification information.

In addition, the first digital assistant device interworks with the first calling terminal corresponding to the identified identification information of the first calling terminal to call the dedicated app pre-installed in the first calling terminal, and the dedicated app is executed in the first calling terminal In the current state, a first voice command, identification information of the first digital assistant, and a first call outgoing request signal are transmitted to the first calling terminal (S610).

Thereafter, the calling terminal 300 receives a voice command transmitted from the digital auxiliary apparatus 100 , identification information of the digital auxiliary apparatus 100 , a call origination request signal, and the like.

In addition, the calling terminal 300 responds to the received call origination request signal of the digital assistant 100 through a dedicated app running in the calling terminal 300, a special number preset in response to the calling terminal 300 (or a special number) to request (or transmit a call originating request signal) to the communication company server 400 .

That is, the calling terminal 300 responds to the call origination request signal of the digital auxiliary device 100, and uses a special number preset in response to the calling terminal 300 to provide a special number and identification information of the calling terminal 300 . (or the phone number of the calling terminal 300 ) and transmits a call outgoing request signal including a voice command to the communication company server 400 . Here, the special number may be a unique number preset in order to attempt a call connection using the corresponding calling terminal 300 .

For example, the first calling terminal receives a first voice command transmitted from the first digital auxiliary device, identification information of the first digital auxiliary device, a first call origination request signal, etc. 1 special number (eg "010-9999-8888"), the phone number of the first calling terminal (eg "010-1234-5678"), the first voice command (eg "Call son ") and transmits the first call origination request signal including the like to the communication company server 400 (S620).

Thereafter, the communication company server 400 receives the call origination request signal transmitted from the originating terminal 300 , and checks a special number and caller information based on the received call origination request signal.

That is, the communication company server 400 receives a call origination request signal including a special number transmitted from the calling terminal 300 , identification information of the calling terminal 300 , a voice command, and the like.

In addition, the communication company server 400 checks the sender information corresponding to the previously received identification information of the calling terminal 300 from among the caller information corresponding to the previously stored identification information of the calling terminal. Here, the sender information includes a name (or nickname/nickname), a phone number, an email address, social network account information, and the like.

In addition, the communication company server 400 is a call processing request signal including a special number, a voice command, the confirmed caller information, etc. in order to confirm the phone number of the called terminal 500 for a call connection with the calling terminal 300. is transmitted to the service server 200 .

As an example, the communication company server 400 includes a first special number (eg, "010-9999-8888") transmitted from the first calling terminal, a first voice command (eg, "Call my son"), Receives the first call outgoing request signal including the phone number of the first calling terminal (eg, "010-1234-5678"), and the like, and the first calling terminal among the caller information corresponding to the identification information of the calling terminal stored in advance Check the first caller information (eg, including Hong Gil-dong, a phone number (010-1234-5678), etc. corresponding to the first calling terminal) corresponding to the identification information of the.

In addition, the communication company server 400 transmits the first special number (eg, "010-9999-8888"), the first voice command (eg, "Call my son"), the confirmed first caller information, etc. The first call processing request signal including the first is transmitted to the service server 200 (S630).

Thereafter, the service server 200 receives a call processing request signal including a special number, a voice command, caller information, etc. transmitted from the communication company server 400 .

In addition, the service server 200 checks the digital assistant 100 related to the special number and/or caller information based on the special number and caller information included in the received call processing request signal.

That is, the service server 200 is a digital auxiliary device 100 corresponding to the previously received caller information (or special number) among a plurality of previously stored identification information of the digital auxiliary device for each caller information (or for each special number). Check the identification information.

Also, the service server 200 checks the called party information based on the voice command included in the call processing request signal. Here, the called party information includes a name (or nickname/nickname), a phone number, an email address, social network account information, and the like.

That is, the service server 200 is included in the previously received call processing request signal from among a plurality of phone numbers (eg, name/nickname/nickname, phone number, etc.) registered in advance with respect to the calling terminal 300. Check the called party information, which is a phone number corresponding to the name/nickname/nickname included in the voice command.

In addition, the service server 200 performs a call connection (or call connection) function between the service server 200 and the digital assistant 100 in order to perform a call connection function via the corresponding service server 200 .

For example, the service server 200 is a first special number (eg, "010-9999-8888") transmitted from the communication company server 400, a first voice command (eg, "Call my son") , and receives a first call processing request signal including first caller information and the like.

In addition, the service server 200 identifies the first digital assistant related to the first calling terminal based on the first special number and the first caller information included in the received first call processing request signal.

In addition, the service server 200 includes a first voice command (eg, "Call my son") included in the previously received first call processing request signal from among a plurality of phone numbers registered in advance in relation to the first calling terminal. ), the first called party information corresponding to the "son" (eg, the son, including a phone number (010-7777-1234) corresponding to the first called terminal related to the son, etc.) is checked.

Also, the service server 200 performs a call connection function with the identified first digital assistant (S640).

Thereafter, the service server 200 connects an incoming call with the called terminal 500 corresponding to the corresponding called party information based on the previously confirmed called party information in response to the call processing request signal of the preceding communication company server 400 (or an incoming call) connection signal) is requested (or transmitted) to the communication company server 400 .

For example, the service server 200 requests the communication company server 400 for an incoming call connection with the first called terminal corresponding to the checked first called party information (S650).

Thereafter, the communication company server 400 responds to the previously transmitted call processing request signal, and based on the incoming call connection (or incoming call connection request) with the called terminal 500 requested from the service server 200, the corresponding called terminal ( 500) and the service server 200 performs a call connection function. In this way, when the call connection between the called terminal 500 and the service server 200 is normally performed by the communication company server 400 , the called terminal 500 , the communication company server 400 , the service server 200 and the digital assistant A call path between the devices 100 may be normally connected.

Here, when the communication company server 400 performs a call connection function between the corresponding called terminal 500 and the service server 200 based on the incoming call connection with the called terminal 500 requested from the service server 200, The telecommunication company server 400 (or service server 200) transmits caller information related to the calling terminal 300 (including, for example, the phone number of the calling terminal 300, etc.) based on the previously confirmed caller information to the called terminal ( 500), the called terminal 500 may check caller information before connecting the call.

In addition, in a state where the digital assistant 100 and the called terminal 500 are connected to each other via the service server 200 and the communication company server 400 , the communication company server 400 is parallel to the calling terminal 300 and the called terminal 300 . The terminal 500 may be configured to maintain a call connection state via the communication company server 400 . Here, the calling terminal 300 is not connected to the called terminal 500 by using a phone number related to the called terminal 500, but using a special number preset in the calling terminal 300 to the corresponding called terminal. It is possible to maintain a call-connected state with the 500 .

At this time, when the calling terminal 300 and the called terminal 500 are subscribed to different communication companies, a plurality of different communication company servers 400 are configured between the calling terminal 300 and the called terminal 500, respectively. , the call connection between the calling terminal 300 and the plurality of different communication company servers 400 and the called terminal 500 is maintained by the mutual interworking (or mutual communication connection) of the plurality of different communication company servers 400 . may be

As an example, the communication company server 400 responds to the previously transmitted first call processing request signal and based on the incoming call connection with the first called terminal requested from the service server 200, the corresponding first called terminal and the service server ( 200) to perform a call connection function. Accordingly, a first communication path may be formed (or configured) between the first digital assistant, the service server 200 , the communication company server 400 , and the first called terminal.

In addition, the communication company server 400 immediately after the first call path is formed between the first digital assistant, the service server 200, the communication company server 400 and the first called terminal, in parallel with the first calling terminal and the first A second communication path is established between the called terminals (S660).

Thereafter, the service server 200 maintains the voice information (or call) transmitted/received between the digital auxiliary device 100 and the called terminal 500 while the call connection is maintained between the digital auxiliary device 100 and the called terminal 500 . history/call information) is matched with date information (eg, including date and time information) and stored.

That is, the service server 200 records voice information transmitted/received between the digital auxiliary device 100 and the called terminal 500 as date information while the call connection is maintained between the digital auxiliary device 100 and the called terminal 500 . It performs call recording function by matching with .

Also, the service server 200 may convert real-time recorded voice information into text information (or transcript) and store it.

In addition, the service server 200 may perform a voice recognition function on the recorded voice information, and separate and store voice information for each user (eg, for each caller, each called party, etc.).

In addition, the service server 200 may convert and store the separately stored voice information for each user into information in the form of text for each user.

For example, while the call connection between the first digital auxiliary device and the first called terminal is maintained, the service server 200 records voice information according to the call between the first digital auxiliary device and the first called terminal in real time.

In addition, the service server 200 may provide voice information recorded in real time through the voice recognition function to voice information of at least one user input through the first digital assistant and at least other voice information input through the first receiving terminal. The voice information for one or more users is separately stored. In this case, the service server 200 may convert and store user-specific voice information separately stored for each corresponding terminal (including, for example, the first digital assistant, the first called terminal, etc.) into information in the form of text for each user (S670). ).

Thereafter, when the call connection between the digital auxiliary device 100 and the called terminal 500 is terminated, the communication company server 400 connects the digital auxiliary device 100 and the service server 200 and the communication company server 400 connected in parallel. The connection (or call connection) between the communication path between the and the called terminal 500 and the communication path between the calling terminal 300 and the communication company server 400 and the called terminal 500 is terminated (or disconnected), respectively.

That is, when the call connection between the digital auxiliary device 100 and the called terminal 500 is terminated, the communication company server 400 provides the digital auxiliary device 100, the service server 200, the communication company server 400 and the called terminal ( 500) and terminates the call connection between the calling terminal 300, the communication company server 400, and the called terminal 500 after the call connection is terminated.

In addition, after all call connection types, the communication company server 400 charges a call fee related to the corresponding call connection to the calling terminal 300 and/or the called terminal 500 .

For example, when the call connection between the first digital auxiliary device and the first called terminal is terminated, the communication company server 400 terminates the call connection through the first call path between the first digital auxiliary device and the first called terminal, The second call path between the first calling terminal and the first called terminal is terminated (S680).

Thereafter, in a state in which the call state between the digital auxiliary apparatus 100 and the called terminal 500 is maintained or in a state in which the call state between the digital auxiliary apparatus 100 and the called terminal 500 is terminated, the calling terminal 300 When it is desired to check call information (or text information obtained by converting voice information/voice information into text form) between the digital auxiliary device 100 and the called terminal 500, the calling terminal 300 sends the digital auxiliary device 100 A call information request signal for requesting call information between the and the called terminal 500 is transmitted to the service server 200 . In this case, the call information request signal includes information requesting transmission of part or all (or all) of the recorded voice information to the service server 200 , information on the processing form of voice information, identification information of the calling terminal 300 , etc. includes Here, the information on the processing form of the voice information includes a request for original voice information stored in the service server 200, a request for information obtained by converting the original voice information into text form, a request for voice information separated for each user, and voice information separated for each user. It includes information about information requests, etc. converted into text format.

For example, in a state in which the call state between the first digital auxiliary device and the first called terminal is maintained, the first calling terminal transmits the original voice information for 3 minutes immediately after the call connection between the first digital auxiliary device and the first called terminal It transmits a requesting first call information request signal to the service server 200 .

As another example, in a state in which the call state between the first digital auxiliary device and the first called terminal is terminated, the first calling terminal provides separate voice information for each user with respect to the entire call between the first digital auxiliary device and the first called terminal A second call information request signal for requesting information converted into text form is transmitted to the service server 200 (S690).

Thereafter, the service server 200 receives a call information request signal transmitted from the calling terminal 300 .

In addition, the service server 200 receives voice information related to the calling terminal 300 (or voice information between the digital assistant 100 and the called terminal 500 related to the calling terminal 300) from among the plurality of stored voice information. Confirmation, and processing (or converting / converting) the confirmed voice information based on the information on the processing form of the voice information included in the call information request signal to send the call information in the form of voice or text to the calling terminal 300 send to In this case, when there are a plurality of voice information related to the calling terminal 300 , the service server 200 may check (or select) one or more voice information satisfying a preset condition. Here, the preset condition may include the most recent state in the order of date.

For example, the service server 200 receives the first call information request signal transmitted from the first calling terminal, and from among a plurality of voice information stored in the service server 200 , a first digital assistant related to the first calling terminal; Check the first voice information between the first called terminals, and immediately after the call connection among the first voice information identified above based on the original voice information for 3 minutes from immediately after the call connection included in the previously received first call information request signal 1-1 voice information corresponding to the original voice information for 3 minutes is extracted, and the extracted 1-1 voice information is transmitted to the first calling terminal.

As another example, the service server 200 receives the second call information request signal transmitted from the first calling terminal, and among a plurality of voice information stored in the service server 200 , the first digital assistant related to the first calling terminal The second voice information between the and the first called terminal is checked, and based on the information obtained by converting the voice information separated for each user into text form for the entire call included in the previously received second call information request signal, the previously confirmed After separating the entire second voice information for each user, a second transcript (or a transcript for each user in text format) obtained by converting the separated voice information for each user into a text form is transmitted to the first calling terminal (S700).

Thereafter, the calling terminal 300 transmits call information (or a call in voice or text format) between the digital auxiliary device 100 and the called terminal 500 transmitted from the service server 200 in response to the previously transmitted call information request signal. information) is received. Here, the call information may be all voice information recorded in the service server 200 according to the previous call information request signal, or information corresponding to some voice information among all the recorded voice information.

That is, the calling terminal 300 transmits call information in the form of voice and text information between the digital assistant 100 and the called terminal 500 transmitted from the service server 200 in response to the previously transmitted call information request signal. , receives call information in any one of the voice call information separated for each user and the text call call information separated for each user.

In addition, the calling terminal 300 outputs the received call information between the digital assistant 100 and the called terminal 500 .

As an example, the first calling terminal responds to the previously transmitted first call information request signal, and is transmitted from the service server 200, and the original voice information for 3 minutes immediately after the call connection between the first digital assistant and the first called terminal Receives the 1-1th voice information corresponding to , and outputs the received 1-1th voice information.

As another example, the first calling terminal is a voice separated for each user with respect to the entire call content between the first digital assistant and the first called terminal transmitted from the service server 200 in response to the second call information request signal transmitted earlier. A second transcript (or a transcript for each user in text format) obtained by converting information into text format is received, and a second transcript for each user in the received text format is output (S710).

The voice call service system using the digital assistant according to the embodiment of the present invention can be written as a computer program, and codes and code segments constituting the computer program can be easily inferred by a computer programmer in the art. In addition, the computer program is stored in a computer-readable information storage medium (computer readable media), and is read by a computer or a digital auxiliary device according to an embodiment of the present invention, a service server, a calling terminal, a communication company server, a called terminal, etc. It is possible to implement a voice call service system using a digital assistant device by being executed.

The information storage medium includes a magnetic recording medium, an optical recording medium, and the like. The computer program for implementing the voice call service system using the digital assistant according to the embodiment of the present invention may be stored and installed in the internal memory of the digital assistant, the service server, the calling terminal, the communication company server, the called terminal, and the like. Alternatively, an external memory such as a smart card storing and installing a computer program for implementing a voice call service system using a digital auxiliary device according to an embodiment of the present invention may be installed in a voice call service system using a digital auxiliary device through an interface. may be

As described above, the embodiment of the present invention utilizes the calling terminal when a call is connected between the digital assistant and the called terminal under the overall control of the service server, but the actual call does not go through the calling terminal, and the caller's voice command By performing a call between the digital assistant and the called terminal through the digital assistant, the caller can freely make a call with the called terminal through the digital assistant in a state where manipulation or control of the calling terminal is unnecessary, thereby increasing the convenience of use.

In addition, as described above, the embodiment of the present invention maintains the call connection between the calling terminal and the called terminal in parallel when a call is connected between the digital assistant and the called terminal by the overall control of the service server, and the service server and / Or, the communication company server uses the calling terminal's phone number as the calling number to provide an incoming notification to the called terminal. Based on the subscription information of the terminal, various services can be used even when the calling terminal is not near the user, so that the same calling terminal can be utilized as if one or more digital auxiliary devices are located.

In addition, as described above, in the embodiment of the present invention, the service server stores the call contents between the digital auxiliary device and the called terminal, and provides at least some or all of the stored call contents between the digital auxiliary device and the called terminal to the calling terminal. Accordingly, any user can easily check the contents of a conversation exchanged between the called terminals using the digital assistant using the calling terminal.

Those of ordinary skill in the art to which the present invention pertains may modify and modify the above-described contents without departing from the essential characteristics of the present invention. Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention, but to explain, and the scope of the technical spirit of the present invention is not limited by these embodiments. The protection scope of the present invention should be construed by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

The present invention performs a call between the digital auxiliary device and the called terminal through the caller's voice command, and utilizes the calling terminal when connecting a call between the digital auxiliary device and the called terminal, but prevents the actual call from going through the calling terminal, and Through the intermediary, the calling terminal makes a call to the called terminal with a preset special number, but the called terminal identifies the calling terminal's phone number as the caller, stores the call details between the digital assistant and the called terminal in the service server, and stores the stored digital assistant device By providing at least some or all of the content of the call between the and the called terminal to the calling terminal, any user can easily check the contents of the conversation exchanged between the called terminals using the digital assistant using the calling terminal. , can be widely used in the field of call, terminal field, server field, and the like.

10: voice call service system 100: digital assistant
200: service server 300: calling terminal
400: telecommunication company server 500: called terminal
310: communication unit 320: storage unit
330: display unit 340: audio output unit
350: control unit

Claims (5)

requesting, by a service server, to send a call to a calling terminal corresponding to the identification information of the digital auxiliary device based on a voice command transmitted from the digital auxiliary device, identification information of the digital auxiliary device, and a call origination request signal;
checking, by the service server, the digital auxiliary device related to a special number and caller information included in a call processing request signal transmitted from a communication company server;
checking, by the service server, the called party information based on the voice command received from the identified digital auxiliary device, and performing a call connection function with the digital auxiliary device;
requesting, by the service server, an incoming call connection with the called terminal corresponding to the called party information from the communication company server based on the confirmed called party information;
maintaining, by the service server, a communication path between the digital assistant and the called terminal established through the communication company server in response to the requested incoming call connection; and
and storing, by the service server, voice information transmitted and received between the digital auxiliary device and the called terminal as call information by matching the date information until the call between the digital auxiliary device and the called terminal is terminated,
The step of storing as the call information is,
converting the stored voice information into text information and storing;
performing a voice recognition function on the stored voice information to separate and store voice information for each user; and
and at least one of converting and storing the separately stored voice information for each user into text information for each user. ◈Claim 2 was abandoned when paying the registration fee.◈ The method of claim 1,
The step of requesting a call origination to the originating terminal comprises:
Calling a dedicated app pre-installed in the calling terminal corresponding to the identified identification information of the calling terminal; and
Comprising the process of requesting a call to the calling terminal while the dedicated app is running in the calling terminal,
When a call path is established between the digital assistant and the called terminal via the service server and the communication company server, forming, by the communication company server, another communication path between the calling terminal and the called terminal in parallel A voice call service method using a digital assistant, characterized in that it further comprises. ◈Claim 3 was abandoned when paying the registration fee.◈ 3. The method of claim 2,
and releasing, by the communication company server, a state of connection to another call between the calling terminal and the called terminal when the call between the digital assistant and the called terminal is terminated. How to use a voice call service. delete ◈Claim 5 was abandoned when paying the registration fee.◈ The method of claim 1,
When receiving the call information request signal transmitted from the calling terminal by the service server, the voice form is generated based on the information on requesting transmission of part or all of the call information included in the call information request signal and information on the processing form. The digital assistant device of claim 1, wherein the calling terminal provides call information in any one of call information, text form call information, voice call information separated for each user, and text form call information separated for each user, to the calling terminal. How to use a voice call service.

Images