KR20220081651A - System, method and authenticaion apparatus for face-to-face recording - Google Patents

Abstract

The face-to-face recording system is an authentication device that performs simultaneous presence authentication to determine whether the first user and the second user, which are the face-to-face recording targets, are in the same location at the same time, and if the simultaneous presence authentication is successful, the first user and the second user and a face-to-face recording device for receiving and recording the voice from the first user terminal and storing the recorded voice file, wherein the authentication device transmits the first user terminal location information measured by the first user terminal to the first user terminal. Receive from the first user terminal, receive second user terminal location information measured by the second user terminal from the second user terminal, compare the first user terminal location information with the second user terminal location information, When the presence authentication for determining whether the first user and the second user are present is performed, and a QR (Quick Response) code is generated in the first user terminal or the authentication device according to the request of the first user terminal Simultaneous authentication is performed to determine whether the issued authentication number matches the authentication number received from the second user terminal, and the second user terminal location information and the authentication number received from the second user terminal are, The terminal scans the QR code displayed on the screen of the first user terminal and receives it using Uniform Resource Locator (URL) information obtained.

Description

Face-to-face recording system, method, and authentication device {SYSTEM, METHOD AND AUTHENTICAION APPARATUS FOR FACE-TO-FACE RECORDING}

The present invention relates to a face-to-face recording system, a method thereof, and an authentication device.

General Agency (hereinafter, collectively referred to as 'GA') refers to an agency that does not belong to one insurance company and sells products from several insurance companies.

In the domestic insurance market in recent years, the GA channel has been used as a key insurance sales channel, with the number of GA agents rapidly increasing and GA companies becoming larger. The expansion of the influence of the GA channel is similar to the global insurance market, where the insurance market was separated before Korea, and it is expected to intensify in the future.

GA insurance agents face-to-face with clients to enter into various insurance contracts on paper. On paper, the customer's consent or signature is directly entered. In addition to paper contracts, oral contracts can be made through voice calls to establish such insurance contracts. In this case, the contract is established by recording the oral contract using the call center of the insurance company.

However, there are many difficulties for GA insurance planners to enter into a contract through currency while visiting customers in person.

In addition, since the contents of these oral contracts must be stored as a backup by the insurance company, GA insurance planners often record their smartphones, go to the office, save the recording file on a computer, and back it up to a server.

However, it is inconvenient to systematically categorize, organize, and back up the recording files of numerous management customers' contracts or incident handling, which can be a problem when sometimes calls cannot be recorded.

Practically, in the case of incomplete insurance sales through the GA channel, cancellations due to quality assurance issues accounted for 71% (4,805 cases) of the total 6,751 cases, and of these, 49% (2,340 cases) were particularly for cancellation of product description obligations. . Therefore, insurance solicitors in the field are required to take a more systematic way to establish an insurance contract without any legal problems.

In addition to the insurance contract, in the case of handling an accident after an automobile accident, it is necessary to properly grasp the contents of the automobile accident scene and back it up to the insurance company. In addition, if necessary, it is necessary to store and back up the words or calls of customers or other parties who change positions after the fact.

However, in the conventional face-to-face recording method, the recording parties gather in one place and the contents of consultation or discussion are recorded using various devices, for example, a recorder, a recording function of a smart phone, etc., and then the recorded file is transmitted to a specific system and recorded. storage and management is the main method. This face-to-face recording system has no way of proving that the planner and the customer are present at the time of face-to-face recruitment of the financial institution insurance agency, so there is a possibility of violating the law. Also, depending on the language ability of the recording parties, the evidence capability and quality level of the recording file may be affected. In particular, it may cause problems with the integrity of the recording depending on the language habits, knowledge level, language proficiency, and pronunciation ability of the recording parties. In addition, there is a risk of security, such as the loss of the recorded file because the recorded file remains on the device that performed the recording.

The problem to be solved is that the customer terminal collects the location information and authentication number of the customer terminal by using the Uniform Resource Locator (URL) information obtained by scanning the QR code displayed on the screen of the designer terminal, and the designer terminal location information A face-to-face recording system and method for performing simultaneous authentication of the customer and the designer by comparing the location information of the customer and the customer, and performing the authentication of the customer and the designer, and comparing the authentication number issued when the QR code is generated with the collected authentication number; To provide an authentication device.

According to one feature, the face-to-face recording system includes an authentication device that performs simultaneous presence authentication for determining whether a first user and a second user who are face-to-face recording targets are in the same location at the same time, and if the simultaneous presence authentication succeeds, the first and a face-to-face recording device for receiving and recording the voices of the user and the second user from the first user terminal, and storing the recorded voice file, wherein the authentication device is the first user terminal measured by the first user terminal Receive location information from the first user terminal, receive second user terminal location information measured by a second user terminal from the second user terminal, the first user terminal location information and the second user terminal location A presence authentication is performed to determine whether the first user and the second user are present by comparing information, and in response to a request from the first user terminal, the first user terminal or the authentication device performs a QR (Quick Response) ) performs simultaneous authentication to determine whether the authentication number issued when the code is generated matches the authentication number received from the second user terminal, the second user terminal location information and the authentication number received from the second user terminal , is received using Uniform Resource Locator (URL) information obtained by the second user terminal scanning a QR code displayed on the screen of the first user terminal.

The authentication device further receives a QR code token obtained by scanning the QR code from the second user terminal to further perform validation of the QR code token, and the face-to-face recording device is configured to: If both validation of the valid QR code token and authentication of the simultaneous presence are successful, the recording may be performed.

The UR information provides a screen requesting location information consent, and instructs the second user terminal to transmit the second user terminal location information to the authentication device when location information consent is selected or input on the screen may contain information.

The authentication number includes a random number randomly generated at the time the QR code is generated, is included in the QR code, and the authentication device through the QR information obtained by scanning the QR code by the second user terminal may be transmitted to the authentication device together with the UL information when connecting to .

The recorded voice file is stored in mapping with a simultaneous presence authentication value, and the simultaneous presence authentication value is a first user real name, a second user real name, a first user terminal phone number, and a second It includes a user terminal phone number, the first user terminal location information, the second user terminal location information, the authentication number and the QR code token, and the mapped recorded voice file and the simultaneous presence authentication value are the first user and It can be used as proof of simultaneous presence of the second user.

The first user terminal location information may be collected from the first user terminal when a face-to-face recording-only app installed in the first user terminal is executed or during login authentication between the first user terminal and the authentication device.

The face-to-face recording dedicated app installed in the first user terminal determines whether the first user terminal is capable of data communication with the face-to-face recording device, and if the data communication is possible, the first user and the first user using a streaming transmission method The second user's voice is transmitted to the face-to-face recording device for recording, and when the data communication is impossible, the voices of the first user and the second user are recorded and temporarily stored, and when the data communication is enabled, the voice is recorded. It can be transmitted and saved to a face-to-face recording device.

The face-to-face recording system transmits automatic voice data according to the face-to-face recording service scenario to the first user terminal through a WebRTC server connecting the first user terminal and a Web Real Time Communication (WebRTC) communication channel, and the WebRTC communication channel, and An IVR (Interactive Voice Response) server for receiving input or selected data from the first user terminal, and receiving real-time voices of the first and second users from the first user terminal through the WebRTC communication channel to record the face-to-face It may further include an IP Private Branch Exchange (PBX) output to the device.

According to another feature, as a method of operating a terminal for a face-to-face recording service, a second user terminal scans a QR (Quick Response) code displayed on a screen of a first user terminal, and uses the QR code from the QR code. Locator) obtaining information, and transmitting, by the second user terminal, the location information of the second user terminal to an authentication device accessed through the URL information, wherein the location information of the second user terminal is , is compared with the location information of the first user terminal by the authentication device and used for the presence authentication to determine whether the second user terminal and the first user terminal are in the same location, and if the presence authentication is successful, the face-to-face recording device The voices of the first and second users are recorded by the , and the recorded voice files are used as evidence of simultaneous presence of the first and second users, and the voices of the first and second users are the first It is transmitted from the user terminal to the face-to-face recording device.

In the transmitting step, the second user terminal additionally transmits an authentication number obtained from the QR code, and the authentication number is an authentication number issued by the authentication device when the QR code is generated by the authentication device. is used for simultaneous authentication of the first user terminal and the second user terminal in comparison with may be transmitted to the face-to-face recording device.

The authentication number obtained from the QR code may be acquired when the QR code is scanned and transmitted to the authentication device together with the QR information, or displayed on the QR code scan screen and inputted from the second user terminal and transmitted. have.

The location information of the second user terminal is measured by the second user terminal at the current time when the second user terminal selects to accept the location information consent request received from the authentication device accessed through the UR information. It may be location information.

According to another feature, the authentication device includes a communication device, a memory in which a program for performing simultaneous presence authentication for determining whether the first user and the second user, who are the subject of face-to-face recording, are in the same location at the same time, and a program stored in the memory A processor that executes, wherein the program receives the first user terminal location information measured by the first user terminal from the first user terminal, and the second user terminal location information measured by the second user terminal Receives from the second user terminal, compares the first user terminal location information and the second user terminal location information to perform a presence authentication for determining whether the first user and the second user are present, and Simultaneously determining whether the authentication number issued when a QR (Quick Response) code is generated by the first user terminal or the authentication device according to the request of the first user terminal matches the authentication number received from the second user terminal including instructions for performing authentication, wherein the second user terminal location information and the authentication number received from the second user terminal are QR codes displayed by the second user terminal on the screen of the first user terminal It is received using URL (Uniform Resource Locator) information obtained by scanning .

According to the embodiment, by proving that the contracting parties were present at the same time, the integrity of the contract can be secured, the violation of the product description obligation is fundamentally blocked, and the designer's responsibility can be clarified in case of a dispute with the customer.

1 illustrates a connection relationship between a face-to-face recording system and a peripheral configuration according to an embodiment.
2 shows a detailed configuration of a face-to-face recording system according to another embodiment.
3 illustrates a face-to-face recording method according to an embodiment.
4 illustrates a face-to-face recording method according to another embodiment.
5 is a hardware configuration diagram of a face-to-face recording system according to an embodiment.
6 is a hardware configuration diagram of a designer terminal and/or a customer terminal according to an embodiment.

Hereinafter, with reference to the accompanying drawings, the embodiments of the present invention will be described in detail so that those of ordinary skill in the art to which the present invention pertains can easily implement them. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part "includes" a certain element, it means that other elements may be further included, rather than excluding other elements, unless otherwise stated.

In addition, terms such as “…unit”, “…group”, “…module”, etc. described in the specification mean a unit that processes at least one function or operation, which may be implemented by hardware or software or a combination of hardware and software. can

The devices described in the present invention are composed of hardware including at least one processor, a memory device, a communication device, and the like, and a program to be executed in combination with the hardware is stored in a designated place. The hardware has the configuration and capability to implement the method of the present invention. The program includes instructions for implementing the method of operation of the present invention described with reference to the drawings, and is combined with hardware such as a processor and a memory device to execute the present invention.

As used herein, "transmission or provision" may include not only direct transmission or provision, but also transmission or provision indirectly through another device or using a detour path.

In this specification, expressions described in the singular may be construed in the singular or plural unless an explicit expression such as “a” or “single” is used.

In this specification, regardless of the drawings, the same reference numbers refer to the same components, and "and/or" includes each and every combination of one or more of the referenced components.

In this specification, terms including an ordinal number such as first, second, etc. may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present disclosure, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component.

In the embodiments described in this specification with reference to the drawings, an arbitrary embodiment may be implemented alone, various embodiments may be combined or divided, and a specific operation may not be performed in each embodiment.

Now, a face-to-face recording system and method according to an embodiment will be described with reference to the drawings.

1 illustrates a connection relationship between a face-to-face recording system and a peripheral configuration according to an embodiment.

According to an embodiment of the present invention, the face-to-face recording system may provide a mobile face-to-face recording service. The mobile face-to-face recording service starts recording after mutual simultaneous presence authentication based on QR code. Simultaneous presence authentication is based on GPS (Global Positioning System) and compares the location information of users who are the target of face-to-face recording, and based on the authentication number included in the QR code, it can be confirmed that users are recording at the same location at the same time. Of course, the positioning method is not limited to GPS and various positioning methods may be used, but the positioning subject may be user terminals.

Here, if the first user terminal requests generation of the QR code and is the subject of the face-to-face recording, the second user terminal can transmit the location information and authentication information required for simultaneous presence authentication through the QR information obtained by scanning the QR code. .

Hereinafter, the first user terminal will be described as a designer terminal, and the second user terminal will be described as a customer terminal as an example.

Referring to FIG. 1 , the face-to-face recording system 100 is connected to the designer terminal 300 and the customer terminal 400 through the communication network 200 .

The communication network 200 may be formed of a wired communication network, a mobile communication network, a wireless network, and a combination thereof. For example, the wired communication network includes an IP (Internet Protocol)-based wired network. The mobile communication network includes a 5G network, a long term evolution (LTE) network, a wideband code division multiple access (WCDMA) network, and the like. The wireless network includes various types of wireless networks such as a Wi-Fi network. However, the communication network 300 is not limited to a specific technology, since it may include all the networks developed in the future as well as the already established networks as described above.

The face-to-face recording system 100 includes an authentication device 110 , a face-to-face recording device 120 , a face-to-face recording file database 130 , a Web Real-Time Communications (WebRTC) server 140 , an Internet Protocol (IP)-Private (PBX) Branch eXchange) 150 and an interactive voice response (hereinafter referred to as 'IVR') server 160 .

The authentication device 110 performs simultaneous presence authentication to determine whether the designer and the customer, the target of face-to-face recording, are in the same location at the same time.

The authentication device 110 receives the designer terminal location information measured by the designer terminal 300 from the designer terminal 300 . The authentication device 110 receives the customer terminal location information measured by the customer terminal 400 from the customer terminal 400 . The authentication device 110 compares the designer's terminal location information and the customer's terminal location information to perform sit-in authentication to determine whether the designer and the customer are present.

According to an embodiment, the authentication device 110 transmits the current location information of the designer terminal 300 measured by the designer terminal 300 when the face-to-face recording dedicated app 301 installed in the designer terminal 300 is executed. It can be received from (300).

According to another embodiment, if the authentication device 110 succeeds in login authentication during login authentication between the designer terminal 300 and the authentication device 110 , the current location of the designer terminal 300 measured by the designer terminal 300 . Information may be received from the designer terminal 300 .

The authentication device 110 performs simultaneous authentication by determining whether the authentication number issued when a QR (Quick Response) code is generated according to the request of the designer terminal 300 matches the authentication number received from the customer terminal 400 do.

Here, the customer terminal location information and the authentication number may be received using Uniform Resource Locator (URL) information obtained by the customer terminal 400 scanning a QR code displayed on the screen of the designer terminal 300 .

Also, the QR code may be generated by the designer terminal 300 or the authentication device 110 . The QR code includes an authentication number and UR information. The authentication number is generated in the designer terminal 300 and registered in the authentication device 110 from the designer terminal 300 or is generated in the authentication device 110 and generated in the designer terminal 300 ) can be provided.

The authentication number may be a random number randomly generated at the time the QR code is generated. This authentication number is included in the QR code. The authentication number may be transmitted to the authentication device 110 together with the QR information when the customer terminal 400 accesses the authentication device 110 through the UR information obtained by scanning the QR code.

When the customer terminal 400 is connected to the customer terminal 400 by using the QR information obtained by scanning the QR code, the authentication device 110 receives the location information of the customer terminal 400 from the customer terminal 400 and the QR code. You can receive the authentication number and QR code token recorded in .

The authentication device 110 may perform both simultaneous presence authentication and validation of the QR code token, and output the result to the face-to-face recording device 120 .

Here, the QR code token is valid for a threshold time. That is, the QR code is valid for a critical time and cannot be used when the critical time expires. Even if the customer terminal 400 scans the QR code for which the threshold time has expired and obtains the UR information, the authentication device 110 cannot be accessed or the simultaneous presence authentication may fail due to the failure of validation even if simultaneous presence authentication is attempted. .

The UR information provides a screen requesting location information consent to the customer terminal 400 , and when location information consent is selected or inputted on the screen, the customer terminal 400 transmits the customer terminal location information to the authentication device 110 . It may contain information instructing to do so.

The face-to-face recording device 120 may receive and record the voices of the designer and the customer from the designer terminal 300 when the authentication device 110 succeeds in simultaneous presence authentication, and may store the recorded voice file.

In this case, the face-to-face recording device 120 may provide a text-to-speech (TTS) product voice description service during the face-to-face recording process, and the TTS product voice description service may be executed according to the request of the designer terminal 300 . . TTS product voice description service is only available online.

The face-to-face recording dedicated app 301 installed in the designer's terminal 300 determines whether the designer's terminal 300 is capable of data communication with the face-to-face recording device 120, and if data communication is possible, using the streaming transmission method, designers and customers may be transmitted to the face-to-face recording device 120 and recorded. On the other hand, when data communication is impossible, the face-to-face recording dedicated app 301 records and temporarily stores the voices of designers and customers, and when data communication becomes possible, the recorded voice is transmitted to the face-to-face recording device 120 and stored. have.

In this case, the recording file temporarily stored in the designer's terminal 300 is stored in the designer's terminal 300 so that the user of the designer's terminal 300 cannot recognize it.

The recorded voice files of the designer and the customer are mapped with the simultaneous presence authentication value generated by the authentication device 110 and stored in the face-to-face recording file database 130 . The voice file recorded by the designer and the customer may be stored in the face-to-face recording file database 130 by the face-to-face recording device 120 .

Here, the simultaneous occupancy authentication value is the customer real name received from the designer terminal 300, the designer real name, the customer terminal phone number, the designer terminal phone number, the designer terminal location information, and the customer terminal location information received from the customer terminal 400, It may include an authentication number and QR code token.

The mapped recorded voice file and simultaneous presence authentication value are used as proof of simultaneous presence between the planner and the customer at the time of insurance contract. That is, the mapped recorded voice file and the simultaneous presence authentication value can prove that the customer heard a verbal explanation about the insurance contract from the agent at the same time and at the same location.

The WebRTC (Web Real Time Communication) server 140 connects the designer terminal 300 and the WebRTC communication channel. The WebRTC server 140 outputs the designer's and customer's voice data received from the designer's terminal 300 through the communication network 200 to the IP-PBX 150 .

The WebRTC server 140 establishes a WebRTC communication channel with the designer terminal 300 . WebRTC is an API (Application Programming Interface) designed to allow web browsers to communicate with each other without the help of a plug-in, and is designed to be used for voice calls, video calls, and peer-to-peer (P2P) file sharing. The real-time voice is configured to be transmitted between the web browser (Web-browse) of the designer's terminal 300 and the WebRTC server 140, and the voice guidance can be simultaneously executed by connecting to the IVR server 160. In this case, the IVR server 160 may have a back-end TTS function.

The WebRTC server 140 establishes a WebRTC communication channel with the designer terminal 300 . In this case, the WebRTC server 140 performs a call connection procedure, a media session procedure, and the like, but since these procedures are well-known techniques, a detailed description thereof will be omitted.

The WebRTC server 140 is connected to the IVR server 160 through the IP-PBX 150 . By the way, IP-PBX 150 and IVR server 160 are optimized for PSTN. In the PSTN, a communication channel uses a Session Initiation Protocol (hereinafter, collectively referred to as 'SIP').

The IP PBX 150 may receive the voice of the designer and the customer in real time from the designer terminal 300 through the WebRTC communication channel and output the voice to the face-to-face recording device 120 .

The IP-PBX 150 is a private exchange connected to the telephone network and serves as an exchange between the external network and the internal network. In the IP-PBX 150 , additional devices such as an automatic response system (ARS), an IVR, and a video response system (VRS) can implement a function using the API of the IP PBX 150 . Therefore, the IP-PBX 150 is configured to utilize the voice real-time transmission function of WebRTC.

The IP-PBX 150 connects a communication channel between the WebRTC server 140 and the IVR server 160 . The IP-PBX 150 transfers data received from the WebRTC server 140 to the IVR server 160 , and transfers data received from the IVR server 160 to the WebRTC server 140 .

The IVR server 160 may transmit automatic voice data according to the face-to-face recording service scenario to the designer terminal 300 and receive input or selected data from the designer terminal 300 .

When the IVR server 160 is connected to the designer terminal 100 through the WebRTC server 140 and the IP-PBX 150, the IVR server 160 provides the IVR service according to the automatic guidance service program. As a telephone network terminal function, it automatically responds to calls received by the automatic answering system according to a predefined scenario, and the response result can be computerized. In connection with the dual tone multi frequency) transmission function, interworking with existing legacy voice systems can be easily implemented.

The IVR server 160 may convert contract document data corresponding to the document number received from the designer terminal 300 into TTS voice, and transmit it to the designer terminal 300 through the WebRTC server 140 .

The IVR server 160 may proceed by dividing (STEREO) the recording of the voice spoken through the TTS-IVR and the recording of the interlocutor.

The face-to-face recording device 120 may execute a face-to-face recording service based on the WebRTC protocol. Here, the face-to-face recording service is a real-time recording, and it starts driving in the designer's terminal 300 and records the voices uttered by the designer and the customer who are the service party in real time.

The face-to-face recording service is a service that records the contents of the parties meeting and consulting, and may be used, for example, in an insurance contract, accident handling, etc., but is not limited thereto.

The designer terminal 300 executes the dedicated app 301 to access the face-to-face recording system 100 through the communication network 200 . The dedicated app 301 is an app for a face-to-face recording service, and may be a smartphone application that can be downloaded and installed through an app store or the like.

The designer's terminal 300 may include a smart phone, a tablet PC, or the like. The designer terminal 300 may include a plurality of heterogeneous terminals that provide the same UX through the N screen technology.

The designer terminal 300 executes the dedicated app 301 to access the face-to-face recording system 100 and log in. If the login is successful, the execution of the face-to-face recording service is requested, and simultaneous presence authentication is performed in conjunction with the authentication device 110 .

If the simultaneous presence authentication is successful, the designer terminal 300 transmits the designer's voice and the customer's voice received through the microphone provided in the designer's terminal 300 to the face-to-face recording system 100 . The designer's voice and the customer's voice are recorded in real time by the face-to-face recording device 120 .

If the simultaneous presence authentication is successful, the designer's terminal 300 may perform a face-to-face recording and receive a TTS voice explanation service according to the designer's selection. The designer's terminal 300 may automatically transmit the voice of the designer and the customer to the face-to-face recording device 120 according to the designer's selection of an end button, and then end the face-to-face recording.

The customer terminal 400 is a wireless terminal capable of receiving text messages, positioning a location, and accessing a service Uniform Resource Locator (URL) through the communication network 200 .

The customer terminal 400 scans the QR code displayed on the screen of the designer terminal 300 to obtain the QR information from the QR code. When the customer clicks the UR link displayed on the screen of the customer terminal 400 , the customer terminal 400 may access the authentication device 110 through the UR link. In this case, the UR link may be called simultaneous occupancy authentication UR.

The customer terminal 400 transmits the location information of the customer terminal 400 to the authentication device 110 accessed through the UR information. Here, the location information of the customer terminal 400 is the customer terminal 400 at the current time when the customer terminal 400 selects to accept the location information consent request received from the authentication device 110 accessed through the UR information. This may be the measured location information.

Here, the location information of the customer terminal is compared with the location information of the designer's terminal 300 by the authentication device 110 to determine whether the customer terminal 400 and the designer's terminal 300 are in the same location Can be used for seat authentication. . Also, the customer terminal 400 may transmit the authentication number obtained when the QR code is scanned to the authentication device 110 together with the UR information. Alternatively, the customer terminal 400 may display the authentication number obtained when scanning the QR code on the scan screen of the QR code, and when the authentication number is input in the customer terminal 300 , the authentication number may be transmitted to the authentication device 110 .

According to an embodiment, the designer terminal location information and the customer terminal location information may be GPS location information measured by each of the terminals 300 and 400 .

The face-to-face recording system 100 may be implemented as shown in FIG. 2 in detail.

2 shows a detailed configuration of a face-to-face recording system according to another embodiment.

Referring to FIG. 2 , the face-to-face recording system 100 includes a demilitarized zone (DMZ) 101 and an internal network 103 . The DMZ 101 may include at least one web server 105 . The internal network 103 may include at least one IP-PBX/IVR 107 and a billing server 109. In this case, the authentication device 110 and the face-to-face recording device 120 are not included. However, these components 110 and 120 may be located in the internal network.

The web server 105 is a configuration first connected to the designer terminal 300 and the customer terminal 400 , and may include a WebRTC module 111 and a Secure File Transfer Protocol (SFTP) module 113 .

The WebRTC module 111 may be the WebRTC server 140 in FIG. 1 . The WebRTC module 111 may use an application programming interface (API) designed to allow web browsers to communicate with each other without the help of a plug-in. The WebRTC module 111 may be designed to be utilized for voice calls, video calls, peer-to-peer (P2P) file sharing, and the like. The WebRTC module 111 may receive real-time voice by interworking with the web browser of the dedicated app 301 of the designer's terminal 300 and output it to the IP-PBX/IVR 107 .

The WebRTC module 111 may be connected to the back-end TTS 119 of the IP-PBX/IVR 107 to simultaneously execute voice guidance.

The IP PBX/IVR 107 may include an IP PBX module 115 , an IVR module 117 and a TTS module 119 . The IP PBX module 115 may refer to the IP-PBX 150 of FIG. 1 .

The IP PBX module 115 is a private exchange connected to the telephone network, and may serve as an exchange with an externally connected Public Switched Telephone Network (PSTN) and an internal network, that is, the face-to-face recording device 130 and the TTS module 119. Additional devices such as ARS (Audience Response System), IVR module 117, and VRS (Video Response System) can also implement functions using the API of the IP PBX module 115, and the voice of the WebRTC module 111 is It may be configured to utilize real-time transmission capabilities.

As a telephone network terminal function, the IVR module 117 may automatically answer a telephone call received through an automatic answering system according to a predefined scenario. And since the response result can be computerized, it can be linked with the WebRTC module 111 to link with the WebRTC voice generation, control function, and DTMF (dual-tone multi-frequency) transmission function to easily implement interworking with legacy voice systems. .

The designer's terminal 300 may be connected to the WebRTC module 111 through the communication network 200 to connect a voice call using data communication. That is, the designer terminal 300 may transmit the voice through the WebRTC communication channel. In this case, the designer terminal 300 may encrypt the voice in the SFTP method and transmit it to the WebRTC module 111 . SFTP is a network protocol that provides file access, file transfer, and file management over a reliable data stream. That is, the dedicated app 301 of the designer's terminal 300 may have an SFTP transmission function, so that the designer's and customer's voices may be encrypted and transmitted using the SFTP method. The SFTP module 113 may decrypt the encrypted voice and transmit it to the face-to-face recording device 120 .

3 illustrates a face-to-face recording method according to an embodiment.

Referring to FIG. 3 , the designer terminal 300 executes the dedicated app 301 ( S101 ).

When the designer terminal 300 executes the dedicated app 301 , it may acquire location information of the designer terminal 300 according to an instruction set in the dedicated app 301 ( S103 ). The location information of the designer's terminal 300 is measured or obtained by the designer's terminal 300 .

According to an embodiment, location information of the designer's terminal 300 may be measured through a global positioning system (GPS) module built into the designer's terminal 300 . Alternatively, the location information of the designer terminal 300 may be measured using a cell ID method. In addition, it may be measured using a positioning technology implemented in the designer's terminal 300 .

The designer terminal 300 accesses the authentication device 110 through the dedicated app 301 and performs a login authentication procedure (S105). The login authentication procedure may use various well-known methods. In this case, during the access and login process, the location information of the designer's terminal 300 obtained in S103 may be transmitted from the designer's terminal 300 to the authentication device 110 .

When the login authentication is successfully completed in S105, the authentication device 110 transmits a normal login state value to the designer terminal 300 (S107).

The designer terminal 300 transmits the face-to-face recording service execution request to the authentication device 110 when there is a request for executing the face-to-face recording service according to the designer's input or selection in the UI (User Interface) of the dedicated app 301 ( S109 ).

In S109 , the designer's terminal 300 may receive product information and customer information to be recorded face-to-face and transmit it to the authentication device 110 .

In S109, the designer terminal 300 may select a face-to-face recording method. The face-to-face recording method to be selected may include at least one of a communication method and whether text-to-speech (TTS) is used.

The designer terminal 300 may additionally perform customer consent and SMS identity authentication before face-to-face recording is performed. This is a procedure in which the authentication device 110 sends a text (SMS, Short Message Service) requesting consent to the phone number of the customer terminal 400 received from the designer terminal 300 and receives customer consent information through the text. can

The authentication device 110 interworks with the dedicated app 301 to perform an authentication number generation procedure (S111) and a QR code generation procedure including an authentication number (S113). As described above, the authentication number may be generated by the random number generation algorithm of the dedicated app 301 and then shared with the authentication device 110 . Alternatively, the authentication device 110 may issue a random number generation algorithm and transmit it to the dedicated app 301 . The authentication device 110 stores such an authentication number.

The designer terminal 300 outputs the QR code screen generated in S113 (S115). In this way, the designer executes the dedicated app 301 during the process of explaining the product to be recorded face-to-face to the customer, transmits his/her location information to the authentication device 110, generates a QR code including the authentication number, and displays it on the screen. You can then present it to the customer. A subsequent operation will be described with reference to FIG. 4 .

4 illustrates a face-to-face recording method according to another embodiment.

Referring to FIG. 4 , the customer terminal 400 scans the QR code displayed on the screen of the designer's terminal 300 to obtain UR information and an authentication number (S117).

The customer terminal 400 acquires current location information of the customer terminal 400 according to an instruction included in the QR code (S119).

When the customer terminal 400 attempts to access the UR information obtained in S117, it connects to the authentication device 110 (S121).

The authentication device 110 may transmit a URL screen requesting location information consent to the customer terminal 400 (S123).

When the customer terminal 400 clicks the location information consent request UR link of S123 or the location information consent item of the UR screen is selected, the customer terminal 400 includes the location information consent information and the location of the customer terminal 400 obtained in S119 The information is transmitted to the authentication device 110 (S125).

The authentication device 110 may transmit a URL screen requesting an authentication number to the customer terminal 400 (S127). The customer terminal 400 may transmit the authentication number input by the user to the authentication device 110 (S129).

Here, when the QR code is scanned in S117 , the customer terminal 400 accesses the authentication device 110 through the UR link information, and at the same time, the authentication number may be displayed on the screen of the customer terminal 400 . This authentication number may be input by the user in S129.

Alternatively, instead of S127 and S129, the authentication number obtained in S117 may be automatically transmitted when accessing the UR information in S121.

The authentication device 110 compares the location information of the designer's terminal 300 obtained in S105 of FIG. 3 with the location information of the customer terminal 400 obtained in S125 and determines whether they match within a predefined error range. to perform (S131).

The authentication device 110 performs simultaneous authentication to determine whether the authentication number issued in S111 of FIG. 3 and the authentication number received from the customer terminal 400 match (S133). Here, the authentication number used for simultaneous authentication is issued when the designer terminal 300 requests the generation of the QR code, and the QR code is valid only within a threshold time. Accordingly, the authentication number obtained from the QR code scanned within the threshold time can determine whether the designer and the customer are present at the time when the designer terminal 300 requests to generate the QR code.

The authentication device 110 determines whether both the presence authentication of S131 and the simultaneous authentication of S133 succeed (S135). In this case, the QR code token may be transmitted together with the UR information in S121, and validation of the QR code token may be added in S135.

If at least one of the simultaneous presence authentication or validation fails, the authentication device 110 responds to the designer terminal 300 that the face-to-face recording service execution request of S109 has failed (S137).

On the other hand, if the authentication device 110 succeeds in simultaneous seat authentication and/or validation, it responds to the designer terminal 300 that the request for executing the face-to-face recording service of S109 is approved (S139).

The designer terminal 300 that has received the approval response of the face-to-face recording service execution request (S139) converts the dedicated app 301 to the recording mode, receives the designer voice and the customer voice input (S141), and sends it to the face-to-face recording device 120 Real-time streaming is transmitted (S143).

In this case, the designer terminal 300 and the face-to-face recording device 120 may connect a WebRTC-based voice call channel, and transmit the designer's voice and the customer's voice through this channel. The voice of the designer and the voice of the customer may consist of contents such as an insurance product sales process and an explanation of terms and conditions.

The face-to-face recording device 120 creates a recording file by recording the designer's voice and the customer's voice received in S143 (S145).

The face-to-face recording device 120 may receive the simultaneous presence authentication value from the authentication device 110 (S147), map the recording file generated in S145 with the simultaneous presence authentication value, and store it in the database 130 (S149). In this case, the validation value of the QR code token may be included in addition to the simultaneous presence authentication value.

The database 130 may provide a search function and a reproduction function for the recorded file stored in the database 130 .

In the above description, it has been described that the designer's terminal 300 requests the QR code generation and the customer terminal 400 shoots the QR code displayed on the screen of the designer's terminal 300 , but this may be performed in reverse. That is, the customer terminal 400 may request to generate a QR code through a dedicated app, and the designer terminal 300 may photograph the QR code displayed on the screen of the customer terminal 400 . In this case, the customer terminal 400 transmits its location information to the authentication device 110 through the dedicated app. In addition, the location information of the designer's terminal 300 may be transmitted through the QR information acquired through the QR code scan, and an authentication number included in the QR code may also be transmitted along with the location information. The subsequent simultaneous presence authentication procedure is the same as described above.

Meanwhile, FIG. 5 is a block diagram illustrating a hardware configuration of a face-to-face recording system according to an embodiment.

Referring to FIG. 5 , the face-to-face recording system 100 described with reference to FIGS. 1 to 4 and detailed configurations 110, 120, 130, 140, 150, 160, 101, 105, 107 constituting the face-to-face recording system 100 . , 109, 111, 113, 115, 117, 119, 121, 123 may be implemented as at least one computing device 500, and a computer including instructions described to execute the operation of the present disclosure. can run the program.

The computing device 500 includes a communication device 501 , a memory 503 , a storage device 505 , and at least one processor 507 connected to each other via a bus.

The communication device 501 is connected to at least one processor 507 to transmit and/or receive data through the communication network 200 . The memory 503 is connected to the at least one processor 507 and stores a program including instructions for executing the configuration and/or method according to the embodiments described with reference to FIGS. 1 to 4 . The program implements the present invention in combination with hardware such as a memory 503 and at least one processor 507 .

The storage device 505 includes information necessary for the operation of the face-to-face recording system 100 . Processor 507 implements the present invention in combination with hardware such as memory 503, storage device 505, and the like.

6 is a hardware configuration diagram of a designer's terminal and/or a customer terminal according to an embodiment, wherein the terminals 300 and 400 described in FIGS. 1 to 4 may be implemented as at least one computing device 600, A computer program including instructions described to perform the operations of the disclosure may be executed.

Referring to FIG. 6 , the computing device 600 includes a communication device 601 , a display device 603 , an input device 605 , a memory 607 , and at least one processor 609 connected to each other through a bus. .

The communication device 601 allows the memory 607 and/or the processor 609 to access the communication network 200 . The display device 603 may use a liquid crystal display (LCD) technology or a light emitting polymer display (LPD) technology, and the display device 603 may be a capacitive, resistive, or infrared touch display. The display device 603 outputs an operation result of the program executed by the processor 609 on the screen. The input device 605 is a means for receiving a user command, and may include various input devices such as a touch sensor, a keypad, a button, a mouse, a keyboard, and a pointing device.

Memory 607 may include high-speed random access memory, and may also include one or more magnetic disk storage devices, nonvolatile memory such as flash memory devices, or other nonvolatile semiconductor memory devices. The memory 607 is accessed by the processor 609 , and reading/writing/modification/deletion/update of data by the processor 609 may be performed. The memory 607 may include a ROM (not shown), a RAM (not shown), and a memory card (not shown) (eg, micro SD card, memory stick) in the processor 609 . can The memory 607 stores various programs and data necessary for the operation of the terminals 300 and 400 .

The memory 607 includes software components, which are included in the service app 301 .

At least one processor 609 may be implemented as a central processing unit (CPU, Central Processing Unit) or other chipsets, microprocessors, and the like. The processor 609 is a processor configured to perform operations of the terminals 300 and 400 and to execute instructions, and executes a program stored in the memory 607 . The processor 609 executes program instructions for implementing at least some functions of the functions of the service app 301 .

The embodiment of the present invention described above is not implemented only through the apparatus and method, and may be implemented through a program for realizing a function corresponding to the configuration of the embodiment of the present invention or a recording medium in which the program is recorded.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements by those skilled in the art using the basic concept of the present invention as defined in the following claims are also provided. is within the scope of the right.

Claims (13)

An authentication device that performs simultaneous presence authentication to determine whether the first user and the second user, who are the subject of face-to-face recording, are in the same location at the same time, and
and a face-to-face recording device for receiving and recording the voices of the first user and the second user from the first user terminal, and storing the recorded voice file, if the simultaneous presence authentication is successful;
The authentication device is
Receive first user terminal location information measured by the first user terminal from the first user terminal, and receive second user terminal location information measured by a second user terminal from the second user terminal, and Comparing the first user terminal location information and the second user terminal location information to perform a presence authentication for determining whether the first user and the second user are present,
Determining whether the authentication number issued when a QR (Quick Response) code is generated in the first user terminal or the authentication device according to the request of the first user terminal matches the authentication number received from the second user terminal Simultaneous authentication is performed,
The second user terminal location information and the authentication number received from the second user terminal,
A face-to-face recording system, wherein the second user terminal is received using Uniform Resource Locator (URL) information obtained by scanning a QR code displayed on the screen of the first user terminal. In claim 1,
The authentication device is
Further receiving a QR code token obtained by scanning the QR code from the second user terminal to further perform validation of the QR code token,
The face-to-face recording device,
If both the validation of the QR code token valid for a critical time and the authentication of the simultaneous presence are successful, the recording is performed, a face-to-face recording system. In claim 1,
The UR information is,
Providing a screen requesting location information consent, and including information instructing the second user terminal to transmit the second user terminal location information to the authentication device when location information consent is selected or input on the screen, Face-to-face recording system. In claim 3,
The authentication number is
includes a random number randomly generated at the time the QR code is generated, and is included in the QR code,
The face-to-face recording system, wherein the second user terminal is transmitted to the authentication device together with the URI information when accessing the authentication device through the QR information obtained by scanning the QR code. In claim 4,
The recorded audio file is
Simultaneous presence authentication value and mapping are stored,
The simultaneous presence authentication value is,
First user real name, second user real name, first user terminal phone number, second user terminal phone number, the first user terminal location information, the second user terminal location information, the authentication received from the first user terminal including a number and the QR code token,
The mapped recorded voice file and simultaneous presence authentication value are used as evidence of simultaneous presence of the first user and the second user, a face-to-face recording system. In claim 1,
The first user terminal location information,
A face-to-face recording system that is collected from the first user terminal when a face-to-face recording dedicated app installed in the first user terminal is executed or when login authentication is performed between the first user terminal and the authentication device. In claim 1,
The face-to-face recording-only app installed in the first user terminal,
The first user terminal determines whether data communication with the face-to-face recording device is possible, and if the data communication is possible, by using a streaming transmission method to transmit the voices of the first user and the second user to the face-to-face recording device A face-to-face recording system for recording, when the data communication is impossible, recording and temporarily storing the voices of the first user and the second user, and transmitting and storing the voices of the first user and the second user to the face-to-face recording device when the data communication becomes possible. In claim 1,
A WebRTC server connecting the first user terminal and a Web Real Time Communication (WebRTC) communication channel;
An IVR (Interactive Voice Response) server for transmitting automatic voice data according to a face-to-face recording service scenario to the first user terminal through the WebRTC communication channel and receiving input or selected data from the first user terminal, and
IP Private Branch Exchange (PBX) for receiving real-time voices of the first and second users from the first user terminal through the WebRTC communication channel and outputting them to the face-to-face recording device
Further comprising, face-to-face recording system. As a method of operating a terminal for face-to-face recording service,
A step of obtaining, by a second user terminal, a QR (Quick Response) code displayed on the screen of the first user terminal, and obtaining URL (Uniform Resource Locator) information from the QR code; and
and transmitting, by the second user terminal, the location information of the second user terminal to an authentication device accessed through the UR information,
The location information of the second user terminal is,
It is compared with the location information of the first user terminal by the authentication device and is used for seat authentication to determine whether the second user terminal and the first user terminal are in the same location,
If the presence authentication is successful, the voices of the first user and the second user are recorded by the face-to-face recording device, and the recorded voice file is used as evidence of the simultaneous presence of the first user and the second user,
The voices of the first user and the second user are
Transmitted from the first user terminal to the face-to-face recording device, the method. In claim 9,
The transmitting step is
The second user terminal additionally transmits the authentication number obtained from the QR code,
The authentication number is
When the QR code is generated by the authentication device, it is compared with the authentication number issued by the authentication device and used for simultaneous authentication of the first user terminal and the second user terminal,
When both the presence authentication and the simultaneous authentication are successful, the voices of the first user and the second user are transmitted from the first user terminal to the face-to-face recording device. In claim 10,
The authentication number obtained from the QR code is,
The method of claim 1, wherein the method is obtained when the QR code is scanned and transmitted to the authentication device together with the QR information, or is displayed on a scan screen of the QR code and inputted from the second user terminal and transmitted. In claim 11,
The location information of the second user terminal is,
When the second user terminal selects to accept the location information consent request received from the authentication device accessed through the UR information, the method is location information measured by the second user terminal at a current time. communication device,
a memory in which a program for performing simultaneous presence authentication to determine whether the first user and the second user, who are the subject of face-to-face recording, are in the same location at the same time; and
A processor for executing the program stored in the memory;
The program is
Receive first user terminal location information measured by the first user terminal from the first user terminal, and receive second user terminal location information measured by a second user terminal from the second user terminal, and Comparing the first user terminal location information and the second user terminal location information to perform a presence authentication for determining whether the first user and the second user are present,
Determining whether the authentication number issued when a QR (Quick Response) code is generated in the first user terminal or the authentication device according to the request of the first user terminal matches the authentication number received from the second user terminal Containing instructions (Instructions) for performing simultaneous authentication,
The second user terminal location information and the authentication number received from the second user terminal,
The authentication apparatus of claim 1, wherein the second user terminal is received using Uniform Resource Locator (URL) information obtained by scanning a QR code displayed on a screen of the first user terminal.

Images