TW202320008A - Interactive remote contracting and signature generating system - Google Patents

Abstract

An interactive remote contracting and signature generating system comprises a party A device, a party B device and a server. The server initiates a conference procedure based on the registrations of a party A's account and a party B's account, and performs face recognition on the face images of party B's real-time image. When the face recognition result matches a registered face information, the conference procedure is going to proceed. Additionally, the server proceeds an image analysis of the party B's real-time image and determines if the party B completes the correct operations. If affirmed, the critical images will be captured and recorded. With the provided system, the both parties are able to easily complete complex conference procedures through one online platform. This system has the functions of audio-visual analysis and biometric verification for real-time identification, so that all records of the system are authentic and reliable.

Description

Interactive remote signing system

A contracting system, especially an interactive remote contracting system.

Modern people are becoming more and more aware of buying insurance products. Because there are many types of insurance products and they involve complicated money calculations and insurance-related regulations, it is difficult for people to clearly understand the details of the insurance content, and they often seek qualified insurance brokers to assist them in purchasing . Although there are relevant insurance laws and regulations to regulate insurance companies and protect consumers, there are still incidents of insurance salesmen misappropriating premiums and persuading policyholders to borrow money to buy insurance policies, etc., which often appear on the news page, which shows that there are many problems in the current insurance policy , for example: how to complete the insurance purchase action and comply with relevant laws and regulations without being limited by spatial distance, in addition to satisfying consumers’ consumption rights that can be purchased anytime and anywhere, it also implements the requirement of zero contact during the epidemic prevention period; How to truly record that the insurance company has fulfilled its duty of notification and record the current behavior of consumers at the time of insurance application, and increase the authenticity and reliability of the process records to protect the rights of both parties; how to protect consumers' personal information from leakage and other issues.

In addition, in some contracting activities similar to the aforementioned operating procedures, such as trading, banking, and securities businesses, there is no effective solution that can provide online signatures, and the signed documents can protect the rights of both parties at the same time.

In view of the above problems, the present invention provides an interactive remote signing system, which includes a contract party A terminal device, a contract party B terminal device and a server. The device of contract party A logs in the account information of contract party A, captures the real-time audio and video of contract party A, and displays the contract party A's operation window and contract party A's window at the same time. The contract party A's operation window displays the operation specification and operation screen, and contract party A The square end window displays the real-time audio and video of the contract party B end. The device of the contract party B logs in the account information of the contract party B, captures the real-time audio and video of the contract party B, and displays the contract party B's operation window and the contract party B's window at the same time, the contract party B's operation window displays the operation screen, and the contract party B's window displays the contract party A's real-time audio and video . The server is connected to the device of contract party A and contract party B at the same time, and receives real-time audio and video from contract party A and contract party B. The server includes a conference processing unit, an image analysis unit and a storage unit.

The conference processing unit starts the conference program according to the login of the contract party A’s account data and the contract party B’s account data login, transmits the operation specification, operation screen and real-time audio and video from the contract party B’s terminal to the contract party A’s device, and transmits the operation screen and contract party A’s terminal Real-time audio and video to the contract party B's device. The image analysis unit conducts face recognition on the real-time audio and video face image of Party B of the contract. When the recognition result matches the face registration information, a face verification signal is generated and sent to the conference processing unit to continue the meeting procedure; and judge the real-time Whether the audio-visual meets the preset conditions of the corresponding operation specification, and when it is met, capture part of the real-time audio-visual image of the contract party B to generate an operation screen and send it to the conference processing unit. The storage unit stores operation specifications and preset conditions, and records and stores the entire video and audio of the meeting during the execution of meeting procedures.

The interactive remote signing system of the present invention combines online real-time video with an intuitively designed operation window, so that the contract party A and the contract party B can be on the same operating platform through the operation window of the cooperative action (that is, the operation window displayed by the contract party A) The content of the contract party B’s operation window is different from the content of the operation window of the contract party, and the two are not shared screens) to easily complete the complicated meeting procedures. If the contract party has any doubts about the content or process of the meeting, it can immediately use the operation window and real-time audio and video on this platform. Interacting with Party A of the contract is not restricted by geographical space, and can achieve the effect of zero-contact epidemic prevention. In addition, the present invention has audio-visual analysis and biometric verification functions, and can instantly verify contract party A and contract party B during the meeting, instead of simply recording images, thereby enhancing the interactive remote signing system. The authenticity and reliability of the recorded meeting images, and the electronic signature files in the signed documents completed online have also undergone multiple biometric verifications, and electronic records can be traced. Furthermore, through the electronic meeting procedure, the personal certificate of Party B can not leave the body, and Party A does not need to handle the certificate. All can be encrypted and stored in the back-end server, not the personal device of Party A, to protect the personal information security of Party B.

Specific embodiments are listed below to describe the content of the present invention in detail, and drawings are used as auxiliary descriptions. The symbols mentioned in the manual refer to the symbol description.

In addition, the connection between units or modules referred to below refers to data transmission, which can be one-way data transmission or two-way data transmission, and data transmission can be, for example, the reception or sending of messages or images , receiving or issuing instructions, etc., are not limited to the foregoing.

The data transmission mentioned above may include the use of direct electrical connection, or the use of communication protocols (Low Power Wide Area, LoRa), Bluetooth (Bluetooth), WiFi, ZigBee and other wireless communication technologies, or the use of fixed network, Coaxial cable or ADSL (Asymmetric Digital Subscriber Loop), or mobile network (3G, 4G, 5G mobile Internet) and other Internet methods for information transmission, but the above-mentioned communication methods are just examples and not limited to this.

In order to facilitate understanding, the following examples illustrate the application of the interactive remote signing system in insurance policy signing, but the interactive remote signing system of the present invention is limited to the signing of insurance policies, and it can also be applied to bank, securities, etc. for account opening Or other processes that need to sign documents, or other industries that need to sign documents, in order to achieve the purpose of remote signature.

Please refer to FIG. 1 , the interactive remote contract signing system includes a device 10 for contract party A, a device 20 for contract party B and a server 30 . The server 30 includes a conference processing unit 31 , an image analysis unit 32 and a storage unit 33 .

The device 10 of the first party of the contract includes an image capture unit 11 of the first party of the contract, a display unit 12 of the first party of the contract and an audio unit 13 of the first party of the contract. For example, the contract party's terminal device 10 can be electronic devices such as smart phones, tablet computers, notebook computers, smart watches, and personal computers. The image capture unit 11 at the contract party A's side can be a built-in lens or an external network camera of the contract party A's device 10, and the contract party A's audio unit 13 can be the built-in lens of the aforementioned device or an external speaker and microphone. Capture real-time audio and video at the contract party A's end through the contract party A's image capture unit 11 and the contract party A's audio unit 13 . The display unit 12 of the contract party A can be a display screen, a display, a display panel, etc., and its display content includes any combination of the contract party A’s real-time audio and video, the contract party A’s operation window 102, and the contract party A’s window 101. The foregoing descriptions are examples only, but are not intended to be limiting.

The contract party B's device 20 includes a contract party B's image capture unit 21 , a contract party B's display unit 22 , a contract party B's audio unit 23 and a touch input unit 24 . For example, the device 20 of Party B of the contract can be an electronic device such as a smart phone, a tablet computer, a notebook computer, a smart watch, or a personal computer. The image capture unit 21 of the contract party B can be a built-in lens of the contract party B’s device 20 or an external network camera, and the contract party B’s audio unit 23 can be a built-in lens of the contract party B’s device 20 or an external speaker and microphone. Capture through the image capture unit 21 of the contract party B and the audio unit 23 of the contract party B to capture the real-time audio and video of the contract party B. The display unit 22 of the contract party B can be a display screen, a display, a display panel, etc., and its display content includes any combination of the contract party B's real-time audio and video, the contract party B's operation window 202, and the contract party B's window 201. The touch input unit 24 can be a built-in lens of the device 20 of the contracting party, an external tablet, a touch screen capable of handwriting input, and the like. The foregoing descriptions are examples only, but are not intended to be limiting.

The device 10 of the contract party A logs in the account information of the contract party A, captures the real-time audio and video of the contract party A, and displays the contract party A operation window 102 and the contract party A terminal window 101 at the same time, and the contract party A operation window 102 displays the operation specification and operation On the screen, the window 101 of party A of the contract displays the real-time audio and video of party B of the contract. The job specification includes program name, program content, verification program operation instructions, etc., not limited to the foregoing.

Contract party A's operation window 102 may display the operation specification and the operation screen in a sequential order, first display the operation specification and then display the operation screen, or display the operation screen first and then display the operation specification. Or display the operation specification and the operation screen at the same time, as shown in Figure 4A, the operation specification of "recognition result and face verification passed" displayed on the operation window 102 of the contract party A and the part of the image captured from the real-time video and audio from the contract party B Operation screen.

The contract party B terminal device 20 logs in the contract party B’s account information, captures the contract party B’s real-time audio and video, and simultaneously displays the contract party B operation window 202 and the contract party B terminal window 201, the contract party B operation window 202 displays the operation screen, and the contract party B terminal window 201 displays the contract Party A's real-time audio and video, as shown in Figure 4B.

Here, the aspect of this embodiment is described by taking a contract party A terminal device 10 and a contract party B terminal device 20 as an example, but the present invention is not limited thereto, and can also be used for multiple contract party A terminal devices 10 and multiple contract party terminal devices 10 and multiple contract party terminal devices 20 The device 20 of Party B of the contract interacts and signs online at the same time, wherein the window 101 of Party A of the contract can simultaneously display the real-time audio and video of multiple Party B terminals of the contract, or switch between the real-time video and audio of the multiple Party B terminals of the contract (that is, contract The user of Party A's device 10 can click the button to select one of the contract party B's real-time audio and video for display), and the contract party B's window 201 can simultaneously display multiple contract party A's real-time audio and video, or in multiple contract party A's real-time audio and video. Switch among the real-time audio and video (meaning that the user of the contract party B's device 20 can click a button to select one of the contract party A's real-time audio and video for display). Please refer to FIG. 3C and FIG. 3D , in the situation where multiple contract party A terminal devices 10 and multiple contract party B terminal devices 20 are interacting online at the same time, both the contract party A terminal display unit 12 and the contract party B terminal display unit 22 will display The real-time video and audio selection button 103 at the contract party A side and the real-time video and video selection button 203 at the contract party B side are used for switching the displayed real-time video and audio. In addition, in the conference program in this embodiment, each program can have the function of switching and displaying real-time audio and video as shown in FIG. 3C and FIG. 3D , so it will not be repeated here.

However, in some specific programs, such as the insurance content confirmation statement program shown in Figure 9A and Figure 9B, the display unit 12 of the contract party A side and the contract party B side display unit 22 will display the real-time audio and video of the contract party B side that is reading the insurance content confirmation statement , and the real-time audio and video selection button 203 of the contract party B side at this time cannot provide switching and displaying other contract party B side real-time audio and video until the user who is reading the insurance content confirmation statement completes the insurance content confirmation statement program. Programs such as the document signing program shown in Figure 10A and Figure 10B also have similar designs, when one of the contract party B is executing an electronic signature, the contract party A side display unit 12 and the contract party B side display unit 22 will display that the signature is being executed The real-time audio and video at the party B side of the contract, and the real-time audio and video selection button 203 at the party B side of the contract cannot provide switching and displaying the real-time audio and video at the party B side of other contracts until the user completes the document signing procedure.

Please refer to FIG. 1 , the server 30 is connected to the device 10 of the contract party A and the device 20 of the contract party B at the same time, and receives the real-time audio and video of the contract party A and the contract party B. That is to say, the real-time video and audio from the device 10 of the contract party A and the device 20 of the party B of the contract need to be transmitted to the device of the other party through the server 30, rather than directly by the device 10 of the contract party A and the device 20 of the contract party B. The two sides are connected. In this way, there are video records of the interaction process between Party A and Party B, and the transmitted meeting signature files (such as insurance data files, insurance policy documents) are also received and stored by the back-end server 30, without going through the equipment of Party A. To avoid that without the knowledge of Party B of the contract, the meeting signature files agreed by both parties are tampered with privately and there is no record to check.

The meeting processing unit 31 starts the meeting program according to the login of the account data of the contract party A and the login of the contract party B's account data, transmits the operation specification, the operation screen and the real-time audio and video of the contract party B's end to the contract party A's end device 10, and transmits the operation screen and the contract party A's end device 10. The real-time video and audio from the party end is sent to the device 20 of the party B's end of the contract.

For example, please refer to Figure 2A and Figure 2B for the procedure for the proposer to enter the remote contracting system. The insurance broker (Party A) first logs into the interactive remote contracting system with the account information of Party A and selects the remote contracting system that needs to be signed. The interactive remote contract signing system will send the corresponding connection notification to the designated object (the proposer, that is, the contract party B) according to the operation of the device 10 of the contract party A. When the proposer is also in the interactive remote After logging in the account information of Party B of the contract in the contract signing system, and according to the content instructions displayed in the operation window 202 of Party B of the contract, after confirming and reviewing the content of the agreement and clicking the "I Agree" button, the conference processing unit 31 of the server 30 The insurance meeting program (that is, the meeting program) of encrypted video will be started, and the real-time audio and video of the contract party B will be transmitted and displayed on the device 10 of the contract party A, and the real-time audio and video of the contract party A will be transmitted and displayed on the contract party B’s device 20, And enter the next insurance meeting program: show the business registration certificate program, as shown in Figure 3A and Figure 3B, in the contract Party A operation window 102 shown in the contract Party A terminal display unit 12, it is shown that each program insurance broker needs to pay attention to confirmation The insurance details (operating specifications) and real-time images displayed on Party A’s side of the contract, for example, in Figure 3A, the insurance broker shows the real-time audio and video on Party A’s side of the contract, while the operation window 202 of Party B on the contract shows “I confirm that the recruiter has presented a valid registration "Certificate" button, the proposer will operate and click this button before proceeding to the next insurance application meeting procedure.

The image analysis unit 32 performs face recognition on the real-time audio-visual face image of the contract party B, and when the recognition result matches the face registration information, a face verification signal is generated and sent to the conference processing unit 31 to continue the conference procedure. Wherein, the face registration information can be the current face information registered by Party B when logging into the interactive remote signing system, or the face image features pre-registered in the server 30 .

In this way, the interactive remote signing system can check the face image and face displayed in the real-time audio and video of the contract party side in each program, contract party B performs any operation action in the contract party work window 202, or in a specific identity verification program. The registration information is used for face recognition to confirm the identity of the operator image currently displayed on the real-time audio and video of the contract party B, and also to ensure that the entire video recorded by the interactive remote signing system is operated by the same contract party B and passed the identity verify.

The image analysis unit 32 will also judge whether the real-time audio and video at the contract party B’s end meets the preset conditions of the corresponding operation specification, and capture part of the real-time audio and video images at the contract party B’s end to generate an operation screen and send it to the conference processing unit 31 . It also means that the operation screens displayed by contract party A's operation window 102 and contract party B's operation window 202 are different, and the operation screen displayed by contract party A's operation window 102 needs to be judged by the image analysis unit 32. When it is judged that there is a corresponding Only under the default conditions of the operation specification, part of the real-time video and audio images of the party B side of the contract will be captured to generate the above-mentioned operation screen, as shown in the operation window 102 of the contract party A in Figure 4A, the face image registered by the proposer (operation screen) must be the operation screen captured when the real-time audio and video on Party B’s side of the contract meets the preset conditions for the appearance of a face image. Another example is the certificate image (operation screen) displayed on the operation window 102 of contract party A in Figure 6A with data copy prevention warnings. screen.

For example, please refer to the applicant’s face registration procedure shown in Figure 4A and Figure 4B. Contract Party A’s operation window 102 first displays the operating specifications of Contract Party B’s face registration procedure. Display your own facial image (not shown in the figure), and the image analysis unit 32 judges whether the real-time audio and video at the party B side of the contract displays a facial image (corresponding to the preset condition of the operation specification). When this preset condition is met, the image analysis unit 32 32 will immediately capture the face image in the real-time audio and video of the contract party B as the operation screen, and the conference processing unit 31 will transmit the operation screen to the contract party A display unit 12 of the contract party A’s device 10, as shown in Figure 4A . Here, the face image captured by the image analysis unit 32 in real-time video and audio at the contract party B's side can become the face registration information for the subsequent process of face recognition, such as the real person verification process shown in Figure 7A and Figure 7B, Figure 9A And the insurance content confirmation statement procedure shown in FIG. 9B, the document signing procedure shown in FIG. 10A and FIG. 10B, etc.

In addition, the preset condition may also be to require Party B to display the specified action or expression in real time on the party B side of the contract in a specified verification program (such as a real person verification program), or to input a specified action through the touch input unit 24. Graphics, such as circles or arbitrary polygons, etc., the image analysis unit 32 will analyze these images or graphic images to determine whether they meet the preset conditions of the corresponding operation specifications, and when they meet, capture these images or graphic images as The operation screen, the conference processing unit 31 continues to execute the conference program according to the operation screen.

In some embodiments, the face registration program of the applicant can also store the facial images of multiple people as face registration data. For example, when purchasing insurance for a minor child, the insurance application process will simultaneously verify the minor child and other The identity of the legal representative, that is, when there are multiple parties to the contract, in the face registration procedure of the proposer, the face registration of the proposer and the legal representative will be performed separately, so the verification in the subsequent operating procedures The identity will require that the real-time audio and video on the second side of the contract must show the face images of the proposer and the legal representative at the same time to meet the preset conditions and pass the verification.

In addition, the content displayed on the operation window 102 of Party A of the contract includes operation specifications (instructions such as "next step", "re-shooting", "recognition result face verification passed" in Figure 4A) and operation screens (indicated in Figure 4A). The face image registered by the guarantor), that is, the display content of the contract Party A’s operation window 102 is different from the contract Party B’s operation window 202 display content. In this way, the insurance broker (Party A of the contract) can simultaneously know whether the proposer (Party B of the contract) is operating correctly through the operation window 102 of Party A of the contract, or needs to assist in the operation of the system.

The storage unit 33 stores operation specifications and preset conditions, and records and stores the entire video and audio of the insurance application meeting during the execution of meeting procedures. Among them, the whole process audio and video of the insurance application meeting includes the display content of contract party A’s operation window 102, the real-time audio and video of contract party A’s end, the display content of contract party B’s operation window 202 and contract party B’s end of real-time audio and video. In this way, the operation images and interactive video and audio of contract party A and contract party B on this interactive remote signing system can be recorded and stored throughout the process.

Further, in some embodiments, the image analysis unit 32 judges the real-time audio and video of Party B’s side of the contract based on the preset conditions including a plurality of different certificate images shot continuously, and generates an image matching signal when the preset conditions are met, One of the certificate images is selected according to the image matching signal, transmitted through the conference processing unit 31 and displayed on the operation screen. In this way, the authenticity and reliability of the document image stored in the interactive remote signing system can be further enhanced, indicating that the stored image is the document currently issued by Party B of the contract, not a pre-stored document image file. In addition, the said certificates may be but not limited to ID cards, driver's licenses, licenses, passports, health insurance cards and other certificates containing face photos, or personal certificates with anti-counterfeiting marks.

The multiple different ID images captured continuously can be the multiple different ID images obtained by changing different shooting angles within a time period (eg, 5 seconds or 10 seconds). For example, when the default condition is to shoot the certificate at different shooting angles, the image analysis unit 32 will judge the real-time audio and video of Party B, and when the preset condition is met, the certificate image will be captured as the operation screen.

In this way, the image analysis unit 32 can remove the interference of the shooting environment light source through shooting and verifying the certificate at different shooting angles, and the image analysis unit 32 can more accurately capture the certificate image that needs to be preserved and the certificate information content is clear. At the same time, Party A of the contract can assist in identifying whether the photographed certificate has an optical anti-counterfeit mark from the operation screen displayed on the operation window 102 of the contract party, and confirm the authenticity of the certificate to achieve double confirmation.

When the image of the captured certificate is clear enough, the image analysis unit 32 can more accurately read the text displayed in the captured certificate (such as ID card number, name, date of birth, certificate number, etc.) and judge Whether there is the account information of Party B in accordance with the contract, or the information of Party B in the contract contained in the signed document, which is used to judge the authenticity of the certificate. When it is judged to match, an image matching signal will be generated, and the image of the certificate will be captured and an operation screen will be generated.

Alternatively, under the preset condition of taking a plurality of different certificate images continuously, the image analysis unit 32 can start optical detection to detect the optical anti-counterfeit mark on the certificate, and once detected, an image matching signal will be generated, And capture the certificate image and generate the operation screen.

Further, the preset condition can also be that the photo part of the above-mentioned certificate image must match the face registration information, and only when the preset condition is met, the image matching signal is generated. Or set the default condition to meet the need to meet the continuous shooting of a plurality of different ID images and the photo part of the ID image conforms to the face registration information, so as to strengthen the authenticity of the ID provided by the person.

For example, please refer to the document anti-counterfeiting detection program shown in Figure 5A and Figure 5B, in which the document authenticity identification will be carried out, and the identification method can be carried out in the way of setting preset conditions as mentioned above, for example, the image analysis unit 32 can start Optical detection is a combination of detection of the optical anti-counterfeiting mark on the certificate and facial recognition on the photo on the certificate. Further, in order to avoid the program verification by just pasting anti-counterfeiting stickers on ordinary business cards, the image analysis unit 32 may also include an AI model recognition module, which uses the AI model to identify whether the certificate is a real certificate as a preset condition. Taking the ID card as an example, the AI model recognition module can collect hundreds of thousands of ID card photos for machine learning, and calculate and judge whether the detected ID card meets the requirements of a real ID card based on parameters such as the size of the ID card and the relative position of each anti-counterfeiting mark. Some image parameters. In addition, the real-time audio and video and the operation specifications of "taking pictures after 2 seconds" at the contract party B's side can also be displayed in the contract party B's operation window 202, as shown in FIG. 5B.

In addition, in this procedure, when the first certificate fails to pass the verification, the authenticity of the second certificate can be identified, and the reliability of the identity verification of the contract party can be ensured based on the information of the dual certificates of the contract party B.

In some embodiments, the meeting processing unit 31 writes the aforementioned certificate image into the warning and transmits it to the device 10 of the contract party A, and the operation screen of the contract party A's operation window 102 displays the write warning (such as preventing data copying) The warning text or the explanatory text of the limited use of the certificate) image of the certificate. In this way, Party B’s personal certificate does not need to be handed over to Party A to handle business. At the same time, Party A cannot privately copy the valid certificate image of Party B through the interactive remote signing system to increase the security of Party B’s personal information .

For example, please refer to FIG. 6A and FIG. 6B. When the image analysis unit 32 verifies that the certificate is genuine in the certificate anti-counterfeiting detection program and meets the preset conditions of the corresponding operation specification, it will capture the certificate image in the real-time video and audio of the contract party B , in addition, the operation window 102 of contract party A will also display the explanation message of "ID card verification passed", and the operation screen displayed by contract party A's operation window 102 will add a warning of "OOOO long-distance insurance application" to prevent insurance The image of a person's personal certificate is stolen, as shown in the certificate photographing procedure shown in Figure 6A.

In some embodiments, please refer back to FIG. 1, the server 30 may also include a voice recognition unit 34, and the voice recognition contract party B’s real-time audio and video voice password meets the preset voice conditions, and generates a voice verification signal when it is met , the conference processing unit 31 continues to execute the conference program according to the face verification signal and the voice verification signal, and the storage unit 33 stores the default voice condition. In this way, the interactive remote signing system can also have multiple biometric identifications, combined with images (for example, the image analysis unit 32 performs mouth shape analysis, face comparison, facial blood flow detection, or a combination thereof on the real-time audio and video of the contract party B etc.) and voice verification to confirm that the real-time audio and video captured by the contract party B terminal device 20 is indeed a real individual, not a pre-recorded image or a simple face photo, and is used to increase the insurance application meeting recorded by the interactive remote signing system The authenticity and reliability of the whole process of audio and video. Further, the aforementioned preset voice condition includes that the voice password conforms to the specified password content, the preset speech rate or a combination thereof, and a voice verification signal is generated when the preset voice condition is met.

For example, please refer to the real person verification program shown in Fig. 7A and Fig. 7B. In this program, the insurance broker (Party A of the contract) guides the proposer (Party B of the contract) according to the operation specification displayed in the operation window 102 of Party A of the contract. Make preset conditions that meet the operating specifications, such as displaying the face image of the proposer, etc., when the image analysis unit 32 judges that the preset condition is met, it will capture the face image of the proposer (real-time audio and video at the party B side of the contract) Part of the image) to generate an operation screen and send it to the conference processing unit 31. The conference processing unit 31 will add a set of randomly generated designated passwords to the received operation screen, such as a combination of numbers "4980" or a piece of text, and then send the The operation screen containing the instruction password is transferred to the operation window 102 of contract party A, as shown in FIG. 7A. Next, the image analysis unit 32 and the voice recognition unit 34 can perform image analysis and voice analysis respectively simultaneously or sequentially. When the image analysis meets preset conditions (such as mouth shape analysis, facial blood flow detection, etc.) Only when the preset speech conditions are met (such as the analysis of the specified password content, the preset speech rate, etc.), will it pass the real person verification program.

In addition, the voice recognition unit 34 recognizes whether the voice password of the real-time audio and video at Party B's side of the contract meets the preset voice conditions and can also be applied in the insurance content confirmation statement program shown in Figure 9A and Figure 9B. In this program, in addition to the image analysis unit 32 will perform face recognition, the content sent by the meeting processing unit 31 to the contract party B's operation window 202 includes a statement of insurance content that changes the text color at a fixed speed (as shown in the contract party B's operation window 202 in Figure 9B). To guide the applicant (Party B of the contract) to read out the same statement of insurance content, this fixed speed can also be used as the preset speech rate, and the speech recognition unit 34 judges whether the voice password of the real-time audio and video at Party B’s side of the contract meets the preset language. The preset voice condition of the speed, if it is judged that the preset voice speed is not met, the conference processing unit 31 will display that the voice recognition does not match on the operation screen of the contract party B's device 20, and instruct the proposer to re-record. Further, the content sent by the meeting processing unit 31 to the contract Party B’s operation window 202 may further include operation options such as controlling the size of the insurance statement and the speed of changing the color of the text, so that the applicant can set the most comfortable reading method and reading speed. Increase the user's favorability for interface operations.

In some embodiments, the operation screen can display the contract document file, and the device 20 of the contract party B writes the electronic signature file into the contract document file to generate the signed document file, and sends the signed document file to the server 30 . In this way, the server 30 will not only store the video and audio of Party B reviewing the contract document and signing the contract document, but also store the signed document file with the electronic signature file of Party B, and Party A does not need to handle the electronic signature file of Party B , to protect the personal information security of Party B of the contract.

For example, please refer to the document signing procedure shown in FIG. 10A and FIG. 10B . During the execution of the document signing procedure, the operation screen displayed on the operation window 202 of the contract party B and the operation window 102 of the contract party A includes the policy document (contract document file) and the operation instructions for their respective signatures, and the insurance broker (Party A of the contract) and the proposer (Party B of the contract) can sign asynchronously, and the operation screen displayed on the operation window 102 of Party A of the contract will sequentially display the pages that require the signature of the insurance broker , and the content displayed in the contract Party B's operation window 202 is a page that requires the signature of the insurer, so that the insurance broker and the applicant can input their own electronic signature files respectively. Further, the display content of the contract party B's operation window 202 may include an "authorized loading signature" button (as shown in the contract party B's operation window 202 as shown in Figure 10B), and the contract party B only needs to click this button, and the server 30 will perform face recognition. When the face registration information is met, the conference processing unit 31 sends a write-in signature instruction to the device 20 of the contract party B, and the device 20 of the contract party B writes the applicant's electronic signature file into the policy document accordingly. Alternatively, the conference processing unit 31 may write the electronic signature file sent by the device 20 of Party B's end of the contract into the policy document file according to the face verification signal.

The electronic signature file can be in various forms including signature data signed by the user, please refer to FIG. 11A to FIG. 11C . For example, the electronic signature file may be a face signature file as shown in FIG. 11A , which includes a face image captured through face verification at the moment of user signature, and signature data. For example, the server 30 can send an authorization code or an electronic certificate to the user's mobile phone (such as the contract party's device 20) in advance. After the user finishes signing the document on the mobile phone, the server 30 can immediately It can confirm that the signed document files received have been authenticated, and also ensure that the user's personal information, such as signature files, facial features, and biometrics, are stored in the user's personal device, and such personal information will not be leaked to other units To increase the security of personal information. Alternatively, the image analysis unit 32 performs face recognition on the real-time image of the contract party B, and when the recognition is consistent, the server 30 sends a face verification signal to the contract party B's device 20, and the contract party B's device 20 will have a human face accordingly. The electronic signature file of the image is written into the contract document file to generate a signed document file, and the signed document file is sent to the server 30 . In addition, the processing unit (not shown in the figure) of the server 30 can also write the face signature file generated by combining the signature data received from the contract party B's device 20 with the face image into the contract document file according to the face verification signal. Generate a signed document archive. The processing unit of the server 30 is connected to the conference processing unit 31 , the image analysis unit 32 and the storage unit 33 .

Further, the electronic signature file may further include a biometric image, such as the face signature file shown in Figure 11B, and the biometrics captured by the user's device (such as the device 20 of Party B's end of the contract) may be but not limited to Fingerprint, finger vein pattern, iris, voiceprint, etc., and this biometric identification can be performed by a device authenticated by the server 30 for biometric comparison. The server 30 can confirm that it is from the contract party B’s device through the authorization code or electronic certificate. A file of 20 signed documents is authenticated. Either by the biological feature comparison unit (not shown) of the server 30 or by the image analysis unit 32 and/or voice recognition unit 34 to analyze and compare whether the biological feature information captured by the device 20 of the second party in the contract conforms to When face registration information is matched, a biometric image is captured. The biometric comparison unit of the server 30 is connected to the conference processing unit 31 , the image analysis unit 32 , the speech recognition unit 34 and the storage unit 33 . Then, the processing unit of the server 30 writes the electronic signature file generated by combining the face image and the biometric image with the signature data transmitted by the contract party B’s device 20 into the contract document according to the biometric verification signal and the face verification signal file. Or the server 30 sends the biometric verification signal and the face verification signal to the device 20 of the second party in the contract, and the device 20 of the second party in the contract writes the electronic signature file with the face image and biometric image into the contract document file accordingly. Sign the document file, and send the signed document file to the server 30.

In addition, the electronic signature file may further include a real-time image of the witness, as shown in FIG. 11C . The real-time image of the witness mentioned above is the current image of the person who witnessed the user executing the electronic signature. For example, in the document signing process in Figure 10B, the insurance broker (Party A of the contract) witnesses the proposer (Party B of the contract) through the real-time image screen Executing the electronic signature, at this time, the image analysis unit 32 of the server 30 will capture the face image displayed by the real-time audio and video at the party A's side of the contract to generate a real-time witness image. The real-time image of the witness can be sent to the device 20 of the second party in the contract that has been authenticated by the server 30 , and the signed document file is generated by the device 20 of the second party in the contract and sent to the server 30 . Or the server 30 writes the electronic signature file with the real-time image of the witness into the signed document file to generate the signed document file.

Furthermore, each image (such as signature data, face image, biometric image, witness real-time image, etc.) contained in the aforementioned electronic signature file can add a set of hash data calculated according to the hash algorithm, such as The face signature file shown in Fig. 11C. For example, the hash data unit (not shown) in the server 30 uses a hash algorithm to generate a hash code (Hashcode) with at least 8-bit hexadecimal strength. The hash data unit of the server 30 is connected to the conference processing unit 31 , the image analysis unit 32 , the voice recognition unit 34 , the storage unit 33 and the biometric comparison unit. In this way, in order for a third-party unit to verify the authenticity of the face signature file on this signed document file in the future, the hash data contained in the face signature file can be used to compare the identity verification image records of the user's signature process. The hash data obtained by verifying the image is consistent with the hash data of the face signature file, and it can be verified that the face signature file is currently signed by the identity verification image record.

In addition, in the document signing process, when the device 20 of Party B of the contract requires multiple signatures, for example, when the proposer is a minor, the signed document also needs to have the signature of the legal representative, and the face recognition performed by the server 30 The face registration data containing the proposer and the legal representative will be used as the basis for comparison. When the face images of the real-time audio and video on the party B side of the contract have both the face images of the proposer and the legal representative (as shown in Figure 10C As shown in Figure 10D), it meets the face recognition comparison, and then writes the face signature file of the insured person into the policy document (contract document file), so as to meet the requirement that the signature of a minor requires the presence of a legal representative, Second, this electronic signature has been authenticated and has an image record to strengthen the authenticity of the signed document.

Further, in some embodiments, the page where Party B completes the signature will be immediately updated to the contract file file displayed on Party A's work window 102, so that Party A can keep track of Party B's signature status at any time, and timely Inform the contract contents of the necessary precautions. Then, the storage unit 33 of the server 30 will store the signed document file with the signature of Party A and the signature of Party B.

In addition, in some embodiments, the storage unit 33 stores a plurality of contract document information, and a contract document file is generated according to an editing operation input by the contract party terminal device 10 on one of the contract document information. In this way, Party A of the contract can discuss the details of the contract with Party B of the contract, and adjust the content and conditions of the contract on the interactive remote signing system according to the discussion content. Basic information, etc., and store the documents in the system, so that the policy information can be digitized and there is a clear record of query modification process.

In addition, in some embodiments, the operation window 102 of contract party A and the operation window 202 of contract party B each include a description window 100, and the conference processing unit 31 transmits the program name according to the conference program and displays it in the description window 100 after starting the conference program. , For example, the description window 100 in FIGS. 7A and 7B displays the program name of "Real Person Verification", and the description window 100 in FIGS. 10A and 10B displays the program name of "Document Signing", etc. In this way, Party B of the contract can clearly understand the current implementation procedures during the insurance application process. Once there is any doubt, it can fully communicate with Party A through online video in real time, so as to protect the rights of Party B and avoid misunderstandings and disputes in the future.

In addition, in some embodiments, please refer back to FIG. 1, the encryption unit 35 of the server 30 can encrypt the signed document file according to a set condition to restrict the signing of the signed document file confirmed by the pre-delivery confirmation program. Access to files. Setting conditions can include but not limited to conditions such as restricting printing (cannot print or enter a password to print), restrict copying (cannot copy or enter a password to copy), read password, etc., to restrict access to signed documents and files Use permissions to increase the confidentiality or confidentiality of files. In addition, the content on the signed document cannot be tampered with and the signature cannot be copied and stolen by others, so as to ensure the rights and interests of users.

The meeting program may be, but not limited to, an insurance application meeting program, which includes the following steps S101-S112.

Step S101: Enter the system program.

For example, please refer to the program of the proposer entering the remote insurance application system shown in Figure 2A and Figure 2B. When both the insurance broker (Party A of the contract) and the proposer (Party B of the contract) log in to the interactive remote signing system, The video screens of both parties need to wait for the proposer to follow the instructions displayed in the operation window 202 of Party B of the contract. After the proposer confirms the content of the review agreement and clicks the "I Agree" button, the conference processing unit 31 of the server 30 will not be activated. Encrypted video insurance meeting procedures, open the video screen of both parties.

Step S102: confirm the salesperson program.

For example, in the procedure of presenting the business registration certificate shown in Fig. 3A and Fig. 3B, the operation window 102 of Party A of the contract will display the operation specifications that need to be executed in this procedure, for example, asking the insurer to confirm whether the insurance broker has truthfully presented the insurance broker certificate , and the meeting processing unit 31 will display the button "I confirm that the recruiter has shown a valid registration certificate" in the contract Party B's operation window 202, and the next insurance application meeting procedure will be continued after the proposer clicks this button.

Step S103: facial forensics procedure.

Please refer to the applicant’s face registration procedure shown in Figure 4A and Figure 4B. Contract Party A’s operation window 102 first displays the operation specification of the applicant’s face registration program, and the applicant is requested to display his or her own video and video in real time on the contract Party B’s side. Facial image, the image analysis unit 32 judges whether there is a facial image displayed in the real-time audio and video on the contract party B’s side (corresponding to the default condition of the operation specification), and when the preset condition is met, the image analysis unit 32 will capture the real-time video of the contract party B’s side. The facial image in the audio and video is used as the operation screen, and the conference processing unit 31 transmits the operation screen to the device 10 of the first party of the contract, and the display unit 12 of the first party of the contract displays the screen as shown in FIG. 4A . Here, the face image captured by the image analysis unit 32 at the contract party's side in real time can be used as face registration information for face recognition in subsequent procedures. In addition, in this program, facial images of multiple people can also be set to be stored as face registration data, as mentioned in the relevant paragraphs above, and will not be repeated here. Since each execution program has gone through a process of comparison and verification with the face data registered by the applicant's face registration program, it can also be explained that the video and audio content of the insurance application this time is operated by the same applicant.

Step S104: document anti-counterfeiting detection program.

For example, the certificate anti-counterfeiting detection program shown in Figure 5A and Figure 5B, in this program, the identification of the authenticity of the document will be carried out, and the identification method can be carried out in the way of setting preset conditions as described above, for example, the image analysis unit 32 can judge the real-time audio and video of the contract party Is there a preset condition for ID images taken from different angles, so as to avoid the interference of ambient light sources? Choose the clearest ID image for ID information analysis, whether it conforms to the contract Party B's account information and face recognition on the photo on the ID Furthermore, it is also possible to use optical anti-counterfeiting marks to detect or combine AI models to judge whether the detected documents meet the image parameters that real ID cards should have.

Step S105: Complete the certificate image capture procedure.

After completing the document authenticity detection and judging that it meets the real document image requirements, the document photographing procedure shown in Figure 6A and Figure 6B is carried out, and the conference processing unit 31 will write a warning to the captured document image to prevent malicious persons Copy documents.

Step S106: a living body identification program.

Please refer to the real person verification program shown in Figure 7A and Figure 7B, the image analysis unit 32 will first perform face recognition on the face image of the real-time audio and video of the contract party B, and when the recognition result matches the face registration information, the conference processing unit 31 will continue to execute Insure meeting procedures. The operation specification displayed on the operation window 102 of Party A of the contract allows the insurance broker to guide the proposer to make preset conditions that meet the operation specification, such as displaying the face image of the proposer, etc., and the image analysis unit 32 judges that the preset condition is met , the face image of the proposer (a part of the real-time audio-visual image at the contract party B’s end) will be captured to generate an operation screen and sent to the conference processing unit 31, and the conference processing unit 31 will receive the face image of the proposer (Operation screen) plus a set of randomly generated designated passwords, such as the combination of numbers "4980" or a piece of text, and then send the operation screen containing the command password to the contract Party A's operation window 102, as shown in Figure 7A. Next, the image analysis unit 32 and the voice recognition unit 34 perform image analysis and voice analysis, as described in the previous section, which will not be repeated here.

Step S107: A procedure for reviewing the content of the application for guarantee.

For example, please refer to the document review process shown in Figure 8A and Figure 8B. In this program, it can first verify whether the real-time audio and video face image of Party B on the contract is the proposer who matches the face registration information. After identification, the conference processing unit 31 will display the proposer's proposal file in the operation window 202 of the contract party B to maintain the confidentiality of the file. Further, the display content of the contract party B's operation window 202 may include buttons to control the page up and down of the document page (as shown in Figure 8B), and the proposer can control the display of the contract party B's operation window 202 by clicking the button to control the page up and down According to the content of the proposed document, the server 30 correspondingly adjusts the content of the required document displayed on the operation window 102 of the contract party A according to the operation input by the proposer on the device 20 of the contract party B, so that when the proposer has any questions about the required document , the insurance broker can simultaneously and accurately understand the doubts of the proposer, and give corresponding explanations and explanations.

Step S108: Procedure for confirming and declaring insurance content.

Please refer to the procedure for confirming and declaring the insurance content shown in Figure 9A and Figure 9B, after the image analysis unit 32 performs face recognition, the display content sent by the conference processing unit 31 to the device 20 of the contracting party includes text color at a fixed speed The changed insurance content statement, the text color change speed is consistent with the preset speech rate, and the speech recognition unit 34 will analyze whether the voice password of the real-time audio and video at the contract party B’s end meets the preset speech rate for speech recognition (that is, the preset speech condition) . In this program, when the image analysis meets the preset conditions (including but not limited to mouth shape analysis, facial blood flow detection, etc.) and the voice analysis also meets the preset voice conditions (including but not limited to specified password content analysis, preset Speech rate, etc.), it is considered that the insurance content confirmation statement procedure is completed and the next procedure is continued.

Step S109: Asynchronous signature and authorization loading program.

Please refer to the document signing procedure shown in Fig. 10A and Fig. 10B, the operation screen displayed by contract party B's operation window 202 and contract party A's operation window 102 includes policy document files and operation instructions for their respective electronic signatures, and insurance brokers and proposers Asynchronous signature is possible, and the operation screen displayed by Party A's operation window 102 of the contract will sequentially display the pages that require the signature of the insurance broker, while the content displayed on the operation window 202 of Party B of the contract is the pages that require the signature of the guarantor. In this way, the insurance broker The person and the proposer can respectively input their own signature information, and the page where the proposer has signed can also be updated to the operation screen displayed in the operation window 102 of the contract party A in real time. Furthermore, the display content of the contract party B's operation window 202 may include an "authorized loading signature" button (as shown in the contract party B's operation window 202 shown in Figure 10B), and the proposer only needs to click this button, and the server 30 will perform face recognition , when the face registration information is met, the device 20 of Party B of the contract writes the face signature file of the proposer into the policy document file. In addition, in this program, according to the content requirements of the policy, the facial images of multiple people can be verified and written into the facial signature file, as mentioned in the previous relevant paragraphs, and will not be repeated here.

Step S110: Confirm the procedure before sending the item.

Please refer to the pre-delivery confirmation process shown in Figure 12A and Figure 12B, when the policy document file has completed the document signing process, the server 30 will store the signed document file, and in the process shown in Figure 12A and Figure 12B, The signed document file is displayed in the contract Party A operation window 102 and the contract Party B operation window 202 respectively, and the content of the signed document displayed in the contract Party A operation window 102 will also correspond to the proposer's operation on the signed document page. In this way, through the final inspection by both the insurance broker and the proposer, and recording the video and audio of the correctness of the content agreed by the proposer. In some embodiments, as shown in FIG. 12C , the display unit 22 of the contract party B can also simultaneously display the real-time audio and video of the contract party A and the real-time video of the contract party B.

Step S111: Procedure for filling in payment information.

Please refer to the payment information filling procedure shown in Figure 13A and Figure 13B, when both the insurance broker and the proposer have no doubt about the content of the signed document file, the meeting processing unit 31 will send the displayed content of the payment information filling column to the contract Party B's operation window 202, and the operation screen of "filling in the payment information" is sent to the contract Party A's operation window 102. In this way, insurance brokers do not handle bank or credit card information with high personal privacy, protecting personal information from leakage, and protecting the rights and interests of proposers.

Step S112: The OTP procedure is completed after applying for insurance.

Please refer to the OTP confirmation procedure for long-distance insurance application shown in Figure 14A and Figure 14B. According to the relevant laws and regulations of long-distance insurance, long-distance insurance needs to send a one-time password (OTP) to the applicant for identity verification, and the conference processing unit 31 will only Send the display content of the field that needs to enter the SMS password to the operation window 202 of Party B of the contract, and send the operation specification of "OTP sending and filling" to the operation window 102 of Party A of the contract, so as to isolate the insurance broker from obtaining too many relevant applicants More personal personal information.

To sum up, the interactive remote signing system of the present invention combines online real-time video with an intuitively designed operation window, so that contract party A and contract party B can operate on the same operating platform through the collaborative operation window (that is, contract A The content displayed in the operation window of Party B is different from that of the operation window of Party B of the contract, and the two are not shared screens) to easily complete the complicated meeting procedures. If Party B has any doubts about the content or process of the meeting, he can immediately use the operation window and Real-time audio and video interacts with contracting party A on this platform, which is not restricted by geographical space and can achieve the effect of zero-contact epidemic prevention. In addition, the present invention has audio-visual analysis and biometric verification functions, and can instantly verify contract party A and contract party B during the meeting, instead of simply recording images, thereby enhancing the interactive remote signing system. The authenticity and reliability of the recorded meeting images, and the electronic signature files in the signed documents completed online have also undergone multiple biometric verifications, and electronic records can be traced. Furthermore, through the electronic meeting procedure, the personal certificate of Party B can not leave the body, and Party A does not need to handle the certificate. All can be encrypted and stored in the back-end server, not the personal device of Party A, to protect the personal information security of Party B.

Although the technical content of the present invention has been disclosed above with preferred embodiments, it is not intended to limit the present invention. Any modification and modification made by those skilled in the art without departing from the spirit of the present invention should be covered by the present invention. Therefore, the scope of protection of the present invention should be defined by the scope of the appended patent application.

10: contract party A terminal device 11: contract party A terminal image capture unit 12: contract party A terminal display unit 13: contract party A terminal audio unit 100: instruction window 101: contract party A terminal window 102: contract party A operation Window 103: real-time audio and video selection button at contract party A's side 20: contract party B's device 21: contract party B's image capture unit 22: contract party B's display unit 23: contract party B's audio unit 24: touch input unit 201: contract Party B terminal window 202: contract party B operation window 203: contract party B terminal real-time audio and video selection button 30: server 31: conference processing unit 32: image analysis unit 33: storage unit 34: speech recognition unit 35: encryption unit

[Fig. 1] is a block diagram of an interactive remote signing system according to an embodiment of the present invention. [FIG. 2A] It is a schematic diagram of the program of contract party B entering the remote signing system displayed on the display unit of contract party A's terminal according to an embodiment of the present invention. [FIG. 2B] It is a schematic diagram of the procedure for entering the remote signing system displayed by the contract party B's terminal display unit according to an embodiment of the present invention. [Fig. 3A] is a schematic diagram of the procedure for presenting the business registration certificate displayed on the display unit of the party A of the contract according to an embodiment of the present invention. [Fig. 3B] is a schematic diagram of the procedure for presenting the business registration certificate displayed on the display unit of the party B's side of the contract according to an embodiment of the present invention. [Fig. 3C] is a schematic diagram of the procedure for presenting the business registration certificate displayed on the display unit of the party A of the contract according to an embodiment of the present invention. [Fig. 3D] is a schematic diagram of the procedure for presenting the business registration certificate displayed on the display unit of the party B's side of the contract according to an embodiment of the present invention. [Fig. 4A] is a schematic diagram of the face registration procedure of the contract party B displayed on the display unit of the contract party A's side according to an embodiment of the present invention. [Fig. 4B] is a schematic diagram of the face registration procedure of the contract party B displayed on the display unit of the contract party B side according to an embodiment of the present invention. [FIG. 5A] It is a schematic diagram of the certificate anti-counterfeiting detection procedure displayed on the display unit of the party A of the contract according to an embodiment of the present invention. [FIG. 5B] It is a schematic diagram of the anti-counterfeiting detection procedure of the certificate displayed on the display unit of the party B of the contract according to an embodiment of the present invention. [FIG. 6A] It is a schematic diagram of the document photographing procedure displayed on the display unit of the party A of the contract according to an embodiment of the present invention. [Fig. 6B] It is a schematic diagram of the document photographing procedure displayed on the display unit of the party B's side of the contract according to an embodiment of the present invention. [FIG. 7A] It is a schematic diagram of the real person verification procedure displayed on the display unit of the party A of the contract according to an embodiment of the present invention. [FIG. 7B] It is a schematic diagram of the real person verification procedure displayed on the display unit of the party B of the contract according to an embodiment of the present invention. [FIG. 8A] It is a schematic diagram of the review process of the document for protection displayed on the display unit of the party A of the contract according to an embodiment of the present invention. [FIG. 8B] It is a schematic diagram of the review process of the document for protection displayed on the display unit of the party B of the contract according to an embodiment of the present invention. [FIG. 9A] It is a schematic diagram of the procedure for confirming and declaring the insurance content displayed on the display unit of the party A of the contract according to an embodiment of the present invention. [FIG. 9B] It is a schematic diagram of the procedure for confirming and declaring the insurance content displayed on the display unit of the party B's side of the contract according to an embodiment of the present invention. [FIG. 10A] It is a schematic diagram of the document signing procedure displayed on the display unit of the party A of the contract according to an embodiment of the present invention (1). [Fig. 10B] is a schematic diagram of the document signing procedure (1) displayed on the display unit of the party B side of the contract according to an embodiment of the present invention. [FIG. 10C] is a schematic diagram (2) of the document signing procedure displayed on the display unit of Party A of the contract according to an embodiment of the present invention. [FIG. 10D] is a schematic diagram (2) of the document signing procedure displayed on the display unit of the party B side of the contract according to an embodiment of the present invention. [FIG. 11A] is a schematic diagram (1) of an electronic signature file according to an embodiment of the present invention. [Fig. 11B] is a schematic diagram (2) of an electronic signature file according to an embodiment of the present invention. [Fig. 11C] is a schematic diagram (3) of an electronic signature file according to an embodiment of the present invention. [FIG. 12A] It is a schematic diagram of the pre-delivery confirmation procedure displayed on the display unit of the party A of the contract according to an embodiment of the present invention. [Fig. 12B] is a schematic diagram of the pre-delivery confirmation procedure displayed on the display unit of the party B of the contract according to an embodiment of the present invention (1). [Fig. 12C] is a schematic diagram (2) of the pre-delivery confirmation procedure displayed on the display unit of the party B's side of the contract according to an embodiment of the present invention. [FIG. 13A] It is a schematic diagram of the procedure for filling in the payment information displayed on the display unit of the party A of the contract according to an embodiment of the present invention. [FIG. 13B] It is a schematic diagram of the procedure for filling in the payment information displayed on the display unit of the party B of the contract according to an embodiment of the present invention. [FIG. 14A] It is a schematic diagram of the remote insurance OTP confirmation procedure displayed on the display unit of the party A of the contract according to an embodiment of the present invention. [FIG. 14B] It is a schematic diagram of the remote insurance OTP confirmation procedure displayed on the display unit of the contract party B's end according to an embodiment of the present invention.

10: Party A's device in the contract

11: The image capture unit of contract party A

12: The display unit of Party A of the contract

13:Contract party A terminal audio unit

20: Party B's device in the contract

21: Contract party B end image capture unit

22: The display unit of Party B of the contract

23: Contract party B terminal audio unit

24: Touch input unit

30:Server

31: Conference processing unit

32: Image analysis unit

33: storage unit

34:Speech recognition unit

35: encryption unit

Claims (12)

An interactive remote contracting system, including: A contract party A’s terminal device logs in a contract party A’s account information, captures a contract party A’s real-time audio and video, and simultaneously displays a contract party A’s operation window and a contract party A’s terminal window. The contract party A’s operation window displays a Operating specifications and an operation screen, the window of Party A of the contract displays a real-time audio and video of Party B of the contract; A contract party B’s terminal device logs in a contract party B’s account information, captures the contract party B’s real-time audio and video, and simultaneously displays a contract party B’s operation window and a contract party B’s terminal window, the contract party B’s operation window displays the operation screen, and the contract party B’s The terminal window displays the real-time audio and video of Party A of the contract; and A server is connected to the device of Party A of the contract and the device of Party B of the contract at the same time, and receives the real-time audio and video of Party A of the contract and the real-time audio and video of Party B of the contract. The server includes: A meeting processing unit starts a meeting procedure according to the login of the account information of Party A of the contract and the login of the account information of Party B of the contract, and transmits the operation specification, the operation screen and the real-time audio and video of Party B of the contract to the device of Party A of the contract , to transmit the operation screen and the real-time video and audio from Party A’s end of the contract to the device of Party B’s end of the contract; An image analysis unit, which performs face recognition on one of the real-time audio-visual face images of Party B of the contract. When the recognition result matches a face registration information, a face verification signal is generated and sent to the conference processing unit to continue the conference program, and Judging whether the real-time video at Party B's side of the contract meets a preset condition corresponding to the operation specification, and captures part of the real-time video at Party B's side of the contract to generate the operation screen and send it to the conference processing unit; and A storage unit stores the operation specification and the default condition, and records and stores the entire video and audio of the insurance application meeting during the execution of the meeting procedure. The interactive remote signing system as described in claim 1, wherein the operation screen displays a contract document file, and the contract party B’s device writes an electronic signature file into the contract document file to generate a signed document file, and transmits the Sign the document file to this server. The interactive remote signing system as described in claim 2, wherein the device of Party B of the contract writes the electronic signature file into the contract document file according to the face verification signal to generate the signed document file, and transmits the signed document file to that server. The interactive remote signing system as described in claim 2, wherein the storage unit stores multiple contract document information, and the contract document is generated according to the editing operation input by the terminal device of the contract party A on one of the contract document information file. The interactive remote signing system as described in Claim 2, wherein the server further includes an encryption unit, which encrypts the signed document file according to a set condition and restricts access to the signed document file. The interactive remote signing system as described in claim item 1, wherein the preset condition is a plurality of different certificate images taken continuously, and an image matching signal is generated when the preset condition is met, and one of them is selected according to the image matching signal The certificate image is transmitted through the conference processing unit and displayed on the operation screen. The interactive remote signing system as described in claim 6, wherein the conference processing unit writes the certificate image into a warning and sends it to the contract party A’s device, and the operation screen display of the contract party A’s operation window is written The image of the certificate of the warning. The interactive remote signing system as described in claim 6, wherein the default condition is that the photo part of the certificate image must match the face registration information, and the image conformity signal is generated when the preset condition is met. The interactive remote signing system as described in claim 1, wherein the server further includes a voice recognition unit to identify whether a voice password of the real-time audio and video of the party B side of the contract meets a preset voice condition, and generates a voice when it is met The voice verification signal, the conference processing unit continues to execute the conference program according to the face verification signal and the voice verification signal, and the storage unit stores the default voice condition. The interactive remote signing system as described in Claim 9, wherein the preset voice condition is that the voice password matches a specified password content, and the voice verification signal is generated when the voice password is met. The interactive remote signing system as described in Claim 9, wherein the preset voice condition is that the voice password meets a preset speech rate, and the voice verification signal is generated when the voice password meets a preset speech rate. The interactive remote signing system as described in claim item 1, wherein the operation window of Party A of the contract and the operation window of Party B of the contract each include a description window, and the conference processing unit sends a message according to the conference program after starting the conference program The program name is displayed in the help window.

Images