CN113034110A - Service processing method, system, medium and electronic device based on video audit - Google Patents

Service processing method, system, medium and electronic device based on video audit Download PDF

Info

Publication number
CN113034110A
CN113034110A CN202110338656.4A CN202110338656A CN113034110A CN 113034110 A CN113034110 A CN 113034110A CN 202110338656 A CN202110338656 A CN 202110338656A CN 113034110 A CN113034110 A CN 113034110A
Authority
CN
China
Prior art keywords
video
terminal
service
information
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110338656.4A
Other languages
Chinese (zh)
Other versions
CN113034110B (en
Inventor
李善婷
石春波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Taikang Insurance Group Co Ltd
Original Assignee
Taikang Insurance Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Taikang Insurance Group Co Ltd filed Critical Taikang Insurance Group Co Ltd
Priority to CN202110338656.4A priority Critical patent/CN113034110B/en
Publication of CN113034110A publication Critical patent/CN113034110A/en
Application granted granted Critical
Publication of CN113034110B publication Critical patent/CN113034110B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • G06Q10/103Workflow collaboration or project management

Landscapes

  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Strategic Management (AREA)
  • Engineering & Computer Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Operations Research (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Data Mining & Analysis (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The disclosure provides a service processing method, a system, a storage medium and electronic equipment based on video audit, and relates to the technical field of computers. The service processing method comprises the following steps: receiving request information of a service to be processed, which is sent by a first terminal, wherein the request information comprises a ready user list, and the ready user list comprises at least two ready users; when the video auditing requirement of the service to be processed is judged to be met according to the ready user list, establishing video connection with at least one terminal, and receiving a video sent by the at least one terminal, wherein the at least one terminal comprises the first terminal; identifying user identity information in the video; and when the user identity information passes verification, starting a transaction process of the service to be processed. The utility model provides an online implementation scheme of handling to many people's business has improved business processing efficiency and security.

Description

Service processing method, system, medium and electronic device based on video audit
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a service processing method based on video auditing, a service processing system based on video auditing, a computer-readable storage medium, and an electronic device.
Background
With the development of the internet and the popularization of terminals such as smart phones, many services are transferred from off-line processing to on-line processing, for example, in the past, a user needs to go to an insurance company and a bank counter to process insurance and finance related services, most of the services can be processed through a mobile phone App (Application program), and the mobile phone App is very convenient and fast. However, for an organization responsible for business processing, there is a certain security risk in online business, for example, it is difficult to ensure the identity and intention of a user to be true and valid, so that a situation of business fraud cannot be discriminated, and loss is easily caused to the organization or the user himself.
Disclosure of Invention
The present disclosure provides a service processing method based on video audit, a service processing system based on video audit, a computer readable storage medium and an electronic device, thereby improving the security of service handling at least to a certain extent.
According to a first aspect of the present disclosure, a service processing method based on video auditing is provided, which includes: receiving request information of a service to be processed, which is sent by a first terminal, wherein the request information comprises a ready user list, and the ready user list comprises at least two ready users; when the video auditing requirement of the service to be processed is judged to be met according to the ready user list, establishing video connection with at least one terminal, and receiving a video sent by the at least one terminal, wherein the at least one terminal comprises the first terminal; identifying user identity information in the video; and when the user identity information passes verification, starting a transaction process of the service to be processed.
Optionally, the establishing a video connection with at least one terminal includes: sending video invitation information to the first terminal; and when receiving the consent information fed back by the first terminal according to the video invitation information and reaching the first appointment time, establishing video connection with the first terminal.
Optionally, the at least one terminal further includes at least one second terminal; the establishing of the video connection with at least one terminal comprises the following steps: sending video invitation information to the first terminal and/or the second terminal; when receiving the consent information fed back by the second terminal according to the video invitation information and reaching a second appointment time, establishing video connection with the second terminal; the identifying the user identity information in the video comprises: and identifying user identity information in the video sent by the first terminal and the video sent by the second terminal.
Optionally, the method further includes: forwarding the video sent by the second terminal to the first terminal, and receiving a first verification result fed back by the first terminal; forwarding the video sent by the first terminal to the second terminal, and receiving a second verification result fed back by the second terminal; and determining a verification result of the user identity information according to the first verification result, the second verification result and an identification result obtained by identifying the user identity information in the video sent by the first terminal and the video sent by the second terminal.
Optionally, the receiving the video sent by the at least one terminal includes: providing a verification action and a verification code, so that a user can make an action in a video according to the verification action and input voice according to the verification code; receiving video and voice fed back by the at least one terminal in response to the verification action and the verification code; the passing of the authentication of the user identity information comprises: and the face and the action in the video are verified to pass, and the voiceprint feature in the voice is verified to pass.
Optionally, after the transaction flow of the service to be processed is started, the method further includes: and when the detected face number in the real-time video sent by the at least one terminal does not accord with the preset number, or the user identity information corresponding to any face in the real-time video sent by the at least one terminal is not verified, generating risk prompt information.
Optionally, when the at least one terminal further includes at least one second terminal, the method further includes: according to a first mark point in a first real-time video sent by the first terminal and a second mark point in a second real-time video sent by the second terminal, time alignment is carried out on the first real-time video and the second real-time video; and verifying the number of the human faces in the first real-time video and the second real-time video after the time alignment and the user identity information corresponding to each human face.
Optionally, after the transaction flow of the service to be processed is started, the method further includes: providing service confirmation content to guide a user to input service feedback information; and when the feedback result is judged to be confirmation according to the service feedback information and the user identity information is verified to be passed according to the service feedback information, acquiring a service confirmation result.
Optionally, after obtaining the service confirmation result, the method further includes: providing testimony input prompt information to guide a user to input testimony acquisition videos comprising faces and certificates; and when the matching of the face in the testimony collection video and the face in the certificate is successful, and the matching of the corresponding user identity information of the face in the testimony collection video in the ready user and the user identity information in the certificate is successful, determining that the testimony entry is successful.
According to a second aspect of the present disclosure, there is provided a service processing system based on video auditing, including a server and a first terminal, wherein the first terminal is configured to: sending request information of a service to be processed to the server, and sending a video to the server after establishing video connection with the server; the request information comprises a ready user list, and the ready user list comprises at least two ready users; the server is configured to: receiving the request information, establishing video connection with at least one terminal including the first terminal when judging that the video auditing requirement of the service to be processed is met according to the ready user list, receiving the video sent by the at least one terminal, identifying user identity information in the video, and starting the handling process of the service to be processed when the user identity information is verified to pass.
Optionally, the system further includes at least one second terminal configured to: receiving video invitation information sent by the server or video invitation information sent by the server to the first terminal and forwarded by the first terminal, and responding to preset operation aiming at the video invitation information and feeding back agreement information to the server; the server is configured to: and when the consent information fed back by the second terminal is received and a second appointment time is reached, establishing video connection with the second terminal.
According to a third aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the service processing method of the first aspect described above and possible implementations thereof.
According to a fourth aspect of the present disclosure, there is provided an electronic device comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the service processing method of the first aspect and possible implementations thereof via executing the executable instructions.
The technical scheme of the disclosure has the following beneficial effects:
the online transaction implementation scheme for the multi-user service is provided, pre-auditing is performed before video connection is established according to video auditing requirements, service processing efficiency is improved, and safety of online transaction is improved by identifying and verifying user identity information in videos.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is apparent that the drawings in the following description are only some embodiments of the present disclosure, and that other drawings can be obtained from those drawings without inventive effort for a person skilled in the art.
FIG. 1 shows a schematic architecture diagram of a video audit based business processing system in this exemplary embodiment;
FIG. 2 is a flow chart illustrating a method for video audit based business processing in the exemplary embodiment;
fig. 3 is a flowchart illustrating a service processing method according to the present exemplary embodiment;
FIG. 4 is a schematic diagram illustrating a policy information editing page in the exemplary embodiment;
fig. 5 is a diagram showing video invitation information in the present exemplary embodiment;
FIG. 6 is a schematic diagram illustrating a risk hint in the exemplary embodiment;
fig. 7 is a flowchart illustrating a method for obtaining a service confirmation result according to the present exemplary embodiment;
FIG. 8 is a flow diagram illustrating another video audit based business process methodology in the exemplary embodiment;
FIG. 9 is an interactive flow diagram illustrating a method for video audit based business processing in an exemplary embodiment;
fig. 10 shows a schematic structural diagram of an electronic device in the present exemplary embodiment.
Detailed Description
Exemplary embodiments will now be described more fully with reference to the accompanying drawings. The exemplary embodiments, however, may be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the subject matter of the present disclosure can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and the like. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
The flow charts shown in the drawings are merely illustrative and do not necessarily include all of the steps. For example, some steps may be decomposed, and some steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
In the related art, a scheme for performing service processing through video has appeared. The face recognition authentication is usually required when the user transacts the business so as to ensure the authenticity of the user identity. The scheme can be realized only aiming at the service handled by a single person.
However, when the business involves a plurality of users, for example, insurance application business involves an applicant and an insured life, financial loan business involves a borrower and a insurer, and the like, online transaction cannot be realized by the above scheme.
In view of the foregoing problems, exemplary embodiments of the present disclosure provide a service processing method based on video auditing, which is directed to a service involving multiple users. The application scenarios of the service processing method include but are not limited to: in the insurance application business, an applicant and an insured life (or other related personnel such as beneficiaries and insurance agents) establish connection with a server through one or more terminal devices and send video data, the applicant and the insured life are both in videos, and the server realizes related business processing based on video verification.
In order to implement the service processing method, an exemplary embodiment of the present disclosure provides a service processing system based on video auditing. Fig. 1 shows a schematic architecture diagram of the business processing system. As shown in fig. 1, the service processing system 100 may include a server 110 and a first terminal 120. The server 110 is a background server deployed by a service provider (such as an insurance company, a bank, etc.). The first terminal 120 is a terminal device used by a user handling a service, and more specifically, may be a terminal device used by a user initiating a service handling request (referred to as a service initiating user), such as a smart phone, a personal computer, a tablet computer, and the like. The server 110 and the first terminal 120 may establish a connection through a network to implement service interaction, for example, the first terminal 120 establishes a video connection with the server 110 through the network to perform online service handling.
It should be understood that the server 110 may be a computer or a cluster formed by a plurality of computers, and for example, the cluster may include a video connection server, an authentication server, a business transaction server, and the like, and the present disclosure is not limited to the specific architecture of the server 110.
The first terminal 120 is configured to: the request information of the service to be processed is transmitted to the server 110, and the video is transmitted to the server 110 after the video connection is established with the server 110. The request information comprises a ready user list, and the ready user list comprises at least two ready users.
The server 110 is configured to: receiving the request information, establishing video connection with at least one terminal including the first terminal 120 when judging that the video auditing requirements of the to-be-processed service are met according to the ready user list, receiving the video sent by the at least one terminal, identifying the user identity information in the video, and starting the processing flow of the to-be-processed service when the user identity information is verified to pass.
In one embodiment, the first terminal 120 is configured to: video invitation information transmitted by the server 110 is received, and consent information is fed back to the server 110 in response to a preset operation for the video invitation information. The video invitation information is used to invite the terminal to establish a video connection with the server, and may be information including a link pushed by the server 110, for example. The preset operation refers to an operation of accepting the video invitation by the user, and may be, for example, an operation of clicking the video invitation information, an operation of selecting acceptance after long-pressing the video invitation information, or the like. When the user performs a preset operation, the first terminal 120 is triggered to send agreement information about the video invitation information to the server 110, and then a video connection is established with the server 110.
The server 110 is configured to: and when the consent information fed back by the first terminal 120 is received and the first reserved time is reached, establishing a video connection with the first terminal 120.
In one embodiment, the system 100 may further include at least one second terminal 130, which is a terminal device used by a service-related user other than the service-initiating user, and may establish a connection with the server 110 through a network. For example, the applicant uses the first terminal 120 and the insured uses the second terminal 130 to establish a video connection with the server 110 of the insurance company.
The second terminal 130 is configured to: receiving video invitation information sent by the server 110 or video invitation information sent by the server 110 to the first terminal 120 and forwarded by the first terminal 120, and feeding back approval information to the server 110 in response to a preset operation for the video invitation information.
The server 110 is configured to: and when the consent information fed back by the second terminal 130 is received and the second reserved time is reached, establishing a video connection with the second terminal 130.
In one embodiment, the server 110 is configured to: and identifying the user identity information in the video sent by the first terminal and the video sent by the second terminal.
In one embodiment, the server 110 is configured to: forwarding the video sent by the second terminal 130 to the first terminal 120, and receiving a first verification result fed back by the first terminal 120; forwarding the video sent by the first terminal 120 to the second terminal 130, and receiving a second verification result fed back by the second terminal 130; and determining the verification result of the user identity information according to the first verification result, the second verification result and the identification result obtained by identifying the user identity information in the video sent by the first terminal 120 and the video sent by the second terminal 130.
In one embodiment, the server 110 is configured to: providing a verification action and a verification code, and enabling a user to act in the video according to the verification action and input voice according to the verification code; receiving video and voice fed back by the at least one terminal in response to the verification action and the verification code; and verifying the face and the action in the video, and verifying the voiceprint characteristics in the voice to determine the verification result of the user identity information.
In one embodiment, the server 110 is configured to: after a transaction flow of the service to be processed is started, when the detected face number in the real-time video sent by at least one terminal does not accord with the preset number, or the user identity information corresponding to any face in the real-time video sent by at least one terminal is not verified, risk prompt information is generated.
In one embodiment, the server 110 is configured to: according to a first mark point in a first real-time video sent by the first terminal 120 and a second mark point in a second real-time video sent by the second terminal 130, time alignment is carried out on the first real-time video and the second real-time video; and verifying the number of human faces in the first real-time video and the second real-time video after time alignment and the user identity information corresponding to each human face.
In one embodiment, the server 110 is configured to: providing service confirmation content to guide a user to input service feedback information; and when the feedback result is judged to be confirmation according to the service feedback information and the user identity information is verified to be passed according to the service feedback information, acquiring a service confirmation result.
In one embodiment, the server 110 is configured to: after a service confirmation result is obtained, providing testimony input prompt information to guide a user to input testimony acquisition video comprising a face and a certificate; and when the matching of the face in the testimony acquisition video and the face in the certificate is successful, and the matching of the user identity information corresponding to the face in the testimony acquisition video in the ready user and the user identity information in the certificate is successful, determining that the testimony entry is successful.
The following describes a service processing method from the perspective of a server. Fig. 2 shows an exemplary flow of a business processing method performed by a server, which may include:
step S210, receiving request information of a to-be-processed service sent by a first terminal, wherein the request information comprises a ready user list, and the ready user list comprises at least two ready users;
step S220, when the video auditing requirement of the service to be processed is judged to be met according to the ready user list, establishing video connection with at least one terminal, and receiving the video sent by the at least one terminal;
step S230, identifying user identity information in the video;
step S240, when the user identity information passes the verification, starting a transaction process of the service to be processed.
Based on the method, a scheme for conducting online transaction aiming at multi-user service is provided, pre-auditing is conducted before video connection is established according to video auditing requirements, service processing efficiency is improved, and safety of online transaction is improved by identifying and verifying user identity information in videos.
Fig. 2 shows a flow of business processing based on video auditing. For services transacted online, video auditing is a relatively strict processing flow, and for some services with low safety requirements, video auditing is not required, and the services are transacted by conventional electronization. In one embodiment, a service condition of video auditing can be set, and the service process is classified by using the condition. Referring to fig. 3, the business process flow may include:
step S310, obtaining the information of the service to be processed.
Step S320, determine whether the pending service relates to a blacklist user. A blacklisted user may be a user with a certain credit risk. If the blacklist user is involved, performing step S360; if not, step S330 is performed.
Step S330, determining whether the service to be processed is a high risk service. The high-risk business can be determined in advance according to actual business conditions, for example, the loan business is the high-risk business. If the business is a high risk business, executing step S360; if not, step S340 is performed.
Step S340, determining whether the amount of money related to the service to be processed is high. The high-sum standard can be set according to actual business conditions, and the disclosure does not limit the high-sum standard. If the money belongs to the high amount, executing step S360; if not, step S350 is performed.
And step S350, processing the service to be processed by adopting a conventional electronic transaction process.
Step S360, the service to be processed is processed through the video auditing process, that is, the service processing is completed by executing the method process shown in fig. 2.
Therefore, video auditing processing is carried out aiming at the service with higher safety requirement, and the service processing efficiency is favorably improved.
Further, each step in fig. 2 is specifically described.
Referring to fig. 2, in step S210, request information of a pending service sent by a first terminal is received, where the request information includes a ready user list, and the ready user list includes at least two ready users.
The request information is information generated when a user initiates a service handling request. The service initiating user can edit and submit the request information of the service to be processed in the first terminal. The ready user refers to a user who is ready to transact business through video currently among related users of the business to be processed.
For example, for an insurance application, the service initiating user may be an applicant who selects to handle the insurance application in the page of the insurance App and enters the relevant page for service handling. Fig. 4 shows a schematic diagram of a policy information editing page in which a business initiating user can edit information about relevant users, such as filling in information of an applicant, an insured, a beneficiary, etc., and check out which users are ready for a video review, thereby determining ready users, such as the applicant and the insured, which are checked out in fig. 4, as being ready users. The first terminal may generate a list of ready users and add them to the request message.
The pending service of the present exemplary embodiment requires at least two users to participate in the transaction, and thus the ready user list includes at least two ready users.
With continued reference to fig. 2, in step S220, when it is determined that the video audit requirement of the pending service is met according to the ready user list, a video connection is established with at least one terminal, and a video sent by the at least one terminal is received.
The video auditing requirement refers to which users are required to appear in the video when the to-be-processed service is transacted online. For example, the insuring service requires that the insurant and the insured are both present in the video, and when the ready user list includes the insurant and the insured, the server determines that the video auditing requirement of the service to be processed is met. Before actual video review is started, whether the video review requirement of the service to be processed is met is judged according to the ready user list, which is equivalent to pre-review, if the ready user list provided by the user does not meet the video review requirement, the server does not need to establish video connection with the terminal, and corresponding prompt information can be returned, such as that 'personnel participating in video review do not meet the requirement', 'xxx is also needed to participate in video review', and the like, so that the actual video connection is ensured to be carried out under the condition that the user participating in video review meets the video review requirement, and the service processing efficiency is improved.
The present exemplary embodiment allows all users participating in a business transaction to make a video connection through one terminal or multiple terminals. When only one terminal participates in service handling, the terminal is a first terminal, and after video connection is established between the server and the first terminal, subsequent service handling can be carried out; when a plurality of terminals participate in service handling, the server needs to establish video connection with at least one second terminal in addition to the first terminal. Therefore, the at least one terminal includes a first terminal, and may further include at least one second terminal, where the second terminal is a terminal device used by a service-related user other than the service initiating user.
When the video auditing requirement is met, the server can establish video connection with the at least one terminal, and the terminal shoots videos in real time and sends the videos to the server. The video should contain the face of the ready user.
In an embodiment, the establishing a video connection with at least one terminal may include:
sending video invitation information to a first terminal;
and when receiving the consent information fed back by the first terminal according to the video invitation information and reaching the first appointment time, establishing video connection with the first terminal.
When the first terminal receives the video invitation information, the corresponding information can be displayed. Referring to fig. 5, the first terminal may display video invitation information through a pop-up window to ask whether the user authorizes the opposite party to perform a full-process video recording and collect audio, and if the user selects "agree", the first terminal feeds back the agreement information to the server.
The first reserved time may be a service transaction time previously agreed by the first terminal and the server. For example, when a service initiating user requests service handling for the first time, it may be unclear which persons need to participate in video review, which may result in that the video review requirement is not met and the service cannot be handled. In this case, the service processing time can be reserved for the server, and the server can use the time of reaching the first reserved time as one of the preconditions for establishing the video connection, so as to better realize the scheduling of service processing and optimize the allocation of server resources.
The first appointment time can be a time period, for example, 10: 00-10: 30 of x months and x days of x years, and the current time is in the time period and represents that the first appointment time is reached.
In an embodiment, the establishing a video connection with at least one terminal may include:
sending video invitation information to the first terminal and/or the second terminal;
and receiving the consent information fed back by the at least one second terminal according to the video invitation information, and establishing video connection with the second terminal when the second appointment time is reached.
The video invitation information can be directly sent to the second terminal by the server, for example, when the server judges that the video auditing requirements of the service to be processed are met according to the ready user list, the server pushes the video invitation information to all ready users. The video invitation information can also be forwarded to the second terminal by the first terminal, for example, the server sends the video invitation information to the first terminal, the video invitation information contains a link, the first terminal shares the video invitation information with the second terminal, when the user clicks the video invitation information, the user can trigger to request to join the video connection to the server through the link, and the request is equivalent to the agreement information, so that the first terminal, the second terminal and the server establish the video connection.
And the second appointment time is the service processing time of the user aiming at the second terminal, which is appointed by the first terminal and the server in advance. Generally, a service initiating user and other service related users can perform service handling simultaneously, and the first reservation time is the same as the second reservation time, that is, the first terminal and the second terminal establish video connection with the server at the same time or in the same time period. Or, the service initiating user and other service related users may perform service handling simultaneously, for example, the applicant performs a previous part of service handling separately, and the insured adds a subsequent part of service handling, so that the first reservation time and the second reservation time may be different, that is, the first terminal and the second terminal establish video connection with the server at different times or different time periods.
In one embodiment, the server may send the video invitation information to the first terminal when the first reserved time is reached, and may also send the video invitation information to the second terminal when the second reserved time is reached.
After the video connection is established between the terminals and the server, each terminal sends a video to the server.
With continued reference to fig. 2, in step S230, user identity information in the video is identified.
In the exemplary embodiment, after receiving the video sent by the terminal, the server may determine the user identity information in the video through biometric identification. Biometric identification includes, but is not limited to: face recognition, voiceprint recognition, and the like.
When a plurality of users are included in the video, the server may identify the identity information of each user separately.
In one embodiment, if the first terminal and the at least one second terminal both establish a video connection with the server and transmit a video, the server may identify the user identity information in the video transmitted by the first terminal and the video transmitted by the second terminal.
An insurance company or a bank and other organizations usually establish a user information database to store collected information of the face, voiceprint and the like of a user. In step S230, the server may compare the face, the voiceprint, and the like in the video with the face, the voiceprint, and the like in the user information database to determine the user identity information. Or, the server may also send the information such as the face and the voiceprint in the video to a third-party mechanism, and the third-party mechanism compares the information such as the face and the voiceprint and returns the identification result of the user identity information.
With continued reference to fig. 2, in step S240, when the user identity information is verified, a transaction process of the pending transaction is started.
The authentication of the user identity information mainly comprises two aspects: one is to verify the authenticity of the user identity information, for example, to verify the authenticity of the video itself, to ensure that the video is not a computer-synthesized or prerecorded video; and secondly, verifying that the user identity information corresponds to the information in the ready user list one by one, namely that the user in the video is the user in the ready user list, and actually verifying whether the video auditing requirement of the service to be processed is met again according to the user identity information in the video. When the verification is passed, the transaction process of the service to be processed can be started.
In one embodiment, in order to effectively identify the composite video or the prerecorded video to prevent the malicious user from performing the service fraud, after the video connection is established, the server may perform the following steps:
providing a verification action and a verification code, and enabling a user to act in the video according to the verification action and input voice according to the verification code;
and receiving video and voice fed back by the at least one terminal in response to the verification action and the verification code.
For example, the verification motion may be blinking, opening mouth, shaking left head, shaking right head, or the like, or a group of motions in which a plurality of motions are arranged, and the verification code may be a segment of characters, such as text, a numeric string, or the like. The server can randomly generate a verification action and a verification code and send the information of the verification action and the verification code to the first terminal. The first terminal displays guiding information of the verification action and the verification code, such as a face frame and arrows of up, down, left and right are displayed in the middle of the screen to guide the user to shake the head up, down, left and right, and simultaneously displays 'please pronounce xxx' (xxx represents the verification code) below the screen. The user can make a verification action and pronounce the verification code at the same time, and the first terminal sends the video containing the voice to the server for verification.
Further, the server performs triple authentication: verifying whether the face in the video is the face of a ready user; whether the voiceprint features in the voice are matched with the voiceprint features of the ready user or not is verified, so that the accuracy of user identity information identification is improved through the combination of the face and the voiceprint features, and the identity information of the user is ensured to be consistent with the information in the list of the ready user; and verifying whether the action in the video is matched with the verification action, namely whether the action made by the user is accurate or not, so as to ensure that the video is not synthesized or is recorded in advance. Thus, the passing of the authentication of the user identity information may include: the face and action in the video are verified, and the voiceprint features in the voice are verified.
Therefore, the mode of combining verification of the verification action and the verification code can realize very high safety guarantee, and the user can make the action and input voice when verifying so as to complete the acquisition of information of three aspects of face, action and voiceprint, which is very convenient.
In an embodiment, if the first terminal and the at least one second terminal both establish a video connection with the server and send a video, the server may send a verification action and a verification code to the first terminal and the second terminal, respectively, and the verification action and the verification code sent to different terminals may be the same or different. And the server receives the fed back video and voice from the first terminal and the second terminal, respectively verifies the video and voice, and starts a transaction process of the service to be processed when the video and voice fed back by the first terminal and the second terminal are verified to be passed.
In one embodiment, if the first terminal and at least one second terminal both establish a video connection with the server and transmit a video, the first terminal and the second terminal can be mutually authenticated. Specifically, the service processing method may further include the following steps:
forwarding the video sent by the second terminal to the first terminal, and receiving a first verification result fed back by the first terminal;
forwarding the video sent by the first terminal to a second terminal, and receiving a second verification result fed back by the second terminal;
and determining a verification result of the user identity information according to the first verification result, the second verification result and a recognition result obtained by recognizing the user identity information in the video sent by the first terminal and the video sent by the second terminal.
The first verification result is a result of the user of the first terminal performing manual verification on the video of the second terminal, that is, when the user of the first terminal sees the video of the second terminal, whether the user in the video is correct or not can be fed back, that is, the first verification result. The second verification result is a result of the user of the second terminal manually verifying the video of the first terminal. And the server integrates the first verification result, the second verification result and the result of identifying the user identity information in the video to verify the user in the video. Generally, when the first verification result and the second verification result both pass the verification and the identification result of the user identity information also passes the verification, it is determined that the user identity information is verified. Therefore, the reliability of the user identity information verification result can be further improved.
After the transaction flow of the service to be processed is started, the transaction can be performed step by step according to the content of the service to be processed, for example, the server sends related information such as service terms and the like to the terminal in the form of audio or text, and the terminal can play the audio or display the text on a screen.
In the whole process of business handling, the server can keep the real-time video sent by the receiving terminal and check the face information in the real-time video in the whole process so as to ensure that all users participate in the whole process of business handling.
In one embodiment, the service processing method may further include:
and when the detected face number in the real-time video sent by the at least one terminal does not accord with the preset number, or the user identity information corresponding to any face in the real-time video sent by the at least one terminal is not verified, generating risk prompt information.
The preset number may be the number of ready users, or the number of users in the video when the user identity information is identified. Generally, during the whole business process, the user is not allowed to leave from the video, and a new user is not allowed to appear in the video. For example, in an insurance application business, the applicant and the insured have a video through the first terminal, and the applicant and the insured are required to be present in the video all the time, and no third person can be present in the video. And at any time in the process of handling the insurance application business, if the server detects that the number of the human faces in the real-time video is not 2, indicating that the requirement is violated, generating risk prompt information. The risk prompt message can be sent to the terminal and displayed, for example, the message can be "the system detects that the person does not conform to the message, please xxx to return to the video", "the system detects unknown person", etc., so as to prompt the user to comply with the requirement. Certainly, in some services, the number of people required to participate in different transaction stages is different, so the preset number can be changed with different transaction stages, and the server can detect the number of faces in the video according to the preset number of each transaction stage.
In addition, the server can also compare whether each face in the real-time video is consistent with the face of the ready user, if a certain face is inconsistent with the face of the ready user, the result that the user identity information corresponding to the face cannot be verified can be obtained, and the result indicates that the face of other irrelevant people or the simulation mask, the recorded image or the video and the like are possible. In this case, the risk prompt information may also be generated, and the content of the risk prompt information may be the same as or different from the content of the risk prompt information generated when the number of detected faces does not meet the preset number, for example, "identify you use simulation mask/record video, please ensure that xxx is handled by oneself on site", and the like, and the content is sent to the terminal and displayed, as shown in fig. 6, to prompt the user to comply with the requirements.
Furthermore, after the risk prompt information is generated, the current business handling process can be suspended, and the business handling process is continued after the problem is solved. Specifically, if the number of faces does not meet the preset number, when the number of faces in the real-time video is detected to meet the preset number, service handling is continued, or service handling is continued after user identity information is re-verified, or service handling is cancelled when the number of faces is detected to not meet the preset number for a long time. If the user identity information corresponding to the face fails to be verified, the service is continuously transacted after the face in the real-time video is re-verified, or the service is cancelled when the face is verified to be failed for a long time.
In an implementation mode, the safety monitoring of the whole service handling process can be realized by combining the two technical means of detecting the number of the faces and verifying the identity information of the faces. For example, considering that the number of detected faces is lower than the amount of calculation required for verifying face identity information, whether the face data in the video conforms to the preset number can be detected in real time, and whether each face in the video is consistent with the face of the ready user is periodically detected (for example, once every 30 seconds and every minute), so that higher security is realized through lower calculation amount.
If the first terminal and the at least one second terminal establish video connection with the server and send real-time videos, the server can detect the number of faces of the real-time videos sent by each terminal and verify user identity information corresponding to the faces.
Due to the asynchronous time among the first terminal, the second terminal and the server and the difference of the network conditions of the first terminal and the second terminal, a time difference may exist between two portions of real-time video received by the server. In order to facilitate more accurate and synchronous face number detection and face comparison, time alignment can be performed to eliminate time difference. In one embodiment, the service processing method may further include the following steps:
time alignment is carried out on the first real-time video and the second real-time video according to a first mark point in the first real-time video sent by the first terminal and a second mark point in the second real-time video sent by the second terminal;
and verifying the number of human faces in the first real-time video and the second real-time video after time alignment and the user identity information corresponding to each human face.
The first real-time video refers to a real-time video sent by a first terminal, the second real-time video refers to a real-time video sent by a second terminal, and when the number of the second terminals is multiple, the number of the second real-time videos is also multiple. The mark points are marks made on one frame or multiple frames in the video by combining information outside the video, and the first mark points and the second mark points are marks in the first real-time video and the second real-time video respectively. In the process of sending a real-time video to a server by a first terminal and a second terminal, it is generally necessary to report to the server when a specific event occurs, for example, a user performs an operation related to a certain service, and a timestamp may be added when an event corresponding to the operation is reported. The server may determine a first marker point in the first real-time video according to the timestamp of the specific event reported by the first terminal, and determine a second marker point in the second real-time video according to the timestamp of the specific event reported by the second terminal.
For example, a service initiating user performs video connection with a server through a first terminal, a service related user performs video connection with the server through a second terminal, and when the two users start a service handling process through user identity authentication, the server can send a prompt message to the first terminal and the second terminal, that is, a xx service handling is about to start and a confirmation is clicked; a service initiating user clicks on a first terminal for confirmation, triggers sending of confirmation starting information to a server, and comprises a timestamp for sending the information, meanwhile, the first terminal also sends a first real-time video to the server, wherein the first real-time video comprises the timestamp of each frame, and the server can set a first mark point at the position of the same timestamp in the first real-time video according to the timestamp for confirming the starting information; similarly, the service-related user clicks confirmation on the second terminal, and triggers to send confirmation start information containing a time stamp to the server, and the server sets a second mark point at the position of the same time stamp in the second real-time video; furthermore, the server can align the first mark point in the first real-time video with the second mark point in the second real-time video, thereby realizing the time alignment of the two videos. When the alignment is performed, the timestamp of the first real-time video or the timestamp of the second real-time video can be integrally adjusted according to the time difference between the first marking point and the second marking point.
In the service handling process, other mark points can be set according to the service content, for example, after a certain page of service clause is displayed to a user, the user is guided to click options such as 'next page' or 'I read', and the mark points are set in the real-time video according to a timestamp of information sent by the user after clicking.
Through the time alignment processing, the service process is used as a unified standard, so that the first real-time video and the second real-time video are accurately synchronized, and the problem that the verification result of the first real-time video and the second real-time video is unreliable due to time difference is solved.
In one embodiment, a first real-time video transmitted by a first terminal and a second real-time video transmitted by a second terminal may be stitched into one video, for example, the second real-time video is scaled to the same height as the first real-time video and stitched to the right side of the first real-time video. And then verifying the number of the human faces in the spliced video and the user identity information corresponding to the human faces. Therefore, a plurality of processed videos can be converted into one processed video, for example, at a certain moment, the number of faces of one frame of picture in the first real-time video and the number of faces of one frame of picture in the second real-time video need to be detected and compared originally, and by splicing the two videos, the number of faces of one frame of picture in the spliced video only needs to be detected and compared, so that the calculated amount is reduced. On the basis of the time alignment, the first real-time video and the second real-time video are spliced, so that a spliced video with accurate and synchronous time can be obtained, and accurate face verification can be realized.
In an embodiment, referring to fig. 7, the service processing method may further include the following steps:
step S710, providing service confirmation content to guide the user to input service feedback information;
step S720, when the feedback result is determined to be confirmation according to the service feedback information and the user identity information is verified to be passed according to the service feedback information, a service confirmation result is obtained.
The server may send the service confirmation content to the terminal in the form of audio or text, and the terminal may play the audio of the service confirmation content or display the text of the service confirmation content on a screen. The service confirmation content may include information such as "agree", "confirm", etc. to guide the user to give service feedback information. The user can input the voice of 'agreement' or 'disagreement', and the terminal returns the service feedback information in the form of voice to the server. The server identifies the voice content, when the user gives positive selection (such as agreement, confirmation and the like), the feedback result is confirmation, and the server performs voiceprint feature identification on the voice to verify the identity information of the user. And when the feedback result is confirmation and the user identity information passes verification, the server acquires a service confirmation result.
The authentication of the user identity information is not passed, and two cases can be included: and identifying that the voiceprint characteristics are not matched with the voiceprint characteristics of the ready user, and detecting that other sounds in the voice of the service feedback information are processed by the guide user. When the feedback result is judged to be 'disagreement' or 'unconfirmed', or the user identity information is not verified, risk prompt information can be generated to prompt the user whether to input the service feedback information again. If the user selects yes, the service confirmation content is provided again to collect service feedback information; and if the user selects no, canceling the service transaction.
It should be noted that, in the exemplary embodiment, each user who needs to participate in service transaction submits service feedback information, the feedback result is identified as confirmation for the service feedback information of each user, and when the user identity information is verified, a service confirmation result is obtained.
In an embodiment, after obtaining the service confirmation result, the following steps may be further performed:
providing testimony input prompt information to guide a user to input testimony acquisition videos comprising faces and certificates;
and when the matching of the face in the testimony acquisition video and the face in the certificate is successful, and the matching of the user identity information corresponding to the face in the testimony acquisition video and the user identity information in the certificate is successful, determining that the testimony entry is successful.
The testimony input prompt information is used for prompting a user to hold the certificate to acquire information in a video, and can be audio or character information. The video input by the user comprises the face and the certificate of the user, the certificate generally comprises the face and characters, and for example, the front face of the identity card comprises the photo and the identity card information of the user. After the terminal sends the video to the server, the server matches the face in the video with the face in the certificate, identifies the user identity information corresponding to the face, and matches the user identity information with the user identity information in the certificate. In one embodiment, the server may identify the user identity information in the document through OCR (Optical Character Recognition) technology. Through the matching, the successful matching of the face information in the video, the face information in the certificate, the user identity information in the certificate and the identity information of the ready user can be ensured, and therefore the safety of service handling is further improved.
In one embodiment, the server may further provide a signature prompt to guide the user to sign, for example, the user may sign in a user interface of the terminal, and the terminal generates an electronic signature and sends the electronic signature to the server. The signing step may be executed when the service confirmation result is obtained, or may be executed after the face in the video and the face in the certificate are successfully matched, and the user identity information corresponding to the face and the user identity information in the certificate are successfully matched, which is not limited by the present disclosure.
The following describes a service processing method from the perspective of the first terminal. Fig. 8 shows an exemplary flow of a service processing method performed by a first terminal, which may include:
step S810, sending request information of the service to be processed to a server, wherein the request information comprises a ready user list, and the ready user list comprises at least two ready users;
step S820, responding to the server judging that the video auditing requirement of the service to be processed is met according to the ready user list, establishing video connection with the server, and sending the video to the server to enable the server to identify the user identity information in the video;
step S830, in response to the server passing the user identity information verification, starting a transaction process of the to-be-processed service.
The service initiating user can edit and submit request information of the service to be processed in the first terminal, and can fill and select ready users when the request information is edited, so that the first terminal generates a ready user list and adds the ready user list to the request information.
When the server judges that the video auditing requirement of the service to be processed is met according to the ready user list, the server can send relevant information of the judgment result to the first terminal, for example, video invitation information. The user may select "agree" in the video invitation information to trigger the establishment of a video connection with the server, and may then send the video to the server under that connection.
After the server identifies and verifies the user identity information in the video, the first terminal and the server both start a transaction process of the service to be processed. For the first terminal, the transaction flow of the pending service is mainly to receive the content (such as service clauses) of the pending service sent by the server and show the content in the form of audio or characters.
Fig. 9 shows an interaction flow diagram of a business processing method based on video auditing, which includes:
step S901, the first terminal 120 applies for handling a service to be processed, and sends service information to the server 110;
step S902, after receiving the service information, the server 110 determines that the service to be processed adopts video auditing processing, and feeds back the service to the first terminal 120;
step S903, the user edits the ready user list, and the first terminal 120 sends request information containing the list;
step S904, the server 110 determines whether the video auditing requirements of the to-be-processed service are met according to the ready user list;
step S905, when the server 110 determines that the video audit requirement is met, the server 110 establishes a video connection with the first terminal 120 and establishes a video connection with the second terminal 130;
step S906, the first terminal 120 and the second terminal 130 send a real-time video to the server 110 under video connection;
step S907, the server 110 identifies the user identity information in the video and performs authentication;
step S908, when the server 110 passes the authentication of the user identity information, the service transaction process is started, and the first terminal 120 and the second terminal 130 also start the service transaction process;
step S909, the server 110 verifies the faces in the real-time video in the whole service transaction process, including verification of the number of faces and verification of the user identity information corresponding to the faces;
step S910, if the server 110 fails to verify the face in the real-time video, sending a risk prompt message to the first terminal 120 or the second terminal 130;
step S911, if the user selects to re-verify on the first terminal 120 or the second terminal 130, the real-time video is continuously sent to the server 110;
step S912, the server 110 passes the face verification in the real-time video, and sends the service confirmation content when the service content is finished being sent;
step S913, the user inputs the service feedback information according to the service confirmation content, and the first terminal 120 and the second terminal 130 send the service feedback information to the server 110;
step S914, the server 110 sends a testimony input prompt message;
step S915, the user performs witness entry on the first terminal 120 and the second terminal 130, and the first terminal 120 and the second terminal 130 send witness entry information to the server 110;
step S916, the user signs on the first terminal 120 and the second terminal 130, and the first terminal 120 and the second terminal 130 send the user signature information to the server 110;
step S917, the server 110 stores the user signature information, and performs two-in-one storage on the video or the screen capture, and the service processing flow is ended.
Exemplary embodiments of the present disclosure also provide a computer-readable storage medium, which may be implemented in the form of a program product, including program code for causing an electronic device to perform the steps according to various exemplary embodiments of the present disclosure described in the above-mentioned "exemplary method" section of this specification, when the program product is run on the electronic device. In one embodiment, the program product may be embodied as a portable compact disc read only memory (CD-ROM) and include program code, and may be run on an electronic device, such as a personal computer. However, the program product of the present disclosure is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
Exemplary embodiments of the present disclosure also provide an electronic device, which may be a background server of an information platform. The electronic device is explained below with reference to fig. 10. It should be understood that the electronic device 1000 shown in fig. 10 is only an example and should not bring any limitations to the function and scope of use of the embodiments of the present disclosure.
As shown in fig. 10, the electronic device 1000 is embodied in the form of a general purpose computing device. The components of the electronic device 1000 may include, but are not limited to: at least one processing unit 1010, at least one memory unit 1020, and a bus 1030 that couples various system components including the memory unit 1020 and the processing unit 1010.
Where the storage unit stores program code that may be executed by the processing unit 1010 to cause the processing unit 1010 to perform the steps according to various exemplary embodiments of the present invention described in the "exemplary methods" section above in this specification. For example, the processing unit 1010 may perform the method steps as shown in fig. 2, and the like.
The memory unit 1020 may include volatile memory units such as a random access memory unit (RAM)1021 and/or a cache memory unit 1022, and may further include a read only memory unit (ROM) 1023.
Storage unit 1020 may also include a program/utility 1024 having a set (at least one) of program modules 1025, such program modules 1025 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
Bus 1030 may include a data bus, an address bus, and a control bus.
The electronic device 1000 may also communicate with one or more external devices 1100 (e.g., keyboard, pointing device, bluetooth device, etc.), which may be through input/output (I/O) interfaces 1040. The electronic device 1000 may also communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the internet) through the network adapter 1050. As shown, the network adapter 1050 communicates with the other modules of the electronic device 1000 via a bus 1030. It should be appreciated that although not shown, other hardware and/or software modules may be used in conjunction with the electronic device 1000, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functions of two or more modules or units described above may be embodied in one module or unit, according to exemplary embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
As will be appreciated by one skilled in the art, aspects of the present disclosure may be embodied as a system, method or program product. Accordingly, various aspects of the present disclosure may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system. Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is to be limited only by the following claims.

Claims (13)

1. A service processing method based on video audit is characterized by comprising the following steps:
receiving request information of a service to be processed, which is sent by a first terminal, wherein the request information comprises a ready user list, and the ready user list comprises at least two ready users;
when the video auditing requirement of the service to be processed is judged to be met according to the ready user list, establishing video connection with at least one terminal, and receiving a video sent by the at least one terminal, wherein the at least one terminal comprises the first terminal;
identifying user identity information in the video;
and when the user identity information passes verification, starting a transaction process of the service to be processed.
2. The method of claim 1, wherein establishing the video connection with the at least one terminal comprises:
sending video invitation information to the first terminal;
and when receiving the consent information fed back by the first terminal according to the video invitation information and reaching the first appointment time, establishing video connection with the first terminal.
3. The method of claim 1, wherein the at least one terminal further comprises at least one second terminal; the establishing of the video connection with at least one terminal comprises the following steps:
sending video invitation information to the first terminal and/or the second terminal;
when receiving the consent information fed back by the second terminal according to the video invitation information and reaching a second appointment time, establishing video connection with the second terminal;
the identifying the user identity information in the video comprises:
and identifying user identity information in the video sent by the first terminal and the video sent by the second terminal.
4. The method of claim 3, further comprising:
forwarding the video sent by the second terminal to the first terminal, and receiving a first verification result fed back by the first terminal;
forwarding the video sent by the first terminal to the second terminal, and receiving a second verification result fed back by the second terminal;
and determining a verification result of the user identity information according to the first verification result, the second verification result and an identification result obtained by identifying the user identity information in the video sent by the first terminal and the video sent by the second terminal.
5. The method according to claim 1, wherein said receiving the video transmitted by the at least one terminal comprises:
providing a verification action and a verification code, so that a user can make an action in a video according to the verification action and input voice according to the verification code;
receiving video and voice fed back by the at least one terminal in response to the verification action and the verification code;
the passing of the authentication of the user identity information comprises:
and the face and the action in the video are verified to pass, and the voiceprint feature in the voice is verified to pass.
6. The method of claim 1, wherein after initiating the transaction flow of the pending transaction, the method further comprises:
and when the detected face number in the real-time video sent by the at least one terminal does not accord with the preset number, or the user identity information corresponding to any face in the real-time video sent by the at least one terminal is not verified, generating risk prompt information.
7. The method of claim 6, wherein when the at least one terminal further comprises at least one second terminal, the method further comprises:
according to a first mark point in a first real-time video sent by the first terminal and a second mark point in a second real-time video sent by the second terminal, time alignment is carried out on the first real-time video and the second real-time video;
and verifying the number of the human faces in the first real-time video and the second real-time video after the time alignment and the user identity information corresponding to each human face.
8. The method of claim 1, wherein after initiating the transaction flow of the pending transaction, the method further comprises:
providing service confirmation content to guide a user to input service feedback information;
and when the feedback result is judged to be confirmation according to the service feedback information and the user identity information is verified to be passed according to the service feedback information, acquiring a service confirmation result.
9. The method of claim 8, wherein after obtaining the service confirmation result, the method further comprises:
providing testimony input prompt information to guide a user to input testimony acquisition videos comprising faces and certificates;
and when the matching of the face in the testimony collection video and the face in the certificate is successful, and the matching of the corresponding user identity information of the face in the testimony collection video in the ready user and the user identity information in the certificate is successful, determining that the testimony entry is successful.
10. The business processing system based on video audit is characterized by comprising a server and a first terminal, wherein,
the first terminal is configured to: sending request information of a service to be processed to the server, and sending a video to the server after establishing video connection with the server; the request information comprises a ready user list, and the ready user list comprises at least two ready users;
the server is configured to: receiving the request information, establishing video connection with at least one terminal including the first terminal when judging that the video auditing requirement of the service to be processed is met according to the ready user list, receiving the video sent by the at least one terminal, identifying user identity information in the video, and starting the handling process of the service to be processed when the user identity information is verified to pass.
11. The system of claim 10, further comprising at least one second terminal configured to: receiving video invitation information sent by the server or video invitation information sent by the server to the first terminal and forwarded by the first terminal, and responding to preset operation aiming at the video invitation information and feeding back agreement information to the server;
the server is configured to: and when the consent information fed back by the second terminal is received and a second appointment time is reached, establishing video connection with the second terminal.
12. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method of any one of claims 1 to 9.
13. An electronic device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the method of any of claims 1 to 9 via execution of the executable instructions.
CN202110338656.4A 2021-03-30 2021-03-30 Service processing method, system, medium and electronic equipment based on video auditing Active CN113034110B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110338656.4A CN113034110B (en) 2021-03-30 2021-03-30 Service processing method, system, medium and electronic equipment based on video auditing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110338656.4A CN113034110B (en) 2021-03-30 2021-03-30 Service processing method, system, medium and electronic equipment based on video auditing

Publications (2)

Publication Number Publication Date
CN113034110A true CN113034110A (en) 2021-06-25
CN113034110B CN113034110B (en) 2023-12-22

Family

ID=76452839

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110338656.4A Active CN113034110B (en) 2021-03-30 2021-03-30 Service processing method, system, medium and electronic equipment based on video auditing

Country Status (1)

Country Link
CN (1) CN113034110B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113438523A (en) * 2021-07-06 2021-09-24 江西大江传媒网络股份有限公司 Video exhibition and broadcasting intelligent analysis feedback system based on mobile internet
CN113706091A (en) * 2021-07-14 2021-11-26 广州赛宝认证中心服务有限公司 Intelligent remote auditing method, device, system, computer equipment and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105491393A (en) * 2015-12-02 2016-04-13 北京暴风科技股份有限公司 Method for implementing multi-user live video business
WO2018113526A1 (en) * 2016-12-20 2018-06-28 四川长虹电器股份有限公司 Face recognition and voiceprint recognition-based interactive authentication system and method
CN108537501A (en) * 2018-03-22 2018-09-14 平安信托有限责任公司 Business witnesses method, apparatus, computer equipment and storage medium
CN109543507A (en) * 2018-09-29 2019-03-29 深圳壹账通智能科技有限公司 Identity identifying method, device, terminal device and storage medium
CN109862401A (en) * 2018-12-21 2019-06-07 深圳创维-Rgb电子有限公司 Real name register method, device, television set and the readable storage medium storing program for executing of account
CN111126124A (en) * 2019-10-12 2020-05-08 深圳壹账通智能科技有限公司 User identity authentication method and device for multi-party video and computer equipment
CN111340635A (en) * 2020-02-17 2020-06-26 中国平安人寿保险股份有限公司 Data checking method, equipment, server and readable storage medium
CN112528259A (en) * 2020-12-23 2021-03-19 平安普惠企业管理有限公司 Identity authentication method, identity authentication device, computer equipment and storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105491393A (en) * 2015-12-02 2016-04-13 北京暴风科技股份有限公司 Method for implementing multi-user live video business
WO2018113526A1 (en) * 2016-12-20 2018-06-28 四川长虹电器股份有限公司 Face recognition and voiceprint recognition-based interactive authentication system and method
CN108537501A (en) * 2018-03-22 2018-09-14 平安信托有限责任公司 Business witnesses method, apparatus, computer equipment and storage medium
CN109543507A (en) * 2018-09-29 2019-03-29 深圳壹账通智能科技有限公司 Identity identifying method, device, terminal device and storage medium
CN109862401A (en) * 2018-12-21 2019-06-07 深圳创维-Rgb电子有限公司 Real name register method, device, television set and the readable storage medium storing program for executing of account
CN111126124A (en) * 2019-10-12 2020-05-08 深圳壹账通智能科技有限公司 User identity authentication method and device for multi-party video and computer equipment
CN111340635A (en) * 2020-02-17 2020-06-26 中国平安人寿保险股份有限公司 Data checking method, equipment, server and readable storage medium
CN112528259A (en) * 2020-12-23 2021-03-19 平安普惠企业管理有限公司 Identity authentication method, identity authentication device, computer equipment and storage medium

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113438523A (en) * 2021-07-06 2021-09-24 江西大江传媒网络股份有限公司 Video exhibition and broadcasting intelligent analysis feedback system based on mobile internet
CN113706091A (en) * 2021-07-14 2021-11-26 广州赛宝认证中心服务有限公司 Intelligent remote auditing method, device, system, computer equipment and storage medium
CN113706091B (en) * 2021-07-14 2024-03-22 广州赛宝认证中心服务有限公司 Intelligent remote auditing method, device, system, computer equipment and storage medium

Also Published As

Publication number Publication date
CN113034110B (en) 2023-12-22

Similar Documents

Publication Publication Date Title
US11842740B2 (en) Seamless authentication and enrollment
US11636430B2 (en) Device, system and method for summarizing agreements
CN112333549B (en) Video processing method and device, electronic equipment and storage medium
AU2018354129B2 (en) System and method for automated online notarization meeting recovery
WO2021175019A1 (en) Guide method for audio and video recording, apparatus, computer device, and storage medium
CN104835266A (en) Business handling method and system of VTM
CN113034110B (en) Service processing method, system, medium and electronic equipment based on video auditing
CN110322317A (en) A kind of transaction data processing method, device, electronic equipment and medium
CN113706091B (en) Intelligent remote auditing method, device, system, computer equipment and storage medium
CN108765789A (en) Intelligence is opened an account robot and account-opening method
CN106228365A (en) A kind of method of payment and device
CN110138743A (en) Acquisition methods, device, computer equipment and the storage medium of resource bid file
CN109493078A (en) Payment system, method of payment and the second client terminal device
US20220199092A1 (en) Method for processing a payment transaction, and corresponding device, system and programs
CN113112232A (en) Online loan auditing method, auditing device, electronic equipment and storage medium
US10454914B2 (en) System and method for verifying user supplied items asserted about the user for searching
CN113221529A (en) Event investigation method and device
US20200089325A1 (en) Input Commands via Visual Cues
CN113487289B (en) Online payment method and device, computer readable storage medium and electronic equipment
CN116861393A (en) Business service verification method, device, computer equipment and storage medium
TW201935920A (en) Video conference inviting method and video conference service system
CN115438889A (en) Interactive service quality detection method, electronic device and computer storage medium
CN114387091A (en) Remote credit method, device, electronic equipment and storage medium
CN117808299A (en) Service handling method, device, equipment and medium
CN116991515A (en) Method, device, equipment, medium and product for displaying and creating appointment information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant