TW202019122A - Customer service video verification system and customer service video verification method - Google Patents

Customer service video verification system and customer service video verification method Download PDF

Info

Publication number
TW202019122A
TW202019122A TW107139232A TW107139232A TW202019122A TW 202019122 A TW202019122 A TW 202019122A TW 107139232 A TW107139232 A TW 107139232A TW 107139232 A TW107139232 A TW 107139232A TW 202019122 A TW202019122 A TW 202019122A
Authority
TW
Taiwan
Prior art keywords
image
customer service
feature
video verification
user
Prior art date
Application number
TW107139232A
Other languages
Chinese (zh)
Other versions
TWI736807B (en
Inventor
許繡鶴
王振宇
Original Assignee
兆豐國際商業銀行股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 兆豐國際商業銀行股份有限公司 filed Critical 兆豐國際商業銀行股份有限公司
Priority to TW107139232A priority Critical patent/TWI736807B/en
Publication of TW202019122A publication Critical patent/TW202019122A/en
Application granted granted Critical
Publication of TWI736807B publication Critical patent/TWI736807B/en

Links

Images

Abstract

A customer service video verification system, connected to an electronic device and a bank file system and having a communication unit, a processing unit and a video verification system is provided. The communication unit communicated to the electronic device and the bank file system. The processing unit receives a video verification request and a user identification information sent by the electronic device, and obtains a file information corresponding to the user identification information in the bank file system. The video verification system connected to processing unit. The processing unit activates the vide3o verification system in response to receiving a streaming image from the electronic device. The video verification system determines a similarity value for the streaming image according to the streaming image and the user identification information. The processing units receives and sends a verification result back to the electronic device.

Description

客服視訊驗證系統及客服視訊驗證方法Customer service video verification system and customer service video verification method

本發明是有關於一種提供身分認證的技術,且特別是有關於一種客服視訊驗證系統及客服視訊驗證方法。The invention relates to a technology for providing identity authentication, and in particular to a customer service video verification system and a customer service video verification method.

在數位化的時代,越來越多客戶傾向以網路取代臨櫃,以期能讓網路打破地點的限制,達到不論在哪裡都能使用各類金融服務的效果。然而,由於金融服務性質較為敏感且管制較多,倘若牽涉到使用者的權限變更、大筆金額交易或高風險交易時,使用者仍必須前往銀行臨櫃辦理。因此,如何能夠減少使用者的困擾,同時維持金融服務的安全性為本領域技術人員所致力的課題。In the era of digitalization, more and more customers tend to replace the counter with the Internet, in order to allow the Internet to break through the restrictions of the location and achieve the effect of using various financial services no matter where they are. However, due to the relatively sensitive nature of financial services and more controls, users must still go to the bank's counter to deal with changes in user permissions, large amounts of transactions, or high-risk transactions. Therefore, how to reduce the user's troubles while maintaining the security of financial services is a subject dedicated to those skilled in the art.

本發明提供一種客服視訊驗證系統及客服視訊驗證方法,用以讓使用者在維持安全性的情形下,突破空間與時間的限制進行金融服務。The present invention provides a customer service video verification system and a customer service video verification method for users to break through the limitations of space and time to perform financial services while maintaining security.

在本揭露的一實施例中,客服視訊驗證系統連接於電子裝置及銀行檔案系統,並具有通訊單元、處理單元及影像辨識系統。通訊單元通訊連接電子裝置及銀行檔案系統。處理單元連接於通訊單元,接收由電子裝置傳送的視訊驗證請求及使用者身分資訊,並且依據使用者身分資訊獲取銀行檔案系統中相應使用者身分資訊的檔案資訊。影像辨識系統連接至處理單元。處理單元還於通過通訊單元接收來自電子裝置的串流影像時,啟用影像辨識系統。影像辨識系統依據串流影像以及使用者身分資訊中的使用者影像辨識串流影像的相似程度值。處理單元接收驗證結果,並回傳驗證結果至電子裝置。In an embodiment of the present disclosure, the customer service video verification system is connected to the electronic device and the bank file system, and has a communication unit, a processing unit, and an image recognition system. The communication unit communicates with the electronic device and the bank file system. The processing unit is connected to the communication unit, receives the video verification request and the user identity information sent by the electronic device, and obtains the file information of the corresponding user identity information in the bank file system according to the user identity information. The image recognition system is connected to the processing unit. The processing unit also activates the image recognition system when receiving the streaming image from the electronic device through the communication unit. The image recognition system recognizes the similarity value of the stream image according to the stream image and the user image in the user identity information. The processing unit receives the verification result and returns the verification result to the electronic device.

在本揭露的一實施例中,客服視訊驗證方法適用於客服視訊驗證系統。且客服視訊驗證方法具有下列步驟。接收由電子裝置傳送的視訊驗證請求及使用者身分資訊;依據使用者身分資訊獲取銀行檔案系統中相應使用者身分資訊的檔案資訊;接收來自電子裝置的串流影像,並啟用客服視訊驗證系統中的影像辨識系統;由影像辨識系統依據串流影像以及檔案資訊中的使用者影像辨識串流影像的相似程度值;該處理單元接收驗證結果,並回傳驗證結果至該電子裝置,以使電子裝置依據驗證結果繼續服務程序。In an embodiment of the present disclosure, the customer service video verification method is applicable to the customer service video verification system. And the customer service video verification method has the following steps. Receive the video verification request and user identity information sent by the electronic device; obtain the file information of the corresponding user identity information in the bank file system based on the user identity information; receive the streaming image from the electronic device, and enable the customer service video verification system Image recognition system; the image recognition system recognizes the similarity value of the stream image according to the stream image and the user image in the file information; the processing unit receives the verification result and returns the verification result to the electronic device, so that the electronic The device continues the service procedure based on the verification result.

基於上述,本發明的客服視訊驗證系統以及客服視訊驗證方法提供線上的認證方法,以讓使用者在申辦銀行服務時,突破了時間與空間的限制,因而提升了用戶的便利性。此外,通過採用影像辨識系統給予相似值,可以輔助客服進行使用者身分確認,更提申了網路申辦金融服務的安全性。Based on the above, the customer service video verification system and the customer service video verification method of the present invention provide an online authentication method to allow users to break through the time and space restrictions when applying for banking services, thereby improving user convenience. In addition, by adopting an image recognition system to give similar values, it can assist the customer service to confirm the user's identity, and it also mentions the security of online bidding for financial services.

為讓本發明的上述特徵和優點能更明顯易懂,下文特舉實施例,並配合所附圖式作詳細說明如下。In order to make the above-mentioned features and advantages of the present invention more obvious and understandable, the embodiments are specifically described below in conjunction with the accompanying drawings for detailed description as follows.

圖1繪示本揭露一實施例客服視訊驗證系統的示意圖。請參照圖1,本揭露的客服視訊驗證系統100連接於電子裝置10以及銀行檔案系統20。FIG. 1 shows a schematic diagram of a customer service video verification system according to an embodiment of the disclosure. Please refer to FIG. 1. The disclosed customer service video verification system 100 is connected to the electronic device 10 and the bank file system 20.

電子裝置10例如為使用者所持有的終端裝置,例如,個人電腦、筆記型電腦、平板電腦或手機等,本揭露不限於此。The electronic device 10 is, for example, a terminal device held by a user, for example, a personal computer, a notebook computer, a tablet computer, a mobile phone, or the like, and the disclosure is not limited thereto.

銀行檔案系統20是用以儲存客戶的個人開戶的檔案資料以及後續在銀行進行服務所產生的相關資料,舉例來說,檔案資料具有使用者的姓名、身分證字號、出生年月日、帳號、開戶行、通關問題、帳戶交易明細以及身分證件影像,然本發明不限於此。The bank file system 20 is used to store the file data of the customer’s personal account opening and the related data generated by the subsequent service in the bank. For example, the file data has the user’s name, ID number, date of birth, account number, Account opening bank, customs clearance issues, account transaction details, and identity certificate images, but the invention is not limited to this.

客服視訊驗證系統100會以有線或者是無線的方式直接或透過其他伺服器間接連接於電子裝置10以及銀行檔案系統20,本揭露不限於此。The customer service video verification system 100 is directly or indirectly connected to the electronic device 10 and the bank file system 20 in a wired or wireless manner, and the disclosure is not limited thereto.

客服視訊驗證系統100具有通訊單元110、處理單元120以及影像辨識系統130。The customer service video verification system 100 has a communication unit 110, a processing unit 120, and an image recognition system 130.

通訊單元110用以傳送與接收各種資訊,特別是,通訊單元110會連接於電子裝置10以及銀行檔案系統20。The communication unit 110 is used to transmit and receive various information. In particular, the communication unit 110 is connected to the electronic device 10 and the bank file system 20.

在本揭露的實施例中,通訊單元110是採用通訊晶片進行實作,通訊晶片可為支援全球行動通信(Global System for Mobile communication, GSM)、個人手持式電話系統(Personal Handy-phone System, PHS)、碼多重擷取(Code Division Multiple Access, CDMA)系統、寬頻碼分多址(Wideband Code Division Multiple Access, WCDMA)系統、長期演進(Long Term Evolution, LTE)系統、全球互通微波存取(Worldwide interoperability for Microwave Access, WiMAX)系統、無線保真(Wireless Fidelity, Wi-Fi)系統或藍牙的信號傳輸的元件。In the embodiment of the present disclosure, the communication unit 110 is implemented by using a communication chip. The communication chip may be a global system for mobile communication (GSM) or a personal handy-phone system (PHS). ), Code Division Multiple Access (CDMA) system, Wideband Code Division Multiple Access (WCDMA) system, Long Term Evolution (LTE) system, Global Interoperable Microwave Access (Worldwide) Interoperability for Microwave Access (WiMAX) system, Wireless Fidelity (Wi-Fi) system or Bluetooth signal transmission component.

處理單元120連接於通訊單元110,並執行客服視訊驗證系統100的必要運算。處理單元例如為中央處理單元(Central Processing Unit,CPU),或是其他可程式化之一般用途或特殊用途的微處理器(Microprocessor)、數位信號處理器(Digital Signal Processor,DSP)、可程式化控制器、特殊應用積體電路(Application Specific Integrated Circuit,ASIC)或其他類似元件或上述元件的組合,本揭露不限於此。The processing unit 120 is connected to the communication unit 110 and executes necessary operations of the customer service video verification system 100. The processing unit is, for example, a central processing unit (Central Processing Unit, CPU), or other programmable general-purpose or special-purpose microprocessor (Microprocessor), digital signal processor (Digital Signal Processor, DSP), programmable The controller, the application specific integrated circuit (ASIC) or other similar components or the combination of the above components are not limited to this disclosure.

影像辨識系統130連接於處理單元120,並提供影像辨識的服務。特別是,影像辨識系統130可以進一步分析人臉的特徵點。影像辨識系統130例如是由具備分析人臉特徵點的運算能力的晶片或處理器來實現,本揭露不限於此。The image recognition system 130 is connected to the processing unit 120 and provides image recognition services. In particular, the image recognition system 130 can further analyze the feature points of the face. The image recognition system 130 is implemented by, for example, a chip or a processor having a computing capability for analyzing facial feature points, and the disclosure is not limited thereto.

需說明的是,客服視訊驗證系統100是位於客服端的系統,以協助客服人員進行視訊驗證。因此,在本揭露的一實施例中,處理單元120會提供並顯示使用者介面於客服端的螢幕,以提供各類資訊供客服人員參考。It should be noted that the customer service video verification system 100 is a system located on the customer service side to assist customer service personnel in performing video verification. Therefore, in an embodiment of the present disclosure, the processing unit 120 provides and displays a screen of the user interface on the customer service end to provide various types of information for the customer service personnel to refer to.

圖2繪示本揭露一實施例客服視訊驗證方法的流程圖。在本揭露的一實施例中,客服視訊驗證方法適用於圖1繪示的客服視訊驗證系統100,然本揭露不限於此。以下將同時搭配圖1與圖2對客服視訊提供方法進行說明。FIG. 2 shows a flowchart of a customer service video verification method according to an embodiment of the disclosure. In an embodiment of the present disclosure, the customer service video verification method is applicable to the customer service video verification system 100 shown in FIG. 1, but the disclosure is not limited thereto. The following will describe the method of providing customer service video together with FIG. 1 and FIG. 2.

需先說明的是,本揭露的客服視訊驗證方法是用以提供使用者在網路上執行服務流程(例如開戶、數位帳戶權限提升、高額轉帳、基金申購、高額換匯、掛失復原、金融卡補換發等)的過程中,對本人進行認證,以加強安全性。也就是說,客服視訊驗證系統100及客服視訊驗證方法會被應用於服務流程的其中一個步驟之中,然不限於此。It should be noted that the disclosed customer service video verification method is used to provide users with the implementation of service processes on the Internet (such as account opening, digital account permission enhancement, high-value transfer, fund purchase, high-value currency exchange, loss recovery, financial card supplement In the process of renewal, etc., authenticate yourself to enhance security. In other words, the customer service video verification system 100 and the customer service video verification method will be applied to one of the steps of the service process, but it is not limited to this.

因此,在使用者通過電子裝置10接入客服視訊驗證系統100前,使用者會在電子裝置10的媒介(例如,應用程式)上輸入自身的資料、申辦的服務,並且輸入必要的資訊。在本揭露的一實施例中,使用者必須要先完成在視訊驗證前的所有認證,才能將電子裝置10導引至客服視訊驗證系統100。倘若使用者無法完整的輸入在視訊驗證前的所有認證,電子裝置10將不會顯示視訊驗證請求的選項,而使電子裝置10傳送視訊驗證請求。基此,能夠避免客戶無理的進線客服要求驗證,減輕客服人員的人力。Therefore, before the user accesses the customer service video verification system 100 through the electronic device 10, the user enters his/her own data, bid services, and necessary information on the medium (eg, application) of the electronic device 10. In an embodiment of the present disclosure, the user must first complete all authentications before video verification before the electronic device 10 can be directed to the customer service video verification system 100. If the user cannot completely input all the certifications before the video verification, the electronic device 10 will not display the option of the video verification request, and the electronic device 10 sends the video verification request. Based on this, it can avoid unreasonable incoming customer service request verification and reduce the manpower of customer service personnel.

在步驟S210,由處理單元120接收電子裝置10傳送的視訊驗證請求及使用者身分資訊。具體來說,使用者身分資訊即為使用者在進線客服前,所輸入的部分或全部資料,例如姓名、生日、身分證字號等。In step S210, the processing unit 120 receives the video verification request and the user identity information sent by the electronic device 10. Specifically, the user identity information refers to some or all of the data entered by the user before entering the customer service, such as name, birthday, ID number, etc.

在步驟S220,由處理單元120通過通訊單元110,並依據使用者身分資訊獲取銀行檔案系統中相應使用者身分資訊的檔案資訊。詳細來說,為了要確認使用者身分,處理單元120會依據使用者身分資訊進一步獲取使用者在銀行資料庫中所建檔的檔案資訊,並進一步進行比對使用者身分資訊以及檔案資訊 。In step S220, the processing unit 120 passes through the communication unit 110 and obtains the file information of the corresponding user identity information in the bank file system according to the user identity information. In detail, in order to confirm the user's identity, the processing unit 120 will further obtain the file information of the file created by the user in the bank database according to the user identity information, and further compare the user identity information and the file information.

在本揭露的一實施例中,倘若檔案資訊與使用者身分資訊不一致,處理單元120會直接回傳進線失敗的訊息至電子裝置10。在本揭露的其他實施例中,倘若檔案資訊與使用者身分資訊不一致,處理單元120會允許電子裝置10進線,然而處理單元120會進一步提供警示訊息,以提示客服人員。In an embodiment of the present disclosure, if the file information and the user identity information are inconsistent, the processing unit 120 will directly return the incoming line failure message to the electronic device 10. In other embodiments of the present disclosure, if the file information is inconsistent with the user identity information, the processing unit 120 will allow the electronic device 10 to enter the line, however, the processing unit 120 will further provide a warning message to alert the customer service personnel.

在步驟S230,由處理單元120通過通訊單元110接收來自電子裝置10的串流影像,並啟用影像辨識系統130。在使用者身分資訊確認無誤,且獲取使用者身分資訊後,處理單元120會允許電子裝置10的串流影像串接至客服視訊驗證系統100。並且,處理單元120同時啟用影像辨識系統130,以對串流影像進行分析。In step S230, the processing unit 120 receives the streaming image from the electronic device 10 through the communication unit 110, and activates the image recognition system 130. After the user identity information is confirmed to be correct and the user identity information is obtained, the processing unit 120 allows the streaming image of the electronic device 10 to be serially connected to the customer service video verification system 100. Moreover, the processing unit 120 simultaneously activates the image recognition system 130 to analyze the streaming image.

在步驟S240,由影像辨識系統130依據串流影像以及使用者身分資訊中的使用者影像辨識串流影像的相似程度值。In step S240, the image recognition system 130 recognizes the similarity value of the stream image according to the stream image and the user image in the user identity information.

在本揭露的一實施例中,影像辨識系統130會擷取串流影像中的瞬間影像,並對瞬間影像進行臉部特徵分析,以獲取相應串流影像以及使用者影像的臉部特徵點。影像辨識系統130會比對相應串流影像的臉部特徵點是否相似於檔案資訊中的使用者影像的臉部特徵點。影像辨識系統130會依據比對結果,進一步辨識串流影像相較於檔案資訊中的使用者影像的相似程度值。In an embodiment of the present disclosure, the image recognition system 130 will capture the instantaneous image in the streaming image, and perform facial feature analysis on the instantaneous image to obtain the facial feature points of the corresponding streaming image and the user image. The image recognition system 130 compares whether the facial feature points of the corresponding streaming image are similar to the facial feature points of the user image in the file information. The image recognition system 130 will further recognize the similarity value of the stream image compared to the user image in the file information according to the comparison result.

在本揭露的一實施例中,影像辨識系統130是採用即時辨識的方式。影像辨識系統130不僅會對瞬間影像進行臉部特徵分析,更會對使用者的動作進行動作分析。具體來說,在使用者第一次進線至客服視訊驗證系統100進行驗證時,影像辨識系統130會分析並記錄使用者的動作特徵於銀行檔案系統20中的檔案資訊中,以作為相應使用者的預設動作特徵。藉此,之後使用者再次進線至客服視訊驗證系統100進行驗證時,影像辨識系統130即可由銀行檔案系統20的檔案資訊中讀取預設動作特徵,並比對預設動作特徵和串流影像的動作特徵,以依據比對結果辨識動作特徵相較於預設動作特徵的相似程度值。藉此,影像系統通過使用者的臉部特徵點以及動作特徵進行身分識別,加強了視訊驗證的安全性。In an embodiment of the present disclosure, the image recognition system 130 uses real-time recognition. The image recognition system 130 not only analyzes facial features of instantaneous images, but also analyzes actions of users. Specifically, when the user first enters the customer service video verification system 100 for verification, the image recognition system 130 analyzes and records the user's movement characteristics in the file information in the bank file system 20 for corresponding use The default action characteristics of the author. In this way, when the user enters the customer service video verification system 100 again for verification, the image recognition system 130 can read the default action characteristics from the file information of the bank file system 20, and compare the default action characteristics and the stream The motion feature of the image is to identify the similarity value of the motion feature compared to the preset motion feature according to the comparison result. In this way, the image system performs identity recognition through the user's facial feature points and motion features, which enhances the security of video verification.

除此之外,在本揭露的另一實施例中,客服視訊驗證系統100更具備聲紋辨識系統(未繪示),聲紋辨識系統連接於處理單元120,並辨識串流影像的聲紋特徵。具體來說,在使用者第一次進線至客服視訊驗證系統100進行驗證時,聲紋辨識系統會分析並記錄使用者的聲紋特徵於銀行檔案系統20的檔案資訊中的預設聲紋特徵。藉此,使用者再次進線至客服視訊驗證系統100進行驗證時,聲紋辨識系統會讀取預設聲紋特徵,並比對預設聲紋特徵及串流影像的聲紋特徵,以依據相應的比對結果辨識聲紋特徵相較於預設聲紋特徵的相似程度值。藉由通過使用者的臉部特徵點以及聲紋特徵進行身分識別,加強了視訊驗證的安全性。In addition, in another embodiment of the present disclosure, the customer service video verification system 100 further includes a voiceprint recognition system (not shown). The voiceprint recognition system is connected to the processing unit 120 and recognizes the voiceprint of the streaming image feature. Specifically, when the user enters the customer service video verification system 100 for the first time for verification, the voiceprint recognition system analyzes and records the user's voiceprint feature in the default voiceprint in the file information of the bank file system 20 feature. In this way, when the user enters the customer service video verification system 100 again for verification, the voiceprint recognition system will read the preset voiceprint features and compare the preset voiceprint features with the voiceprint features of the streaming image, based on The corresponding comparison results identify the similarity value of the voiceprint features compared to the preset voiceprint features. By performing identity recognition through the user's facial feature points and voiceprint features, the security of video verification is enhanced.

值得一提的是,在本揭露的實施例中,處理單元120會在客服人員與使用者進行視訊驗證的當下,直接將串流影像以及相似程度值整合在同一使用者介面中。藉此,客服人員可以立即依據相似程度值做出反應,以提升視訊驗證的效率。It is worth mentioning that, in the embodiment of the present disclosure, the processing unit 120 directly integrates the streaming image and the similarity value into the same user interface when the customer service personnel and the user perform video verification. In this way, the customer service staff can immediately respond based on the similarity value to improve the efficiency of video verification.

在步驟S250,由處理單元120接收驗證結果,並回傳驗證結果至電子裝置10,以使電子裝置10繼續完成服務程序。In step S250, the processing unit 120 receives the verification result and returns the verification result to the electronic device 10, so that the electronic device 10 continues to complete the service procedure.

在客服人員依據相似程度值確認使用者的身分為正常或異常後,客服人員會在客服視訊驗證系統100中回報驗證結果。此時,處理單元120會通過通訊單元110而將接收到的驗證結果回報至電子裝置10,以提供使用者在電子裝置10端繼續完成申辦服務的流程。After the customer service staff confirms that the user's identity is normal or abnormal according to the similarity value, the customer service staff will report the verification result in the customer service video verification system 100. At this time, the processing unit 120 reports the received verification result to the electronic device 10 through the communication unit 110 to provide the user with the process of completing the application service on the electronic device 10 side.

綜上所述,本發明的客服視訊驗證系統以及客服視訊驗證方法提供線上的認證方法,以讓使用者在申辦銀行服務時,突破了時間與空間的限制,因而提升了用戶的便利性。不僅如此,除了進行人工確認外,通過採用影像辨識系統給予相似值,可以提供標準一致且科學的人臉辨識結果,輔助客服進行確認。基此,更提申了網路申辦金融服務的安全性。In summary, the customer service video verification system and the customer service video verification method of the present invention provide an online authentication method to allow users to break through the time and space restrictions when applying for banking services, thereby improving user convenience. Not only that, in addition to manual confirmation, by using an image recognition system to give similar values, it can provide consistent and scientific face recognition results to assist customer service confirmation. Based on this, the security of online bidding for financial services is even more mentioned.

雖然本發明已以實施例揭露如上,然其並非用以限定本發明,任何所屬技術領域中具有通常知識者,在不脫離本發明的精神和範圍內,當可作些許的更動與潤飾,故本發明的保護範圍當視後附的申請專利範圍所界定者為準。Although the present invention has been disclosed as above with examples, it is not intended to limit the present invention. Any person with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of the present invention. The scope of protection of the present invention shall be subject to the scope defined in the appended patent application.

10:電子裝置20:銀行檔案系統100:客服視訊驗證系統110:通訊單元120:處理單元130:影像辨識系統S210~S250:步驟10: Electronic device 20: Bank file system 100: Customer service video verification system 110: Communication unit 120: Processing unit 130: Image recognition system S210~S250: Steps

圖1繪示本揭露一實施例客服視訊驗證系統的示意圖。 圖2繪示本揭露一實施例客服視訊驗證方法的流程圖。FIG. 1 shows a schematic diagram of a customer service video verification system according to an embodiment of the disclosure. FIG. 2 shows a flowchart of a customer service video verification method according to an embodiment of the disclosure.

10:電子裝置 10: Electronic device

20:銀行檔案系統 20: Bank File System

100:客服視訊驗證系統 100: Customer service video verification system

110:通訊單元 110: communication unit

120:處理單元 120: processing unit

130:影像辨識系統 130: Image recognition system

Claims (12)

一種客服視訊驗證系統,連接於一電子裝置及一銀行檔案系統,包括: 一通訊單元,通訊連接該電子裝置及該銀行檔案系統; 一處理單元,連接於該通訊單元,該處理單元接收由該電子裝置傳送的視訊驗證請求及使用者身分資訊,並且依據該使用者身分資訊獲取該銀行檔案系統中相應該使用者身分資訊的檔案資訊;以及 一影像辨識系統,連接至該處理單元,其中,該處理單元還於通過該通訊單元接收來自該電子裝置的串流影像,並啟用該影像辨識系統, 該影像辨識系統依據該串流影像以及該檔案資訊中的一使用者影像辨識該串流影像的相似程度值, 該處理單元接收一驗證結果,並回傳該驗證結果至該電子裝置,以使該電子裝置依據該驗證結果繼續一服務程序。A customer service video verification system, connected to an electronic device and a bank file system, includes: a communication unit that communicates with the electronic device and the bank file system; a processing unit that is connected to the communication unit, and the processing unit receives the A video verification request and user identity information sent by the electronic device, and obtaining file information corresponding to the user identity information in the bank file system according to the user identity information; and an image recognition system connected to the processing unit, wherein, The processing unit also receives the stream image from the electronic device through the communication unit and activates the image recognition system, the image recognition system recognizes the stream image based on the stream image and a user image in the file information The similarity value of, the processing unit receives a verification result, and returns the verification result to the electronic device, so that the electronic device continues a service process based on the verification result. 如申請專利範圍第1項所述的客服視訊驗證系統,其中該處理單元提供一使用者介面,並整合該串流影像及該相似程度值於該使用者介面。The customer service video verification system described in item 1 of the patent application scope, wherein the processing unit provides a user interface, and integrates the streaming image and the similarity value in the user interface. 如申請專利範圍第2項所述的客服視訊驗證系統,其中,該處理單元還比對使用者身分資訊以及檔案資訊,若檔案資訊與使用者身分資訊不一致,該處理單元回傳一進線失敗的訊息至該電子裝置,或提供一警示訊息於該使用者介面。The customer service video verification system as described in item 2 of the patent application scope, in which the processing unit also compares user identity information and file information, if the file information and the user identity information are inconsistent, the processing unit fails to return an incoming line Message to the electronic device, or provide a warning message to the user interface. 如申請專利範圍第1項所述的客服視訊驗證系統,其中, 該影像辨識系統擷取串流影像中的瞬間影像,並對該瞬間影像以及該使用者影像進行臉部特徵分析,以獲取相應該瞬間影像及該使用者影像的該臉部特徵點, 該影像辨識系統還比對該串流影像的該臉部特徵點以及該檔案資訊中該使用者影像的臉部特徵點,並依據比對結果辨識該串流影像相較於該使用者影像的該相似程度值。The customer service video verification system as described in item 1 of the patent scope, wherein the image recognition system captures the instantaneous image in the streaming image, and performs facial feature analysis on the instantaneous image and the user image to obtain the phase The facial feature points of the instant image and the user image should be compared with the facial feature points of the streaming image and the facial feature points of the user image in the file information based on the ratio. Identify the similarity value of the stream image compared to the user image for the result. 如申請專利範圍第4項所述的客服視訊驗證系統,其中, 該影像辨識系統還辨識該串流影像中的一動作特徵,並儲存該動作特徵為該銀行檔案系統的該檔案資訊中的一預設動作特徵, 該影像辨識系統還讀取該預設動作特徵,並比對該預設動作特徵及該串流影像的該動作特徵,以依據相應的比對結果辨識該動作特徵相較於該預設動作特徵的該相似程度值。The customer service video verification system as described in item 4 of the patent application scope, wherein the image recognition system also recognizes an action feature in the streaming image and stores the action feature as one of the file information of the bank file system Preset motion feature, the image recognition system also reads the preset motion feature, and compares the preset motion feature with the motion feature of the streaming image to identify the motion feature based on the corresponding comparison result compared to The similarity value of the preset action feature. 如申請專利範圍第4項所述的客服視訊驗證系統,更包括: 聲紋辨識系統,連接於該處理單元,辨識該串流影像的聲紋特徵,並儲存該聲紋特徵為該銀行檔案系統的該檔案資訊中的一預設聲紋特徵, 該聲紋辨識系統還讀取該預設聲紋特徵,並比對預設聲紋特徵以及該串流影像的該聲紋特徵,以依據相應的比對結果辨識該聲紋特徵相較於該預設聲紋特徵的該相似程度值。The customer service video verification system as described in item 4 of the patent application scope further includes: a voiceprint recognition system, connected to the processing unit, to recognize the voiceprint feature of the streaming image, and store the voiceprint feature as the bank file system A preset voiceprint feature in the file information of the file, the voiceprint recognition system also reads the preset voiceprint feature, and compares the preset voiceprint feature and the voiceprint feature of the streaming image, according to the corresponding The comparison result of identifies the similarity value of the voiceprint feature compared to the preset voiceprint feature. 一種客服視訊驗證方法,適用於一客服視訊驗證系統,該方法包括: 接收由一電子裝置傳送的視訊驗證請求及使用者身分資訊; 依據該使用者身分資訊獲取該銀行檔案系統中相應該使用者身分資訊的檔案資訊; 接收來自該電子裝置的串流影像,並啟用該客服視訊驗證系統中的一影像辨識系統; 由該影像辨識系統依據該串流影像以及該檔案資訊中的一使用者影像辨識該串流影像的相似程度值; 由該處理單元接收一驗證結果,並回傳該驗證結果至該電子裝置,以使該電子裝置依據該驗證結果繼續一服務程序。A customer service video verification method is suitable for a customer service video verification system. The method includes: receiving a video verification request and user identity information transmitted by an electronic device; obtaining the corresponding user in the bank file system according to the user identity information File information of identity information; receiving streaming images from the electronic device, and enabling an image recognition system in the customer service video verification system; the image recognition system according to the streaming image and a user image in the file information Recognize the similarity value of the streaming image; receive a verification result by the processing unit, and return the verification result to the electronic device, so that the electronic device continues a service process based on the verification result. 如申請專利範圍第7項所述的客服視訊驗證方法,更包括: 提供一使用者介面,並整合該串流影像及該相似程度值於該使用者介面。The customer service video verification method described in item 7 of the patent application scope further includes: providing a user interface, and integrating the streaming image and the similarity value in the user interface. 如申請專利範圍第8項所述的客服視訊驗證方法,更包括: 比對使用者身分資訊以及檔案資訊;以及 若檔案資訊與使用者身分資訊不一致,回傳一進線失敗的訊息至該電子裝置,或提供一警示訊息於該使用者介面。The customer service video verification method described in item 8 of the patent application scope further includes: comparing user identity information and file information; and if the file information is inconsistent with the user identity information, return a message that an incoming line fails to the electronic Device, or provide a warning message to the user interface. 如申請專利範圍第7項所述的客服視訊驗證方法,其中,於由該影像辨識系統依據該串流影像以及該檔案資訊中的該使用者影像辨識該串流影像的相似程度值的步驟中,還包括: 由該影像辨識系統擷取串流影像中的瞬間影像,並對該瞬間影像以及該使用者影像進行臉部特徵分析,以獲取相應該瞬間影像及該使用者影像的臉部特徵點;以及 由該影像辨識系統比對該串流影像的該臉部特徵點以及該檔案資訊中該使用者影像的該臉部特徵點,並依據比對結果辨識該串流影像相較於該使用者影像的該相似程度值。The customer service video verification method as described in item 7 of the patent application scope, wherein in the step of identifying the similarity value of the streaming image by the image recognition system based on the streaming image and the user image in the file information And also includes: capturing the instant image in the streaming image by the image recognition system, and performing facial feature analysis on the instant image and the user image to obtain facial features corresponding to the instant image and the user image Points; and the facial feature points of the stream image and the facial feature points of the user image in the file information are compared by the image recognition system, and the stream image is identified according to the comparison result compared to the The similarity value of the user image. 如申請專利範圍第10項所述的客服視訊驗證方法,更包括: 由該影像辨識系統辨識該串流影像中的一動作特徵,並儲存該動作特徵為該銀行檔案系統的該檔案資訊中的一預設動作特徵;以及 由該影像辨識系統讀取該預設動作特徵,並比對該預設動作特徵及該串流影像的該動作特徵,以依據相應的比對結果辨識該動作特徵相較於該預設動作特徵的該相似程度值。The customer service video verification method described in item 10 of the patent application scope further includes: recognizing an action feature in the streaming image by the image recognition system, and storing the action feature in the file information of the bank file system A preset action feature; and the image recognition system reads the preset action feature and compares the preset action feature with the action feature of the streaming image to identify the action feature phase according to the corresponding comparison result The similarity value compared to the preset action feature. 如申請專利範圍第10項所述的客服視訊驗證方法,其中該客服視訊驗證系統更包括一聲紋辨識系統,且該客服視訊驗證方法包括: 由該客服視訊驗證系統的該聲紋辨識系統,辨識該串流影像的聲紋特徵,並儲存該聲紋特徵為該銀行檔案系統的該檔案資訊中的一預設聲紋特徵;以及 由該聲紋辨識系統讀取該預設聲紋特徵,並比對預設聲紋特徵以及該串流影像的該聲紋特徵,以依據相應的比對結果辨識該聲紋特徵相較於該預設聲紋特徵的該相似程度值。The customer service video verification method as described in item 10 of the patent application scope, wherein the customer service video verification system further includes a voiceprint recognition system, and the customer service video verification method includes: the voiceprint recognition system by the customer service video verification system, Recognizing the voiceprint feature of the streaming image, and storing the voiceprint feature as a preset voiceprint feature in the file information of the bank file system; and reading the preset voiceprint feature by the voiceprint recognition system, And compare the preset voiceprint feature and the voiceprint feature of the streaming image to identify the similarity value of the voiceprint feature compared to the preset voiceprint feature according to the corresponding comparison result.
TW107139232A 2018-11-06 2018-11-06 Customer service video verification system and customer service video verification method TWI736807B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW107139232A TWI736807B (en) 2018-11-06 2018-11-06 Customer service video verification system and customer service video verification method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW107139232A TWI736807B (en) 2018-11-06 2018-11-06 Customer service video verification system and customer service video verification method

Publications (2)

Publication Number Publication Date
TW202019122A true TW202019122A (en) 2020-05-16
TWI736807B TWI736807B (en) 2021-08-21

Family

ID=71895834

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107139232A TWI736807B (en) 2018-11-06 2018-11-06 Customer service video verification system and customer service video verification method

Country Status (1)

Country Link
TW (1) TWI736807B (en)

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI557004B (en) * 2014-01-10 2016-11-11 Utechzone Co Ltd Identity authentication system and its method
TWI591587B (en) * 2016-11-11 2017-07-11 南開科技大學 Cardless cash withdrawal system and method thereof

Also Published As

Publication number Publication date
TWI736807B (en) 2021-08-21

Similar Documents

Publication Publication Date Title
US20190034934A1 (en) Biometric payment
US10747866B2 (en) Transaction approval based on a scratch pad
WO2020211388A1 (en) Behavior prediction method and device employing prediction model, apparatus, and storage medium
US20220122051A1 (en) Method and system for securing transactions in a point of sale
US10055734B2 (en) Systems and methods for processing customer purchase transactions using biometric data
US20190087825A1 (en) Systems and methods for provisioning biometric templates to biometric devices
US20170243225A1 (en) Systems and methods for using multi-party computation for biometric authentication
US20140279516A1 (en) Authenticating a physical device
US20170169435A1 (en) Method and system for authorizing a transaction
US20210304316A1 (en) System, Method, and Computer Program Product for Patient Authentication and Identity Risk Assessment
WO2018111539A1 (en) Systems and methods for use in authenticating consumers in connection with payment account transactions
CN109426963B (en) Biometric system for authenticating biometric requests
WO2019083500A1 (en) System, method, and apparatus for automatically encoding data in an electronic communication
US20210398141A1 (en) Systems and methods for preempting customer acceptance of predatory loan offers and fraudulent transactions
US20220391913A1 (en) Techniques to improve fraud detection at financial terminals
WO2018156276A1 (en) Systems and methods for use in providing enhanced authentication of consumers
KR102447899B1 (en) System and method for non-face-to-face identification kyc solution
WO2015145727A1 (en) Personal information acquisition system and personal information acquisition method
TWI736807B (en) Customer service video verification system and customer service video verification method
TWM591664U (en) Electronic device for performing identity registration procedure
TWM573485U (en) Customer service video verification system
TWI736942B (en) Biometric transaction method and biometric transaction system
TW202107309A (en) Electronic device and method for performing identity registration procedure
KR20140011522A (en) Method and apparatus for performing electronic finance transaction using face recognition
TWI718541B (en) Identity verification system and method for financial transactions