TW202230246A - Service processing method and device based on terminal attitude - Google Patents

Service processing method and device based on terminal attitude Download PDF

Info

Publication number
TW202230246A
TW202230246A TW110142670A TW110142670A TW202230246A TW 202230246 A TW202230246 A TW 202230246A TW 110142670 A TW110142670 A TW 110142670A TW 110142670 A TW110142670 A TW 110142670A TW 202230246 A TW202230246 A TW 202230246A
Authority
TW
Taiwan
Prior art keywords
terminal
posture
determined
gesture
code
Prior art date
Application number
TW110142670A
Other languages
Chinese (zh)
Inventor
祖立軍
鄒奮
王琪
Original Assignee
大陸商中國銀聯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 大陸商中國銀聯股份有限公司 filed Critical 大陸商中國銀聯股份有限公司
Publication of TW202230246A publication Critical patent/TW202230246A/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/30Payment architectures, schemes or protocols characterised by the use of specific devices or networks
    • G06Q20/32Payment architectures, schemes or protocols characterised by the use of specific devices or networks using wireless devices
    • G06Q20/327Short range or proximity payments by means of M-devices
    • G06Q20/3274Short range or proximity payments by means of M-devices using a pictured code, e.g. barcode or QR-code, being displayed on the M-device

Abstract

The invention discloses a service processing method and device based on a terminal attitude, and the method comprises the steps: obtaining the attitude of a terminal, and the attitude comprises a first attitude and a second attitude; and according to the first attitude and the second attitude of the terminal, determining the type of collection equipment, and calling a two-dimensional code of a preset application program to perform service processing. The two-dimensional code of the APP is automatically called according to the attitude of the terminal and the type of the collection equipment, any click operation of a user is not needed, the two-dimensional code display efficiency is improved, the terminal service processing capacity is improved, and the user experience is improved.

Description

一種基於終端姿態的業務處理方法及裝置A service processing method and device based on terminal attitude

本發明屬於終端支付技術領域,尤其關於一種基於終端姿態的業務處理方法及裝置。The invention belongs to the technical field of terminal payment, and in particular relates to a terminal gesture-based service processing method and device.

目前二維碼支付已經較為普遍,在被掃場景中,需要使用者在手機上進行多步點擊操作後才能顯示出二維碼。例如打開相關支付APP(Application,應用程式),點擊顯示介面“付款”按鈕後,顯示出付款二維碼。上述顯示二維碼的方式都需要使用者在支付前進行多步手動點擊操作,影響了用戶體驗。At present, QR code payment is relatively common. In the scanned scene, the user needs to perform multi-step click operations on the mobile phone to display the QR code. For example, open the relevant payment APP (Application), click the "Payment" button on the display interface, and the payment QR code will be displayed. The above methods of displaying the QR code all require the user to perform multi-step manual click operations before payment, which affects the user experience.

本發明實施例提供一種基於終端姿態的業務處理方法及裝置,用以提高終端支付的效率,提升用戶體驗。Embodiments of the present invention provide a terminal gesture-based service processing method and device, so as to improve the efficiency of terminal payment and improve user experience.

第一方面,本發明實施例提供一種基於終端姿態的業務處理方法,包括: 獲取終端的姿態,該姿態包括第一姿態和第二姿態; 根據該終端的第一姿態和第二姿態,確定收款設備的類型,並調用預設的應用程式的二維碼進行業務處理。 In a first aspect, an embodiment of the present invention provides a terminal gesture-based service processing method, including: acquiring a posture of the terminal, the posture includes a first posture and a second posture; According to the first posture and the second posture of the terminal, the type of the payment device is determined, and the two-dimensional code of the preset application program is called for business processing.

上述技術方案中,通過依據終端的姿態和收款設備的類型,自動調用APP的二維碼,無需用戶任何的點擊操作,提高了二維碼展示效率,從而提高了終端業務處理能力,提升用戶體驗。In the above technical solution, by automatically calling the two-dimensional code of the APP according to the posture of the terminal and the type of the payment device, without any click operation by the user, the display efficiency of the two-dimensional code is improved, thereby improving the terminal business processing capability and improving the user. experience.

可選的,該根據該終端的第一姿態和第二姿態,確定收款設備的類型,並調用預設的應用程式的二維碼進行業務處理,包括: 在確定該終端的姿態為該第一姿態時,通過該終端的攝像頭獲取該收款設備的掃描資訊,並對該掃描資訊進行識別,確定該收款設備的類型; 在確定該收款設備的類型為掃碼盒子且確定該終端的姿態為該第二姿態時,調用該預設的應用程式的二維碼進行業務處理。 Optionally, the type of the payment device is determined according to the first posture and the second posture of the terminal, and the QR code of the preset application is called for business processing, including: When it is determined that the posture of the terminal is the first posture, the scanning information of the payment device is acquired through the camera of the terminal, and the scanning information is identified to determine the type of the payment device; When it is determined that the type of the payment device is a scan code box and the posture of the terminal is determined to be the second posture, the two-dimensional code of the preset application is called for business processing.

可選的,該根據該終端的第一姿態和第二姿態,確定收款設備的類型,並調用預設的應用程式的二維碼進行業務處理,包括: 在確定該終端的姿態為該第一姿態且在預設時間間隔內該終端的姿態為該第二姿態時,通過該終端的攝像頭獲取該收款設備的掃描資訊,並對該掃描資訊進行識別,確定該收款設備的類型; 在確定該收款設備的類型為掃碼盒子時,直接調用該預設的應用程式的二維碼進行業務處理。 Optionally, the type of the payment device is determined according to the first posture and the second posture of the terminal, and the QR code of the preset application is called for business processing, including: When it is determined that the posture of the terminal is the first posture and the posture of the terminal is the second posture within the preset time interval, the scanning information of the payment device is acquired through the camera of the terminal, and the scanning information is identified. , to determine the type of the collection device; When it is determined that the type of the payment device is a scan code box, the QR code of the preset application program is directly invoked for business processing.

可選的,該對該掃描資訊進行識別,確定該收款設備的類型,包括: 通過訓練好的人工智慧AI識別演算法對該掃描資訊進行識別,確定該收款設備的類型。 Optionally, the scanning information is identified to determine the type of the payment device, including: The scanned information is recognized by the trained artificial intelligence AI recognition algorithm, and the type of the payment device is determined.

可選的,該第一姿態為翻轉狀態或正面放置的傾斜狀態。Optionally, the first posture is a flipped state or a tilted state placed on the front.

可選的,該方法還包括: 若該收款設備的類型為掃碼槍,則在確定該終端的傾角為預設角度時,調用該預設的應用程式的二維碼進行業務處理。 Optionally, the method further includes: If the type of the payment device is a code scanner, when it is determined that the inclination angle of the terminal is a preset angle, the QR code of the preset application is called for business processing.

可選的,該終端的姿態還包括第三姿態; 在調用預設的應用程式的二維碼進行業務處理之後,還包括: 在確定該終端的姿態為第三姿態時,切換應用程式,並調用切換後的應用程式的二維碼進行業務處理。 Optionally, the posture of the terminal further includes a third posture; After calling the QR code of the preset application for business processing, it also includes: When it is determined that the posture of the terminal is the third posture, the application program is switched, and the two-dimensional code of the switched application program is called for business processing.

第二方面,本發明實施例提供一種基於終端姿態的業務處理裝置,包括: 獲取單元,用於獲取終端的姿態,該姿態包括第一姿態和第二姿態; 處理單元,用於根據該終端的第一姿態和第二姿態,確定收款設備的類型,並調用預設的應用程式的二維碼進行業務處理。 In a second aspect, an embodiment of the present invention provides a terminal gesture-based service processing device, including: an acquisition unit, used for acquiring the posture of the terminal, the posture includes a first posture and a second posture; The processing unit is used for determining the type of the payment device according to the first posture and the second posture of the terminal, and calling the two-dimensional code of the preset application program for business processing.

可選的,該處理單元具體用於: 在確定該終端的姿態為該第一姿態時,通過該終端的攝像頭獲取該收款設備的掃描資訊,並對該掃描資訊進行識別,確定該收款設備的類型; 在確定該收款設備的類型為掃碼盒子且確定該終端的姿態為該第二姿態時,調用該預設的應用程式的二維碼進行業務處理。 Optionally, the processing unit is specifically used for: When it is determined that the posture of the terminal is the first posture, the scanning information of the payment device is acquired through the camera of the terminal, and the scanning information is identified to determine the type of the payment device; When it is determined that the type of the payment device is a scan code box and the posture of the terminal is determined to be the second posture, the two-dimensional code of the preset application is called for business processing.

可選的,該處理單元具體用於: 在確定該終端的姿態為該第一姿態且在預設時間間隔內該終端的姿態為該第二姿態時,通過該終端的攝像頭獲取該收款設備的掃描資訊,並對該掃描資訊進行識別,確定該收款設備的類型; 在確定該收款設備的類型為掃碼盒子時,直接調用該預設的應用程式的二維碼進行業務處理。 Optionally, the processing unit is specifically used for: When it is determined that the posture of the terminal is the first posture and the posture of the terminal is the second posture within the preset time interval, the scanning information of the payment device is acquired through the camera of the terminal, and the scanning information is identified. , to determine the type of the collection device; When it is determined that the type of the payment device is a scan code box, the QR code of the preset application program is directly invoked for business processing.

可選的,該處理單元具體用於: 通過訓練好的AI識別演算法對該掃描資訊進行識別,確定該收款設備的類型。 Optionally, the processing unit is specifically used for: The scanned information is recognized by the trained AI recognition algorithm, and the type of the payment device is determined.

可選的,該第一姿態為翻轉狀態或正面放置的傾斜狀態。Optionally, the first posture is a flipped state or a tilted state placed on the front.

可選的,該處理單元還用於: 若該收款設備的類型為掃碼槍,則在確定該終端的傾角為預設角度時,調用該預設的應用程式的二維碼進行業務處理。 Optionally, the processing unit is also used to: If the type of the payment device is a code scanner, when it is determined that the inclination angle of the terminal is a preset angle, the QR code of the preset application is called for business processing.

可選的,該終端的姿態還包括第三姿態; 該處理單元還用於: 該調用預設的應用程式的二維碼進行業務處理之後,在確定該終端的姿態為第三姿態時,切換應用程式,並調用切換後的應用程式的二維碼進行業務處理。 Optionally, the posture of the terminal further includes a third posture; The processing unit is also used to: After calling the two-dimensional code of the preset application program for business processing, when it is determined that the posture of the terminal is the third posture, the application program is switched, and the two-dimensional code of the switched application program is called for business processing.

第三方面,本發明實施例還提供一種計算設備,包括: 記憶體,用於存儲程式指令; 處理器,用於調用該記憶體中存儲的程式指令,按照獲得的程式執行上述基於終端姿態的業務處理方法。 In a third aspect, an embodiment of the present invention further provides a computing device, including: memory, used to store program instructions; The processor is configured to call the program instruction stored in the memory, and execute the above-mentioned service processing method based on the terminal posture according to the obtained program.

第四方面,本發明實施例還提供一種電腦可讀非揮發性存儲介質,包括電腦可讀指令,當電腦讀取並執行該電腦可讀指令時,使得電腦執行上述基於終端姿態的業務處理方法。In a fourth aspect, an embodiment of the present invention also provides a computer-readable non-volatile storage medium, including a computer-readable instruction, when the computer reads and executes the computer-readable instruction, the computer executes the above-mentioned terminal gesture-based business processing method .

為利 貴審查委員了解本發明之技術特徵、內容與優點及其所能達到之功效,茲將本發明配合附圖及附件,並以實施例之表達形式詳細說明如下,而其中所使用之圖式,其主旨僅為示意及輔助說明書之用,未必為本發明實施後之真實比例與精準配置,故不應就所附之圖式的比例與配置關係解讀、侷限本發明於實際實施上的申請範圍,合先敘明。In order to facilitate the examiners to understand the technical features, content and advantages of the present invention and the effects that can be achieved, the present invention is hereby described in detail as follows in the form of embodiments with the accompanying drawings and accessories, and the drawings used therein , the purpose of which is only for illustration and auxiliary description, and may not necessarily be the real scale and precise configuration after the implementation of the present invention. Therefore, the proportion and configuration relationship of the attached drawings should not be interpreted or limited to the application of the present invention in actual implementation. Scope, to be described first.

在本發明的描述中,需要理解的是,術語「中心」、「橫向」、「上」、「下」、「左」、「右」、「頂」、「底」、「內」、「外」等指示的方位或位置關係為基於圖式所示的方位或位置關係,僅是為了便於描述本發明和簡化描述,而不是指示或暗示所指的裝置或元件必須具有特定的方位、以特定的方位構造和操作,因此不能理解為對本發明的限制。In the description of the present invention, it should be understood that the terms "center", "lateral", "top", "bottom", "left", "right", "top", "bottom", "inside", " The orientation or positional relationship indicated by "outside" is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the indicated device or element must have a specific orientation, so as to The specific orientation configuration and operation are therefore not to be construed as limitations of the present invention.

圖1為本發明實施例提供的一種系統架構。如圖1所示,該系統架構可以包括使用者手機和商戶兩大部分。FIG. 1 is a system architecture provided by an embodiment of the present invention. As shown in Figure 1, the system architecture can include two parts: the user's mobile phone and the merchant.

1)用戶手機。1) User mobile phone.

(1)硬體層 主要包含攝像頭、陀螺儀、AI(Artificial Intelligence,人工智慧)晶片等,攝像頭用於採集圖像資訊,陀螺儀用於採集手機姿態資訊,AI晶片為物識別AI演算法模型提供運行基礎。 (1) Hardware layer It mainly includes cameras, gyroscopes, AI (Artificial Intelligence, artificial intelligence) chips, etc. The camera is used to collect image information, the gyroscope is used to collect mobile phone attitude information, and the AI chip provides the operating basis for the object recognition AI algorithm model.

(2)系統層 資訊採集及控制模組用於控制系統硬體採集相關圖像、姿態資訊,並將相關資訊作為參數傳輸給系統應用中物識別AI演算法模型用於分析。 (2) System layer The information collection and control module is used to control the hardware of the system to collect relevant images and attitude information, and transmit the relevant information as parameters to the AI algorithm model for object recognition in the system application for analysis.

(3)應用層 對接系統應用,集成相關支付SDK(Software Development Kit,軟體開發套件)或APP(Application,應用程式),當物識別AI演算法模型分析結果表明可以顯示二維碼時,調用相關SDK或APP介面顯示二維碼用於業務處理。 (3) Application layer Docking the system application, integrating the relevant payment SDK (Software Development Kit, software development kit) or APP (Application, application program), when the analysis result of the object recognition AI algorithm model shows that the QR code can be displayed, call the relevant SDK or APP interface to display QR codes are used for business processing.

2)商戶2) Merchant

(1)掃碼盒子等收款設備。 當用戶展示二維碼後,通過掃碼盒子、掃碼槍等收款設備讀取二維碼資訊,並將資訊傳輸至商戶後臺。其中,掃碼盒子可以如圖2所示結構,該掃碼盒子可以放置在店鋪的桌面上,其上部為掃碼視窗,使用者展示二維碼的時候需要翻轉手機,手機的顯示幕朝向掃碼盒子的掃碼視窗才可以掃碼成功。圖3所示的是掃碼槍的一種結構,該掃碼槍為手持設備,需要收款人員手持操作,手持時掃碼視窗是朝下的,此時手機需要處於傾斜狀態,將顯示幕朝向掃碼視窗。 (1) Scanning box and other payment equipment. After the user displays the QR code, the QR code information is read through the scanning box, scanning gun and other payment devices, and the information is transmitted to the merchant's background. Among them, the scan code box can be structured as shown in Figure 2, the scan code box can be placed on the desktop of the store, and the upper part of the scan code box is a scan code window. Only the scan code window of the code box can scan the code successfully. Figure 3 shows a structure of the code scanning gun. The code scanning gun is a handheld device and needs to be hand-held by the payee. When hand-held, the code scanning window is facing down. At this time, the mobile phone needs to be in a tilted state, and the display screen is facing Scanning window.

(2)商戶後臺 負責下訂單並將交易上送至相關支付機構或系統。 (2) Merchant background Responsible for placing the order and sending the transaction to the relevant payment institution or system.

需要說明的是,上述圖1所示的結構僅是一種示例,本發明實施例對此不做限定。It should be noted that the structure shown in FIG. 1 above is only an example, which is not limited in this embodiment of the present invention.

基於上述描述,圖4詳細的示出了本發明實施例提供的一種基於終端姿態的業務處理方法的流程,該流程可以由基於終端姿態的業務處理裝置執行。Based on the above description, FIG. 4 shows in detail a flow of a terminal gesture-based service processing method provided by an embodiment of the present invention, and the flow may be executed by a terminal gesture-based service processing apparatus.

如圖4所示,該流程具體包括: 步驟401,獲取終端的姿態,該姿態包括第一姿態和第二姿態。 As shown in Figure 4, the process specifically includes: Step 401: Obtain a posture of the terminal, where the posture includes a first posture and a second posture.

在本發明實施例中,終端的第一姿態可以為翻轉姿態或正面放置的傾斜姿態,第二姿態可以為上下擺動或左右擺動的姿態,終端的姿態可以通過終端內置的陀螺儀來識別,例如終端翻轉預設角度後,可以確認為是翻轉姿態。終端的顯示幕的正面的前端傾斜一定角度時,可以認為是正面放置的傾斜姿態,如圖5所示。該預設角度和一定角度可以依據經驗設置。如圖6所示,圖6中a圖是上下擺動的姿態,圖6中b圖為左右擺動的姿態。In this embodiment of the present invention, the first posture of the terminal may be a flipping posture or an inclined posture placed on the front side, the second posture may be a posture of swinging up and down or swinging left and right, and the posture of the terminal may be recognized by the built-in gyroscope of the terminal, for example After the terminal flips the preset angle, it can be confirmed as a flipped posture. When the front end of the front of the display screen of the terminal is inclined at a certain angle, it can be considered as an inclined posture of being placed on the front, as shown in FIG. 5 . The preset angle and a certain angle can be set according to experience. As shown in FIG. 6 , picture a in FIG. 6 is a posture of swinging up and down, and picture b in FIG. 6 is a posture of swinging left and right.

需要說明的是,該第一姿態還可以設置為終端的顯示介面的解鎖動作,即顯示介面處於鎖定狀態時,此時收到終端的第一姿態時,可以確認是解釋動作,調用解鎖指令,解除顯示介面的鎖定狀態。It should be noted that the first gesture can also be set as the unlocking action of the display interface of the terminal, that is, when the display interface is in a locked state, when the first gesture of the terminal is received at this time, it can be confirmed that it is an interpretation action, and the unlocking command can be called. Unlock the display interface.

步驟402,根據該終端的第一姿態和第二姿態,確定收款設備的類型,並調用預設的應用程式的二維碼進行業務處理。Step 402 , according to the first posture and the second posture of the terminal, determine the type of the payment device, and call the two-dimensional code of the preset application program for business processing.

具體的可以分為以下兩種方式來描述:Specifically, it can be described in the following two ways:

方式一: 在確定終端的姿態為第一姿態時,通過終端的攝像頭獲取收款設備的掃描資訊,對掃描資訊進行識別,確定收款設備的類型。然後在確定收款設備的類型為掃碼盒子且確定終端的姿態為第二姿態時,調用預設的應用程式的二維碼進行業務處理。 method one: When it is determined that the posture of the terminal is the first posture, the scanning information of the payment device is acquired through the camera of the terminal, the scanning information is identified, and the type of the payment device is determined. Then, when it is determined that the type of the payment device is a code-scanning box and the posture of the terminal is determined to be the second posture, the QR code of the preset application is called for business processing.

當第一姿態為翻轉姿態時,可以通過終端的前置攝像頭獲取收款設備的掃描資訊。即啟用前置攝像頭來獲取收款設備的圖像資訊。When the first posture is the flip posture, the scanning information of the payment device can be obtained through the front camera of the terminal. That is, enable the front camera to obtain the image information of the payment device.

當第一姿態為證明放置的傾斜姿態時,可以通過終端的前置攝像頭獲取收款設備的掃描資訊。需要說明的是,在獲取收款設備的掃描資訊時,可以也可以通過後置攝像頭來採集,在實際應用時,可以依據經驗來選擇。When the first posture is an inclined posture for proving placement, the scanning information of the payment device can be obtained through the front camera of the terminal. It should be noted that, when acquiring the scanning information of the payment device, it can also be collected through the rear camera, and in practical application, it can be selected based on experience.

收款設備的類型可以包括掃碼盒子和掃碼槍兩種類型。The types of payment equipment can include two types: scan code box and scan code gun.

可以通過訓練好的AI識別演算法對掃描資訊進行識別,得到收款設備的類型。The scanned information can be recognized by the trained AI recognition algorithm to obtain the type of the payment device.

其中,訓練好的AI識別演算法是經過機器學習訓練後的物識別AI演算法。Among them, the trained AI recognition algorithm is the object recognition AI algorithm trained by machine learning.

方式二: 在確定終端的姿態為第一姿態且在預設時間間隔內終端的姿態為第二姿態時,首先通過終端的攝像頭獲取收款設備的掃描資訊;對掃描資訊進行識別,確定收款設備的類型。然後在確定收款設備的類型為掃碼盒子時,直接調用預設的應用程式的二維碼進行業務處理。其中,預設時間間隔可以依據經驗設置。例如可以設置為5s,即接收到第一姿態之後的5s內接收到第二姿態。 Method two: When it is determined that the posture of the terminal is the first posture and the posture of the terminal is the second posture within the preset time interval, first obtain the scanning information of the payment device through the camera of the terminal; identify the scanning information to determine the type of the payment device . Then, when it is determined that the type of the payment device is a scan code box, the QR code of the preset application is directly called for business processing. The preset time interval can be set according to experience. For example, it can be set to 5s, that is, the second gesture is received within 5s after the first gesture is received.

當收款設備的類型為掃碼槍時,在確定終端的傾角為預設角度時,調用預設的應用程式的二維碼進行業務處理。預設角度可以依據經驗設置,如圖5所示的正面放置的傾斜姿態。When the type of the payment device is a scan code gun, when the inclination angle of the terminal is determined to be the preset angle, the QR code of the preset application is called for business processing. The preset angle can be set according to experience, such as the inclined posture of frontal placement as shown in FIG. 5 .

此外,在調用預設的應用程式的二維碼之後,還可以切換其它應用程式的二維碼,具體的,在確定終端處於第三姿態時,切換應用程式,並調用切換後的應用程式的二維碼進行業務處理。In addition, after calling the QR code of the preset application program, the QR code of other application programs can also be switched. Specifically, when it is determined that the terminal is in the third posture, the application program is switched, and the switched application program is called. QR code for business processing.

上述第二姿態和第三姿態可以為上下擺動或左右擺動。例如,第二姿態為上下擺動時,第三姿態為左右擺動;第二姿態為左右擺動時,第三姿態為上下擺動。在實際應用過程中,可以自行設置。The above-mentioned second posture and the third posture may be swing up and down or swing left and right. For example, when the second posture is swinging up and down, the third posture is swinging left and right; when the second posture is swinging left and right, the third posture is swinging up and down. In the actual application process, you can set it yourself.

上述業務處理可以理解為是支付業務或者掃碼識別業務等等。The above-mentioned business processing can be understood as payment business or scanning code identification business and so on.

為了更好的解釋本發明實施例,下面將在具體的實施場景下來描述上述基於終端姿態的業務處理的過程。In order to better explain the embodiments of the present invention, the above-mentioned process of terminal gesture-based service processing will be described below in a specific implementation scenario.

如圖7所示的被掃支付業務流程,具體如下: (1) 用戶解鎖手機用於支付; (2) 手機翻轉並對準掃碼盒子等設備,當系統應用通過陀螺儀識別到手機處於翻轉狀態時會打開前置攝像頭採集圖像資訊,並傳輸給物識別AI演算法模型; (3) 經過機器學習訓練後的物識別AI演算法模型對圖像資訊進行分析處理,用於識別是否存在掃碼盒子等業務處理設備,當識別到存在掃碼盒子等業務處理設備時等待使用者確認顯碼動作; (4) 系統應用通過陀螺儀識別到用戶上下擺動手機確認顯碼動作後,調用相關支付SDK或APP顯碼介面自動顯示支付二維碼(若使用者處於未登錄狀態時需先在相關支付APP內登錄),若使用者想要更換支付方式,可通過左右擺動手機更換; (5) 商戶通過掃碼盒子等收款設備讀取二維碼; (6) 商戶將二維碼資訊傳輸至商戶後臺,商戶後臺下訂單並將交易上送至相關支付機構或系統。 The scanned payment business process shown in Figure 7 is as follows: (1) The user unlocks the mobile phone for payment; (2) The mobile phone is turned over and aligned with the scanning box and other devices. When the system application recognizes that the mobile phone is in an inverted state through the gyroscope, it will turn on the front camera to collect image information and transmit it to the object recognition AI algorithm model; (3) The object recognition AI algorithm model trained by machine learning analyzes and processes the image information, and is used to identify whether there are business processing equipment such as code scanning boxes. to confirm the display code action; (4) After the system application recognizes that the user swings the mobile phone up and down to confirm the code display action through the gyroscope, it will call the relevant payment SDK or APP code display interface to automatically display the payment QR code (if the user is not logged in, he must first log in the relevant payment APP) If the user wants to change the payment method, he can change it by swinging the mobile phone left and right; (5) The merchant reads the QR code through the scanning box and other payment devices; (6) The merchant transmits the QR code information to the merchant's background, and the merchant's background places the order and sends the transaction to the relevant payment institution or system.

在本發明實施例中,獲取終端的姿態,該姿態包括第一姿態和第二姿態;根據該終端的第一姿態和第二姿態,確定收款設備的類型,並調用預設的應用程式的二維碼進行業務處理。通過依據終端的姿態和收款設備的類型,自動調用APP的二維碼,無需用戶任何的點擊操作,提高了二維碼展示效率,從而提高了終端業務處理能力,提升用戶體驗。In the embodiment of the present invention, the posture of the terminal is acquired, and the posture includes a first posture and a second posture; according to the first posture and the second posture of the terminal, the type of the payment device is determined, and the preset application program is called. QR code for business processing. By automatically calling the QR code of the APP according to the posture of the terminal and the type of the payment device, without any click operation by the user, the display efficiency of the QR code is improved, thereby improving the terminal business processing capability and improving the user experience.

基於相同的技術構思,圖8示例性的示出了本發明實施例提供的一種基於終端姿態的業務處理裝置的結構,該裝置可以執行基於終端姿態的業務處理流程。Based on the same technical concept, FIG. 8 exemplarily shows the structure of a terminal gesture-based service processing apparatus provided by an embodiment of the present invention, and the apparatus can execute a terminal gesture-based service processing flow.

如圖8所示,該裝置具體包括: 獲取單元801,用於獲取終端的姿態,該姿態包括第一姿態和第二姿態; 處理單元802,用於根據該終端的第一姿態和第二姿態,確定收款設備的類型,並調用預設的應用程式的二維碼進行業務處理。 As shown in Figure 8, the device specifically includes: an acquisition unit 801, configured to acquire the posture of the terminal, the posture includes a first posture and a second posture; The processing unit 802 is configured to determine the type of the payment device according to the first posture and the second posture of the terminal, and call the two-dimensional code of the preset application program to perform business processing.

可選的,該處理單元802具體用於: 在確定該終端的姿態為該第一姿態時,通過該終端的攝像頭獲取該收款設備的掃描資訊,並對該掃描資訊進行識別,確定該收款設備的類型; 在確定該收款設備的類型為掃描盒子且確定該終端的姿態為該第二姿態時,調用該預設的應用程式的二維碼進行業務處理。 Optionally, the processing unit 802 is specifically used for: When it is determined that the posture of the terminal is the first posture, the scanning information of the payment device is acquired through the camera of the terminal, and the scanning information is identified to determine the type of the payment device; When it is determined that the type of the payment device is a scanning box and the posture of the terminal is determined to be the second posture, the two-dimensional code of the preset application is called for business processing.

可選的,該處理單元802具體用於: 在確定該終端的姿態為該第一姿態且在預設時間間隔內該終端的姿態為該第二姿態時,通過該終端的攝像頭獲取該收款設備的掃描資訊,並對該掃描資訊進行識別,確定該收款設備的類型; 在確定該收款設備的類型為掃碼盒子時,直接調用該預設的應用程式的二維碼進行業務處理。 Optionally, the processing unit 802 is specifically used for: When it is determined that the posture of the terminal is the first posture and the posture of the terminal is the second posture within the preset time interval, the scanning information of the payment device is acquired through the camera of the terminal, and the scanning information is identified. , to determine the type of the collection device; When it is determined that the type of the payment device is a scan code box, the QR code of the preset application program is directly invoked for business processing.

可選的,該處理單元802具體用於: 通過訓練好的AI識別演算法對該掃描資訊進行識別,確定該收款設備的類型。 Optionally, the processing unit 802 is specifically used for: The scanned information is recognized by the trained AI recognition algorithm, and the type of the payment device is determined.

可選的,該第一姿態為翻轉狀態或正面放置的傾斜狀態。Optionally, the first posture is a flipped state or a tilted state placed on the front.

可選的,該處理單元802還用於: 若該收款設備的類型為掃碼槍,則在確定該終端的傾角為預設角度時,調用該預設的應用程式的二維碼進行業務處理。 Optionally, the processing unit 802 is further configured to: If the type of the payment device is a code scanner, when it is determined that the inclination angle of the terminal is a preset angle, the QR code of the preset application is called for business processing.

可選的,該終端的姿態還包括第三姿態; 該處理單元802還用於: 在調用預設的應用程式的二維碼進行業務處理之後,在確定該終端的姿態為第三姿態時,切換應用程式,並調用切換後的應用程式的二維碼進行業務處理。 Optionally, the posture of the terminal further includes a third posture; The processing unit 802 is also used for: After calling the two-dimensional code of the preset application program for business processing, when it is determined that the posture of the terminal is the third posture, the application program is switched, and the two-dimensional code of the switched application program is called for business processing.

基於相同的技術構思,本發明實施例還提供了一種計算設備,包括: 記憶體,用於存儲程式指令; 處理器,用於調用記憶體中存儲的程式指令,按照獲得的程式執行上述基於終端姿態的業務處理方法。 Based on the same technical concept, an embodiment of the present invention also provides a computing device, including: memory, used to store program instructions; The processor is configured to call the program instruction stored in the memory, and execute the above-mentioned service processing method based on the terminal posture according to the obtained program.

基於相同的技術構思,本發明實施例還提供了一種電腦可讀非揮發性存儲介質,包括電腦可讀指令,當電腦讀取並執行電腦可讀指令時,使得電腦執行上述基於終端姿態的業務處理方法。Based on the same technical concept, an embodiment of the present invention also provides a computer-readable non-volatile storage medium, including computer-readable instructions, when the computer reads and executes the computer-readable instructions, the computer executes the above-mentioned terminal gesture-based service Approach.

本發明是參照根據本發明實施例的方法、設備(系統)、和電腦程式產品的流程圖和/或方框圖來描述的。應理解可由電腦程式指令實現流程圖和/或方框圖中的每一流程和/或方框、以及流程圖和/或方框圖中的流程和/或方框的結合。可提供這些電腦程式指令到通用電腦、專用電腦、嵌入式處理機或其他可程式設計資料處理設備的處理器以產生一個機器,使得通過電腦或其他可程式設計資料處理設備的處理器執行的指令產生用於實現在流程圖一個流程或多個流程和/或方框圖一個方框或多個方框中指定的功能的裝置。The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine for causing the instructions to be executed by the processor of the computer or other programmable data processing device Means are created for implementing the functions specified in a flow or flows of the flowcharts and/or a block or blocks of the block diagrams.

這些電腦程式指令也可存儲在能引導電腦或其他可程式設計資料處理設備以特定方式工作的電腦可讀記憶體中,使得存儲在所述電腦可讀記憶體中的指令產生包括指令裝置的製造品,所述指令裝置實現在流程圖一個流程或多個流程和/或方框圖一個方框或多個方框中指定的功能。These computer program instructions may also be stored in computer readable memory capable of directing a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in said computer readable memory result in the manufacture of devices including instructions product, the instruction means implements the functions specified in the flow or flow of the flowchart and/or the block or blocks of the block diagram.

這些電腦程式指令也可裝載到電腦或其他可程式設計資料處理設備上,使得在電腦或其他可程式設計設備上執行一系列操作步驟以產生電腦實現的處理,從而在電腦或其他可程式設計設備上執行的指令提供用於實現在流程圖一個流程或多個流程和/或方框圖一個方框或多個方框中指定的功能的步驟。These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operational steps are performed on the computer or other programmable device to produce a computer-implemented process that can be executed on the computer or other programmable device. The instructions executed on the above provide steps for implementing the functions specified in one or more of the flowcharts and/or one or more blocks of the block diagrams.

以上僅為本發明之較佳實施例,並非用來限定本發明之實施範圍,如果不脫離本發明之精神和範圍,對本發明進行修改或者等同替換,均應涵蓋在本發明申請專利範圍的保護範圍當中。The above are only preferred embodiments of the present invention, and are not intended to limit the scope of implementation of the present invention. If the present invention is modified or equivalently replaced without departing from the spirit and scope of the present invention, it shall be covered by the protection within the scope of the patent application of the present invention. within the range.

401-402:步驟 801:獲取單元 802:處理單元 401-402: Steps 801: Get unit 802: Processing Unit

圖1為本發明實施例提供的一種系統架構的示意圖; 圖2為本發明實施例提供的一種掃碼盒子的示意圖; 圖3為本發明實施例提供的一種掃碼槍的示意圖; 圖4為本發明實施例提供的一種基於終端姿態的業務處理方法的流程示意圖; 圖5為本發明實施例提供的一種終端姿態的示意圖; 圖6為本發明實施例提供的一種終端姿態的示意圖; 圖7為本發明實施例提供的一種支付業務流程的示意圖; 圖8為本發明實施例提供的一種基於終端姿態的業務處理裝置的結構示意圖。 1 is a schematic diagram of a system architecture according to an embodiment of the present invention; 2 is a schematic diagram of a code scanning box provided by an embodiment of the present invention; 3 is a schematic diagram of a code scanning gun provided by an embodiment of the present invention; 4 is a schematic flowchart of a service processing method based on terminal gestures provided by an embodiment of the present invention; FIG. 5 is a schematic diagram of a terminal posture according to an embodiment of the present invention; FIG. 6 is a schematic diagram of a terminal posture according to an embodiment of the present invention; 7 is a schematic diagram of a payment business process provided by an embodiment of the present invention; FIG. 8 is a schematic structural diagram of a terminal gesture-based service processing apparatus according to an embodiment of the present invention.

401-402:步驟 401-402: Steps

Claims (16)

一種基於終端姿態的業務處理方法,其特徵在於,包括: 獲取終端的姿態,該姿態包括第一姿態和第二姿態; 根據該終端的第一姿態和第二姿態,確定收款設備的類型,並調用預設的應用程式的二維碼進行業務處理。 A service processing method based on terminal attitude, comprising: acquiring a posture of the terminal, the posture includes a first posture and a second posture; According to the first posture and the second posture of the terminal, the type of the payment device is determined, and the two-dimensional code of the preset application program is called for business processing. 如請求項1所述之基於終端姿態的業務處理方法,其特徵在於,該根據該終端的第一姿態和第二姿態,確定收款設備的類型,並調用預設的應用程式的二維碼進行業務處理,包括: 在確定該終端的姿態為該第一姿態時,通過該終端的攝像頭獲取該收款設備的掃描資訊,並對該掃描資訊進行識別,確定該收款設備的類型; 在確定該收款設備的類型為掃碼盒子且確定該終端的姿態為該第二姿態時,調用該預設的應用程式的二維碼進行業務處理。 The terminal gesture-based business processing method according to claim 1, characterized in that the type of the payment device is determined according to the first gesture and the second gesture of the terminal, and the QR code of the preset application is called. Conduct business processing, including: When it is determined that the posture of the terminal is the first posture, the scanning information of the payment device is acquired through the camera of the terminal, and the scanning information is identified to determine the type of the payment device; When it is determined that the type of the payment device is a scan code box and the posture of the terminal is determined to be the second posture, the two-dimensional code of the preset application is called for business processing. 如請求項1所述之基於終端姿態的業務處理方法,其特徵在於,該根據該終端的第一姿態和第二姿態,確定收款設備的類型,並調用預設的應用程式的二維碼進行業務處理,包括: 在確定該終端的姿態為該第一姿態且在預設時間間隔內該終端的姿態為該第二姿態時,通過該終端的攝像頭獲取該收款設備的掃描資訊,並對該掃描資訊進行識別,確定該收款設備的類型; 在確定該收款設備的類型為掃碼盒子時,直接調用該預設的應用程式的二維碼進行業務處理。 The terminal gesture-based business processing method according to claim 1, characterized in that the type of the payment device is determined according to the first gesture and the second gesture of the terminal, and the QR code of the preset application is called. Conduct business processing, including: When it is determined that the posture of the terminal is the first posture and the posture of the terminal is the second posture within the preset time interval, the scanning information of the payment device is acquired through the camera of the terminal, and the scanning information is identified. , to determine the type of the collection device; When it is determined that the type of the payment device is a scan code box, the QR code of the preset application program is directly invoked for business processing. 如請求項2或3所述之基於終端姿態的業務處理方法,其特徵在於,該對該掃描資訊進行識別,確定該收款設備的類型,包括: 通過訓練好的人工智慧AI識別演算法對該掃描資訊進行識別,確定該收款設備的類型。 The terminal gesture-based business processing method according to claim 2 or 3, characterized in that the identification of the scanned information to determine the type of the payment device includes: The scanned information is recognized by the trained artificial intelligence AI recognition algorithm, and the type of the payment device is determined. 如請求項1至3中任一項所述之基於終端姿態的業務處理方法,其特徵在於,該第一姿態為翻轉狀態或正面放置的傾斜狀態。The service processing method based on the terminal posture according to any one of claims 1 to 3, characterized in that the first posture is a flipped state or a frontally placed tilted state. 如請求項1至3中任一項所述之基於終端姿態的業務處理方法,其特徵在於,該方法還包括: 若該收款設備的類型為掃碼槍,則在確定該終端的傾角為預設角度時,調用該預設的應用程式的二維碼進行業務處理。 The terminal gesture-based service processing method according to any one of claim items 1 to 3, characterized in that the method further comprises: If the type of the payment device is a code scanner, when it is determined that the inclination angle of the terminal is a preset angle, the QR code of the preset application is called for business processing. 如請求項1至3中任一項所述之基於終端姿態的業務處理方法,其特徵在於,該終端的姿態還包括第三姿態; 在調用預設的應用程式的二維碼進行業務處理之後,還包括: 在確定該終端的姿態為第三姿態時,切換應用程式,並調用切換後的應用程式的二維碼進行業務處理。 The terminal gesture-based service processing method according to any one of claim items 1 to 3, wherein the terminal gesture further includes a third gesture; After calling the QR code of the preset application for business processing, it also includes: When it is determined that the posture of the terminal is the third posture, the application program is switched, and the two-dimensional code of the switched application program is called for business processing. 一種基於終端姿態的業務處理裝置,其特徵在於,包括: 獲取單元,用於獲取終端的姿態,該姿態包括第一姿態和第二姿態; 處理單元,用於根據該終端的第一姿態和第二姿態,確定收款設備的類型,並調用預設的應用程式的二維碼進行業務處理。 A terminal gesture-based service processing device, comprising: an acquisition unit, used for acquiring the posture of the terminal, the posture includes a first posture and a second posture; The processing unit is used for determining the type of the payment device according to the first posture and the second posture of the terminal, and calling the two-dimensional code of the preset application program for business processing. 如請求項8所述之基於終端姿態的業務處理裝置,其特徵在於,該處理單元具體用於: 在確定該終端的姿態為該第一姿態時,通過該終端的攝像頭獲取該收款設備的掃描資訊,並對該掃描資訊進行識別,確定該收款設備的類型; 在確定該收款設備的類型為掃碼盒子且確定該終端的姿態為該第二姿態時,調用該預設的應用程式的二維碼進行業務處理。 The terminal gesture-based service processing device according to claim 8, wherein the processing unit is specifically used for: When it is determined that the posture of the terminal is the first posture, the scanning information of the payment device is acquired through the camera of the terminal, and the scanning information is identified to determine the type of the payment device; When it is determined that the type of the payment device is a scan code box and the posture of the terminal is determined to be the second posture, the two-dimensional code of the preset application is called for business processing. 如請求項8所述之基於終端姿態的業務處理裝置,其特徵在於,該處理單元具體用於: 在確定該終端的姿態為該第一姿態且在預設時間間隔內該終端的姿態為該第二姿態時,通過該終端的攝像頭獲取該收款設備的掃描資訊,並對該掃描資訊進行識別,確定該收款設備的類型; 在確定該收款設備的類型為掃碼盒子時,直接調用該預設的應用程式的二維碼進行業務處理。 The terminal gesture-based service processing device according to claim 8, wherein the processing unit is specifically used for: When it is determined that the posture of the terminal is the first posture and the posture of the terminal is the second posture within the preset time interval, the scanning information of the payment device is acquired through the camera of the terminal, and the scanning information is identified. , to determine the type of the collection device; When it is determined that the type of the payment device is a scan code box, the QR code of the preset application program is directly invoked for business processing. 如請求項9或10所述之基於終端姿態的業務處理裝置,其特徵在於,該處理單元具體用於: 通過訓練好的AI識別演算法對該掃描資訊進行識別,確定該收款設備的類型。 The terminal gesture-based service processing device according to claim 9 or 10, wherein the processing unit is specifically used for: The scanned information is recognized by the trained AI recognition algorithm, and the type of the payment device is determined. 如請求項8至10中任一項所述之基於終端姿態的業務處理裝置,其特徵在於,該第一姿態為翻轉狀態或正面放置的傾斜狀態。The terminal posture-based service processing device according to any one of claims 8 to 10, wherein the first posture is a flipped state or a frontally placed tilted state. 如請求項8至10中任一項所述之基於終端姿態的業務處理裝置,其特徵在於,該處理單元還用於: 若該收款設備的類型為掃碼槍,則在確定該終端的傾角為預設角度時,調用該預設的應用程式的二維碼進行業務處理。 The terminal gesture-based service processing device according to any one of claim items 8 to 10, wherein the processing unit is further configured to: If the type of the payment device is a code scanner, when it is determined that the inclination angle of the terminal is a preset angle, the QR code of the preset application is called for business processing. 如請求項8至10中任一項所述之基於終端姿態的業務處理裝置,其特徵在於,該終端的姿態還包括第三姿態; 該處理單元還用於: 在調用預設的應用程式的二維碼進行業務處理之後,在確定該終端的姿態為第三姿態時,切換應用程式,並調用切換後的應用程式的二維碼進行業務處理。 The terminal gesture-based service processing device according to any one of claim items 8 to 10, wherein the terminal gesture further includes a third gesture; The processing unit is also used to: After calling the two-dimensional code of the preset application program for business processing, when it is determined that the posture of the terminal is the third posture, the application program is switched, and the two-dimensional code of the switched application program is called for business processing. 一種計算設備,其特徵在於,包括: 記憶體,用於存儲程式指令; 處理器,用於調用該記憶體中存儲的程式指令,按照獲得的程式執行如請求項1至7中任一項所述之基於終端姿態的業務處理方法。 A computing device, comprising: memory, used to store program instructions; The processor is configured to invoke the program instruction stored in the memory, and execute the terminal gesture-based service processing method described in any one of request items 1 to 7 according to the obtained program. 一種電腦可讀非揮發性存儲介質,其特徵在於,包括電腦可讀指令,當電腦讀取並執行該電腦可讀指令時,使得電腦執行如請求項1至7中任一項所述之基於終端姿態的業務處理方法。A computer-readable non-volatile storage medium, characterized in that it includes a computer-readable instruction, when the computer reads and executes the computer-readable instruction, the computer is made to execute the based on any one of claim 1 to 7. A service processing method for terminal gestures.
TW110142670A 2021-01-29 2021-11-17 Service processing method and device based on terminal attitude TW202230246A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110123679.3 2021-01-29
CN202110123679.3A CN112862479A (en) 2021-01-29 2021-01-29 Service processing method and device based on terminal posture

Publications (1)

Publication Number Publication Date
TW202230246A true TW202230246A (en) 2022-08-01

Family

ID=75986638

Family Applications (1)

Application Number Title Priority Date Filing Date
TW110142670A TW202230246A (en) 2021-01-29 2021-11-17 Service processing method and device based on terminal attitude

Country Status (3)

Country Link
CN (1) CN112862479A (en)
TW (1) TW202230246A (en)
WO (1) WO2022160843A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112862479A (en) * 2021-01-29 2021-05-28 中国银联股份有限公司 Service processing method and device based on terminal posture
CN115079886B (en) * 2022-07-21 2023-01-03 荣耀终端有限公司 Two-dimensional code recognition method, electronic device, and storage medium
CN116596013B (en) * 2023-07-18 2023-11-03 立臻科技(昆山)有限公司 Bar code providing method, device, electronic equipment and readable storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140172701A1 (en) * 2012-12-18 2014-06-19 iGate Technologies Inc. Funds Transfer Using Two Dimensional Barcodes
CN107578245A (en) * 2017-08-28 2018-01-12 珠海市魅族科技有限公司 Wake up method and apparatus, computer installation and the storage medium of payment interface
CN111209904A (en) * 2018-11-21 2020-05-29 华为技术有限公司 Service processing method and related device
CN110009330A (en) * 2019-02-02 2019-07-12 阿里巴巴集团控股有限公司 Method of payment and device
CN112862479A (en) * 2021-01-29 2021-05-28 中国银联股份有限公司 Service processing method and device based on terminal posture

Also Published As

Publication number Publication date
WO2022160843A1 (en) 2022-08-04
CN112862479A (en) 2021-05-28

Similar Documents

Publication Publication Date Title
TW202230246A (en) Service processing method and device based on terminal attitude
CN106687885B (en) Wearable device for messenger processing and method of use thereof
US20200409545A1 (en) Display adaptation method and apparatus for application, and storage medium
EP2950180B1 (en) Method for determining screen display mode and terminal device
EP2866088B1 (en) Information processing apparatus and method
US20140300542A1 (en) Portable device and method for providing non-contact interface
US20160370883A1 (en) Information processing apparatus, control method, program, and storage medium
US8094242B2 (en) Object management apparatus, mobile terminal, and object management method
US20150227946A1 (en) Generating barcode and authenticating based on barcode
WO2018059328A1 (en) Terminal control method, terminal, and data storage medium
JP6550963B2 (en) Authentication system, image forming apparatus, terminal device, and program
WO2017147748A1 (en) Wearable system gesture control method and wearable system
CN103125115A (en) Information processing apparatus, information processing system and information processing method
CN111353458A (en) Text box marking method and device and storage medium
EP2107529A2 (en) Storage medium storing image conversion programm and image conversion apparatus
CN108596122A (en) A kind of auth method, device, authentication machine and computer-readable medium
KR20190140657A (en) Electronic device for generating object and system
CN112818733B (en) Information processing method, device, storage medium and terminal
CN210691314U (en) Access control system and login device based on in vivo detection
US9300908B2 (en) Information processing apparatus and information processing method
KR102107395B1 (en) A mobile terminal and a method for recognizing a code by the mobile terminal
JP6558145B2 (en) Information processing terminal, information processing system, processing method thereof, and program
CN112561809A (en) Image processing method, device and equipment
WO2018120353A1 (en) Vr capturing method, system and mobile terminal
JP2019185818A (en) Portable terminal, information processing system, and processing method and program thereof