TW201946001A - Authorized store voice payment system including a communication unit, a display unit, a processing unit, an image recognition module, and a voice recognition module - Google Patents

Abstract

Provided is an authorized store voice payment system, which is applicable to a user end. The system includes a communication unit, a display unit, a processing unit, an image recognition module, and a voice recognition module. The display unit provides an interactive display interface. The processing unit is coupled to the communication unit and the display unit. The image recognition module is configured to perform image recognition on image data. The voice recognition module is configured to perform voice recognition on voice signals. The processing unit performs image recognition on the image data related to stores and products through the image recognition module, and determines at least one product to be purchased through the display interface. The processing unit performs voice recognition on the voice signal through the voice recognition module, and determines the purchase of at least one product and performs user identity confirmation and online payment through the display interface.

Description

Special store voice payment system

The invention relates to an information inquiry system, and more particularly to a special shop voice payment system for a financial institution.

With the vigorous development of e-commerce and the popularization of electronic payment services, long-distance online transactions have become an important transaction channel, and people's online website consumption has become a trend. In response to this trend, local bankers have launched services for local bank customers to use the bank's chip financial card or credit card to pay online when they shop at a shopping site.

In order to confirm identity and financial transactions, the user will continue to use the computer to enter text when shopping or paying, such as entering a password during identity verification, and entering a financial or credit card account number and password during the payment process. And other complex processes. In addition, users must bind a debit or credit card in advance. In the use of online debit card transactions, users must install a card reader and related software on their computers. Users must have a credit card, debit card, or card number or account number on hand when making online purchases to make payments. These operations are not friendly to users, especially for the elderly, they are more complicated, inconvenient and error-prone. In order to confirm the card number or account number entered by the user, the user must also check multiple times, which reduces the efficiency of shopping operations and payment.

An object of the present invention is to provide a special store voice payment system, which can effectively use computing information and communication resources to facilitate users to complete online shopping and payment operations, and can reduce the complexity of the above operations, enabling online shopping and The payment operation is more efficient and convenient, so that users have a better experience.

In order to achieve at least the above-mentioned object, the present invention proposes a special shop voice payment system, which is suitable for a user terminal. The special shop voice payment system includes a communication unit, a display unit, a processing unit, an image recognition module, and a voice recognition module. The display unit is used to provide an interactive display interface. The processing unit is coupled to the communication unit and the display unit. The image recognition module is used for image recognition of image data. The voice recognition module is used for voice recognition of a voice signal. The image recognition module and voice recognition module are executed by the processing unit for online shopping and payment. The processing unit performs image recognition on the image data about the store and the product through the image recognition module, and determines at least one product to be purchased through the display interface. The processing unit performs voice recognition on the voice signal through the voice recognition module, and determines the purchase of at least one product, the identity confirmation, and the online payment through the display interface.

In one embodiment, the processing unit is used to obtain image data about the store and the product. The processing unit is configured to perform image recognition on the image data through the image recognition module to obtain picture characteristic data about the store and the product, and transmit the picture characteristic data to the picture information server through the communication unit. The processing unit is used to receive the product-related data correspondingly generated by the image information server in response to the image characteristic data through the communication unit and output the image information server through the display interface. The product-related data includes store name data, product name data, and price data.

In an embodiment, the processing unit is configured to receive the first voice signal and use the voice recognition module to perform voice recognition to determine whether the first voice signal represents a payment method using a financial instrument account to purchase the goods in the relevant data At least one product. If the processing unit determines that the first voice signal is representative of using the payment method of the financial instrument account to purchase at least one product, the processing unit outputs a spoken password request message. The processing unit is configured to receive the second voice signal through the communication unit and send an identity confirmation signal according to the second voice signal to the voiceprint recognition server. The processing unit is used to receive the user identification code correspondingly output by the voiceprint recognition server in response to the identity confirmation signal through the communication unit.

In an embodiment, the processing unit is configured to transmit the shopping-related data to the accounting server through the communication unit, and the shopping-related data includes at least one product corresponding to the store name data, product name data, price data, and user identification code, Information on financial instrument accounts. The processing unit is used to receive payment-related data correspondingly output through the communication unit through the display interface and output the accounting server in response to the shopping-related data. The payment-related data includes data representing the transfer account number, the special account transfer account number, and the transfer amount. The processing unit is configured to receive the third voice signal and perform voice recognition through the voice recognition module to determine whether the third voice signal represents a determination to make a payment to purchase at least one product. If the processing unit determines that the third voice signal indicates that payment is determined to purchase at least one product, the communication unit transmits a payment confirmation message to the account server for payment.

In one embodiment, the processing unit is used to find out the address of a terminal device that makes a payment. The processing unit is configured to output a shipping address confirmation message to request confirmation whether the geographic address of the address of the terminal device is used as the shipping address of the at least one product. The processing unit is configured to receive the fourth voice signal and perform voice recognition to determine whether the fourth voice signal represents determining the shipping address. If the processing unit determines that the fourth voice signal is representative of determining the shipping address, the processing unit is configured to send the shipping address information to an account server or a store transaction unit corresponding to at least one product.

In order to achieve at least the above-mentioned object, the present invention proposes a special shop voice payment system, which is applicable to a server. The special shop voice payment system includes at least one management server, and each management server includes a network unit and a data processing unit. The network unit is configured to perform network communication and communicate with at least one terminal device. The data processing unit is electrically coupled to the network unit and is configured to process signals transmitted by the at least one terminal device. The at least one management server is configured to: perform image recognition on the image data of the store and the commodity to determine at least one product to be purchased; perform voice recognition on the first voice signal to determine to purchase at least one commodity; and perform the second voice signal Voice recognition for user identification; voice recognition for third voice signal for online payment.

In an embodiment, at least one management server is configured to: obtain image data about stores and products; perform image recognition on the image data to obtain image characteristic data about stores and products and transmit the image characteristic data to the image information server Receiving and outputting image-related information related to the product generated by the image information server in response to image characteristic data, the product-related data includes store name data, product name data, and price data; receiving the first voice signal and performing voice recognition based on the It is determined whether the first voice signal represents the use of a payment method of a financial instrument account to purchase at least one product indicated in the product-related information. If it is determined that the first voice signal represents the use of a payment method of a financial instrument account to purchase at least one product, at least one management server outputs a spoken password request message.

In an embodiment, at least one management server is used to: receive the second voice signal and send an identity confirmation signal to the voiceprint recognition server accordingly; receive the voiceprint recognition server responding to the identity confirmation signal and output correspondingly Send the shopping-related data to the accounting server, the shopping-related data includes the store name data, product name data, price data, user identification code, and financial instrument account data corresponding to at least one product; receive and output The billing server responds to the shopping-related data and outputs corresponding payment-related data. The payment-related data includes data representing the transfer account number, the special store transfer account number, and the transfer amount; receiving the third voice signal and performing voice recognition to determine Whether the third voice signal represents a determination to make a payment to purchase at least one item. If it is determined that the third voice signal indicates that the payment is determined to purchase at least one product, the at least one management server transmits the determined payment message to the account server for payment.

In an embodiment, at least one management server is used to: find out the address of the terminal device making the payment; and output a shipping address confirmation message to request confirmation whether the geographical address of the terminal device address is used as the at least one The shipping address of the product; receiving the fourth voice signal and performing voice recognition to determine whether the fourth voice signal represents determining the shipping address. If it is determined that the fourth voice signal is to determine the shipping address, the at least one management server sends the shipping address information to the account server or at least one store transaction unit corresponding to the product.

In an embodiment, at least one management server is configured to: if it is determined that the fourth voice signal is representative and the shipping address is incorrect, the at least one management server outputs a shipping address request message to request the user to input and output Shipment address; receiving the fifth voice signal and performing voice recognition to determine whether the fifth voice signal enters the shipping address on behalf of the user. If it is determined that the fifth voice signal is to input the shipping address on behalf of the user, the at least one management server sends the shipping address information to the account server or at least one store transaction unit corresponding to the product.

In this way, the embodiment of the special store voice payment system can effectively use computing information and communication resources to facilitate users to complete online shopping and payment operations, while reducing the complexity of the above operations and enabling online shopping and payment operations More efficient and convenient for users to have a better experience.

In order to fully understand the purpose, features and effects of the present invention, the following specific embodiments are used in conjunction with the accompanying drawings to explain the present invention in detail, as described below:

Please refer to FIG. 1 and FIG. 2. FIG. 1 is a block diagram of an application scenario of a special shop voice payment system applied to a user terminal, and FIG. 2 is a block diagram of an embodiment of a special shop voice payment system.

As shown in FIG. 1 and FIG. 2, the special shop voice payment system 10 is suitable for a user terminal, such as being implemented in a terminal device 100. As shown in FIG. 2, the special store voice payment system 10 implemented in the terminal device 100 includes a communication unit 110, a display unit 120, a processing unit 130, an image recognition module 141, and a voice recognition module 142. The special store voice payment system 10 may be implemented using the terminal device 100. The terminal device 100 is, for example, any computing device such as a smart phone, a tablet, a notebook or a desktop computer.

The communication unit 110 is used for signal connection to the network 90 to communicate with external servers, such as the picture information server 20, the voiceprint recognition server 30, and the account server 40. The display unit 120, such as a liquid crystal display or a touch screen, is used to provide an interactive display interface. The processing unit 130, such as a micro processor, a single chip or a microcontroller, is coupled to the communication unit 110 and the display unit 120. In addition, in this embodiment, the terminal device 100 further includes an image unit 150 and a sound unit 160. The image unit 150 includes, for example, a camera, an image processor, or the like, or a combination thereof. The sound unit 160 includes, for example, a microphone, a sound processor, or the like, or a combination thereof.

The image recognition module 141 is used for performing image recognition on image data. The voice recognition module 142 is used for receiving voice and performing voice recognition accordingly. The image recognition module 141 and the voice recognition module 142 can be implemented by hardware, software, or software and hardware. For example, the image recognition module 141 and the voice recognition module 142 are program modules stored in a memory unit 140 electrically coupled to the processing unit 130 and executed by the processing unit 130, or the image recognition module 141 and the voice recognition module 142 are respectively This is achieved by an image processor (such as the image unit 150) and a sound processor (such as the sound unit 160) electrically coupled to the processing unit 130. The image recognition module 141 can use various techniques of image analysis to segment image data, such as photos, or compare it with a knowledge base to intercept the targets in the photos, or perform target recognition Object recognition, such as identifying the target as belonging to a product, the brand of the product, the name or address of a store, or other. The speech recognition module 142 can use speech to text (STT) technology to convert speech content into corresponding text. The construction method is to build a huge corpus through sound feature comparison and corpus collection. After receiving the voice, the system compares the corpus and converts the voice content into possible text. The data converted from speech to text can be used as analysis or comparison of judgment conditions for further processing such as confirmation of purchase or confirmation of payment. However, the implementation of the present invention is not limited by these examples.

The processing unit 130 uses the image recognition module 141, the voice recognition module 142, the display unit 120, and the communication unit 110 to perform online shopping and payment. The processing unit 130 performs image recognition on the image data about the store and the product through the image recognition module 141 and allows the user of the terminal device 100 to determine at least one product to be purchased through the display interface. The processing unit 130 performs voice recognition on the user's voice through the voice recognition module 142 and determines the purchase of at least one product, confirms the identity of the user, and performs online payment through the display interface.

For example, the image data about the store and the product may include one or more digital images containing the name of the product, brand, or store. For example, the image data IM in FIG. 1 contains the product (such as shoes) and the brand or store ’s image. Name (such as ABC) image. The image data IM can be generated in different ways. For example, the user can use the terminal device 100 to capture an image of the physical product and the brand or name of the product as the image data IM. The user can also use the terminal device 100 to obtain a digital image containing the name of a product, brand, or store from outside (such as a social media website, Internet search, website, or email). However, the implementation of the present invention is not limited by the above examples.

In an embodiment, the processing unit 130 is configured to obtain image data about a store and a commodity. The processing unit 130 performs image recognition on the image data through the image recognition module 141 to obtain picture characteristic data about the store and the product, and transmits the picture characteristic data to the picture information server 20 through the communication unit 110. For example, the image recognition module 141 uses the segmentation technology of image processing to find the target object, such as the product, the brand of the product, the name or address of the store, or other, so as to intercept the image of the product (such as shoes) in the image data and the name of the brand or store (Such as ABC) image as the picture characteristic data. Since the image data may contain image content such as backgrounds or people that are not related to shopping content such as goods and product brands, the amount of image feature data obtained by the image data through the above-mentioned image recognition processing has been greatly reduced. Therefore, in this embodiment, since the terminal device 100 is used to perform pre-image recognition processing on the image data, the processing operation load of the picture information server 20 can be reduced, and direct transmission of image data (such as a Or multiple photos) wasting network resources and computing data, which can improve overall online shopping and payment efficiency.

The image information server 20 has a product database related to products, brands, and stores. The product database includes image data of products, brands, and stores, image data of products sold by the stores, and the image data between these images. Correspondence or relationship, as well as the price and product information of the products sold by the store. The picture information server 20 compares or searches the picture characteristic data with the image data in the product database. For example, the shop name or brand name obtained by identifying the picture is used to find the shop name, and the picture item type is identified to find the product. If there are products in the product database that are the same as or similar to the image characteristic data, the image information server 20 generates corresponding product-related data correspondingly. Product-related information includes store name data, product name data, and price data. For example, if there is no product of a certain brand that is the same or similar to the picture characteristic data in the product database (such as a hiking shoe of the brand ABC), the picture information server 20 may also generate product related data correspondingly, such as Are other products of the same brand in the picture characteristic data (such as mountaineering clothing), or the same or similar products of different brands of the same store in the picture characteristic data. For another example, when the image characteristic data has images of brands and products, and when using this product database to find multiple stores corresponding to the brands and products in the image characteristic data, the image information server 20 may also generate multiple stores correspondingly. Product related information. For another example, when the image feature data has images of the first store, brand, and product, and when the product database is used to find only the second store that corresponds to the brand and product in the image feature data, the image information server 20 may also generate correspondingly Information about the products of the second store. However, the implementation of the present invention is not limited by the example of the picture information server 20 described above.

The processing unit 130 receives the product-related data correspondingly generated by the image information server 20 in response to the image characteristic data through the communication unit 110 and outputs the image information server 20 through the display interface, so that the user can select and confirm through the terminal device 100. For example, the display interface can display related information of the product and cooperate with the image of the product, and cooperate with the display interface for the user to select and confirm the product to be purchased.

In an embodiment, after the user selects and confirms the product to be purchased, the processing unit 130 is configured to receive the first voice signal and perform voice recognition through the voice recognition module 142 to determine whether the first voice signal represents use. The payment method of the financial instrument account is to purchase at least one commodity specified in the relevant information of the commodity. A financial instrument account is, for example, an account of a financial instrument such as a cash card, a credit card, or a financial card. It is assumed here that the terminal device 100 has set the payment method of the related financial instrument account. For example, the user has opened a mobile transaction service with a financial institution that has issued financial instruments, and the related payment has been installed in the terminal device 100. Software or settings. For example, a special store voice payment system or a financial institution may require the user to say a certain content format to confirm the product and the payment method to indicate the purchase of the product. Pay "statement. If there is only one product to be confirmed, you can ask the user to say "buy" in the sentence to confirm that you want to buy this product. If there are multiple products to be confirmed, you can allow the user to say "buy all", "buy Item one, item three. " The "financial card" in the sentence can also be changed to its financial instrument such as cash card or credit card. In addition, the "bank" in the above sentence can also be changed to the name of a financial institution such as a bank. However, the implementation of the present invention is not limited to the above examples.

If the processing unit 130 determines that the first voice signal is representative of using the payment method of the financial instrument account to purchase at least one product, the processing unit 130 outputs a spoken password request message. For example, the terminal device 100 displays a text or a representative pattern of “Please say a pass code” through a display interface or uses a voice to inform the user to say a pass code. The processing unit 130 is configured to receive a second voice signal and send an identity confirmation signal according to the second voice signal to the voiceprint recognition server 30 for user identity confirmation.

Special store voice payment systems or financial institutions may require users to speak a specific sentence (or pass code) in a certain format to identify users. For example, ask users to say 6 to 12 characters for pass codes, such as "land Bank WZ Voice Shopping 89 ", where a specific sentence can be defined as a certain word, sentence, call sound or a combination thereof. The voiceprint recognition server 30 has a voiceprint feature database. The voiceprint feature database has a user's voiceprint feature, and the correspondence between the voiceprint feature and the user's identification code. The voiceprint feature is determined by the user's voice. It is composed of a plurality of sound characteristic values such as wavelength, frequency, intensity, and rhythm. After the voiceprint recognition server 30 receives the identity confirmation signal, it processes the second voice signal in the identity confirmation signal to obtain the voiceprint feature of the second voice signal, and then uses the voiceprint feature and voiceprint of the second voice signal. The voiceprint features in the feature database are compared. The voiceprint recognition server 30 finds the corresponding user identification code from the voiceprint feature database according to the voiceprint characteristics of the second voice signal. In one embodiment, the voiceprint recognition server 30 may transmit the user identification code to the terminal device 100. In another embodiment, the terminal device 100 may be configured to output an identity confirmation signal according to the second voice signal and further cause the identity confirmation signal to carry a pairing password, and transmit the identity confirmation signal to the voiceprint recognition server 30. After the voiceprint recognition server 30 finds the user identification code as described above, it can further determine whether the corresponding password stored in the voiceprint recognition server 30 and associated with the user identification code is the pairing password transmitted by the terminal device 100. Consistent (such as identical or matching). If the judgment result about the passwords are consistent, the voiceprint recognition server 30 transmits the user identification code to the terminal device 100. If the determination result is no, the voiceprint recognition server 30 notifies the terminal device 100 of the result, and the terminal device 100 may allow the user to re-utter a specific sentence or stop the shopping operation. With this embodiment, the security of the user identity confirmation mechanism can be enhanced. However, the implementation of the present invention is not limited by the above examples. In some embodiments, the terminal device 100 may be configured to analyze a voice characteristic value such as a sound wavelength, frequency, intensity, or rhythm or a combination thereof according to the second voice signal, and output an identity confirmation signal including the voice characteristic value. Alternatively, the identity confirmation signal further includes a pairing password, and is sent to the voiceprint recognition server 30 for user identity verification. Therefore, in these embodiments, since the terminal device 100 performs pre-voice analysis processing according to the second voice signal, the burden on the processing operation of the voiceprint recognition server 30 can be reduced, and the second voice can be directly avoided. The waste of network resources and computing data caused by signals can improve the overall efficiency of online shopping and payment.

The processing unit 130 receives the user identification code correspondingly output by the voiceprint recognition server 30 in response to the identity confirmation signal. In one embodiment, the processing unit 130 is configured to transmit shopping-related data to the accounting server 40. The shopping-related data includes at least one product corresponding to the store name data, product name data, price data, and user identification code, finance Tool account information. The accounting server 40 can be implemented as a shopping payment database having a correspondence relationship between shopping-related data and payment-related data. The accounting server 40 finds corresponding payment-related data from the shopping payment database according to the shopping-related data and outputs it. Payment related information. The processing unit 130 is configured to receive and output this payment-related information through a display interface. The payment-related data includes information representing a transfer account number, a special store transfer account number, and a transfer amount.

In order to determine whether a user wants to make a payment to purchase a product, a special store voice payment system or a financial institution may require the user to speak a specific sentence in a certain format to identify the user, such as asking the user to say "correct", " OK "," Yes, please transfer "or other specific sentences, where a specific sentence can be defined as a certain word, sentence, call sound or a combination thereof. To this end, the processing unit 130 is configured to receive the third voice signal and perform voice recognition through the voice recognition module 142 to determine whether the third voice signal represents a determination to make a payment to purchase at least one product. If the processing unit 130 determines that the third voice signal is representative of making a payment to purchase at least one product, and if the third voice signal is identified as conforming to a specific sentence "correct", it transmits a payment confirmation message to the accounting server 40 for processing Pay. For example, after receiving the payment confirmation message, the account server 40 may perform payment related operations, such as further performing online transfer or payment transactions through an accounting system of a financial machine or a third-party payment system. The account server 40 may transmit payment results, such as success or failure, and payment information to the terminal device 100.

As shown above, the special store voice payment system 10 implemented on the terminal device 100 provides a user interface using video and voice interactions to select and confirm a desired product, as well as to confirm the payment method, identity, and payment. In this way, the terminal device 100 effectively utilizes computing information and communication resources to facilitate users to complete online shopping and payment operations.

Please refer to FIG. 3, which is a schematic flowchart of an embodiment of an operating method of a special store voice payment system. As shown in FIG. 3, the operation method of the special store voice payment system includes the following steps S10 to S40. As shown in step S10, the special store voice payment system performs image recognition on the image data about the store and the product to determine at least one product to be purchased. As shown in step S20, voice recognition of the first voice signal is performed by the special store voice payment system to determine the purchase of at least one product. As shown in step S30, a voice recognition system of the special store performs voice recognition on the second voice signal to confirm the identity of the user. As shown in step S40, the third voice signal is recognized by the special store voice payment system to perform online payment.

The operation method shown in FIG. 3 can be used to implement a special shop voice payment system. For example, a special shop voice payment system can be implemented on a terminal device on a user side, or a special shop voice payment system can be implemented on a server side. In addition, based on this operation method, various possible extensions and applications of the above-mentioned special store voice payment system can be made.

In some embodiments, the operation method shown in FIG. 3 may be applied to a terminal device of a user terminal, such as executing an application (APP) created based on the operation method of FIG. 3 on the terminal device of the user terminal. In this way, the terminal device on the user side provides the user interface as an intermediary and utilizes image recognition and voice recognition functions, and then communicates with the picture information server 20, voiceprint recognition server 30, and accounting server 40. In this way, the terminal device on the user side effectively utilizes computing information and communication resources to facilitate the user to complete online shopping and payment operations.

The implementation of steps S10 to S40 of FIG. 3 is further described below by using the embodiments of FIGS. 4A and 4B as examples.

Please refer to FIG. 4A and FIG. 4B, which are schematic flowcharts of an embodiment based on the operation method of FIG. 3. As shown in FIG. 4A, in an embodiment, step S10 may include the following steps S110 to S130. As shown in step S110, the image data about the store and the product is acquired by the special store voice payment system. As shown in step S120, the special store voice payment system performs image recognition on the image data to obtain picture characteristic data about the store and the product and transmits the picture characteristic data to the picture information server 20. As shown in step S130, the special store voice payment system receives and outputs the product related data correspondingly generated by the picture information server 20 in response to the picture characteristic data, and the product related data includes store name data, product name data, and price data. The implementation of the generation of the picture feature data, the picture information server 20, and the product-related data can be implemented by using multiple embodiments mentioned in the foregoing related content, and will not be described again. However, the implementation of the present invention is not limited by this example.

As shown in FIG. 4A, in an embodiment, step S20 may include the following steps S140 and S150. As shown in step S140, the special store voice payment system receives the first voice signal and performs voice recognition to determine whether the first voice signal represents a payment method using a financial instrument account to purchase at least one of the items referred to in the product-related information. commodity. As shown in step S150, if it is determined that the first voice signal represents the use of a payment method of a financial instrument account to purchase at least one product, the special store voice payment system outputs a spoken password request message. In addition, as shown in step S145, if the determination result in step S150 is NO, the special store voice payment system may perform other processing, such as stopping in response to an error or allowing the user to try to enter voice again. Regarding the implementation of the confirmation of the payment method, the selection of the product, or the confirmation by voice, it can be implemented by using multiple embodiments mentioned in the foregoing related content, so it will not be repeated here. However, the implementation of the present invention is not limited by this example.

As shown in FIG. 4A, in an embodiment, step S30 may include the following steps S160 and S170. As shown in step S160, the special voice payment system receives the second voice signal and sends an identity confirmation signal according to the second voice signal to the voiceprint recognition server 30 to confirm the identity of the user. Regarding the content of the identity confirmation signal, the voiceprint recognition server 30, and the implementation manner of the identity verification of the user, it can be implemented by using multiple embodiments mentioned in the foregoing related content, so it will not be repeated here. If the judgment result of the voiceprint recognition server 30 confirming the identity of the user is correct, the voiceprint recognition server 30 transmits the corresponding user identification code to the special shop voice payment system. As shown in step S170, the voiceprint recognition server 30 receives the user identification code correspondingly output in response to the identity confirmation signal through the special store voice payment system. In addition, if the determination result of the voiceprint recognition server 30 confirming the identity of the user is incorrect, the special store voice payment system may allow the user to re-utter a specific sentence or stop the shopping operation. However, the implementation of the present invention is not limited by this example.

As shown in FIG. 4B, in an embodiment, step S40 may include the following steps. As shown in step S180, the shopping-related data is transmitted to the account server 40 through the special store voice payment system, and the shopping-related data includes the store name data, product name data, price data, and user identification code corresponding to at least one product. , Financial instrument account information. As shown in step S190, the special store voice payment system receives and outputs payment-related data correspondingly output by the account server 40 in response to shopping-related data. The payment-related data includes representative transfer account numbers, special store transfer account numbers, and transfers. Information on the amount. As shown in step S200, the third store voice payment system receives the third voice signal and performs voice recognition to determine whether the third voice signal represents a determination to make a payment to purchase at least one product. As shown in step S210, if the special store voice payment system determines that the third voice signal is representative to make a payment to purchase at least one product, the special store voice payment system transmits the determined payment message to the account server 40 for payment. In addition, as shown in step S205, if the determination result in step S200 is no, the special store voice payment system may perform other processes, such as stopping the process or allowing the user to try to input voice again. The implementation manner of determining the payment by voice can be implemented by using multiple embodiments mentioned in the foregoing related content, and will not be described again. However, the implementation of the present invention is not limited by this example.

In addition, the above-mentioned special store voice payment system can be implemented based on any embodiment of the operation method of FIG. 3, and possible extensions and applications can be made. For example, in some embodiments, the operation method based on FIG. 3 further utilizes the special store voice payment system to obtain the shipping address, and requires the user to determine by voice. Please refer to FIG. 5, which is a schematic flowchart of another embodiment based on the operation method of FIG. 3. As shown in FIG. 5, in an embodiment, the operation method further includes the following steps. As shown in step S310, the address of the terminal device used by the user who makes the payment is found by using the special store voice payment system. For example, a terminal device is a smart device such as a mobile phone or tablet. It uses a "location based service" (LBS) via a mobile operator's radio communication network or an external positioning method (such as mobile communication positioning). , Wi-Fi positioning, Bluetooth positioning or GPS positioning) to obtain the location information of the mobile end user, and obtain the geographic address of the terminal device with the support of a geographic information system (GIS) platform. In addition, the special store voice payment system can further modify this geographic address based on the user registration information or shopping records of the user of this terminal device in the special store voice payment system, so that the final geographic address meets the postal or express delivery Shipping address. As shown in step S320, the special store voice payment system outputs a shipping address confirmation message to request the user to confirm whether the geographical address of the address of the terminal device is used as the shipping address of at least one product. For example, the shipping address confirmation message may include a map and text message, or a message containing multiple shipping address options, and is output on the user interface of the computing device in voice, image, or text, or a combination thereof. . The special store voice payment system may require users to make a choice and confirm the above shipping address by voice. If the user interface outputs 3 optional addresses that can be used as the shipping address, the user can say: "Please ship to the first address"; if there is only one address to choose from, the user can say Out: "Please ship to this address" or "Please ship here". As shown in step S330, the special store voice payment system receives the fourth voice signal and performs voice recognition to determine whether the fourth voice signal represents the user to determine the shipping address. As shown in step S340, if the special store voice payment system determines that the fourth voice signal is to determine the shipping address on behalf of the user, the special store voice payment system sends the shipping address information to the account server 40 or at least one product corresponding Store transaction unit. For example, a store transaction unit may be a server or program module of a store that provides goods, and may further notify the store to handle subsequent matters such as shipments, accounts, and so on.

As shown in FIG. 5, in an embodiment, the operation method further includes the following steps. As shown in step S331, if the special shop voice payment system determines that the fourth voice signal is representative and the shipping address is incorrect, the special shop voice payment system outputs a shipping address request message to request the user to enter a shipping address. For example, the shipping address request message may be output on the user interface of the terminal device by using voice, image, or text, or a combination thereof. As shown in step S333, the special store voice payment system receives the fifth voice signal and performs voice recognition to determine whether the fifth voice signal enters the shipping address on behalf of the user. As shown in step S335, if the special store voice payment system determines that the fifth voice signal is to input the shipping address on behalf of the user, it sends the shipping address information to the account server 40 or the store transaction unit corresponding to at least one product. In addition, if the judgment result of the special store voice payment system is negative, the special store voice payment system may allow the user to re-enter the shipping address or stop the shopping operation. However, the implementation of the present invention is not limited by this example.

In other embodiments, the operation method based on FIG. 3 may be applied to implement a special store voice payment system on the server side. Please refer to FIG. 6, which is a schematic diagram of an embodiment of a special store voice payment system 15 applied to a server. As shown in FIG. 6, the server-side special shop voice payment system 15 includes: at least one management server, which can be used to implement any one or a combination of the operation methods based on FIG. 3. The terminal device 100A on the user side communicates with the special shop voice payment system 15 on the server side in a wireless or wired manner. The special voice payment system 15 on the server side acts as an intermediary and communicates and interacts with applications or web browsers executed by the terminal device 100A on the user side to process and respond to requests for online shopping and payment. Thereby, the user application or the corresponding user interface in the web browser allows the user to perform operations using images and voice. The special store voice payment system 15 on the server side implements the image recognition and voice recognition functions based on the embodiment of the operating method of FIG. 3, and then communicates with the picture information server 20, voiceprint recognition server 30, and accounting server 40. Communication, so that the special store voice payment system 15 effectively uses computing information and communication resources to facilitate users to complete online shopping and payment operations.

In some embodiments in which the operation method based on FIG. 3 (as shown in FIGS. 3 to 5) is applied to the special store voice payment system 15 on the server side, the terminal device 100A on the user side communicates with the server in a wireless or wired manner. The special store voice payment system 15 communicates. The special store voice payment system 15 obtains image data about stores and products from the terminal device 100A and receives voice signals (such as the first to third voice signals, or the fourth and fifth voice signals). Signal), in which the terminal device 100A can use voice processing or voice compression technology to convert the user's voice into a digitized signal to become a voice signal. The special store voice payment system 15 outputs the product-related data received from the picture information server 20 to the terminal device 100A. The special store voice payment system 15 outputs a spoken password request message to the terminal device 100A. The special store voice payment system 15 outputs the payment-related materials received from the account server 40 to the terminal device 100A.

Please refer to FIG. 7, which is a schematic block diagram of an embodiment of a management server of a special shop voice payment system. As shown in FIG. 7, an embodiment of the management server 200 includes a network unit 210 and a data processing unit 220. The network unit 210 is configured to perform network communication and communicate with the terminal device 100A. The data processing unit 220 is electrically coupled to the network unit 210. The network unit 210 is a wireless or wired communication module. For example, the network unit 210 is configured to establish a communication link with at least one of a broadband network, an optical fiber network, a wireless local area network, and a mobile communication network to communicate with the network. The data processing unit 220 is a microprocessor, a microcontroller, or any circuit with control or computing functions. In addition, the management server 200 may further include a storage unit 230, such as a memory device, a database, or a cloud storage space or a combination thereof, and the storage unit 230 may be used to store data of the management server during processing of online shopping or payment. However, the implementation of the present invention is not limited by the above examples.

In some embodiments, a computer-readable storage medium is proposed, which records a code that allows a computing device (such as the aforementioned terminal device 100 or management server 200) to execute an operation method of a special store voice payment system based on FIG. 3, The method may be one or any combination of all the above embodiments including the operation method according to FIG. 3, 4A, 4B or 5. For example, the code is, for example, one or more programs or program modules, such as used to implement steps S10 to S40 according to FIG. 3, and may be executed in any suitable order. When a computing device (such as the aforementioned terminal device 100 or management server 200) executes this code, the computing device can cause the computing device to execute the embodiment based on the operation method of FIG. 3. Examples of these storage media include, but are not limited to, optical information storage media, magnetic information storage media, or memory, such as a memory card, firmware, or ROM or RAM.

As shown in the above embodiment, the special store voice payment system allows the terminal device on the user side to provide a user interface that uses video and voice interaction to select the product to be purchased, confirm the payment method, confirm the identity, and pay. confirm. In this way, the special store voice payment system effectively uses computing information and communication resources to facilitate users to complete online shopping and payment operations. Compared with the conventional shopping and payment system, users may be required to continuously use the computer to enter text, such as entering a password in the user's identity confirmation, and entering a financial card or credit card account number and password in the payment process. The payment system allows the user to confirm the desired product, the payment method, the identity, and the payment in a voice manner, and can greatly reduce the complexity of the above operation. Therefore, the special store voice payment system effectively uses computing information and communication resources to facilitate users to complete online shopping and payment operations, while greatly reducing the complexity of the above operations, and making online shopping and payment operations more efficient. And convenient, let users get a better experience. In this way, the special store voice payment system according to the present invention can improve the convenience of mobile payment. For example, the special store voice payment system can be implemented to allow users not to bind a financial card or credit card in advance, and the user does not need to install a card reader. It is also an inconvenient operation method that allows users to make online purchases without having to have a credit card or debit card to enter a card number or account number.

The present invention has been disclosed in the foregoing with a preferred embodiment, but those skilled in the art should understand that this embodiment is only for describing the present invention, and should not be interpreted as limiting the scope of the present invention. It should be noted that all changes and substitutions equivalent to this embodiment should be included in the scope of the present invention. Therefore, the scope of protection of the present invention shall be defined by the scope of the patent application.

10‧‧‧Special store voice payment system on the user side

15‧‧‧ server-side special shop voice payment system

20‧‧‧Picture Information Server

30‧‧‧Voiceprint recognition server

40‧‧‧Accounting Server

90‧‧‧ Internet

100‧‧‧ terminal device

100A‧‧‧Terminal device

110‧‧‧ communication unit

120‧‧‧display unit

130‧‧‧processing unit

140‧‧‧Storage unit

141‧‧‧Image recognition module

142‧‧‧Voice recognition module

150‧‧‧Image Unit

160‧‧‧ sound unit

200‧‧‧ management server

210‧‧‧ Network Unit

220‧‧‧Data Processing Unit

230‧‧‧Storage Unit

IM‧‧‧Image data

S10 ~ S40‧‧‧‧step

S110 ~ S210‧‧‧step

S310 ~ S335‧‧‧step

[Fig. 1] is a block diagram of an application scenario of an embodiment of a special shop voice payment system applied to a user terminal. [Fig. 2] is a block diagram of an embodiment of a special shop voice payment system on the user side. [Fig. 3] It is a schematic flowchart of an embodiment of a method for operating a voice payment system in a special store. [Fig. 4A] is a schematic flowchart of an embodiment based on the operation method of Fig. 3. [Fig. 4B] is a schematic flowchart of an embodiment based on the operation method of Fig. 3. [Fig. 5] is a schematic flowchart of another embodiment based on the operation method of Fig. 3. [Fig. 6] It is a schematic diagram of an embodiment of a special shop voice payment system applied to a server. [Fig. 7] It is a schematic block diagram of an embodiment of a management server of a special shop voice payment system.

Claims (10)

A special store voice payment system suitable for a user terminal. The special store voice payment system includes: a communication unit; a display unit for providing an interactive display interface; a processing unit coupled to the communication unit and The display unit; an image recognition module for image recognition of image data; and a voice recognition module for voice recognition of voice signals; wherein the processing unit uses the image recognition module and the voice recognition module Group, the display unit, and the communication unit for online shopping and payment; the processing unit performs image recognition on the image data of the store and the product through the image recognition module and determines at least one product to be purchased through the display interface; The processing unit performs voice recognition on the voice signal through the voice recognition module and determines the purchase of the at least one product, confirms the identity of the user, and performs online payment through the display interface. The special shop voice payment system according to claim 1, wherein: the processing unit is used to obtain the image data about the store and the goods; the processing unit is used to perform image recognition on the image data through the image recognition module to obtain Regarding the picture characteristic data of the store and the product and transmitting the picture characteristic data to a picture information server through the communication unit; the processing unit is used to receive through the communication unit and output the picture information server through the display interface to respond to the picture Product-related data corresponding to the characteristic data. The product-related data includes store name data, product name data, and price data. The special store voice payment system according to claim 2, wherein: the processing unit is configured to receive a first voice signal and perform voice recognition through the voice recognition module to determine whether the first voice signal represents the use of a financial The payment method of the instrument account is to purchase at least one product indicated in the relevant information of the product; if the processing unit determines that the first voice signal is representative of using the payment method of the financial instrument account to purchase the at least one product, the processing The unit outputs a spoken password request message; receives a second voice signal and transmits a confirmation signal based on one of the second voice signals to a voiceprint recognition server through the communication unit; the processing unit is used to receive through the communication unit The voiceprint recognition server responds to the identity confirmation signal and outputs a user identification code correspondingly. The special store voice payment system according to claim 3, wherein: the processing unit is configured to transmit shopping-related data to an account server through the communication unit, and the shopping-related data includes a name of a store corresponding to the at least one product Data, product name data, price data, and the user identification code and data of the financial instrument account; the processing unit is used to receive through the communication unit and output through the display interface the accounting server responds to shopping-related data and corresponds Payment-related data output from the local area, the payment-related data includes data representing a transfer account number, a special store transfer account number, and a transfer amount; the processing unit is configured to receive a third voice signal and pass the voice recognition module accordingly The group performs voice recognition to determine whether the third voice signal represents a determination to make a payment to purchase the at least one commodity; if the processing unit determines that the third voice signal represents a determination to make a payment to purchase the at least one commodity, through the communication The unit sends a confirm payment message to the account server for payment. The special store voice payment system as described in claim 4, wherein: the processing unit is used to find out the address of a terminal device that makes a payment; the processing unit is used to output a shipping address confirmation message to request confirmation whether the The geographic address of the address of the terminal device is used as the shipping address of the at least one product; the processing unit is configured to receive a fourth voice signal and perform voice recognition to determine whether the fourth voice signal represents the determination of the shipment Address; and if the processing unit determines that the fourth voice signal is representative of determining the shipping address, the processing unit is configured to send a shipping address message to the account server or a store corresponding to the at least one product Transaction unit. A special store voice payment system is applicable to a server. The special store voice payment system includes: at least one management server, each of the management servers includes: a network unit for network communication and communicates with at least A terminal device communicates; a data processing unit electrically coupled to the network unit for processing signals transmitted by the at least one terminal device; wherein the at least one management server is configured to: Performing image recognition on the image data of the product to determine at least one product to be purchased; performing speech recognition on a first voice signal to determine the purchase of the at least one product; performing speech recognition on a second voice signal to confirm user identity; Perform voice recognition on a third voice signal for online payment. The special shop voice payment system according to claim 6, wherein the at least one management server is configured to: obtain the image data; perform image recognition on the image data to obtain image characteristic data about the store and the product, and the image Send characteristic data to a picture information server; and receive and output product related data corresponding to the picture characteristic data in response to the picture information server, the product related data including store name data, product name data, and price data; receive The first voice signal is used to perform voice recognition to determine whether the first voice signal represents a payment method using a financial instrument account to purchase at least one commodity referred to in the product-related information; and if the first voice is determined The signal indicates that the payment method of the financial instrument account is used to purchase the at least one commodity, and a password request message is output. The special store voice payment system as described in claim 7, wherein the at least one management server is configured to: receive the second voice signal and transmit an identity confirmation signal to a voiceprint recognition server; and receive the voice The pattern recognition server responds to the identity confirmation signal and outputs a user identification code correspondingly; sends shopping-related data to an account server, the shopping-related data includes store name data and product names corresponding to the at least one product Data, price data, the user ID, and the information of the financial instrument account; receiving and outputting payment-related data that the accounting server responds to in response to shopping-related data, the payment-related data includes a transfer-out account number , A special store transfer account number and a transfer amount of information; receiving the third voice signal and performing voice recognition to determine whether the third voice signal represents a determination to make a payment to purchase the at least one product; and if it is judged that The third voice signal indicates that a payment is determined to purchase the at least one product, and a confirmation payment message is transmitted. Send to this account server for payment. The special store voice payment system according to claim 8, wherein the at least one management server is used to: find out the address of a terminal device that makes a payment; and output a shipping address confirmation message to request confirmation whether the The geographic address of the address of the terminal device is used as the shipping address of the at least one product; receiving a fourth voice signal and performing voice recognition to determine whether the fourth voice signal represents determining the shipping address; and if determined The fourth voice signal indicates that the shipping address is determined, and then sends a shipping address message to the account server or a store transaction unit corresponding to the at least one product. The special shop voice payment system according to claim 9, wherein the at least one management server is configured to: if it is determined that the fourth voice signal is representative and the shipping address is incorrect, output a shipping address request Message to request input of the shipping address; receive a fifth voice signal and perform speech recognition to determine whether the fifth voice signal represents the input of the shipping address; and if it is determined that the fifth voice signal represents the input of the shipping address, Then, a shipping address message is transmitted to the account server or a store transaction unit corresponding to the at least one product.