CN111951014A

CN111951014A - Account binding system and method based on intelligent sound box

Info

Publication number: CN111951014A
Application number: CN202010813544.5A
Authority: CN
Inventors: 朱金美; 李峰; 罗涛; 郝永宸
Original assignee: Industrial and Commercial Bank of China Ltd ICBC
Current assignee: Industrial and Commercial Bank of China Ltd ICBC
Priority date: 2020-08-13
Filing date: 2020-08-13
Publication date: 2020-11-17
Anticipated expiration: 2040-08-13
Also published as: CN111951014B

Abstract

The invention provides an account binding system and method based on a smart sound box, wherein the system comprises a server, a server and a server, wherein the server receives a request voice provided by the smart sound box and a device number of the smart sound box; obtaining user identity information according to the comparison result of the request voice and a preset text, and when the user identity information is a first user; generating a binding information token and corresponding first audio information according to the equipment number, and feeding back the binding information token and the first audio information to the intelligent sound box; receiving account information and a binding information token provided by the client, associating and storing the account information, the equipment number and the binding information token according to the binding information token, generating second audio information, and feeding the second audio information back to the smart sound box; and executing deduction processing on the account information corresponding to the binding information token according to the payment information provided by the client and the binding information token.

Description

Account binding system and method based on intelligent sound box

Technical Field

The invention relates to the technical field of internet, in particular to an account binding system and method based on an intelligent sound box.

Background

In recent years, with the rapid development of artificial intelligence, the intelligent sound box is also rapidly popularized as a carrier of artificial intelligence, and the demand for consumption based on the intelligent sound box is increasing day by day. How to realize the binding of the intelligent sound box and the third-party account is the first step of meeting the requirements of user consumption and the like. Currently, the mainstream binding process of the smart sound box and the third party account is based on an OAuth (Open Authorization) protocol to complete an Authorization authentication process. The OAuth authorization main flow is as follows: the method comprises the steps that a smart sound box manufacturer App (Application, a mobile phone Application program) requests a third party account to log in an authorization page in a WebView mode, a user inputs account information and a password in the WebView to complete identity authentication and authorization, and after authorization, an Access Token is provided for the manufacturer App to complete the whole authentication process. This authorization method has the following disadvantages:

the user flow is cumbersome. The user requests the third party account login authorization through the manufacturer App by installing the manufacturer App, and the Access Token is obtained, so that the process is long.

And the potential safety hazard of information exists. The user needs to input the account and password information of the user in the manufacturer App, and the risk of user information leakage exists.

The invention provides a system and a method for binding an intelligent sound box and an account based on sound wave transmission, which finish the binding of the unique device id of the intelligent sound box and a third party account by utilizing the principle of sound wave transmission; the method does not depend on an OAuth protocol and does not need App access of a manufacturer, so that the problem of complicated OAuth authorization mode is solved, and the risk degree of user information leakage possibly caused by OAuth authorization is effectively reduced. Meanwhile, better user experience can be provided by combining the use scene of the intelligent sound box.

Disclosure of Invention

The invention aims to provide an account binding system and method based on an intelligent sound box, which overcome the defects of the existing intelligent sound box and account binding mode, are safe and convenient to use and have better user experience.

In order to achieve the above object, the account binding system based on the smart sound box provided by the invention comprises the smart sound box, a server and a client; the intelligent sound box is used for receiving a request voice of a user, binding the request voice with the equipment number of the current intelligent sound box and then sending the binding request voice to the server side for account registration; receiving first audio information which is fed back by a server and carries a binding information token, and providing the first audio information to the client; and receiving second audio information of an account registration request processing result fed back by the server, and providing the second audio information to the user.

In the account binding system based on the smart sound box, preferably, the smart sound box includes a voice monitoring module and an audio playing module; the voice monitoring module is used for receiving a request voice of a user, binding the request voice with the equipment number of the current intelligent sound box and then sending the binding request voice to the server side for account registration; the audio playing module is used for receiving first audio information which is fed back by the server and carries the binding information token, and providing the first audio information to the client; and receiving second audio information of an account registration request processing result fed back by the server, and providing the second audio information to the user.

The invention also provides an account binding system based on the intelligent sound box, which comprises the intelligent sound box, a server and a client; the server is used for receiving the request voice provided by the intelligent sound box and the equipment number of the intelligent sound box; obtaining user identity information according to the comparison result of the request voice and a preset text, and when the user identity information is a first user; generating a binding information token and corresponding first audio information according to the equipment number, and feeding back the binding information token and the first audio information to the intelligent sound box; receiving account information and a binding information token provided by the client, associating and storing the account information, the equipment number and the binding information token according to the binding information token, generating second audio information, and feeding the second audio information back to the smart sound box; and executing deduction processing on the account information corresponding to the binding information token according to the payment information provided by the client and the binding information token.

In the account binding system based on the smart sound box, preferably, the server includes an audio receiving module, a user account binding module, a payment management module and an audio issuing module; the audio receiving module is used for receiving the request voice provided by the intelligent sound box and the equipment number of the intelligent sound box; performing semantic recognition on the request voice to obtain a request text, and comparing the consistency of the request text and a preset text to obtain user identity information; the user account binding module is used for binding the user identity information to a first user; generating a binding information token and corresponding first audio information according to the equipment number, and feeding back the binding information token and the first audio information to the intelligent sound box through the audio issuing module; the account information and the binding information token provided by the client are received, the account information, the equipment number and the binding information token are associated and then stored according to the binding information token, second audio information is generated, and the second audio information is fed back to the intelligent sound box; and the payment management module is used for executing deduction processing on the account information corresponding to the binding information token according to the payment information provided by the client and the binding information token.

In the account binding system based on the smart sound box, preferably, the server further includes a master user authorization module; the master user authorization module is used for generating an authorization request according to the user identity information when the user identity information is a second user, and providing the authorization request to a first user; and receiving authorization information and payment limit information provided by a first user, and providing the payment limit information to the client according to the authorization information.

The invention also provides an account binding system based on the intelligent sound box, which comprises the intelligent sound box, a server and a client; the client is used for receiving first audio information provided by the intelligent sound box, obtaining a binding information token carried in the first audio information, and providing the binding information token and account information of a first user to the server; and obtaining payment information generated in the payment process of the first user, and providing the payment information and the binding information token to the server side for deduction processing.

In the above account binding system based on a smart speaker, preferably, the client further includes a payment limit module; the payment limit module is used for receiving payment limit information provided by a server, carrying out limit processing on the payment process of a first user and/or a second user according to the payment limit information to generate payment information, and providing the payment information and the binding information token to the server for deduction processing.

The invention also provides an account binding method based on the intelligent sound box, which comprises the following steps: receiving a request voice of a user, binding the request voice with a device number of a current intelligent sound box, and sending the bound request voice to a server side for account registration; receiving first audio information which is fed back by a server and carries a binding information token, and providing the first audio information to a client; and receiving second audio information of an account registration request processing result fed back by the server, and providing the second audio information to the user.

The invention also provides an account binding method based on the intelligent sound box, which comprises the following steps: receiving request voice provided by the intelligent sound box and the equipment number of the intelligent sound box; performing semantic recognition on the request voice to obtain a request text, and comparing the consistency of the request text and a preset text to obtain user identity information; when the user identity information is a first user, generating a binding information token and corresponding first audio information according to the equipment number, and feeding back the binding information token and the first audio information to the intelligent sound box; receiving account information and a binding information token provided by a client, associating and storing the account information, the equipment number and the binding information token according to the binding information token, generating second audio information, and feeding the second audio information back to the intelligent sound box; and executing deduction processing on the account information corresponding to the binding information token according to the payment information provided by the client and the binding information token.

In the above account binding method based on a smart speaker, preferably, the method further includes: when the user identity information is a second user, generating an authorization request according to the user identity information, and providing the authorization request to a first user; and receiving authorization information and payment limit information provided by a first user, and providing the payment limit information to a client according to the authorization information.

In the above account binding method based on a smart speaker, preferably, the generating a binding information token according to the device number includes: generating a random number, and inquiring one or N information array subscripts corresponding to the random number in a preset frequency information dictionary according to the random number; obtaining corresponding binding information and frequency according to the information array subscript; obtaining a binding information token according to the binding information and the frequency assembly; wherein the random number is any value in the subscript of the information array; and N is any integer which is less than the total subscript number of the information array and is more than one.

In the above account binding method based on a smart speaker, preferably, the generating a binding information token and corresponding first audio information according to the device number includes: generating corresponding pulse code modulation audio according to corresponding frequency information in the binding information token; and synthesizing first audio information according to the pulse code modulation audio and a preset background audio.

In the above account binding method based on a smart speaker, preferably, synthesizing first audio information according to the pulse code modulation audio and a preset background audio includes: respectively obtaining frequency energy arrays of the pulse code modulation audio and a preset background audio; superposing the frequency energy array with an audio energy array, and performing inverse transformation on the audio energy array to generate first audio information; and, the frequency of the pulse code modulated audio is greater than 17000 Hz; the frequency of the background audio is preset to be 20Hz to 8000 Hz.

In the above account binding method based on a smart speaker, preferably, the obtaining frequency energy arrays of the pulse code modulation audio and the preset background audio respectively includes: and obtaining the frequency energy arrays of the pulse code modulation audio and the preset background audio by any one method of fast Fourier transform, discrete Fourier transform and discrete cosine transform.

The invention also provides an account binding method based on the intelligent sound box, which comprises the following steps: receiving first audio information provided by an intelligent sound box, obtaining a binding information token carried in the first audio information, and providing the binding information token and account information of a first user to a server; and acquiring payment information generated in the payment process of the first user, and providing the payment information and the binding information token to a server side for deduction processing.

In the above account binding method based on a smart speaker, preferably, the method further includes: receiving payment limit information provided by a server, and carrying out limit processing on the payment process of the first user and/or the second user according to the payment limit information to generate payment information;

and providing the payment information and the binding information token to a server side for deduction processing.

The invention also provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method when executing the computer program.

The present invention also provides a computer-readable storage medium storing a computer program for executing the above method.

The invention has the beneficial technical effects that: and the binding of the intelligent sound box and the bank system account is conveniently and quickly completed. The system does not need to be developed in cooperation with manufacturers, and does not need to use the authorization modes such as the traditional OAuth and the like; the characteristics of the intelligent sound box are fully utilized, and the binding is conveniently and quickly finished in a sound wave transmission mode; the risk degree of leakage of account information is reduced. The system does not need to depend on the application of a manufacturer, so that potential safety hazards such as user names and passwords input into accounts by the application of the manufacturer do not exist; meanwhile, high-frequency transmission is used for sound wave transmission, so that eavesdropping can be effectively prevented, and the risk degree of account information leakage is effectively reduced.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the principles of the invention. In the drawings:

fig. 1A is a schematic structural diagram of an account binding system based on a smart speaker according to an embodiment of the present invention;

fig. 1B is a schematic view of an application structure of an account binding system based on a smart speaker according to an embodiment of the present invention;

fig. 2 is a schematic structural diagram of a server according to an embodiment of the present invention;

fig. 3 is a schematic structural diagram of a client according to an embodiment of the present invention;

fig. 4 is a schematic flowchart of an account binding method based on a smart sound box according to an embodiment of the present invention;

fig. 5 is a schematic flowchart of an account binding method based on a smart sound box according to an embodiment of the present invention;

fig. 6 is a schematic flowchart of an account binding method based on a smart sound box according to an embodiment of the present invention;

FIG. 7 is a schematic flow chart illustrating payment deduction according to an embodiment of the present invention;

fig. 8 is a flowchart illustrating a binding request and audio transmission according to an embodiment of the present invention;

fig. 9 is a schematic flowchart of audio analysis and smart speaker/third party account binding according to an embodiment of the present invention;

fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The following detailed description of the embodiments of the present invention will be provided with reference to the drawings and examples, so that how to apply the technical means to solve the technical problems and achieve the technical effects can be fully understood and implemented. It should be noted that, unless otherwise specified, the embodiments and features of the embodiments of the present invention may be combined with each other, and the technical solutions formed are within the scope of the present invention.

Additionally, the steps illustrated in the flow charts of the figures may be performed in a computer system such as a set of computer-executable instructions and, although a logical order is illustrated in the flow charts, in some cases, the steps illustrated or described may be performed in an order different than here.

Referring to fig. 1A, an account binding system based on a smart speaker provided in the present invention includes a smart speaker, a server, and a client; the intelligent sound box is used for receiving a request voice of a user, binding the request voice with the equipment number of the current intelligent sound box and then sending the binding request voice to the server side for account registration; receiving first audio information which is fed back by a server and carries a binding information token, and providing the first audio information to the client; and receiving second audio information of an account registration request processing result fed back by the server, and providing the second audio information to the user. In actual work, the system may further include a storage module for storing the relevant registration information, and of course, the storage module may also be incorporated into the server according to actual needs, which is not limited in the present invention; in a specific application example, the intelligent sound box is connected with the server through a network, the intelligent sound box is connected with the client through audio playing-recording acquisition, the server is connected with the client through a network, and the storage module is respectively connected with the server and the client.

In an embodiment of the present invention, the smart audio may include a voice monitoring module and an audio playing module; the voice monitoring module is used for receiving a request voice of a user, binding the request voice with the equipment number of the current intelligent sound box and then sending the binding request voice to the server side for account registration; the audio playing module is used for receiving first audio information which is fed back by the server and carries the binding information token, and providing the first audio information to the client; and receiving second audio information of an account registration request processing result fed back by the server, and providing the second audio information to the user. Specifically, as shown in fig. 1B, the smart sound box 1 is mainly configured to receive a user request voice, send the unique device id of the smart sound box 1 and the user request voice to the server 2, play the audio information to the client 3 after receiving the audio information carrying the binding information token returned by the server 2, receive the audio information of the binding account request processing result returned by the server 2, and play the audio information to the user. The intelligent sound box 1 comprises a voice monitoring module 11 and an audio playing module 12. The voice monitoring module 11 monitors a user request voice requestVoice, and sends the user request voice and the unique intelligent sound box device id to the server 2; and forwards the audio carrying the binding information token returned by the server 2 or the audio of the binding account request processing result returned by the server 2 to the audio playing module 12. The audio playing module 12 plays the audio forwarded by the audio monitoring module 11. In fig. 1B, the semantic analysis module 21, the binding information module 22, the audio generation module 23, the audio synthesis module 24, the audio distribution module 25, the matching module 26, the audio collection module 31, the frequency acquisition module 32, the binding information acquisition module 33, the binding information uploading module 34, the frequency information dictionary, and the storage unit included in the server 2, the client 3, and the storage module 4 will be described in detail in the following embodiments, and thus, detailed description thereof will not be provided.

Referring to fig. 1A, the present invention further provides an account binding system based on a smart speaker, where the system includes the smart speaker, a server, and a client; the server is used for receiving the request voice provided by the intelligent sound box and the equipment number of the intelligent sound box; obtaining user identity information according to the comparison result of the request voice and a preset text, and when the user identity information is a first user; generating a binding information token and corresponding first audio information according to the equipment number, and feeding back the binding information token and the first audio information to the intelligent sound box; receiving account information and a binding information token provided by the client, associating and storing the account information, the equipment number and the binding information token according to the binding information token, generating second audio information, and feeding the second audio information back to the smart sound box; and executing deduction processing on the account information corresponding to the binding information token according to the payment information provided by the client and the binding information token. In actual work, the server is mainly responsible for analyzing the user request voice sent by the intelligent sound box and acquiring the semantics of the user request voice; generating an audio sinvoice carrying binding information token; meanwhile, in order to optimize the user experience and enable the user to hear the background audio, the audio sinvoice is synthesized with the background audio prepared in advance, in order to prevent the background audio from interfering with the audio sinvoice, the audio sinvoice is high-frequency sound (higher than 17000Hz), and the background audio is audio of 20-8000 Hz.

Specifically, the audio sinvoice and the background audio prepared in advance are synthesized as follows: and acquiring corresponding frequency energy arrays sinvoiceFre and backgroundFre from the audio sinvoice and the background audio through Fast Fourier Transform (FFT), Discrete Fourier Transform (DFT), Discrete Cosine Transform (DCT) and other modes, then overlapping the frequency energy arrays sinVoiceFre and backgroundFre to generate a superposed audio frequency energy array, and then generating the synthesized audio unitvoice of the superposed frequency energy array by using the inverse transform (inverse fast Fourier transform (IFFT), Inverse Discrete Fourier Transform (IDFT) or Inverse Discrete Cosine Transform (IDCT)) corresponding to the selected mode. Then, the audio unity voice is issued to the intelligent sound box to be played; and finally, matching the binding information sent by the client, and returning the binding account request processing result audio to the intelligent sound box for playing.

Referring to fig. 2, in an embodiment of the present invention, the server includes an audio receiving module, a user account binding module, a payment management module, and an audio issuing module; the audio receiving module is used for receiving the request voice provided by the intelligent sound box and the equipment number of the intelligent sound box; performing semantic recognition on the request voice to obtain a request text, and comparing the consistency of the request text and a preset text to obtain user identity information; the user account binding module is used for binding the user identity information to a first user; generating a binding information token and corresponding first audio information according to the equipment number, and feeding back the binding information token and the first audio information to the intelligent sound box through the audio issuing module; the account information and the binding information token provided by the client are received, the account information, the equipment number and the binding information token are associated and then stored according to the binding information token, second audio information is generated, and the second audio information is fed back to the intelligent sound box; and the payment management module is used for executing deduction processing on the account information corresponding to the binding information token according to the payment information provided by the client and the binding information token. Further, the server also comprises a master user authorization module; the master user authorization module is used for generating an authorization request according to the user identity information when the user identity information is a second user, and providing the authorization request to a first user; and receiving authorization information and payment limit information provided by a first user, and providing the payment limit information to the client according to the authorization information.

Specifically, in actual work, the server may include a semantic analysis module, a binding information generation module, an audio synthesis module, an audio delivery module, and a matching module. The semantic analysis module receives a user request voice requestVoice and the unique device id of the intelligent sound box, which are sent by the voice monitoring module of the intelligent sound box, performs semantic analysis on the user request voice requestVoice to obtain a corresponding text, compares the consistency with a preset binding account request text to judge whether the text is an account binding request, and sends the unique device id of the intelligent sound box to the binding information generation module to generate binding information if the text is the account binding request; otherwise, the user request voice sent by the voice monitoring module of the intelligent sound box is continuously monitored. And the binding information generation module receives the unique equipment id of the intelligent sound box sent by the semantic analysis module to generate binding information token. Specifically, the manner in which the binding information generating module generates the binding information token and the frequency array frequencylarr is as follows:

according to a "frequency-information" dictionary (as an example in table 1 below) of a storage module, a group of information array subscripts corresponding to a binding information token can be generated in a random number generating manner, then binding information and frequency corresponding to each information array subscript are obtained by querying the "frequency-information" dictionary, and the binding information token and the frequency array freqylarr are assembled respectively according to the generation sequence of the random array subscripts. Wherein the subscript is greater than or equal to 0 and less than the "frequency-information" dictionary length. Taking the "frequency-information" dictionary as an example of the following table, in view of better anti-interference of high-frequency sound, the high-frequency sound (higher than 17000Hz) is selected, and it is assumed that the preset length of the strap information token is 3:

TABLE 1

Frequency of	Binding information	Information array subscript
			17000Hz	a	0
17100Hz	b	1
			17200Hz	c	2
17300Hz	d	3

A new character string is generated in the form of a generated random number, for example, "312", that is, a group of information array subscripts of the binding information token, so that the binding information token assembled by the corresponding binding information according to the generation sequence of the random array subscripts is "dbc", and a frequency array frequencylarr corresponding to the binding information token is [17300,17100,17200 ]. Sending the frequency array frequencylarr corresponding to the binding information token and the unique equipment id of the intelligent sound box to a storage unit of the storage module 4 for storage; meanwhile, the frequency array frequencylarr corresponding to the binding information token is sent to the audio generating module 23.

The audio generating module generates a corresponding PCM (Pulse Code Modulation) audio sinvoice according to the frequency array frequenarr forwarded by the binding information generating module 22, and forwards the PCM audio sinvoice to the audio synthesizing module. The audio synthesis module synthesizes the audio sinvoice forwarded by the audio generation module and the background audio prepared in advance into audio unity voice and forwards the audio unity voice to the audio issuing module.

Specifically, the method comprises the following steps: the method for synthesizing the audio sinvoice and the background audio prepared in advance into the audio unity voice comprises the following steps: respectively obtaining frequency energy arrays sinvoiceFre and background audio frequency by means of Fast Fourier Transform (FFT), Discrete Fourier Transform (DFT), Discrete Cosine Transform (DCT) or the like, and superposing the frequency energy arrays sinvoiceFre and background audio frequency to obtain superposed frequency energy array unit Fre; specific synthetic modes are shown in the following table 2:

TABLE 2

And then generating the synthetic audio unity voice of the superposition frequency energy array unit Fre by utilizing the inverse transform (fast inverse Fourier transform (IFFT), Inverse Discrete Fourier Transform (IDFT) or Inverse Discrete Cosine Transform (IDCT)) corresponding to the selected mode.

And the audio issuing module issues the audio unity voice forwarded by the audio synthesis module to the voice monitoring module of the intelligent sound box. The matching module matches the token stored in the storage unit of the storage module and the binding information token uploaded by the binding information uploading module in a consistency comparison mode. If the user account information of the client and the unique device id of the intelligent sound box of the binding information token in the storage unit of the storage module are consistent, storing the user account information of the client and the unique device id of the intelligent sound box in the storage unit of the storage module, and forming associated information of the user account information and the unique device id of the intelligent sound box; and forwarding the audio information of the processing result of the account binding request to a voice monitoring module of the intelligent sound box.

Referring to fig. 1A again, the present invention further provides an account binding system based on a smart speaker, where the system includes the smart speaker, a server and a client; the client is used for receiving first audio information provided by the intelligent sound box, obtaining a binding information token carried in the first audio information, and providing the binding information token and account information of a first user to the server; and obtaining payment information generated in the payment process of the first user, and providing the payment information and the binding information token to the server side for deduction processing. In actual work, the client is mainly responsible for collecting the audio carrying the binding information token when the intelligent sound box plays the audio; analyzing the audio information to obtain binding information token; and uploading the binding information token and the user account information of the client to a server.

Referring to fig. 3, the client includes an audio acquisition module, a frequency acquisition module, a binding information uploading module, and a payment limit module. The payment limit module is used for receiving payment limit information provided by a server, carrying out limit processing on a first user and/or a second user in a payment process according to the payment limit information to generate payment information, and providing the payment information and the binding information token to the server for deduction processing. The audio acquisition module monitors whether a binding account audio exists, acquires the audio carrying the binding information token played by the intelligent sound box in a recording mode, and forwards the acquired audio to the frequency acquisition module. The frequency acquisition module acquires a frequency array corresponding to the audio through modes of Fast Fourier Transform (FFT), Discrete Fourier Transform (DFT), Discrete Cosine Transform (DCT) and the like according to the audio forwarded by the audio acquisition module, and forwards the frequency array corresponding to the binding information token to the binding information acquisition module.

Specifically, taking the example of obtaining a frequency array corresponding to an audio by fast fourier transform FFT, a frequency array obtaining process is specifically described: the audio frequency corresponding to the binding information token uses high frequency sound (higher than 17000Hz), and the background audio frequency is 20-8000 Hz. And carrying out fast Fourier transform on the acquired audio to obtain a frequency energy array, wherein the subscript is the corresponding frequency, the value corresponding to the subscript is the energy value of the frequency, and the subscript sequence with the maximum binding information token length of the energy value is selected from the frequency energy array and is the frequency array to be acquired.

The binding information acquisition module queries a frequency-information dictionary of the storage module according to the frequency array forwarded by the frequency acquisition module, acquires binding information token, and forwards the binding information token to the binding information uploading module. And the binding information uploading module uploads the binding information token forwarded by the binding information acquisition module and the user account information of the client to a matching module of the server.

In an embodiment of the present invention, the storage module is configured to store a "frequency-information" dictionary, which is used for a client to analyze a binding information token, and a server to generate the binding information token; meanwhile, the system is used for storing binding information token, the unique id of the intelligent sound box and user account information of the client; the frequency-information dictionary and the storage unit are contained.

Referring to fig. 4, the present invention further provides an account binding method based on a smart speaker, where the method includes:

s401, receiving a request voice of a user, binding the request voice with a device number of a current intelligent sound box, and sending the bound request voice to a server side for account registration;

s402, receiving first audio information which is fed back by a server and carries a binding information token, and providing the first audio information to a client;

s403, receiving second audio information of the account registration request processing result fed back by the server, and providing the second audio information to the user.

Referring to fig. 5, the present invention further provides an account binding method based on a smart speaker, where the method includes:

s501, receiving request voice provided by the intelligent sound box and the equipment number of the intelligent sound box;

s502, performing semantic recognition on the request voice to obtain a request text, and comparing the consistency of the request text and a preset text to obtain user identity information;

s503, when the user identity information is a first user, generating a binding information token and corresponding first audio information according to the equipment number, and feeding the binding information token and the first audio information back to the intelligent sound box;

s504, receiving account information and a binding information token provided by a client, associating and storing the account information, the equipment number and the binding information token according to the binding information token, generating second audio information, and feeding the second audio information back to the smart sound box;

s505, deduction processing is carried out on the account information corresponding to the binding information token according to the payment information provided by the client and the binding information token.

Wherein the method may further comprise: when the user identity information is a second user, generating an authorization request according to the user identity information, and providing the authorization request to a first user; and receiving authorization information and payment limit information provided by a first user, and providing the payment limit information to a client according to the authorization information.

In the above embodiment, generating the binding information token according to the device number includes: generating a random number, and inquiring one or N information array subscripts corresponding to the random number in a preset frequency information dictionary according to the random number; obtaining corresponding binding information and frequency according to the information array subscript; obtaining a binding information token according to the binding information and the frequency assembly; wherein the random number is any value in the subscript of the information array; and N is any integer which is less than the total subscript number of the information array and is more than one. Thus, in another embodiment of the present invention, the generating the binding information token and the corresponding first audio information according to the device number includes: generating corresponding pulse code modulation audio according to corresponding frequency information in the binding information token; and synthesizing first audio information according to the pulse code modulation audio and a preset background audio. Wherein synthesizing first audio information according to the pulse code modulation audio and a preset background audio comprises: respectively obtaining frequency energy arrays of the pulse code modulation audio and a preset background audio; superposing the frequency energy array with an audio energy array, and performing inverse transformation on the audio energy array to generate first audio information; and, the frequency of the pulse code modulated audio is greater than 17000 Hz; the frequency of the background audio is preset to be 20Hz to 8000 Hz. In this embodiment, obtaining the frequency energy arrays of the pulse code modulation audio and the preset background audio respectively comprises: and obtaining the frequency energy arrays of the pulse code modulation audio and the preset background audio by any one method of fast Fourier transform, discrete Fourier transform and discrete cosine transform.

Referring to fig. 6, the present invention further provides an account binding method based on a smart speaker, where the method includes:

s601, receiving first audio information provided by the intelligent sound box, obtaining a binding information token carried in the first audio information, and providing the binding information token and account information of a first user to a server;

s602, payment information generated in the payment process of the first user is obtained, and the payment information and the binding information token are provided to a server side for deduction processing.

Referring to fig. 7, in the above embodiment, the method may further include:

s701, receiving payment limit information provided by a server, and performing limit processing on a payment process of a first user and/or a second user according to the payment limit information to generate payment information;

s702, the payment information and the binding information token are provided to a server side for deduction processing.

In order to facilitate understanding of the account binding method based on the smart sound box provided by the present invention, the above embodiments will be generally described below with reference to the smart sound box, the server and the client, and it should be understood by those skilled in the art that this example is only an example to illustrate the application of the present invention, and is not further limited thereto.

Referring to fig. 8, in actual work, the flow of binding the request and issuing the audio is as follows:

s801 the voice monitoring module starts to monitor the voice requested by the user.

S802, the user speaks 'I want XXXX' (requestVoice) to the intelligent sound box, and the voice monitoring module uploads the requested voice (requestVoice) of the user and the unique device id of the intelligent sound box to the semantic analysis module of the server according to the uploading mode negotiated with the server. The up-sending method is exemplified as follows: and uploading the audio stream corresponding to the user request voice (request voice) and the unique device id of the intelligent sound box to the server. Or splicing the audio stream corresponding to the user request voice (requestVoice) with the unique device id of the intelligent sound box and then sending the spliced audio stream to the server.

S803, the semantic analysis module obtains a user request voice (requestVoice) and the unique device id of the intelligent sound box according to the information uploaded in the step S802 and the uploading mode negotiated with the voice monitoring module of the intelligent sound box; semantic analysis is carried out on the user request voice (requestVoice), a corresponding text is obtained, and consistency comparison is carried out on the text and the preset binding account request text. The consistency comparison method can be a keyword matching method, and can also be a text full-quantity matching method and the like.

S804, according to the consistency comparison result, judging whether the request is an account binding request, if so, turning to S805; otherwise, go to S801 to continue monitoring the user request voice.

After receiving the account binding request of the intelligent sound box and the unique device id of the intelligent sound box, the server side uses the binding information generation module to generate a group of information array subscripts corresponding to the binding information token in a random number generating mode according to the frequency-information dictionary of the storage module, then obtains the binding information and the frequency corresponding to each information array subscript by inquiring the frequency-information dictionary, assembles the binding information token and the frequency array frequencylarr according to the generation sequence of the random array subscripts, and stores the binding information token, the frequency array freqylarr corresponding to the binding information token and the unique device id of the intelligent sound box into the storage unit of the storage module. And simultaneously, sending the frequency array frequencylarr corresponding to the binding information token to an audio generation module.

And S806 the audio generation module generates corresponding audio sinvoice according to the frequency array frequencyArr.

The audio generation module generates a corresponding audio sinvoice mode according to the frequency array frequencyar as follows: taking the frequency array frequencylarr [17300,17100,17200] as an example, the sine wave audio sinvoice corresponding to 17300,17100 and 17200 can be generated by a way of generating PCM audio by sine wave.

S807 the audio synthesis module synthesizes the audio sinvoice generated in S805 and the background audio voice prepared in advance into an audio unity voice.

And S808, issuing the audio unity voice synthesized in the S806 to an audio monitoring module of the intelligent sound box by using the audio issuing module.

Referring to fig. 9, in actual work, the flow of audio analysis and smart speaker/third party account binding is as follows:

and S901, the audio acquisition module starts monitoring.

S902 judges whether account binding audio exists, if yes, the step jumps to S903, otherwise, the step jumps to S901, and whether account binding audio exists is continuously monitored.

S903 the intelligent sound box plays the synthesized audio unity voice.

S904, the audio acquisition module acquires the audio unit voice played by the intelligent sound box in a recording mode to obtain the recorded audio recordUnitvoice.

The S905 frequency obtaining module obtains a frequency array frequencylarray 2 corresponding to the audio recordtunitvoice.

S906 the binding information acquisition module queries the frequency-information dictionary of the storage module to acquire the binding information token corresponding to the frequency array.

S907 sends the binding information token and the account information of the client to the server through the binding information sending module; the matching module matches the token stored in the storage unit of the storage module in the S904 and the binding information token uploaded by the binding information uploading module in a consistency comparison manner.

S908 judges whether the matching is successful, and if the matching is successful, the step jumps to S909; otherwise, jump to S910.

S909, the account information of the client sent by the binding information uploading module is bound with the unique device id of the intelligent sound box corresponding to the token in the storage unit of the storage module, and the unique device id is stored in the storage unit of the storage module; and the audio corresponding to the binding success prepared in advance is sent to the voice monitoring module.

Wherein: examples of storage modes of the token, the unique device id of the smart speaker, and the account information of the client in the storage unit of the storage module are as follows:

binding information token in a storage unit of the storage module and the unique device id of the intelligent sound box are stored in a dictionary table 3 created in the storage unit;

TABLE 3

Binding information token	Unique device id of intelligent sound box
		dbc	abcdefg

The unique device id of the smart speaker and the account information of the client are stored in a dictionary table 5 created in the storage unit (table 4 is before binding).

Before binding:

TABLE 4

Unique device id of intelligent sound box 1	Account information of client
		abcdefg	Air conditioner

After binding:

TABLE 5

Unique device id of intelligent sound box 1	Account information of client
		abcdefg	******

S910, the audio corresponding to the binding failure prepared in advance is sent to the voice monitoring module.

And the S911 voice monitoring module forwards the matching result to the audio playing module.

S912, the audio playing module plays the account binding result.

The invention has the beneficial technical effects that: the intelligent sound box is conveniently and quickly bound with the account. The system does not need to be developed in cooperation with manufacturers, and does not need to use the authorization modes such as the traditional OAuth and the like; the characteristics of the intelligent sound box are fully utilized, and the binding is conveniently and quickly finished in a sound wave transmission mode; the risk degree of leakage of account information is reduced. The system does not need to depend on the application of a manufacturer, so that potential safety hazards such as user names and passwords input into accounts by the application of the manufacturer do not exist; meanwhile, high-frequency transmission is used for sound wave transmission, so that eavesdropping can be effectively prevented, and the risk degree of account information leakage is effectively reduced.

As shown in fig. 10, the electronic device 600 may further include: communication module 110, input unit 120, audio processing unit 130, display 160, power supply 170. It is noted that the electronic device 600 does not necessarily include all of the components shown in FIG. 10; furthermore, the electronic device 600 may also comprise components not shown in fig. 10, which may be referred to in the prior art.

As shown in fig. 10, the central processor 100, sometimes referred to as a controller or operational control, may include a microprocessor or other processor device and/or logic device, the central processor 100 receiving input and controlling the operation of the various components of the electronic device 600.

The memory 140 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information relating to the failure may be stored, and a program for executing the information may be stored. And the central processing unit 100 may execute the program stored in the memory 140 to realize information storage or processing, etc.

The input unit 120 provides input to the cpu 100. The input unit 120 is, for example, a key or a touch input device. The power supply 170 is used to provide power to the electronic device 600. The display 160 is used to display an object to be displayed, such as an image or a character. The display may be, for example, an LCD display, but is not limited thereto.

The memory 140 may be a solid state memory such as Read Only Memory (ROM), Random Access Memory (RAM), a SIM card, or the like. There may also be a memory that holds information even when power is off, can be selectively erased, and is provided with more data, an example of which is sometimes called an EPROM or the like. The memory 140 may also be some other type of device. Memory 140 includes buffer memory 141 (sometimes referred to as a buffer). The memory 140 may include an application/function storage section 142, and the application/function storage section 142 is used to store application programs and function programs or a flow for executing the operation of the electronic device 600 by the central processing unit 100.

The memory 140 may also include a data store 143, the data store 143 for storing data, such as contacts, digital data, pictures, sounds, and/or any other data used by the electronic device. The driver storage portion 144 of the memory 140 may include various drivers of the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging application, address book application, etc.).

The communication module 110 is a transmitter/receiver 110 that transmits and receives signals via an antenna 111. The communication module (transmitter/receiver) 110 is coupled to the central processor 100 to provide an input signal and receive an output signal, which may be the same as in the case of a conventional mobile communication terminal.

Based on different communication technologies, a plurality of communication modules 110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, may be provided in the same electronic device. The communication module (transmitter/receiver) 110 is also coupled to a speaker 131 and a microphone 132 via an audio processor 130 to provide audio output via the speaker 131 and receive audio input from the microphone 132 to implement general telecommunications functions. Audio processor 130 may include any suitable buffers, decoders, amplifiers and so forth. In addition, an audio processor 130 is also coupled to the central processor 100, so that recording on the local can be enabled through a microphone 132, and so that sound stored on the local can be played through a speaker 131.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims

1. An account binding system based on an intelligent sound box is characterized by comprising the intelligent sound box, a server side and a client side;

the intelligent sound box is used for receiving a request voice of a user, binding the request voice with the equipment number of the current intelligent sound box and then sending the binding request voice to the server side for account registration;

receiving first audio information which is fed back by a server and carries a binding information token, and providing the first audio information to the client;

and receiving second audio information of an account registration request processing result fed back by the server, and providing the second audio information to the user.

2. The smart speaker-based account binding system of claim 1, wherein the smart speaker comprises a voice monitoring module and an audio playing module;

the voice monitoring module is used for receiving a request voice of a user, binding the request voice with the equipment number of the current intelligent sound box and then sending the binding request voice to the server side for account registration;

the audio playing module is used for receiving first audio information which is fed back by the server and carries the binding information token, and providing the first audio information to the client; and receiving second audio information of an account registration request processing result fed back by the server, and providing the second audio information to the user.

3. An account binding system based on an intelligent sound box is characterized by comprising the intelligent sound box, a server side and a client side;

the server is used for receiving the request voice provided by the intelligent sound box and the equipment number of the intelligent sound box;

obtaining user identity information according to the comparison result of the request voice and a preset text, and when the user identity information is a first user; generating a binding information token and corresponding first audio information according to the equipment number, and feeding back the binding information token and the first audio information to the intelligent sound box;

receiving account information and a binding information token provided by the client, associating and storing the account information, the equipment number and the binding information token according to the binding information token, generating second audio information, and feeding the second audio information back to the smart sound box;

and executing deduction processing on the account information corresponding to the binding information token according to the payment information provided by the client and the binding information token.

4. The account binding system based on the smart sound box according to claim 3, wherein the server comprises an audio receiving module, a user account binding module, a payment management module and an audio issuing module;

the audio receiving module is used for receiving the request voice provided by the intelligent sound box and the equipment number of the intelligent sound box; performing semantic recognition on the request voice to obtain a request text, and comparing the consistency of the request text and a preset text to obtain user identity information;

the user account binding module is used for binding the user identity information to a first user; generating a binding information token and corresponding first audio information according to the equipment number, and feeding back the binding information token and the first audio information to the intelligent sound box through the audio issuing module; the account information and the binding information token provided by the client are received, the account information, the equipment number and the binding information token are associated and then stored according to the binding information token, second audio information is generated, and the second audio information is fed back to the intelligent sound box;

and the payment management module is used for executing deduction processing on the account information corresponding to the binding information token according to the payment information provided by the client and the binding information token.

5. The smart speaker-based account binding system of claim 4, wherein the server further comprises a master user authorization module;

the master user authorization module is used for generating an authorization request according to the user identity information when the user identity information is a second user, and providing the authorization request to a first user; and receiving authorization information and payment limit information provided by a first user, and providing the payment limit information to the client according to the authorization information.

6. An account binding system based on an intelligent sound box is characterized by comprising the intelligent sound box, a server side and a client side;

the client is used for receiving first audio information provided by the intelligent sound box, obtaining a binding information token carried in the first audio information, and providing the binding information token and account information of a first user to the server;

and obtaining payment information generated in the payment process of the first user, and providing the payment information and the binding information token to the server side for deduction processing.

7. The smart speaker-based account binding system of claim 6, wherein the client further comprises a payment limit module;

the payment limit module is used for receiving payment limit information provided by a server, carrying out limit processing on the payment process of a first user and/or a second user according to the payment limit information to generate payment information, and providing the payment information and the binding information token to the server for deduction processing.

8. An account binding method based on a smart speaker, the method comprising:

receiving a request voice of a user, binding the request voice with a device number of a current intelligent sound box, and sending the bound request voice to a server side for account registration;

receiving first audio information which is fed back by a server and carries a binding information token, and providing the first audio information to a client;

9. An account binding method based on a smart speaker, the method comprising:

receiving request voice provided by the intelligent sound box and the equipment number of the intelligent sound box;

performing semantic recognition on the request voice to obtain a request text, and comparing the consistency of the request text and a preset text to obtain user identity information;

when the user identity information is a first user, generating a binding information token and corresponding first audio information according to the equipment number, and feeding back the binding information token and the first audio information to the intelligent sound box;

receiving account information and a binding information token provided by a client, associating and storing the account information, the equipment number and the binding information token according to the binding information token, generating second audio information, and feeding the second audio information back to the intelligent sound box;

10. The smart speaker based account binding method of claim 9, further comprising:

when the user identity information is a second user, generating an authorization request according to the user identity information, and providing the authorization request to a first user;

and receiving authorization information and payment limit information provided by a first user, and providing the payment limit information to a client according to the authorization information.

11. The account binding method based on smart sound box according to claim 9, wherein generating the binding information token according to the device number comprises:

generating a random number, and inquiring one or N information array subscripts corresponding to the random number in a preset frequency information dictionary according to the random number;

obtaining corresponding binding information and frequency according to the information array subscript;

obtaining a binding information token according to the binding information and the frequency assembly;

wherein the random number is any value in the subscript of the information array; and N is any integer which is less than the total subscript number of the information array and is more than one.

12. The account binding method based on smart sound box according to claim 11, wherein generating a binding information token and corresponding first audio information according to the device number comprises:

generating corresponding pulse code modulation audio according to corresponding frequency information in the binding information token;

and synthesizing first audio information according to the pulse code modulation audio and a preset background audio.

13. The smart speaker based account binding method of claim 12, wherein synthesizing first audio information according to the pulse code modulation audio and preset background audio comprises:

respectively obtaining frequency energy arrays of the pulse code modulation audio and a preset background audio;

superposing the frequency energy array with an audio energy array, and performing inverse transformation on the audio energy array to generate first audio information;

and, the frequency of the pulse code modulated audio is greater than 17000 Hz; the frequency of the background audio is preset to be 20Hz to 8000 Hz.

14. The account binding method based on smart sound box according to claim 13, wherein obtaining the frequency energy arrays of the pulse code modulation audio and the preset background audio respectively comprises: and obtaining the frequency energy arrays of the pulse code modulation audio and the preset background audio by any one method of fast Fourier transform, discrete Fourier transform and discrete cosine transform.

15. An account binding method based on a smart speaker, the method comprising:

receiving first audio information provided by an intelligent sound box, obtaining a binding information token carried in the first audio information, and providing the binding information token and account information of a first user to a server;

and acquiring payment information generated in the payment process of the first user, and providing the payment information and the binding information token to a server side for deduction processing.

16. The smart speaker based account binding method of claim 15, further comprising:

receiving payment limit information provided by a server, and carrying out limit processing on the payment process of the first user and/or the second user according to the payment limit information to generate payment information;

17. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any of claims 8 to 16 when executing the computer program.

18. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program for executing the method of any one of claims 8 to 16.