WO2019205985A1

WO2019205985A1 - Applet-based sound processing system and method, and server

Info

Publication number: WO2019205985A1
Application number: PCT/CN2019/082853
Authority: WO
Inventors: 杨丽玉; 刘怡中
Original assignee: 厦门声连网信息科技有限公司
Priority date: 2018-04-22
Filing date: 2019-04-16
Publication date: 2019-10-31
Also published as: CN108632140A

Abstract

Disclosed are an applet-based sound processing system and method, and a server. The system comprises a background server, a mobile terminal and an applet server. The method comprises: the mobile terminal running an applet application to receive a sound wave/audio; and the applet server converting the received sound wave/audio into a corresponding acoustic code, and querying a pre-generated binding relationship between the acoustic code and the information content/control instruction to determine the matching information content/control instruction, and invoking the information content or generating a corresponding internal control instruction, wherein the binding relationship is pre-stored in the applet server, the mobile terminal or the background server. By means of the above-mentioned method, when running an applet, a mobile terminal can interact with the other applets, the other applications or the other intelligent devices by means of a sound wave/audio so as to break away from an original application framework and limitations of the applet.

Description

Small program-based sound processing system, method and server

[Technical Field]

The present invention relates to the field of Internet communications, and in particular, to a voice processing system, method and server based on a small program.

【Background technique】

WeChat is a chat software launched by Tencent in 2011. Users can quickly send voice, video, pictures and text through mobile phones, tablets and web pages. WeChat provides various functions such as message push and information sharing. Information users can interact with other people and interact with each other through various built-in interaction methods.

Small programs such as WeChat are already very popular in mobile devices, and interactions can be made between terminals that install and run small programs. However, the interactive premise is based on the pre-made functions of the applet, and the interaction mode is limited to the inter-connection between the applet terminals, and the interaction between other different applet terminals (including hardware or software) and the applet terminal is not realized. .

[Summary of the Invention]

The technical problem to be solved by the present invention is to provide a sound processing system, method and server based on a small program, which realizes the interaction between small programs and devices through voice transmission of information and control instructions, and enhances the limitation of existing interactive applications.

In order to solve the above technical problem, a technical solution adopted by the present invention is: a small program-based sound processing system, the system includes a background server, and further includes: a mobile terminal, installed with a small program application, configured to respond to the small The calling of the program receives the sound wave/audio; the applet server is configured to convert the received sound wave/audio into a corresponding sound code; and query the binding relationship between the pre-generated sound code and the information content/control instruction to obtain the generated relationship with the generated a vocoding-matched information content/control instruction; and invoking the information content, or generating a corresponding internal control instruction; wherein the binding relationship is pre-stored in the applet server, the mobile terminal, or the background server .

The binding relationship is pre-stored in the background server, and the applet server is further configured to send the received sound wave/audio to the background server; the background server is further configured to: receive the received Converting the sound wave/audio into a corresponding vocoding; querying a binding relationship stored in the background server to determine an information content/control instruction that matches the vocoding; invoking the information content, or generating a corresponding to the control instruction Internal control instructions.

The binding relationship is pre-stored in the applet server; the applet server is further configured to send the received sound wave/audio to the background server; the background server is further configured to receive the received Converting the sound wave/audio into a corresponding vocoding code, and transmitting the vocoding code to the applet server; the applet server is further configured to query a binding saved in the applet server according to the received vocoding code The information is determined to match the information content/control instructions of the vocoding.

In order to solve the above technical problem, another technical solution adopted by the present invention is to provide a small program-based sound processing system, the system comprising: a mobile terminal, and an applet application installed for responding to the call of the applet Receiving a target information content/control instruction; the applet server is configured to query the pre-generated binding relationship according to the received target information content/control instruction to determine a voice code that matches the target information content/control instruction; And converting the vocode into corresponding sound waves/audio to play the sound wave/audio through the mobile terminal; wherein the binding relationship is pre-stored in the applet server, the mobile terminal or the background In the server.

The binding relationship is pre-stored in the background server, and the applet server is further configured to send the received information content/internal control instruction to the background server; the background server is further used to Querying the stored binding information according to the received information content/control instruction to convert a voice code matching the information content/control instruction into a corresponding sound wave/audio, and transmitting the sound wave/audio to the The applet server.

The binding relationship is pre-stored in the applet server; the applet server is further configured to send the determined voice code to the background server; the background server is further configured to receive the received The vocoding is converted to a corresponding sound wave/audio and the sound wave/audio is sent to the applet server.

In order to solve the above technical problem, another technical solution adopted by the present invention is to provide a small program-based sound processing system, the system comprising: a sound transmitting end device, which is installed with an applet application, and receives a user by running a small program. Input target information content/control instruction; the sound sending end server is configured to query the binding relationship between the pre-generated vocoding and the information content/control instruction in response to the target information content/control instruction to determine a matching vocal code, and Converting the vocode to corresponding sound wave/audio, and calling the sound transmitting end device to play the sound wave/audio; the sound receiving end device is installed with an applet application, and is sent by the sound sending end device by running the applet receiving device The sound wave/audio; the sound receiving end server is configured to transform the received sound wave/audio into a corresponding sound code, and query a binding relationship between the pre-generated sound code and the information content/control instruction to determine matching information. Content/control instructions.

The sound sending end server is an applet server corresponding to the applet running by the sound sending end device.

The sound receiving end server is an applet server corresponding to the applet running by the sound receiving end device.

In order to solve the above technical problem, another technical solution adopted by the present invention is to provide a small program server, where the server includes: a receiving unit, configured to call a small program to receive sound waves/audio through the mobile terminal; The mobile terminal runs the small program; the processing unit is configured to process the received sound wave/audio to generate a corresponding sound code; the first query unit is configured to query the pre-generated voice code according to the sound code generated by the processing unit And a binding relationship of the information content/control instruction to determine an information content/control instruction that matches the vocoding; wherein the binding relationship is pre-generated and saved in the applet server, the mobile terminal, or the background server a first calling unit, configured to invoke the information content to be displayed by the mobile terminal according to an information content/control instruction matching the vocoding, or generate a corresponding control instruction to invoke the mobile terminal to perform the Control instruction.

In order to solve the above technical problem, another technical solution adopted by the present invention is to provide a small program server, where the server includes: a first query unit, configured to invoke a small program to receive target information content/control instructions through the mobile terminal, and Querying a binding relationship between the pre-generated sound wave and the information content/control instruction to determine a vocoding that matches the target information content/control instruction; wherein the binding relationship is pre-generated and saved in the applet server, moving a first processing unit, configured to process the vocode determined by the first query unit to generate a corresponding sound wave/audio file; and a playback driving unit, configured to drive the mobile terminal to play by Sound/audio files generated by the first processing unit.

In order to solve the above technical problem, another technical solution adopted by the present invention is to provide a small program-based sound processing method, the method comprising: a mobile terminal running a small program application to receive sound waves/audio; and an applet server acquiring through a small program. The sound wave/audio received by the mobile terminal, and converting the sound wave/audio into a corresponding sound code; the applet server queries a binding relationship between the pre-generated sound code and the information content/control instruction, and obtains the The generated vocoding-matched information content/control instruction; wherein the binding relationship is pre-stored in the applet server, the mobile terminal, or the background server; the applet server invokes the information content, or generates Corresponding internal control instructions.

The applet server acquires the sound wave/audio received by the mobile terminal by the applet, the method further includes: the applet server sends the sound wave/audio to the background server; the background server pair The received sound wave/audio is processed to generate a corresponding vocoding code; the background server queries a binding relationship stored in the background server to determine an information content/control instruction that matches the vocoding code, and invokes the Information content, or generate corresponding control instructions.

In order to solve the above technical problem, another technical solution adopted by the present invention is to provide a small program-based sound processing method, the method comprising: an applet server calling a mobile terminal to receive a target information content/control instruction through a small program, and Querying a binding relationship between the pre-generated and saved vocoding and the information content/control instruction to determine a vocoding corresponding to the target information content/control instruction; wherein the binding relationship is pre-generated and saved in the mobile terminal and the applet server Or in a background server; the applet server processes the vocoding to generate a corresponding sound wave/audio; the applet server invokes the mobile terminal to play the sound wave/audio through a small program.

In order to solve the above technical problem, another technical solution adopted by the present invention is to provide a small program-based sound processing method, the method comprising: the sound sending end server calling the sound transmitting end device to receive the target information content/control through the applet Instructing, and querying a binding relationship between the pre-generated and saved vocoding and the information content/control instruction to determine a vocoding corresponding to the target information content/control instruction; wherein the binding relationship is pre-generated and saved in the sound transmitting end a device, a sound sending end server or a background server; the sound sending end server processes the sound code to generate a corresponding sound wave/audio; and the sound sending end server calls the sound sending end device playing station through a small program The sound wave/audio; the sound receiving end device running applet application receives the sound wave/audio; the sound receiving end server acquires the sound wave/audio received by the sound receiving end device through a small program, and converts the sound wave/audio into Corresponding vocoding; the sound receiving end server queries the pre-generated vocoding a binding relationship of the information content/control instruction, obtaining an information content/control instruction matching the generated vocoding; wherein the binding relationship is pre-stored in the sound receiving end server, the sound receiving end device or the In the background server; the sound receiving end server invokes the information content or generates a corresponding internal control instruction.

The sound sending end server and the sound receiving end server are small program servers, and are used to correspondingly call the sound sending end device and the sound receiving end device that run the small program through the applet.

In the above solution, the small program-based sound processing system, method and server, the mobile terminal runs the applet to send/sound/audio, and the small program server queries the pre-generated binding relationship to determine the sound wave interaction information, for example, By transmitting the information content/control content transmitted by the sound wave/audio, the effect of acquiring the corresponding information content or performing the corresponding function is realized, so that the mobile terminal can pass the sound wave/audio with other small programs, other applications, or other when running the small program. The smart devices interact to break away from the original application framework and limitations of the applet.

[Description of the Drawings]

1 is a schematic structural diagram of a small program-based sound processing system in a first embodiment of the present invention;

2 is a schematic structural diagram of a small program-based sound processing system in a second embodiment of the present invention;

Figure 3 is a block diagram showing the structure of a small program-based sound processing system in a third embodiment of the present invention;

4 is a schematic structural diagram of a small program-based sound processing system in a fourth embodiment of the present invention;

5 is a schematic structural diagram of a small program-based sound processing system in a fifth embodiment of the present invention;

6 is a schematic flow chart of a small program-based sound processing method according to a first embodiment of the present invention;

7 is a schematic flow chart of a small program-based sound processing method in a second embodiment of the present invention;

8 is a schematic flow chart of a small program-based sound processing method in a third embodiment of the present invention;

9 is a schematic flow chart of a small program-based sound processing method in a fourth embodiment of the present invention;

FIG. 10 is a schematic flow chart of a small program-based sound processing method in a fifth embodiment of the present invention.

【detailed description】

The prior art nomenclature referred to in the embodiments of the present invention is first explained.

Sonic/Audio (Signal): Usually refers to a piece of sound, or the frequency of a piece of sound.

Audio documents: audio (signal) documents, such as: wav documents, mp3 documents, aac documents.

Audio stream: audio (signal) stream.

Receiver: Refers to an audio receiver, such as a microphone of a mobile phone, or an audio receiver of a smart device.

Applet: WeChat (WeChat) applet, or WhatsApp's erlang, can be run inside WeChat or WhatsAPP or Line to implement custom applications within the APP.

Acoustic signal: The audio (signal) that can be received and further processed by the receiver, the original signal that is parsed.

Vocal code: After the inverse Fourier transform of the acoustic signal, a meaningful digital signal is obtained, which is called vocoding. Vocal database: A database that stores information content corresponding to vocoding and vocoding.

The vocoding corresponds to the content of the information: for example, numbers, alphanumeric characters, symbols, web addresses, coordinate values, or any text with data.

Internal control command: A command signal within a computer or computer device that is intended to trigger a function of the device.

The present invention will be described in detail below with reference to the accompanying drawings and embodiments.

Please refer to FIG. 1 , which is a schematic structural diagram of a small program-based sound processing system according to a first embodiment of the present invention. The system 10 includes a mobile terminal 11, an applet server 12, and a backend server 13. Wherein, the sound processing system shown in the embodiment is applied to identify the information content/control instruction carried by the sound wave/audio signal to call the corresponding content or perform the corresponding function. The small program refers to the WeChat (WeChat) applet or WhatsApp erlang, which can be run inside WeChat, WhatsAPP or Line to implement custom applications in the APP. In the present embodiment, the sound processing is implemented based on an applet, which is a WeChat server.

The mobile terminal 11 is equipped with an applet application for receiving sound waves/audio signals.

Specifically, the mobile terminal 11 runs a small program to open a receiver set by the body of the mobile terminal 11 to receive an acoustic/audio signal. That is, the applet is capable of receiving sound/audio signals.

The applet server 12 is configured to provide data related to the applet user, acquire the sound wave/audio received by the mobile terminal 11 through the applet, convert the sound wave/audio into a corresponding sound code, and generate a corresponding sound code. Query request.

The background server 13 establishes a communication connection with the mobile terminal 11 and the applet server 12, and pre-stores the binding information of the vocoding and the information content/control instruction; and is also used to respond to the vocoding request sent by the applet server 12, and query the binding. The information is returned to return the information content/control command of the matching vocoding to the applet server 12, causing the applet server 12 to call the information content or generate an internal control command corresponding to the control command.

Specifically, the applet server 12 includes:

The receiving unit 121 is configured to invoke an applet to receive the sound wave/audio through the mobile terminal 11;

The processing unit 122 is configured to perform Fourier transform on the received sound wave/audio signal to generate a corresponding sound code.

The first query unit 123 is configured to send a corresponding voice code query request to the background server 13 according to the voice code generated by the processing unit 122.

The background server 13 includes:

a first database 131, configured to store binding information of the vocoding and the information content/control instruction;

The second query unit 132 is configured to query the binding information saved by the first database 131 in response to the vocoding query request sent by the first query unit 123, and send the information content/control instruction matching the vocoding request to the Applet server 12.

The applet server 12 further includes an invoking unit 124 for invoking the information content to be displayed by the mobile terminal 11 according to the received information content/control instruction, or generating an internal control instruction corresponding to the received control instruction, The mobile terminal 11 runs an applet to execute the internal control command.

In this embodiment, the sound wave/audio signal received by the mobile terminal 11 may be: sound wave/audio (signal) played from a television, a computer, a mobile phone, an audio, a broadcast, or any speaker, and is received and outputted by using a small program. Information content or internal control instructions. E.g:

(1) TV advertisements can push product offers or purchase pages to the page of the applet.

(2) The station system of the bus or subway train can push the station information and the surrounding map to the page of the small program by broadcasting.

(3) Receive preset sound waves/audio (signals), so that all small programs that receive the same sound wave/audio (signal) in the same period of time can obtain the same network access parameters, such as Wi-Fi or Bluetooth setting parameters. In order to obtain the corresponding service.

(4) Receive pre-set sonic/audio (signal), let all small programs that receive the same sound/audio (signal) in the same period of time, automatically participate in the game, or participate in any online activities.

Further, the applet server 12 further includes a second database 125 for holding the binding relationship between the vocoding and the information content/control instructions. The binding relationship stored in the second database 125 is originally stored in the background server 13, and the applet server 12 accesses the background server 13 and downloads the binding relationship, thereby saving to the second database 125. The binding relationship stored in the second database 125 may also be generated and saved by the applet server 12 through pre-setting by the system, or may be pre-edited and saved by the user or the administrator.

The first query unit 123 queries the binding information held by the second database 125 according to the vocoding generated by the processing unit 122 to determine the information content/control instruction that matches the vocoding.

Further, the mobile terminal 11 further includes a third database 111. The binding relationship may also be saved in the third database 111 in the mobile terminal 11. The source of the binding relationship may be as follows:

(1) The applet server 12 is downloaded and saved to the mobile terminal 11 by accessing the background server 13;

(2) The applet server 12 is generated by the system pre-setting, or the applet user and the administrator pre-edit and save;

(3) the mobile terminal 11 directly accesses the background server 13 and downloads;

(4) The user and administrator of the mobile terminal 11 pre-edited and saved.

Please refer to FIG. 2 , which is a schematic structural diagram of a small program-based sound processing system according to a second embodiment of the present invention. Wherein, the sound processing system shown in the embodiment is applied to identify the information content/control instruction carried by the sound wave/audio signal to call the corresponding content or perform the corresponding function. In the present embodiment, when the applet server 22 acquires the sound wave/audio received by the mobile terminal 21 through the applet, it is also used to transmit the sound wave/audio to the background server 23. The background server 23 is further configured to perform Fourier transform on the received sound wave/audio to generate a corresponding sound code, and query its saved binding relationship to determine information content/control instructions corresponding to the sound code, and call The content of the information, or the corresponding internal control instructions.

Specifically, with respect to the sound processing system described in FIG. 1, the applet server 22 further includes a first communication unit 226 for transmitting the received sound waves/audio to the background server 23.

The background server 23 further includes:

a second communication unit 235, configured to receive sound waves/audio sent by the applet server 22;

a second processing unit 234, configured to perform Fourier transform on the received sound wave/audio to generate a corresponding vocoding code;

The second invoking unit 233 is configured to invoke the internal information determined by the second query unit 231 or generate a corresponding internal control instruction.

Further, when the background server 23 performs Fourier transform on the received sound wave/audio to generate a corresponding sound code, the second communication unit 235 is further configured to send the sound code to the applet server 22. The first query unit 223 of the applet server 22 queries the binding relationship stored in the second database 225, or saved in the third database 211, to determine the information content/control instructions that match the voice code. The first invoking unit 224 calls the internal information determined by the first inquiring unit 223 or generates a corresponding internal control instruction.

The other units in Figure 2 and their working principles are shown in the sound processing system shown in Figure 1 and its corresponding text portion.

Please refer to FIG. 3 , which is a schematic structural diagram of a small program-based sound processing system according to a third embodiment of the present invention. Among them, the sound processing system shown in the present embodiment is applied to convert an information content/control command into an acoustic/audio signal to transmit corresponding information. The sound processing system 30 includes a mobile terminal 31, an applet server 32, and a background server 32. The applet server 32 includes a second database 321 for pre-saving the binding relationship between the voice code and the information content/control instruction.

The mobile terminal 31 is installed with an applet application, and runs the applet to query the second database 321, determines the voice code corresponding to the target information content/control command, and performs Fourier transform on the voice code to generate a corresponding Sonic/audio, and the player of the mobile terminal 31 is called to play the sound/audio.

Specifically, the applet server 32 includes:

The first query unit 322 is configured to query the second database 321 in response to the user's query instruction to determine a voice code that matches the target information content/control instruction;

a first processing unit 323, configured to perform a Fourier transform on the voice code determined by the first query unit 322 to generate a corresponding sound wave/audio file;

The playback driving unit 324 is configured to drive the player set by the mobile terminal 31 to play the sound wave/audio file generated by the first processing unit 323.

In another embodiment, the binding relationship may also be saved in advance in the third database 311 of the mobile terminal 31. The applet server 32 accesses the mobile terminal 31 by calling the applet and acquires the binding relationship from the third database 311.

In another embodiment, the binding relationship may also be pre-stored in the first database 331 of the background server 33.

Please refer to FIG. 4 , which is a schematic structural diagram of a sound processing system based on a small program according to a fourth embodiment of the present invention. Among them, the sound processing system shown in the present embodiment is applied to convert an information content/control command into an acoustic/audio signal to transmit corresponding information. In this embodiment, the background server 43 further includes: Compared to the sound processing system shown in FIG.

a second communication unit 432, configured to establish a communication connection with the applet server 42;

a second processing unit 433, configured to perform Fourier transform on the voice code corresponding to the target information content/control instruction to generate a corresponding sound wave/audio file;

The vocoding code corresponding to the target information content/control command may be determined by the applet server 32 in response to the user's query instruction querying the binding relationship stored in the second database 421, and uploaded and sent by the first communication unit 425. .

In other embodiments, the vocoding corresponding to the target information content/control instruction is determined by the applet server 42 transmitting, by the first communication unit 425, the target information content/control command requested by the user to the background server. 43. The background server 43 further includes a second query unit 434, configured to query the binding relationship held by the first database 431 according to the received target information content/control instruction, thereby determining the corresponding voice code.

The other units in Figure 4 and their working principles are shown in the sound processing system shown in Figure 3 and its corresponding text portion.

Please refer to FIG. 5 , which is a schematic structural diagram of a sound processing system based on a small program according to a fifth embodiment of the present invention. Among them, the sound processing system shown in the present embodiment is applied to convert an information content/control command into an acoustic/audio signal to transmit corresponding information, and convert the information content/control command into an acoustic/audio signal to transmit corresponding information. Specifically, the sound processing system 50 includes a sound transmitting device 51, a sound transmitting server 52, a sound receiving server 53, a background server 54, and a sound receiving device 55.

In the present embodiment, the voice transmitting end server 52 is an applet server.

The sound transmitting device 51 is installed with an applet application, and determines a target content information/control command by running a small program.

The voice transmitting end server 52 queries the pre-generated binding relationship in response to the target content information/control command to determine a matched vocoding, and performs Fourier transform on the voicing to generate corresponding sound/audio, and invokes sound transmission. The end device 51 plays the sound wave/audio.

The binding relationship may be pre-stored in the voice sending end device 51, or may be pre-stored in the voice sending end server 52, or may be obtained by accessing the binding relationship saved by the background server 54.

When the sound transmitting device 51 plays the sound wave/audio, the sound receiving end server 53 receives the sound wave/audio by calling the sound receiving device 55. In the present embodiment, the sound receiving end server 53 is an applet server, and the sound receiving end device 55 is installed with an applet application and receives the sound wave/audio by running a small program.

The sound receiving end server 53 performs Fourier transform on the received sound wave/audio to convert into a corresponding sound code, and queries a pre-generated binding relationship to determine an information content/control instruction matching the sound code, thereby calling the Information content, or generate corresponding internal control instructions.

The binding relationship may be pre-stored in the voice receiving device 55, or may be pre-stored in the voice receiving server 53, or may be obtained by accessing the binding relationship saved by the background server 54.

For the unit in Figure 5 and its working principle, please refer to the sound processing system shown in Figure 1-4 and its corresponding text parts, which are not described here.

With the sound processing system as described above, an applet can be used to generate and play sound waves/audio (signals), and the receiving device (mobile phone, smart device, smart home appliance, smart car) can interact with the transmitting device. E.g:

(1) Using the mobile phone running the applet to generate and play the sound wave/audio (signal) carrying the "open door command", the smart door lock responds to the sound wave/audio to open the door lock.

(2) Using the mobile phone running the small program to generate and play the sound wave/audio (signal) of the TV remote control command, as the remote controller, enable the TV set to switch on and off in response to the sound wave/audio.

(3) Use the mobile phone running the applet to generate and play sound waves/audio (signals) to start the car engine or the electric car motor.

(4) Use the mobile phone running the applet to generate and play sound waves/audio (signal) to interact with other apps or applets running on the phone.

(5) Use the mobile phone running the applet to generate and play the sound wave/audio (signal) and make multiple smart device command trigger signals.

Please refer to FIG. 6 , which is a small program-based sound processing method according to a first embodiment of the present invention. Among them, the sound processing method shown in the present embodiment is applied to convert an information content/control command into an acoustic/audio signal to transmit corresponding information. The method includes:

Step S60, the mobile terminal runs an applet application to receive the sound wave/audio signal;

Step S61, the applet server acquires the sound wave/audio received by the mobile terminal through the applet, and converts the sound wave/audio into a corresponding sound code.

In step S62, the applet server queries the binding relationship between the pre-generated voice code and the information content/control command to determine the information content/control command corresponding to the voice code.

The binding relationship is pre-generated and saved in the applet server, and can also be saved in the mobile terminal or the background server.

In step S63, the applet server calls the information or generates a corresponding internal control instruction.

Please refer to FIG. 7 , which is a small program-based sound processing method according to a second embodiment of the present invention. Among them, the sound processing method shown in the present embodiment is applied to convert an information content/control command into an acoustic/audio signal to transmit corresponding information. The method includes:

Step S70, the mobile terminal runs the applet application to receive the sound wave/audio signal;

Step S71, the applet server acquires the sound wave/audio received by the mobile terminal through the applet, and sends the sound wave/audio to the background server.

In step S72, the background server processes the received sound wave/audio to generate a corresponding sound code.

Specifically, the background server performs Fourier transform processing on the received sound waves/audio to generate corresponding sound codes.

Step S73, the background server queries the binding relationship stored in the background server to determine the information content/control instruction that matches the voice code, and invokes the information content, or generates a corresponding control instruction. Then the process ends.

Further, after the background server processes the received sound wave/audio to generate the corresponding sound code, the method further includes:

In step S74, the background server sends the voice code to the applet server.

Step S75, the applet server queries the binding relationship stored in the applet server to query the information content/control instruction matching the voice code, and invokes the information content, or generates a corresponding control instruction. Then the process ends.

Please refer to FIG. 8 , which is a small program-based sound processing method according to a third embodiment of the present invention. Among them, the sound processing method shown in the present embodiment is applied to convert an information content/control command into an acoustic/audio signal to transmit corresponding information. The method includes:

Step S80, the applet server calls the mobile terminal to receive the target information content/control instruction through the applet, and queries the binding relationship between the previously generated and saved voice code and the information content/control instruction to determine the target information content/control instruction corresponding to the target information content/control instruction. Vocal code.

The binding relationship may be pre-generated and saved in a mobile terminal, an applet server, or a background server.

In step S81, the applet server processes the sound code to generate corresponding sound waves/audio.

Step S82, the applet server calls the mobile terminal to play the sound wave/audio through the applet.

Please refer to FIG. 9 , which is a small program-based sound processing method according to a fourth embodiment of the present invention. Among them, the sound processing method shown in the present embodiment is applied to convert an information content/control command into an acoustic/audio signal to transmit corresponding information. The method includes:

Step 90: The applet server calls the mobile terminal to receive the target information content/control instruction through the applet, and queries the binding relationship between the pre-generated and saved voice code and the information content/control instruction to determine the target information content/control instruction corresponding to the target information content/control instruction. Vocal code.

In step S91, the applet server sends the voice code to the background server.

In step S92, the background server processes the received voice code to generate a corresponding sound/audio file, and sends the sound wave/audio file to the applet server.

In step S93, the applet server calls the mobile terminal to play the sound wave/audio file through the applet.

Please refer to FIG. 10, which is a small program-based sound processing method according to a fifth embodiment of the present invention. Among them, the sound processing method shown in the present embodiment is applied to convert an information content/control command into an acoustic/audio signal to transmit corresponding information, and convert the information content/control command into an acoustic/audio signal to transmit corresponding information. The method includes:

Step S100, the sound sending end server invokes the sound sending end device to receive the target information content/control instruction through the applet, and queries the binding relationship between the previously generated and saved voice code and the information content/control instruction to determine the target information content/control. The vocoding corresponding to the instruction.

The binding relationship may be pre-generated and saved in the voice sending end device, the voice sending end server, or the background server.

In this embodiment, the voice sender server is an applet server.

In step S101, the sound sending end server processes the sound code to generate corresponding sound waves/audio.

Step S102, the sound sending end server calls the sound sending end device to play the sound wave/audio through the applet.

In step S103, the sound receiving end device runs an applet application to receive the sound wave/audio signal.

Step S104, the sound receiving end server acquires the sound wave/audio received by the sound receiving end device through the applet, and converts the sound wave/audio into a corresponding sound code.

In this embodiment, the sound receiving end server is an applet server, and the sound receiving end device is installed with an applet application, and receives the sound wave/audio by running a small program.

Step S105, the sound receiving end server queries the binding relationship between the pre-generated voice code and the information content/control instruction to determine the information content/control instruction of the voice code.

The binding relationship is pre-generated and saved in the voice receiving server, and may also be stored in the voice receiving device or the background server.

In step S106, the sound receiving end server calls the information or generates a corresponding internal control instruction.

For the method steps in FIG. 10, please refer to the sound processing system shown in FIG. 6-9 and its corresponding text portions, which are not described herein.

In an embodiment of the present invention, a small program-based sound processing system, method, and server, the mobile terminal runs a small program to transmit/or sound waves/audio, and the small program server queries a pre-generated binding relationship to determine sound wave interaction information. For example, by transmitting the information content/control content transmitted by the sound wave/audio, the effect of acquiring the corresponding information content or performing the corresponding function is realized, so that the mobile terminal can pass the sound wave/audio with other small programs, other applications, and the like when running the small program. Or other smart devices interact to break away from the original application framework and limitations of the applet.

In the embodiments provided by the present invention, the disclosed system, terminal and method may be implemented in other manners. For example, the terminal embodiment described above is schematic, and the division of the unit is a logical function division, and the actual implementation may have another division manner.

The units described as separate components may or may not be physically separate, ie may be located in one place, or may be distributed over multiple network elements. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, all or part of the technical solution of the present invention may be embodied in the form of a software product stored in a storage medium, including a plurality of instructions for causing a computer device (which may be a personal computer, The management server, or network device, etc. or processor, performs all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read only memory (English: read-only memory, abbreviation: ROM), a random access memory (English: Random Access Memory, abbreviation: RAM), a magnetic disk or an optical disk, and the like. A variety of media that can store program code.

The above is only the embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformation of the present invention and the contents of the drawings may be directly or indirectly applied to other related technologies. The fields are all included in the scope of patent protection of the present invention.

Claims

A small program-based sound processing system, characterized in that the system comprises a background server, and further comprising:

a mobile terminal, installed with an applet application for receiving sound waves/audio in response to the call of the applet;

a small program server, configured to convert the received sound wave/audio into a corresponding sound code; query a binding relationship between the pre-generated sound code and the information content/control instruction, and obtain information content that matches the generated sound code/ Controlling the instruction; and invoking the information content or generating a corresponding internal control instruction;

The binding relationship is pre-stored in the applet server, the mobile terminal, or the background server.
The applet-based sound processing system according to claim 1, wherein the binding relationship is pre-stored in the background server, and the applet server is further configured to send the received sound wave/audio to The background server;

The background server is also used to:

Converting the received sound wave/audio into a corresponding sound code;

Querying a binding relationship stored in the background server to determine an information content/control instruction that matches the vocoding;

The information content is called or an internal control instruction corresponding to the control instruction is generated.
The applet-based sound processing system according to claim 1, wherein the binding relationship is pre-stored in the applet server; the applet server is further configured to send the received sound wave/audio To the background server;

The background server is further configured to convert the received sound wave/audio into a corresponding sound code, and send the sound code to the applet server;

The applet server is further configured to query, according to the received vocoding, binding information stored in the applet server to determine an information content/control instruction that matches the vocoding.
A small program based sound processing system, characterized in that the system comprises:

a mobile terminal, installed with an applet application, configured to receive a target information content/control instruction in response to the call of the applet;

a small program server, configured to query a pre-generated binding relationship according to the received target information content/control instruction to determine a vocoding that matches the target information content/control instruction; and convert the vocal code into Corresponding sound/audio for playing the sound wave/audio through the mobile terminal;

The binding relationship is pre-stored in the applet server, the mobile terminal, or the background server.
The applet-based sound processing system according to claim 4, wherein the binding relationship is pre-stored in the background server, and the applet server is further configured to receive the received information content/ An internal control command is sent to the background server;

The background server is further configured to query the stored binding information according to the received information content/control instruction to convert the sound code matching the information content/control instruction into a corresponding sound wave/audio, and The sonic/audio is sent to the applet server.
The applet-based sound processing system according to claim 4, wherein the binding relationship is pre-stored in the applet server; the applet server is further configured to send the determined voice code And the background server is further configured to convert the received voice code into a corresponding sound wave/audio, and send the sound wave/audio to the applet server.
A small program based sound processing system, characterized in that the system comprises:

a sound transmitting device, which is installed with an applet application, and receives a target information content/control command input by the user by running a small program;

a sound sending end server, configured to query a binding relationship between the pre-generated voice code and the information content/control instruction in response to the target information content/control instruction to determine a matched voice code, and convert the voice code into a corresponding sound wave /audio, and calling the sound transmitting device to play the sound wave/audio;

a sound receiving device, installed with an applet application, and receiving the sound wave/audio sent by the sound transmitting device by running a small program;

The sound receiving end server is configured to convert the received sound wave/audio into a corresponding sound code, and query a binding relationship between the pre-generated sound code and the information content/control instruction to determine a matching information content/control instruction.
The applet-based sound processing system according to claim 7, wherein the sound transmitting end server is an applet server corresponding to an applet run by the sound transmitting end device.
The applet-based sound processing system according to claim 8, wherein the sound receiving end server is an applet server corresponding to an applet run by the sound receiving end device.
A small program server, characterized in that the server comprises:

a receiving unit, configured to invoke an applet to receive sound waves/audio through the mobile terminal; wherein the mobile terminal runs the applet;

a processing unit, configured to process the received sound wave/audio to generate a corresponding sound code;

a first querying unit, configured to query, according to the vocode generated by the processing unit, a binding relationship between the pre-generated vocoding code and the information content/control instruction to determine an information content/control instruction that matches the vocoding code; The binding relationship is pre-generated and saved in the applet server, the mobile terminal, or the background server;

a first calling unit, configured to invoke the information content to be displayed by the mobile terminal according to an information content/control instruction matched with the vocoding, or generate a corresponding control instruction to invoke the mobile terminal to perform the control instruction.
A small program server, characterized in that the server comprises:

a first query unit, configured to invoke the applet to receive the target information content/control instruction by the mobile terminal, and query a binding relationship between the pre-generated sound wave and the information content/control instruction to determine that the target information content/control instruction is matched The vocoding code; wherein the binding relationship is pre-generated and saved in the applet server, the mobile terminal or the background server;

a first processing unit, configured to process the voice code determined by the first query unit to generate a corresponding sound wave/audio file;

And a playback driving unit, configured to drive the mobile terminal to play the sound wave/audio file generated by the first processing unit.
A small program-based sound processing method, characterized in that the method comprises:

The mobile terminal runs a small program application to receive sound waves/audio;

The applet server acquires the sound wave/audio received by the mobile terminal through the applet, and converts the sound wave/audio into a corresponding sound code;

The applet server queries a binding relationship between the pre-generated vocoding and the information content/control instruction, and obtains an information content/control instruction that matches the generated vocoding; wherein the binding relationship is pre-stored in the In the applet server, the mobile terminal or the background server;

The applet server invokes the information content or generates a corresponding internal control instruction.
The method according to claim 12, wherein the applet server acquires sound waves/audio received by the mobile terminal by using a small program, the method further comprising:

The applet server sends the sound wave/audio to the background server;

The background server processes the received sound wave/audio to generate a corresponding sound code;

The background server queries a binding relationship stored in the background server to determine an information content/control instruction that matches the vocoding, and invokes the information content or generates a corresponding control instruction.
A small program-based sound processing method, characterized in that the method comprises:

The applet server calls the mobile terminal to receive the target information content/control instruction through the applet, and queries the binding relationship between the pre-generated and saved voice code and the information content/control instruction to determine the voice code corresponding to the target information content/control instruction; The binding relationship is pre-generated and saved in a mobile terminal, an applet server, or a background server;

The applet server processes the vocoding to generate a corresponding sound wave/audio;

The applet server invokes the mobile terminal to play the sound wave/audio through a small program.
A small program-based sound processing method, characterized in that the method comprises:

The sound sending end server calls the sound transmitting end device to receive the target information content/control instruction through the applet, and queries the binding relationship between the previously generated and saved sound code and the information content/control instruction to determine the target information content/control instruction corresponding to the target information content/control command a vocoding code; wherein the binding relationship is pre-generated and saved in a sound sending end device, a sound sending end server, or a background server;

The sound sending end server processes the sound code to generate a corresponding sound wave/audio;

The sound sending end server calls the sound sending end device to play the sound wave/audio through a small program;

The sound receiving end device running applet application receives the sound wave/audio;

The sound receiving end server acquires the sound wave/audio received by the sound receiving end device through a small program, and converts the sound wave/audio into a corresponding sound code;

The sound receiving end server queries a binding relationship between the pre-generated voice code and the information content/control instruction, and obtains an information content/control instruction that matches the generated voice code; wherein the binding relationship is pre-stored in the Said in the sound receiving end server, the sound receiving end device or the background server;

The sound receiving end server invokes the information content or generates a corresponding internal control instruction.
The small program-based sound processing method according to claim 15, wherein the sound transmitting end server and the sound receiving end server are small applet servers, and are used to correspondingly call the small running by the applet. The sound transmitting device and the sound receiving device of the program.