CN112637147B

CN112637147B - Method, terminal and server for establishing and connecting communication service through audio

Info

Publication number: CN112637147B
Application number: CN202011450267.2A
Authority: CN
Inventors: 路九阳
Original assignee: Qingdao Hope Bird Technology Co ltd
Current assignee: Qingdao Hope Bird Technology Co ltd
Priority date: 2020-12-13
Filing date: 2020-12-13
Publication date: 2022-08-05
Anticipated expiration: 2040-12-13
Also published as: CN112637147A

Abstract

The application provides a method for establishing and connecting communication service through audio, a terminal and a server, wherein the method comprises the steps of establishing communication service at a communication service establishing terminal, collecting and generating first audio data, and sending the established communication service information and the first audio data to the server; registering a communication service record at a server, storing a first audio data record, and recording a corresponding relation between the communication service record and the first audio data record; acquiring and generating second audio data at the communication service connection terminal, and sending a communication service connection request to the server; searching similar first audio data records in the first audio data record set by the server according to the received second audio data, acquiring the corresponding communication service records and providing communication service information; the communication service connection terminal establishes a communication connection with the communication service. The application provides a method for quickly establishing communication service connection between terminals capable of acquiring similar audio.

Description

Method, terminal and server for establishing and connecting communication service through audio

Technical Field

The invention relates to the field of internet technology and communication, in particular to a method, a terminal, a server and a system for establishing and connecting communication service through audio.

Background

As a physical phenomenon, sound is ubiquitous in the real world, and with the development of technology, sound processing technologies, such as audio coding and audio recognition, are becoming more sophisticated through computers. In daily life, we often encounter two or more identical or similar sound waves, such as: broadcasting station, the announcer and the audience can receive similar sound information; telephone voice communication, wherein both parties of the telephone communication receive similar voice information; in daily conversation and on-site meeting, a conversation person and a participant are in the same sound environment; two communication devices in the same sound environment, etc. The above are common scenes, but the simple voice communication cannot meet the communication requirements of people, for example, a broadcaster can watch programs in the host of the painting and calligraphy, and hopes that listeners can quickly acquire the explained painting and calligraphy content; the audience listens to the advertising goods through broadcasting and expects to directly place orders for purchase; the two parties of telephone voice communication expect that the same photo appears on the computer for communication at the same time of telephone; the method includes that a live host hopes that the explained PPT can quickly convey each member while meeting; the members who discuss on the spot open the WeChat to build the crowd face to face, expect to start and join the personnel on the spot automatically by a key, operate high-efficiently; and carrying out quick pairing communication on two devices in the same sound environment, and the like. In the above scenario, multiple parties receiving the same or similar sound all have a requirement for establishing communication, and therefore, how to quickly establish communication based on the same or similar sound is a critical issue to apply a new technical solution.

Disclosure of Invention

In view of the above-mentioned existing situation, the present application provides a method for quickly establishing communication through audio by applying sound coding, audio comparison and computer communication technologies, so as to establish communication connection and provide communication service for a plurality of devices that can receive the same or similar audio.

In a first aspect, the present application provides a method for creating a communication service through audio, executed at a communication service creation terminal, including:

acquiring an audio signal of a first sound, generating audio signal data or an audio signal data stream, and generating first audio data from the audio signal data or the audio signal data stream, or performing audio coding processing on the audio signal data or the audio signal data stream according to a preset coding rule to generate first audio data;

sending the first audio data to a server;

creating a communication service, and generating communication service registration information based on the communication service, wherein the communication service is used for a communication service connection terminal to connect and access, or the communication service creation terminal and the communication service connection terminal to connect, access or communicate, and the communication service registration information is used for registering the communication service at a service end;

sending the communication service registration request to the server, wherein the communication service registration request at least comprises communication service registration information;

receiving a communication service registration result from the server, wherein the communication service registration result comprises return information of successful registration or failed registration of the communication service at the server;

in the method, the first sound creates a sound acquirable by a terminal for the communication service; the server is used for receiving the communication service registration request and the first audio data sent by the communication service creation terminal, registering a communication service record based on communication service registration information contained in the communication service registration request, generating a first audio data record based on the first audio data storage, and recording a corresponding relation between the registered communication service record and the stored first audio data record; the encoding rule is used to calculate a characteristic value of the audio signal data or the audio signal data stream.

According to the scheme provided by the embodiment of the application, the communication service creation terminal sends the audio data and the communication service registration information to the server, registers the communication service and stores the audio data in the server, and establishes the corresponding relation between the communication service and the server so that the connection terminal capable of providing similar audio data can acquire the corresponding communication service.

In an implementation manner of the present application, at the communication service creation terminal, the first audio data and the communication service registration information are together generated into the communication service registration request, and the communication service registration request is sent to the server;

the server is further configured to obtain the first audio data and communication service registration information according to the received communication service registration request, register a communication service record based on the communication service registration information, store the first audio data as a first audio data record, and record a correspondence between the communication service record and the first audio data record.

In the implementation manner, the communication service registration request sent to the server includes the first audio data, so that the server registers the corresponding communication service based on the provided audio data.

In another implementation manner of the present application, after the communication service created by the communication service creation terminal is registered at the server, the method further includes:

continuously or continuously acquiring the audio signal data or audio signal data stream based on an audio signal in a first sound, generating first audio data, and sending the first audio data generated each time to the server;

after the first audio data is received by the server, the received first audio data and the first audio data record correspondingly stored in the server are merged and stored, or the received first audio data is used for replacing the first audio data record correspondingly stored in the server.

In this implementation manner, since both the first sound receivable by the communication service creation terminal and the second sound receivable by the connection terminal change with time, after the communication service record is registered in the server, the communication service creation terminal continuously or continuously acquires the audio signal and generates the first audio data to send to the server, so as to update the first audio data corresponding to the communication service stored in the server, thereby providing the corresponding communication service for calculating the second audio data received in real time for connecting to the communication service.

In another implementation manner of the present application, after acquiring an audio signal of a first sound to generate audio signal data or an audio signal data stream, the method further includes:

and at the communication service creation terminal, obtaining corresponding audio processing rules by condition selection or calculation according to one or more of communication service creation terminal information, configuration information of the communication service, properties of the first audio data and audio processing rules specified by a server, and performing audio processing on the audio signal data or audio signal data stream according to the audio processing rules, wherein the audio processing comprises one or more of audio filtering, audio extraction, audio conversion, audio clipping, audio combination and audio detection.

In the above implementation manner, the communication service creation terminal may select or calculate and generate a corresponding audio processing rule according to the creation terminal, the communication service configuration, the server requirement, and the property of the first audio, and perform audio filtering, audio extraction, audio conversion, audio clipping, audio merging, and the like on the audio data based on the processing rule.

In another implementation manner of the present application, before performing audio coding processing on the audio data or the audio data stream according to a predetermined coding rule, the method further includes, at the communication service creation terminal, selecting or calculating to obtain a corresponding coding rule according to one or more of communication service creation terminal information, configuration information of the communication service, a property of the first audio data, and a coding rule specified by a service end as a condition.

In the above implementation manner, the communication service creation terminal may select or calculate to generate a corresponding audio coding rule according to the creation terminal, the communication service configuration, the server requirement, and the property of the first audio, and encode the audio data based on the coding rule to calculate the feature value of the audio data according to the corresponding requirement.

In another implementation manner of the present application, the generating, by the communication service creation terminal, a communication service registration request further includes:

generating additional information registered for the communication service according to one or more of the communication service creation terminal information, the configuration information of the communication service, the property information of the first audio data, and the used encoding rule information;

sending the communication service registration request to the server side, and simultaneously sending additional information of the communication service registration;

in the above implementation manner, after the additional information registered for the communication service is received by the server, the content included in the additional information registered for the communication service is stored as the data field associated with the communication service record, and is used for filtering and querying the communication service record.

In a second aspect, the present application further provides a method for creating a communication service through audio, which is performed at a server side, and the method includes:

receiving a communication service creation request sent by a communication service creation terminal;

registering communication service information contained in the communication service creation request and generating a communication service record;

receiving first audio data sent by a communication service creation terminal, storing the first audio data as a first audio data record, and establishing a corresponding relation between the first audio data record and the communication service record;

and generating registration result return information according to the communication service record, and sending the registration result return information to the communication service creation terminal.

Through the scheme provided by the embodiment, the communication service record is registered at the server side, and the corresponding relation between the communication service record and the first audio data is established.

In another implementation manner of the application, after the server receives the first audio data sent by the communication service creation terminal, the method further includes determining whether the received first audio data and/or the received communication service information to be registered meet a condition for registering the communication service according to a predetermined registration rule, registering the communication service and generating communication service registration success information when determining that the condition for registering the communication service is met, and generating the communication service registration failure information when determining that the condition for registering the communication service is not met.

In the above implementation manner, the predetermined registration rule includes performing calculation according to one or more of first audio data included in the communication service registration request, the communication service creation terminal information, the communication service configuration information, a communication service record already stored by the server, an audio data record already stored by the server, and a registration rule stored by the server.

According to the above implementation manner, when the server registers the communication service record, whether the received first audio data and the received communication service information to be registered meet the condition for registering the communication service is judged according to the predetermined registration rule, so as to realize the registration management of the communication service, such as restricting the use of the same or similar audio data for registering the communication service.

In another implementation manner of the present application, the server receives and stores first audio data sent by the communication service creation terminal at the server, and further includes, when it is determined that the communication service corresponding to the first audio data is registered, acquiring a registered communication service record corresponding to the first audio data, acquiring a corresponding first audio data record according to the communication service record, and merging and storing the received first audio data and the first audio data in the first audio data record correspondingly stored in the server, or replacing the first audio data in the first audio data record correspondingly stored in the server with the received first audio data.

According to the implementation mode, the server side provides a corresponding data processing mode for the audio data sent by the communication service creation terminal which has successfully registered the communication service, and the first audio data record is updated in a combined storage or replacement mode. The principle is that since both the first sound and the second sound change with time, it is necessary to ensure that the first audio data record of the server is in the latest state, so as to perform audio comparison calculation corresponding to the second audio data received in real time.

In another implementation manner of the present application, the receiving, by the server, the communication service registration request sent by the communication service creation terminal, further includes receiving additional information of the communication service registration sent by the communication service creation terminal, analyzing the additional information of the communication service registration, and storing content included in the additional information of the communication service registration as a data field associated with a communication service data record corresponding to the registration.

In the above implementation, the data field stored according to the content included in the additional information registered for the communication service is used for the filtering query of the communication service data record.

In a third aspect, the present application further provides a method for connecting a communication service through audio, where the method is performed at a server, and the method includes:

receiving a communication service connection request of a communication service connection terminal;

parsing second audio data included in the communication service connection request;

according to the second audio data, performing similarity audio searching in the first audio data record set to obtain first audio data records similar to the first audio data records;

according to the similar first audio data record, according to the corresponding relation between the first audio data record stored in the server and the communication service record, obtaining the communication service record corresponding to the first audio data record;

and returning the communication service connection information contained in the communication service record to the communication service connection terminal, or establishing the communication connection between the communication service connection terminal and the communication service.

According to the scheme provided by the embodiment of the application, similar audio searching is executed in the first audio data record set through the received second audio data in the communication service connection terminal, the similar first audio data record is located, the communication service record corresponding to the similar first audio data record is obtained, and the communication service connection terminal is provided with services based on the communication service, so that the purpose of realizing the application is achieved.

In one implementation manner of the present application, performing a first audio data record search with similarity in the first audio data record set according to the second audio data, further includes:

according to the time information contained in the second audio data, determining an audio data length range for performing similarity search in the first audio data contained in the first audio data record;

and reading a first audio data record contained in the first audio data record set, extracting a corresponding audio data segment from first audio data contained in the first audio data record according to the audio data length range, and returning the first audio data record as a search result after determining that an audio data segment similar to the second audio data is found in the audio data segment.

The above implementations provide a method of finding a first audio data record in a first set of audio data records that has a similarity to the second audio data.

In another implementation manner of the present application, performing a first audio data record search with similarity in the first audio data record set according to the second audio data further includes:

and obtaining a similarity value of the second audio data and first audio data contained in the first audio data record, executing audio similarity calculation according to subsequently received audio data corresponding to the second audio data and subsequently received audio data corresponding to the first audio data within a preset time range after determining that the similarity value obtained by the audio similarity calculation meets a preset similarity judgment rule, and returning the first audio data record as a search result.

The above implementation, in combination with the principle that the first sound and the second sound change with time, provides a method for verifying the similarity between the confirmation and the verification of the second audio data and the first audio data record step by step with time.

In another implementation manner of the present application, after establishing a communication connection between the communication service connection terminal and the communication service, at the service end, the method further includes:

receiving second audio data sent by the communication service connection terminal;

obtaining a corresponding communication service record according to a communication service connected with the communication service connection terminal, and obtaining a corresponding first audio data record according to the communication service record;

and executing audio similarity calculation according to the received second audio data and the first audio data contained in the corresponding first audio recording data record, and disconnecting the communication service connection terminal from the communication service after confirming that the similarity value obtained by the audio similarity calculation does not accord with a preset similarity judgment rule.

According to the above implementation manner, in the embodiment of the present application, a method for disconnecting communication with the service connection terminal is provided, that is, second audio data collected by the communication service connection terminal and first audio data collected by the communication service creation terminal are judged by a similarity rule, and when the similarity is too low or dissimilar, the communication connection with the communication service connection terminal is disconnected.

In a fourth aspect, the present application further provides a method for connecting a communication service through audio, which is performed at a communication service connection terminal, the method including:

acquiring an audio signal of a second sound, generating audio signal data or an audio signal data stream, and generating second audio data from the audio signal data or the audio signal data stream, or generating second audio data after performing audio coding processing on the audio signal data or the audio signal data stream according to a preset coding rule;

generating a communication service connection request based on the second audio data;

sending a communication service connection request to a server;

and establishing communication connection with the communication service, or receiving communication service request response information sent by the server, and establishing communication connection with the communication service when the response information comprises communication service information.

According to the scheme provided by this embodiment, the server is configured to receive the communication service connection request, parse and acquire the second audio data, search for first audio data similar to the second audio data according to the second audio data, acquire a corresponding first audio data record and a corresponding communication service record, connect the communication service, or generate communication service connection information based on information included in the communication service record and return the communication service connection information to the communication service connection terminal. In the above implementation method, the communication service connection terminal sends the communication service connection request and simultaneously sends the second audio data, and the main purpose of the method is to request the communication service information corresponding to the first audio data record similar to the second audio data from the server.

In one implementation manner of the present application, after acquiring an audio signal of a second sound to generate audio data or an audio data stream, the method further includes:

and at the communication service connection terminal, selecting or calculating corresponding audio processing rules as conditions according to one or more of the communication service connection terminal information, the configuration information of the communication service, the property of the second audio data and audio processing rules appointed by a service terminal, and performing audio processing on the audio data or the audio data stream according to the audio processing rules, wherein the audio processing comprises one or more of audio filtering, audio extraction, audio conversion, audio clipping, audio combination and audio detection.

In the above implementation manner, the communication service connection terminal may select or calculate to generate a corresponding audio processing rule according to the connection terminal, the communication service configuration, the server requirement, and the property of the second audio, and perform audio filtering, audio extraction, audio conversion, audio clipping, audio merging, and the like on the audio data based on the processing rule.

In another implementation manner of the present application, before performing audio encoding processing on the audio data or the audio data stream according to a predetermined encoding rule, the method further includes:

and at the communication service connection terminal, selecting or calculating to obtain a corresponding coding rule as a condition according to one or more of the communication service connection terminal information, the communication service configuration information requesting to establish connection, the property of the second audio data and the coding rule designated by the service terminal.

In the above implementation manner, the communication service connection terminal may select or calculate to generate a corresponding audio coding rule according to the connection terminal, the communication service configuration, the server requirement, and the property of the second audio, and encode the audio data based on the coding rule to calculate the feature value of the audio data according to the corresponding requirement.

In another implementation manner of the present application, after the communication service connection terminal establishes the communication connection with the communication service, the method further includes:

the audio acquisition processing unit acquires an audio signal continuously or according to a preset time interval based on the second sound and generates second audio data, and the second audio data is used for generating the communication service verification request;

sending the second audio data or the communication service verification request to the server;

according to the implementation manner, the second audio data is used for receiving by the server, validity of communication service connection is verified based on the second audio data, so that effective communication service connection is kept under the condition that the second audio data and the corresponding first audio data are similar audio data, and otherwise, the communication service connection is disconnected.

In another implementation manner of the present application, generating a communication service connection request based on the second audio data further includes:

generating additional information of the communication service connection based on one or more of the communication service connection terminal information, communication service configuration information requesting connection establishment, property information of the second audio data, and encoding rule information used;

sending the communication service connection request to the server side, and simultaneously sending additional information of the communication service connection;

according to the implementation manner, after the additional information of the communication service connection is received by the server, the additional information is used for filtering and inquiring the communication service record stored by the server.

In a fifth aspect, the present application further provides a communication service creation terminal for use by a communication service creator, the communication service creation terminal comprising: the system comprises an audio acquisition processing unit, a communication service creating unit, a sending unit and a receiving unit. The audio acquisition processing unit is used for acquiring an audio signal of a first sound and generating first audio data, and the audio acquisition processing unit generates the first audio data according to the acquired audio signal data or audio signal data stream, or generates the first audio data after performing audio coding processing on the acquired audio signal data or audio signal data stream according to a predetermined coding rule. A communication service creating unit, configured to create a communication service, and generate communication service registration information for the created communication service, where the communication service is used for a communication service connection terminal to connect and access, or for the communication service creation terminal and the communication service connection terminal to connect and access, the communication service registration information at least includes the communication service connection address information, and the communication service registration information is used to register the communication service at a service end. The sending unit is used for sending the first audio data to a server; the system comprises a server side and a server side, wherein the server side is used for sending a communication service registration request to the server side, and the communication service registration request at least comprises communication service registration information; the system is also used for sending a communication service logout request to the server; and the server is also used for sending communication service creation terminal information to the server. A receiving unit, configured to receive a communication service registration result from the server, where the communication service registration result includes return information of success or failure of registration of the communication service; the server is also used for receiving communication service logout result information returned by the server; and is also used for receiving communication service connection terminal information corresponding to the created communication service.

In the above implementation, the first sound creates a sound available to a terminal for the communication service; the server is used for receiving the communication service registration request and the first audio data sent by the communication service creation terminal, registering a communication service record based on communication service registration information contained in the communication service registration request, generating a first audio data record based on the first audio data storage, and recording a corresponding relation between the registered communication service record and the stored first audio data record; the encoding rule is used to calculate a characteristic value of the audio signal data or the audio signal data stream.

According to the above, the communication service creation terminal has a function of implementing the behavior of the communication service creation terminal in the above method, and the function may be implemented by software or by hardware executing corresponding software, where the software or hardware includes one or more modules corresponding to the above function.

In an optional implementation, after the communication service is created, the audio acquisition processing unit is further configured to continue or continue to acquire the audio signal based on the first sound and generate first audio data; the sending unit is further configured to send the first audio data generated each time to the server.

In the above implementation, after the first audio data is received by the server, the received first audio data is stored corresponding to the communication service.

In an optional implementation, the audio collecting and processing unit in the service creation terminal is further configured to obtain a corresponding audio processing rule according to one or more selections or computations of the communication service creation terminal information, the configuration information of the communication service, the property of the first audio data, and an audio processing rule specified by a server, and perform audio processing on the audio signal data or the audio signal data stream according to the audio processing rule, where the audio processing includes one or more of audio filtering, audio extraction, audio conversion, audio clipping, audio merging, and audio detection; the audio signal processing device is further used for calculating and obtaining a corresponding encoding rule according to one or more of configuration information of the communication service, the property of the first audio data and an encoding rule specified by a server, and encoding the audio signal data or the audio signal data stream according to the encoding rule to generate first audio data; and the system is also used for generating additional information registered by the communication service according to one or more of the communication service creation terminal information, the configuration information of the communication service, the property information of the first audio data and the used coding rule information. The sending unit is further configured to send the additional information of the communication service registration to the server, where the additional information of the communication service registration is received by the server, and the content contained in the additional information of the communication service registration is stored as a data field associated with the communication service record and is used for filtering and querying the communication service record.

In a sixth aspect, the present application further provides a server, configured to register and manage audio data and communication services, where the server includes: the system comprises a communication service registration unit, a communication service logout unit, an audio data management unit and a communication service management unit. The communication service registration unit is used for receiving a communication service registration request sent by a communication service creation terminal and registering a communication service according to the received communication service registration request, wherein the communication service registration comprises the steps of generating identification information for the communication service and adding a communication service record in a communication service database; the communication service creation terminal is also used for receiving the communication service creation terminal information; and is also used for returning the result information of the communication service registration success or the communication service registration failure. The communication service logout unit is used for receiving a communication service logout request sent by the communication service creation terminal, searching and acquiring a communication service record according to the received communication service logout request and performing logout processing on the communication service record; and also for returning the result information of the communication service logout. The audio data management unit is used for receiving and storing first audio data used for establishing the communication service and sent by the communication service establishing terminal, generating a first audio data record and simultaneously recording the corresponding relation between the first audio data record and the registered communication service record; the method is further used for receiving first audio data sent by the communication server side which has created the communication service, acquiring a first audio data record corresponding to the registered communication service record corresponding to the first audio data record, and merging and storing the received first audio data and the first audio data contained in the first audio data record, or replacing the first audio data in the first audio data record with the received first audio data. The communication service management unit is used for receiving a communication service connection request sent by a communication service connection terminal, processing the communication service connection request, calculating and obtaining a target communication service according to second audio data contained in the communication service connection request, and returning the target communication service to the communication service connection terminal or establishing connection between the communication service connection terminal and the target communication service; the terminal is also used for receiving the communication service registration terminal information; the communication service establishing terminal is also used for returning communication service establishing terminal information corresponding to the target communication service to the communication service connecting terminal; the communication service establishing terminal is also used for sending the connection terminal information to a communication service establishing terminal corresponding to the target communication service; the communication service connection terminal is further configured to receive a communication service verification request sent by the communication service connection terminal, search a corresponding first audio data record according to second audio data included in the communication service verification request and the connected communication service, detect similarity between the second audio data and the corresponding first audio data included in the first audio data record, and disconnect the connection between the communication service connection terminal and the communication service when it is determined that the similarity does not conform to a preset similarity determination rule.

According to the above, the server has the function of implementing the server behavior in the above method.

In an optional implementation scheme, the communication service registration unit is further configured to, after receiving a communication service registration request sent by the communication service creation terminal, determine, according to a predetermined registration rule, whether the received first audio data and/or the received communication service information to be registered meet a condition for registering a communication service, register the communication service and generate communication service registration success information when determining that the condition for registering the communication service is met, and generate the communication service registration failure information when determining that the condition for registering the communication service is not met; and the communication service creating terminal is also used for receiving and analyzing the additional information of the communication service registration sent by the communication service creating terminal, and storing the content contained in the additional information of the communication service registration as the associated data field of the corresponding registered communication service data record.

In the above implementation, the predetermined registration rule includes performing calculation according to one or more of first audio data included in the communication service registration request, the communication service creation terminal information, the communication service configuration information, a communication service record already stored by the server, an audio data record already stored by the server, and a registration rule stored by the server; the additional information of the communication service registration includes a data field in which content is stored for filtering queries of the communication service data record.

In an optional implementation scheme, the service management unit is further configured to, according to the second audio data, perform a first audio data record search with similarity in the first audio data record set, and search for a first audio data record similar to the first audio data record, where determining, according to time information included in the second audio data, an audio data length range in which the similarity search is performed in the first audio data included in the first audio data record, reading the first audio data record included in the first audio data record set, extracting, according to the audio data length range, a corresponding audio data segment from the first audio data included in the first audio data record, and after determining, in the audio data segment, that the audio data segment similar to the second audio data is found, and returning the first audio data record as a search result.

In an optional implementation scheme, the communication service management unit performs, according to the second audio data, search for a first audio data record with similarity in the first audio data record set, and further includes obtaining a similarity value between the second audio data and the first audio data contained in the first audio data record, performing, within a preset time range, audio similarity calculation according to subsequently received audio data corresponding to the second audio data and subsequently received audio data corresponding to the first audio data after determining that the similarity value reaches a predetermined first threshold, and returning the first audio data record as a search result after determining that the similarity value obtained by the audio similarity calculation reaches a preset similarity judgment rule.

In a seventh aspect, the present application further provides a communication service connection terminal for use by a communication service visitor. The communication service connection terminal includes: the device comprises an audio acquisition processing unit, a sending unit, a receiving unit and a communication service connecting unit. The audio acquisition processing unit is configured to acquire an audio signal of a second sound and generate second audio data, where the second sound is the audio signal acquirable by the audio acquisition unit, and acquire and generate the second audio data based on the second sound, and the acquiring and generating the second audio data includes generating the second audio data according to the acquired audio signal data or audio signal data stream, or generating the second audio data after performing audio coding processing on the acquired audio signal data or audio signal data stream according to a predetermined coding rule. The sending unit is used for sending a communication service connection request to a server, the sent information simultaneously comprises the second audio data, and the server calculates and returns corresponding communication service connection information according to the received data; also used for sending the communication service and connecting the terminal information; and after the communication service connection terminal establishes the communication connection with the communication service, the communication service connection terminal continuously or according to a preset time interval sends a communication service verification request to the server, wherein the verification request comprises the second audio data, and the validity of the communication service connection is verified by the server based on the verification request so as to ensure that the second audio data and the corresponding first audio data keep a valid communication service connection under similar conditions, otherwise, the communication service connection is disconnected. A receiving unit, configured to receive communication service connection request response information sent by the server, where the communication service connection request response information includes the communication service identification information normally returned by the server, or information returned by the server without finding a corresponding communication service; and is further configured to receive communication service creation terminal information corresponding to the requested communication service connection. And the communication service connecting unit is used for connecting the communication service according to the communication service information returned by the service end.

In the above implementation, when the second sound and the first sound used by the communication service creation terminal to create the communication service are the same or similar sound, a connection with the corresponding communication service may be established. And after receiving the communication service connection request, the server analyzes and acquires the second audio data, searches for first audio data similar to the second audio data according to the second audio data, acquires a corresponding first audio data record and a corresponding communication service record, and connects the communication service or generates communication service connection information based on the information contained in the communication service record and returns the communication service connection information to the communication service connection terminal.

According to the above, the communication service connection terminal has a function of implementing the behavior of the communication service connection terminal in the above method, the function may be implemented by software, or may be implemented by hardware executing corresponding software, and the software or hardware includes one or more modules corresponding to the above function.

In an optional implementation scheme, the audio acquisition processing unit is further configured to obtain a corresponding audio processing rule according to one or more selections or calculations among the communication service connection terminal information, the configuration information of the communication service, the property of the second audio data, and an audio processing rule specified by a server, and perform audio processing on the audio signal data or the audio signal data stream according to the audio processing rule, where the audio processing includes one or more of audio filtering, audio extraction, audio conversion, audio clipping, audio merging, and audio detection; the audio data processing device is also used for selecting or calculating to obtain a corresponding coding rule as a condition according to one or more of the communication service connection terminal information, the communication service configuration information requesting to establish connection, the property of the second audio data and the coding rule appointed by the server, and coding the audio data or the audio data stream according to the coding rule to generate second audio data; and the additional information is used for generating the communication service registration additional information based on one or more of the communication service connection terminal information, the communication service configuration information for requesting connection establishment, the property information of the second audio data and the used coding rule information. The sending unit is further configured to send additional information of the communication service connection to the server, where the additional information of the communication service connection is received by the server and is used to perform filtering query on a communication service record stored by the server.

In an optional implementation, the audio acquisition processing unit is further configured to, after establishing a communication connection with the communication service, acquire an audio signal based on the second sound continuously or at a predetermined time interval, generate the second audio data, generate the communication service verification request, and send the second audio data or the communication service verification request to the server.

In the above implementation, the second audio data or the communication service verification request is received by the server, and validity of communication service connection is verified based on the second audio data or the communication service verification request, so as to ensure that the valid communication service connection is maintained when the second audio data and the corresponding first audio data are similar audio data, and otherwise, the communication service connection is disconnected.

In an eighth aspect, the present application further provides a system for creating and connecting a communication service through audio, the system comprising the communication service creation terminal according to the fifth aspect, the server according to the sixth aspect, and the communication service connection terminal according to the seventh aspect, wherein the service creation terminal can implement any one of the methods according to the first aspect, the server can implement any one of the methods according to the second aspect and the third aspect, and the communication service connection terminal can implement any one of the methods according to the fourth aspect.

In a ninth aspect, the present application provides a computer storage medium for storing computer software instructions for a communication service creation terminal according to the fifth aspect, which contains a program designed to execute the first aspect.

In a tenth aspect, the present application provides a computer storage medium for storing computer software instructions for the server according to the sixth aspect, which includes a program designed to execute the second and third aspects.

In an eleventh aspect, the present application provides a computer storage medium for storing computer software instructions for a communication service connection terminal according to the seventh aspect, which contains a program for executing the program designed according to the fourth aspect.

In a twelfth aspect, the present application provides a computer program for performing the method of creating a communication service by audio of any one of the first aspect when the computer program is executed by a computer.

In a thirteenth aspect, the present application provides a computer program for performing the method of connecting communication services through audio creation of any one of the second and/or third aspects, when the computer program is executed by a computer.

In a fourteenth aspect, the present application provides a computer program for performing the method of any one of the fourth aspect for connecting communication services through audio when the computer program is executed by a computer.

It can be seen that in the above aspects, with the method provided by the present application, for two or more terminals that can receive the same or similar sound signals, one terminal can establish a communication service, and the other terminals can quickly establish a connection with the communication service.

Drawings

Fig. 1 is a schematic diagram of an architecture of a communication service created and connected through audio according to an embodiment of the present application;

fig. 2 is a schematic flowchart of a communication service created and connected through audio according to an embodiment of the present application;

fig. 3 is a schematic flowchart of another communication service through audio creation and connection provided by an embodiment of the present application;

fig. 4 is a schematic flowchart illustrating a first audio data update after the communication service is registered according to an embodiment of the present application;

FIG. 5 is a flowchart illustrating processing an audio signal according to an embodiment of the present application using audio processing rules;

FIG. 6 is a flowchart illustrating encoding an audio signal using audio encoding rules according to an embodiment of the present application;

fig. 7 is a schematic diagram illustrating an additional information processing flow of communication service registration and connection according to an embodiment of the present application;

fig. 8 is a schematic flowchart illustrating a procedure for checking whether a communication service registration meets a registration requirement according to an embodiment of the present application;

fig. 9 is a schematic time range diagram of similarity calculation performed on two audio data according to an embodiment of the present application;

fig. 10 is a schematic diagram illustrating a similarity calculation process for two audio data according to an embodiment of the present disclosure;

fig. 11 is a flowchart illustrating a procedure for checking validity of a communication service connection according to an embodiment of the present application.

Detailed Description

The embodiments of the present application are in part illustrative of the present application and are not intended to be limiting of the present application.

Embodiments of the present application will now be described with reference to the accompanying drawings, and it is to be understood that the described embodiments are merely illustrative of some, but not all, embodiments of the present application. As can be known to those skilled in the art, with the development of technology and the emergence of new scenes, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

In the following, in order to make the present application easier to understand, some common descriptions related to the embodiments of the present application are explained, and it should be noted that these explanations should not be construed as limiting the scope of protection claimed in the present application.

Communication service

In the embodiments of the present application, the communication service is not limited to the network communication service in the conventional sense, and is mainly characterized in that the communication service can be connected or accessed, or is used for being connected to a terminal for receiving, including but not limited to software, a program, hardware, a network service, a network connection, network communication, and the like, which can be connected or accessed, or a network operation, a network instruction, and the like, such as a website, a network application, a network connection, a network service program, and the like, which are used for being connected to a terminal for receiving, can be used as the communication service in the embodiments of the present application. In the present application, the connection communication service is not limited to the network communication connection in the conventional sense, but also includes receiving the content in the communication service, such as receiving the network command in the communication service. In addition, the creation of the communication service at the communication service creation terminal is not limited to the creation of a communication service from a new one, and includes defining a communication service, such as designating a web address as a communication service, designating a network instruction as a communication service, and the like. It should be noted that the communication service creation terminal creates a communication service, the communication service connection terminal connects the communication service, and communication between two terminals and the communication service, and between two terminals is not particularly limited in the present application. Generally, for one communication service, there is one communication service creation terminal, to which one or more communication service connection terminals are connected.

Second, first sound, second sound

In an embodiment of the application, the first sound is a sound acquirable by a communication service creation terminal, the second sound is a sound acquirable by a communication service connection terminal, the communication service creation terminal creates a communication service, registers the communication service based on the first sound at a server, that is, establishes a correspondence between the first sound audio data and the registered communication service, provides the second sound audio data when the communication service connection terminal requests a communication service connection, and connects the communication service created corresponding to the similar audio data when the first sound audio data similar thereto is found. Therefore, the two terminals establish communication connection on the premise of similarity of the first sound and the second sound.

Communication service establishing terminal, communication service connecting terminal and service end

An architecture diagram of a communication service created and connected through audio according to an embodiment of the present application shown in fig. 1 includes a communication service creation terminal 10, a communication service connection terminal 11, and a server 12, where the communication service creation terminal 10 is configured to create a communication service based on a first sound, and includes a communication service creation module 101, a first audio data collection module 102, and a communication service registration request generation module 103; the server 12 includes a communication service registration unit 121 and a communication service management unit 122, and the registration unit 121 includes: a communication service registration module 1211, a first audio data storage module 1212, and the communication service management unit 122 includes: a similar first audio data searching module 1221 and a communication service searching module 1222 corresponding to the first audio data are executed according to the second audio data, and the service end is used for registering and managing one or more communication services, managing audio data and providing communication service connection for the communication service connection terminal 11; the communication service connection terminal 11 is configured to request a communication service based on the second sound, and includes a second audio data collection module 111, a communication service connection request generation module 112, and a communication service information reception and connection module 113. The communication service creation terminal, the communication service connection terminal and the server are software, hardware or equipment with the functional modules.

Four, audio data

In the embodiment of the present application, the first audio data and the second audio data are not limited to audio data in the conventional sense, but may also be feature values extracted by performing encoding calculation based on audio data in the conventional sense, and a main purpose is to identify and distinguish corresponding sounds, but not in the reproduction and playing of the audio.

Hereinafter, examples of the present application will be described.

As shown in fig. 2, a schematic flowchart of a communication service created and connected through audio according to an embodiment of the present application is provided, which includes the following steps:

in the communication service creation terminal 10:

s201, collecting a first sound audio signal. In the step, audio signal data or an audio signal data stream is acquired and obtained based on the first sound;

s202, first audio data is generated. The data collected in S201 is generated as first audio data, and optionally, the data collected in S201 is subjected to audio coding processing according to a predetermined coding rule to generate the first audio data. According to the implementation principle of the present application, the first audio data and the second audio data, hereinafter referred to as audio data, are mainly used for identification, differentiation, and comparison purposes, but not for playing, and therefore, preferably, the audio data of the present application is generated as feature values by extracting and processing the original audio data, and thus, can be used for fast transmission and comparison, and further, the generated feature values have a continuous characteristic, that is, in a continuous piece of audio, any audio segment contained therein has a corresponding feature value, and the data contained in the feature values corresponding to the same audio segment are the same, proportional, or have a functional relationship; preferably, in the audio data, corresponding acquisition time information is also included, and preferably, the audio data is in a time-series representation form;

s203, sending first audio data to a server;

in the server 12:

s206, receiving first audio data;

s207, storing the first audio data and generating a first audio data record. It should be noted that the server stores the audio data for a plurality of communication service creation terminals, and therefore, the first audio data record includes the corresponding communication service creation terminal identification information. Optionally, the first audio data received from a communication service creation terminal for a plurality of times is stored in the server in the form of a plurality of records, and the plurality of stored records are logically identical to one first audio record as a whole;

in the communication service creation terminal 10:

s204, a communication service is created. Optionally, the created communication service includes access address information of the communication service;

s205, generating a communication service registration request; the communication service registration request contains information required for registering the communication service at a server;

s208, sending a communication service registration request to the server; optionally, the method further includes sending the communication service creation terminal information, that is, the identification information of the communication service creation terminal 10, to a server;

in the server 12:

s209, receiving a communication service registration request; optionally, the method further includes receiving communication service creation terminal information;

s210, registering communication service, namely registering at a server and generating a communication service record;

s211, recording a correspondence between the registered communication service record and the stored first audio data record, that is, generating a correspondence for each of the first audio data sent from the communication service creation terminal and the communication service requiring registration;

s212, generating communication service registration response information;

s213, returning the communication service registration result information to the communication service establishing terminal;

in the communication service creation terminal 10:

s214, receiving communication service creation result information. This step indicates that the communication service registration is completed;

through the steps, the communication service creation terminal sends the first audio data and the communication service registration request to the server, receives and generates the relation between the first audio data and the communication service registration request at the server, and provides a foundation for the subsequent communication service through audio connection. For example, when a radio broadcaster wants to enable an audience to see a content (for example, a web page) being broadcasted while listening to a program, the radio broadcaster generates a feature value (first audio data) of an audio frequency broadcasted by the radio broadcaster, creates a communication service based on a website corresponding to the web page, sends the communication service and the web page to a server, and the server registers the communication service according to the received information, stores the audio data, and establishes a corresponding relationship.

In the communication service connection terminal 11:

s215, collecting a second sound audio signal;

s216, generating second audio data, wherein in the step, the encoding rule used for generating the second audio data is the same as or corresponding to that in step S202, that is, the audio data generated in S216 and S202 may be directly compared or compared using a function, and the features and the generating manner thereof are similar to that in S202, and are not described herein again;

s217, a communication service connection request is generated. The communication service connection request at least contains second audio data, and optionally, the second audio data is used as the communication service connection request and is sent to the server;

s218, sending a communication service connection request to a server; optionally, the method further includes sending the communication service connection terminal information to a server;

through the steps, the communication service connection terminal sends a communication service connection request to the server to acquire related communication services, such as the communication services established by the radio announcer, according to the steps, in the process that the audience listens to the program, the audience acquires the audible frequency generation characteristic value (second audio data), and generates a communication service connection request according to the characteristic value and sends the communication service connection request to the server to acquire the corresponding communication services.

At the server 12:

s219, receiving a communication service connection request; optionally, receiving the communication service connection terminal information;

s220, analyzing the communication service registration request and extracting second audio data;

s221, finding out a first audio data record with the first audio data similar to the second audio data in a first audio data record set;

s222, acquiring a communication service record corresponding to the first audio data record in the search result;

s223, generating communication service connection response data;

according to the above steps, the server side stores a plurality of first audio data records, each first audio data record corresponds to one communication service record, through the steps, the corresponding first audio data record is searched and obtained through the second audio data sent by the communication service connection terminal in an audio similarity searching mode, and then the connection request is responded according to the communication service information contained in the corresponding communication service record. As in the above example of the radio station announcer and the audience, after the server receives a connection request sent by a certain audience, according to the second audio data contained in the connection request, in the first audio data record set stored in the server, the first audio data record containing the first audio data similar to the second audio data is found, that is, the first audio data record created according to the first audio data sent by the radio station announcer is obtained, and the corresponding communication service information, that is, the website information used by the announcer to create the communication service is returned.

S224, sending communication service connection response data to the communication service connection terminal;

s225, receiving communication service connection response data;

s226, the communication service is connected.

According to the above steps, the communication service connection terminal obtains the corresponding communication service information and further connects the communication service. As in the above example of the radio announcer and listener, in this step, the listener accesses the web site to open the corresponding web page upon receipt.

It should be noted that the steps in the above embodiments are for illustrating the implementation principle of the present application, and some steps may be combined, omitted, and adjusted in order, for example: the first audio data and the communication service registration request in the above steps are sent to the server, the execution sequence is not particularly limited, and the first audio data and the communication service registration request can be sent simultaneously or sequentially. In addition, in the above steps, the processing of communication service registration failure and the processing of connection communication service failure are omitted, and the present application should not be limited thereto.

Through the embodiment, the communication service creation terminal sends the audio data and the communication service registration information to the server, the communication service is registered and the audio data is stored in the server, when the server receives the connection request sent by the communication service connection terminal, the server searches and obtains the similar first audio data record according to the audio data provided by the server, and obtains and returns the communication service information based on the corresponding communication service record, so that the purpose of creating and connecting the communication service through the audio is basically achieved.

The beneficial effects achieved by the application are explained by combining the examples of the radio station announcer and the audience: and through the similarity of the audios played by the announcer and listened by the audience, the communication connection is quickly established between the two audios. Due to the universality of the communication service in the application, the method is suitable for various network communications and accesses, and therefore, a novel communication mode is generated, such as audience communication, forum discussion and the like while broadcasting programs, online and offline ordering connection is directly provided when advertisements are played, and the like. In addition, through the implementation mode provided by the application, the communication service connection terminal can request the communication service in a unified mode, and the audience can acquire the communication service provided by each radio station announcer through a single application program or equipment of the application, even other communication services are included, so that the operation is simple and rapid.

In another implementation manner of the embodiment of the present application, as shown in fig. 3, for another schematic flow chart of creating and connecting a communication service through audio provided by the embodiment of the present application, steps different from those in fig. 2 are listed as follows:

in the communication service creation terminal 10:

s301, collecting a first sound audio signal;

s302, generating first audio data;

s303, establishing a communication service;

s304, generating a communication service registration request according to the communication service information and the first audio data;

s305, sending a communication service registration request to a server; optionally, the method further includes sending the communication service creation terminal information, that is, the identification information of the communication service creation terminal 10, to a server;

in the server 12:

s306, receiving a communication service registration request; optionally, the method further includes receiving communication service creation terminal information;

s307, the communication service registration request is analyzed, and communication service registration information and first audio data contained in the communication service registration request are acquired;

s308, registering communication service;

s309, storing the first audio data and generating a first audio data record;

and S310, recording the corresponding relation between the registered communication service record and the stored first audio data record.

In this implementation, step S311 corresponds to step S212 in fig. 2, and each subsequent step corresponds to the step in fig. 2, which is not described herein again.

In the above implementation, the difference from the implementation corresponding to fig. 2 is that the first audio data generated in S302 and the communication service created in S303 are used to generate a communication service registration request in S304, and the server 12 analyzes and processes the included communication service registration information and the first audio data according to the received communication service registration request.

In a possible implementation manner, corresponding to the embodiment of fig. 2 and 3, the communication service record corresponding to the first audio data record in the search result is obtained in step S222 or S321, the response data of the communication service connection generated in step S223 or S322 includes the communication service creation terminal 10 information, optionally, communication service connection notification information is generated according to the communication service connection terminal 11 information, the communication service connection notification information is sent to the communication service creation terminal 10, optionally, the communication service connection terminal confirms the communication service creation terminal information, and/or, in a case that the communication service creation terminal confirms the communication service connection terminal information, the communication service connection terminal is allowed to connect the communication service.

With reference to the implementation manners corresponding to fig. 2 and fig. 3, the implementation principle of the present application is analyzed, and two elements of the communication service are created at the server: first audio data, communication service registration information. The first audio data has real-time performance, and the communication service generally has singleness, that is, one communication service corresponds to one first audio data record, but one first audio data record corresponds to first audio data of different time periods. Therefore, optionally, in a possible implementation manner of the present application, for a communication service creation terminal, one piece of communication service registration information sent to a server may correspondingly send a plurality of pieces of first audio data, so that the server completes the communication service registration processing.

In a feasible implementation scenario, after the communication service is registered at the service end 12, the communication service creation terminal receives result information of successful communication service registration, as shown in fig. 4, which is a schematic flow diagram of updating the first audio data after the communication service is registered, provided in this embodiment of the present application, and further includes the following processing steps:

in the communication service creation terminal 10:

s401, receiving communication service registration result information;

s402, collecting a first sound audio signal;

s403, generating first audio data;

s404, sending first audio data to a server;

in the server 12:

s405, receiving first audio data;

s406, searching a corresponding communication service record;

s407, searching for a corresponding first audio data record according to the communication service record;

s408, merging and storing or replacing the received data according to the data stored in the first audio recording data;

in fig. 4, similar steps to those in fig. 2 and 3 are omitted.

In the foregoing implementation scenario, a manner is provided in which the communication service continuously or continuously updates the first audio data after the server registration is completed. The method provided by the application provides communication services for a plurality of terminals based on similar audio information, but has the problems that the received sound information changes along with time at the same time or within a certain time range, namely, after the communication service creation terminal registers the communication service based on the first audio data of a certain time period, under most conditions, the communication service connection terminal sends a connection request within a subsequent time period, at the moment, the sound collected by both sides changes, therefore, in the implementation scenario, after the communication service creation terminal finishes the registration of the communication service, the communication service creation terminal needs to continuously or continuously collect the audio signal and generate the first audio data, and send the first audio data to the service terminal to update the first audio data, when receiving the latest second audio data provided by the communication service connection terminal, both the two audio data keep the latest state and correspond to the same time or within a certain time range, thereby performing an audio similarity comparison calculation to obtain a corresponding communication service.

In another possible implementation scenario of the present application, after the communication service provided by the communication service creation terminal 10 is registered at the service end 12, the communication service creation terminal 10 sends a communication service change request to the service end 12, where the change request includes new communication service registration information, and at the service end 12, the communication service registration record correspondingly created by the communication service creation terminal is modified into the new communication service registration information, and all communication service connection terminals 11 connected to the communication service are notified, and the connected communication service is switched to the new communication service. In combination with the above examples of the radio announcer and the audience, the advantage that the announcer can change the communication service during the playing of the program, such as changing the website, so that the audience can access different communication services along with the automatic connection of the program.

In a specific implementation scenario, the communication service creation terminal 10 and the communication service connection terminal 11 create and connect a communication service based on similar audio, and the sound is a sound wave generated by vibration of an object, and there are many factors affecting the sound, such as a sound-producing device, a position where the sound is received, an environment, and the like, and for example, when listeners listen to the same program, the sound received by almost every listener is completely different. Therefore, before processing the generated audio data, it is preferable to process the sound.

Please refer to fig. 5, which is a flowchart illustrating a process of processing an audio signal according to an audio processing rule, comprising the following steps:

in the communication service creation terminal 10:

s501, collecting a first sound audio signal;

s5011, calculating or selecting to obtain a corresponding audio processing rule;

s5012, processing the audio signal according to the audio processing rule;

s503, generating first audio data;

in the communication service connection terminal 11:

s506, collecting a second sound audio signal;

s5061, calculating or selecting to obtain a corresponding audio processing rule;

s5062, processing the audio signal according to the audio processing rule;

s507, generating second audio data;

likewise, steps not related to capturing audio-generated audio data are omitted in fig. 5.

In the above implementation, S5011 or S5061 calculates or selects to obtain the corresponding audio processing rule, including but not limited to calculating or selecting as a condition one or more of terminal information, configuration information of a communication service, a property of audio signal data, an audio processing rule specified by a service end, and the like, for example, according to the property of the audio signal data, when the sound is determined to be voice, a voice-related audio processing rule is adopted, and for example, different audio processing rules are adopted for different types of terminals. Optionally, the audio processing rules further include an audio detection rule, where the audio detection rule is used to detect whether the audio signal data meets a condition for registering or connecting to the communication service, and in steps S5012 and S5062, the audio processing rules further include detecting the audio signal using the audio detection rule, and terminating a current operation related to registering or connecting to the communication service when the audio signal data does not meet the condition for registering or connecting to the communication service.

Through the implementation mode, the obtained beneficial effects are that more effective audio signals or audio data can be obtained through the audio processing rules, and efficient audio similarity comparison operation can be more favorably carried out, for example, environmental noise is filtered at the audience terminal to obtain purer sound signals, so that the operation efficiency is improved, the operation time is saved, and the connection terminal can conveniently and rapidly obtain communication services.

With the above implementation, high-quality audio signal data can be obtained, but the audio signal data generally has a large data size, can be used for playing audio, but is not favorable for fast transmission, and in addition, if the audio signal data is directly applied to audio similarity comparison calculation, the operation efficiency is low, so the obtained audio signal data is preferably subjected to audio coding processing.

In a preferred implementation scenario of the present application, as shown in fig. 6, a flowchart for encoding an audio signal using an audio encoding rule provided in the embodiment of the present application includes the following steps:

in the communication service creation terminal 10:

s601, collecting a first sound audio signal;

s6011, calculating or selecting to obtain a corresponding audio coding rule;

s6012, processing the audio signal according to the audio coding rule;

s603, generating first audio data;

in the communication service connection terminal 11:

s606, collecting a second sound audio signal;

s6061, calculating or selecting to obtain a corresponding audio coding rule;

s6062, processing the audio signal according to the audio coding rule;

s607, generating second audio data;

likewise, steps not related to the acquisition of audio, the generation of audio data are omitted in fig. 6.

In the above implementation, S6011, S6061 calculates or selects to obtain the corresponding audio processing rule, including but not limited to calculating or selecting to obtain the corresponding audio processing rule according to one or more of terminal information, configuration information of a communication service, a property of audio signal data, a service-side specified encoding rule, and the like as a condition, for example, according to the property of the audio signal data, when the sound is determined to be speech, a speech-related encoding rule is adopted, and when the property of the audio signal data is determined to be music, a music-related encoding rule is adopted. It should be noted that, the coding rules obtained by the above condition calculation or selection require the consistency or correlation between the coding rules finally obtained by S6061 and S6061, and the core of this implementation is that the communication service creation terminal 10 and the communication service connection terminal respectively calculate according to their own conditions, and it needs to be ensured that the same or correlated coding rules are finally obtained, such as: communication services are created using a specified type of communication service creation terminal (e.g., APP1), communication services are requested using another specified type of communication service connection terminal (e.g., APP2), and encoding rules are specified in APP1, APP2 to ensure that the audio data encoded by APP1 and the audio data encoded by APP2 can be subjected to efficient similarity comparison operations, yet quickly distinguished from the audio data provided by other types of terminals. Preferably, the applied coding rule is written in the head of the audio data, which is beneficial to quickly distinguish whether two audio data have similarity before the audio similarity comparison operation is carried out, or to select the similarity calculation function according to the used coding rule. Preferably, at the communication service creation terminal 10, after the coding rule is generated at S6011, all subsequent audio signal data is coded using the rule; in the communication-service creating terminal 10, after the encoding rule is generated in S6061, the rule is used for all subsequent encoding of audio signal data.

In the above implementation manner, the audio signal data is encoded by using the encoding rule, and finally, the first audio data or the second audio data is obtained, where the audio signal data is different from the audio data in that the former can be used for sound reproduction and playing, the data size is large, and the data characteristics are not obvious; the latter is generally not usable for sound reproduction, and is a feature value extracted based on the audio signal data, which has a small data amount but can effectively identify an audio signal, and is usable for efficient similarity comparison calculation, such as a feature value extracted based on intensity, pitch, frequency, tone, etc. of a sound signal, a feature value extracted based on a change in sound-containing elements, or the like. According to the implementation mode, the following beneficial effects can be obtained, the audio data stored by the server side is not true audio data, and the privacy of a user is protected conveniently; the data volume is small, so that the server can bear more terminals to provide communication service registration and connection service; the method is beneficial to efficiently executing the comparison operation of the audio data similarity, and the response speed of the communication service connection request is improved.

In an alternative implementation manner, the above embodiment S6011 may generate a plurality of encoding rules, correspondingly, each encoding rule is applied in S6012 to encode the first audio signal data, and generate a corresponding feature vector by encoding, and finally, the first audio signal data generated in S603 includes all the generated feature vectors. For encoding of the second audio data, S6061, S6062 and S607 are similar to the above steps and are not described herein again.

In the specific implementation scenario of the present application, there are a large number of communication service creation terminals 10, and therefore, a large number of first audio data records are correspondingly stored in the server 12, and when the communication service connection terminal 11 sends a request to the server 12 for the first time, it is not possible to locate the first audio data record set that needs to be subjected to audio similarity comparison, for example, similar audio records are searched in all the first audio data records by using the second audio data, which results in a large amount of calculation and a low execution efficiency. Therefore, it is preferable that corresponding additional information is carried in the communication service registration request and the communication service connection request, and the additional information is used for fast query of data, so as to obtain the first audio data record set used for performing the audio comparison operation, and reduce the number of times of the audio similarity comparison calculation.

According to the above analysis, in a preferred implementation manner of the present application, as shown in fig. 7, a schematic flow chart for processing additional information in a communication service registration and connection process provided in the embodiment of the present application includes the following main steps:

in the communication service registration terminal 10:

s701, establishing a communication service;

s7011, generating additional information for the communication service registration;

s702, sending a communication service registration request to a server, wherein the communication service registration request comprises additional information of communication service registration;

in the server 12:

s703, receiving a communication service registration request;

s704, registering communication service and generating a communication service record;

s705, storing the content contained in the additional information registered by the communication service as the data field associated with the communication service record;

in the communication service connection terminal 11:

s706, creating a communication service connection request;

s7061, generating additional information of the communication service connection;

s707, sending a communication service connection request to the server, wherein the communication service connection request comprises additional information of communication service connection;

in the server 12:

s708, receiving a communication service connection request;

s709, acquiring additional information of communication service connection;

s710, filtering communication service records according to the additional information of the communication service connection;

s711, searching similar first audio data records in the communication service record set obtained by filtering;

similarly, the steps not related to the additional information for communication service registration and the additional information for communication service connection are omitted in fig. 7.

In the above implementation, the additional information of the communication service registration is generated in S7011, including but not limited to one or more of related information of the communication service connection terminal 11, configuration information of the communication service, property of the first audio data, and encoding rule information used, and the additional information of the communication service registration is generated in S7061, including but not limited to one or more of communication service configuration information of the communication service creation terminal, a request for connection establishment, property of the second audio data, and encoding rule information used. For example, in combination with the above example of establishing a communication service between a broadcaster and an audience, the broadcaster broadcasts a voice program, and simultaneously expects the audience in a certain region to participate in an interaction, when registering the communication service, the broadcaster simultaneously provides additional information for registering the communication service, sets first additional information "voice broadcast" based on the property of the first audio, sets second additional information "a city" based on the region where the first additional information is located, and when registering at the server 12, stores the additional information as a data field recorded by the communication service; when the listener sends the communication service connection request, the additional information "voice broadcast" generated based on the property of the second audio and the additional information "city a" generated based on the region where the listener is located are carried at the same time, so that after the server 12 receives the communication service connection request, the communication service registration record is filtered and inquired at the server according to the additional information "voice broadcast" and "city a" provided by the listener, and finally, the first audio data record set for performing audio similarity calculation is obtained, and the calculation efficiency is improved.

Optionally, in step S705, the content included in the additional information registered for the communication service is stored as a data field associated with the first audio data record.

Through the implementation mode, the associated data field is established for the communication service registration record or the first audio data record at the server side through the additional information of the communication service registration request, and the communication service registration record or the first audio data record is filtered through the additional information in the communication service connection request. The beneficial effect that is finally obtained is that the first audio data record set used for performing audio similarity comparison calculation is rapidly obtained, which is time-saving and efficient, and in addition, a basis is provided for supporting large-scale communication service creation and connection through audio, for example, when the server 12 provides services for a certain specific type of communication service creation terminal (APP1) and a corresponding specified type of communication service connection terminal (APP2), according to the present implementation, the second audio data received from APP2 can be rapidly obtained from the first audio data record set provided by APP1 when performing audio similarity comparison calculation, and rapidly filters data records unrelated to APP 1.

In some specific implementation scenarios, the communication service creation terminal sends the first audio data to the server, and a communication service registration request is sent to register the communication service at the server, because the same or similar situation may occur in the audio data provided by a plurality of communication service creation terminals, as in the above example of the announcer and the viewer, if one of the viewers provides similar audio data to the server while listening to the program, a new communication service is required to be created, thereby causing a situation of communication service registration confusion.

According to the above phenomena, in a preferred implementation manner of the present application, as shown in fig. 8, a flow diagram for checking whether a registration requirement is met in a communication service registration process provided by the embodiment of the present application includes the following main steps:

in the server 12:

s809, receiving a communication service registration request;

s810, judging whether the received first audio data and/or the received communication service information to be registered meet the condition of registering the communication service according to a preset registration rule;

s2811, when judging that the condition of registering the communication service is not met, returning a communication service registration failure result;

s812, registering communication service and generating a communication service record;

the above omits a step unrelated to the judgment as to whether the registered communication service meets the condition.

In the above implementation, before the server 12 registers the communication service, S810 is executed to determine whether the received first audio data and/or the received communication service information to be registered meet the condition for registering the communication service according to a predetermined registration rule, where the predetermined registration rule includes, but is not limited to, the following situations: for the received first audio data used for registering the communication service, when the similarity of the received first audio data and the audio data in the first audio data record stored at the current service end and used for providing audio similarity comparison operation is judged, the communication service is not allowed to be registered; protected audio data is saved at the server side, and when the received first audio data for registering a communication service is similar to the protected audio data, the creation of the communication service is not allowed, and so on. Optionally, before the communication service is registered in the service end 12, the communication service creation terminal or the information sent by the communication service creation terminal is authenticated.

According to the above implementation, a registration rule check is added to the registration of the communication service at the server side to avoid the occurrence of situations like the above where the communication service is created based on similar, protected audio data or the like.

In an embodiment of the present application, according to the received second audio data, a first audio data record search including similar audio data is performed in the first audio data record set, that is, a similar first audio data record is searched, which is an important implementation link of the present application.

In a specific implementation scenario, for a first audio data and a second audio data for performing an audio similarity operation, according to time information contained in the second audio data, firstly, an audio data length range for performing a similarity search in the first audio data is determined, referring to a time range diagram for performing a similarity calculation between the second audio data and the first audio data, which is provided in the embodiment of the present application and is shown in fig. 9, where the second audio data is a segment of audio data from time t1 to time t2, and due to influences of a device for acquiring sound, network transmission, and the like, when performing a similarity search in the first audio data, the search range needs to be moderately expanded, such as expanding the d1 time length forward and expanding the d2 time length backward, thereby performing an audio similarity search calculation in the time range from t 1-d 1 to t2+ d2, and the used calculation method is similar to search another character string in a character string, the method specifically comprises the following steps: and performing similarity calculation on the two by using a likelihood function, acquiring a likelihood reference value to judge the similarity, and calculating a similarity reference value and the like according to the note difference value and the likelihood reference value. Optionally, the first audio data and/or the second audio data are processed by using a dynamic time warping algorithm, and audio similarity calculation is performed on the basis of obtaining standard audio data corresponding to the time scale.

In an optional implementation scenario of the present application, the similarity calculation between the second audio data and the first audio data is performed by using a plurality of audio similarity algorithms, such as: according to each feature vector corresponding to the same coding rule contained in the two audio data, similarity calculation can be carried out once, and the first audio data record with low similarity is excluded according to the calculation result, or the first audio data record with the highest similarity is obtained according to the total similarity value, the average similarity value, the weighted value and the like obtained by each operation.

According to the above two implementation manners, the first audio data record with the highest similarity to the second audio data or the first audio data record set with higher similarity may be obtained. Optionally, the above implementation manner may be combined with the implementation manner provided in the following embodiment, and the first audio data record where the first audio data similar to the second audio data is located is accurately located according to the change of time.

In a preferred implementation scenario, as shown in fig. 10, a schematic flow chart of calculating similarity between second audio data and first audio data provided in the embodiment of the present application provides an implementation method for verifying and confirming that second audio data and first audio data records have similarity step by step over time, and the specific steps are as follows:

in the communication service creation terminal 10:

s1001, collecting a first sound audio signal;

s1002, generating first audio data D1-0;

s1003, sending first audio data D1-0 to a server;

in the server 12:

s1007, receiving first audio data D1-0;

in the communication service connection terminal 11:

s1004, collecting a second sound audio signal;

s1005, generating second audio data D2-0;

s1006, sending second audio data D2-0 to the server;

in the server 12:

s1008, receiving second audio data D2-0;

s1009, calculating a similarity value L0 between D2-0 and D1-0, and when L0 is larger than a first threshold Y0;

according to the above steps, the reacquisition of the audio signal and the similarity calculation are performed when L0 is greater than the first threshold Y0 in S1009, that is, the following steps are continuously performed:

in the communication service creation terminal 10:

s1010, collecting a first sound audio signal;

s1011, generating first audio data D1-n;

s1012, sending first audio data D1-n to a server;

in the server 12:

s1013, receiving the first audio data D1-n;

in the communication service connection terminal 11:

s1014, collecting a second sound audio signal;

s1015, generating second audio data D2-n;

s1016, sending second audio data D2-n to the server;

in the server 12:

s1017, receiving second audio data D2-n;

s1018, calculating a similarity value Ln between D2-n and D1-n, and when Ln is larger than a second threshold value Y1 or the average value of L0-Ln is larger than a third threshold value Y2;

s1019, confirming the first audio data recording D1 as similar audio data of the second audio data D2;

the above steps S1010 to S1018 are a loop step, and S1019 is executed when the condition in S1018 is satisfied, otherwise, the audio signal is continuously acquired again and the similarity calculation is continuously executed, that is, steps S1010 to S1018, and when the specified number of loops or time length is reached, it is determined that D1 is not similar to D2.

After determining that D1 and D2 are similar audio data, in the server 12, the following are performed:

s1020, generating communication service connection response data;

in the communication service connection terminal 11:

s1021, receiving the communication service connection response data.

The implementation mode is combined with the daily voice distinguishing process of the people, and is similar to the process of fuzziness judgment of the voice of a person when the person talks for the first time, then the voice is locked, and the person continues to listen until the received information is enough, so that the voice sent out by the person is determined. In S1009, the similarity L0 of the two audio signals is obtained in the first comparison, and when L0 is greater than the first threshold Y0, it indicates that the sound has a certain similarity, it is necessary to continue receiving the audio data to confirm that the two audio data indeed have similarity. Alternatively, when L0 is greater than a predetermined value, it is directly confirmed that the two sounds have similarity. When the condition that L0 is greater than Y0 in S1009 is satisfied, the next round of data acquisition and comparison steps, i.e., S1010 to S1018, are entered, wherein the step S1018 and the step S1009 have the same nature, and are not described herein again.

According to the implementation mode, the method has the advantages that on the basis of confirming that the second audio data is similar to the first audio data, the similarity of the second audio data and the first audio data is verified along with the change of time, and the accuracy of the system implemented by the application is improved.

In a possible implementation scenario of the present application, after the communication service connection terminal 11 connects to the communication service, the validity of the communication service connection is verified according to the sound signal that can be collected during the communication service connection process, as shown in fig. 11, which is a schematic flow diagram for verifying the validity of the communication service according to the second audio data provided in the embodiment of the present application, the main steps are as follows:

after the communication service connection terminal 11 establishes a connection with a corresponding communication service:

s1103, acquiring an audio signal continuously or at predetermined time intervals based on a second sound, and generating second audio data, or further generating a communication service verification request based on the second audio data;

s1104, sending a second audio data or communication service verification request to the server;

in the server 12:

s1105, receiving a second audio data or communication service verification request;

s1106, obtaining a corresponding communication service record according to the communication service connected by the communication service connection terminal;

s1107, obtaining a corresponding first audio data record according to the communication service record;

s1108, audio similarity calculation is performed according to the received second audio data and the audio data contained in the corresponding first audio recording data record;

s1109, generating notification information for disconnecting the communication service connection terminal when the similarity value obtained by the similarity calculation is confirmed not to reach a preset threshold value;

s1110, transmitting notification information for disconnecting the communication service connection terminal;

in the communication service creation terminal 10:

s1111, receiving the notification information;

s1112, disconnecting the communication service connection terminal from the communication service.

According to the above implementation method, when the similarity between the second audio data collected in the communication service connection terminal 11 and the first audio data collected by the communication service creation terminal 10 is too low or not similar, the communication connection with the communication service connection terminal is disconnected.

In a possible implementation scenario of the present application, a certain terminal is not strictly limited to create a terminal for a communication service or connect a terminal for a communication service, and a sending request thereof includes communication service registration information and is simultaneously used for connecting other terminals that can provide the same or related communication service registration data, the connection is to connect the communication service, because the type of terminal can provide similar audio data and the same or similar communication service registration information, at the service end, according to the communication service registration request provided by the type of terminal, a communication connection is established between the creation terminal and the connection terminal for the same audio data. Through the implementation manner, the method is beneficial to quickly establishing communication connection among a plurality of terminals or executing certain network operation, for example, the method is applied to face-to-face group building under the WeChat, after a user clicks the face-to-face group building, each WeChat terminal simultaneously sends a communication service registration request and includes audio data to the server, and after the server receives and retrieves the same or similar requests, the user capable of providing similar audio data is added into the same WeChat group, and it should be noted that the operation finally executed by the server is as follows: a user is joined to a group as a network operation, which may be considered a communication service in this application. Optionally, the position information in the above terminal information is sent as additional information of the communication service registration information, thereby improving the calculation efficiency. The above method is equally applicable to quickly establishing a communication connection between two devices or applications in a unified sound environment that can receive similar audio signals.

In a possible implementation scenario of the present application, the communication service creation terminal 10 sends a communication service logout request to the server 12 to logout the communication service created by the communication service creation terminal 10, and the server 12 receives the logout request to obtain a communication service record to be logout, and deletes or marks the communication service record and the corresponding first audio data record. Optionally, after the logging of the communication service is completed in the server 12, a logging-off completion notification message is sent to the corresponding communication service creation terminal. Optionally, after the logging of the communication service is completed in the server 12, a logging completion notification message is sent to the corresponding communication service connection terminal, and the connection between the communication service connection terminal and the communication service is disconnected.

The embodiment of the application also provides a system for creating and connecting communication service through audio, the system comprises the communication service creating terminal, the server and the communication service connecting terminal, and the communication service creating, registering and connecting methods implemented above are realized.

Embodiments of the present application also provide a computer-readable storage medium, in which a computer program is stored, and when the computer program runs on a computer, the computer is enabled to execute the method for creating, registering and connecting a communication service through audio according to the embodiments.

In addition, the present application also provides a computer program product, which includes a computer program, when running on a computer, causing the computer to execute the method for creating, registering and connecting a communication service through audio described in the above embodiments.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the procedures or functions described in accordance with the present application are generated, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, digital subscriber line) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk), among others.

It is to be understood that some or all of the steps or operations in the above-described embodiments are merely examples, and other operations or variations of various operations may be performed by the embodiments of the present application. Further, the various steps may be performed in a different order presented in the above-described embodiments, and it is possible that not all of the operations in the above-described embodiments are performed.

The above description is only a specific implementation of the embodiments of the present application, but the scope of the embodiments of the present application is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the embodiments of the present application, and all the changes or substitutions should be covered by the scope of the embodiments of the present application. Therefore, the protection scope of the embodiments of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for creating a communication service through audio, performed at a communication service creation terminal, comprising:

creating a communication service, and generating communication service registration information based on the communication service, wherein the communication service is used for connecting and accessing a communication service connection terminal, or connecting and accessing the communication service creation terminal and the communication service connection terminal, and the communication service registration information is used for registering the communication service at a service end;

sending the first audio data and the communication service registration request to a server, wherein the communication service registration request at least comprises communication service registration information;

wherein the first sound creates a sound acquirable by a terminal for the communication service; the server is used for receiving the communication service registration request and the first audio data, registering a communication service record based on communication service registration information contained in the communication service registration request, generating a first audio data record based on the first audio data storage, and recording the corresponding relation between the registered communication service record and the stored first audio data record; the server is also used for receiving second audio data sent by the communication service connection terminal, searching for the first audio data similar to the second audio data, and returning corresponding communication service according to the corresponding relation so as to be connected and accessed by the communication service connection terminal; the communication service is used for establishing communication connection between a communication service establishing terminal and a communication service connecting terminal for obtaining the same or similar audio data; the encoding rule is used for calculating a characteristic value of the audio signal data or the audio signal data stream; multiple parties in the same sound environment receive the same or similar sound to establish communication; further, the first audio data similar to the second audio data is searched, and the first audio data is returned as a search result after the similarity value obtained by the audio similarity calculation is confirmed to meet a preset similarity judgment rule.

2. The method of claim 1, further comprising:

generating the communication service registration request by the communication service creation terminal together with the first audio data and the communication service registration information, and sending the communication service registration request to the server;

3. The method according to claim 1, further comprising, after the registration of the communication service created by the communication service creation terminal at the server is completed:

4. The method of claim 1, wherein after acquiring the audio signal of the first sound to generate the audio signal data or audio signal data stream, further comprising:

5. The method of claim 1, wherein before the audio data or the audio data stream is subjected to the audio coding process according to the predetermined coding rule, the method further comprises:

and at the communication service creation terminal, selecting or calculating to obtain a corresponding coding rule as a condition according to one or more of the communication service creation terminal information, the configuration information of the communication service, the property of the first audio data and the coding rule specified by a server.

6. The method of claim 1, wherein the communication service creation terminal generates a communication service registration request, further comprising:

after the additional information registered by the communication service is received by the server, the content contained in the additional information of the communication service is stored as the data field associated with the communication service record and is used for filtering and inquiring the communication service record.

7. A method for creating a communication service through audio, performed at a server side, comprising:

receiving a communication service creation request and first audio data sent by a communication service creation terminal;

registering communication service information contained in the communication service creation request, generating a communication service record, and storing the first audio data as a first audio data record; and establishing a correspondence between the first audio data record and the communication service record;

generating registration result return information according to the communication service record, and sending the registration result return information to the communication service creation terminal;

the first audio data is used for being compared with second audio data received from a communication service connection terminal, when the first audio data and the second audio data are similar, corresponding communication service is returned according to the corresponding relation for the communication service connection terminal to connect and access, and communication connection is established between a communication service creation terminal and the communication service connection terminal for communication service which can obtain the same or similar audio data; multiple parties in the same sound environment receive the same or similar sound to establish communication; and further comparing the similarity of the second audio data and the first audio data, and returning a comparison result for confirming that the similarity of the second audio data and the first audio data is similar after confirming that the similarity value obtained by the audio similarity calculation meets a preset similarity judgment rule.

8. The method according to claim 7, further comprising, after the server receives the first audio data transmitted by the communication service creation terminal:

judging whether the received first audio data and/or the received communication service information to be registered meet the condition for registering the communication service according to a preset registration rule, registering the communication service and generating communication service registration success information when the condition for registering the communication service is met, and generating communication service registration failure information when the condition for registering the communication service is not met;

the predetermined registration rule includes performing calculation according to one or more of first audio data included in the communication service registration request, the communication service creation terminal information, the communication service configuration information, a communication service record stored by the server, an audio data record stored by the server, and a registration rule stored in the server.

9. The method of claim 7, wherein the server receives the first audio data sent by the communication service creation terminal and stores the first audio data in the server, and further comprising:

when the communication service corresponding to the first audio data is determined to be registered, acquiring a corresponding registered communication service record, acquiring a corresponding first audio data record according to the communication service record, and merging and storing the received first audio data and the first audio data in the first audio data record correspondingly stored in the server, or replacing the first audio data in the first audio data record correspondingly stored in the server with the received first audio data.

10. The method of claim 7, wherein the server receives the communication service registration request sent by the communication service creation terminal, and further comprising:

and receiving the additional information of the communication service registration sent by the communication service creation terminal, analyzing the additional information of the communication service registration, and storing the content contained in the additional information of the communication service registration as a data field associated with the corresponding registered communication service data record, wherein the data field stored according to the content contained in the additional information of the communication service registration is used for filtering and querying the communication service data record.

11. A method for connecting communication services via audio, performed at a server, comprising:

returning the communication service connection information contained in the communication service record to the communication service connection terminal, or establishing communication connection between the communication service connection terminal and the communication service;

the corresponding relation among the first audio data record, the communication service record, the first audio data record and the communication service record is generated and stored after the server receives a communication service creation request and first audio data sent by a communication service creation terminal; multiple parties in the same sound environment receive the same or similar sound to establish communication; further, the first audio data record similar to the second audio data is searched, and the first audio data record is returned as a search result after the similarity value obtained by the audio similarity calculation is confirmed to accord with a preset similarity judgment rule.

12. The method of claim 11, wherein performing a first audio data record lookup with similarity in the first set of audio data records based on the second audio data, further comprises:

reading a first audio data record contained in the first audio data record set, extracting a corresponding audio data segment from first audio data contained in the first audio data record according to the audio data length range, determining that an audio data segment similar to the second audio data is found in the audio data segment, and returning the first audio data record as a search result.

13. The method of claim 11 or 12, wherein performing a first audio data record lookup with similarity in the first set of audio data records based on the second audio data, further comprises:

14. The method according to claim 11, wherein after the communication connection is established between the communication service connection terminal and the communication service, at the service end, the method further comprises:

15. A method of connecting a communication service through audio, performed at a communication service connection terminal, comprising:

sending a communication service connection request to a server;

establishing communication connection with the communication service, or receiving communication service request response information sent by the server, and establishing communication connection with the communication service when the response information comprises communication service information;

the server is used for receiving the communication service connection request, analyzing and acquiring the second audio data, searching first audio data similar to the second audio data according to the second audio data, acquiring a corresponding first audio data record and a corresponding communication service record, and connecting the communication service or generating communication service connection information based on information contained in the communication service record and returning the communication service connection information to the communication service connection terminal; the server is further used for receiving a communication service registration request and the first audio data, registering a communication service record based on communication service registration information contained in the communication service registration request, generating a first audio data record based on the first audio data storage, and recording a corresponding relation between the registered communication service record and the stored first audio data record; multiple parties in the same sound environment receive the same or similar sound to establish communication; further, the first audio data similar to the second audio data is searched, and the first audio data is returned as a search result after the similarity value obtained by the audio similarity calculation is confirmed to meet a preset similarity judgment rule.

16. The method of claim 15, wherein after acquiring the audio signal of the second sound to generate the audio data or audio data stream, further comprising:

17. The method according to claim 15, wherein before the audio data or the audio data stream is subjected to the audio encoding process according to the predetermined encoding rule, further comprising,

18. The method according to claim 15, further comprising, after the communication service connection terminal establishes the communication connection with the communication service:

and the second audio data is used for receiving by the server, the validity of the communication service connection is verified based on the second audio data, so that the effective communication service connection is kept under the condition that the second audio data and the corresponding first audio data are similar audio data, and otherwise, the communication service connection is disconnected.

19. The method of claim 15, wherein generating a communication service connection request based on the second audio data further comprises:

and after the additional information of the communication service connection is received by the server, the additional information is used for filtering and inquiring the communication service record stored by the server.

20. A communication service creation terminal for use by a communication service creator, comprising:

the audio acquisition processing unit is used for acquiring an audio signal of a first sound and generating first audio data, and comprises the steps of generating the first audio data according to the acquired audio signal data or audio signal data stream, or generating the first audio data after performing audio coding processing on the acquired audio signal data or audio signal data stream according to a preset coding rule;

a communication service creating unit, configured to create a communication service, and generate communication service registration information for the created communication service, where the communication service is used for a communication service connection terminal to connect to and access, or for the communication service creation terminal and the communication service connection terminal to connect to and access, the communication service registration information at least includes the communication service connection address information, and the communication service registration information is used to register the communication service at a service end;

the sending unit is used for sending the first audio data to a server; the system comprises a server side and a server side, wherein the server side is used for sending a communication service registration request to the server side, and the communication service registration request at least comprises communication service registration information; the system is also used for sending a communication service logout request to the server; the server is also used for sending communication service creation terminal information to the server;

a receiving unit, configured to receive a communication service registration result from the server, where the communication service registration result includes return information of success or failure of registration of the communication service; the server is also used for receiving communication service logout result information returned by the server; the communication service connection terminal is also used for receiving communication service connection terminal information corresponding to the created communication service;

wherein the first sound creates a sound acquirable by a terminal for the communication service; the server is used for receiving the communication service registration request and the first audio data sent by the communication service creation terminal, registering a communication service record based on communication service registration information contained in the communication service registration request, generating a first audio data record based on the first audio data storage, and recording a corresponding relation between the registered communication service record and the stored first audio data record; the encoding rule is used for calculating a characteristic value of the audio signal data or the audio signal data stream; the server is also used for receiving second audio data sent by the communication service connection terminal, searching for the first audio data similar to the second audio data, and returning corresponding communication service according to the corresponding relation so as to be connected and accessed by the communication service connection terminal; multiple parties in the same sound environment receive the same or similar sound to establish communication; further, the first audio data similar to the second audio data is searched, and the first audio data is returned as a search result after the similarity value obtained by the audio similarity calculation is confirmed to meet a preset similarity judgment rule.

21. The communication service creation terminal of claim 20, wherein after the communication service creation is completed, the audio collection processing unit is further configured to continue or continue to collect the audio signal based on the first sound and generate first audio data; the sending unit is further configured to send the first audio data generated each time to the server;

and after the first audio data is received by the server, storing the received first audio data corresponding to the communication service.

22. The communication service creation terminal of claim 20, wherein the audio capture processing unit is further configured to obtain a corresponding audio processing rule according to one or more selections or calculations among the communication service creation terminal information, the configuration information of the communication service, the property of the first audio data, and a server-specified audio processing rule, and perform audio processing on the audio signal data or the audio signal data stream according to the audio processing rule, wherein the audio processing includes one or more of audio filtering, audio extraction, audio conversion, audio clipping, audio merging, and audio detection; the audio signal processing device is further used for calculating and obtaining a corresponding encoding rule according to one or more of configuration information of the communication service, the property of the first audio data and an encoding rule specified by a server, and encoding the audio signal data or the audio signal data stream according to the encoding rule to generate first audio data; the communication service registration information generating unit is further used for generating additional information of the communication service registration according to one or more of the communication service creation terminal information, the configuration information of the communication service, the property information of the first audio data and the used coding rule information;

the sending unit is further configured to send the additional information of the communication service registration to the server, where the additional information of the communication service registration is received by the server, and the content contained in the additional information of the communication service registration is stored as a data field associated with the communication service record and is used for filtering and querying the communication service record.

23. A server for registering and managing audio data and communication services, comprising:

a communication service registration unit, configured to receive a communication service registration request sent by a communication service creation terminal, and register a communication service according to the received communication service registration request, where registering the communication service includes generating identification information for the communication service, and adding a communication service record in a communication service database; the communication service creation terminal is also used for receiving the communication service creation terminal information; the communication service registration server is also used for returning result information of the communication service registration success or the communication service registration failure;

the communication service logout unit is used for receiving a communication service logout request sent by the communication service creation terminal, searching and acquiring a communication service record according to the received communication service logout request and performing logout processing on the communication service record; also used for returning the result information of communication service logout;

the audio data management unit is used for receiving and storing first audio data used for establishing the communication service and sent by the communication service establishing terminal, generating a first audio data record and simultaneously recording the corresponding relation between the first audio data record and the registered communication service record; the communication server is further configured to receive first audio data sent by the communication server that has created the communication service, obtain a first audio data record corresponding to the registered communication service record corresponding to the first audio data record, merge and store the received first audio data and first audio data included in the first audio data record, or replace the first audio data in the first audio data record with the received first audio data;

the communication service management unit is used for receiving a communication service connection request sent by a communication service connection terminal, processing the communication service connection request, calculating and obtaining a target communication service according to second audio data contained in the communication service connection request, and returning the target communication service to the communication service connection terminal or establishing connection between the communication service connection terminal and the target communication service; the terminal is also used for receiving the communication service registration terminal information; the communication service establishing terminal is also used for returning communication service establishing terminal information corresponding to the target communication service to the communication service connecting terminal; the communication service connection terminal is also used for sending the communication service connection terminal information to a communication service creation terminal corresponding to the target communication service; the communication service connection terminal is also used for receiving a communication service verification request sent by the communication service connection terminal, searching a corresponding first audio data record according to second audio data contained in the communication service verification request and the connected communication service, detecting the similarity between the second audio data and the corresponding first audio data contained in the first audio data record, and disconnecting the connection between the communication service connection terminal and the communication service when the similarity is determined not to accord with a preset similarity judgment rule;

the server receives second audio data sent by a communication service connection terminal, searches for and obtains the first audio data similar to the second audio data, and returns corresponding target communication service according to the corresponding relation so as to be connected and accessed by the communication service connection terminal; multiple parties in the same sound environment receive the same or similar sound to establish communication; further, the first audio data similar to the second audio data is searched, and the first audio data is returned as a search result after the similarity value obtained by the audio similarity calculation is confirmed to meet a preset similarity judgment rule.

24. The server according to claim 23, wherein the communication service registration unit is further configured to, after receiving a communication service registration request sent by the communication service creation terminal, determine whether the received first audio data and/or the received communication service information to be registered meet a condition for registering a communication service according to a predetermined registration rule, register the communication service and generate communication service registration success information when it is determined that the condition for registering the communication service is met, and generate the communication service registration failure information when it is determined that the condition for registering the communication service is not met; the communication service creating terminal is also used for receiving and analyzing the additional information registered by the communication service sent by the communication service creating terminal, and storing the content contained in the additional information registered by the communication service as the associated data field of the corresponding registered communication service data record;

the predetermined registration rule comprises calculation according to one or more of first audio data contained in the communication service registration request, communication service creation terminal information, communication service configuration information, communication service records stored by the server, audio data records stored by the server and registration rules stored in the server; the additional information of the communication service registration includes a data field in which content is stored for filtering queries of the communication service data record.

25. The server according to claim 23, wherein the communication service management unit is further configured to, according to the second audio data, perform a first audio data record search with similarity in the first audio data record set, and search for a first audio data record similar to the first audio data record, where determining, according to time information included in the second audio data, a length range of audio data for performing the similarity search in the first audio data included in the first audio data record, reading the first audio data record included in the first audio data record set, extracting, according to the length range of audio data, a corresponding audio data segment from the first audio data included in the first audio data record, and after determining, in the audio data segment, that an audio data segment similar to the second audio data is found, and returning the first audio data record as a search result.

26. The server according to claim 23, wherein the communication service management unit performs a first audio data record search with similarity in the first audio data record set according to the second audio data, further comprising obtaining a similarity value between the second audio data and first audio data included in the first audio data record, performing audio similarity calculation according to subsequently received audio data corresponding to the second audio data and subsequently received audio data corresponding to the first audio data within a preset time range after determining that the similarity value reaches a predetermined first threshold, and returning the first audio data record as a search result after determining that the similarity value obtained by the audio similarity calculation reaches a preset similarity judgment rule.

27. A communication service connection terminal for use by a communication service visitor, comprising:

the audio acquisition processing unit is used for acquiring an audio signal of a second sound and generating second audio data, wherein the second sound is the audio signal acquirable by the audio acquisition unit, and the second audio data is acquired and generated based on the second sound and comprises the steps of generating the second audio data according to the acquired audio signal data or audio signal data stream or generating the second audio data after performing audio coding processing on the acquired audio signal data or audio signal data stream according to a preset coding rule;

the sending unit is used for sending a communication service connection request to a server, the sent information simultaneously comprises the second audio data, and the server calculates and returns corresponding communication service connection information according to the received data; also used for sending the communication service and connecting the terminal information; the communication service connection terminal is further used for continuously sending a communication service verification request to the server or according to a preset time interval after the communication service connection terminal establishes the communication connection with the communication service, wherein the verification request comprises the second audio data, the validity of the communication service connection is verified by the server based on the verification request, so that the second audio data and the corresponding first audio data are ensured to keep a valid communication service connection under the similar condition, and otherwise, the communication service connection is disconnected;

a receiving unit, configured to receive communication service connection request response information sent by the server, where the communication service connection request response information includes the communication service identification information normally returned by the server, or information returned by the server without finding a corresponding communication service; the communication service creation terminal is also used for receiving communication service creation terminal information corresponding to the requested communication service connection;

the communication service connecting unit is used for connecting the communication service according to the communication service information returned by the service end;

after receiving the communication service connection request, the server analyzes and acquires the second audio data, searches for first audio data similar to the second audio data according to the second audio data, acquires a corresponding first audio data record and a corresponding communication service record, and connects the communication service or generates communication service connection information based on the information contained in the communication service record and returns the communication service connection information to the communication service connection terminal; multiple parties in the same sound environment receive the same or similar sound to establish communication; further, the first audio data similar to the second audio data is searched, and the first audio data is returned as a search result after the similarity value obtained by the audio similarity calculation is confirmed to meet a preset similarity judgment rule.

28. The communication service connection terminal of claim 27, wherein the audio collection processing unit is further configured to obtain a corresponding audio processing rule according to one or more selections or calculations among the communication service connection terminal information, the configuration information of the communication service, the property of the second audio data, and a server-specified audio processing rule, and perform audio processing on the audio signal data or the audio signal data stream according to the audio processing rule, wherein the audio processing includes one or more of audio filtering, audio extraction, audio conversion, audio clipping, audio merging, and audio detection; the audio data processing device is also used for selecting or calculating to obtain a corresponding coding rule as a condition according to one or more of the communication service connection terminal information, the communication service configuration information requesting to establish connection, the property of the second audio data and the coding rule appointed by the server, and coding the audio data or the audio data stream according to the coding rule to generate second audio data; the communication service connection terminal is further used for generating additional information of the communication service registration based on one or more of the communication service connection terminal information, communication service configuration information for requesting connection establishment, property information of the second audio data and used coding rule information;

the sending unit is further configured to send additional information of the communication service connection to the server, where the additional information of the communication service connection is received by the server and is used to perform filtering query on a communication service record stored by the server.

29. The communication service connection terminal according to claim 27, wherein the audio collection processing unit is further configured to, after establishing the communication connection with the communication service, collect an audio signal based on the second sound continuously or at a predetermined time interval and generate the second audio data and generate the communication service verification request, and transmit the second audio data or the communication service verification request to the server;

and the second audio data or the communication service verification request is received by the server, the validity of communication service connection is verified based on the second audio data or the communication service verification request, so that the effective communication service connection is kept under the condition that the second audio data and the corresponding first audio data are similar audio data, and otherwise, the communication service connection is disconnected.