CN113645279A - Audio transmission processing method based on Internet of things - Google Patents
Audio transmission processing method based on Internet of things Download PDFInfo
- Publication number
- CN113645279A CN113645279A CN202110851037.5A CN202110851037A CN113645279A CN 113645279 A CN113645279 A CN 113645279A CN 202110851037 A CN202110851037 A CN 202110851037A CN 113645279 A CN113645279 A CN 113645279A
- Authority
- CN
- China
- Prior art keywords
- audio
- audio data
- target
- internet
- things
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephonic Communication Services (AREA)
Abstract
The application provides an audio transmission processing method based on the Internet of things, and relates to the technical field of the Internet of things. In the method, firstly, a plurality of pieces of audio data sent by a plurality of target internet of things devices are obtained, wherein the plurality of pieces of audio data are obtained by respectively carrying out audio acquisition on a target environment based on the plurality of target internet of things devices; secondly, clustering a plurality of pieces of audio data based on the audio duration information, the audio energy information and the sound source quantity information to obtain at least one audio data cluster; and then screening out at least one piece of audio data based on at least one audio data cluster, taking the audio data as representative audio data of the target environment, and sending the representative audio data to the internet of things background server in communication connection. Based on the method, the problem that resources are wasted easily in audio transmission in the existing Internet of things technology can be solved.
Description
Technical Field
The application relates to the technical field of the Internet of things, in particular to an audio transmission processing method based on the Internet of things.
Background
In the field of internet of things, transmission of a large amount of data is generally involved. For example, in an application scenario, in order to ensure reliability of data acquisition, multiple internet of things devices are arranged in a target environment to perform data acquisition, such as audio data acquisition, simultaneously, and then the data acquisition is sent to a background server for processing. However, through research by the inventor, it is found that, based on the prior art, a problem of resource waste is easily caused in the process of transmitting the collected audio data.
Disclosure of Invention
In view of this, an object of the present application is to provide an audio transmission processing method based on the internet of things, so as to solve the problem that resource waste is easily caused in audio transmission in the existing technology of the internet of things.
In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:
an audio transmission processing method based on the Internet of things is applied to audio transmission equipment, and comprises the following steps:
the method comprises the steps of obtaining a plurality of pieces of audio data sent by a plurality of target Internet of things devices in communication connection, wherein the plurality of pieces of audio data are obtained by respectively carrying out audio acquisition on a target environment based on the plurality of target Internet of things devices, and each piece of audio data comprises audio duration information, audio energy information and sound source quantity information;
clustering the plurality of pieces of audio data based on the audio duration information, the audio energy information and the sound source quantity information to obtain at least one audio data cluster, wherein each audio data cluster comprises at least one piece of audio data;
screening out at least one piece of audio data based on the at least one audio data cluster, taking the audio data as representative audio data of the target environment, and sending the representative audio data to a communication-connected Internet of things background server.
In a possible embodiment, in the method for processing audio transmission based on the internet of things, the step of filtering out at least one piece of audio data based on the at least one audio data cluster to serve as representative audio data of the target environment, and sending the representative audio data to a communicatively connected internet of things background server includes:
counting the number of audio data included in each audio data cluster to obtain a first audio number corresponding to the audio data cluster, wherein the number of the audio data clusters is multiple to obtain a plurality of corresponding first audio numbers;
calculating a quantity ratio among the first audio quantities, and determining a target quantity corresponding to each first audio quantity based on the quantity ratio and a predetermined target total quantity, wherein the target total quantity is generated based on quantity configuration operation performed by the audio transmission equipment in response to a corresponding management user;
for each first audio quantity, determining a target quantity of audio data corresponding to the first audio quantity from at least one piece of audio data included in the audio data cluster corresponding to the first audio quantity, wherein the target quantity of audio data is used as target audio data corresponding to the first audio quantity, and using each determined target audio data as representative audio data of the target environment;
and sending the representative audio data to a communication-connected Internet of things background server.
In a possible embodiment, in the method for processing audio transmission based on the internet of things, for each of the first audio amounts, the step of determining, as target audio data corresponding to the first audio amount, a target amount of audio data corresponding to the first audio amount in at least one piece of audio data included in an audio data cluster corresponding to the first audio amount, and using each determined target audio data as representative audio data of the target environment includes:
for each first audio frequency quantity, determining at least one piece of sound source quantity information corresponding to at least one piece of audio frequency data included in the audio frequency data cluster corresponding to the first audio frequency quantity;
for each audio data cluster, determining the number of audio data corresponding to each piece of sound source number information corresponding to the audio data cluster in the audio data cluster, and obtaining a second audio number corresponding to each piece of sound source number information;
for each audio data cluster, determining a corresponding target number of pieces of audio data in the audio data cluster based on a size relation between each second audio number corresponding to the audio data cluster, and taking the target number of pieces of audio data as target audio data corresponding to the audio data cluster;
and taking each piece of determined target audio data as representative audio data of a target environment.
In a possible embodiment, in the method for processing audio transmission based on the internet of things, for each audio data cluster, the step of determining, based on a size relationship between each second audio quantity corresponding to the audio data cluster, a corresponding target quantity of pieces of audio data in the audio data cluster, as the target audio data corresponding to the audio data cluster includes:
and sequentially traversing the second audio quantity corresponding to each audio data cluster according to the sequence from large to small for each audio data cluster, wherein for the traversed second audio quantity, each piece of audio data corresponding to the second audio quantity can be used as the target audio data corresponding to the audio data cluster until the quantity of the obtained target audio data reaches the target quantity.
In a possible embodiment, in the method for processing audio transmission based on the internet of things, the representative audio data is a plurality of pieces of representative audio data, and the step of sending the representative audio data to a communicatively connected internet of things background server includes:
determining the sound source quantity information of each piece of representative audio data;
and sequentially sending the plurality of pieces of representative audio data to a communication-connected Internet of things background server based on the magnitude relation of the sound source quantity information of each piece of representative audio data.
In a possible embodiment, in the audio transmission processing method based on the internet of things, the step of obtaining a plurality of pieces of audio data sent by a plurality of target internet of things devices in communication connection includes:
obtaining a plurality of candidate audio data sent by a plurality of internet of things devices in communication connection;
and screening the candidate audio data based on a preset audio screening rule to obtain multiple audio data sent by multiple target Internet of things devices, wherein the target Internet of things devices are Internet of things devices for sending the audio data screened out.
In a possible embodiment, in the audio transmission processing method based on the internet of things, the step of performing screening processing on the candidate audio data based on a preset audio screening rule to obtain multiple pieces of audio data sent by multiple target internet of things devices includes:
determining audio duration information corresponding to each candidate audio data;
and screening the plurality of candidate audio data based on a preset audio screening rule and the audio duration information corresponding to each candidate audio data to obtain a plurality of audio data sent by a plurality of target Internet of things devices.
In a possible embodiment, in the audio transmission processing method based on the internet of things, the step of performing screening processing on the plurality of candidate audio data based on a preset audio screening rule and the audio duration information corresponding to each candidate audio data to obtain a plurality of pieces of audio data sent by a plurality of target devices of the internet of things includes:
determining minimum audio time length information and maximum audio time length information in the audio time length information corresponding to the candidate audio data;
determining a target audio time interval based on the minimum audio time information and the maximum audio time information, wherein a lower limit value of the target audio time interval is determined based on the minimum audio time information, and an upper limit value of the target audio time interval is determined based on the maximum audio time information;
performing equal-interval segmentation processing on the target audio time duration intervals to obtain a plurality of continuous target audio time duration sub-intervals, and assigning values to each target audio time duration sub-interval according to the sequence of time duration from small to large to obtain time duration sub-interval assignment information corresponding to each target audio time duration sub-interval, wherein the assignment corresponding to the smaller time duration is smaller than the assignment corresponding to the larger time duration;
counting the number of the candidate audio data of which the audio duration information belongs to the target audio duration subinterval aiming at each target audio duration subinterval to obtain a third audio number corresponding to the target audio duration subinterval;
respectively forming corresponding time length subinterval assignment-audio number combinations based on the time length subinterval assignment information and the third audio number corresponding to each target audio time length subinterval to obtain a plurality of time length subinterval assignment-audio number combinations;
determining time length sub-interval assignment-audio number change trend information of the plurality of time length sub-interval assignment-audio number combinations;
determining each time length subinterval assignment-audio number combination which accords with the time length subinterval assignment-audio number change trend information in the time length subinterval assignment-audio number combinations as a target time length subinterval assignment-audio number combination;
and assigning the candidate audio data included in the audio number combination to each target duration subinterval as the screened audio data.
In a possible embodiment, in the audio transmission processing method based on the internet of things, the step of performing screening processing on the candidate audio data based on a preset audio screening rule to obtain multiple pieces of audio data sent by multiple target internet of things devices includes:
determining audio energy information corresponding to each piece of candidate audio data;
and screening the plurality of candidate audio data based on a preset audio screening rule and the audio energy information corresponding to each candidate audio data to obtain a plurality of audio data sent by a plurality of target Internet of things devices.
In a possible embodiment, in the audio transmission processing method based on the internet of things, the step of performing screening processing on the candidate audio data based on a preset audio screening rule to obtain multiple pieces of audio data sent by multiple target internet of things devices includes:
determining the sound source quantity information corresponding to each candidate audio data;
and screening the candidate audio data based on a preset audio screening rule and the sound source quantity information corresponding to each candidate audio data to obtain multiple audio data sent by multiple target Internet of things devices.
According to the audio transmission processing method based on the Internet of things, after a target Internet of things device collects a plurality of pieces of audio data, the collected audio data are clustered and screened through the audio transmission device, and then the screened representative audio data are sent to the Internet of things background server. Based on this, compare in the conventional technical scheme who directly sends the audio data who gathers for thing networking backend server, adopt the technical scheme that this application provided, owing to passed through certain screening, can reduce the quantity of the audio data that need send to a certain extent, reduce the resource that transmission audio data need consume to the audio transmission who exists among the existing internet of things appears the wasting of resources easily problem.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
Fig. 1 is a block diagram of an audio transmission device according to an embodiment of the present application.
Fig. 2 is a schematic flowchart illustrating steps included in an audio transmission processing method based on the internet of things according to an embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
As shown in fig. 1, an embodiment of the present application provides an audio transmission device. Wherein the audio transmission device may include a memory and a processor.
In detail, the memory and the processor are electrically connected directly or indirectly to realize data transmission or interaction. For example, they may be electrically connected to each other via one or more communication buses or signal lines. The memory can have stored therein at least one software function (computer program) which can be present in the form of software or firmware. The processor may be configured to execute the executable computer program stored in the memory, so as to implement the internet of things-based audio transmission processing method provided in the embodiments of the present application (described later).
Alternatively, the Memory may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Read-Only Memory (EPROM), an electrically Erasable Read-Only Memory (EEPROM), and the like. The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), a System on Chip (SoC), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components.
Also, the structure shown in fig. 1 is only an illustration, and the audio transmission device may further include more or fewer components than those shown in fig. 1, or have a different configuration from that shown in fig. 1, for example, may include a communication unit for information interaction with other devices (e.g., internet of things devices).
Wherein, in an alternative example, the audio transmission device may be a gateway device with data processing capability.
With reference to fig. 2, an embodiment of the present application further provides an audio transmission processing method based on the internet of things, which is applicable to the audio transmission device. The method steps defined by the flow related to the audio transmission processing method based on the internet of things can be realized by the audio transmission equipment.
The specific process shown in FIG. 2 will be described in detail below.
Step S110, obtaining a plurality of pieces of audio data sent by a plurality of target internet of things devices in communication connection.
In this embodiment, the audio transmission device may first obtain a plurality of pieces of audio data sent by a plurality of target internet of things devices in communication connection.
The target internet of things devices (such as audio acquisition devices) can be deployed in a target environment and can be spaced apart from each other by a certain distance. The plurality of pieces of audio data may be obtained by respectively performing audio acquisition on the target environment based on the plurality of target internet of things devices, and each piece of audio data includes audio duration information (duration length of the audio data), audio energy information (an energy value of the audio data, for example, an average value of energy values of a plurality of frames of audio frames included in the audio data, the energy value of each frame of audio frame may be calculated based on a related prior art, which is not specifically limited herein) and audio source number information (the number of people or objects making a sound, which is calculated based on a related prior art, and is not specifically limited herein).
And step S120, clustering the plurality of pieces of audio data based on the audio duration information, the audio energy information and the sound source quantity information to obtain at least one audio data cluster.
In this embodiment, after obtaining the pieces of audio data based on step S110, the audio transmission device may perform clustering processing on the pieces of audio data based on the audio duration information, the audio energy information, and the sound source number information (for example, a three-dimensional clustering space may be formed based on the audio duration information, the audio energy information, and the sound source number information, and then clustering may be performed based on a proximity algorithm or other algorithms), so that at least one audio data cluster may be obtained.
Wherein each of the audio data clusters may include at least one piece of the audio data.
Step S130, screening out at least one piece of audio data based on the at least one audio data cluster, taking the audio data as representative audio data of a target environment, and sending the representative audio data to a communication-connected Internet of things background server.
In this embodiment, after obtaining the at least one audio data cluster based on step S120, the audio transmission device may filter out at least one piece of audio data based on the at least one audio data cluster, where the at least one piece of audio data is used as the representative audio data of the target environment, and then send the representative audio data to the internet of things background server in communication connection.
Based on the method, after the target Internet of things equipment collects a plurality of pieces of audio data, the collected audio data are subjected to cluster screening through the audio transmission equipment, and then the screened representative audio data are sent to the Internet of things background server. Based on this, compare in the conventional technical scheme who directly sends the audio data who gathers for thing networking backend server, adopt the technical scheme that this application provided, owing to passed through certain screening, can reduce the quantity of the audio data that need send to a certain extent, reduce the resource that transmission audio data need consume to the audio transmission who exists among the existing internet of things appears the wasting of resources easily problem.
It will be appreciated that in an alternative example, the plurality of pieces of audio data may be obtained based on the following steps:
first, a plurality of candidate audio data sent by a plurality of internet of things devices in communication connection can be obtained. The target environment may deploy the multiple internet of things devices, and each internet of things device may be in communication connection with the audio transmission device to send acquired data, such as candidate audio data, to the audio transmission device;
secondly, can be based on preset audio frequency screening rule right many candidate audio data carry out screening process, obtain many audio data that a plurality of target thing networking devices sent, wherein, target thing networking devices are screened for sending the thing networking devices of audio data, that is to say, can regard as the candidate audio data that the rule was screened based on preset audio frequency screening as audio data, correspondingly, the thing networking devices that send audio data can be for target thing networking devices.
It is understood that, in a first alternative example, the pieces of audio data may be obtained based on the preset audio filtering rule based on the following steps:
firstly, determining audio duration information corresponding to each candidate audio data;
secondly, screening the plurality of candidate audio data based on a preset audio screening rule and the audio duration information corresponding to each candidate audio data to obtain a plurality of audio data sent by the target Internet of things equipment.
For example, in an alternative example, the pieces of audio data may be determined based on the audio duration information based on the following steps:
determining minimum audio time length information and maximum audio time length information in audio time length information corresponding to the candidate audio data;
secondly, determining a target audio time interval based on the minimum audio time information and the maximum audio time information, wherein a lower limit value of the target audio time interval is determined based on the minimum audio time information, if the minimum audio time information is used as a lower limit value, an upper limit value of the target audio time interval is determined based on the maximum audio time information, if the maximum audio time information is used as an upper limit value;
performing equal-interval segmentation processing on the target audio time duration interval to obtain a plurality of continuous target audio time duration sub-intervals, and assigning values to each target audio time duration sub-interval according to the sequence of time duration from small to large to obtain time duration sub-interval assignment information corresponding to each target audio time duration sub-interval, wherein the length of the equal-interval segmentation can be determined based on configuration operation performed by a user corresponding to the response of the audio transmission equipment according to actual application requirements, and in the assignment processing, the assignment corresponding to the smaller time duration is smaller than the assignment corresponding to the larger time duration, for example, the time duration and the corresponding assignment can have a positive correlation;
fourthly, counting the number of the candidate audio data of the audio duration information belonging to the target audio duration subinterval aiming at each target audio duration subinterval to obtain a third audio number corresponding to the target audio duration subinterval;
fifthly, respectively forming corresponding time length sub-interval assignment-audio number combinations based on the time length sub-interval assignment information and the third audio number corresponding to each target audio time length sub-interval to obtain a plurality of time length sub-interval assignment-audio number combinations;
sixthly, determining the time length subinterval assignment-audio number change trend information of the time length subinterval assignment-audio number combination, and obtaining the change trend information if curve fitting processing is carried out;
seventhly, determining each time length subinterval assignment-audio number combination which accords with the time length subinterval assignment-audio number change trend information in the time length subinterval assignment-audio number combinations as a target time length subinterval assignment-audio number combination;
and eighthly, taking the candidate audio data included in each target duration subinterval assignment-audio quantity combination as the screened audio data.
For another example, in another alternative example, the pieces of audio data may also be determined based on the audio duration information based on the following steps:
determining minimum audio time length information and maximum audio time length information in audio time length information corresponding to the candidate audio data;
secondly, determining a target audio time interval based on the minimum audio time information and the maximum audio time information, wherein the lower limit value of the target audio time interval is determined based on the minimum audio time information, and the upper limit value of the target audio time interval is determined based on the maximum audio time information;
thirdly, performing equal-interval segmentation processing on the target audio time duration intervals to obtain a plurality of continuous target audio time duration sub-intervals, and assigning values to each target audio time duration sub-interval according to the sequence of time duration from small to large to obtain time duration sub-interval assignment information corresponding to each target audio time duration sub-interval;
fourthly, counting the number of the candidate audio data of the audio duration information belonging to the target audio duration subinterval aiming at each target audio duration subinterval to obtain a third audio number corresponding to the target audio duration subinterval;
fifthly, respectively forming corresponding time length sub-interval assignment-audio number combinations based on the time length sub-interval assignment information and the third audio number corresponding to each target audio time length sub-interval to obtain a plurality of time length sub-interval assignment-audio number combinations;
sixthly, determining the time length subinterval assignment-audio number change trend information of the time length subinterval assignment-audio number combination;
seventhly, calculating a trend deviation degree between the time length subinterval assignment-audio number combination and the time length subinterval assignment-audio number change trend information for each time length subinterval assignment-audio number combination (for example, in a two-dimensional space of the time length subinterval assignment and the audio number, calculating a distance between fitting curves corresponding to the time length subinterval assignment-audio number combination and the time length subinterval assignment-audio number change trend information, wherein the distance can be used as a corresponding trend deviation degree), and judging whether the trend deviation degree is smaller than a preset trend deviation degree or not, wherein the preset trend deviation degree can be determined based on configuration operation of the audio transmission equipment responding to a corresponding user according to actual application requirements;
eighthly, determining a time length sub-interval assignment-audio number combination corresponding to each trend deviation degree smaller than the preset trend deviation degree as a target time length sub-interval assignment-audio number combination;
and ninthly, assigning the candidate audio data included in the audio number combination to each target duration subinterval as the screened audio data.
It is understood that, in a second alternative example, the pieces of audio data may be obtained based on the preset audio filtering rule based on the following steps:
firstly, audio energy information corresponding to each candidate audio data can be determined;
secondly, screening the plurality of candidate audio data based on a preset audio screening rule and the audio energy information corresponding to each candidate audio data to obtain a plurality of audio data sent by a plurality of target internet of things devices.
For example, in an alternative example, the pieces of audio data may be derived based on the audio energy information based on the following steps:
determining minimum audio energy information and maximum audio energy information in audio energy information corresponding to the candidate audio data;
a second step of determining a target audio energy interval based on the minimum audio energy information and the maximum audio energy information, wherein a lower limit value of the target audio energy interval is determined based on the minimum audio energy information, and an upper limit value of the target audio energy interval is determined based on the maximum audio energy information;
thirdly, performing equal-interval segmentation processing on the target audio energy interval to obtain a plurality of continuous target audio energy subintervals, and assigning values to each target audio energy subinterval according to the sequence of audio energy from small to large to obtain energy subinterval assignment information corresponding to each target audio energy subinterval, wherein the assignment corresponding to smaller audio energy is smaller than the assignment corresponding to larger audio energy;
fourthly, counting the number of the candidate audio data of the audio energy information belonging to the target audio energy subinterval aiming at each target audio energy subinterval to obtain a fourth audio number corresponding to the target audio energy subinterval;
fifthly, respectively forming corresponding energy subinterval assignment-audio number combinations based on the energy subinterval assignment information and the fourth audio number corresponding to each target audio energy subinterval to obtain a plurality of energy subinterval assignment-audio number combinations;
sixthly, determining energy subinterval assignment-audio quantity change trend information of the plurality of energy subinterval assignment-audio quantity combinations, as described above;
seventhly, determining each energy subinterval assignment-audio number combination which accords with the energy subinterval assignment-audio number change trend information in the plurality of energy subinterval assignment-audio number combinations as a target energy subinterval assignment-audio number combination;
and eighthly, taking the candidate audio data included in each target energy subinterval assignment-audio quantity combination as the screened audio data.
It is understood that, in a third alternative example, the pieces of audio data may be obtained based on the following steps based on the preset audio filtering rule:
firstly, the sound source quantity information corresponding to each candidate audio data can be determined;
secondly, screening the candidate audio data based on a preset audio screening rule and the sound source quantity information corresponding to each candidate audio data to obtain multiple audio data sent by multiple target internet of things devices.
For example, in an alternative example, the pieces of audio data may be obtained based on the sound source number information based on the following steps:
the method comprises the steps of firstly, determining minimum sound source quantity information and maximum sound source quantity information in sound source quantity information corresponding to a plurality of candidate audio data;
a second step of determining a target sound source number interval based on the minimum sound source number information and the maximum sound source number information, wherein a lower limit value of the target sound source number interval is determined based on the minimum sound source number information, and an upper limit value of the target sound source number interval is determined based on the maximum sound source number information;
thirdly, performing equal-interval segmentation processing on the target sound source number interval to obtain a plurality of continuous target sound source number subintervals, and assigning values to each target sound source number subinterval according to the sequence from small sound source number to large sound source number to obtain sound source number subinterval assignment information corresponding to each target sound source number subinterval, wherein the assignment corresponding to the smaller sound source number is smaller than the assignment corresponding to the larger sound source number;
fourthly, counting the number of the candidate audio data of the sound source number information belonging to the target sound source number subinterval aiming at each target sound source number subinterval to obtain a fifth audio number corresponding to the target sound source number subinterval;
fifthly, respectively forming corresponding sound source number subinterval assignment-audio number combinations based on the sound source number subinterval assignment information and the fifth audio number corresponding to each target sound source number subinterval to obtain a plurality of sound source number subinterval assignment-audio number combinations;
sixthly, determining sound source quantity subinterval assignment-audio quantity change trend information of the plurality of sound source quantity subinterval assignment-audio quantity combinations, as described above;
seventhly, determining each sound source quantity subinterval assignment-audio quantity combination which accords with the sound source quantity subinterval assignment-audio quantity change trend information in the plurality of sound source quantity subinterval assignment-audio quantity combinations as a target sound source quantity subinterval assignment-audio quantity combination;
and eighthly, assigning the candidate audio data included in the audio quantity combination to each target audio source quantity subinterval to serve as the screened audio data.
It will be appreciated that in an alternative example, the representative audio data of the target environment may be determined based on the at least one audio data cluster based on the following steps:
firstly, counting the number of audio data included in each audio data cluster to obtain a first audio number corresponding to the audio data cluster, wherein the number of the audio data clusters is multiple to obtain a plurality of corresponding first audio numbers;
secondly, calculating a quantity ratio among a plurality of first audio quantities, and determining a target quantity corresponding to each first audio quantity based on the quantity ratio and a predetermined target total quantity (for example, multiplying the quantity ratio by the target total quantity, so that the target quantity corresponding to each first audio quantity can be obtained), wherein the target total quantity is generated based on quantity configuration operation performed by a corresponding management user by the audio transmission device in response to an actual application scenario;
then, for each first audio quantity, determining a target quantity of audio data corresponding to the first audio quantity from at least one piece of audio data included in an audio data cluster corresponding to the first audio quantity, wherein the target quantity of audio data is used as target audio data corresponding to the first audio quantity, and using each determined target audio data as representative audio data of the target environment;
and finally, sending the representative audio data to a communication-connected Internet of things background server.
It will be appreciated that in an alternative example, the target number of pieces of audio data may be determined in the audio data cluster as representative audio data of the target environment based on the following steps:
firstly, aiming at each first audio frequency quantity, determining at least one piece of sound source quantity information corresponding to at least one piece of audio data included in an audio data cluster corresponding to the first audio frequency quantity, wherein one piece of audio data corresponds to one piece of sound source quantity information;
secondly, for each audio data cluster, determining the number of audio data corresponding to each piece of sound source number information corresponding to the audio data cluster in the audio data cluster, and obtaining a second audio number corresponding to each piece of sound source number information, for example, determining the number of audio data with the sound source number of 1 and the number of audio data with the sound source number of 2 in one audio data cluster;
then, for each audio data cluster, determining a corresponding target number of pieces of audio data in the audio data cluster based on a size relation between each second audio number corresponding to the audio data cluster, and taking the target number of pieces of audio data as target audio data corresponding to the audio data cluster;
and finally, taking each piece of determined target audio data as representative audio data of a target environment.
It is understood that, in an alternative example, a target number of pieces of target audio data may be determined based on the magnitude relationship between the second audio numbers based on the following steps:
and sequentially traversing the second audio quantity corresponding to each audio data cluster according to the sequence from large to small for each audio data cluster, wherein for the traversed second audio quantity, each piece of audio data corresponding to the second audio quantity can be used as the target audio data corresponding to the audio data cluster until the quantity of the obtained target audio data reaches the target quantity.
It will be appreciated that in an alternative example, where the representative audio data is a plurality of pieces, the plurality of pieces of representative audio data may be sent to a communicatively connected networked backend server based on the following steps:
firstly, determining sound source quantity information of each piece of representative audio data;
secondly, based on the magnitude relation of the sound source quantity information of each piece of representative audio data, the representative audio data are sequentially sent to a communication-connected internet-of-things background server, for example, representative audio data with larger sound source quantity information can be preferentially sent.
In summary, according to the audio transmission processing method based on the internet of things, after the target internet of things device collects multiple pieces of audio data, the collected multiple pieces of audio data are clustered and screened through the audio transmission device, and then the screened representative audio data are sent to the internet of things background server. Based on this, compare in the conventional technical scheme who directly sends the audio data who gathers for thing networking backend server, adopt the technical scheme that this application provided, owing to passed through certain screening, can reduce the quantity of the audio data that need send to a certain extent, reduce the resource that transmission audio data need consume to the audio transmission who exists among the existing internet of things appears the wasting of resources easily problem.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus and method embodiments described above are illustrative only, as the flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, an electronic device, or a network device) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes. It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. The audio transmission processing method based on the Internet of things is applied to audio transmission equipment and comprises the following steps:
the method comprises the steps of obtaining a plurality of pieces of audio data sent by a plurality of target Internet of things devices in communication connection, wherein the plurality of pieces of audio data are obtained by respectively carrying out audio acquisition on a target environment based on the plurality of target Internet of things devices, and each piece of audio data comprises audio duration information, audio energy information and sound source quantity information;
clustering the plurality of pieces of audio data based on the audio duration information, the audio energy information and the sound source quantity information to obtain at least one audio data cluster, wherein each audio data cluster comprises at least one piece of audio data;
screening out at least one piece of audio data based on the at least one audio data cluster, taking the audio data as representative audio data of the target environment, and sending the representative audio data to a communication-connected Internet of things background server.
2. The internet of things-based audio transmission processing method according to claim 1, wherein the step of screening out at least one piece of audio data based on the at least one audio data cluster as representative audio data of the target environment and sending the representative audio data to a communicatively connected internet of things background server includes:
counting the number of audio data included in each audio data cluster to obtain a first audio number corresponding to the audio data cluster, wherein the number of the audio data clusters is multiple to obtain a plurality of corresponding first audio numbers;
calculating a quantity ratio among the first audio quantities, and determining a target quantity corresponding to each first audio quantity based on the quantity ratio and a predetermined target total quantity, wherein the target total quantity is generated based on quantity configuration operation performed by the audio transmission equipment in response to a corresponding management user;
for each first audio quantity, determining a target quantity of audio data corresponding to the first audio quantity from at least one piece of audio data included in the audio data cluster corresponding to the first audio quantity, wherein the target quantity of audio data is used as target audio data corresponding to the first audio quantity, and using each determined target audio data as representative audio data of the target environment;
and sending the representative audio data to a communication-connected Internet of things background server.
3. The internet of things-based audio transmission processing method according to claim 2, wherein the step of determining, for each of the first audio amounts, a target amount of audio data corresponding to the first audio amount from at least one piece of audio data included in an audio data cluster corresponding to the first audio amount as target audio data corresponding to the first audio amount, and taking each determined piece of target audio data as representative audio data of the target environment includes:
for each first audio frequency quantity, determining at least one piece of sound source quantity information corresponding to at least one piece of audio frequency data included in the audio frequency data cluster corresponding to the first audio frequency quantity;
for each audio data cluster, determining the number of audio data corresponding to each piece of sound source number information corresponding to the audio data cluster in the audio data cluster, and obtaining a second audio number corresponding to each piece of sound source number information;
for each audio data cluster, determining a corresponding target number of pieces of audio data in the audio data cluster based on a size relation between each second audio number corresponding to the audio data cluster, and taking the target number of pieces of audio data as target audio data corresponding to the audio data cluster;
and taking each piece of determined target audio data as representative audio data of a target environment.
4. The internet of things-based audio transmission processing method according to claim 3, wherein the step of determining, for each audio data cluster, a corresponding target number of pieces of audio data in the audio data cluster based on a size relationship between each second audio number corresponding to the audio data cluster, as the target audio data corresponding to the audio data cluster, includes:
and sequentially traversing the second audio quantity corresponding to each audio data cluster according to the sequence from large to small for each audio data cluster, wherein for the traversed second audio quantity, each piece of audio data corresponding to the second audio quantity can be used as the target audio data corresponding to the audio data cluster until the quantity of the obtained target audio data reaches the target quantity.
5. The internet of things-based audio transmission processing method according to claim 2, wherein the representative audio data is a plurality of pieces, and the step of sending the representative audio data to a communicatively connected internet of things background server includes:
determining the sound source quantity information of each piece of representative audio data;
and sequentially sending the plurality of pieces of representative audio data to a communication-connected Internet of things background server based on the magnitude relation of the sound source quantity information of each piece of representative audio data.
6. The internet-of-things-based audio transmission processing method according to any one of claims 1 to 5, wherein the step of obtaining the pieces of audio data sent by the plurality of communicatively connected target internet-of-things devices includes:
obtaining a plurality of candidate audio data sent by a plurality of internet of things devices in communication connection;
and screening the candidate audio data based on a preset audio screening rule to obtain multiple audio data sent by multiple target Internet of things devices, wherein the target Internet of things devices are Internet of things devices for sending the audio data screened out.
7. The internet of things-based audio transmission processing method according to claim 6, wherein the step of performing screening processing on the candidate audio data based on a preset audio screening rule to obtain audio data sent by target internet of things devices comprises:
determining audio duration information corresponding to each candidate audio data;
and screening the plurality of candidate audio data based on a preset audio screening rule and the audio duration information corresponding to each candidate audio data to obtain a plurality of audio data sent by a plurality of target Internet of things devices.
8. The internet of things-based audio transmission processing method according to claim 7, wherein the step of performing screening processing on the candidate audio data based on a preset audio screening rule to obtain audio data sent by target internet of things devices comprises:
determining minimum audio time length information and maximum audio time length information in the audio time length information corresponding to the candidate audio data;
determining a target audio time interval based on the minimum audio time information and the maximum audio time information, wherein a lower limit value of the target audio time interval is determined based on the minimum audio time information, and an upper limit value of the target audio time interval is determined based on the maximum audio time information;
performing equal-interval segmentation processing on the target audio time duration intervals to obtain a plurality of continuous target audio time duration sub-intervals, and assigning values to each target audio time duration sub-interval according to the sequence of time duration from small to large to obtain time duration sub-interval assignment information corresponding to each target audio time duration sub-interval, wherein the assignment corresponding to the smaller time duration is smaller than the assignment corresponding to the larger time duration;
counting the number of the candidate audio data of which the audio duration information belongs to the target audio duration subinterval aiming at each target audio duration subinterval to obtain a third audio number corresponding to the target audio duration subinterval;
respectively forming corresponding time length subinterval assignment-audio number combinations based on the time length subinterval assignment information and the third audio number corresponding to each target audio time length subinterval to obtain a plurality of time length subinterval assignment-audio number combinations;
determining time length sub-interval assignment-audio number change trend information of the plurality of time length sub-interval assignment-audio number combinations;
calculating the trend deviation between the time length sub-interval assignment-audio number combination and the time length sub-interval assignment-audio number change trend information aiming at each time length sub-interval assignment-audio number combination, and judging whether the trend deviation is smaller than the preset trend deviation or not;
assigning a value-audio number combination to each time sub-interval corresponding to the trend deviation degree smaller than the preset trend deviation degree, and determining the value-audio number combination as a target time sub-interval value-audio number combination;
and assigning the candidate audio data included in the audio number combination to each target duration subinterval as the screened audio data.
9. The internet of things-based audio transmission processing method according to claim 6, wherein the step of performing screening processing on the candidate audio data based on a preset audio screening rule to obtain audio data sent by target internet of things devices comprises:
determining audio energy information corresponding to each piece of candidate audio data;
and screening the plurality of candidate audio data based on a preset audio screening rule and the audio energy information corresponding to each candidate audio data to obtain a plurality of audio data sent by a plurality of target Internet of things devices.
10. The internet of things-based audio transmission processing method according to claim 6, wherein the step of performing screening processing on the candidate audio data based on a preset audio screening rule to obtain audio data sent by target internet of things devices comprises:
determining the sound source quantity information corresponding to each candidate audio data;
and screening the candidate audio data based on a preset audio screening rule and the sound source quantity information corresponding to each candidate audio data to obtain multiple audio data sent by multiple target Internet of things devices.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110851037.5A CN113645279A (en) | 2021-07-27 | 2021-07-27 | Audio transmission processing method based on Internet of things |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110851037.5A CN113645279A (en) | 2021-07-27 | 2021-07-27 | Audio transmission processing method based on Internet of things |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113645279A true CN113645279A (en) | 2021-11-12 |
Family
ID=78418556
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110851037.5A Withdrawn CN113645279A (en) | 2021-07-27 | 2021-07-27 | Audio transmission processing method based on Internet of things |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113645279A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116150186A (en) * | 2022-12-02 | 2023-05-23 | 深圳市艾奥科技有限公司 | Communication Internet of things management method and system based on big data |
-
2021
- 2021-07-27 CN CN202110851037.5A patent/CN113645279A/en not_active Withdrawn
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116150186A (en) * | 2022-12-02 | 2023-05-23 | 深圳市艾奥科技有限公司 | Communication Internet of things management method and system based on big data |
| CN116150186B (en) * | 2022-12-02 | 2023-08-08 | 深圳市艾奥科技有限公司 | Communication Internet of things management method and system based on big data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8341742B2 (en) | Network attack detection devices and methods | |
| CN112351119B (en) | Probability-based block chain transaction originating IP address determination method and device | |
| EP2897088A1 (en) | Method and apparatus for optimum spatial clustering | |
| CN106202126B (en) | A kind of data analysing method and device for logistics monitoring | |
| CN113553942A (en) | Image processing method | |
| CN113726783A (en) | Abnormal IP address identification method and device, electronic equipment and readable storage medium | |
| CN113645279A (en) | Audio transmission processing method based on Internet of things | |
| CN113609389A (en) | Community platform information pushing method and system | |
| CN113435359A (en) | Image recognition method | |
| CN113645305A (en) | Method and system for determining transmission node of data of Internet of things | |
| CN113259213B (en) | Intelligent home information monitoring method based on edge computing intelligent gateway | |
| CN113099401B (en) | Internet of things data transmission method and equipment | |
| CN113407750A (en) | Image distributed storage method and system | |
| CN113590869A (en) | Data storage management method and system | |
| CN113132162A (en) | Method, device, equipment and medium for configuring Internet of things card | |
| CN113256366A (en) | Order data processing method and system based on big data and cloud computing | |
| CN113571093A (en) | Audio data processing method | |
| CN113486342A (en) | Information security processing method and system based on user behavior analysis | |
| CN113628073A (en) | Property management method and system for intelligent cell | |
| CN112686760B (en) | Financial business processing method and platform based on big data | |
| CN113141661B (en) | Wireless gateway allocation method | |
| CN115174695B (en) | Scheduling system and method for distributed network resources | |
| CN113489735A (en) | Network information safety diagnosis method | |
| CN113037568A (en) | Information distribution method of Internet of things equipment | |
| CN113556514A (en) | Image transmission method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20211112 |