CN107230474B - Method and system for synthesizing audio data - Google Patents
Method and system for synthesizing audio data Download PDFInfo
- Publication number
- CN107230474B CN107230474B CN201710255866.0A CN201710255866A CN107230474B CN 107230474 B CN107230474 B CN 107230474B CN 201710255866 A CN201710255866 A CN 201710255866A CN 107230474 B CN107230474 B CN 107230474B
- Authority
- CN
- China
- Prior art keywords
- clock
- preliminary
- client
- time
- audio data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000002194 synthesizing effect Effects 0.000 title claims abstract description 43
- 238000000034 method Methods 0.000 title claims abstract description 29
- 230000005540 biological transmission Effects 0.000 claims abstract description 138
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 48
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 48
- 238000004364 calculation method Methods 0.000 claims description 7
- 238000004891 communication Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/08—Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/003—Changing voice quality, e.g. pitch or formants
- G10L21/007—Changing voice quality, e.g. pitch or formants characterised by the process used
- G10L21/01—Correction of time axis
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Electric Clocks (AREA)
- Synchronisation In Digital Transmission Systems (AREA)
- Telephonic Communication Services (AREA)
Abstract
The present invention relates to the field of data processing, and in particular, to a method and system for synthesizing audio data. The method comprises the steps that audio data are collected through a client, and a client clock corresponding to the collection time is recorded; calibrating the client clock according to the preliminary calibration value corresponding to the client to obtain a preliminary clock; sending the audio data and the preliminary clock to a synthesis end; acquiring the time length from the time when the client sends a calibration request to the time when the client receives a standard clock at a preset time interval to form a transmission time length set; the synthesis end calibrates the preliminary clock according to the minimum transmission duration in the transmission duration set to obtain an accurate clock; and the synthesis end synthesizes more than two audio data collected by the client according to the accurate clock. The phenomenon that echo or beat is not right exists in audio data synthesized by multi-channel audio data is effectively reduced.
Description
Technical Field
The present invention relates to the field of data processing, and in particular, to a method and system for synthesizing audio data.
Background
In the process of synthesizing multiple paths of audio data into one path of audio data, the local clock of the client where each audio data is located needs to be calibrated by taking the clock of the server as a standard. However, the existing clock calibration method often ignores the time error generated in the process of calibrating the clock between the client and the server, and the reason for generating the time error is that the client intends to calibrate the value of the local clock at the first time, and sends a clock calibration request to the server, and after receiving the clock calibration request from the client, the server acquires the value of the current server clock as the standard value of the client after the local clock is calibrated at the first time. Although the difference between the standard value calibrated by the local clock of the client and the actual standard value may be very small, in a distributed environment, the difference may reach several seconds, which causes the beat of the synthesized audio data to be disordered or to have obvious echo.
In a distributed environment, due to the difference between the clocks of the server and each client, the real time consumed in the process that the client sends the calibration clock request to the server and the server obtains the current clock cannot be accurately known, and the real time consumed in the process that the server sends the standard value to the client cannot be known, so that each client cannot work on the same physical clock in the distributed environment; in addition, the clock stored in each device may be different at the moment the client performs clock calibration due to the busy level of the device, scheduling time difference, and physical configuration of the device itself. Therefore, the existing method for calibrating the clock under the distributed environment has low accuracy, and the beat of the synthesized audio data is easy to be disordered or has obvious echo.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: how to effectively reduce the phenomenon of echo or beat mismatch of audio data synthesized by multiple paths of audio data.
In order to solve the technical problems, the invention adopts the technical scheme that:
the invention provides a method for synthesizing audio data, which comprises the following steps:
s1, the client collects the audio data and records the client clock corresponding to the collection time;
s2, calibrating the client clock according to the preliminary calibration value corresponding to the client to obtain a preliminary clock;
s3, sending the audio data and the preliminary clock to a synthesis end;
s4, acquiring the time length from the time when the client sends the calibration request to the time when the standard clock is received at a preset time interval, and forming a transmission time length set; the synthesis end calibrates the preliminary clock according to the minimum transmission duration in the transmission duration set to obtain an accurate clock;
and S5, the synthesis end synthesizes more than two audio data collected by the client according to the accurate clock.
The present invention also provides a system for synthesizing audio data, comprising:
the acquisition module is used for acquiring audio data by the client and recording a client clock corresponding to the acquisition time;
the first calibration module is used for calibrating the client clock according to the preliminary calibration value corresponding to the client to obtain a preliminary clock;
the sending module is used for sending the audio data and the preliminary clock to a synthesis end;
the second calibration module is used for acquiring the time length from the time when the client sends the calibration request to the time when the standard clock is received at a preset time interval to form a transmission time length set; the synthesis end calibrates the preliminary clock according to the minimum transmission duration in the transmission duration set to obtain an accurate clock;
and the synthesis module is used for synthesizing more than two pieces of audio data acquired by the client by the synthesis end according to the accurate clock.
The invention has the beneficial effects that: according to the method, the client side intermittently communicates with the server to acquire the standard clock of the server in the time period from the beginning of acquiring the audio data to the end of acquiring the audio data, and calibrates the initial calibration value obtained according to the communication time between the client side and the server and the standard clock acquired by the client side according to the minimum communication time acquired in the time period, namely twice the real time consumed in the process that the client side sends a calibration clock request to the server to acquire the current clock, so that the local clock of the client side after calibration approaches the actual standard clock, and the phenomenon that the synthesized audio data has echo or no beat after the audio data acquired by each client side is synthesized into the audio data is effectively reduced in a distributed environment.
Drawings
FIG. 1 is a block flow diagram of an embodiment of a method for synthesizing audio data according to the present invention;
FIG. 2 is a block diagram of an embodiment of a system for synthesizing audio data according to the present invention;
FIG. 3 is a block diagram of an embodiment of a system for synthesizing audio data according to the present invention;
description of reference numerals:
1. an acquisition module; 2. a first calibration module; 3. a sending module; 4. a second calibration module;
41. a first acquisition unit; 42. a first calibration unit; 421. a first calculation unit; 422. a second calculation unit; 423. a second calibration unit; 424. an update unit; 43. a repeating unit; 44. a marking unit; 5. a synthesis module; 51. a synthesis unit; 6. a first acquisition module; 7. a second acquisition module;
8. a first calculation module; 9. a second calculation module; 101. a client; 102. a server;
103. and (4) synthesizing the terminal.
Detailed Description
In order to explain technical contents, achieved objects, and effects of the present invention in detail, the following description is made with reference to the accompanying drawings in combination with the embodiments.
Referring to fig. 1 to 3 of the drawings,
as shown in fig. 1, the present invention provides a method of synthesizing audio data, comprising:
s1, the client collects the audio data and records the client clock corresponding to the collection time;
s2, calibrating the client clock according to the preliminary calibration value corresponding to the client to obtain a preliminary clock;
s3, sending the audio data and the preliminary clock to a synthesis end;
s4, acquiring the time length from the time when the client sends the calibration request to the time when the standard clock is received at a preset time interval, and forming a transmission time length set; the synthesis end calibrates the preliminary clock according to the minimum transmission duration in the transmission duration set to obtain an accurate clock;
and S5, the synthesis end synthesizes more than two audio data collected by the client according to the accurate clock.
Further, the S2 is preceded by:
acquiring a client clock corresponding to a preset moment;
acquiring the time from the time when the client sends a calibration request to the time when the standard clock corresponding to the preset time is received, and acquiring the preliminary transmission time;
calculating the sum of the standard clock corresponding to the preset time and half of the preliminary transmission time to obtain a preliminary calibration clock of the preset time;
and calculating the difference between the preliminary calibration clock at the preset moment and the client clock corresponding to the preset moment to obtain the preliminary calibration value.
Further, the S4 specifically includes:
s41, acquiring the time length from the time when the client sends the calibration request to the time when the client receives the standard clock, and acquiring the current transmission time length;
s42, if the current transmission time length is less than the preliminary transmission time length, then: the synthesis end calibrates the preliminary clock according to the current transmission duration; updating the preliminary transmission duration using the current transmission duration;
s43, repeating the steps S41 to S42 at preset time intervals until the client finishes collecting the audio data;
and S44, marking the current preliminary clock as the accurate clock.
As can be seen from the above description, during the period from the time when the client acquires the audio data to the time when the client finishes acquiring the audio data, once it is found that the newly acquired transmission duration is smaller than the minimum value of the previously acquired transmission duration, the preliminary clock in the synthesis end is calibrated immediately according to the newly acquired transmission duration, so that when the client finishes acquiring the audio data, the preliminary clocks in the synthesis end are all calibrated to be accurate clocks, and the efficiency of synthesizing the audio data is improved.
Further, the calibrating the preliminary clock by the synthesizing end according to the current transmission duration specifically includes:
calculating half of the current transmission time length to obtain an accurate transmission time length;
obtaining a transmission time error value according to the preliminary transmission time and the accurate transmission time;
calibrating the preliminary clock according to the transmission duration error value;
updating the preliminary transmission duration using the current transmission duration.
Further, synthesizing more than two audio data collected by the client, specifically:
and synthesizing the audio data collected by more than two clients according to a preset normalized mixing algorithm.
As can be seen from the above description, the synthesized audio data changes smoothly, and pop sound is avoided.
As shown in fig. 2, the present invention also provides a system for synthesizing audio data, comprising:
the acquisition module 1 is used for acquiring audio data by a client and recording a client clock corresponding to the acquisition time;
the first calibration module 2 is configured to calibrate the client clock according to a preliminary calibration value corresponding to the client, so as to obtain a preliminary clock;
a sending module 3, configured to send the audio data and the preliminary clock to a synthesizing end;
the second calibration module 4 is configured to acquire, at a preset time interval, a time length from when the client sends a calibration request to when the client receives a standard clock, and form a transmission time length set; the synthesis end calibrates the preliminary clock according to the minimum transmission duration in the transmission duration set to obtain an accurate clock;
and the synthesis module 5 is used for synthesizing more than two pieces of audio data acquired by the client by the synthesis end according to the accurate clock.
Further, still include:
the first acquisition module 6 is used for acquiring a client clock corresponding to a preset time;
the second obtaining module 7 is configured to obtain a time length from when the client sends the calibration request to when the client receives the standard clock corresponding to the preset time, so as to obtain a preliminary transmission time length;
the first calculating module 8 is configured to calculate a sum of the standard clock corresponding to the preset time and a half of the preliminary transmission duration to obtain a preliminary calibration clock at the preset time;
and the second calculating module 9 is configured to calculate a difference between the preliminary calibration clock at the preset time and the client clock corresponding to the preset time, so as to obtain the preliminary calibration value.
Further, the second calibration module 4 includes:
a first obtaining unit 41, configured to obtain a time length from when the client sends a calibration request to when the client receives a standard clock, so as to obtain a current transmission time length;
a first calibration unit 42, configured to, if the current transmission duration is smaller than the preliminary transmission duration: the synthesis end calibrates the preliminary clock according to the current transmission duration; updating the preliminary transmission duration using the current transmission duration;
a repeating unit 43, configured to repeatedly execute the first obtaining unit and the first calibrating unit at preset time intervals until the client finishes acquiring audio data;
a marking unit 44, configured to mark the current preliminary clock as the accurate clock.
Further, the first calibration unit 42 includes:
a first calculating unit 421, configured to calculate a half of the current transmission duration to obtain an accurate transmission duration;
a second calculating unit 422, configured to obtain a transmission duration error value according to the preliminary transmission duration and the accurate transmission duration;
a second calibration unit 423 for calibrating the preliminary clock according to the transmission duration error value;
an updating unit 424, configured to update the preliminary transmission duration with the current transmission duration.
Further, the synthesis module 5 comprises:
and a synthesizing unit 51, configured to synthesize the audio data collected by the two or more clients according to a preset normalized mixing algorithm.
The first embodiment of the invention is as follows:
the present embodiment provides a method of synthesizing audio data, including:
s1, the client collects the audio data and records the client clock corresponding to the collection time;
wherein, each Client (Client1, Client2 … …) under the distributed environment collects the audio data and respectively records the Client local clock corresponding to the collection time;
s2, acquiring a preliminary calibration value of each client under the distributed environment; the method specifically comprises the following steps:
s21, acquiring a client clock corresponding to the preset time;
acquiring and recording a local clock C1 of a current Client 1;
s22, acquiring the time length from the time when the client sends the calibration request to the time when the client receives the standard clock corresponding to the preset time, and acquiring the preliminary transmission time length;
the Client1 sends a calibration request to the server and acquires the local clock StartTime of the current Client1, the server acquires the current standard clock S1 of the server and sends the standard clock S1 to the Client1 after receiving the calibration request, the Client1 acquires the local clock EndTime of the current Client1 while receiving the standard clock S1, and the preliminary transmission time length is the difference between EndTime and StartTime;
obviously, an error exists between the actual standard clock corresponding to the local clock C1 of the Client1 and the standard clock S1, where the error is a duration consumed by the Client1 sending a calibration request to the server to obtain the standard clock S1 of the server;
s23, calculating the sum of the standard clock corresponding to the preset time and half of the preliminary transmission time length to obtain a preliminary calibration clock of the preset time;
the initial calibration clock of the local clock C1 of the Client1 obtained by the initial calibration is S1-1/2 (EndTime-StartTime);
s24, calculating the difference between the preliminary calibration clock at the preset time and the client clock corresponding to the preset time to obtain the preliminary calibration value;
the initial calibration value of the Client1 is C1- (S1-1/2(EndTime-StartTime)), and the initial calibration values of other clients in the distributed environment are obtained according to the same method;
s3, calibrating the client clock according to the preliminary calibration value corresponding to the client to obtain a preliminary clock;
when the Client1 acquires the audio data Music1, the Client local clock corresponding to the acquisition time is C2, and the preliminary clock corresponding to C2 is preliminarclock ═ C2- (C1- (S1-1/2(EndTime-StartTime))), and the preliminary clocks of other clients acquiring the audio data in the distributed environment are acquired according to the same method;
s4, sending the audio data and the preliminary clock to a synthesis end;
the Client1 sends the audio data Music1 and the corresponding preliminary clock to the Client, and other clients also send the acquired audio data and the corresponding preliminary clock to the Client in real time;
s5, acquiring the time length from the time when the client sends the calibration request to the time when the standard clock is received at a preset time interval, and forming a transmission time length set; the synthesis end calibrates the preliminary clock according to the minimum transmission duration in the transmission duration set to obtain an accurate clock; the method specifically comprises the following steps:
s51, acquiring the time length from the time when the client sends the calibration request to the time when the client receives the standard clock, and acquiring the current transmission time length;
s52, if the current transmission time length is less than the preliminary transmission time length, then: the synthesis end calibrates the preliminary clock according to the current transmission duration; updating the preliminary transmission duration using the current transmission duration;
the method for calibrating the preliminary clock by the synthesis end according to the current transmission duration specifically comprises the following steps: calculating half of the current transmission time length to obtain an accurate transmission time length; obtaining a transmission time error value according to the initial transmission time and the accurate transmission time; calibrating the preliminary clock according to the transmission duration error value; updating the preliminary transmission duration using the current transmission duration;
for example, if the time length from when the Client1 sends the calibration request to when the standard clock corresponding to the preset time is received is the transport time, and is less than the preliminary transmission time length recorded by the current system, the accurate transmission time length is 1/2transport time; the transmission duration error value error is, error is 1/2(EndTime-StartTime) -1/2 transportTime; calibrating the preliminary clock by using the transmission duration error value, so that the calibrated preliminary clock is preliminaryClock-error; updating the value of the preliminary transmission time length to a transportTime, namely the preliminary transmission time length represents the minimum time length from the moment when the client starts to collect audio data to the moment, and the client sends a calibration request to the moment when receiving a standard clock corresponding to the preset moment;
s53, repeating the steps S51 to S52 at preset time intervals until the client finishes collecting the audio data;
s54, marking the current preliminary clock as the accurate clock;
in the period from the time when the client starts to collect the audio data to the time when the client finishes collecting the audio data through the step S5, calibrating the preliminary clock of the audio data obtained in the synthesizing end at a preset time interval, where the preliminary clock when the client finishes collecting the audio data is the accurate clock closest to the actual standard clock;
s6, the synthesis end synthesizes more than two audio data collected by the client according to the accurate clock;
and synthesizing more than two audio data collected by the client according to a preset normalized mixing algorithm.
The second embodiment of the invention is as follows:
as shown in fig. 2, the present embodiment provides a system for synthesizing audio data, including:
the client acquires audio data through the acquisition module 1 and records a client clock corresponding to the acquisition time;
the first obtaining module 6 obtains a client clock corresponding to a preset time; the second obtaining module 7 obtains the time length from the time when the client sends the calibration request to the time when the standard clock corresponding to the preset time is received, so as to obtain the preliminary transmission time length; the first calculating module 8 calculates the sum of the standard clock corresponding to the preset time and half of the preliminary transmission time length to obtain a preliminary calibration clock at the preset time; the second calculating module 9 calculates a difference between the preliminary calibration clock at the preset time and the client clock corresponding to the preset time to obtain the preliminary calibration value;
the first calibration module 2 calibrates the client clock according to the preliminary calibration value corresponding to the client to obtain a preliminary clock; the sending module 3 sends the audio data and the preliminary clock to a synthesis end;
the second calibration module 4 acquires the time length from the time when the client sends the calibration request to the time when the standard clock is received at a preset time interval, and forms a transmission time length set; the synthesis end calibrates the preliminary clock according to the minimum transmission duration in the transmission duration set to obtain an accurate clock; the method specifically comprises the following steps:
the first obtaining unit 41 obtains the time length from the time when the client sends the calibration request to the time when the client receives the standard clock, so as to obtain the current transmission time length; if the current transmission time length is less than the preliminary transmission time length, then: the first calibration unit 42 triggers the synthesis end to calibrate the preliminary clock according to the current transmission duration; updating the preliminary transmission duration using the current transmission duration; the repeating unit 43 repeatedly executes the first obtaining unit and the first calibrating unit at preset time intervals until the client finishes collecting audio data; the marking unit 44 marks the current preliminary clock as the accurate clock;
wherein the first calibration unit 42 comprises: the first calculating unit 421 calculates a half of the current transmission duration to obtain an accurate transmission duration; the second calculating unit 422 obtains a transmission duration error value according to the preliminary transmission duration and the accurate transmission duration; the second calibration unit 423 calibrates the preliminary clock according to the transmission duration error value; the updating unit 424 updates the preliminary transmission duration using the current transmission duration;
the synthesis end of the synthesis module 5 synthesizes the audio data collected by more than two clients according to the accurate clock; specifically, the synthesizing unit 51 in the synthesizing module 5 synthesizes the audio data collected by more than two clients according to a preset normalized mixing algorithm.
The third embodiment of the invention is as follows:
as shown in fig. 3, the present embodiment provides a system for synthesizing audio data, including a client 101, a server 102, and a synthesizing end 103;
wherein the client 101 comprises: the device comprises an acquisition module 1, a first calibration module 2 and a sending module 3;
wherein the synthesis end 103 comprises a second calibration module 4 and a synthesis module 5;
each client 101 in the distributed environment acquires audio data through the acquisition module 1, and calibrates a client local clock corresponding to the acquisition time of the acquired audio data through the first calibration module 2 to obtain a preliminary clock; the client 101 sends the audio data and the corresponding preliminary clock to the synthesizing end 103 through the sending module 3; in the time period from the beginning of collecting the audio data to the end of collecting the audio data, the client 101 sends a calibration request to the server 102, and forms a transmission duration set; a second calibration module 2 in the synthesis end 103 calibrates a preliminary clock corresponding to the audio data received by the synthesis end according to the transmission duration set to obtain an accurate clock; the synthesizing end 103 synthesizes the audio data collected by each client through the synthesizing module 5.
In summary, according to the method and system for synthesizing audio data provided by the present invention, in the time period from the beginning of collecting audio data to the end of collecting audio data at the client, the client intermittently communicates with the server to obtain the standard clock of the server, and according to the minimum communication duration obtained in the time period, that is, the process that the closest client sends a clock calibration request to the server and the server acquires the current clock is twice of the real time consumed in the process, the initial calibration value obtained according to the communication time length between the primary client and the server and the standard clock acquired by the client is calibrated, the fact that the calibrated local clock of the client approaches the actual standard clock is realized, therefore, under the distributed environment, the phenomenon that echo or beat is not correct exists in the synthesized audio data after the audio data collected by each client is synthesized into the audio data is effectively reduced.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all equivalent changes made by using the contents of the present specification and the drawings, or applied directly or indirectly to the related technical fields, are included in the scope of the present invention.
Claims (6)
1. A method of synthesizing audio data, comprising:
s1, the client collects the audio data and records the client clock corresponding to the collection time;
s2, calibrating the client clock according to the preliminary calibration value corresponding to the client to obtain a preliminary clock;
s3, sending the audio data and the preliminary clock to a synthesis end;
s4, acquiring the time length from the time when the client sends the calibration request to the time when the standard clock is received at a preset time interval, and forming a transmission time length set; the synthesis end calibrates the preliminary clock according to the minimum transmission duration in the transmission duration set to obtain an accurate clock;
s5, the synthesis end synthesizes more than two audio data collected by the client according to the accurate clock;
the S2 may further include:
acquiring a client clock corresponding to a preset moment;
acquiring the time from the time when the client sends a calibration request to the time when the standard clock corresponding to the preset time is received, and acquiring the preliminary transmission time;
calculating the sum of the standard clock corresponding to the preset time and half of the preliminary transmission time to obtain a preliminary calibration clock of the preset time;
calculating the difference between the preliminary calibration clock at the preset time and the client clock corresponding to the preset time to obtain the preliminary calibration value;
wherein, the S4 specifically is:
s41, acquiring the time length from the time when the client sends the calibration request to the time when the client receives the standard clock, and acquiring the current transmission time length;
s42, if the current transmission time length is less than the preliminary transmission time length, then: the synthesis end calibrates the preliminary clock according to the current transmission duration; updating the preliminary transmission duration using the current transmission duration;
s43, repeating the steps S41 to S42 at preset time intervals until the client finishes collecting the audio data;
and S44, marking the current preliminary clock as the accurate clock.
2. The method of claim 1, wherein the synthesizing end calibrates the preliminary clock according to the current transmission duration, specifically:
calculating half of the current transmission time length to obtain an accurate transmission time length;
obtaining a transmission time error value according to the preliminary transmission time and the accurate transmission time;
calibrating the preliminary clock according to the transmission duration error value;
updating the preliminary transmission duration using the current transmission duration.
3. The method for synthesizing audio data according to claim 1, wherein synthesizing audio data collected by two or more clients specifically comprises:
and synthesizing the audio data collected by more than two clients according to a preset normalized mixing algorithm.
4. A system for synthesizing audio data, comprising:
the acquisition module is used for acquiring audio data by the client and recording a client clock corresponding to the acquisition time;
the first calibration module is used for calibrating the client clock according to the preliminary calibration value corresponding to the client to obtain a preliminary clock;
the sending module is used for sending the audio data and the preliminary clock to a synthesis end;
the second calibration module is used for acquiring the time length from the time when the client sends the calibration request to the time when the standard clock is received at a preset time interval to form a transmission time length set; the synthesis end calibrates the preliminary clock according to the minimum transmission duration in the transmission duration set to obtain an accurate clock;
the synthesis module is used for synthesizing the audio data acquired by more than two clients by the synthesis end according to the accurate clock;
wherein, still include:
the first acquisition module is used for acquiring a client clock corresponding to a preset moment;
the second acquisition module is used for acquiring the time from the time when the client sends the calibration request to the time when the standard clock corresponding to the preset time is received, so as to obtain the preliminary transmission time;
the first calculation module is used for calculating the sum of the standard clock corresponding to the preset time and half of the preliminary transmission time length to obtain a preliminary calibration clock of the preset time;
the second calculation module is used for calculating the difference between the preliminary calibration clock at the preset time and the client clock corresponding to the preset time to obtain the preliminary calibration value;
wherein the second calibration module comprises:
the first acquisition unit is used for acquiring the time length from the time when the client sends the calibration request to the time when the client receives the standard clock, so as to obtain the current transmission time length;
a first calibration unit, configured to, if the current transmission duration is smaller than the preliminary transmission duration: the synthesis end calibrates the preliminary clock according to the current transmission duration; updating the preliminary transmission duration using the current transmission duration;
the repeating unit is used for repeatedly executing the first acquiring unit and the first calibrating unit at preset time intervals until the client finishes acquiring the audio data;
and the marking unit is used for marking the current preliminary clock as the accurate clock.
5. System for synthesizing audio data according to claim 4, characterized in that the first calibration unit comprises:
the first calculating unit is used for calculating half of the current transmission time length to obtain the accurate transmission time length;
the second calculation unit is used for obtaining a transmission time error value according to the preliminary transmission time and the accurate transmission time;
a second calibration unit, configured to calibrate the preliminary clock according to the transmission duration error value;
and the updating unit is used for updating the preliminary transmission time length by using the current transmission time length.
6. System for synthesizing audio data according to claim 4, characterized in that the synthesis module comprises:
and the synthesis unit is used for synthesizing more than two audio data acquired by the client according to a preset normalized mixing algorithm.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710255866.0A CN107230474B (en) | 2017-04-18 | 2017-04-18 | Method and system for synthesizing audio data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710255866.0A CN107230474B (en) | 2017-04-18 | 2017-04-18 | Method and system for synthesizing audio data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107230474A CN107230474A (en) | 2017-10-03 |
| CN107230474B true CN107230474B (en) | 2020-06-09 |
Family
ID=59933085
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710255866.0A Active CN107230474B (en) | 2017-04-18 | 2017-04-18 | Method and system for synthesizing audio data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107230474B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115379551B (en) * | 2022-08-19 | 2024-05-17 | 合肥联信电源有限公司 | Clock calibration method applied to energy storage type emergency power supply |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1280358A2 (en) * | 2001-07-17 | 2003-01-29 | Kabushiki Kaisha Toshiba | Audio clock restoring apparatus and audio clock restoring method |
| CN1833212A (en) * | 2003-07-31 | 2006-09-13 | 株式会社半导体能源研究所 | Semiconductor device and driving method of semiconductor device |
| CN1933414A (en) * | 2005-09-13 | 2007-03-21 | 上海欣泰通信技术有限公司 | Time regulation algorithm for network time synchronizing in telecommunication field |
| CN1942962A (en) * | 2004-04-06 | 2007-04-04 | 松下电器产业株式会社 | Audio reproducing apparatus, audio reproducing method, and program |
| CN101425891A (en) * | 2008-12-09 | 2009-05-06 | 中兴通讯股份有限公司 | Time synchronization method, system and customer terminal |
| CN103379232A (en) * | 2012-04-13 | 2013-10-30 | 展讯通信（上海）有限公司 | Communication server, communication terminal and voice communication method |
| CN105099649A (en) * | 2015-08-14 | 2015-11-25 | 宋亚玲 | Method and system for synchronously inserting network time |
| CN105578199A (en) * | 2016-02-22 | 2016-05-11 | 北京佰才邦技术有限公司 | Virtual reality panorama multimedia processing system and method and client device |
| CN105684085A (en) * | 2013-10-21 | 2016-06-15 | 索尼公司 | Information processing apparatus, method, and program |
| CN107147462B (en) * | 2017-04-18 | 2019-01-15 | 福建天泉教育科技有限公司 | A kind of clock correcting method and system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7295578B1 (en) * | 2001-09-12 | 2007-11-13 | Lyle James D | Method and apparatus for synchronizing auxiliary data and video data transmitted over a TMDS-like link |
| US7558326B1 (en) * | 2001-09-12 | 2009-07-07 | Silicon Image, Inc. | Method and apparatus for sending auxiliary data on a TMDS-like link |
-
2017
- 2017-04-18 CN CN201710255866.0A patent/CN107230474B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1280358A2 (en) * | 2001-07-17 | 2003-01-29 | Kabushiki Kaisha Toshiba | Audio clock restoring apparatus and audio clock restoring method |
| CN1833212A (en) * | 2003-07-31 | 2006-09-13 | 株式会社半导体能源研究所 | Semiconductor device and driving method of semiconductor device |
| CN1942962A (en) * | 2004-04-06 | 2007-04-04 | 松下电器产业株式会社 | Audio reproducing apparatus, audio reproducing method, and program |
| CN1933414A (en) * | 2005-09-13 | 2007-03-21 | 上海欣泰通信技术有限公司 | Time regulation algorithm for network time synchronizing in telecommunication field |
| CN101425891A (en) * | 2008-12-09 | 2009-05-06 | 中兴通讯股份有限公司 | Time synchronization method, system and customer terminal |
| CN103379232A (en) * | 2012-04-13 | 2013-10-30 | 展讯通信（上海）有限公司 | Communication server, communication terminal and voice communication method |
| CN105684085A (en) * | 2013-10-21 | 2016-06-15 | 索尼公司 | Information processing apparatus, method, and program |
| CN105099649A (en) * | 2015-08-14 | 2015-11-25 | 宋亚玲 | Method and system for synchronously inserting network time |
| CN105578199A (en) * | 2016-02-22 | 2016-05-11 | 北京佰才邦技术有限公司 | Virtual reality panorama multimedia processing system and method and client device |
| CN107147462B (en) * | 2017-04-18 | 2019-01-15 | 福建天泉教育科技有限公司 | A kind of clock correcting method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107230474A (en) | 2017-10-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9374214B2 (en) | Communication apparatus, communication system, and communication method | |
| CN110168396B (en) | Time of arrival (TOA) measurements | |
| TW200807008A (en) | Associating a universal time with a received signal | |
| EP1961186B1 (en) | Using travel-time as means for improving the accuracy of simple network time protocol | |
| US20100073228A1 (en) | Method and apparatus for a global navigation satellite system receiver coupled to a host computer system | |
| WO2017071270A1 (en) | Local clock adjustment method, and time service method and device | |
| CA2436706A1 (en) | Method and apparatus for determining location using a coarse position estimate | |
| JP6605863B2 (en) | Electronic device, method, program, and protection system | |
| CN112543078A (en) | Network time server calibration method and device based on satellite common view | |
| Dotlic et al. | Ranging methods utilizing carrier frequency offset estimation | |
| CN113110016B (en) | Common view data generation method, receiver and time calibration system | |
| KR20150038294A (en) | Correction parameter calculation device and system, correction parameter calculation method, and computer program | |
| CN109379160A (en) | A kind of clock alignment server and method | |
| CN107230474B (en) | Method and system for synthesizing audio data | |
| CN101631049B (en) | Method and device for testing network time service precision | |
| JP4883555B2 (en) | Oscillation control device and synchronization system | |
| JP2013231636A (en) | Clock number/time association circuit, identified clock time generation circuit, event execution instruction/time difference generation circuit, event execution device, radar device, and communication device | |
| CN103197329B (en) | A kind of method of quick acquisition pseudorange | |
| US8843615B2 (en) | Method and device for measuring the temporal drift of an item of electronic equipment connected to a network | |
| CN115150019A (en) | Multi-sensor time synchronization method, device, equipment and medium | |
| CN107147462B (en) | A kind of clock correcting method and system | |
| RU175803U1 (en) | WATCH SYNCHRONIZATION DEVICE | |
| JP6823701B1 (en) | Clock regulators, methods, and programs | |
| US20120049916A1 (en) | Calibration method for oscillation frequency and calibration device for oscillation frequency | |
| CN103763052A (en) | Method and device for measuring time deviation of forwarding type track measuring system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |