CN112235863B

CN112235863B - Audio equipment

Info

Publication number: CN112235863B
Application number: CN202011094490.8A
Authority: CN
Inventors: 童伟峰; 张亮; 黎骅
Original assignee: Bestechnic Shanghai Co Ltd
Current assignee: Bestechnic Shanghai Co Ltd
Priority date: 2020-10-13
Filing date: 2020-10-13
Publication date: 2023-04-18
Anticipated expiration: 2040-10-13
Also published as: CN112235863A

Abstract

The application provides an audio device, which is in wireless connection with a paired device, and is used for receiving and demodulating a wireless frame sent by the paired device and acquiring synchronous information, wherein the wireless frame comprises data collected by a sensor of the paired device and a corresponding first clock count value; adjusting a self synchronous clock based on the synchronization information to be synchronous with a synchronous clock of the paired device; a data acquisition assembly is arranged in the audio equipment, and comprises a sensor; the audio equipment is also used for recording a second clock counting value when the sensor of the audio equipment collects data based on the synchronous clock of the audio equipment and synchronously processing the data collected by the sensor of the audio equipment and the data collected by the sensor of the matched equipment according to the first clock counting value and the second clock counting value. The data that this application can realize gathering the sensor of audio equipment and the data that the sensor of pairing equipment gathered synchronize, from this, be of value to the use and the integration of audio equipment and the data of pairing equipment.

Description

Audio equipment

Technical Field

The application relates to the technical field of data synchronization, in particular to audio equipment.

Background

In modern life, audio devices (e.g., headphones, speakers, etc.) are increasingly used. Conventional audio devices are usually connected to an audio source device (e.g., a mobile phone, a computer, etc.) through a connection cable. With the development of wireless technology, wireless audio devices have emerged. The audio source device can be wirelessly connected with a plurality of wireless audio devices. In the prior art, a wireless audio device usually has a data acquisition function. However, the wireless audio devices wirelessly connected to the sound source device and the sensors included in the wireless audio devices are relatively poor in data acquisition synchronization, so that when the sound source device processes the data acquired by the wireless audio devices, each data often has an uncertain or unknown time delay, the synchronization is relatively poor, the use effect of the data is affected, the data fusion is affected, and the like.

Disclosure of Invention

In view of the above, an object of the present invention is to provide an audio device, so as to improve the problem of poor data acquisition synchronization between a sensor of the audio device and a sensor of a pairing device.

The application provides an audio device, which is in wireless connection with a paired device, and is used for receiving and demodulating a wireless frame sent by the paired device and acquiring synchronous information, wherein the wireless frame comprises data acquired by a sensor of the paired device, and the wireless frame also comprises related information of a first clock count value corresponding to the data acquired by the sensor of the paired device; the audio equipment is further used for adjusting a self synchronous clock based on the synchronous information so as to enable the self synchronous clock to be synchronous with the synchronous clock of the pairing equipment; the audio equipment is further used for recording a second clock count value when the sensor acquires data based on the synchronous clock of the audio equipment, and synchronously processing the data acquired by the sensor of the audio equipment and the data acquired by the sensor of the pairing equipment according to the first clock count value and the second clock count value.

The audio device receives and demodulates a wireless frame sent by the pairing device, acquires synchronization information, adjusts a synchronization clock of the audio device based on the synchronization information to be synchronous with the pairing device, records a second clock count value of data collected by a sensor of the audio device based on the synchronization clock of the audio device, and synchronizes the data collected by the sensor of the audio device and the data collected by the sensor of the pairing device according to the first clock count value and the second clock count value, so that the data collected by a plurality of sensors of the audio device can be synchronized with the data collected by a plurality of sensors of the pairing device, and the problem of poor data collection synchronization between the sensor of the audio device and the sensor of the pairing device is solved.

Further, the synchronization information includes at least any one of a timing synchronization error and a carrier synchronization error.

Further, the audio device includes a processing chip, the processing chip includes a processing module and a co-processing module, the co-processing module is configured to record a second clock count value when the processing chip acquires data from each sensor of the audio device, the processing module is configured to perform synchronous processing on the sensor of the audio device and the data acquired by the sensor of the paired device based on the data acquired by the sensor of the paired device and the corresponding first clock count value, and the data acquired by the processing chip from each sensor of the audio device and the corresponding second clock count value.

In the application, the processing chip comprises the co-processing module, and the co-processing module can share the task of recording the counting value of the synchronous clock when the processing chip acquires data from each sensor respectively, so that the processing module can use the part of the calculation power for processing other tasks, and the operation performance of the processing chip is improved on the whole.

Furthermore, each sensor of the audio device is further configured to send a trigger signal when the acquired data needs to be transmitted to the processing chip, the processing chip includes storage modules corresponding to the sensors of the audio device one to one, and the processing chip is configured to acquire data of the corresponding sensor based on the trigger signal and store the acquired data in the corresponding storage module; the co-processing module is used for storing a second clock count value corresponding to the triggering moment into the corresponding storage module based on the triggering signal, and the processing module is used for reading the data from the sensors and the second clock count values corresponding to the data of the sensors from the storage modules and processing the data of the corresponding sensors according to the second clock count values so as to synchronize the data from the sensors of the audio equipment.

In the application, each sensor sends a trigger signal when data needs to be transmitted, the trigger signal triggers the processing chip to acquire the data acquired by each sensor and perform synchronous processing, and the processing chip can be responsible for other tasks before not receiving the trigger signal, so that the problem of high system overhead caused by the fact that the processing chip acquires the data acquired by each sensor constantly and records the synchronous clock count value when the data is acquired can be avoided.

Furthermore, the processing chip is further configured to trigger the processing module based on the trigger signal, and the processing module is further configured to read data of the corresponding sensor after being triggered, and store the read data in the corresponding storage module.

Further, the processing chip further comprises a DMA module, the processing chip triggers the DMA module based on the trigger signal, and the DMA module is used for acquiring data of the corresponding sensor after being triggered and storing the acquired data into the corresponding storage module.

In the application, the processing chip further comprises a DMA module, and the DMA module can share the work of the processing module for acquiring the data of the sensor based on the trigger signal, so that the working pressure of the processing module is reduced, the processing module can release more computing power to process other tasks, and the computing performance of the processing chip is improved on the whole.

Furthermore, the data acquisition assembly also comprises storage units which are in one-to-one correspondence with the sensors of the audio equipment, the sensors acquire data according to respective sampling frequencies and store the acquired data in the corresponding storage units, and the sensors are used for determining that the data needs to be transmitted when the data volume in the corresponding storage units reaches respective preset values; or after the completion of the respective preset number of data acquisitions, determining that data needs to be transferred.

In the application, the data acquisition assembly further comprises storage units which correspond to the plurality of sensors one by one, each sensor acquires data according to respective sampling frequency and stores the acquired data into the corresponding storage unit, and when the data volume of each sensor in the corresponding storage unit reaches respective preset value, the data to be transmitted is determined; or after the data acquisition of the respective preset number is completed, the data to be transmitted is determined, namely, the data to be transmitted is automatically determined by each sensor after the corresponding condition is met, and after the processing chip determines the condition to be met by the data to be transmitted for the first time and completes the configuration, each sensor can determine whether the data to be transmitted is needed by determining whether the condition is met, namely, the processing chip does not need to be configured again in the subsequent process, so that the working pressure of the processing chip can be reduced to a certain extent.

Further, the synchronization processing is interpolation processing.

Further, the synchronization precision of the synchronization process is less than the clock period of the synchronization clock of the audio device.

Further, the clock frequency of the audio device's synchronous clock is greater than the sampling frequency of the audio device's sensors.

In the application, the clock frequency of the synchronous clock is greater than the sampling frequency of each sensor, so that the data collected by each sensor can be accurately synchronized.

Further, the sensor of the audio device is an acceleration sensor, a gyroscope, a digital microphone, a temperature sensor, a humidity sensor, a pressure sensor or an infrared sensor.

The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the application will be apparent from the description and drawings, and from the claims.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.

Fig. 1 is a schematic diagram of wireless connection between an audio device, a pairing device, and an audio source device according to an embodiment of the present application.

Fig. 2 is a block diagram of an audio device according to an embodiment of the present application.

Icon: an audio device-10; pairing device-20; audio source device-30; data acquisition component-11; a sensor-111; a storage unit-113; a processing chip-13; a co-processing module-131; -a processing module-132; a storage module-133; DMA module-134.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.

Referring to fig. 1, an embodiment of the present application provides an audio device 10 wirelessly connected to a pairing device 20 and an audio source device 30 respectively. Pairing device 20 may also be wirelessly connected to audio source device 30. The wireless connection between the audio device 10 and the pairing device 20, and between the audio device 10 and/or the pairing device 20 and the sound source device 30 may be a bluetooth connection, a WIFI connection, or a wireless connection based on a human body as a transmission medium, or the like. The Bluetooth connection includes, but is not limited to, classic Bluetooth (Classic Bluetooth), BLE (Bluetooth Low Energy), LE audio (BT 5.2 standard), and the like.

It is understood that in other embodiments, audio source device 30 may be omitted, and audio device 10 is wirelessly connected to companion device 20. The wireless connection may be a bluetooth connection, a WIFI connection, or a wireless connection based on a human body as a transmission medium, or the like. The Bluetooth connection includes, but is not limited to, classic Bluetooth (Classic Bluetooth), BLE (Bluetooth Low Energy), LE audio (BT 5.2 standard), and the like.

The audio device 10 may be a wireless loudspeaker, a left ear wireless headset or a right ear wireless headset in a wireless headset pair, or the like. Accordingly, when the audio device 10 is a wireless sound box, the pairing device 20 may be another wireless sound box wirelessly connected with the audio device 10, and a wireless headset is equivalent; where the audio device 10 is a left ear wireless headset of a wireless headset pair, the companion device 20 may be a right ear wireless headset and vice versa. The sound source device 30 may be a mobile phone, a smart watch, a tablet computer, a notebook computer, or the like.

In one embodiment, audio device 10 may first establish a wireless connection with audio source device 30 and then wirelessly transmit communication information (e.g., wireless communication address of audio source device, encryption parameters of the wireless connection between audio device 10 and audio source device 30, etc.) to paired device 20. The pairing device 20 listens and receives audio data transmitted by the sound source device 30 based on the communication information. Alternatively, the audio device 10 may transmit the communication information to the pairing device 20 in a direct or indirect manner. Direct modes include, but are not limited to, classic bluetooth, BLE, LE audio, etc. Indirect means include, but are not limited to, means of relaying through audio source device 30 or other devices (e.g., when audio device 10 and companion device 20 are a wireless headset pair, the other devices may be a charging box), etc.

It is understood that in other embodiments, the pairing device 20 may first establish a wireless connection with the audio source device 30 and then wirelessly transmit the communication information to the audio device 10. The audio device 10 listens to and receives audio data transmitted from the sound source device 30 based on the communication information.

The sound source device 30 may wirelessly transmit the audio data to be played to the audio device 10 and the pairing device 20, respectively, for playing. Alternatively, the audio source device 30 may wirelessly transmit the audio data to be played to one of the audio device 10 and the counterpart device 20, and then forward the audio data to be played to the other by receiving the audio data to be played transmitted from the audio source device 30.

The audio device 10 and the counterpart device 20 may each perform data collection, such as collecting voice data, temperature data, humidity data, and the like. When the audio device 10 and the pairing device 20 are both wirelessly connected to the audio source device 30, the audio device 10 and the pairing device 20 may wirelessly transmit the acquired data to the audio source device 30 for processing, respectively. When the audio device 10 is wirelessly connected to the counterpart device 20 and one of the two is also wirelessly connected to the sound source device 30, one of the two not wirelessly connected to the sound source device 30 may wirelessly transmit the acquired data to one of the two wirelessly connected to the sound source device 30, and then one of the two wirelessly connected to the sound source device 30 may wirelessly transmit the acquired data to the sound source device 30.

The audio device 10, the counterpart device 20, and the audio source device 30 are clock-synchronized.

In an embodiment, the audio device 10 and the pairing device 20 are both wirelessly connected to the audio device 30, and at this time, the audio device 10 and the pairing device 20 respectively receive the wireless frames sent by the audio device 30. The audio device 10 and the pairing device 20 demodulate the wireless frames received from the sound source device respectively to obtain synchronization information, and adjust the respective synchronization clocks based on the synchronization information respectively, thereby synchronizing the respective synchronization clocks with the clock of the sound source device 30. The synchronization information includes, but is not limited to, timing synchronization error, carrier synchronization error, and the like.

In one embodiment, the audio device 10 and the pairing device 20 are wirelessly connected, and one of the two is wirelessly connected to the sound source device 30, at this time, one of the two wirelessly connected to the sound source device 30 receives the wireless frame transmitted by the sound source device 30, demodulates the received wireless frame from the sound source device 30 to obtain the synchronization information, and then adjusts its own synchronization clock based on the synchronization information, thereby synchronizing its own synchronization clock with the clock of the sound source device 30. Then, one of the two wirelessly connected to the sound source device 30 sends a wireless frame to the other, and the other demodulates the received wireless frame after receiving the wireless frame to obtain synchronization information, and then adjusts its own synchronization clock based on the synchronization information, so that its own synchronization clock is synchronized with the clock of one of the two wirelessly connected to the sound source device 30, and then synchronizes its own synchronization clock with the clock of the sound source device 30. The synchronization information includes, but is not limited to, timing synchronization error, carrier synchronization error, and the like.

In both embodiments, the radio frame includes synchronization information, i.e. the synchronization information is transmitted as part of the data of the radio frame. Therefore, after receiving the wireless frame, the audio device 10 and the pairing device 20 can directly obtain the synchronization information by demodulating the wireless frame.

It is understood that in other embodiments, the radio frame may not include synchronization information. At this time, when the audio device 10 and the pairing device 20 receive the wireless frame, the respective synchronous clocks record the synchronous clock count values when the wireless frame is received, and then the synchronous clock count values are compared with the respective preset synchronous clock count values, and the respective synchronous clocks are adjusted according to the comparison result. It should be noted that the preset synchronous clock count value is a theoretical count value of the respective synchronous clock when the audio device 10 and the pairing device 20 receive the wireless frame, and the synchronous clock count values respectively recorded by the respective synchronous clocks when the audio device 10 and the pairing device 20 receive the wireless frame are actual count values. When the theoretical counting value and the actual counting value have deviation, the clock is out of synchronization. By adjusting the respective synchronous clocks based on the deviation, the audio device 10 can be synchronized with the clocks of the counterpart device 20 and the audio source device 30.

It is understood that the adjustment of the synchronous clock according to the synchronization information is prior art in the field and will not be described herein.

It is understood that the audio device 10 and the pairing device 20 can perform clock synchronization adjustment when the wireless connection is established with the audio source device 30 for the first time; or, after establishing wireless connection with the sound source device 30, adjusting the clock synchronization at preset time intervals; alternatively, the clock synchronization adjustment is performed continuously after the wireless connection with the sound source device 30 is established.

Accordingly, the clock synchronization adjustment can be performed between the audio device 10 and the pairing device 20 when the wireless connection is established for the first time; or after the wireless connection is established, adjusting the clock synchronization at intervals of preset duration; alternatively, the clock synchronization adjustment is performed continuously after the wireless connection is established.

After the audio device 10 and the pairing device 20 are synchronized with the clock of the sound source device 30, after the audio data sent by the sound source device 30 is received, the received audio data is synchronized based on the respective synchronization clocks, and then the audio data after the synchronization processing is respectively played, so that the audio data played by the audio device 10 and the pairing device 20 are synchronized, and the user experience is improved.

After the audio device 10 and the pairing device 20 are synchronized in clock, the acquired data may be synchronized based on the respective synchronized clocks, and then the synchronized data may be transmitted to the sound source device 30, so that the operation pressure of the sound source device 30 in processing the data acquired by the audio device 10 and the pairing device 20 may be reduced.

In this embodiment, the audio device 10 is wirelessly connected to the pairing device 20, and is configured to receive and demodulate a wireless frame sent by the pairing device 20, and acquire synchronization information; and adjusts its own synchronization clock based on the synchronization information to synchronize its own synchronization clock with the pairing apparatus 20 clock. In this embodiment, the wireless frame includes data collected by the sensor of the paired device 20 and information related to the first clock count value corresponding to the data collected by the sensor of the paired device 20, but does not include synchronization information. The audio device 10 records its own count value of the synchronization clock upon receiving the wireless frame transmitted by the pairing device 20, and compares it with a preset count value of the synchronization clock to acquire synchronization information (here, the synchronization information refers to a deviation of an actual count value from a theoretical count value).

It is understood that the information related to the first clock count value corresponding to the data collected by the sensor of the paired device 20 may be directly the first clock count value corresponding to the data collected by the sensor of the paired device 20.

Or, the related information of the first clock count value corresponding to the data acquired by the sensor of the paired device 20 may be a corresponding relationship between a sampling point corresponding to the data currently acquired by the sensor of the paired device 20 and a sampling point corresponding to (the first clock count value of) the first frame data of the sensor of the paired device 20, at this time, the paired device 20 may wirelessly connect the first clock count value of the first frame data of the sensor data of the paired device 20 and/or a corresponding relationship between a time interval between two adjacent sampling points of the sensor of the paired device 20 and a synchronous clock count of the paired device 20 (for example, a time interval between two adjacent sampling points corresponds to N counts of the synchronous clock of the paired device 20) with the audio device 10, and transmit the corresponding relationship between the sampling point corresponding to the data currently acquired by the sensor of the paired device 20 and the sampling point corresponding to the first frame data of the sensor of the paired device 20 to the audio device 10, when the subsequent paired device 20 wirelessly transmits the data and the audio device 10. After the audio device 10 receives the data currently acquired by the sensor of the paired device 20 and/or the corresponding relationship between the sampling point corresponding to the data currently acquired by the sensor of the paired device 20 and the sampling point corresponding to the first clock count value of the first frame data of the sensor of the paired device 20, based on the first clock count value of the first frame data of the sensor of the paired device 20 acquired at the beginning of establishing the wireless connection with the paired device 20, the corresponding relationship between the time interval between two adjacent sampling points of the sensor of the paired device 20 and the synchronous clock count of the paired device 20, and the corresponding relationship between the sampling point corresponding to the data currently acquired by the sensor of the paired device 20 and the sampling point corresponding to the first clock count value of the first frame data of the sensor of the paired device 20, the first clock count value corresponding to the data currently acquired by the sensor of the paired device 20 may be calculated.

It is understood that the correspondence between the time interval between two adjacent sampling points of the sensor of the counterpart device 20 and the synchronous clock count of the counterpart device 20 may be preset in the audio device 10.

It is understood that after the pairing device 20 acquires data from its respective sensors, the data collected by the respective sensors may be processed synchronously. The synchronization processing here may be interpolation processing. After the synchronization process, the sampling interval of the sensor data is converted to the synchronous clock of the counterpart device 20 or its N (N is an integer) divided clock. Since the synchronization clock of the counterpart device 20 is synchronized with the synchronization clock of the audio device 10 (adjusted based on the synchronization information). Accordingly, the paired device 20 can transmit the first clock count value of the first frame data of the sensor data of the paired device 20 to the audio device 10 through the wireless connection. In the case where the sensor data is continuous, the audio device 10 receives the sensor data from the pairing device 20 and the first clock count value of the first frame data thereof, and synchronization of the sensor data of the pairing device 20 and the sensor data of the audio device 10 can be achieved. It is understood that the data collected by the sensor of the audio device 10 may also be processed synchronously, and after the synchronization process, the sampling interval of the sensor data of the audio device 10 is converted to the synchronous clock of the audio device 10 or its N (N is an integer) frequency division clock. Thus, the sensor data of the audio device 10 and the sensor data of the counterpart device 20 are based on respective synchronous clocks that are synchronized with each other.

Referring to fig. 2, in the present embodiment, a data acquisition component 11 is disposed in the audio device 10. The data acquisition assembly 11 includes one or more sensors 111 for acquiring data. The sensors 111 include, but are not limited to, acceleration sensors, gyroscopes, digital microphones, temperature sensors, humidity sensors, pressure sensors, or infrared sensors. In this embodiment, the types of sensors 111 included in the data acquisition assembly 11 are not all the same.

In this embodiment, each sensor 111 is also used to send a trigger signal when data needs to be transferred. The trigger signal is an indication that the data that needs to be transmitted by each sensor 111 is ready for completion.

In one embodiment, the data acquisition assembly 11 further includes a storage unit 113 in one-to-one correspondence with the plurality of sensors 111. The storage unit 113 may be a first-in first-out storage unit or a ping-pong buffer unit, etc. It should be noted that the ping-pong buffer unit may be physically a single storage structure or two storage structures. The storable capacity of each storage unit 113 may be the same or different. In this embodiment, the storage capacity of each storage unit 113 is different.

Each sensor 111 collects data at its own sampling frequency and stores the collected data in the corresponding storage unit 113. Each sensor 111 is configured to determine that data needs to be transmitted when the data amount in the corresponding storage unit 113 reaches a preset ratio of the respective capacity (for example, when one of the storage structures is full of data in the case that the storage unit 113 is a ping-pong cache unit including two identical storage blocks), or determine that data needs to be transmitted after the data acquisition of the respective preset amount is completed. The preset ratio and the preset number may be preset before the audio device 10 is shipped from the factory. Optionally, the preset ratios are different for the storage units 113 corresponding to different sensors 111; similarly, the preset number is different for different sensors 111. Thus, the times at which different sensors 111 need to transmit data can be staggered.

In this embodiment, the audio device 10 is further configured to record a count value (a second clock count value) of the synchronous clock when the sensor 111 of the audio device collects data based on the synchronous clock of the audio device, and perform synchronization processing on the data collected by the sensor of the audio device and the data collected by the sensor of the pairing device 20 according to the second clock count value and the acquired first clock count value. Before the synchronization processing, the data collected by the sensor of the audio device 10 and the data collected by the sensor of the pairing device 20 respectively represent the respective collection time through the second clock count value and the first clock count value, that is, the data collection time is recorded through the respective time axes of the audio device 10, that is, the pairing device 20; after the synchronization processing, the data collected by the sensor of the audio device 10 and the data collected by the sensor of the pairing device 20 are unified to record the respective collection time by using the same time axis, or the data collected by the sensor of the audio device 10 and the data collected by the sensor of the pairing device 20 correspond to the same clock count value after the synchronization processing.

It is understood that the first clock count value and the second clock count value are counted based on the respective synchronous clocks of the pairing device 20 and the audio device 10.

In this embodiment, the audio device 10 is further configured to perform synchronous processing on data collected by the multiple sensors 111 based on its own synchronous clock. Optionally, the synchronization accuracy of the synchronization process is less than the clock period of the synchronization clock of the audio device 10 to characterize the normal progress of the synchronization process. The synchronization accuracy refers to the minimum time interval that can be reached by the synchronization process. Optionally, the clock frequency of the synchronous clock of the audio device 10 is greater than the sampling frequency of each sensor 111, so that the synchronous clock of the audio device 10 can accurately locate the time when each sensor 111 sends the trigger signal, and further, the audio device 10 can synchronize the data collected by each sensor 111. Alternatively, the clock frequency of the synchronous clock may be greater than 1MHz. In the present embodiment, the synchronization processing is interpolation processing, for example, linear interpolation, quadratic interpolation, or the like. The specific contents of the interpolation processing are prior art in the art and will not be described here.

In this embodiment, the audio device 10 further includes a processing chip 13. The synchronous clock of the audio device 10 may be built into the processing chip 13. Of course, the synchronous clock of the audio device 10 may be disposed in parallel with the processing chip 13 and connected to the processing chip 13. The processing chip 13 may be an audio processing chip, a video processing chip, or an integrated chip, etc. The processing chip 13 is connected to the plurality of sensors 111 of the data acquisition assembly 11, and is configured to acquire data acquired by each sensor 111 and perform synchronous processing on the data acquired by the plurality of sensors 111 based on a synchronous clock. It is understood that the processing chip 13 may obtain the data of the corresponding sensor 111 based on any one of SPI (Serial Peripheral Interface), UART (Universal Asynchronous Receiver/Transmitter), I2C (Inter-Integrated Circuit) and I2S (Inter-IC Sound, integrated Circuit built-in audio bus).

Optionally, the processing chip 13 comprises a plurality of I/O interfaces. The I/O interface may be a GPIO interface. Each sensor 111 is connected to the processing chip 13 through an I/O interface, so as to transmit the data collected by itself to the processing chip 13. In this embodiment, the storage units 113 corresponding to the sensors 111 are connected to the processing chip 13 through one I/O interface. Each sensor 111 is indirectly connected to one I/O interface via a corresponding storage unit 113, and further to the processing chip 13.

The processing chip 13 may include a co-processing module 131 and a processing module 132.

The co-processing module 131 is connected to the synchronous clock of the audio device 10, and is configured to record a count value of the synchronous clock of the audio device 10 when the processing chip 13 acquires data from each sensor 111. In this embodiment, the co-processing module 131 is configured to record a count value of a synchronous clock of the audio device 10 when the processing chip 13 receives the trigger signal sent by the sensor 111. In the prior art, the processing module 132 is usually triggered by a trigger signal, and a count value of a synchronous clock corresponding to a trigger time is recorded, in this embodiment, the co-processing module 131 shares this part of the work of the processing module 132, so that other work of the processing module 132 can be prevented from being interrupted, and thus, the processing capability of the processing chip 13 is improved to a certain extent. In addition, in the prior art, when the processing module 132 is triggered by the trigger signal, it may be necessary to complete the current processing operation and then record the count value of the synchronous clock corresponding to the trigger time. In this way, the recording of the count value of the synchronous clock at the trigger time is delayed, and since a plurality of sensors 111 are still continuously acquiring data during the process of the processing module 132 completing the current processing task, that is, other sensors 111 may be sequentially transmitting trigger signals during the process of the processing module 132 completing the current processing task, the count value of the synchronous clock is easily confused. In this embodiment, the co-processing module 131 stores the count value of the synchronous clock at the trigger time in time, so as to avoid the problems in the prior art.

The processing module 132 is configured to perform synchronous processing on the data acquired by the sensor of the audio device 10 and the data acquired by the sensor of the pairing device 20 based on the data acquired by the sensor of the pairing device 20 and the corresponding first clock count value acquired by the audio device 10, and the data acquired by the processing chip 13 from each sensor 111 and the corresponding count value (second clock count value) of the synchronous clock, respectively.

In this embodiment, the processing module 132 is configured to interpolate the data collected by the sensor of the paired device 20 and the data collected by the sensor 111 of the audio device 10 based on the data collected by the sensor of the paired device 20 and the corresponding first clock count value, which are obtained by the audio device 10, and the data collected by the processing chip 13 from each sensor 111 and the corresponding second clock count value, respectively, so that the data collected by the sensor of the paired device 20 and the data collected by the sensor 111 of the audio device 10 are synchronized.

It is understood that the processing module 132 may also be configured to determine a corresponding sensor type based on the data format of the data acquired by the sensor of the paired device 20 acquired by the audio device 10, and then synchronize the data acquired by the sensor of the paired device 20 and the data acquired by the corresponding sensor 111 of the audio device 10 based on the data acquired by the sensor of the paired device 20 acquired by the audio device 10 and the corresponding first clock count value, and the data acquired by the processing chip 13 from the corresponding sensor 111 (a sensor of the same sensor type as the acquired data acquired by the sensor of the paired device 20) and the corresponding second clock count value, respectively. The synchronization processing here may be interpolation processing.

It is understood that the processing module 132 may also be configured to perform synchronous processing on the data acquired by the plurality of sensors based on the data acquired by the processing chip 13 from each sensor 111 and the count value of the corresponding synchronous clock. The synchronization process here may be an interpolation process. After the synchronization process, the sampling interval of the sensor data is converted to a synchronous clock or its N (N is an integer) frequency division clock. It is understood that the data collected by the sensor of the paired device 20 may also be subjected to synchronization processing, and after the synchronization processing, the sampling interval of the sensor data of the paired device 20 is converted to the synchronous clock of the paired device 20 or its N (N is an integer) frequency division clock. Then, based on the data acquired by the sensor of the paired device 20 and the corresponding first clock count value acquired by the audio device 10, and the data of each synchronized sensor 111 in the audio device 10 and the corresponding second clock count value, the data acquired by the sensor of the paired device 20, the data of each synchronized sensor 111 in the audio device 10 and the corresponding second clock count value are subjected to secondary synchronization processing.

In this embodiment, the processing module 132 is configured to interpolate data collected by the multiple sensors 111 based on data obtained by the processing chip 13 from each sensor 111 and a count value of a corresponding synchronization clock, so that the data of the multiple sensors 111 are synchronized. It will be appreciated that the processing module 132 may also be used to process other computational tasks of the audio device 10.

The processing chip 13 may further include a storage module 133 in one-to-one correspondence with the sensors 111. The storage modules 133 are connected to the storage units 113 in a one-to-one correspondence. In this embodiment, each of the memory modules 133 is connected to one I/O interface of the processing chip 13, and further connected to the memory unit 113 connected to the I/O interface. Each storage module 133 is further connected to the co-processing module 131 and the processing module 132, respectively.

The processing chip 13 is configured to obtain data of a corresponding sensor based on the trigger signal, and store the obtained data in the corresponding storage module 133. By connecting the plurality of storage modules 133 and the plurality of storage units 113 in a one-to-one correspondence, the data collected by each sensor 111 can be stored separately, so as to avoid confusion of data sources during subsequent synchronous processing.

In this embodiment, the co-processing module 131 is configured to store the count value of the synchronous clock corresponding to the trigger time into the corresponding storage module 133 based on the trigger signal. The processing module 132 is configured to read the data from the plurality of sensors 111 and the count value of the synchronization clock corresponding to each of the data of the plurality of sensors 111 from each of the storage modules 133, and process the data of the corresponding sensor 111 according to the count value of the synchronization clock, so as to synchronize the data from the plurality of sensors 111.

In one embodiment, the processing chip 13 is further configured to trigger the processing module 132 based on the trigger signal. The processing module 132 is further configured to read data of the corresponding sensor 111 after being triggered, and store the read data in the corresponding storage module 133. Alternatively, the processing chip 13 may directly trigger the processing module 132 by using the trigger signal, or the processing chip 13 may trigger the processing module 132 at a preset time interval after receiving the trigger signal, so that the processing module 132 reads the data of the corresponding sensor 111 and stores the data in the corresponding storage module 133.

The processing module 132 is further configured to read the data from the plurality of sensors 111 and the count value of the synchronization clock corresponding to each of the data of the plurality of sensors 111 from each of the storage modules 133, and process the data of the corresponding sensor 111 according to the count value of the synchronization clock, so as to synchronize the data from the plurality of sensors 111.

In this embodiment, the processing module 132 is configured to read the data of the multiple sensors 111 and the count values of the synchronous clocks corresponding to the data of the multiple sensors 111 from the storage module 133, and interpolate the data of the corresponding sensors 111 according to the count values of the synchronous clocks, so that the data acquired by the multiple sensors 111 are synchronized.

Optionally, the trigger signal is an interrupt signal of the processing module 132, and the processing module 132 reads data of the corresponding sensor 111 in an interrupt handler, stores the data in the corresponding storage module 133, and performs synchronization processing on the data. The contents of the interrupt handler are prior art and therefore, will not be described herein.

In an embodiment, the processing chip 13 may further include a DMA (Direct Memory Access) module 134. The processing chip 13 is also configured to trigger the DMA module 134 based on the trigger signal. The DMA module 134 is configured to acquire data of the corresponding sensor 111 after being triggered, and store the acquired data in the corresponding storage module 133. The DMA module 134 can share the work of the processing module 132 for acquiring the data of the sensor 111 based on the trigger signal, so as to reduce the working pressure of the processing module 132, so that the processing module 132 can release more computing power to process other tasks, thereby improving the computing performance of the processing chip 13 as a whole.

Alternatively, the processing chip 13 may directly trigger the DMA module 134 with the trigger signal when receiving the trigger signal; or the processing chip 13 may trigger the DMA module 134 at a predetermined time interval after receiving the trigger signal.

In this embodiment, the DMA module 134 is triggered by the trigger signal to acquire the data of the corresponding sensor 111. Since the trigger signal is generated after the data amount in the storage unit 113 corresponding to each sensor 111 reaches a respective preset value or each sensor 111 completes the data acquisition of a respective preset number, for the DMA module, the data amount required to be acquired after being triggered by the trigger signal is fixed, and thus, the data amount of the data of each acquisition unit required to be acquired by the DMA module 134 does not need to be configured by the processing module 132 each time the DMA module is triggered, so that the processing module 132 is not interfered, thereby improving the processing capability of the processing chip 13 as a whole.

In this embodiment, the plurality of storage modules 133 are respectively connected to the plurality of storage units 113 in a one-to-one correspondence manner through the I/O interface of the processing chip 13, which is equivalent to forming a plurality of DMA channels between the processing chip 13 and the data acquisition assembly 11. Each DMA channel corresponds to one memory module 133, one memory unit 113, and an I/O bus coupled between the corresponding memory module 133 and the memory unit 113. Since the trigger signal may be generated after the amount of data in the storage unit 113 corresponding to each sensor 111 reaches a respective preset value or each sensor 111 completes the collection of a respective preset amount of data, the amount of data transferred in a single time may be fixed for each DMA channel. In addition, since each DMA channel corresponds to a corresponding storage unit 113, and each storage unit 113 corresponds to a corresponding sensor 111, based on a trigger signal sent by a specific sensor 111 when data transfer is required, when the DMA module 134 acquires data collected by the sensor 111, the address of the storage unit 113 to be accessed is also fixed. Therefore, it is not necessary to repeatedly configure the data amount of the data of each acquisition unit that needs to be acquired by the DMA module 134 and the address of the storage unit 113 that needs to be accessed by the DMA module 134 when acquiring the data of each acquisition unit by the processing module 132 every time the sensor 111 sends a trigger signal, so that the processing module 132 is not interfered, thereby improving the processing capability of the data synchronization system.

It can be understood that, since the respective preset values of the storage units 113 corresponding to the sensors 111 may be different, and the respective preset numbers of the sensors 111 may also be different, accordingly, the number of data transferred in a single time by each DMA channel may also be different. The DMA module 134 may sequentially obtain the data of the corresponding sensor 111 through the corresponding DMA channel according to the sequence of the trigger signals sent by the sensors 111 and the principle of first-come first-triggered.

Alternatively, the plurality of DMA channels may be ordered in advance in a predetermined order so as to distinguish the DMA channels. For the case that the DMA module 134 is triggered by the trigger signals sent by different sensors 111 at the same time, the DMA module 134 may sequentially acquire the data of the corresponding sensor 111 through the corresponding DMA channels according to an order determined in advance based on the DMA ordering (which may be the same as or different from the ordering performed on the plurality of DMA channels in advance according to a predetermined order). Therefore, the condition that the data of the acquisition unit is lost can be avoided.

In this embodiment, the DMA module can share the work of acquiring the data of the acquisition unit based on the trigger signal for the processing module, so as to further reduce the working pressure of the processing module, and the DMA module is responsible for the work of acquiring the data of the acquisition unit, so that the processing module is free from interference, and can release more computing power to process other tasks of the data synchronization system to a certain extent.

The audio equipment provided by the application acquires the synchronous information by receiving and demodulating the wireless frame sent by the pairing equipment, then adjusts the synchronous clock of the audio equipment on the basis of the synchronous information so as to be synchronous with the pairing equipment, and then synchronously processes the data acquired by the sensors on the basis of the synchronous clock, so that the data acquired by the sensors on the audio equipment can be synchronized with the pairing equipment, and the use experience of a user is improved.

In the application, the data acquisition assembly further comprises storage units which correspond to the plurality of sensors one by one, each sensor acquires data according to respective sampling frequency and stores the acquired data into the corresponding storage unit, and when the data volume of each sensor in the corresponding storage unit reaches respective preset value, the data needing to be transmitted is determined; or after the data acquisition of the respective preset number is completed, the data to be transmitted is determined, namely, the data to be transmitted is automatically determined by each sensor after the corresponding condition is met, and after the processing chip determines the condition to be met by the data to be transmitted for the first time and completes the configuration, each sensor can determine whether the data to be transmitted is needed by determining whether the condition is met, and the processing chip does not need to be configured again in the subsequent process, so that the working pressure of the processing chip can be reduced to a certain extent.

In the application, the processing chip comprises the co-processing module, and the co-processing module can share the task of recording the counting value of the synchronous clock when the processing chip respectively acquires data from each sensor for the processing module, so that the processing module can use the part of calculation power for processing other tasks, and the operation performance of the processing chip is integrally improved.

The pairing device 20 may also include a data acquisition component and a processing chip, the data acquisition component includes a plurality of sensors and a storage unit corresponding to the plurality of sensors, and the processing chip includes a co-processing module, a storage module and a DMA module. The connection relationships and the mutual cooperation between the processing chip of the pairing device 20 and the data acquisition component, between the components (i.e., the sensor, i.e., the storage unit) inside the data acquisition component, and between the components (i.e., the co-processing module, the processing module, and the storage module, i.e., the DMA module) inside the processing chip, enable the process of synchronously processing the data acquired by the multiple sensors of the pairing device based on the synchronous clock of the pairing device 20 to correspond to the corresponding content of the audio device 10 in the foregoing embodiment, and specific content may refer to the foregoing embodiment, which is not described herein again.

The sound source device 30 may also include a data collecting component and a processing chip, wherein the data collecting component includes a plurality of sensors and a storage unit corresponding to the plurality of sensors, and the processing chip includes a co-processing module, a storage module and a DMA module. The connection relationship and the mutual cooperation between the processing chip of the sound source device 30 and the data acquisition component, between the components inside the data acquisition component (i.e., the sensor, i.e., the storage unit), and between the components inside the processing chip (i.e., the co-processing module, the processing module, and the storage module, i.e., the DMA module) achieve that the process of synchronously processing the data acquired by the plurality of sensors of the pairing device based on the synchronous clock of the sound source device 30 corresponds to the corresponding content of the audio device 10 in the foregoing embodiment, and specific content can refer to the foregoing embodiment and is not described herein again.

The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made to the present application by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. The audio equipment is characterized by being in wireless connection with paired equipment and used for receiving and demodulating a wireless frame sent by the paired equipment and acquiring synchronous information, wherein the wireless frame comprises data collected by a sensor of the paired equipment and also comprises information related to a first clock count value corresponding to the data collected by the sensor of the paired equipment; the audio equipment is further used for adjusting a self synchronous clock based on the synchronous information so as to enable the self synchronous clock to be synchronous with the synchronous clock of the pairing equipment; a data acquisition assembly is arranged in the audio equipment, and the data acquisition assembly comprises a sensor and is used for acquiring data; the audio equipment is also used for recording a second clock count value when the sensor of the audio equipment acquires data based on the synchronous clock of the audio equipment; and synchronously processing the data acquired by the sensor of the self and the data acquired by the sensor of the paired equipment according to the first clock count value and the second clock count value;

the audio equipment comprises a processing chip, the processing chip comprises a processing module and a co-processing module, the co-processing module is used for recording second clock count values when the processing chip acquires data from each sensor of the audio equipment respectively when the processing chip receives a trigger signal sent by the sensor, and the processing module is used for carrying out synchronous processing on the sensor of the audio equipment and the data acquired by the sensor of the paired equipment based on the data acquired by the sensor of the paired equipment and the corresponding first clock count values and the data acquired by the processing chip from each sensor of the audio equipment and the corresponding second clock count values.

2. The audio device of claim 1, wherein the synchronization information includes at least any one of a timing synchronization error and a carrier synchronization error.

3. The audio device according to claim 1, wherein each sensor of the audio device is further configured to send a trigger signal when the collected data needs to be transmitted to the processing chip, the processing chip includes storage modules in one-to-one correspondence with the sensors of the audio device, and the processing chip is configured to obtain data of the corresponding sensor based on the trigger signal and store the obtained data in the corresponding storage module; the co-processing module is used for storing a second clock count value corresponding to the triggering moment into the corresponding storage module based on the triggering signal, and the processing module is used for reading the data from the sensors and the second clock count values corresponding to the data of the sensors from the storage modules and processing the data of the corresponding sensors according to the second clock count values so as to synchronize the data from the sensors of the audio equipment.

4. The audio device of claim 3, wherein the processing chip is further configured to trigger the processing module based on the trigger signal, and the processing module is further configured to read data of the corresponding sensor after being triggered and store the read data in the corresponding storage module.

5. The audio device of claim 3, wherein the processing chip further comprises a DMA module, the processing chip triggers the DMA module based on the trigger signal, and the DMA module is configured to acquire data of a corresponding sensor after being triggered and store the acquired data in a corresponding storage module.

6. The audio device of claim 3, wherein the data acquisition component further comprises a storage unit in one-to-one correspondence with each sensor of the audio device, each sensor respectively acquiring data according to a respective sampling frequency and storing the acquired data in the corresponding storage unit, each sensor being configured to determine that data needs to be transmitted when the amount of data in the corresponding storage unit reaches a respective preset value; or after completing the respective preset number of data acquisitions, determining that data needs to be transferred.

7. The audio device of claim 1, wherein the synchronization process is an interpolation process.

8. The audio device of claim 1, wherein a synchronization accuracy of the synchronization process is less than a clock period of a synchronization clock of the audio device.

9. The audio device of claim 1, wherein a clock frequency of a synchronous clock of the audio device is greater than a sampling frequency of sensors of the audio device.

10. The audio device of claim 1, wherein the sensor of the audio device is an acceleration sensor, a gyroscope, a digital microphone, a temperature sensor, a humidity sensor, a pressure sensor, or an infrared sensor.