CN113542479A

CN113542479A - Recording method, recording device, wireless earphone and storage medium

Info

Publication number: CN113542479A
Application number: CN202110846275.7A
Authority: CN
Inventors: 许逸君
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2021-07-26
Filing date: 2021-07-26
Publication date: 2021-10-22
Anticipated expiration: 2041-07-26
Also published as: CN113542479B; WO2023005412A1

Abstract

The application discloses a recording method, a recording device, a wireless earphone and a storage medium. The recording method comprises the following steps: acquiring wearing states of a first wireless earphone and a second wireless earphone; if the wearing state of the wireless earphones in the first wireless earphone and the second wireless earphone changes, adjusting a recording mode according to the wireless earphones in the wearing state in the first wireless earphone and the second wireless earphone; controlling a wireless earphone in a wearing state to acquire audio data; preprocessing audio data according to a recording mode; and transmitting the preprocessed audio data to the electronic equipment. The method can realize the acquisition and processing of the audio data according to the wearing state of each wireless earphone in the process of recording by using the wireless earphones, thereby ensuring the recording effect.

Description

Recording method, recording device, wireless earphone and storage medium

Technical Field

The present application relates to the field of audio processing, and more particularly, to a recording method, apparatus, wireless headset and storage medium.

Background

With the rapid progress of the technology level and the living standard, the wireless earphone is more and more widely applied due to the characteristics of convenient carrying and the like. Among them, True Wireless Stereo (TWS) headphones are more popular among users because they completely eliminate the trouble of wires and are more free to use. Current wireless headsets are typically provided with a microphone for the collection of sound in a recording scene. When the wireless earphone is used for recording, the adopted recording mode is usually fixed, and the recording mode is not flexible enough.

Disclosure of Invention

In view of the above problems, the present application provides a recording method, an apparatus, a wireless headset and a storage medium.

In a first aspect, an embodiment of the present application provides a recording method, which is applied to a first wireless headset, where the first wireless headset is connected to a second wireless headset and an electronic device, and both the first wireless headset and the second wireless headset are provided with audio acquisition devices, where the method includes: acquiring wearing states of the first wireless earphone and the second wireless earphone; if the wearing state of the wireless earphone in the first wireless earphone and the second wireless earphone changes, adjusting a recording mode according to the wireless earphone in the wearing state in the first wireless earphone and the second wireless earphone; controlling the wireless earphone in a wearing state to acquire audio data; preprocessing the audio data according to the recording mode; and transmitting the preprocessed audio data to the electronic equipment.

In a second aspect, an embodiment of the present application provides a sound recording device, which is applied to a first wireless headset, the first wireless headset is connected to a second wireless headset and an electronic device, the first wireless headset and the second wireless headset are both provided with an audio acquisition device, the device includes: the wireless earphone comprises a state acquisition module, a mode adjustment module, a data acquisition module, a data processing module and a data transmission module, wherein the state acquisition module is used for acquiring the wearing states of the first wireless earphone and the second wireless earphone; the mode adjusting module is used for adjusting a recording mode according to the wireless earphone in the wearing state in the first wireless earphone and the second wireless earphone if the wearing state of the wireless earphone in the first wireless earphone and the second wireless earphone changes; the data acquisition module is used for controlling the wireless earphone in a wearing state to acquire audio data; the data processing module is used for preprocessing the audio data according to the recording mode; the data transmission module is used for transmitting the preprocessed audio data to the electronic equipment.

In a third aspect, an embodiment of the present application provides a wireless headset, including: one or more processors; a memory; one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the sound recording method provided by the first aspect above.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a program code is stored in the computer-readable storage medium, and the program code may be called by a processor to execute the recording method provided in the first aspect.

According to the scheme, the wearing state of the first wireless earphone and the wearing state of the second wireless earphone are obtained through the first wireless earphone, if the wearing state of at least one wireless earphone in the first wireless earphone and the second wireless earphone changes, the recording mode is adjusted according to the wireless earphones in the wearing states in the first wireless earphone and the second wireless earphone, and the recording mode comprises a single-channel recording mode or a double-channel recording mode. Therefore, the recording mode can be controlled according to the wearing states of the first wireless earphone and the second wireless earphone in the recording process, and the obtained audio data is correspondingly processed, so that the recording mode is matched with the wearing states, the flexibility of the recording mode is improved, and the recording effect is guaranteed.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic diagram illustrating an application environment provided by an embodiment of the present application.

Fig. 2 shows another schematic diagram of an application environment provided by the embodiment of the present application.

Fig. 3 shows another schematic diagram of an application environment provided by the embodiment of the present application.

Fig. 4 shows a flow chart of an encoding control method according to an embodiment of the present application.

Fig. 5 shows a schematic structural diagram of a wireless headset according to an embodiment of the present application.

Fig. 6 shows a schematic diagram of an application scenario provided in an embodiment of the present application.

Fig. 7 shows a flow chart of an encoding control method according to another embodiment of the present application.

Fig. 8 shows a flow chart of an encoding control method according to yet another embodiment of the present application.

Fig. 9 shows a schematic diagram of an application scenario provided in another embodiment of the present application.

Fig. 10 shows another schematic diagram of an application scenario provided in another embodiment of the present application.

Fig. 11 shows a flowchart of step S340 in the encoding control method according to another embodiment of the present application.

Fig. 12 shows a schematic diagram of a synchronized audio acquisition provided by yet another embodiment of the present application.

Fig. 13 shows a flow chart of an encoding control method according to yet another embodiment of the present application.

Fig. 14 shows a flow chart of an encoding control method according to yet another embodiment of the present application.

Fig. 15 shows a schematic diagram of a monaural recording provided by another embodiment of the present application.

FIG. 16 shows a block diagram of an encoding control apparatus according to an embodiment of the present application.

Fig. 17 is a block diagram of a wireless headset for performing a coding control method according to an embodiment of the present application.

Fig. 18 is a storage unit for storing or carrying program codes for implementing the encoding control method according to the embodiment of the present application.

Detailed Description

In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.

Electronic devices (such as smart phones and tablet computers) have become one of the most common consumer electronic products in daily life, and with the development of wireless communication technology, wireless headsets are increasingly widely used due to the characteristics of convenience in carrying and the like when users record sounds by using the electronic devices. Among them, a True Wireless Stereo (TWS) headset has an increasing share in the headset market due to its excellent characteristics of being more comfortable to wear, convenient to use, unobtrusive, smaller and more beautiful.

Binaural stereo recording (Binaural Audio) is a recording technique that highly restores the real sense of hearing by providing microphones at the positions of both ears of an artificial head so that sound arriving at the position of each ear can be captured and both signals can be reproduced separately at each ear. This reproduction is not suitable for monophonic playback, and if the desired effect is not achieved by speaker playback, headphones are often used to completely separate the sound signals received by the two ears, which allows the artificial head to completely reproduce the content heard by the listener.

When the binaural stereo recording is realized, microphones (microphones, MIC) respectively arranged on two earphones of the TWS earphone can be used for receiving sound, and the effect of the binaural recording technology can be achieved. However, during the recording, the user may not always keep wearing both ears, and thus, there may be a case where the wearing is switched from one ear wearing to two ears wearing and vice versa. If the user still uses the two ears to receive sound when taking off a single earphone, the sound field picked up by the earphone taken off and the earphone worn at the moment is not consistent with the actual sound field, so that the recorded sound field effect is deviated; in the single-ear wearing process, if the user wears another earphone and still records the monaural audio, the user experience is affected because the user cannot record the audio with the binaural recording effect even if the user wears the earphones with both ears.

In view of the above problems, the inventor provides a recording method, an apparatus, a wireless headset and a storage medium provided in this embodiment of the present application, which can control a recording mode according to wearing states of a first wireless headset and a second wireless headset, and perform corresponding processing on acquired audio data, so that the recording mode is matched with the wearing states, thereby improving flexibility of the recording mode and ensuring a recording effect.

Before introducing the coding control method of the embodiment of the present application, an application environment corresponding to the coding control method is introduced. As shown in fig. 1, an application environment corresponding to the encoding control method includes a sound recording system 10, where the sound recording system 10 includes an electronic device 11, a first wireless headset 12, and a second wireless headset 13. The electronic device 11 may be a smart phone, a tablet computer, an electronic book, a smart wearable device, or the like, which is capable of running an application program and has a function of collecting an audio signal. The first Wireless earphone 12 and the second Wireless earphone 13 form a True Wireless Stereo (TWS) earphone, wherein the left and right earphones of the TWS earphone are independent from each other and do not need to be connected by cables, and Wireless separation of left and right sound channels can be realized. In the embodiment of the present application, the sounds of the left and right channels can be collected by the first wireless earphone 12 and the second wireless earphone 13, respectively.

In the embodiment of the present application, an application program capable of acquiring audio is installed in the electronic device 11, and specifically, the application program may be audio playing software, video playing software, or call software, or other software capable of triggering audio playing. An audio acquisition device, such as a microphone, may be disposed in each of the first wireless headset 12 and the second wireless headset 13. The first wireless headset 12 and the second wireless headset 13 may be provided with an audio capturing device to capture audio signals, and the electronic device 11 may process the audio signals to generate audio files. Of course, the electronic device 11 may also send the audio to be played to at least one of the first wireless headset 12 and the second wireless headset 13, and play the voice by at least one of the first wireless headset 12 and the second wireless headset 13.

As an embodiment, as shown in fig. 2, the electronic device 11 can be connected to the first wireless headset 12 and the second wireless headset 13 at the same time. The first wireless headset 12 and the second wireless headset 13 can directly transmit audio data to the electronic device 11, or receive and play audio data transmitted by the electronic device 11.

As another embodiment, as shown in fig. 3, the electronic device 11 is connected to the first wireless headset 12 through bluetooth, and then the first wireless headset 12 is connected to the second wireless headset 13 through bluetooth, so that the electronic device 11, the first wireless headset 12 and the second wireless headset 13 are connected simultaneously through networking, that is, the first wireless headset 12 serves as a relay for the electronic device 11 and the second wireless headset 13.

In the embodiment of the present application, the electronic device 11, the first wireless headset 12 and the second wireless headset 13 are connected in the manner shown in fig. 3, so that the first wireless headset 12 can be used as a master headset, and the second wireless headset 13 can be used as a slave headset.

Referring to fig. 4, fig. 4 is a flowchart illustrating a coding control method according to an embodiment of the present application. In a specific embodiment, the encoding method may be applied to the above-mentioned sound recording system, and specifically, the execution subject of the method may be a first wireless earphone, the first wireless earphone and the second wireless earphone are both provided with audio acquisition devices, and the first wireless earphone and the second wireless earphone adopt the connection manner shown in fig. 4. As will be described in detail with respect to the flow shown in fig. 4, the encoding control method may specifically include the following steps:

step S110: acquiring wearing states of the first wireless earphone and the second wireless earphone.

In the embodiment of the application, when two wireless earphones of the TWS earphone are used for recording, the wearing state of the user on the wireless earphones may be changed, and if a fixed recording mode is adopted in the recording process, the recording effect may be affected. Therefore, when recording, the first wireless earphone (main earphone) connected with the electronic device can acquire the wearing states of the first wireless earphone and the second wireless earphone so as to control the recording mode.

In some embodiments, as shown in fig. 5, a wear detector 121 is disposed on the housing of the first wireless headset 12, and the wear detector 12 is disposed on a designated surface of the housing of the first wireless headset 12, the designated surface being a surface of the headset that contacts the concha cavity of the human ear when the first wireless headset 12 is worn. Optionally, a black circular hole may be formed in the designated surface, a wearing detector 121 is assembled in the circular hole, the wearing detector 121 may be a light-sensitive sensor and include a light-emitting unit and a light-sensing unit, the light-emitting unit may be an LED lamp, the LED lamp emits infrared light, the infrared light penetrates through a prism sheet on the circular hole, the infrared light radiates out of the ear phone, if an opaque object is in front of the ear phone, most of the infrared light is reflected back, and the light-sensing unit determines whether an object is blocked according to the intensity of the reflected light, so as to infer whether the wearing state is present. Similarly, the second wireless headset 12 may also be provided with a wear detector, and determine whether the second wireless headset 12 is in a worn state based on the wear detector. Of course, the specific type of the wearing detector may not be limited, and the wearing detector may be a touch sensor, a pressure sensor, or the like.

In this embodiment, a state threshold corresponding to the wearing detector may be set in advance, and the detection value detected by the wearing detector may be compared with the state threshold, and whether the wireless headset is in the wearing state may be determined according to the comparison result. For example, when the wearing detector is a light sensor, the state threshold is a set light intensity threshold, and if the light intensity detected by the light sensor is lower than the set light intensity threshold, it is determined that the wireless headset is in a wearing state; and if the light intensity detected by the light sensor is greater than or equal to the set light intensity threshold value, determining that the wireless earphone is not in a wearing state.

In some embodiments, when the first wireless headset acquires the wearing states of the first wireless headset and the second wireless headset, the first wireless headset may detect the wearing state of the first wireless headset and acquire the wearing state detected by the second wireless headset from the second wireless headset. That is, the first wireless earphone and the second wireless earphone can simultaneously detect the wearing state, and the second wireless earphone synchronizes the detection result to the first wireless earphone after detecting the wearing state of the second wireless earphone.

In some embodiments, when recording, the first wireless earphone may acquire the wearing states of the first wireless earphone and the second wireless earphone in real time, so as to control subsequent recording according to the wearing states; the first wireless headset may acquire the wearing states of the first wireless headset and the second wireless headset according to the set frequency, for example, the first wireless headset may acquire the wearing states of the first wireless headset and the second wireless headset every 1 second.

Step S120: and if the wearing state of the wireless earphones in the first wireless earphone and the second wireless earphone changes, adjusting a recording mode according to the wireless earphones in the wearing state in the first wireless earphone and the second wireless earphone.

In the embodiment of the application, after acquiring the wearing states of the first wireless earphone and the second wireless earphone, the first wireless earphone can determine whether the wearing states of the first wireless earphone and the second wireless earphone are changed; if the wearing state of the wireless earphone in the first wireless earphone and the second wireless earphone changes, the recording mode can be adjusted. It can be understood that, when the wireless earphone is in the wearing state, the user may expect the worn earphone to be in the using state and collect sound, and the wireless earphone that is not in the wearing state is not in use, and in the state of wearing by one ear, the wireless earphone that is in the wearing state and the wireless earphone that is not in the wearing state simultaneously collect audio data, so as to implement binaural recording, which easily causes sound field inconsistency and deviation, and affects the recording effect.

In some embodiments, the recording mode may include a mono recording mode and a binaural recording mode. When the wearing state of the wireless headset changes, adjusting the recording mode according to the wireless headset in the wearing state in the first wireless headset and the second wireless headset may include: if the first wireless earphone and the second wireless earphone are both in a wearing state, adjusting the recording mode to be a dual-channel recording mode; if one of the first wireless earphone and the second wireless earphone is not in a wearing state, the recording mode is adjusted to be a single-channel recording mode. It is understood that the mono recording mode is adopted when one of the wireless earphones is in the wearing mode, and the binaural recording mode is adopted when both of the wireless earphones are in the wearing mode.

In some embodiments, the recording mode may include three or more channels of recording modes in addition to a mono recording mode and a binaural recording mode. When the recording mode is a recording mode with three or more sound channels, the audio data collected by the at least one wireless earphone can be used as the audio data of the at least two sound channels. For example, in a three-channel recording mode, the audio data collected by the first wireless headset may be used as the audio data of two channels, and the audio data collected by the second wireless headset may be used as the audio data of the other channel.

Step S130: and controlling the wireless earphone in the wearing state to collect audio data.

In this embodiment of the application, after the first wireless headset determines the recording mode, the first wireless headset may further control the wireless headset in a wearing state to acquire audio data based on the wearing states of the first wireless headset and the second wireless headset.

In some embodiments, at least one of the first wireless headset and the second wireless headset is in a wearing state (i.e., a state of being worn by both ears or a state of being worn by one ear), and the wireless headset in the wearing state is controlled to perform audio data acquisition, and the wireless headset not in the wearing state is controlled not to perform audio data acquisition. It can be understood that, when the wireless headset is in a wearing state, the user may expect the worn headset to be in a using state to collect sound, and therefore, the wireless headset in the wearing state may be controlled to collect audio data; the wireless earphone which is not worn is probably not used by a user, and in a state of being worn by a single ear, the wireless earphone which is worn and the wireless earphone which is not worn simultaneously acquire audio data, so that the sound field is easy to be inconsistent and deviated, the recording effect is influenced, and the wireless earphone which is not worn can be controlled not to acquire the audio data.

Step S140: and preprocessing the audio data according to the recording mode.

In this embodiment, the first wireless earphone may also perform preprocessing on audio data acquired in a recording process according to a recording mode.

In some embodiments, if the recording mode is a binaural recording mode, the first wireless earphone and the second wireless earphone simultaneously acquire audio data, and at this time, the audio data of two channels can be acquired, so that processing corresponding to binaural recording can be performed. Specifically, the audio data collected by the first wireless headset and the second wireless headset may be merged to obtain merged audio data for sending to the electronic device. If the recording mode is a mono recording mode, only one of the first wireless earphone and the second wireless earphone collects audio data, and at this time, only audio data of one channel can be obtained, and then the collected audio data is processed corresponding to mono recording, for example, a mono flag may be added, so that the electronic device can know that the audio data sent by the first wireless earphone is mono audio data.

In some embodiments, if the first wireless headset and the second wireless headset simultaneously acquire audio data, the second wireless headset may transmit the acquired audio data to the first wireless headset, and the first wireless headset performs pre-processing corresponding to a recording mode on the audio data acquired by the first wireless headset and the audio data transmitted by the second wireless headset to obtain processed audio data. If the first wireless earphone collects the audio data and the second wireless earphone does not collect the audio data, the first wireless earphone can preprocess the collected audio data in a recording mode to obtain the processed audio data. And if the first wireless earphone does not collect the audio data, the second wireless earphone collects the audio data, at the moment, the first wireless earphone only serves as a relay earphone, the audio data transmitted by the second wireless earphone is preprocessed in a corresponding recording mode to obtain processed audio data, and the processed audio data is transmitted to the electronic equipment subsequently.

Step S150: and transmitting the preprocessed audio data to the electronic equipment.

In this embodiment of the application, after the first wireless headset preprocesses the acquired audio data, the preprocessed audio data may be transmitted to the electronic device, so that the electronic device generates an audio file according to the received audio data. Specifically, the audio file may be generated by performing operations such as encoding or optimization processing on the audio data, and the specified audio format may be MP3, WAV, FLC, and the like, and the specific audio format may not be limited.

In some embodiments, after the first wireless earphone transmits the processed audio data to the electronic device, the wireless communication module (e.g., bluetooth module, etc.) of the electronic device receives the audio data packet, decodes the audio data packet into PCM data, and sends the PCM data to a post-processing algorithm module, which may be a module in the application processor AP, and adjusts the gain adjustment process and the frequency process to output a file of the MP3 to the recorded APK. From this, set up the process of aftertreatment in electronic equipment one side, not only can guarantee the recording effect, can also reduce wireless earphone's consumption.

The gain adjustment process includes a gain increase operation and a Dynamic Range adjustment (DRC), wherein the gain increase operation includes a gain increase for the entire frequency domain or time domain portion of the audio signal of the target sound source, and the Dynamic Range adjustment is used to dynamically adjust the audio output amplitude, suppress the volume within a certain Range when the volume is large, and appropriately raise the volume when the volume is small. Are commonly used to control the audio output power so that the speaker does not break and is clearly audible when played at low volume. The frequency processing is used for processing different frequency parts of an audio signal of a target sound source, such as EQ and noise reduction, wherein EQ is called equal in english, that is, an equalizer, and is used for performing gain or attenuation on one or more frequency bands of the audio signal, so as to achieve the purpose of adjusting timbre. The noise reduction may be filtering, that is, filtering signals of a partial frequency band in the audio signal, and the like, so as to reduce noise in the audio signal.

In some embodiments, the process of performing post-processing on the audio data by the electronic device in the previous embodiment may also be provided in the wireless headset, wherein the first wireless headset may also perform the above-mentioned post-processing in the pre-processing process in step S140, so as to ensure the recording effect. Optionally, the first wireless headset may obtain a current remaining power, and if the remaining power is greater than the power threshold, it indicates that the current remaining power is sufficient, so that the above post-processing may be performed. When the above post-processing is performed by the wireless headset, the first wireless headset may further add a corresponding processing flag to the processed audio data, so that the electronic device knows that the audio data has been post-processed, thereby reducing the processing amount of the electronic device.

In some embodiments, when the first wireless headset transmits the acquired audio data to the electronic device, since the wireless headset acquiring the audio data encodes the audio data after acquiring the audio data, the first wireless headset may further add code rate information to the audio data, so that after the electronic device receives the audio data, the electronic device may obtain the code rate of the audio data according to the code rate information, and thus when the audio data is further processed to generate an audio file, the sampling rate, bit information, strength of compressed data, and the like during processing may be adjusted according to the code rate.

In some embodiments, in addition to controlling the wireless headset in a wearing state to collect audio data, the wireless headset not in the wearing state may also collect audio data when a set state condition is satisfied. Optionally, the first wireless earphone and the second wireless earphone are both in a wearing state, that is, in a state of being worn by both ears, and both the first wireless earphone and the second wireless earphone can collect audio data, that is, collect audio data of both channels; and when only one of the first wireless earphone and the second wireless earphone is in a wearing state, controlling the wireless earphone in the wearing state to acquire audio data, and when the wireless earphone not in the wearing state meets a set state condition, acquiring the audio data, wherein the audio data may be acquired by a single channel or not. Optionally, the setting of the state condition may include: the spatial position of the wireless earphone which is not in the wearing state relative to the wireless earphone in the wearing state meets the set position condition. The position condition may be set based on a relative spatial position that may exist between the wireless earphones when the user wears the first wireless earphone and the second wireless earphone, and understandably, when the user wears the first wireless earphone and the second wireless earphone, the relative spatial position between the two wireless earphones may change along with the movement or the head rotation of the user, so that the relative spatial position that exists between the two wireless earphones in a state of wearing the ears may be obtained, and the position condition may be determined. When the spatial position of the wireless headset not in the worn state relative to the wireless headset in the worn state satisfies the set position condition, although one of the wireless headsets is not in the worn state, the recorded sound field also matches the sound field during binaural recording, and therefore, the audio data can also be acquired. Optionally, the setting of the state condition may include: the second wireless headset is in a handheld state. It will be appreciated that in some scenarios, as shown in fig. 6, the possible recording scenario is an interview scenario, in which case interviewer a may wear the first wireless headset 12, and interviewee B may hold the second wireless headset 13 to gather the voice of interviewee B. Accordingly, it may be determined whether the second wireless headset is in a handheld state to confirm whether the second wireless headset needs to be controlled to capture audio data. Optionally, a surface of the ear stem of the second wireless headset may be provided with a touch sensor to determine whether the second wireless headset is in a handheld state based on data detected by the touch sensor.

According to the recording method provided by the embodiment of the application, in the recording process, when the wearing states of the wireless earphones in the first wireless earphone and the second wireless earphone change, the recording mode is adjusted, the wireless earphones for collecting audio data are controlled, the collected audio data are preprocessed according to the recording mode, the recording mode is matched with the wearing states, the flexibility of the recording mode is improved, and the recording effect is guaranteed.

Referring to fig. 7, fig. 7 is a flowchart illustrating a recording method according to another embodiment of the present application. The recording method is applied to the first wireless headset, and as will be described in detail with reference to the flow shown in fig. 7, the recording method may specifically include the following steps:

step S210: acquiring wearing states of the first wireless earphone and the second wireless earphone.

Step S220: and if the wearing state of the wireless earphones in the first wireless earphone and the second wireless earphone changes, adjusting a recording mode according to the wireless earphones in the wearing state in the first wireless earphone and the second wireless earphone.

In the embodiment of the present application, step S210 and step S220 may refer to the contents of the foregoing embodiments, and are not described herein again.

Step S230: and if the first wireless earphone is in a wearing state and the second wireless earphone is not in the wearing state, controlling the first wireless earphone to acquire audio data.

In this embodiment of the application, after the first wireless headset acquires the wearing states of the first wireless headset and the second wireless headset, if the first wireless headset is in the wearing state and the second wireless headset is not in the wearing state, the first wireless headset may be controlled to collect audio data, and the second wireless headset does not collect audio data. It can be understood that, when the second wireless earphone is not worn, if the first wireless earphone and the second wireless earphone simultaneously acquire audio data, and binaural recording is performed, the recorded sound field may not coincide with the recorded sound field, and a sound field deviation may occur.

Step S240: and if the first wireless earphone and the second wireless earphone are both in a wearing state, controlling the first wireless earphone and the second wireless earphone to acquire audio data.

In this embodiment of the application, after the first wireless headset acquires the wearing states of the first wireless headset and the second wireless headset, if the first wireless headset and the second wireless headset are both in the wearing states, the TWS headset is in a state of being worn by two ears, and at this time, the first wireless headset and the second wireless headset may be controlled to both acquire audio data, so as to achieve an effect of binaural recording.

In some embodiments, after the first wireless headset acquires the wearing states of the first wireless headset and the second wireless headset, if the first wireless headset is not in the wearing state and the second wireless headset is in the wearing state, at this time, since the first wireless headset is a main headset connected to the electronic device and the current main headset is not in the wearing state, the main headset may be switched to be the second wireless headset, and the second wireless headset is used for collecting audio data, so as to reduce transmission time of the audio data.

Step S250: and preprocessing the audio data according to the recording mode.

Step S260: and transmitting the preprocessed audio data to the electronic equipment.

In the embodiment of the present application, step S250 and step S260 may refer to contents of other embodiments, which are not described herein again.

The recording method provided by the embodiment of the application adjusts the recording mode according to the change of the wearing state of the wireless earphone in the recording process, controls the two to simultaneously acquire audio data when the two are in the wearing state, controls the first wireless earphone as the main earphone to be in the wearing state, controls the first wireless earphone to only acquire the audio data when the second wireless earphone is not in the wearing state, enables the recording mode to be matched with the wearing state, improves the flexibility of the recording mode, and ensures the recording effect.

Referring to fig. 8, fig. 8 is a flowchart illustrating a recording method according to another embodiment of the present application. The recording method is applied to the wireless headset, and will be described in detail with reference to the flow shown in fig. 8, and the recording method may specifically include the following steps:

step S310: acquiring wearing states of the first wireless earphone and the second wireless earphone.

Step S320: and if the wearing state of the wireless earphones in the first wireless earphone and the second wireless earphone changes, adjusting a recording mode according to the wireless earphones in the wearing state in the first wireless earphone and the second wireless earphone.

In the embodiment of the present application, step S310 and step S320 may refer to the contents of the foregoing embodiments, and are not described herein again.

Step S330: and if the first wireless earphone is in a wearing state and the second wireless earphone is not in the wearing state, controlling the first wireless earphone to acquire audio data.

In the embodiment of the application, in the recording process, if the first wireless earphone is in a wearing state and the second wireless earphone is changed from the wearing state to an unworn state, the recording can be performed in a mono recording mode, at this time, the first wireless earphone can be controlled to acquire audio data, and the second wireless earphone does not acquire audio data, so that the recorded sound field is prevented from deviating and the recording effect is prevented from being affected. In this case, the mode is directly switched to the monaural recording mode, and the first wireless headset continues to acquire audio data, so that no delay or interruption occurs.

Step S340: and if the first wireless earphone is in a wearing state and the second wireless earphone is changed from a non-wearing state to a wearing state, controlling the first wireless earphone to collect audio data.

In the embodiment of the application, in the recording process, after the first wireless earphone acquires the wearing states of the first wireless earphone and the second wireless earphone, if the first wireless earphone is in the wearing state and the second wireless earphone is not in the wearing state, the first wireless earphone is controlled to acquire audio data, and at this time, the mode is a mono recording mode. Moreover, when the first wireless earphone is in a wearing state and the second wireless earphone is changed from a non-wearing state to a wearing state, the two-channel recording is required, at this time, the first wireless earphone can be kept to collect the audio data, and the second wireless earphone is required to be controlled to collect the audio data.

In some scenarios, as shown in fig. 9, a user wears the first wireless headset 12 and the second wireless headset 13 at the same time to record, and at this time, the first wireless headset and the second wireless headset simultaneously collect audio data to realize binaural recording; as shown in fig. 10, after the user takes off the second wireless headset 13, the user can only control the first wireless headset 12 to collect audio data, thereby realizing monaural recording.

Step S350: and acquiring synchronous information for synchronizing the audio data collected by the first wireless earphone and the second wireless earphone, wherein the synchronous information is used for synchronizing the collected audio data by the first wireless earphone and the second wireless earphone.

In this embodiment of the application, when the first wireless headset is in a wearing state and the second wireless headset is changed from a non-wearing state to a wearing state, since the second wireless headset does not acquire audio data before, in order to ensure that the audio data of the dual channels are recorded, the audio data of the dual channels in the audio data subsequently sent to the electronic device are synchronized, that is, the audio data of the dual channels in the audio data sent to the electronic device are simultaneously acquired, so that the audio data acquired by the first wireless headset and the second wireless headset can be synchronized. Specifically, the first wireless headset may acquire synchronization information for synchronizing audio data acquired by the first wireless headset and the second wireless headset, where the synchronization information is used for synchronizing the acquired audio data by the first wireless headset and the second wireless headset, so as to ensure that the two-channel audio data in the audio data sent to the electronic device is the audio data acquired at the same time.

In some embodiments, referring to fig. 11, acquiring synchronization information for synchronizing the first wireless headset and the second wireless headset to acquire audio data may include:

step S351: and acquiring the synchronous time of the first wireless earphone and the second wireless earphone for audio data acquisition, wherein the synchronous time is used for controlling the time of starting audio data acquisition by the second wireless earphone.

In this embodiment, the first wireless earphone may acquire the synchronization time of the first wireless earphone and the audio data acquisition of the second wireless earphone, so that the second wireless earphone controls when it starts recording, and the first wireless earphone may subsequently know when the audio data acquired by the second wireless earphone starts recording, thereby ensuring the synchronization of the audio data acquired by the first wireless earphone and the second wireless earphone.

Optionally, acquiring the synchronization time of the first wireless headset and the second wireless headset for audio data acquisition may include: acquiring the time length required by the second wireless earphone for starting recording as a first time length; acquiring time length for sending synchronization information to be generated to the second wireless earphone as second time length; and generating the synchronization time based on the current time, the first time length and the second time length. In this way, when the first wireless headset determines the above synchronization time, the time length that the second wireless headset needs to spend for starting the recording process, for example, the process of starting the microphone and setting the encoder, etc., can be obtained; and after the subsequent determined synchronization information can be obtained, the synchronization information is sent to the time length of the second wireless earphone, and then the first time length and the second time length are added on the basis of the current time, so that the synchronization time (time) of the synchronous recording is obtained. That is to say, at the synchronization time, the second wireless headset collects the audio data, and the first wireless headset can also know the audio data collected after the time point of the synchronization time, so that the first wireless headset can subsequently compare and combine the audio data sent when the second wireless headset starts recording with the audio data collected by the first wireless headset, and send the audio data to the electronic device, thereby ensuring that the time of collecting the dual-channel audio data sent to the electronic device by the wireless headset is consistent.

Step S352: and acquiring the data packet sequence numbers of the synchronous audio data packets of the first wireless earphone and the second wireless earphone, wherein the data packet sequence numbers are used for the second wireless earphone to number the acquired audio data packets.

In this embodiment, since the wireless headset usually encodes the collected audio data into different data packets when collecting the audio data, the first wireless headset may number the obtained data packets during the recording process. When the second wireless earphone changes from the unworn state to the worn state, the sequence numbers of the data packets of the synchronous audio data packets of the first wireless earphone and the second wireless earphone can be acquired, so that the audio data packets acquired at the same time by the second wireless earphone are numbered as the sequence numbers of the audio data packets acquired at the same time by the first wireless earphone.

Optionally, the first wireless headset may obtain, based on the packet sequence number of the currently acquired audio data and the synchronization time, the packet sequence number obtained by numbering the acquired audio data packet at the synchronization time of the first wireless headset, as the packet sequence numbers of the synchronized audio data packets of the first wireless headset and the second wireless headset. The first wireless earphone can obtain the speed of the data packet according to the synchronous time and the data packet sequence number and the coded audio data, and pre-estimate the sequence number after numbering the audio data packet at the synchronous time.

Step S353: generating the synchronization information based on the synchronization time and the packet sequence number.

After the synchronization time and the packet sequence number are obtained, synchronization information may be generated based on the synchronization time and the packet sequence number, and the synchronization information includes the synchronization time and the packet sequence number.

Of course, when the first wireless headset and the second wireless headset synchronize the collected audio data in other manners, the corresponding synchronization information may be generated according to the other manners adopted.

Step S360: and sending the synchronization information to the second wireless earphone, wherein the second wireless earphone is used for collecting audio data according to the synchronization information.

In this embodiment of the application, after the first wireless headset generates the synchronization information, the synchronization information may be sent to the second wireless headset, after the second wireless headset receives the synchronization information, when the second wireless headset controls to collect audio data according to the synchronization information, after the second wireless headset sends the first audio data packet that starts to be recorded to the first wireless headset, the first wireless headset may know when the audio data packet that is sent by the second wireless headset starts to be recorded, and determine the audio data packet corresponding to the audio data packet in the audio data packet that is collected by the first wireless headset, so that when the audio data of the two channels is sent to the electronic device, the synchronization of the audio data of the two channels is maintained.

In some embodiments, when the synchronization information includes synchronization time and a packet sequence number, an audio time stamp and a packet sequence number may be simultaneously carried in an audio data packet obtained by the first wireless earphone and the second wireless earphone according to the acquired audio data, and after the first audio data packet recorded at the beginning is sent to the first wireless earphone by the subsequent second wireless earphone, the first wireless earphone may compare the audio data packet generated by the first wireless earphone with the audio time stamp and the packet sequence number of the first audio data packet, thereby achieving synchronization of the audio data of the two channels.

In some embodiments, the second wireless headset, when not worn, acts as a slave headset, and may be disconnected from the master headset (first wireless headset) to reduce power consumption since it does not currently require audio data collection. Referring to fig. 12, after the slave earphone is in a wearing state, a connection can be established with the master earphone; then, the master earphone acquires the synchronization time and the data packet serial number N, and sends the synchronization time and the data packet serial number to the slave earphone as synchronization information, wherein N is a positive integer; the slave earphone sets the starting time of the encoder according to the synchronous time so as to control the slave earphone to start to collect audio data and encode the audio data at the synchronous time; after the slave earphone acquires the first audio data packet, numbering the first audio data packet as a data packet sequence number N in the synchronous information, and sending the data packet sequence number N to the master earphone; and the master earphone carries out synchronization according to the audio data packet with the data packet sequence number N in the audio data packets generated by the master earphone and the slave earphone.

Step S370: and preprocessing the audio data according to the recording mode.

Step S380: and transmitting the preprocessed audio data to the electronic equipment.

In the embodiment of the present application, step S370 and step S380 may refer to contents of other embodiments, which are not described herein again.

According to the recording method provided by the embodiment of the application, in the recording process, the first wireless earphone serving as the main earphone adjusts the recording mode according to the wearing states of the first wireless earphone and the second wireless earphone when the wearing states change, and controls the wireless earphone for collecting audio data, so that the recording mode is matched with the wearing states, the flexibility of the recording mode is improved, and the recording effect is guaranteed. In addition, when the first wireless earphone is in a wearing state and the second wireless earphone is changed from a non-wearing state to a wearing state, the audio data acquisition synchronization between the two earphones is carried out, and the acquisition time synchronization of the audio data transmitted to the electronic equipment during binaural recording is ensured, so that the accuracy and the recording effect of the recording content are ensured.

Referring to fig. 13, fig. 13 is a schematic flowchart illustrating a recording method according to still another embodiment of the present application. The recording method is applied to the wireless headset, and will be described in detail with reference to the flow shown in fig. 13, and the recording method may specifically include the following steps:

step S410: acquiring wearing states of the first wireless earphone and the second wireless earphone.

Step S420: and if the wearing state of the wireless earphones in the first wireless earphone and the second wireless earphone changes, adjusting a recording mode according to the wireless earphones in the wearing state in the first wireless earphone and the second wireless earphone.

In the embodiment of the present application, step S410 and step S420 may refer to the contents of the foregoing embodiments, and are not described herein again.

Step S430: and if the first wireless earphone is changed from the wearing state to the non-wearing state and the second wireless earphone is in the wearing state, disconnecting the first wireless earphone from the electronic equipment.

In the embodiment of the application, in the recording process, after the first wireless headset acquires the wearing states of the first wireless headset and the second wireless headset, if the first wireless headset changes from the wearing state to the non-wearing state and the second wireless headset is in the wearing state, the second wireless headset is required to collect audio data, and the first wireless headset does not collect the audio data. Under the circumstance, if the first wireless earphone is still connected with the electronic equipment as the main earphone, the audio data collected by the second wireless earphone still needs to be transferred through the first wireless earphone, and the efficiency of transmitting the audio data to the electronic equipment is low. Therefore, when the first wireless earphone is detected to be changed from the wearing state to the non-wearing state and the second wireless earphone is detected to be in the wearing state, the connection with the electronic equipment can be disconnected.

Step S440: and sending a switching instruction to the second wireless earphone, wherein the switching instruction is used for indicating the second wireless earphone to be connected with the electronic equipment, acquiring audio data, and preprocessing the acquired audio data according to the recording mode and then transmitting the preprocessed audio data to the electronic equipment.

In this embodiment of the application, the first wireless headset may send a switching instruction to the second wireless headset while disconnecting from the electronic device, and after receiving the switching instruction, the second wireless headset may respond to the switching instruction, connect to the electronic device, collect audio data, and pre-process the collected audio data according to a recording mode and transmit the audio data to the electronic device, thereby implementing a monaural recording mode when the first wireless headset is taken off from an ear by a user and the second wireless headset is worn.

In some scenes, a user may only wear the first wireless earphone to record, and only control the first wireless earphone to collect audio data at the time, so as to realize mono sound recording; when the user takes off the first wireless headset and puts on the second wireless headset, and the first wireless headset is changed from the wearing state to the non-wearing state while the second wireless headset is in the wearing state, the processing of step S430 and step S440 is performed.

In some scenes, a user may wear a first wireless earphone to record at the same time, and at the moment, the first wireless earphone and a second wireless earphone are controlled to collect audio data at the same time, so that the dual-channel recording is realized; when the user takes off the first wireless headset and puts on the second wireless headset, and the first wireless headset is changed from the wearing state to the non-wearing state while the second wireless headset is in the wearing state, the processing of step S430 and step S440 is performed.

Step S450: and if the first wireless earphone is in a wearing state and the second wireless earphone is not in the wearing state, controlling the first wireless earphone to acquire audio data.

Step S460: and if the first wireless earphone and the second wireless earphone are both in a wearing state, controlling the first wireless earphone and the second wireless earphone to acquire audio data.

Step S470: and preprocessing the audio data according to the recording mode.

Step S480: and transmitting the preprocessed audio data to the electronic equipment.

In the embodiment of the present application, steps S450 to S480 may refer to contents of other embodiments, and are not described herein again.

According to the recording method provided by the embodiment of the application, in the recording process, the first wireless earphone serving as the main earphone adjusts the recording mode according to the wearing states of the first wireless earphone and the second wireless earphone when the wearing states change, and controls the wireless earphone for collecting audio data, so that the recording mode is matched with the wearing states, the flexibility of the recording mode is improved, and the recording effect is guaranteed. In addition, the second wireless earphone is in a wearing state, when the first wireless earphone is changed from the wearing state to the wearing state, the main earphone is switched to the second wireless earphone, so that the second wireless earphone does not need to transfer collected audio data to the electronic equipment, and the transmission efficiency of the audio data is improved.

Referring to fig. 14, fig. 14 is a schematic flowchart illustrating a recording method according to yet another embodiment of the present application. The recording method is applied to the wireless headset, and will be described in detail with reference to the flow shown in fig. 14, and the recording method may specifically include the following steps:

step S510: acquiring wearing states of the first wireless earphone and the second wireless earphone.

Step S520: and if the wearing state of the wireless earphones in the first wireless earphone and the second wireless earphone changes, adjusting a recording mode according to the wireless earphones in the wearing state in the first wireless earphone and the second wireless earphone.

Step S530: and controlling the wireless earphone in the wearing state to collect audio data.

In the embodiment of the present application, steps S510 to S530 may refer to the contents of the foregoing embodiments, and are not described herein again.

Step S540: and if the recording mode is a single-channel recording mode and the audio data is a first collected audio data packet, adding second indication information to the audio data to obtain a second target data packet, wherein the second indication information is used for indicating that the current single-channel recording mode is single-channel recording.

In some embodiments, when performing preprocessing corresponding to a mode of performing monaural recording on the obtained audio data, if the obtained third audio data packet is a first audio data packet collected by a wireless earphone collecting audio data in the first wireless earphone and the second wireless earphone, second indication information may be added to the third audio data packet to obtain a second target data packet, where the second indication information is used to indicate that the current audio data is monaural recording. Therefore, after the electronic device acquires the sent second target data packet, it can be known that the audio data acquired by the current first wireless earphone is the audio data of the single-channel recording, and therefore, the subsequent electronic device can copy the audio data as the audio data of another channel, that is, the two channels use the same data, and then generate an audio file according to the audio data of the two channels.

For example, referring to fig. 15, fig. 15 shows a principle of recording when the first wireless earphone is used as a main earphone to collect audio data, and the electronic device is a mobile phone to realize monaural recording. The main earphone can perform OPUS coding on audio data collected by the microphone, then place audio data packets obtained by coding into a main buffer area, and add the second indication information into a first audio data packet generated during monaural recording through the frame header information control module; the subsequent main earphone sends the audio data packet to the mobile phone Bluetooth after taking out the audio data packet from the main buffer area; before the mobile phone Bluetooth transmits the Audio data packet to the Audio, if the analyzed second indication information indicates that the Audio data packet is a single-channel recording, the data is copied to be used as another channel data, namely the left channel and the right channel use the same data, and then the processed data is transmitted to the mobile phone Audio module to generate an Audio file.

In other embodiments, if one of the first wireless headset and the second wireless headset collects audio data, the obtained audio data packet may also be used as dual-channel audio data, and the dual-channel audio data is synthesized to obtain a third target data packet. That is, the first wireless headset as a main headset may copy the obtained audio data packet as an audio data packet of another channel, that is, the two channels use the same audio data, and then combine the audio data packets into one data packet (third target data packet), and subsequently send the data packet to the electronic device.

Step S550: and if the recording mode is a dual-channel recording mode, storing a first audio data packet acquired by the first wireless earphone in a first buffer area, and storing a received second audio data packet acquired by the second wireless earphone in a second buffer area.

In this embodiment of the application, when the first wireless earphone and the second wireless earphone both collect audio data, buffer areas are disposed in the first wireless earphone and the second wireless earphone, where the buffer area in the first wireless earphone is a first buffer area and a second buffer area, and the buffer area in the second wireless earphone is a third buffer area. When the second wireless earphone is recording, the second audio data packet obtained by encoding the collected audio data can be put into a third buffer area; the first wireless headset may place the first audio data packet into the first buffer area, where the first audio data packet is obtained by encoding the acquired audio data. And after the second wireless earphone sends the second audio data packet in the third buffer area to the first wireless earphone, the first wireless earphone stores the second audio data packet in the second buffer area, and then the uplink data sending process is carried out.

Step S560: and merging the first audio data packet and the second audio data packet to obtain a first target data packet.

In this embodiment of the application, when sending the uplink data, the first wireless headset may take out the first audio data packet in the first buffer and the second audio data packet in the second buffer, and then send the same audio data packet after merging the first audio data packet and the second audio data packet to the electronic device.

In some embodiments, the first wireless headset and the second wireless headset both collect audio data, and when binaural recording is implemented, synchronization between audio data packets acquired by the first wireless headset and the second wireless headset needs to be ensured, that is, acquisition times corresponding to the first audio data packet and the second audio data packet that need to be combined by the first wireless headset need to be synchronized and consistent, so as to ensure authenticity of the combined audio data packets. Optionally, based on the first time stamp of the first audio data packet and the second time stamp of the second audio data packet, if the first time stamp is consistent with the second time stamp, the first audio data and the second audio data may be integrated into one audio data packet.

In other embodiments, the first wireless headset may synchronize the first audio data packet when binaural recording starts, that is, when the first wireless headset and the second wireless headset start to collect audio data simultaneously, and the subsequent audio data packets may be directly merged. If the first audio data packet and the second audio data packet are the first audio data packet in the recording process, comparing the first audio data packet with the second audio data packet according to the synchronous information in the first audio data packet and the second audio data packet; and if the first audio data packet is matched with the second audio data, merging the first audio data packet and the second audio data packet and then sending the merged first audio data packet and second audio data packet to the electronic equipment. For subsequently acquired audio data packets, the audio data packets respectively acquired by the first wireless earphone and the second wireless earphone can be merged according to the time sequence of acquisition and then transmitted to the electronic device.

In some embodiments, if the second audio data packet is a first audio data packet sent by the second wireless headset, the first audio data packet and the second audio data packet are merged, and the first indication information is added to obtain the first target data packet, where the first indication information is used to indicate that the current dual-channel recording is performed. Therefore, after the electronic equipment acquires the sent first target data packet, the electronic equipment can know that the current audio data acquired by the first wireless earphone is the audio data of the two-channel recording according to the first indication information, and then performs post-processing on the audio data to generate a corresponding audio file.

In some embodiments, under the condition that the first wireless earphone and the second wireless earphone simultaneously perform audio data acquisition, if the first wireless earphone determines that the first wireless earphone is changed from the wearing state to the non-wearing state according to the acquired wearing states of the first wireless earphone and the second wireless earphone, and the second wireless earphone is in the wearing state, the main earphone switching process described in the step S430 and the step S440 in the previous embodiment is executed, and during switching, when the first wireless earphone is disconnected, audio data in a buffer area of the first wireless earphone is not sent to the electronic device, so that the audio data is lost. For the problem, the first wireless earphone can send the audio data which is not sent to the electronic equipment to the second wireless earphone, when the second wireless earphone can disconnect the first wireless earphone from the electronic equipment, the audio data collected in the process of establishing connection with the electronic equipment by the second wireless earphone is cached, after the second wireless earphone is connected with the electronic equipment, the audio data sent by the first wireless earphone can be transmitted to the electronic equipment, and then the audio data collected in the switching process is transmitted to the electronic equipment, so that the audio data can not be lost when the main earphone is switched.

In this embodiment, when the second wireless headset establishes a connection with the electronic device, that is, when the switching of the main headset is completed, the bandwidth of the channel between the second wireless headset and the electronic device may be increased, and the transmission power of wireless communication between the second wireless headset and the electronic device may be increased, for example, the bluetooth transmission power may be increased, so that the audio data sent by the first wireless headset may be transmitted to the electronic device more quickly, and it is ensured that the subsequently acquired audio data may be transmitted to the electronic device in time.

Step S570: and transmitting the preprocessed audio data to the electronic equipment.

In the embodiment of the present application, step S570 may refer to the contents of other embodiments, which are not described herein again.

According to the recording method provided by the embodiment of the application, in the recording process, the first wireless earphone serving as the main earphone controls the wireless earphones for collecting the audio data according to the wearing states of the first wireless earphone and the second wireless earphone, so that the recording mode is matched with the wearing state, and after the wireless earphones for collecting the audio data are controlled, the corresponding processing of single-channel recording or double-channel recording is carried out according to the wireless earphones for collecting the audio data at present, and the matching of the recording mode and the wearing state is realized. The flexibility of the recording mode is improved, and the recording effect is guaranteed.

Referring to fig. 16, a block diagram of a recording apparatus 400 according to an embodiment of the present disclosure is shown. This recording device 400 is applied to first wireless headset, first wireless headset is connected with second wireless headset and electronic equipment, first wireless headset with second wireless headset all is provided with audio acquisition device. The recording apparatus 400 includes: a state acquisition module 410, a mode adjustment module 420, a data acquisition module 430, a data processing module 440, and a data transmission module 450. The state acquiring module 410 is configured to acquire wearing states of the first wireless headset and the second wireless headset; the mode adjustment module 420 is configured to adjust a recording mode according to a wireless earphone in a wearing state of the first wireless earphone and the second wireless earphone if the wearing state of at least one of the first wireless earphone and the second wireless earphone changes, where the recording mode includes a mono-channel recording mode or a binaural recording mode; the data acquisition module 430 is configured to control the wireless headset in a wearing state to acquire audio data; the data processing module 440 is configured to pre-process the audio data according to the recording mode; the data transmission module 450 is configured to transmit the preprocessed audio data to the electronic device.

In some embodiments, the mode adjustment module 420 may be configured to: if the wearing state of at least one of the first wireless earphone and the second wireless earphone changes, adjusting a recording mode according to the wireless earphone in the wearing state of the first wireless earphone and the second wireless earphone, wherein the recording mode comprises a single-channel recording mode or a double-channel recording mode.

In some embodiments, the data acquisition module 430 may be configured to: if the first wireless earphone is in a wearing state and the second wireless earphone is not in the wearing state, controlling the first wireless earphone to collect audio data; and if the first wireless earphone and the second wireless earphone are both in a wearing state, controlling the first wireless earphone and the second wireless earphone to acquire audio data.

In one possible implementation, the data acquisition module 430 may be configured to: if the first wireless earphone is in a wearing state and the second wireless earphone is changed from a non-wearing state to a wearing state, controlling the first wireless earphone to collect audio data; acquiring synchronous information for synchronizing the audio data collected by the first wireless earphone and the second wireless earphone, wherein the synchronous information is used for synchronizing the collected audio data by the first wireless earphone and the second wireless earphone; and sending the synchronization information to the second wireless earphone, wherein the second wireless earphone is used for collecting audio data according to the synchronization information.

In this embodiment, the acquiring of the synchronization information by the data acquiring module 430 for synchronizing the first wireless headset and the second wireless headset to acquire the audio data may include: acquiring the synchronous time of the first wireless earphone and the second wireless earphone for audio data acquisition, wherein the synchronous time is used for controlling the time of starting audio data acquisition by the second wireless earphone; acquiring data packet sequence numbers of the synchronous audio data packets of the first wireless earphone and the second wireless earphone, wherein the data packet sequence numbers are used for the second wireless earphone to number the acquired audio data packets; generating the synchronization information based on the synchronization time and the packet sequence number.

Optionally, the acquiring the synchronization time of the audio data acquisition by the first wireless headset and the second wireless headset by the data acquisition module 430 may include: acquiring the time length required by the second wireless earphone for starting recording as a first time length; acquiring time length for sending synchronization information to be generated to the second wireless earphone as second time length; and generating the synchronization time based on the current time, the first time length and the second time length.

Optionally, the acquiring the packet sequence numbers of the synchronized audio packets of the first wireless headset and the second wireless headset by the data acquiring module 430 may include: acquiring a data packet sequence number after numbering the acquired audio data packet when the first wireless earphone is in the synchronous time based on the data packet sequence number of the currently acquired audio data and the synchronous time, and taking the data packet sequence number as the data packet sequence number of the synchronous audio data packet of the first wireless earphone and the second wireless earphone

In some embodiments, the sound recording apparatus 400 may further include: a connection control module and a connection switching module. The connection control module is used for disconnecting the connection with the electronic equipment if the first wireless earphone is changed from a wearing state to a non-wearing state and the second wireless earphone is in a wearing state; the connection switching module is used for sending a switching instruction to the second wireless earphone, wherein the switching instruction is used for indicating the second wireless earphone to be connected with the electronic equipment, collecting audio data, and preprocessing the collected audio data according to the recording mode and then transmitting the preprocessed audio data to the electronic equipment.

In one possible implementation, the data processing module 430 may be configured to: if the recording mode is a dual-channel recording mode, storing a first audio data packet acquired by the first wireless earphone in a first buffer area, and storing a received second audio data packet acquired by the second wireless earphone in a second buffer area; and merging the first audio data packet and the second audio data packet to obtain a first target data packet.

Optionally, the data processing module 430 may be configured to: if the second audio data packet is a first audio data packet sent by the second wireless earphone, comparing the first audio data packet with the second audio data packet according to the synchronous information in the first audio data packet and the second audio data packet; and if the first audio data packet is matched with the second audio data packet, executing the merging of the first audio data packet and the second audio data packet to obtain a first target data packet.

Optionally, the data processing module 430 may be configured to: if the second audio data packet is a first audio data packet sent by the second wireless earphone, merging the first audio data packet and the second audio data packet, and adding first indication information to obtain a first target data packet, wherein the first indication information is used for indicating that the current audio data packet is a binaural recording.

In one possible implementation, the data processing module 430 may be configured to: and if the recording mode is a single-channel recording mode and the audio data is the first collected audio data packet, adding second indication information to the third audio data packet to obtain a second target data packet, wherein the second indication information is used for indicating that the current single-channel recording mode is adopted.

In one possible implementation, the data processing module 430 may be configured to: and if the recording mode is a single-channel recording mode, taking the audio data packet acquired by the first wireless earphone as the audio data of the double channels, and synthesizing the audio data of the double channels to obtain a third target data packet.

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, the coupling between the modules may be electrical, mechanical or other type of coupling.

In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.

To sum up, the scheme that this application provided acquires through first wireless earphone and the wearing state of second wireless earphone changes if the wearing state of at least one wireless earphone in first wireless earphone and the second wireless earphone, according to being in the wireless earphone of wearing state in first wireless earphone and the second wireless earphone, adjusts the recording mode, and the recording mode includes the mode of monophonic recording or the mode of binaural recording. Therefore, the recording mode can be controlled according to the wearing states of the first wireless earphone and the second wireless earphone in the recording process, and the obtained audio data is correspondingly processed, so that the recording mode is matched with the wearing states, the flexibility of the recording mode is improved, and the recording effect is guaranteed.

Referring to fig. 17, a block diagram of a wireless headset according to an embodiment of the present application is shown. The wireless headset 100 of the present application may include one or more of the following components: a processor 110, a memory 120, an audio capture device 130, a communication device 140, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by the one or more processors 110, the one or more programs configured to perform the methods as described in the foregoing method embodiments, the memory 120, the audio capture device 130, and the communication device 140 all connected to the processor 110. The audio capture device 130 may be a microphone and the communication device 140 may be a wireless communication device, such as a bluetooth communication module

Processor 110 may include one or more processing cores. The processor 110 interfaces with various components throughout the wireless headset 100 using various interfaces and lines to perform various functions of the wireless headset 100 and process data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 120 and invoking data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a communication chip.

The Memory 120 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The memory data area may also store data created by the wireless headset 100 during use (e.g., phone book, audio-video data, chat log data), etc.

Referring to fig. 18, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer-readable medium 800 has stored therein a program code that can be called by a processor to execute the method described in the above-described method embodiments.

The computer-readable storage medium 800 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 800 includes a non-volatile computer-readable storage medium. The computer readable storage medium 800 has storage space for program code 810 to perform any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code 810 may be compressed, for example, in a suitable form.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. A recording method is applied to a first wireless earphone, the first wireless earphone is connected with a second wireless earphone and an electronic device, the first wireless earphone and the second wireless earphone are both provided with audio acquisition devices, and the method comprises the following steps:

acquiring wearing states of the first wireless earphone and the second wireless earphone;

if the wearing state of the wireless earphone in the first wireless earphone and the second wireless earphone changes, adjusting a recording mode according to the wireless earphone in the wearing state in the first wireless earphone and the second wireless earphone;

controlling the wireless earphone in a wearing state to acquire audio data;

preprocessing the audio data according to the recording mode;

and transmitting the preprocessed audio data to the electronic equipment.

2. The method of claim 1, wherein the adjusting the recording mode according to the wireless headset in a wearing state of the first wireless headset and the second wireless headset comprises:

if the first wireless earphone and the second wireless earphone are both in a wearing state, adjusting a recording mode to be a dual-channel recording mode;

and if one of the first wireless earphone and the second wireless earphone is not in a wearing state, adjusting the recording mode to be a single-channel recording mode.

3. The method of claim 1, wherein the controlling the wireless headset in a worn state to capture audio data comprises:

if the first wireless earphone is in a wearing state and the second wireless earphone is not in the wearing state, controlling the first wireless earphone to collect audio data;

and if the first wireless earphone and the second wireless earphone are both in a wearing state, controlling the first wireless earphone and the second wireless earphone to acquire audio data.

4. The method of claim 3, wherein after the adjusting the recording mode according to the wireless headset in a worn state of the first wireless headset and the second wireless headset, the method further comprises:

if the first wireless earphone is changed from the wearing state to the non-wearing state and the second wireless earphone is in the wearing state, disconnecting the first wireless earphone from the electronic equipment;

and sending a switching instruction to the second wireless earphone, wherein the switching instruction is used for indicating the second wireless earphone to be connected with the electronic equipment, acquiring audio data, and preprocessing the acquired audio data according to the recording mode and then transmitting the preprocessed audio data to the electronic equipment.

5. The method of claim 3, wherein controlling the first wireless headset and the second wireless headset to capture audio data if the first wireless headset and the second wireless headset are both worn comprises:

if the first wireless earphone is in a wearing state and the second wireless earphone is changed from a non-wearing state to a wearing state, controlling the first wireless earphone to collect audio data;

acquiring synchronous information for synchronizing the audio data collected by the first wireless earphone and the second wireless earphone, wherein the synchronous information is used for synchronizing the collected audio data by the first wireless earphone and the second wireless earphone;

and sending the synchronization information to the second wireless earphone, wherein the second wireless earphone is used for collecting audio data according to the synchronization information.

6. The method of claim 5, wherein obtaining synchronization information for synchronizing the first wireless headset with the second wireless headset to capture audio data comprises:

acquiring the synchronous time of the first wireless earphone and the second wireless earphone for audio data acquisition, wherein the synchronous time is used for controlling the time of starting audio data acquisition by the second wireless earphone;

acquiring data packet sequence numbers of the synchronous audio data packets of the first wireless earphone and the second wireless earphone, wherein the data packet sequence numbers are used for the second wireless earphone to number the acquired audio data packets;

generating the synchronization information based on the synchronization time and the packet sequence number.

7. The method of claim 6, wherein the obtaining the synchronized time of the first wireless headset and the second wireless headset for audio data acquisition comprises:

acquiring the time length required by the second wireless earphone for starting recording as a first time length;

acquiring time length for sending synchronization information to be generated to the second wireless earphone as second time length;

and generating the synchronization time based on the current time, the first time length and the second time length.

8. The method of claim 6, wherein obtaining the packet sequence numbers of the first wireless headset and the second wireless headset synchronized audio packets comprises:

and acquiring a data packet sequence number after numbering the acquired audio data packet when the first wireless earphone is in the synchronous time based on the data packet sequence number of the currently acquired audio data and the synchronous time, and taking the data packet sequence number as the data packet sequence numbers of the synchronous audio data packets of the first wireless earphone and the second wireless earphone.

9. The method of any of claims 1-8, wherein the pre-processing the audio data according to the recording mode comprises:

if the recording mode is a dual-channel recording mode, storing a first audio data packet acquired by the first wireless earphone in a first buffer area, and storing a received second audio data packet acquired by the second wireless earphone in a second buffer area;

and merging the first audio data packet and the second audio data packet to obtain a first target data packet.

10. The method of claim 9, wherein before said combining the first audio packet and the second audio packet to obtain the first destination packet, the method further comprises:

if the second audio data packet is a first audio data packet sent by the second wireless earphone, comparing the first audio data packet with the second audio data packet according to the synchronous information in the first audio data packet and the second audio data packet;

and if the first audio data packet is matched with the second audio data packet, executing the merging of the first audio data packet and the second audio data packet to obtain a first target data packet.

11. The method of claim 9, wherein merging the first audio packet and the second audio packet to obtain a first destination packet comprises:

if the second audio data packet is a first audio data packet sent by the second wireless earphone, merging the first audio data packet and the second audio data packet, and adding first indication information to obtain a first target data packet, wherein the first indication information is used for indicating that the current audio data packet is a binaural recording.

12. The method of any of claims 1-8, wherein the pre-processing the audio data according to the recording mode comprises:

and if the recording mode is a single-channel recording mode and the audio data is a first collected audio data packet, adding second indication information to the audio data to obtain a second target data packet, wherein the second indication information is used for indicating that the current single-channel recording mode is single-channel recording.

13. The method of any of claims 1-8, wherein the pre-processing the audio data according to the recording mode comprises:

and if the recording mode is a single-channel recording mode, taking the audio data as the audio data corresponding to each channel in the double channels, and synthesizing the audio data corresponding to each channel to obtain a third target data packet.

14. The utility model provides a recording device, its characterized in that is applied to first wireless earphone, first wireless earphone is connected with second wireless earphone and electronic equipment, first wireless earphone with second wireless earphone all is provided with audio acquisition device, the device includes: a state acquisition module, a mode adjustment module, a data acquisition module, a data processing module and a data transmission module, wherein,

the state acquisition module is used for acquiring the wearing states of the first wireless earphone and the second wireless earphone;

the mode adjusting module is configured to adjust a recording mode according to a wireless earphone in a wearing state of the first wireless earphone and the second wireless earphone if the wearing state of at least one of the first wireless earphone and the second wireless earphone changes, where the recording mode includes a mono-channel recording mode or a binaural recording mode;

the data acquisition module is used for controlling the wireless earphone in a wearing state to acquire audio data;

the data processing module is used for preprocessing the audio data according to the recording mode;

the data transmission module is used for transmitting the preprocessed audio data to the electronic equipment.

15. A wireless headset, comprising:

an audio acquisition device;

one or more processors;

a memory;

one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of any of claims 1-13.

16. A computer-readable storage medium, having stored thereon program code that can be invoked by a processor to perform the method according to any one of claims 1 to 13.