WO2023050089A1 - 音频采集方法、系统及计算机可读存储介质 - Google Patents

音频采集方法、系统及计算机可读存储介质 Download PDF

Info

Publication number
WO2023050089A1
WO2023050089A1 PCT/CN2021/121445 CN2021121445W WO2023050089A1 WO 2023050089 A1 WO2023050089 A1 WO 2023050089A1 CN 2021121445 W CN2021121445 W CN 2021121445W WO 2023050089 A1 WO2023050089 A1 WO 2023050089A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
collection
component
audio collection
audio processing
Prior art date
Application number
PCT/CN2021/121445
Other languages
English (en)
French (fr)
Inventor
林浩
周事成
边云锋
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2021/121445 priority Critical patent/WO2023050089A1/zh
Priority to CN202180101377.4A priority patent/CN117795978A/zh
Publication of WO2023050089A1 publication Critical patent/WO2023050089A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/08Mouthpieces; Microphones; Attachments therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/20Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers

Definitions

  • the present application relates to the technical field of audio collection, and in particular, to an audio collection method, system, and computer-readable storage medium.
  • the collection end is generally designed as an inseparable integrated structure as a whole.
  • one of the objectives of the present application is to provide an audio collection method, system and computer-readable storage medium.
  • the collection terminal designed as an integrated structure is usually The volume is large, and there is a problem of inconvenient collection; (2) The collection terminal designed as an integrated structure has a single use method, limited use scenarios, and cannot meet diverse use needs.
  • an embodiment of the present application provides an audio collection system, the audio collection system includes a first audio processing component, and an audio collection component detachably connected to the first audio processing component;
  • the audio collection component includes a power supply module
  • the first audio processing component is provided with a first conductive terminal, and the audio collection component is provided with a second conductive terminal;
  • the first conductive terminal contacts the second conductive terminal and establishes a wired communication connection, and the audio signal collected by the audio collection part passes through the a wired communication connection is transmitted to the first audio processing component;
  • the audio collection part works based on the power supply module, and the audio collection part establishes a first wireless communication connection with the first audio processing part, The audio collection component sends the collected audio signal to the first audio processing component via the first wireless communication connection;
  • the first audio processing component is configured to send the audio signal to other remote audio devices through the second wireless communication connection.
  • the functions in the audio collection terminal are classified, and the audio collection terminal is designed as a detachable first audio processing component and an audio collection component, so as to realize a detachable modular design for the structure of the audio collection terminal,
  • the volume of each component is smaller, which is convenient for users to use, and users can choose different usage methods according to actual usage requirements.
  • the audio collection component is placed independently of the first audio processing component, the volume is small and compact
  • the audio collection part can be worn on any part of the user's body, and the use methods are diversified, which is conducive to improving the user's experience.
  • the collection end is usually designed as an inseparable integrated structure as a whole, thus limiting the use method (or collection method) of these audio collection products, such as
  • the transmitter of the wireless microphone is generally at the neckline, and the recording pen is generally held or placed on a platform, and the audio collected by it cannot meet the hearing needs of the user.
  • an embodiment of the present application provides an audio collection system, the audio collection system includes a first audio processing component and at least two independent audio collection components;
  • the audio collection part is provided with a wearing part, and at least two of the audio collection parts can be respectively fixed at different positions of the human body through the wearing part;
  • the audio collection component can establish a first wireless communication connection with the first audio processing component
  • the first audio processing unit is used for:
  • the audio signals respectively collected by at least two audio collection components are synthesized into stereo sound based on the wearing position information.
  • the audio collection system is provided with at least two independent audio collection components, and the user can fix at least two independent audio collection components at different positions of the human body according to actual needs, so that when the user communicates with others
  • the at least two independent audio collection components collect audio signals respectively to realize audio collection at multiple positions, and then synthesize the audio signals collected at multiple different positions into stereo according to the wearing positions of the audio collection components, which can simulate human Ear real hearing experience, to meet the user's hearing needs.
  • an embodiment of the present application provides an audio collection system, the audio collection system includes a first audio processing component and an audio collection component; the first audio processing component is detachably connected to the audio collection component;
  • the audio signal collected by the audio collection part is transmitted to the first audio processing part through the first communication connection;
  • the audio signal collected by the audio collection part is transmitted to the first audio processing part through the second communication connection; wherein, the first communication connection different from said second communication connection;
  • the first audio processing component is also used to send the audio signal to other audio devices at the far end.
  • the embodiment of the present application provides an audio collection method, which is applied to a first audio processing unit in an audio collection system; the first audio processing unit is detachably connected to the audio collection unit; the audio collection unit includes A power supply module; the first audio processing component is provided with a first conductive terminal, and the audio collection component is provided with a second conductive terminal;
  • the methods include:
  • the audio collection unit When the audio collection unit is installed on the first audio processing unit, it receives the audio signal transmitted by the audio collection unit via a wired communication connection; the wired communication connection is composed of the first conductive terminal and the second The conductive terminals are contacted and established;
  • the audio collection part When the audio collection part is placed independently of the first audio processing part, it receives the audio signal sent by the audio collection part via the first wireless communication connection; wherein, the audio collection part works based on the power supply module;
  • the audio signal is sent to other remote audio devices through the second wireless communication connection.
  • the embodiment of the present application provides an audio collection method, which is applied to the first audio processing component in the audio collection system; the audio collection system also includes at least two independent audio collection components; the audio collection component A wearing part is provided, and at least two of the audio collection components can be respectively fixed at different positions of the human body through the wearing parts; the audio collection part can establish a first wireless communication connection with the first audio processing part;
  • the methods include:
  • the audio signals respectively collected by at least two audio collection components are synthesized into stereo sound based on the wearing position information.
  • the embodiment of the present application provides a computer-readable storage medium, the computer-readable storage medium stores executable instructions, and when the executable instructions are executed by a processor, the fourth aspect or the fifth aspect is implemented. any one of the methods described.
  • FIGS. 1 to 8 are schematic diagrams of different structures of the audio collection system provided by the embodiment of the present application.
  • FIG. 9 is a schematic diagram of the workflow of the audio collection system provided by the embodiment of the present application.
  • FIG. 10 and FIG. 11 are schematic flowcharts of different audio collection methods provided by the embodiments of the present application.
  • the collection terminal is usually designed as an inseparable integrated structure as a whole, and there are the following problems: (1) the collection terminal designed as an integrated structure is usually large in size, and there is a problem of collection Inconvenient problem; (2) The collection terminal designed as an integrated structure has a single use mode, limited use scenarios, and cannot meet diverse use requirements.
  • an embodiment of the present application provides an audio collection system, the audio collection system includes a first audio processing unit, and an audio collection unit detachably connected to the first audio processing unit; the audio collection The component can be installed in the first audio processing component, or can be placed independently of the first audio processing component, the audio collection component transmits the collected audio signal to the first audio processing component, and the The first audio processing component sends the audio signal to other audio devices at the far end.
  • the functions in the audio collection terminal are classified, and the audio collection terminal is designed as a detachable first audio processing component and an audio collection component, so as to realize a detachable modular design for the structure of the audio collection terminal,
  • the volume of each component is smaller, which is convenient for users to use, and users can choose different usage methods according to actual usage requirements.
  • the audio collection component is placed independently of the first audio processing component, the volume is small and compact
  • the audio collection part can be worn on any part of the user's body, and the use methods are diversified, which is conducive to improving the user's experience.
  • the audio collection system provided in the embodiment of the present application is applicable to any audio collection scene, which is not limited in this embodiment.
  • the user when the audio collection unit is installed on the first audio processing unit, the user can hold the audio collection system for audio collection, or the audio collection system can be placed at a preset position For example, it is placed on a platform, or it is erected on a support.
  • the audio collection component when the audio collection component is placed independently of the first audio processing component, the audio collection component can be placed near the sound source, for example, it can be worn on the user who is speaking , can be worn on any part of the user, such as worn on the ear, neck or head, or clamped on the neckline and so on.
  • the audio collection system 100 includes a first audio processing unit 10, and an audio collection unit 20 detachably connected to the first audio processing unit 10; wherein, The audio collection component 20 includes a power supply module 21 ; the first audio processing component 10 is provided with a first conductive terminal 11 , and the audio collection component 20 is provided with a second conductive terminal 22 .
  • the audio collecting part 20 when the audio collecting part 20 is mounted on the first audio processing part 10, the first conductive terminal 11 contacts the second conductive terminal 22 and establishes a wired communication connection, the audio The audio signal collected by the collection component 20 is transmitted to the first audio processing component 10 via the wired communication connection.
  • the audio collection unit 20 when the audio collection unit 20 is placed independently of the first audio processing unit 10, the audio collection unit 20 works based on the power supply module 21, and the audio collection unit 20 is connected to the first audio processing unit 10.
  • the audio processing unit 10 establishes a first wireless communication connection, and the audio collection unit 20 sends the collected audio signal to the first audio processing unit 10 via the first wireless communication connection.
  • the first audio processing part 10 can establish a second wireless communication connection with other audio devices at the far end. After receiving the audio signal collected by the audio collecting part 20, the first audio processing part 10 can pass through the second A wireless communication link sends the audio signal to other audio devices at a remote location. Exemplarily, the audio device may play the received audio signal, or further edit the audio signal, or forward the audio signal to other devices.
  • the audio collection part 20 is mainly responsible for the audio collection function
  • the first audio processing part 10 is responsible for the audio remote transmission function, so as to realize the classification of the functions in the audio collection end, and the audio collection end is designed to be detachable
  • the first audio processing part 10 and the audio collection part 20 realize the detachable modular design of the structure of the audio collection end. 20 can be installed in the first audio processing part 10, and can also be placed independently of the first audio processing part 10. Users can choose different usage methods according to actual usage requirements. The usage methods are diversified, which is beneficial to improve the User experience.
  • the first audio processing unit 10 is provided with a receiving slot for accommodating the audio collection unit 20; when the audio collection unit 20 is mounted on the first audio processing unit 10, the audio The collecting part 20 is placed in the containing groove. It can be understood that this embodiment does not impose any restrictions on the specific structure of the receiving tank, and it can be determined according to the actual application scenario under the condition that the structure of the receiving tank is adapted to the shape of the audio collection component 20 . specific settings.
  • the power supply module 21 of the audio collection module may be in a closed state, not supplying power to the audio collection module, and the first audio processing
  • the component 10 can supply power to the audio collection component 20 through the contact between the first conductive terminal 11 and the second conductive terminal 22, and the audio collection component 20 and the first audio processing component 10 work as a whole
  • the power supply module 21 of the audio collection module does not work when the audio collection unit 20 is installed on the first audio processing unit 10, which is also conducive to saving the power of the power supply module 21 and improving the performance of the audio collection module. Endurance when left alone.
  • the audio collection unit 20 when the audio collection unit 20 is installed on the first audio processing unit 10, if the power supply module 21 of the audio collection module is not fully charged, the first audio processing unit 10 will also The power supply module 21 can be charged through the contact between the first conductive terminal 11 and the second conductive terminal 22, which is beneficial to improve the battery life of the audio collection module when it is placed independently.
  • the audio collection part 20 is provided with a wearing part, and when the audio collection part 20 is placed independently of the first audio processing part 10, the audio collection part 20 is used to be fixed on the human body.
  • the wearing part can be adapted to multiple different parts of the user, so that the audio collection part 20 can be fixed on multiple different parts of the human body based on the wearing part, for example, it can be worn on the ear of the human body , head, neck, shoulder or chest, etc., the user can fix the audio collection component 20 on the body through the wearing part according to actual needs, such as wearing it on the head or on the ear.
  • the specific shape of the wearing part can be specifically set according to the actual application scene, which is not limited in this embodiment.
  • the audio collection part 20 is detachably connected to the wearable part.
  • the wearable part There are multiple wearing parts, and different wearing parts are adapted to different parts of the user, such as ear-hook wearing parts, head A wearable part, a clip-on wearable part or a neck-mounted wearable part, etc.
  • the audio collection part 20 can be connected to one of the wearable parts according to actual needs, so that the audio collection part 20 can pass through the wearable part.
  • the part is fixed on the corresponding part of the human body, for example, the audio collection part 20 is connected to the ear-hook wearing part, and the audio collection part 20 is fixed to the ear of the human body through the ear-hook wearing part.
  • the audio collection part 20 is fixedly connected to the wearing part, and the wearing part integrates a variety of structures that can be fixed on multiple different parts of the human body, and one of the structures can be selected according to the actual situation. 20 fixed on the human body.
  • the audio collection system 100 may include a first audio processing unit 10, a second audio processing unit 30 and the The first audio processing unit 10 is detachably connected to an audio collection unit 20 .
  • the audio collection part 20 can be installed in the first audio processing part 10, and can also be placed independently of the first audio processing part 10, and the first audio processing part 10 can be connected with the second audio processing part 10.
  • the audio processing unit 30 establishes a second wireless communication connection, and then sends the audio signal collected by the audio collection unit 20 to the second audio processing unit 30 through the second wireless communication connection.
  • the second audio processing part 30 is used to connect with the image acquisition device, for example, the second audio processing part 30 can be arranged on the image acquisition device, and can be connected with the image acquisition device through a preset port (such as a USB port) ) wired connection, or the second audio processing part 30 can also be connected with the image acquisition device by means of wireless communication; after the second audio processing part 30 is connected with the image acquisition device, the audio The audio signal collected by the collection component 20 is transmitted to the image collection device, so as to synthesize the audio signal and the image signal collected by the image collection device into an audio and video data stream.
  • a preset port such as a USB port
  • the respective placement positions of the audio collection part 20 and the first audio processing part 10 are generally not too large. For example, they may all be within the visual range of the user, and the location of the second audio processing unit 30 or other remote audio equipment is not limited in this implementation, such as the second audio processing unit 30 or Other audio devices at the far end are not within the visible range of the user.
  • the signal strength of the first wireless communication connection is greater than the signal strength of the second wireless communication connection.
  • the The first wireless communication connection can be a near-field communication connection, such as a connection based on a Bluetooth protocol, an infrared protocol, or a UWB (ultra-wideband) protocol; Or other audio receiving devices) are far away, then the second wireless communication connection can be a remote communication connection, such as based on an Ethernet communication connection.
  • a near-field communication connection such as a connection based on a Bluetooth protocol, an infrared protocol, or a UWB (ultra-wideband) protocol; Or other audio receiving devices
  • the second wireless communication connection can be a remote communication connection, such as based on an Ethernet communication connection.
  • the first audio processing unit 10 is provided with a microphone 12, and the first audio processing unit 10 can use the microphone 12 to collect audio signals. That is to say, in the audio collection system 100, the audio collection part 20 can be used to collect the audio signal, and the microphone 12 can also be used to collect the audio signal, and the audio collection part 20 and the microphone 12 can collect the audio signal simultaneously. Audio signals, one of the two may also be used to collect audio signals, which is not limited in this embodiment.
  • the first audio processing unit 10 can send the audio signal collected by the microphone 12 and/or the audio signal collected by the audio collection unit 20 to other remote audio devices.
  • the microphone 12 and the audio collection part 20 can collect audio signals simultaneously, and the first audio processing part 10 is also used to The audio signal collected by the audio collection component 20 and the audio signal collected by the microphone 12 are sent to other remote audio devices.
  • the audio signal collected by the microphone 12 is used to perform audio processing on the audio signal collected by the audio collection component 20 .
  • the audio signal collected by the microphone 12 is used to optimize the audio signal collected by the audio collection component 20, which is beneficial to improve the quality and playback effect of the optimized audio signal.
  • the audio collection unit 20 when the audio collection unit 20 is placed independently of the first audio processing unit 10, the audio collection unit 20 can be placed at a position close to the sound source (for example, worn on the user who speaks), and the The first audio processing part 10 can be placed in the environmental space where the sound source (such as the user) is located, the microphone 12 and the audio collection part 20 can collect audio signals simultaneously, and the audio collection part 20 can collect Regarding the audio signal of the sound source (such as the user), the microphone 12 in the first audio processing unit 10 can collect an audio signal related to the ambient sound, and then the audio signal collected by the microphone 12 can be used to analyze the The audio signal collected by the audio collection part 20 is subjected to audio processing.
  • the audio signal collected by the microphone 12 may be used to perform audio modification on the audio signal collected by the audio collection component 20, For example, obtain a compensation signal opposite in phase to the audio signal collected by the microphone 12, and use the compensation signal to compensate the audio signal collected by the audio collection part 20, and offset the wind in the audio signal collected by the audio collection part 20. Noise, to highlight the target frequency band (such as highlighting the human voice).
  • the ambient sound component may be extracted from the audio signal collected by the microphone 12, and the ambient sound component may be added to the audio signal collected by the audio collection component 20, so that the added audio signal is more natural.
  • the audio collection unit 20 When the audio collection unit 20 is mounted on the first audio processing unit 10, considering that the audio signal collected by the microphone 12 is basically the same as the audio signal collected by the audio collection unit 20, in order to effectively save loss, you can use Any one of the microphone 12 and the audio collection component 20 collects audio signals, so that the power consumption of the audio collection system 100 can be effectively saved, and the battery life of the audio collection system 100 can be improved.
  • the microphone 12 and the audio collection component 20 can also collect audio signals at the same time, which is not limited in this embodiment.
  • the first audio processing unit 10 when the audio collection unit 20 is placed independently of the first audio processing unit 10, the The audio collection unit 20 can be placed near the sound source (for example, worn on the speaking user), and the first audio processing unit 10 can be placed in the environment where the sound source (for example, the user) is located.
  • the audio signals collected by the microphone 12 in the first audio processing unit 10 are also different, and the audio signals collected in some positions may not be the same.
  • the first audio processing unit 10 is placed in the same environmental space as the sound source but relatively far away, the ambient sound of this position is consistent with the location of the sound source The ambient sound may be different, resulting in the audio signal collected by the microphone 12 not meeting the usage requirements.
  • the first audio processing unit 10 can also determine the collection position of the microphone 12 , and then output position prompt information according to the difference between the collection position and a preset reference position; the position prompt information is used to remind the user to move the first audio processing component 10 to the reference position; the The reference position is a position where the collected audio signal meets the usage requirements, and the reference position may be specifically set according to an actual application scenario, and this embodiment does not impose any limitation on this.
  • the first audio processing unit 10 may be provided with a visual sensor, and the first audio processing unit 10 may determine the collection position of the microphone 12 based on a visual positioning method, such as the collection position of the microphone 12 It is determined according to the recognition result of the second image collected by the visual sensor; for another example, the collection position of the microphone 12 is determined according to the pose when the second image is collected by the visual sensor.
  • a visual positioning method such as the collection position of the microphone 12 It is determined according to the recognition result of the second image collected by the visual sensor; for another example, the collection position of the microphone 12 is determined according to the pose when the second image is collected by the visual sensor.
  • the first audio processing unit 10 can also determine whether the microphone 12 is connected to the audio collection unit 20.
  • the first audio processing unit 10 may determine the distance between the microphone 12 and the audio collection unit 20 based on the signal strength of the first wireless communication connection, the greater the signal strength, the greater the The closer the distance between the microphone 12 and the audio collection component 20 is.
  • the first audio processing part 10 also has an editing processing function, and the first audio processing part 10 can perform editing on the audio signal collected by the microphone and/or the audio signal collected by the audio collection part.
  • the editing process is beneficial to improve the quality of the audio signal (such as playback quality or transmission quality, etc.), and the processed audio signal is sent to other remote audio devices through the second wireless communication connection.
  • the editing processing includes but not limited to synthesis processing, enhancement processing, noise reduction processing and/or filtering processing and so on.
  • the first audio processing component 10 can perform wireless enhancement processing on the audio signal collected by the at least one audio collection component 20, so that the processing The final audio signal can be transmitted farther and has a lower packet loss rate, which improves the transmission quality of the audio signal.
  • the first audio processing unit 10 can use the audio signal collected by the microphone 12 to analyze the audio collected by the audio collection unit 20
  • the signal is subjected to audio processing, such as synthesizing the audio signal collected by the microphone 12 and the audio signal collected by the audio collection part 20;
  • the signal is subjected to noise reduction processing, so that the processed audio signal has a better playback effect.
  • the first audio processing component 10 can synthesize and process the audio signals collected by the at least two audio collection components 20, so that The processed audio signal has a better playback effect.
  • the audio collection part 20 can only have the audio collection function, which is conducive to reducing the weight and weight of the audio collection part 20.
  • the audio collection part 20 can only have the audio collection function, which is conducive to reducing the weight and weight of the audio collection part 20.
  • the audio collection part 20 can only have the audio collection function, which is conducive to reducing the weight and weight of the audio collection part 20.
  • the audio collection part 20 can only have the audio collection function, which is conducive to reducing the weight and weight of the audio collection part 20.
  • more functions can be set in the first audio processing part 10 according to actual needs; then the audio collection part 20
  • the volume is smaller than the volume of the first audio processing part 10; and/or, the weight of the audio collection part 20 is smaller than the weight of the first audio processing part 10.
  • the collection end is generally designed as an inseparable integrated structure as a whole, thus limiting the use method (or collection method) of these audio collection products .
  • the transmitting end of the wireless microphone is generally at the neckline position, and the recording pen is generally held or placed on a platform, and the audio collected by it cannot meet the auditory needs of the user.
  • the embodiment of the present application provides an audio collection system 100
  • the audio collection system 100 includes a first audio processing component 10 and at least two independent audio collection components 20; that is, at least two audio
  • the collection part 20 can be placed independently of the first audio processing part 10 .
  • the audio collection part 20 is provided with a wearing part 23, and at least two of the audio collection parts 20 can be respectively fixed at different positions of the human body through the wearing part 23.
  • the audio collection part 20 can establish a first wireless communication connection with the first audio processing part 10; for example, when the audio collection part 20 is placed independently of the first audio processing part 10, the audio collection part 20 Based on the power supply module 21 working, the audio collection component 20 establishes a first wireless communication connection with the first audio processing component 10 .
  • the first audio processing part 10 is used to: acquire the wearing position information of the audio collecting part 20; receive the audio signals respectively collected by at least two of the audio collecting parts 20 through the first wireless communication connection; The wearing position information synthesizes the audio signals respectively collected by at least two audio collection components 20 into a stereo sound.
  • the audio collection system 100 is provided with at least two independent audio collection components 20, and the user can fix at least two independent audio collection components 20 at different positions of the human body according to actual needs, so that the user can communicate with others During the communication process, the at least two independent audio collection components 20 respectively collect audio signals to realize audio collection at multiple positions, and then synthesize the audio signals collected at multiple different positions according to the wearing positions of the audio collection components 20 Stereo sound can simulate the real hearing experience of the human ear to meet the hearing needs of users.
  • the first audio processing unit 10 establishes a second wireless communication connection with other audio equipment at the far end, and the first audio processing unit 10 can also send the stereo sound to other audio equipment at the far end .
  • the audio collection system 100 further includes a second audio processing component 30 .
  • the first audio processing unit 10 can establish a second wireless communication connection with the second audio processing unit 30, and then send the stereo sound to the second audio processing unit 30 through the second wireless communication connection .
  • the second audio processing part 30 is used to connect with the image acquisition device, and can transmit the stereo sound to the image acquisition device, so as to synthesize the stereo sound and the image signal collected by the image acquisition device into an audio and video data stream .
  • the determined wearing position information is sent to the first audio processing unit 10 .
  • the audio collection component 20 is provided with a proximity sensor, and the proximity sensor is used to determine the Whether the audio collection component 20 is in contact with the human body.
  • the proximity sensor includes but is not limited to a capacitive proximity sensor, an inductive proximity sensor, Photoelectric proximity sensors, infrared sensors or ultrasonic sensors, etc.
  • the audio collection part 20 is also provided with a preset sensor other than the proximity sensor, and when it is determined that the audio collection part 20 is in contact with a human body, the audio collection part 20 uses the preset sensor to obtain a human body characteristic parameters, and determine the current wearing position information of the audio collection unit 20 based on the human body characteristic parameters, and send the wearing position information to the first audio processing unit 10 via the first wireless communication connection.
  • the preset sensor includes a bone conduction sensor
  • the human body characteristic parameters include bone conduction signals collected from the wearing part 23
  • the component 20 uses the bone conduction sensor to collect bone conduction signals from the 23 bits of the wearing part, and then according to the correlation between the bone conduction signals and the preset voice signals, from the mapping relationship between the preset voice signals and the 23 bits of the wearing part Determine the current wearing position information of the audio collection component 20 .
  • the correlation between the bone conduction signal and the preset voice signal can be determined by the difference between parameters such as strength, amplitude, energy or frequency of the bone conduction signal and the preset voice signal, The smaller the difference, the higher the correlation between the bone conduction signal and the preset voice signal, and the larger the difference, the lower the correlation between the bone conduction signal and the preset voice signal.
  • a difference threshold can be set. When the difference between parameters such as strength, amplitude, energy or frequency between the bone conduction signal and the preset voice signal is less than the difference threshold, it means that the bone conduction signal and the preset voice signal are different from each other. Assuming that the voice signal has a strong correlation, the wearing position information can be obtained according to the 23 bits of the wearing part mapped by the preset voice signal.
  • the preset sensor includes a visual sensor
  • the human body characteristic parameters include a first image related to the wearing part 23
  • 20 uses the visual sensor to collect a first image about the wearing part 23, and then determines the current wearing position information of the audio collection part 20 according to the contour information extracted from the first image; for example, the audio collection part 20 can determine the 23 bits of the body wearing part according to the outline information and the preset mapping relationship (representing the mapping relationship between the outline information and the 23 bits of the body wearing part), so as to obtain the wearing position information.
  • the wearing positions of the at least two independent audio collection components 20 also have an impact on the playback quality of the final synthesized stereo sound, for example, if the at least two independent audio collection components 20 are fixed on the same side of the human body, Then the synthesized stereo may not be able to fully simulate the real hearing effect of human ears, and the stereo playback effect is not good.
  • the first audio processing component 10 acquires the wearing position information and audio signals sent by at least two audio collection units 20 respectively, the first audio processing component first Judging whether the wearing position information conforms to a preset wearing position condition, the preset wearing position condition indicates that the wearing positions of the at least two independent audio collection components 20 can effectively ensure the real simulation effect of the synthesized stereo sound.
  • the preset wearing position conditions include: two of the at least two audio collection components 20 are placed symmetrically with respect to the central axis of the human body, or at least two of the audio collection components 20 are respectively worn on the human body in different preset conditions. Two of the different preset positions are symmetrical with respect to the central axis of the human body.
  • two of the at least two audio collection components 20 are respectively worn on the left and right ears or on the left and right shoulders of the user.
  • the audio collection system 100 includes three audio collection parts 20, wherein two audio collection parts 20 are respectively worn on the left and right ears of the user, and the third audio collection part 20 is worn on the user's head. head or neck etc.
  • the first audio processing component 10 If the wearing position information conforms to the preset wearing position condition, indicating that the audio signals collected by at least two of the audio collecting components 20 can synthesize stereo sound that meets the requirements, then the first audio processing component 10 The information synthesizes the audio signals respectively collected by at least two audio collection components 20 into stereo sound, and then transmits the stereo sound to other audio devices at the far end. If the wearing position information does not conform to the preset wearing position condition, it indicates that the stereo sound synthesized by the audio signals collected by at least two audio collecting components 20 respectively does not meet the requirements, then the first audio processing component 10 based on the The wearing position information sends out prompt information, and the prompt information is used to prompt the user to wear at least two audio collection components 20 at positions that meet requirements on the human body. In this embodiment, after acquiring the wearing position information, it is judged whether the wearing position information meets the wearing condition, which is beneficial to improve the real effect of the synthesized stereo sound.
  • the first audio processing unit 10 may determine the modulation mode of the amplitude, phase and/or frequency of the audio signal based on the wearing position information; and then based on the The modulation mode modulates the audio signals respectively collected by at least two audio collection components 20 to obtain the stereo sound.
  • the amplitude, phase and/or frequency of the audio signal can be modulated based on different wearing parts 23 of the user, so as to obtain stereo sound with real auditory effects.
  • the relative positions or distances between the audio collection components 20 and the sound source are also different, so that at least two of the audio collection components 20 are respectively If the collected audio signals are different, the modulation modes of the amplitude, phase and/or frequency of each audio signal are also different.
  • different modulation modes are used to process the audio signal, which is beneficial to improve the real effect of the synthesized stereo sound.
  • the audio collection system 100 includes two audio collection components 20, the two audio collection components 20 are respectively fixed to the left and right ears of the human body to collect audio signals, and the synthesized stereo sound is binaural stereo.
  • the audio collection system 100 includes three audio collection parts 20, wherein two audio collection parts 20 are respectively fixed on the left and right ears of the human body, and the third audio collection part 20 is fixed on the head of the human body. Stereo is 3D surround sound.
  • the modulation method is determined according to the relative positional relationship and/or distance between the wearing part 23 and the sound source indicated by the wearing position information; for example, the first audio processing component 10 may be based on the wearing position information
  • the relative positional relationship and/or distance between the 23 bits of the wearing part and the sound source determine the modulation method of the amplitude, phase and/or frequency of the audio signal; wherein, the distance between the 23 bits of the wearing part and the sound source
  • the relative positional relationship and/or distance are different, the amplitude, phase and/or frequency modulation modes of the audio signal are also different, and the obtained stereo sound is also different.
  • the first audio processing unit 10 pre-stores multiple candidate modulation modes for the amplitude, phase and/or frequency of the audio signal; wherein, different candidate modulation modes correspond to different wearing position information; the modulation The mode may be selected from multiple candidate modulation modes according to the wearing position information.
  • the first audio processing unit 10 pre-stores a reference audio signal collected with reference to the wearing position, and a reference modulation method for the amplitude, phase and/or frequency of the reference audio signal. During actual use, The first audio processing unit 10 may adjust the reference modulation mode according to the difference between the acquired wearing position information and the reference wearing position, so as to obtain the modulation mode corresponding to the wearing position information.
  • the first audio processing unit 10 can also edit the stereo sound, and send the processed stereo sound to other remote audio devices through the second wireless communication connection; wherein,
  • the editing processing includes but not limited to enhancement processing, noise reduction processing and/or filtering processing, etc., so as to improve the playback effect of the stereo sound.
  • the first audio processing unit 10 can perform wireless enhancement processing on the stereo sound, so that the processed stereo sound can be transmitted farther and have a lower packet loss rate.
  • the first audio processing unit 10 is also provided with a microphone 12; the first audio processing unit 10 is also used to superimpose the audio signal collected by the microphone 12 on the stereo , and then send the superimposed stereo sound to other audio devices at the far end through the second wireless communication connection.
  • the audio signal collected by the microphone 12 is superimposed in the stereo sound, which is beneficial to improve the playback effect of the stereo sound.
  • At least two of the audio collection components 20 can be placed at positions close to the sound source (such as being worn on different parts of the speaking user), and the first audio processing component 10 can be placed at the sound source (such as the In the environmental space where the user) is located, the microphone 12 and the audio collection part 20 can collect audio signals at the same time, and the audio collection part 20 can collect audio signals related to the sound source (such as the user), the The microphone 12 in the first audio processing part 10 can gather the relevant audio signal of environmental sound, then can extract the environmental sound component from the audio signal that described microphone 12 gathers, and superimpose in the described stereo sound of synthesis, increase described Stereo realism.
  • the first audio processing unit 10 is further configured to: acquire the wearing positions of at least two of the audio collection units 20 Information and audio signals; the audio signals and the wearing position information collected by at least two of the audio collecting components 20 are sent to other audio devices at the far end through the second wireless communication connection, so that other audio devices are based on the wearing position information
  • the audio signals respectively collected by at least two audio collection components 20 are synthesized into stereo sound.
  • the first audio processing part 10 is also provided with a microphone 12; the first audio processing part 10 is also configured to send the audio signal collected by the microphone 12 to other remote devices through the second wireless communication connection. an audio device, so that other audio devices superimpose the audio signal collected by the microphone 12 into the stereo sound.
  • the first audio processing unit 10 includes a memory, and may store the audio signal collected by the audio collection unit, the audio signal collected by the microphone and/or the stereo sound, etc. in the memory.
  • the audio collection component 20 may encode the collected audio signal, and then transmit the encoded audio signal to the second wireless communication connection or the wired communication connection.
  • An audio processing unit 10 the first audio processing unit 10 has a decoding function, and can decode the encoded audio signal.
  • the audio collection system 100 including a first audio processing unit 10 and at least two audio collection units 20 as an example, in the actual use of the audio collection system 100, firstly The first audio processing unit 10 detects whether each of the audio collection units 20 is installed on the first audio processing unit 10,
  • the audio processing unit 10 receives the audio signal collected by the first audio processing unit 10 through the wired communication connection, and sends it to other remote audio devices.
  • the first audio processing unit 10 detects Whether the first wireless communication connection has been established between itself and the audio collection component 20 .
  • the audio collection unit 20 has not established a first wireless communication connection with the first audio processing unit 10, it is possible that the audio collection unit 20 is not turned on or is outside the wireless communication distance, and the first audio processing unit 10 sends a prompt message of abnormal communication, at this time, the audio collection component 20 cannot collect audio signals or the collected audio signals cannot be transmitted.
  • the first audio processing unit 10 If the audio collection unit 20 establishes a first wireless communication connection with the first audio processing unit 10, the first audio processing unit 10 notifies the audio collection unit 20 of the wearing position via the first wireless communication connection. To detect, the audio collection component 20 first detects whether it is in contact with the human body.
  • the audio collection part 20 determines the current wearing position information of the audio collection part 20, and sends the wearing position information to the first wireless communication connection via the first wireless communication connection.
  • the audio processing part 10; and then the first audio processing part 10 obtains the wearing position information of at least two of the audio collecting parts 20, and based on the wearing position information, the audio signals collected by the at least two audio collecting parts 20 respectively Synthesize into stereo sound, and send the stereo sound to other audio devices at the far end through the second wireless communication connection.
  • the audio collection system includes a first audio processing component and two audio collection components (hereinafter referred to as earphone A and earphone B) wearable on the ear as example:
  • the first audio processing unit After the first audio processing unit is powered on, the first audio processing unit checks whether it is equipped with earphone A and earphone B: in step S11, the first audio processing unit checks whether it has established wired communication with earphone A and, in step S21, the first audio processing component checks whether it has established a wired communication connection with the earphone B.
  • step S12 the audio signal collected by earphone A is transmitted to the first audio processing unit through a wired communication connection, and the first audio processing unit passes the second wireless communication Connect and send the audio signal to other audio equipment at the far end; and, in step S21, the audio signal collected by the earphone B is transmitted to the first audio processing unit via a wired communication connection, and the first audio processing unit passes the second wireless communication Connect to other audio equipment that sends the audio signal to the far end.
  • the first audio processing component can also detect whether itself (including earphone A and/or earphone B) is worn on the human body (such as being clamped on the neckline, wrist, etc.) or held by a preset sensor, and Output wearing reminder information according to the detection result to remind the user of the current wearing situation of the first audio processing component (such as in any one of non-wearing mode, non-handheld mode, wearing mode, and handheld mode).
  • itself including earphone A and/or earphone B
  • Output wearing reminder information according to the detection result to remind the user of the current wearing situation of the first audio processing component (such as in any one of non-wearing mode, non-handheld mode, wearing mode, and handheld mode).
  • step S13 the first audio processing part detects whether itself and the earphone A are The first wireless communication connection is established; and, in step S23, the first audio processing component detects whether it has established the first wireless communication connection with the earphone B.
  • step S14 the first audio processing component outputs communication abnormality information related to earphone A, and the earphone A cannot collect audio signals or the collected audio signals cannot be transmitted; and, in step S24, the first audio processing component outputs communication information related to earphone B Communication abnormality information, the earphone B cannot collect audio signals or the collected audio signals cannot be transmitted.
  • the earphone B establish a first wireless communication connection with the first audio processing component: in step S15, the first audio processing component notifies the earphone A to perform wearing detection; and, in step S25, the first audio processing component An audio processing unit notifies the earphone B to perform wearing detection.
  • step S16 earphone A detects whether it is in contact with the human body through the human body proximity sensor; and, in step S26, earphone B detects whether it is in contact with the human body through the human body proximity sensor.
  • step S17 the earphone A sends the collected audio signal and the unworn information to the first audio processing unit, and the first audio processing unit outputs the prompt information according to the unworn information (such as prompting the user to wear the earphone A) and sending the audio signal to other audio equipment at the far end; and, in step S27, the earphone B sends the collected audio signal and the unworn information to the first audio processing unit,
  • the first audio processing component outputs prompt information (such as prompting the user to wear earphone B) according to the not-wearing information and sends the audio signal to other audio devices at the far end.
  • step S18 the earphone A uses the preset sensor to obtain the human body characteristic parameters, and determines whether the earphone A is worn on the user's ear based on the human body characteristic parameters; and, in step S28, The earphone B acquires the human body characteristic parameters using preset sensors, and determines whether the earphone B is worn on the user's ear based on the human body characteristic parameters.
  • step S19 the earphone A sends the collected audio signal and the unworn information to the first audio processing unit, and the first audio processing unit outputs prompt information according to the unworn information (such as prompting the user to wear the earphone A) and sending the audio signal to other audio equipment at the far end;
  • the first audio processing component outputs prompt information (such as prompting the user to wear the earphone B) according to the not-wearing information and sends the audio signal to other audio devices at the far end.
  • step S20 earphone A sends the collected audio signal and wearing position information to the first audio processing component; and, in step S30, earphone B collects the audio signal and The wearing position information is sent to the first audio processing component.
  • the first audio processing part obtains the wearing position information of earphone A and earphone B (worn on the ear respectively); Based on the wearing position information, the audio signals collected by earphone A and earphone B are synthesized into stereo; The second wireless communication connection sends the stereo sound to other audio devices at the far end.
  • an embodiment of the present application also provides an audio collection system, the audio collection system includes a first audio processing component and an audio collection component; the first audio processing component is detachably connected to the audio collection component;
  • the audio signal collected by the audio collection unit is transmitted to the first audio processing unit through the first communication connection.
  • the audio signal collected by the audio collection part is transmitted to the first audio processing part through the second communication connection; wherein, the first communication connection Different from the second communication connection, for example, the first communication connection is a wired communication connection, and the second communication connection is a wireless communication connection.
  • the first audio processing component is also used to send the audio signal to other audio devices at the far end.
  • Various implementations described herein can be implemented using a computer readable medium such as computer software, hardware, or any combination thereof.
  • the embodiments described herein can be implemented by using Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays ( FPGA), processors, controllers, microcontrollers, microprocessors, electronic units designed to perform the functions described herein.
  • ASICs Application Specific Integrated Circuits
  • DSPs Digital Signal Processors
  • DSPDs Digital Signal Processing Devices
  • PLDs Programmable Logic Devices
  • FPGA Field Programmable Gate Arrays
  • processors controllers, microcontrollers, microprocessors, electronic units designed to perform the functions described herein.
  • an embodiment such as a procedure or a function may be implemented with a separate software module that allows at least one function or operation to be performed.
  • the software codes can be implemented by a software application (or program
  • the embodiment of the present application also provides an audio collection method, which is applied to the first audio processing component in the audio collection system; the first audio processing component is detachably connected to the audio collection component;
  • the audio collection part includes a power supply module; the first audio processing part is provided with a first conductive terminal, and the audio collection part is provided with a second conductive terminal;
  • the methods include:
  • step S101 when the audio collection unit is installed on the first audio processing unit, the audio signal transmitted by the audio collection unit via a wired communication connection is received; the wired communication connection is connected by the first conductive terminal contact and establishes with the second conductive terminal.
  • step S102 when the audio collection unit is placed independently of the first audio processing unit, receive the audio signal sent by the audio collection unit via the first wireless communication connection; wherein the audio collection unit is based on the The power supply module is working.
  • step S103 the audio signal is sent to other remote audio devices through the second wireless communication connection.
  • the method further includes: establishing a second wireless communication connection with the second audio processing component, and sending the audio signal to the second audio processing component through the second wireless communication connection, so that the first The second audio processing component transmits the audio signal to the image acquisition device, so as to synthesize the audio signal and the image signal collected by the image acquisition device into an audio and video data stream.
  • the signal strength of the first wireless communication connection is greater than the signal strength of the second wireless communication connection.
  • the first audio processing part is provided with a receiving slot for accommodating the audio collection part; when the audio collection part is installed on the first audio processing part, the audio collection part placed in the holding tank.
  • the method further includes: when the audio collection component is installed on the first audio processing component, through the contact between the first conductive terminal and the second conductive terminal, the audio The acquisition unit is powered.
  • the audio collection part is provided with a wearing part; when the audio collection part is placed independently of the first audio processing part, the audio collection part is used to be fixed to the human body through the wearing part.
  • the first audio processing component is provided with a microphone
  • the method further includes: sending the audio signal collected by the audio collection component and the audio signal collected by the microphone to other remote audio devices through the second wireless communication connection.
  • the microphone and the audio collection part collect audio signals at the same time.
  • the audio signal collected by the microphone is used to perform audio processing on the audio signal collected by the audio collection component.
  • the volume of the audio collection component is smaller than that of the first audio processing component; and/or, the weight of the audio collection component is smaller than the weight of the first audio processing component.
  • the method further includes: editing the audio signal, and sending the processed audio signal to other remote audio devices through the second wireless communication connection.
  • the editing processing includes: synthesis processing, enhancement processing, noise reduction processing and/or filtering processing.
  • the audio collection system includes at least two audio collection components provided with wearing parts;
  • the at least two audio collection parts can be respectively fixed at different positions of the human body through the wearing part.
  • the method further includes: acquiring the wearing position information of at least two of the audio collection components; synthesizing the audio signals respectively collected by the at least two audio collection components into stereo based on the wearing position information; The stereo sound is sent to other audio devices at the far end through the second wireless communication connection.
  • the method is further used for:
  • the wearing position information meets the preset wearing position condition, synthesizing audio signals respectively collected by at least two of the audio collection components into stereo based on the wearing position information;
  • a prompt message is issued based on the wearing position information.
  • the preset wearing position conditions include: two of the at least two audio collection components are placed symmetrically with respect to the central axis of the human body, or at least two of the audio collection components are respectively worn on the body Default location.
  • the acquiring the wearing position information of the audio collecting component includes: receiving the current wearing position information of the audio collecting component sent by the audio collecting component via the first wireless communication connection;
  • the audio collection component is provided with a proximity sensor and a preset sensor other than the proximity sensor; the proximity sensor is used for when the audio collection component is placed independently of the first audio processing component, Determine whether the audio collection unit is in contact with the human body; if the audio collection unit is determined to be in contact with the human body, use the preset sensor to obtain human body characteristic parameters, and determine the current state of the audio collection unit based on the human body characteristic parameters. wear location information.
  • the preset sensor includes a bone conduction sensor, and the human body characteristic parameters include bone conduction signals collected from the wearing part; and/or, the preset sensor includes a visual sensor, and the human body characteristic parameters include There is the first image of the wearing part.
  • the current wearing position information of the audio collection component is determined from the mapping relationship between the preset voice signal and the wearing part according to the correlation between the bone conduction signal and the preset voice signal; and/or The current wearing position information of the audio collection component is determined according to the contour information extracted from the first image.
  • the synthesizing the audio signals respectively collected by at least two of the audio collection components into stereo sound based on the wearing position information includes: determining the amplitude and phase of the audio signal based on the wearing position information and/or a modulation method of frequency; based on the modulation method, the audio signals respectively collected by at least two of the audio collection components are modulated to obtain the stereo sound.
  • the information on the wearing position is different, and the modulation modes of the amplitude, phase and/or frequency of the audio signal are also different.
  • the modulation method is determined according to the relative positional relationship and/or distance between the wearing part indicated by the wearing position information and the sound source.
  • the first audio processing unit pre-stores multiple candidate modulation modes for the amplitude, phase and/or frequency of the audio signal; where different candidate modulation modes correspond to different wearing position information; the The modulation mode is selected from multiple candidate modulation modes according to the wearing position information.
  • the first audio processing unit is further provided with a microphone
  • the method further includes: superimposing the audio signal collected by the microphone into the stereo sound; and sending the superimposed stereo sound to other remote audio devices through the second wireless communication connection.
  • the method further includes: determining the collection position of the microphone; outputting position prompt information according to the difference between the collection position and a reference position; the position prompt information is used to remind the user to place the The first audio processing component is moved to the reference position.
  • the first audio processing component is also provided with a visual sensor
  • the collection position of the microphone is determined according to the recognition result of the second image collected by the visual sensor.
  • the method also includes:
  • the audio signals and the wearing position information respectively collected by at least two of the audio collection components are sent to other remote audio devices through the second wireless communication connection, so that other audio devices send at least two of the audio signals based on the wearing position information.
  • the audio signals respectively collected by the audio collection part are synthesized into stereo.
  • the embodiment of the present application also provides another audio collection method, which is applied to the first audio processing component in the audio collection system;
  • the audio collection system also includes at least two independent audio collection components
  • the audio collection part is provided with a wearing part, and at least two of the audio collection parts can be respectively fixed in different positions of the human body through the wearing part;
  • the audio collection part can establish a first audio processing part with the first wireless communication connection;
  • the methods include:
  • step S201 the wearing position information of the audio collection component is acquired.
  • step S202 audio signals respectively collected by at least two of the audio collection components are received through the first wireless communication connection.
  • step S203 the audio signals respectively collected by at least two of the audio collection components are synthesized into stereo based on the wearing position information.
  • the audio collection component includes a power supply module.
  • the audio collection part When the audio collection part is placed independently of the first audio processing part, the audio collection part works based on the power supply module, and the audio collection part establishes the first wireless communication with the first audio processing part connected, the audio collection component sends the collected audio signal to the first audio processing component via the first wireless communication connection.
  • the method further includes: sending the stereo sound to other remote audio devices through a second wireless communication connection.
  • the method further comprises a second audio processing component.
  • the method further includes: establishing a second wireless communication connection with the second audio processing component, and sending the stereo sound to the second audio processing component through the second wireless communication connection so that the second audio processing The component transmits the stereo sound to the image acquisition device, so as to synthesize the stereo sound and the image signal collected by the image acquisition device into an audio and video data stream.
  • the signal strength of the first wireless communication connection is greater than the signal strength of the second wireless communication connection strength.
  • the method further includes:
  • the wearing position information meets the preset wearing position condition, synthesizing audio signals respectively collected by at least two of the audio collection components into stereo based on the wearing position information;
  • a prompt message is issued based on the wearing position information.
  • the preset wearing position conditions include: two of the at least two audio collection components are placed symmetrically with respect to the central axis of the human body, or at least two of the audio collection components are respectively worn on the body Default location.
  • the acquiring the wearing position information of the audio collection component includes:
  • the audio collection component is provided with a proximity sensor and a preset sensor other than the proximity sensor; the proximity sensor is used for when the audio collection component is placed independently of the first audio processing component, Determine whether the audio collection unit is in contact with the human body; if the audio collection unit is determined to be in contact with the human body, use the preset sensor to obtain human body characteristic parameters, and determine the current state of the audio collection unit based on the human body characteristic parameters. wear location information.
  • the preset sensor includes a bone conduction sensor, and the human body characteristic parameters include bone conduction signals collected from the wearing part; and/or, the preset sensor includes a visual sensor, and the human body characteristic parameters include There is the first image of the wearing part.
  • the current wearing position information of the audio collection component is determined from the mapping relationship between the preset voice signal and the wearing part according to the correlation between the bone conduction signal and the preset voice signal; and/or The current wearing position information of the audio collection component is determined according to the contour information extracted from the first image.
  • the synthesizing the audio signals respectively collected by at least two audio collection components into stereo based on the wearing position information includes:
  • the audio signals respectively collected by at least two audio collection components are modulated to obtain the stereo sound.
  • the information on the wearing position is different, and the modulation modes of the amplitude, phase and/or frequency of the audio signal are also different.
  • the modulation mode is determined according to the relative positional relationship and/or distance between the wearing part indicated by the wearing position information and the sound source.
  • the first audio processing unit pre-stores multiple candidate modulation modes for the amplitude, phase and/or frequency of the audio signal; where different candidate modulation modes correspond to different wearing position information;
  • the modulation mode is selected from multiple candidate modulation modes according to the wearing position information.
  • the first audio processing component is provided with a microphone
  • the method further includes: superimposing the audio signal collected by the microphone into the stereo sound; and sending the superimposed stereo sound to other remote audio devices through the second wireless communication connection.
  • the method further includes: determining the collection position of the microphone; outputting position prompt information according to the difference between the collection position and a reference position; the position prompt information is used to remind the user to place the The first audio processing component is moved to the reference position.
  • the first audio processing component is further provided with a visual sensor; the collection position of the microphone is determined according to the recognition result of the second image collected by the visual sensor.
  • the audio collection component can be installed on the first audio processing component
  • the first audio processing component is provided with a first conductive terminal, and the audio collection component is provided with a second conductive terminal;
  • the first conductive terminal contacts the second conductive terminal and establishes a wired communication connection, and the audio signal collected by the audio collection part passes through the The wired communication connection transmits to the first audio processing component.
  • the method further includes: when the audio collection component is installed on the first audio processing component, through the contact between the first conductive terminal and the second conductive terminal, the audio The acquisition unit is powered.
  • the first audio processing part is provided with a receiving slot for accommodating the audio collection part; when the audio collection part is installed on the first audio processing part, the audio collection part placed in the holding tank.
  • the method further includes: when the audio collection unit is installed on the first audio processing unit, sending the audio signal collected by the audio collection unit to a remote end through a second wireless communication connection other audio equipment.
  • the first audio processing component is provided with a microphone
  • the method further includes: sending the audio signal collected by the audio collection component and the audio signal collected by the microphone to other remote audio devices through the second wireless communication connection; wherein the audio signal collected by the microphone It is used for performing audio processing on the audio signal collected by the audio collection component.
  • the microphone and at least two audio collection components collect audio signals simultaneously.
  • the volume of the audio collection component is smaller than that of the first audio processing component; and/or, the weight of the audio collection component is smaller than the weight of the first audio processing component.
  • the method further includes: editing the stereo sound, and sending the processed stereo sound to other remote audio devices through the second wireless communication connection.
  • the editing processing includes: enhancement processing, noise reduction processing and/or filtering processing.
  • an audio processing unit includes a memory and a processor, executable instructions are stored on the memory, and the processor is configured to execute any one of the above-mentioned method steps.
  • non-transitory computer-readable storage medium including instructions, such as a memory including instructions, which are executable by a processor of an apparatus to perform the above method.
  • the non-transitory computer readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.
  • a non-transitory computer-readable storage medium enabling the terminal to execute the above method when instructions in the storage medium are executed by a processor of the terminal.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

一种音频采集方法、系统及计算机可读存储介质。其中,音频采集系统包括第一音频处理部件和音频采集部件;所述第一音频处理部件与所述音频采集部件可拆卸的连接;当所述音频采集部件装设于所述第一音频处理部件时,所述音频采集部件采集的音频信号经由第一通讯连接传输至所述第一音频处理部件;当所述音频采集部件独立于所述第一音频处理部件放置时,所述音频采集部件采集的音频信号经由第二通讯连接传输至所述第一音频处理部件;其中,所述第一通讯连接和所述第二通讯连接不同;所述第一音频处理部件还用于将所述音频信号发送到远端的其他音频设备。本实施例实现音频采集端的可拆卸式设计。

Description

音频采集方法、系统及计算机可读存储介质 技术领域
本申请涉及音频采集技术领域,具体而言,涉及一种音频采集方法、系统及计算机可读存储介质。
背景技术
随着技术的发展,音频采集产品也越来越多样化,诸如有线麦克风、无线麦克风、录音笔、头戴式耳机、具有录音功能的设备(如手机、相机、电脑或者平板等)等。其中,相关技术中的音频采集产品,其采集端通常作为一个整体被设计成一个不可拆分的一体化结构。
发明内容
有鉴于此,本申请的目的之一是提供一种音频采集方法、系统及计算机可读存储介质。
第一方面,考虑到相关技术中的音频采集产品,其采集端通常作为一个整体被设计成一个不可拆分的一体化结构,存在以下问题:(1)被设计成一体化结构的采集端通常体积较大,存在采集不便的问题;(2)被设计成一体化结构的采集端的使用方式单一,使用场景受限,无法满足多样化的使用需求。
基于此,本申请实施例提供了一种音频采集系统,所述音频采集系统包括第一音频处理部件、和与所述第一音频处理部件可拆卸连接的音频采集部件;
所述音频采集部件包括供电模块;
所述第一音频处理部件设置有第一导电端子,所述音频采集部件设置有第二导电端子;
当所述音频采集部件装设于所述第一音频处理部件时,所述第一导电端子与所述第二导电端子接触并建立有线通讯连接,所述音频采集部件采集的音频信号经由所述有线通讯连接传输给所述第一音频处理部件;
当所述音频采集部件独立于所述第一音频处理部件放置时,所述音频采集部件基于所述供电模块工作,所述音频采集部件与所述第一音频处理部件建立第一无线通讯连接,所述音频采集部件将采集的音频信号经由所述第一无线通讯连接发送给所述第一音频处理部件;
所述第一音频处理部件用于通过第二无线通讯连接将所述音频信号发送到远端的其他音频设备。
本实施例中,对音频采集端中的功能进行分类,将音频采集端设计成可拆分的第一音频处理部件和音频采集部件,实现对音频采集端的结构进行可拆卸式的模块化设计,在拆分后各个部件的体积更为小巧,方便用户使用,而且用户可以根据实际使用需求选择不同的使用方式,比如当所述音频采集部件独立于所述第一音频处理部件放置时,体积小巧的音频采集部件可被穿戴于用户身上的任意部位,使用方式多样化,有利于提高了用户的使用体验。
第二方面,考虑到相关技术中音频采集产品,其采集端通常作为一个整体被设计成一个不可拆分的一体化结构,从而限定了这些音频采集产品的使用方式(或者说采集方式),比如无线麦的发射端一般在领口位置,录音笔一般手持或者放在一个平台面,其采集的音频无法满足用户的听觉需求。
基于此,本申请实施例提供了一种音频采集系统,所述音频采集系统包括第一音频处理部件和至少两个独立的音频采集部件;
所述音频采集部件设置有穿戴部,至少两个所述音频采集部件能够通过所述穿戴部分别固定在人体的不同位置;
所述音频采集部件能够与所述第一音频处理部件建立第一无线通讯连接;
所述第一音频处理部件用于:
获取所述音频采集部件的穿戴位置信息;
通过所述第一无线通讯连接接收由至少两个所述音频采集部件分别采集的音频信号;
基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声。
本实施例中,所述音频采集系提供有至少两个独立的音频采集部件,用户可以根据实际需要将至少两个独立的音频采集部件固定在人体的不同位置,以便在用户与他人沟通过程中所述至少两个独立的音频采集部件分别采集音频信号,实现多个位置的音频采集,进而还能根据音频采集部件的穿戴位置将在多个不同位置上采集的音频信 号合成立体声,能够模拟人耳真实听觉感受,满足用户的听觉需求。
第三方面,本申请实施例提供了一种音频采集系统,所述音频采集系统包括第一音频处理部件和音频采集部件;所述第一音频处理部件与所述音频采集部件可拆卸的连接;
当所述音频采集部件装设于所述第一音频处理部件时,所述音频采集部件采集的音频信号经由第一通讯连接传输至所述第一音频处理部件;
当所述音频采集部件独立于所述第一音频处理部件放置时,所述音频采集部件采集的音频信号经由第二通讯连接传输至所述第一音频处理部件;其中,所述第一通讯连接和所述第二通讯连接不同;
所述第一音频处理部件还用于将所述音频信号发送到远端的其他音频设备。
第四方面,本申请实施例提供了一种音频采集方法,应用于音频采集系统中的第一音频处理部件;所述第一音频处理部件与音频采集部件可拆卸连接;所述音频采集部件包括供电模块;所述第一音频处理部件设置有第一导电端子,所述音频采集部件设置有第二导电端子;
所述方法包括:
当所述音频采集部件装设于所述第一音频处理部件时,接收所述音频采集部件经由有线通讯连接传输的音频信号;所述有线通讯连接由所述第一导电端子与所述第二导电端子接触并建立;
当所述音频采集部件独立于所述第一音频处理部件放置时,接收所述音频采集部件经由第一无线通讯连接发送的音频信号;其中,所述音频采集部件基于所述供电模块工作;
通过第二无线通讯连接将所述音频信号发送到远端的其他音频设备。
第五方面,本申请实施例提供了一种音频采集方法,应用于音频采集系统中的第一音频处理部件;所述音频采集系统还包括至少两个独立的音频采集部件;所述音频采集部件设置有穿戴部,至少两个所述音频采集部件能够通过所述穿戴部分别固定在人体的不同位置;所述音频采集部件能够与所述第一音频处理部件建立第一无线通讯连接;
所述方法包括:
获取所述音频采集部件的穿戴位置信息;
通过所述第一无线通讯连接接收由至少两个所述音频采集部件分别采集的音频信号;
基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声。
第六方面,本申请实施例提供了一种计算机可读存储介质,所述计算机可读存储介质存储有可执行指令,所述可执行指令被处理器执行时实现如第四方面或第五方面任意一项所述的方法。
附图说明
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1~图8是本申请实施例提供的音频采集系统的不同结构示意图;
图9是本申请实施例提供的音频采集系统的工作流程示意图;
图10和图11是本申请实施例提供的音频采集方法的不同流程示意图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
相关技术中的音频采集产品,其采集端通常作为一个整体被设计成一个不可拆分的一体化结构,存在以下问题:(1)被设计成一体化结构的采集端通常体积较大,存在采集不便的问题;(2)被设计成一体化结构的采集端的使用方式单一,使用场景受限,无法满足多样化的使用需求。
针对于上述问题,本申请实施例提供了一种音频采集系统,所述音频采集系统包括第一音频处理部件、和与所述第一音频处理部件可拆卸连接的音频采集部件;所述音频采集部件可以装设于所述第一音频处理部件中,也可以独立于所述第一音频处理部件放置,所述音频采集部件将采集的音频信号传输给所述第一音频处理部件,由所述第一音频处理部件将音频信号发送到远端的其他音频设备。本实施例中,对音频采 集端中的功能进行分类,将音频采集端设计成可拆分的第一音频处理部件和音频采集部件,实现对音频采集端的结构进行可拆卸式的模块化设计,在拆分后各个部件的体积更为小巧,方便用户使用,而且用户可以根据实际使用需求选择不同的使用方式,比如当所述音频采集部件独立于所述第一音频处理部件放置时,体积小巧的音频采集部件可被穿戴于用户身上的任意部位,使用方式多样化,有利于提高了用户的使用体验。
其中,本申请实施例提供的音频采集系统适用于任何音频采集场景,本实施例对此不做任何限制。在一示例性的应用场景中,当所述音频采集部件装设于所述第一音频处理部件时,用户可以手持该音频采集系统进行音频采集,或者该音频采集系统可以被放置在预设位置上,例如被放置在一平台上,或者被架设在一支架上。在另一示例性的应用场景中,当所述音频采集部件独立于所述第一音频处理部件放置时,所述音频采集部件可被放置在音源附近,比如可以被穿戴于正在说话的用户身上,可以穿戴于用户的任意部位,比如佩戴于耳部、颈部或者头部,或者夹持在领口等等。
接下来对本申请实施例提供的音频采集系统100进行说明:所述音频采集系统100包括第一音频处理部件10、和与所述第一音频处理部件10可拆卸连接的音频采集部件20;其中,所述音频采集部件20包括供电模块21;所述第一音频处理部件10设置有第一导电端子11,所述音频采集部件20设置有第二导电端子22。
请参阅图1,当所述音频采集部件20装设于所述第一音频处理部件10时,所述第一导电端子11与所述第二导电端子22接触并建立有线通讯连接,所述音频采集部件20采集的音频信号经由所述有线通讯连接传输给所述第一音频处理部件10。
请参阅图2,当所述音频采集部件20独立于所述第一音频处理部件10放置时,所述音频采集部件20基于所述供电模块21工作,所述音频采集部件20与所述第一音频处理部件10建立第一无线通讯连接,所述音频采集部件20将采集的音频信号经由所述第一无线通讯连接发送给所述第一音频处理部件10。
所述第一音频处理部件10可以与远端的其他音频设备建立第二无线通讯连接,在接收到所述音频采集部件20采集的音频信号之后,所述第一音频处理部件10可以通过第二无线通讯连接将所述音频信号发送到远端的其他音频设备。示例性的,所述音频设备可以播放接收到的所述音频信号,或者将所述音频信号进行进一步地编辑处理,或者将所述音频信号转发给其他设备。
本实施例中,所述音频采集部件20主要负责音频采集功能,第一音频处理部件10负责音频远端传输功能,实现对音频采集端中的功能进行分类,将音频采集端设计 成可拆分的第一音频处理部件10和音频采集部件20,实现对音频采集端的结构进行可拆卸式的模块化设计,在拆分后各个部件的体积更为小巧,方便用户使用,而且所述音频采集部件20可以装设于所述第一音频处理部件10中,也可以独立于所述第一音频处理部件10放置,用户可以根据实际使用需求选择不同的使用方式,使用方式多样化,有利于提高了用户的使用体验。示例性的,所述第一音频处理部件10设置有容纳槽,用于容纳所述音频采集部件20;当所述音频采集部件20装设于所述第一音频处理部件10时,所述音频采集部件20置于所述容纳槽中。可以理解的是,本实施例对于所述容纳槽的具体结构不做任何限制,在满足所述容纳槽的结构适配于所述音频采集部件20的形状的情况下,可依据实际应用场景进行具体设置。
当所述音频采集部件20装设于所述第一音频处理部件10时,所述音频采集模块的供电模块21可以处于关闭状态,不为所述音频采集模块供电,而所述第一音频处理部件10能够通过所述第一导电端子11与所述第二导电端子22的接触为所述音频采集部件20供电,所述音频采集部件20和所述第一音频处理部件10作为一个整体进行工作,另外,所述音频采集模块的供电模块21在音频采集部件20装设于所述第一音频处理部件10时不工作,也有利于节省所述供电模块21的电量,提高所述音频采集模块在被独立放置时的续航能力。
进一步地,当所述音频采集部件20装设于所述第一音频处理部件10时,在所述音频采集模块的供电模块21的电量未满的情况下,所述第一音频处理部件10还能够通过所述第一导电端子11与所述第二导电端子22的接触为所述供电模块21充电,从而有利于提高所述音频采集模块在被独立放置时的续航能力。
示例性的,所述音频采集部件20设置有穿戴部,当所述音频采集部件20独立于所述第一音频处理部件10放置时,所述音频采集部件20用于通过所述穿戴部固定于人体。其中,所述穿戴部可适配于用户的多个不同部位,从而使得所述音频采集部件20可基于所述穿戴部固定在人体中的多个不同的部位,比如可以穿戴于人体的耳部、头部、颈部、肩部或者胸部等等,用户可以根据实际需要将所述音频采集部件20通过穿戴部固定在身上,比如戴在头上或者佩戴在耳部等。所述穿戴部的具体形状可依据实际应用场景进行具体设置,本实施例对此不做任何限制。
作为例子,所述音频采集部件20和所述可穿戴部可拆卸连接,所述穿戴部的数量有多个,不同的穿戴部适配于用户的不同部位,比如有耳挂式穿戴部、头戴式穿戴部、夹持式穿戴部或者挂颈式穿戴部等等,可以根据实际需要将所述音频采集部件20与其中一个可穿戴部连接,以将所述音频采集部件20通过所述穿戴部固定于人体的相应部 位,比如将所述音频采集部件20与耳挂式穿戴部连接,所述音频采集部件20通过耳挂式穿戴部固定于人体的耳部。
作为例子,所述音频采集部件20和所述穿戴部固定连接,所述穿戴部集成了能够固定于人体多个不同部位的多种结构,可依据实际情况选择其中一个结构将所述音频采集部件20固定于人体。
在一示例性的实施例中,比如在音视频采集场景中,请参阅图3以及图4,所述音频采集系统100可以包括第一音频处理部件10、第二音频处理部件30和与所述第一音频处理部件10可拆卸连接的音频采集部件20。其中,所述音频采集部件20可以装设于所述第一音频处理部件10中,也可以独立于所述第一音频处理部件10放置,所述第一音频处理部件10能够与所述第二音频处理部件30建立第二无线通讯连接,然后通过所述第二无线通讯连接将所述音频采集部件20采集的音频信号发送给所述第二音频处理部件30。
所述第二音频处理部件30用于与影像采集设备连接,比如所述第二音频处理部件30可以设置在所述影像采集设备上,并与所述影像采集设备通过预设端口(如USB端口)有线连接,或者所述第二音频处理部件30也可以采用无线通讯方式与所述影像采集设备连接;所述第二音频处理部件30在与所述影像采集设备连接之后,能够将所述音频采集部件20采集的音频信号传输给所述影像采集设备,以将所述音频信号与所述影像采集设备采集的影像信号合成为音视频数据流。
在一些实施例中,考虑到当所述音频采集部件20独立于所述第一音频处理部件10放置时,通常所述音频采集部件20和第一音频处理部件10分别的放置位置通常不会太远,比如可能都在用户的可视范围内,而所述第二音频处理部件30或者远端的其他音频设备所在位置本实施对此不做任何限制,比如所述第二音频处理部件30或者远端的其他音频设备不在用户的可视范围内,在这种情况下,所述第一无线通讯连接的信号强度大于所述第二无线通讯连接的信号强度。
示例性的,考虑到当所述音频采集部件20独立于所述第一音频处理部件10放置时,通常所述音频采集部件20和第一音频处理部件10之间的距离较近,则所述第一无线通讯连接可以是近场通信连接,如基于蓝牙协议、红外协议、UWB(超宽带)协议连接;而第一音频处理部件10和远端的其他音频设备(例如第二音频处理部件30或者其他音频接收设备)的距离较远,则所述第二无线通讯连接可以是远程通讯连接,如基于以太网通讯连接。
在一些实施例中,请参阅图5以及图6,所述第一音频处理部件10设置有麦克风 12,所述第一音频处理部件10能够使用所述麦克风12来采集音频信号。即是说,在所述音频采集系统100中,可以使用音频采集部件20来采集音频信号,也可以使用所述麦克风12来采集音频信号,所述音频采集部件20和所述麦克风12可以同时采集音频信号,也可以使用两者中的一者来采集音频信号,本实施例对此不做任何限制。所述第一音频处理部件10能够将所述麦克风12采集的音频信号和/或所述音频采集部件20采集的音频信号发送到远端的其他音频设备。
当所述音频采集部件20独立于所述第一音频处理部件10放置时,所述麦克风12和所述音频采集部件20可以同时采集音频信号,所述第一音频处理部件10还用于将所述音频采集部件20采集的音频信号和所述麦克风12采集的音频信号发送到远端的其他音频设备。其中,所述麦克风12采集的音频信号用于对所述音频采集部件20采集的音频信号进行音频处理。本实施例中,实现使用麦克风12采集的音频信号来优化所述音频采集部件20采集的音频信号,从而有利于提高优化后的音频信号的质量和播放效果。
示例性的,当所述音频采集部件20独立于所述第一音频处理部件10放置时,所述音频采集部件20可以放置在靠近音源的位置(比如穿戴于说话的用户身上),而所述第一音频处理部件10可以放置在所述音源(比如所述用户)所在的环境空间中,所述麦克风12和所述音频采集部件20可以同时采集音频信号,所述音频采集部件20能够采集到有关于音源(比如所述用户)的音频信号,所述第一音频处理部件10中的麦克风12可以采集有关于环境音的音频信号,进而可以使用所述麦克风12采集的音频信号来对所述音频采集部件20采集的音频信号进行音频处理。
在一个例子中,比如在所述音频采集部件20采集的音频信号风噪过大的情况下,可以采用所述麦克风12采集的音频信号对所述音频采集部件20采集的音频信号进行音频修饰,比如获取与所述麦克风12采集的音频信号相位相反的补偿信号,并使用所述补偿信号来补偿所述音频采集部件20采集的音频信号,抵消所述音频采集部件20采集的音频信号中的风噪,以突出目标频段(比如突出人声)。在另一个例子中,又比如可以从所述麦克风12采集的音频信号提取环境音成分,并为所述音频采集部件20采集的音频信号增加环境音成分,以使增加后的音频信号更加自然。
当所述音频采集部件20装设于所述第一音频处理部件10时,考虑到麦克风12采集的音频信号和音频采集部件20采集的音频信号基本相同,因此,为了能够有效节省损耗,可以使用麦克风12和所述音频采集部件20中的任一者来采集音频信号,从而能够有效节省所述音频采集系统100的电力损耗,提高音频采集系统100的续航能 力。当然,所述麦克风12和所述音频采集部件20也可以同时采集音频信号,本实施例对此不做任何限制。
在一些实施例中,由上述描述可知,在所述第一音频处理部件10设置有麦克风12的情况下,当所述音频采集部件20独立于所述第一音频处理部件10放置时,所述音频采集部件20可以放置在靠近音源的位置(比如穿戴于说话的用户身上),而所述第一音频处理部件10可以放置在所述音源(比如所述用户)所在的环境空间中。考虑到第一音频处理部件10被放置在环境空间中的不同位置时,所述第一音频处理部件10中的麦克风12所采集的音频信号也有所不同,在有些位置上采集的音频信号可能不符合使用需求,比如在所述音频所处环境空间较大的情况下,第一音频处理部件10被放置在与所述音源同一环境空间但是比较远的位置,该位置的环境音与音源所在位置的环境音可能有所差异,导致麦克风12采集的音频信号不符合使用需求。
基于此,在一种可能的实现方式中,当所述音频采集部件20独立于所述第一音频处理部件10放置时,所述第一音频处理部件10还能够确定所述麦克风12的采集位置,然后根据所述采集位置与预设的参考位置之间的差异,输出位置提示信息;所述位置提示信息用于提醒用户将所述第一音频处理部件10移动至所述参考位置;所述参考位置为采集的音频信号符合使用需求的位置,所述参考位置可依据实际应用场景进行具体设置,本实施例对此不做任何限制。
示例性的,所述第一音频处理部件10可以设置有视觉传感器,所述第一音频处理部件10可以基于视觉定位方式来确定所述麦克风12所在的采集位置,比如所述麦克风12的采集位置根据所述视觉传感器采集的第二影像的识别结果确定;又比如所述麦克风12的采集位置根据所述视觉传感器采集第二影像时的位姿确定。
在另一种可能的实现方式中,当所述音频采集部件20独立于所述第一音频处理部件10放置时,所述第一音频处理部件10还能够确定所述麦克风12与所述音频采集部件20之间的距离,在该距离大于预设距离值的情况下,输出提示信息,所述提示信息用于提醒用户将所述第一音频处理部件10移动至距所述音频采集部件20更近的位置,以使得所述麦克风12采集的音频信号满足使用需求。示例性的,所述第一音频处理部件10可以基于所述第一无线通讯连接的信号强度来确定所述麦克风12与所述音频采集部件20之间的距离,信号强度越大,表示所述麦克风12与所述音频采集部件20之间的距离越近。
在一些实施例中,所述第一音频处理部件10还具有编辑处理功能,所述第一音频处理部件10能够对麦克风采集的音频信号和/或所述音频采集部件采集的所述音频信 号进行编辑处理,有利于提高所述音频信号的质量(比如播放质量或者传输质量等),并通过第二无线通讯连接将处理后的音频信号发送到远端的其他音频设备。其中,所述编辑处理包括但不限于合成处理、增强处理、降噪处理和/或滤波处理等等。
示例性的,在所述音频采集系统100包括至少一个音频采集部件20的情况下,所述第一音频处理部件10能够对至少一个音频采集部件20采集的音频信号进行无线增强处理,从而使得处理后的音频信号能够发射的距离更远、丢包率更低,提高了所述音频信号的传输质量。
示例性的,在所述第一音频处理部件10设置有麦克风12的情况下,所述第一音频处理部件10可以使用所述麦克风12采集的音频信号来对所述音频采集部件20采集的音频信号进行音频处理,比如将所述麦克风12采集的音频信号和所述音频采集部件20采集的音频信号进行合成处理;或者使用所述麦克风12采集的音频信号对所述音频采集部件20采集的音频信号进行降噪处理,从而使得处理后的音频信号具有更佳的播放效果。
示例性的,在所述音频采集系统100包括至少两个音频采集部件20的情况下,所述第一音频处理部件10能够对至少两个音频采集部件20采集的音频信号进行合成处理,从而使得处理后的音频信号具有更佳的播放效果。
在一些实施例中,考虑到音频采集部件20可以穿戴于人体,为了减轻人体负担,所述音频采集部件20可以只具备音频采集功能即可,从而有利于减少所述音频采集部件20的重量和/或体积,而其他的音频处理功能可以集成在所述第一音频处理部件10中,可以根据实际需要在所述第一音频处理部件10中设置更多的功能;则所述音频采集部件20的体积小于所述第一音频处理部件10的体积;和/或,所述音频采集部件20的重量小于所述第一音频处理部件10的重量。
在一些实施例中,考虑到相关技术中音频采集产品,其采集端通常作为一个整体被设计成一个不可拆分的一体化结构,从而限定了这些音频采集产品的使用方式(或者说采集方式),比如无线麦的发射端一般在领口位置,录音笔一般手持或者放在一个平台面,其采集的音频无法满足用户的听觉需求。
基于此,请参阅图7,本申请实施例提供了一种音频采集系统100,所述音频采集系统100包括第一音频处理部件10以及至少两个独立的音频采集部件20;即至少两个音频采集部件20可独立于所述第一音频处理部件10放置。其中,所述音频采集部件20设置有穿戴部23,至少两个所述音频采集部件20能够通过所述穿戴部23分别固定在人体的不同位置。
所述音频采集部件20能够与所述第一音频处理部件10建立第一无线通讯连接;例如当所述音频采集部件20独立于所述第一音频处理部件10放置时,所述音频采集部件20基于所述供电模块21工作,所述音频采集部件20与所述第一音频处理部件10建立第一无线通讯连接。
所述第一音频处理部件10用于:获取所述音频采集部件20的穿戴位置信息;通过所述第一无线通讯连接接收由至少两个所述音频采集部件20分别采集的音频信号;基于所述穿戴位置信息将至少两个所述音频采集部件20分别采集的音频信号合成为立体声。
本实施例中,所述音频采集系统100提供有至少两个独立的音频采集部件20,用户可以根据实际需要将至少两个独立的音频采集部件20固定在人体的不同位置,以便在用户与他人沟通过程中所述至少两个独立的音频采集部件20分别采集音频信号,实现多个位置的音频采集,进而还能根据音频采集部件20的穿戴位置将在多个不同位置上采集的音频信号合成立体声,能够模拟人耳真实听觉感受,满足用户的听觉需求。
在一些实施例中,所述第一音频处理部件10与远端的其他音频设备建立第二无线通讯连接,所述第一音频处理部件10还能够将所述立体声发送到远端的其他音频设备。示例性的,比如在音视频采集场景中,所述音频采集系统100还包括第二音频处理部件30。其中,所述第一音频处理部件10能够与所述第二音频处理部件30建立第二无线通讯连接,然后通过所述第二无线通讯连接将所述立体声发送给所述第二音频处理部件30。所述第二音频处理部件30用于与影像采集设备连接,能够将所述立体声传输给所述影像采集设备,以将所述立体声与所述影像采集设备采集的影像信号合成为音视频数据流。
在一些实施例中,所述音频采集部件20的穿戴位置信息可以由所述音频采集部件20确定之后,将确定的穿戴位置信息发送给所述第一音频处理部件10。
在一些可能的实施方式中,所述音频采集部件20设置有接近传感器,所述接近传感器用于在所述音频采集部件20独立于所述第一音频处理部件10放置的情况下,确定所述音频采集部件20是否与人体接触。可以理解的是,本申请实施例对于所述接近传感器的具体类型不做任何限制,可依据实际应用场景进行具体设置,例如所述接近传感器包括但不限于电容式接近传感器、电感式接近传感器、光电式接近传感器、红外传感器或者超声波传感器等等。
所述音频采集部件20还设置有除所述接近传感器之外的预设传感器,在确定所述音频采集部件20与人体接触的情况下,所述音频采集部件20使用所述预设传感器获 取人体特征参数,并基于所述人体特征参数确定所述音频采集部件20当前的穿戴位置信息,将所述穿戴位置信息经由所述第一无线通讯连接发送给所述第一音频处理部件10。
示例性的,所述预设传感器包括骨传导传感器,所述人体特征参数包括从穿戴部23位采集的骨传导信号;在确定所述音频采集部件20与人体接触的情况下,所述音频采集部件20使用所述骨传导传感器从穿戴部23位采集骨传导信号,然后根据所述骨传导信号与预设语音信号之间的相关性,从预设语音信号与穿戴部23位的映射关系中确定所述音频采集部件20当前的穿戴位置信息。其中,所述骨传导信号与预设语音信号之间的相关性可以通过所述骨传导信号和所述预设语音信号两者的强度、振幅、能量或者频率等参数之间的差异来确定,差异越小,表示所述骨传导信号与预设语音信号之间的相关性越高,差异越大,表示所述骨传导信号与预设语音信号之间的相关性越低。例如可以设置一差异阈值,当所述骨传导信号和所述预设语音信号两者的强度、振幅、能量或者频率等参数之间的差异小于该差异阈值时,表示所述骨传导信号与预设语音信号具有强相关性,则可以根据所述预设语音信号所映射的穿戴部23位获得所述穿戴位置信息。
示例性的,所述预设传感器包括视觉传感器,所述人体特征参数包括有关于穿戴部23位的第一影像;在确定所述音频采集部件20与人体接触的情况下,所述音频采集部件20使用所述视觉传感器采集有关于穿戴部23位的第一影像,然后根据从所述第一影像中提取的轮廓信息确定所述音频采集部件20当前的穿戴位置信息;例如所述音频采集部件20可根据所述轮廓信息以及预设的映射关系(表示轮廓信息与人体穿戴部23位的映射关系)确定人体穿戴部23位,从而获取所述穿戴位置信息。
在一些实施例中,至少两个独立的音频采集部件20的穿戴位置对于最终合成的立体声的播放质量也有所影响,比如如果所述至少两个独立的音频采集部件20固定在人体的同一侧,则合成的立体声可能无法完全模拟人耳真实听觉效果,立体声播放效果不佳。因此,为了提高合成的立体声的真实模拟效果,所述第一音频处理部件10在获取至少两个所述音频采集部件20分别发送的穿戴位置信息和音频信号之后,所述第一音频处理组件首先判断所述穿戴位置信息与预设穿戴位置条件是否符合,所述预设穿戴位置条件指示所述至少两个独立的音频采集部件20的穿戴位置能够有效保证合成的立体声的真实模拟效果。
其中,所述预设穿戴位置条件包括:至少两个所述音频采集部件20中的其中两个相对于人体中轴对称放置、或者至少两个所述音频采集部件20分别穿戴于人体的不同 预设部位,所述不同预设部位中的其中两个相对于人体中轴对称。例如在实际应用场景中,至少两个所述音频采集部件20中的其中两个分别穿戴于用户的左右耳或者左右肩膀上。例如,在实际应用场景中,所述音频采集系统100包括有3个音频采集部件20,其中两个音频采集部件20分别穿戴于用户的左右耳,第三个音频采集部件20穿戴于用户的头部或者颈部等。
若所述穿戴位置信息与预设穿戴位置条件符合,表明至少两个所述音频采集部件20分别采集的音频信号能够合成符合要求的立体声,则所述第一音频处理部件10基于所述穿戴位置信息将至少两个所述音频采集部件20分别采集的音频信号合成为立体声,然后还可以将所述立体声传输给远端的其他音频设备。若所述穿戴位置信息与预设穿戴位置条件不符合,表明至少两个所述音频采集部件20分别采集的音频信号所合成的立体声不符合要求,则所述第一音频处理部件10基于所述穿戴位置信息发出提示信息,所述提示信息用于提示用户将至少两个音频采集部件20穿戴在人体符合要求的位置。本实施例中,在获取所述穿戴位置信息之后判断所述穿戴位置信息是否符合穿戴条件,有利于提高合成的立体声的真实效果。
在一些实施例中,在合成立体声的过程中,所述第一音频处理部件10可以基于所述穿戴位置信息,确定所述音频信号的幅度、相位和/或频率的调制方式;然后基于所述调制方式对至少两个所述音频采集部件20分别采集的音频信号进行调制,得到所述立体声。本实施例中,能够基于用户不同的穿戴部23位,对所述音频信号的幅度、相位和/或频率进行调制,从而获得具有真实听觉效果的立体声。
其中,考虑到至少两个所述音频采集部件20的所述穿戴位置信息不同,则音频采集部件20与声源之间的相对位置或者距离也不同,使得至少两个所述音频采集部件20分别采集的音频信号有所差异,则各个所述音频信号之间的幅度、相位和/或频率的调制方式也不同。本实施例中,采用不同的调制方式对音频信号进行处理,有利于提高合成的立体声的真实效果。
示例性的,所述音频采集部件20的数量不同和/或所述穿戴位置信息不同,所述音频信号的幅度、相位和/或频率的调制方式也不同,合成的立体声也有所不同,从而有利于满足用户的多样化需求。在一个例子中,所述音频采集系统100包括两个音频采集部件20,两个音频采集部件20分别固定于人体的左右耳以采集音频信号,合成的立体声为双耳道立体声。在另一个例子中,所述音频采集系统100包括三个音频采集部件20,其中两个音频采集部件20分别固定于人体的左右耳,第三个音频采集部件20固定于人体头部,合成的立体声为3D环绕式立体声。
示例性的,所述调制方式根据所述穿戴位置信息指示的穿戴部23位与音源之间的相对位置关系和/或距离确定;比如所述第一音频处理部件10可以基于所述穿戴位置信息包括的所述穿戴部23位与音源之间的相对位置关系和/或距离确定所述音频信号的幅度、相位和/或频率的调制方式;其中,所述穿戴部23位与音源之间的相对位置关系和/或距离不同,所述音频信号的幅度、相位和/或频率的调制方式也不同,获得的立体声也有所不同。
示例性的,所述第一音频处理部件10预存有针对于音频信号的幅度、相位和/或频率的多种候选调制方式;其中,不同的候选调制方式对应不同的穿戴位置信息;所述调制方式可以根据所述穿戴位置信息,从多种候选调制方式中选择得到。
示例性的,所述第一音频处理部件10预存有参考穿戴位置采集的参考音频信号、和针对于所述参考音频信号的幅度、相位和/或频率的参考调制方式,在实际使用过程中,所述第一音频处理部件10可以根据获取到的穿戴位置信息与所述参考穿戴位置之间的差异,对所述参考调制方式进行调整,从而获取所述穿戴位置信息对应的调制方式。
在一些实施例中,所述第一音频处理部件10还可以对所述立体声进行编辑处理,并将通过所述第二无线通讯连接将处理后的立体声发送到远端的其他音频设备;其中,所述编辑处理包括但不限于增强处理、降噪处理和/或滤波处理等,从而有利于提高所述立体声的播放效果。示例性的,所述第一音频处理部件10可以对所述立体声进行无线增强处理,从而使得处理后的立体声可以发射得更远,丢包率更低。
在一些实施例中,请参阅图8,所述第一音频处理部件10还设置有麦克风12;所述第一音频处理部件10还用于将所述麦克风12采集的音频信号叠加到所述立体声中,然后通过所述第二无线通讯连接将叠加后的立体声发送到远端的其他音频设备。本实施例中在立体声中叠加所述麦克风12采集的音频信号,有利于提高所述立体声的播放效果。
示例性的,至少两个所述音频采集部件20可以放置在靠近音源的位置(比如穿戴于说话的用户的不同部位),而所述第一音频处理部件10可以放置在所述音源(比如所述用户)所在的环境空间中,所述麦克风12和所述音频采集部件20可以同时采集音频信号,所述音频采集部件20能够采集到有关于音源(比如所述用户)的音频信号,所述第一音频处理部件10中的麦克风12可以采集有关于环境音的音频信号,则可以从所述麦克风12采集的音频信号中提取环境音成分,并叠加到合成的所述立体声中,增加所述立体声的真实感。
在一些实施例中,在所述第一音频处理部件10并不具备立体声合成功能的情况下,所述第一音频处理部件10还用于:获取至少两个所述音频采集部件20的穿戴位置信息和音频信号;通过第二无线通讯连接将至少两个所述音频采集部件20分别采集的音频信号和穿戴位置信息发送到远端的其他音频设备,以使其他音频设备基于所述穿戴位置信息将至少两个所述音频采集部件20分别采集的音频信号合成为立体声。
示例性的,所述第一音频处理部件10还设置有麦克风12;所述第一音频处理部件10还用于将所述麦克风12采集的音频信号通过第二无线通讯连接发送到远端的其他音频设备,以使其他音频设备将所述麦克风12采集的音频信号叠加到所述立体声中。
示例性的,所述第一音频处理部件10包括有存储器,可以存储器中存储所述音频采集部件采集的音频信号,所述麦克风采集的音频信号和/或所述立体声等等。
示例性的,为提高传输效率,所述音频采集部件20可以将采集的音频信号进行编码,然后将编码后的音频信号通过所述第一无线通讯连接或者所述有线通讯连接传输给所述第一音频处理部件10,所述第一音频处理部件10具有解码功能,可以对编码后的音频信号进行解码处理。
在一示例性的实施例中,以所述音频采集系统100包括一个第一音频处理部件10和至少两个音频采集部件20为例,在所述音频采集系统100实际使用过程中,首先所述第一音频处理部件10检测各个所述音频采集部件20是否装设于所述第一音频处理部件10上,
针对于每个音频采集部件20,如果确定所述音频采集部件20装设于所述第一音频处理部件10,比如所述第一音频处理部件10如果检测到自身与所述音频采集部件20建立了有线通讯连接,或者所述第一音频处理部件10的第一导电端子和所述第一音频处理部件10的第二导电端子有接触,确定两者处于组合状态。则所述第一音频处理部件10通过所述有线通讯连接接收所述第一音频处理部件10采集的音频信号,并发送到远端的其他音频设备。
如果确定所述音频采集部件20并未装设于所述第一音频处理部件10,即所述音频采集部件20独立于所述第一音频处理部件10放置,所述第一音频处理部件10检测自身与所述音频采集部件20是否建立了第一无线通讯连接。
如果所述音频采集部件20与所述第一音频处理部件10并未建立第一无线通讯连接,可能所述音频采集部件20并未开机或者在无线通讯距离之外,所述第一音频处理部件10发出通讯异常的提示信息,此时所述音频采集部件20无法采集音频信号或者采集的音频信号无法传输。
如果所述音频采集部件20与所述第一音频处理部件10建立了第一无线通讯连接,所述第一音频处理部件10通过所述第一无线通讯连接通知所述音频采集部件20进行穿戴位置检测,所述音频采集部件20首先检测自身是否与人体接触。
如果所述音频采集部件20与人体接触,所述音频采集部件20确定所述音频采集部件20当前的穿戴位置信息,将所述穿戴位置信息经由所述第一无线通讯连接发送给所述第一音频处理部件10;进而所述第一音频处理部件10获取至少两个所述音频采集部件20的穿戴位置信息,基于所述穿戴位置信息将至少两个所述音频采集部件20分别采集的音频信号合成为立体声,通过第二无线通讯连接将所述立体声发送到远端的其他音频设备。
在一个示例性的应用场景中,请参阅图9,以所述音频采集系统包括一个第一音频处理部件和2个可穿戴于耳部的音频采集部件(以下称为耳机A和耳机B)为例:
在第一音频处理部件开机之后,所述第一音频处理部件检查自身是否装设有耳机A和耳机B:在步骤S11中,所述第一音频处理部件检查自身是否与耳机A建立了有线通讯连接;以及,在步骤S21中,所述第一音频处理部件检查自身是否与耳机B建立了有线通讯连接。
当耳机A、耳机B装设于所述第一音频处理部件:在步骤S12中,耳机A采集的音频信号经由有线通讯连接传输给第一音频处理部件,第一音频处理部件通过第二无线通讯连接将所述音频信号发送到远端的其他音频设备;以及,在步骤S21中,耳机B采集的音频信号经由有线通讯连接传输给第一音频处理部件,第一音频处理部件通过第二无线通讯连接将所述音频信号发送到远端的其他音频设备。示例性的,所述第一音频处理部件还可以通过预设传感器检测自身(含耳机A和/或耳机B)是否被穿戴于人体(比如被夹持在领口、手腕等)或者被手持,并根据检测结果输出穿戴提醒信息,以提醒用户当前第一音频处理部件的穿戴情况(比如处于非穿戴模式、非手持模式、穿戴模式、手持模式中的任意一种)。
当耳机A、耳机B并未装设于所述第一音频处理部件,即耳机A、耳机B独立于第一音频处理部件放置:在步骤S13中,第一音频处理部件检测自身与耳机A是否建立了第一无线通讯连接;以及,在步骤S23中,第一音频处理部件检测自身与耳机B是否建立了第一无线通讯连接。
如果耳机A、耳机B并未与所述第一音频处理部件建立第一无线通讯连接,可能耳机A、耳机B未开机或者放置距离较远(即处于无线通信距离之外):在步骤S14中,第一音频处理部件输出与耳机A相关的通信异常信息,所述耳机A无法采集音频 信号或者采集的音频信号无法传输;以及,在步骤S24中,第一音频处理部件输出与耳机B相关的通信异常信息,所述耳机B无法采集音频信号或者采集的音频信号无法传输。
如果耳机A、耳机B与所述第一音频处理部件建立第一无线通讯连接:在步骤S15中,所述第一音频处理部件通知耳机A进行穿戴检测;以及,在步骤S25中,所述第一音频处理部件通知耳机B进行穿戴检测。
耳机A、耳机B的穿戴检测过程:在步骤S16中,耳机A通过人体接近传感器检测自身是否与人体接触;以及,在步骤S26中,耳机B通过人体接近传感器检测自身是否与人体接触。
如果耳机A、耳机B未与人体接触:在步骤S17中,耳机A将采集的音频信号和未穿戴信息发送给第一音频处理部件,所述第一音频处理部件根据未穿戴信息输出提示信息(比如提示用户穿戴耳机A)以及将所述音频信号发送到远端的其他音频设备;以及,在步骤S27中,耳机B将采集的音频信号和未穿戴信息发送给第一音频处理部件,所述第一音频处理部件根据未穿戴信息输出提示信息(比如提示用户穿戴耳机B)以及将所述音频信号发送到远端的其他音频设备。
如果耳机A、耳机B与人体接触:在步骤S18中,耳机A使用预设传感器获取人体特征参数,并基于所述人体特征参数确定耳机A是否佩戴于用户耳部;以及,在步骤S28中,耳机B使用预设传感器获取人体特征参数,并基于所述人体特征参数确定耳机B是否佩戴于用户耳部。
如果耳机A、耳机B未佩戴于耳部:在步骤S19中,耳机A将采集的音频信号和未穿戴信息发送给第一音频处理部件,所述第一音频处理部件根据未穿戴信息输出提示信息(比如提示用户穿戴耳机A)以及将所述音频信号发送到远端的其他音频设备;以及,在步骤S29中,耳机B将采集的音频信号和未穿戴信息发送给第一音频处理部件,所述第一音频处理部件根据未穿戴信息输出提示信息(比如提示用户穿戴耳机B)以及将所述音频信号发送到远端的其他音频设备。
如果耳机A、耳机B佩戴于耳部:在步骤S20中,耳机A将采集的音频信号和穿戴位置信息发送给第一音频处理部件;以及,在步骤S30中,耳机B将采集的音频信号和穿戴位置信息发送给第一音频处理部件。
在步骤S40中,第一音频处理部件获取耳机A和耳机B的穿戴位置信息(分别穿戴于耳部);基于所述穿戴位置信息将耳机A和耳机B分别采集的音频信号合成为立体声;通过第二无线通讯连接将所述立体声发送到远端的其他音频设备。相应地,本 申请实施例还提供了一种音频采集系统,所述音频采集系统包括第一音频处理部件和音频采集部件;所述第一音频处理部件与所述音频采集部件可拆卸的连接;
当所述音频采集部件装设于所述第一音频处理部件时,所述音频采集部件采集的音频信号经由第一通讯连接传输至所述第一音频处理部件。
当所述音频采集部件独立于所述第一音频处理部件放置时,所述音频采集部件采集的音频信号经由第二通讯连接传输至所述第一音频处理部件;其中,所述第一通讯连接和所述第二通讯连接不同,例如所述第一通讯连接为有线通讯连接,所述第二通讯连接为无线通讯连接。
所述第一音频处理部件还用于将所述音频信号发送到远端的其他音频设备。
这里描述的各种实施方式可以使用例如计算机软件、硬件或其任何组合的计算机可读介质来实施。对于硬件实施,这里描述的实施方式可以通过使用特定用途集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理装置(DSPD)、可编程逻辑装置(PLD)、现场可编程门阵列(FPGA)、处理器、控制器、微控制器、微处理器、被设计为执行这里描述的功能的电子单元中的至少一种来实施。对于软件实施,诸如过程或功能的实施方式可以与允许执行至少一种功能或操作的单独的软件模块来实施。软件代码可以由以任何适当的编程语言编写的软件应用程序(或程序)来实施,软件代码可以存储在存储器中并且由控制器执行。
相应地,请参阅图10,本申请实施例还提供了一种音频采集方法,应用于音频采集系统中的第一音频处理部件;所述第一音频处理部件与音频采集部件可拆卸连接;所述音频采集部件包括供电模块;所述第一音频处理部件设置有第一导电端子,所述音频采集部件设置有第二导电端子;
所述方法包括:
在步骤S101中,当所述音频采集部件装设于所述第一音频处理部件时,接收所述音频采集部件经由有线通讯连接传输的音频信号;所述有线通讯连接由所述第一导电端子与所述第二导电端子接触并建立。
在步骤S102中,当所述音频采集部件独立于所述第一音频处理部件放置时,接收所述音频采集部件经由第一无线通讯连接发送的音频信号;其中,所述音频采集部件基于所述供电模块工作。
在步骤S103中,通过第二无线通讯连接将所述音频信号发送到远端的其他音频设备。
在一实施例中,所述方法还包括第二音频处理部件。
所述方法还包括:与所述第二音频处理部件建立第二无线通讯连接,并通过所述第二无线通讯连接将所述音频信号发送给所述第二音频处理部件,以使所述第二音频处理部件将所述音频信号传输给影像采集设备,以将所述音频信号与所述影像采集设备采集的影像信号合成为音视频数据流。
在一实施例中,所述第一无线通讯连接的信号强度大于所述第二无线通讯连接的信号强度。
在一实施例中,所述第一音频处理部件设置有容纳槽,用于容纳所述音频采集部件;当所述音频采集部件装设于所述第一音频处理部件时,所述音频采集部件置于所述容纳槽中。
在一实施例中,所述方法还包括:当所述音频采集部件装设于所述第一音频处理部件时,通过所述第一导电端子与所述第二导电端子的接触为所述音频采集部件供电。
在一实施例中,所述音频采集部件设置有穿戴部;当所述音频采集部件独立于所述第一音频处理部件放置时,所述音频采集部件用于通过所述穿戴部固定于人体。
在一实施例中,所述第一音频处理部件设置有麦克风;
所述方法还包括:通过所述第二无线通讯连接将所述音频采集部件采集的音频信号和所述麦克风采集的音频信号发送到远端的其他音频设备。
在一实施例中,当所述音频采集部件独立于所述第一音频处理部件放置时,所述麦克风和所述音频采集部件同时采集音频信号。
在一实施例中,所述麦克风采集的音频信号用于对所述音频采集部件采集的音频信号进行音频处理。
在一实施例中,所述音频采集部件的体积小于所述第一音频处理部件的体积;和/或,所述音频采集部件的重量小于所述第一音频处理部件的重量。
在一实施例中,所述方法还包括:对所述音频信号进行编辑处理,并通过第二无线通讯连接将处理后的音频信号发送到远端的其他音频设备。
在一实施例中,所述编辑处理包括:合成处理、增强处理、降噪处理和/或滤波处理。
在一实施例中,所述音频采集系统包括至少两个设置有穿戴部的音频采集部件;
当所述音频采集部件独立于所述第一音频处理部件放置时,所述至少两个所述音频采集部件能够通过所述穿戴部分别固定在人体的不同位置。
在一实施例中,所述方法还包括:获取至少两个所述音频采集部件的穿戴位置信 息;基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声;通过第二无线通讯连接将所述立体声发送到远端的其他音频设备。
在一实施例中,在获取至少两个所述音频采集部件的穿戴位置信息之后,所述方法还用于:
若所述穿戴位置信息与预设穿戴位置条件符合,基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声;
若所述穿戴位置信息与预设穿戴位置条件不符合,基于所述穿戴位置信息发出提示信息。
在一实施例中,所述预设穿戴位置条件包括:至少两个所述音频采集部件中的其中两个相对于人体中轴对称放置、或者至少两个所述音频采集部件分别穿戴于人体的预设部位。
在一实施例中,所述获取所述音频采集部件的穿戴位置信息,包括:接收所述音频采集部件经由所述第一无线通讯连接发送的所述音频采集部件当前的穿戴位置信息;
其中,所述音频采集部件设置有接近传感器和除所述接近传感器之外的预设传感器;所述接近传感器用于在所述音频采集部件独立于所述第一音频处理部件放置的情况下,确定所述音频采集部件是否与人体接触;所述音频采集部件还用于若确定与人体接触,使用所述预设传感器获取人体特征参数,并基于所述人体特征参数确定所述音频采集部件当前的穿戴位置信息。
在一实施例中,所述预设传感器包括骨传导传感器,所述人体特征参数包括从穿戴部位采集的骨传导信号;和/或,所述预设传感器包括视觉传感器,所述人体特征参数包括有关于穿戴部位的第一影像。
在一实施例中,所述音频采集部件当前的穿戴位置信息根据所述骨传导信号与预设语音信号之间的相关性,从预设语音信号与穿戴部位的映射关系中确定;和/或,所述音频采集部件当前的穿戴位置信息根据从所述第一影像中提取的轮廓信息确定。
在一实施例中,所述基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声,包括:基于所述穿戴位置信息,确定所述音频信号的幅度、相位和/或频率的调制方式;基于所述调制方式对至少两个所述音频采集部件分别采集的音频信号进行调制,得到所述立体声。
在一实施例中,所述穿戴位置信息不同,所述音频信号的幅度、相位和/或频率的调制方式也不同。
在一实施例中,所述调制方式根据所述穿戴位置信息指示的穿戴部位与音源之间 的相对位置关系和/或距离确定。
在一实施例中,所述第一音频处理部件预存有针对于音频信号的幅度、相位和/或频率的多种候选调制方式;其中,不同的候选调制方式对应不同的穿戴位置信息;所述调制方式根据所述穿戴位置信息,从多种候选调制方式中选择得到。
在一实施例中,所述第一音频处理部件还设置有麦克风;
所述方法还包括:将所述麦克风采集的音频信号叠加到所述立体声中;通过所述第二无线通讯连接将叠加后的立体声发送到远端的其他音频设备。
在一实施例中,所述方法还包括:确定所述麦克风的采集位置;根据所述采集位置与参考位置之间的差异,输出位置提示信息;所述位置提示信息用于提醒用户将所述第一音频处理部件移动至所述参考位置。
在一实施例中,所述第一音频处理部件还设置有视觉传感器;
所述麦克风的采集位置根据所述视觉传感器采集的第二影像的识别结果确定。
在一实施例中,所述方法还包括:
获取至少两个所述音频采集部件的穿戴位置信息;
通过第二无线通讯连接将至少两个所述音频采集部件分别采集的音频信号和穿戴位置信息发送到远端的其他音频设备,以使其他音频设备基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声。
相应的,请参与图11,本申请实施例还提供了另一种音频采集方法,应用于音频采集系统中的第一音频处理部件;所述音频采集系统还包括至少两个独立的音频采集部件;所述音频采集部件设置有穿戴部,至少两个所述音频采集部件能够通过所述穿戴部分别固定在人体的不同位置;所述音频采集部件能够与所述第一音频处理部件建立第一无线通讯连接;
所述方法包括:
在步骤S201中,获取所述音频采集部件的穿戴位置信息。
在步骤S202中,通过所述第一无线通讯连接接收由至少两个所述音频采集部件分别采集的音频信号。
在步骤S203中,基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声。
在一实施例中,所述音频采集部件包括供电模块。
当所述音频采集部件独立于所述第一音频处理部件放置时,所述音频采集部件基 于所述供电模块工作,所述音频采集部件与所述第一音频处理部件建立所述第一无线通讯连接,所述音频采集部件将采集的音频信号经由所述第一无线通讯连接发送给所述第一音频处理部件。
在一实施例中,所述方法还包括:通过第二无线通讯连接将所述立体声发送到远端的其他音频设备。
在一实施例中,所述方法还包括第二音频处理部件。
所述方法还包括:与所述第二音频处理部件建立第二无线通讯连接,通过所述第二无线通讯连接将所述立体声发送给所述第二音频处理部件以使所述第二音频处理部件将所述立体声传输给所述影像采集设备,以将所述立体声与所述影像采集设备采集的影像信号合成为音视频数据流。
在一实施例中,在所述音频采集部件与所述第一音频处理部件建立第一无线通讯连接的情况下,所述第一无线通讯连接的信号强度大于所述第二无线通讯连接的信号强度。
在一实施例中,在获取至少两个所述音频采集部件的穿戴位置信息之后,所述方法还包括:
若所述穿戴位置信息与预设穿戴位置条件符合,基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声;
若所述穿戴位置信息与预设穿戴位置条件不符合,基于所述穿戴位置信息发出提示信息。
在一实施例中,所述预设穿戴位置条件包括:至少两个所述音频采集部件中的其中两个相对于人体中轴对称放置、或者至少两个所述音频采集部件分别穿戴于人体的预设部位。
在一实施例中,所述获取所述音频采集部件的穿戴位置信息,包括:
接收所述音频采集部件经由所述第一无线通讯连接发送的所述音频采集部件当前的穿戴位置信息;
其中,所述音频采集部件设置有接近传感器和除所述接近传感器之外的预设传感器;所述接近传感器用于在所述音频采集部件独立于所述第一音频处理部件放置的情况下,确定所述音频采集部件是否与人体接触;所述音频采集部件还用于若确定与人体接触,使用所述预设传感器获取人体特征参数,并基于所述人体特征参数确定所述音频采集部件当前的穿戴位置信息。
在一实施例中,所述预设传感器包括骨传导传感器,所述人体特征参数包括从穿 戴部位采集的骨传导信号;和/或,所述预设传感器包括视觉传感器,所述人体特征参数包括有关于穿戴部位的第一影像。
在一实施例中,所述音频采集部件当前的穿戴位置信息根据所述骨传导信号与预设语音信号之间的相关性,从预设语音信号与穿戴部位的映射关系中确定;和/或,所述音频采集部件当前的穿戴位置信息根据从所述第一影像中提取的轮廓信息确定。
在一实施例中,所述基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声,包括:
基于所述穿戴位置信息,确定所述音频信号的幅度、相位和/或频率的调制方式;
基于所述调制方式对至少两个所述音频采集部件分别采集的音频信号进行调制,得到所述立体声。
在一实施例中,所述穿戴位置信息不同,所述音频信号的幅度、相位和/或频率的调制方式也不同。
在一实施例中,所述调制方式根据所述穿戴位置信息指示的穿戴部位与音源之间的相对位置关系和/或距离确定。
在一实施例中,所述第一音频处理部件预存有针对于音频信号的幅度、相位和/或频率的多种候选调制方式;其中,不同的候选调制方式对应不同的穿戴位置信息;
所述调制方式根据所述穿戴位置信息,从多种候选调制方式中选择得到。
在一实施例中,所述第一音频处理部件设置有麦克风;
所述方法还包括:将所述麦克风采集的音频信号叠加到所述立体声中;通过所述第二无线通讯连接将叠加后的立体声发送到远端的其他音频设备。
在一实施例中,所述方法还包括:确定所述麦克风的采集位置;根据所述采集位置与参考位置之间的差异,输出位置提示信息;所述位置提示信息用于提醒用户将所述第一音频处理部件移动至所述参考位置。
在一实施例中,所述第一音频处理部件还设置有视觉传感器;所述麦克风的采集位置根据所述视觉传感器采集的第二影像的识别结果确定。
在一实施例中,所述音频采集部件能够装设于所述第一音频处理部件;
所述第一音频处理部件设置有第一导电端子,所述音频采集部件设置有第二导电端子;
当所述音频采集部件装设于所述第一音频处理部件时,所述第一导电端子与所述第二导电端子接触并建立有线通讯连接,所述音频采集部件采集的音频信号经由所述有线通讯连接传输给所述第一音频处理部件。
在一实施例中,所述方法还包括:当所述音频采集部件装设于所述第一音频处理部件时,通过所述第一导电端子与所述第二导电端子的接触为所述音频采集部件供电。
在一实施例中,所述第一音频处理部件设置有容纳槽,用于容纳所述音频采集部件;当所述音频采集部件装设于所述第一音频处理部件时,所述音频采集部件置于所述容纳槽中。
在一实施例中,所述方法还包括:当所述音频采集部件装设于所述第一音频处理部件时,通过第二无线通讯连接将所述音频采集部件采集的音频信号发送到远端的其他音频设备。
在一实施例中,所述第一音频处理部件设置有麦克风;
所述方法还包括:通过所述第二无线通讯连接将所述音频采集部件采集的音频信号和所述麦克风采集的音频信号发送到远端的其他音频设备;其中,所述麦克风采集的音频信号用于对所述音频采集部件采集的音频信号进行音频处理。
在一实施例中,所述麦克风和至少两个所述音频采集部件同时采集音频信号。
在一实施例中,所述音频采集部件的体积小于所述第一音频处理部件的体积;和/或,所述音频采集部件的重量小于所述第一音频处理部件的重量。
在一实施例中,所述方法还包括:对所述立体声进行编辑处理,并通过第二无线通讯连接将处理后的立体声发送到远端的其他音频设备。
在一实施例中,所述编辑处理包括:增强处理、降噪处理和/或滤波处理。
在一实施例中,提供一种音频处理部件,其所述音频处理部件包括存储器和处理器,所述存储器上存储有可执行指令,所述处理器被配置为执行上述任意一项所述的方法的步骤。
在示例性实施例中,还提供了一种包括指令的非临时性计算机可读存储介质,例如包括指令的存储器,上述指令可由装置的处理器执行以完成上述方法。例如,非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
一种非临时性计算机可读存储介质,当存储介质中的指令由终端的处理器执行时,使得终端能够执行上述方法。需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是 还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。
以上对本申请实施例所提供的方法和装置进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。

Claims (109)

  1. 一种音频采集系统,其特征在于,所述音频采集系统包括第一音频处理部件、和与所述第一音频处理部件可拆卸连接的音频采集部件;
    所述音频采集部件包括供电模块;
    所述第一音频处理部件设置有第一导电端子,所述音频采集部件设置有第二导电端子;
    当所述音频采集部件装设于所述第一音频处理部件时,所述第一导电端子与所述第二导电端子接触并建立有线通讯连接,所述音频采集部件采集的音频信号经由所述有线通讯连接传输给所述第一音频处理部件;
    当所述音频采集部件独立于所述第一音频处理部件放置时,所述音频采集部件基于所述供电模块工作,所述音频采集部件与所述第一音频处理部件建立第一无线通讯连接,所述音频采集部件将采集的音频信号经由所述第一无线通讯连接发送给所述第一音频处理部件;
    所述第一音频处理部件用于通过第二无线通讯连接将所述音频信号发送到远端的其他音频设备。
  2. 根据权利要求1所述的系统,其特征在于,所述系统还包括第二音频处理部件;
    所述第一音频处理部件还用于与所述第二音频处理部件建立第二无线通讯连接,通过所述第二无线通讯连接将所述音频信号发送给所述第二音频处理部件;
    所述第二音频处理部件用于与影像采集设备连接,将所述音频信号传输给所述影像采集设备,以将所述音频信号与所述影像采集设备采集的影像信号合成为音视频数据流。
  3. 根据权利要求1或2所述的系统,其特征在于,所述第一无线通讯连接的信号强度大于所述第二无线通讯连接的信号强度。
  4. 根据权利要求1所述的系统,其特征在于,所述第一音频处理部件设置有容纳槽,用于容纳所述音频采集部件;
    当所述音频采集部件装设于所述第一音频处理部件时,所述音频采集部件置于所述容纳槽中。
  5. 根据权利要求1所述的系统,其特征在于,当所述音频采集部件装设于所述第一音频处理部件时,所述第一音频处理部件还用于:通过所述第一导电端子与所述第二导电端子的接触为所述音频采集部件供电。
  6. 根据权利要求1所述的系统,其特征在于,所述音频采集部件设置有穿戴部;
    当所述音频采集部件独立于所述第一音频处理部件放置时,所述音频采集部件用于通过所述穿戴部固定于人体。
  7. 根据权利要求1至6任意一项所述的系统,其特征在于,所述第一音频处理部件设置有麦克风;
    所述第一音频处理部件还用于通过所述第二无线通讯连接将所述音频采集部件采集的音频信号和所述麦克风采集的音频信号发送到远端的其他音频设备。
  8. 根据权利要求7所述的系统,其特征在于,当所述音频采集部件独立于所述第一音频处理部件放置时,所述麦克风和所述音频采集部件同时采集音频信号。
  9. 根据权利要求7所述的系统,其特征在于,所述麦克风采集的音频信号用于对所述音频采集部件采集的音频信号进行音频处理。
  10. 根据权利要求1至9任意一项所述的系统,其特征在于,所述音频采集部件的体积小于所述第一音频处理部件的体积;
    和/或,所述音频采集部件的重量小于所述第一音频处理部件的重量。
  11. 根据权利要求1至9任意一项所述的系统,其特征在于,所述第一音频处理部件还用于对所述音频信号进行编辑处理,并通过第二无线通讯连接将处理后的音频信号发送到远端的其他音频设备。
  12. 根据权利要求11所述的系统,其特征在于,所述编辑处理包括:合成处理、增强处理、降噪处理和/或滤波处理。
  13. 根据权利要求1所述的系统,其特征在于,所述系统包括至少两个设置有穿戴部的音频采集部件;
    当所述音频采集部件独立于所述第一音频处理部件放置时,所述至少两个所述音频采集部件能够通过所述穿戴部分别固定在人体的不同位置。
  14. 根据权利要求13所述的系统,其特征在于,所述第一音频处理部件还用于:
    获取至少两个所述音频采集部件的穿戴位置信息;
    基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声;
    通过第二无线通讯连接将所述立体声发送到远端的其他音频设备。
  15. 根据权利要求14所述的系统,其特征在于,在获取至少两个所述音频采集部件的穿戴位置信息之后,所述第一音频处理组件还用于:
    若所述穿戴位置信息与预设穿戴位置条件符合,基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声;
    若所述穿戴位置信息与预设穿戴位置条件不符合,基于所述穿戴位置信息发出提示信息。
  16. 根据权利要求15所述的系统,其特征在于,所述预设穿戴位置条件包括:至少两个所述音频采集部件中的其中两个相对于人体中轴对称放置、或者至少两个所述音频采集部件分别穿戴于人体的预设部位。
  17. 根据权利要求14所述的系统,其特征在于,所述音频采集部件设置有接近传感器和除所述接近传感器之外的预设传感器;
    所述接近传感器用于在所述音频采集部件独立于所述第一音频处理部件放置的情况下,确定所述音频采集部件是否与人体接触;
    所述音频采集部件还用于若确定与人体接触,使用所述预设传感器获取人体特征参数,并基于所述人体特征参数确定所述音频采集部件当前的穿戴位置信息,将所述穿戴位置信息经由所述第一无线通讯连接发送给所述第一音频处理部件。
  18. 根据权利要求17所述的系统,其特征在于,所述预设传感器包括骨传导传感器,所述人体特征参数包括从穿戴部位采集的骨传导信号;
    和/或,所述预设传感器包括视觉传感器,所述人体特征参数包括有关于穿戴部位的第一影像。
  19. 根据权利要求18所述的系统,其特征在于,所述音频采集部件还用于:
    根据所述骨传导信号与预设语音信号之间的相关性,从预设语音信号与穿戴部位的映射关系中确定所述音频采集部件当前的穿戴位置信息;
    和/或,根据从所述第一影像中提取的轮廓信息确定所述音频采集部件当前的穿戴位置信息。
  20. 根据权利要求14所述的系统,其特征在于,所述第一音频处理部件还用于:
    基于所述穿戴位置信息,确定所述音频信号的幅度、相位和/或频率的调制方式;
    基于所述调制方式对至少两个所述音频采集部件分别采集的音频信号进行调制,得到所述立体声。
  21. 根据权利要求20所述的系统,其特征在于,所述穿戴位置信息不同,所述音频信号的幅度、相位和/或频率的调制方式也不同。
  22. 根据权利要求20所述的系统,其特征在于,所述调制方式根据所述穿戴位置信息指示的穿戴部位与音源之间的相对位置关系和/或距离确定。
  23. 根据权利要求20所述的系统,其特征在于,所述第一音频处理部件预存有针对于音频信号的幅度、相位和/或频率的多种候选调制方式;其中,不同的候选调制方 式对应不同的穿戴位置信息;
    所述调制方式根据所述穿戴位置信息,从多种候选调制方式中选择得到。
  24. 根据权利要求14所述的系统,其特征在于,所述第一音频处理部件还设置有麦克风;
    所述第一音频处理部件还用于:
    将所述麦克风采集的音频信号叠加到所述立体声中;
    通过所述第二无线通讯连接将叠加后的立体声发送到远端的其他音频设备。
  25. 根据权利要求7或24所述的系统,其特征在于,所述第一音频处理部件还用于:
    确定所述麦克风的采集位置;
    根据所述采集位置与参考位置之间的差异,输出位置提示信息;所述位置提示信息用于提醒用户将所述第一音频处理部件移动至所述参考位置。
  26. 根据权利要求25所述的系统,其特征在于,所述第一音频处理部件还设置有视觉传感器;
    所述麦克风的采集位置根据所述视觉传感器采集的第二影像的识别结果确定。
  27. 根据权利要求13所述的系统,其特征在于,所述第一音频处理部件还用于:
    获取至少两个所述音频采集部件的穿戴位置信息;
    通过第二无线通讯连接将至少两个所述音频采集部件分别采集的音频信号和穿戴位置信息发送到远端的其他音频设备,以使其他音频设备基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声。
  28. 一种音频采集系统,其特征在于,所述音频采集系统包括第一音频处理部件和至少两个独立的音频采集部件;
    所述音频采集部件设置有穿戴部,至少两个所述音频采集部件能够通过所述穿戴部分别固定在人体的不同位置;
    所述音频采集部件能够与所述第一音频处理部件建立第一无线通讯连接;
    所述第一音频处理部件用于:
    获取所述音频采集部件的穿戴位置信息;
    通过所述第一无线通讯连接接收由至少两个所述音频采集部件分别采集的音频信号;
    基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声。
  29. 根据权利要求28所述的系统,其特征在于,所述音频采集部件包括供电模块;
    当所述音频采集部件独立于所述第一音频处理部件放置时,所述音频采集部件基于所述供电模块工作,所述音频采集部件与所述第一音频处理部件建立所述第一无线通讯连接,所述音频采集部件将采集的音频信号经由所述第一无线通讯连接发送给所述第一音频处理部件。
  30. 根据权利要求28所述的系统,其特征在于,所述第一音频处理部件还用于通过第二无线通讯连接将所述立体声发送到远端的其他音频设备。
  31. 根据权利要求30所述的系统,其特征在于,所述系统还包括第二音频处理部件;
    所述第一音频处理部件还用于与所述第二音频处理部件建立第二无线通讯连接,通过所述第二无线通讯连接将所述立体声发送给所述第二音频处理部件;
    所述第二音频处理部件用于与影像采集设备连接,将所述立体声传输给所述影像采集设备,以将所述立体声与所述影像采集设备采集的影像信号合成为音视频数据流。
  32. 根据权利要求31所述的系统,其特征在于,在所述音频采集部件与所述第一音频处理部件建立第一无线通讯连接的情况下,所述第一无线通讯连接的信号强度大于所述第二无线通讯连接的信号强度。
  33. 根据权利要求28所述的系统,其特征在于,在获取至少两个所述音频采集部件的穿戴位置信息之后,所述第一音频处理组件还用于:
    若所述穿戴位置信息与预设穿戴位置条件符合,基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声;
    若所述穿戴位置信息与预设穿戴位置条件不符合,基于所述穿戴位置信息发出提示信息。
  34. 根据权利要求33所述的系统,其特征在于,所述预设穿戴位置条件包括:至少两个所述音频采集部件中的其中两个相对于人体中轴对称放置、或者至少两个所述音频采集部件分别穿戴于人体的预设部位。
  35. 根据权利要求33所述的系统,其特征在于,所述音频采集部件设置有接近传感器和除所述接近传感器之外的预设传感器;
    所述接近传感器用于在所述音频采集部件独立于所述第一音频处理部件放置的情况下,确定所述音频采集部件是否与人体接触;
    所述音频采集部件还用于若确定与人体接触,使用所述预设传感器获取人体特征参数,并基于所述人体特征参数确定所述音频采集部件当前的穿戴位置信息,将所述 穿戴位置信息经由所述第一无线通讯连接发送给所述第一音频处理部件。
  36. 根据权利要求35所述的系统,其特征在于,所述预设传感器包括骨传导传感器,所述人体特征参数包括从穿戴部位采集的骨传导信号;
    和/或,所述预设传感器包括视觉传感器,所述人体特征参数包括有关于穿戴部位的第一影像。
  37. 根据权利要求36所述的系统,其特征在于,所述音频采集部件还用于:
    根据所述骨传导信号与预设语音信号之间的相关性,从预设语音信号与穿戴部位的映射关系中确定所述音频采集部件当前的穿戴位置信息;
    和/或,根据从所述第一影像中提取的轮廓信息确定所述音频采集部件当前的穿戴位置信息。
  38. 根据权利要求28所述的系统,其特征在于,所述第一音频处理部件还用于:
    基于所述穿戴位置信息,确定所述音频信号的幅度、相位和/或频率的调制方式;
    基于所述调制方式对至少两个所述音频采集部件分别采集的音频信号进行调制,得到所述立体声。
  39. 根据权利要求38所述的系统,其特征在于,所述穿戴位置信息不同,所述音频信号的幅度、相位和/或频率的调制方式也不同。
  40. 根据权利要求38所述的系统,其特征在于,所述调制方式根据所述穿戴位置信息指示的穿戴部位与音源之间的相对位置关系和/或距离确定。
  41. 根据权利要求38所述的系统,其特征在于,所述第一音频处理部件预存有针对于音频信号的幅度、相位和/或频率的多种候选调制方式;其中,不同的候选调制方式对应不同的穿戴位置信息;
    所述调制方式根据所述穿戴位置信息,从多种候选调制方式中选择得到。
  42. 根据权利要求28至41任意一项所述的系统,其特征在于,所述第一音频处理部件设置有麦克风;
    所述第一音频处理部件还用于将所述麦克风采集的音频信号叠加到所述立体声中;通过所述第二无线通讯连接将叠加后的立体声发送到远端的其他音频设备。
  43. 根据权利要求42所述的系统,其特征在于,所述第一音频处理部件还用于:
    确定所述麦克风的采集位置;
    根据所述采集位置与参考位置之间的差异,输出位置提示信息;所述位置提示信息用于提醒用户将所述第一音频处理部件移动至所述参考位置。
  44. 根据权利要求43所述的系统,其特征在于,所述第一音频处理部件还设置有 视觉传感器;
    所述麦克风的采集位置根据所述视觉传感器采集的第二影像的识别结果确定。
  45. 根据权利要求28所述的系统,其特征在于,所述音频采集部件能够装设于所述第一音频处理部件;
    所述第一音频处理部件设置有第一导电端子,所述音频采集部件设置有第二导电端子;
    当所述音频采集部件装设于所述第一音频处理部件时,所述第一导电端子与所述第二导电端子接触并建立有线通讯连接,所述音频采集部件采集的音频信号经由所述有线通讯连接传输给所述第一音频处理部件。
  46. 根据权利要求45所述的系统,其特征在于,当所述音频采集部件装设于所述第一音频处理部件时,所述第一音频处理部件还用于:通过所述第一导电端子与所述第二导电端子的接触为所述音频采集部件供电。
  47. 根据权利要求45所述的系统,其特征在于,所述第一音频处理部件设置有容纳槽,用于容纳所述音频采集部件;
    当所述音频采集部件装设于所述第一音频处理部件时,所述音频采集部件置于所述容纳槽中。
  48. 根据权利要求45~47任意一项所述的系统,其特征在于,当所述音频采集部件装设于所述第一音频处理部件时,所述第一音频处理部件还用于:通过第二无线通讯连接将所述音频采集部件采集的音频信号发送到远端的其他音频设备。
  49. 根据权利要求48所述的系统,其特征在于,所述第一音频处理部件设置有麦克风;
    所述第一音频处理部件还用于通过所述第二无线通讯连接将所述音频采集部件采集的音频信号和所述麦克风采集的音频信号发送到远端的其他音频设备。
  50. 根据权利要求42或49所述的系统,其特征在于,所述麦克风和至少两个所述音频采集部件同时采集音频信号。
  51. 根据权利要求28至50任意一项所述的系统,其特征在于,所述音频采集部件的体积小于所述第一音频处理部件的体积;
    和/或,所述音频采集部件的重量小于所述第一音频处理部件的重量。
  52. 根据权利要求28所述的系统,其特征在于,所述第一音频处理部件还用于对所述立体声进行编辑处理,并通过第二无线通讯连接将处理后的立体声发送到远端的其他音频设备。
  53. 根据权利要求52所述的系统,其特征在于,所述编辑处理包括:增强处理、降噪处理和/或滤波处理。
  54. 一种音频采集系统,其特征在于,所述音频采集系统包括第一音频处理部件和音频采集部件;所述第一音频处理部件与所述音频采集部件可拆卸的连接;
    当所述音频采集部件装设于所述第一音频处理部件时,所述音频采集部件采集的音频信号经由第一通讯连接传输至所述第一音频处理部件;
    当所述音频采集部件独立于所述第一音频处理部件放置时,所述音频采集部件采集的音频信号经由第二通讯连接传输至所述第一音频处理部件;其中,所述第一通讯连接和所述第二通讯连接不同;
    所述第一音频处理部件还用于将所述音频信号发送到远端的其他音频设备。
  55. 一种音频采集方法,其特征在于,应用于第一音频处理部件;所述第一音频处理部件与音频采集部件可拆卸连接;所述音频采集部件包括供电模块;所述第一音频处理部件设置有第一导电端子,所述音频采集部件设置有第二导电端子;
    所述方法包括:
    当所述音频采集部件装设于所述第一音频处理部件时,接收所述音频采集部件经由有线通讯连接传输的音频信号;所述有线通讯连接由所述第一导电端子与所述第二导电端子接触并建立;
    当所述音频采集部件独立于所述第一音频处理部件放置时,接收所述音频采集部件经由第一无线通讯连接发送的音频信号;其中,所述音频采集部件基于所述供电模块工作;
    通过第二无线通讯连接将所述音频信号发送到远端的其他音频设备。
  56. 根据权利要求55所述的方法,其特征在于,所述方法还包括第二音频处理部件;
    所述方法还包括:
    与所述第二音频处理部件建立第二无线通讯连接,并通过所述第二无线通讯连接将所述音频信号发送给所述第二音频处理部件,以使所述第二音频处理部件将所述音频信号传输给影像采集设备,以将所述音频信号与所述影像采集设备采集的影像信号合成为音视频数据流。
  57. 根据权利要求55或56所述的方法,其特征在于,所述第一无线通讯连接的信号强度大于所述第二无线通讯连接的信号强度。
  58. 根据权利要求55所述的方法,其特征在于,所述第一音频处理部件设置有容纳槽,用于容纳所述音频采集部件;
    当所述音频采集部件装设于所述第一音频处理部件时,所述音频采集部件置于所述容 纳槽中。
  59. 根据权利要求55所述的方法,其特征在于,所述方法还包括:
    当所述音频采集部件装设于所述第一音频处理部件时,通过所述第一导电端子与所述第二导电端子的接触为所述音频采集部件供电。
  60. 根据权利要求55所述的方法,其特征在于,所述音频采集部件设置有穿戴部;
    当所述音频采集部件独立于所述第一音频处理部件放置时,所述音频采集部件用于通过所述穿戴部固定于人体。
  61. 根据权利要求55至60任意一项所述的方法,其特征在于,所述第一音频处理部件设置有麦克风;
    所述方法还包括:
    通过所述第二无线通讯连接将所述音频采集部件采集的音频信号和所述麦克风采集的音频信号发送到远端的其他音频设备。
  62. 根据权利要求61所述的方法,其特征在于,当所述音频采集部件独立于所述第一音频处理部件放置时,所述麦克风和所述音频采集部件同时采集音频信号。
  63. 根据权利要求61所述的方法,其特征在于,所述麦克风采集的音频信号用于对所述音频采集部件采集的音频信号进行音频处理。
  64. 根据权利要求55至63任意一项所述的方法,其特征在于,所述音频采集部件的体积小于所述第一音频处理部件的体积;
    和/或,所述音频采集部件的重量小于所述第一音频处理部件的重量。
  65. 根据权利要求55至63任意一项所述的方法,其特征在于,所述方法还包括:
    对所述音频信号进行编辑处理,并通过第二无线通讯连接将处理后的音频信号发送到远端的其他音频设备。
  66. 根据权利要求65所述的方法,其特征在于,所述编辑处理包括:合成处理、增强处理、降噪处理和/或滤波处理。
  67. 根据权利要求55所述的方法,其特征在于,
    当所述音频采集部件独立于所述第一音频处理部件放置时,至少两个所述音频采集部件能够通过穿戴部分别固定在人体的不同位置。
  68. 根据权利要求67所述的方法,其特征在于,所述方法还包括:
    获取至少两个所述音频采集部件的穿戴位置信息;
    基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声;
    通过第二无线通讯连接将所述立体声发送到远端的其他音频设备。
  69. 根据权利要求68所述的方法,其特征在于,在获取至少两个所述音频采集部件的穿戴位置信息之后,所述方法还用于:
    若所述穿戴位置信息与预设穿戴位置条件符合,基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声;
    若所述穿戴位置信息与预设穿戴位置条件不符合,基于所述穿戴位置信息发出提示信息。
  70. 根据权利要求69所述的方法,其特征在于,所述预设穿戴位置条件包括:至少两个所述音频采集部件中的其中两个相对于人体中轴对称放置、或者至少两个所述音频采集部件分别穿戴于人体的预设部位。
  71. 根据权利要求68所述的方法,其特征在于,所述获取所述音频采集部件的穿戴位置信息,包括:
    接收所述音频采集部件经由所述第一无线通讯连接发送的所述音频采集部件当前的穿戴位置信息;
    其中,所述音频采集部件设置有接近传感器和除所述接近传感器之外的预设传感器;
    所述接近传感器用于在所述音频采集部件独立于所述第一音频处理部件放置的情况下,确定所述音频采集部件是否与人体接触;
    所述音频采集部件还用于若确定与人体接触,使用所述预设传感器获取人体特征参数,并基于所述人体特征参数确定所述音频采集部件当前的穿戴位置信息。
  72. 根据权利要求71所述的方法,其特征在于,所述预设传感器包括骨传导传感器,所述人体特征参数包括从穿戴部位采集的骨传导信号;
    和/或,所述预设传感器包括视觉传感器,所述人体特征参数包括有关于穿戴部位的第一影像。
  73. 根据权利要求72所述的方法,其特征在于,
    所述音频采集部件当前的穿戴位置信息根据所述骨传导信号与预设语音信号之间的相关性,从预设语音信号与穿戴部位的映射关系中确定;
    和/或,所述音频采集部件当前的穿戴位置信息根据从所述第一影像中提取的轮廓信息确定。
  74. 根据权利要求68所述的方法,其特征在于,所述基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声,包括:
    基于所述穿戴位置信息,确定所述音频信号的幅度、相位和/或频率的调制方式;
    基于所述调制方式对至少两个所述音频采集部件分别采集的音频信号进行调制,得到所述立体声。
  75. 根据权利要求74所述的方法,其特征在于,所述穿戴位置信息不同,所述音频信号的幅度、相位和/或频率的调制方式也不同。
  76. 根据权利要求74所述的方法,其特征在于,所述调制方式根据所述穿戴位置信息指示的穿戴部位与音源之间的相对位置关系和/或距离确定。
  77. 根据权利要求74所述的方法,其特征在于,所述第一音频处理部件预存有针对于音频信号的幅度、相位和/或频率的多种候选调制方式;其中,不同的候选调制方式对应不同的穿戴位置信息;
    所述调制方式根据所述穿戴位置信息,从多种候选调制方式中选择得到。
  78. 根据权利要求68所述的方法,其特征在于,所述第一音频处理部件还设置有麦克风;
    所述方法还包括:
    将所述麦克风采集的音频信号叠加到所述立体声中;
    通过所述第二无线通讯连接将叠加后的立体声发送到远端的其他音频设备。
  79. 根据权利要求61或78所述的方法,其特征在于,所述方法还包括:
    确定所述麦克风的采集位置;
    根据所述采集位置与参考位置之间的差异,输出位置提示信息;所述位置提示信息用于提醒用户将所述第一音频处理部件移动至所述参考位置。
  80. 根据权利要求79所述的方法,其特征在于,所述第一音频处理部件还设置有视觉传感器;
    所述麦克风的采集位置根据所述视觉传感器采集的第二影像的识别结果确定。
  81. 根据权利要求67所述的方法,其特征在于,所述方法还包括:
    获取至少两个所述音频采集部件的穿戴位置信息;
    通过第二无线通讯连接将至少两个所述音频采集部件分别采集的音频信号和穿戴位置信息发送到远端的其他音频设备,以使其他音频设备基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声。
  82. 一种音频采集方法,其特征在于,应用于音频采集系统中的第一音频处理部件;所述音频采集系统还包括至少两个独立的音频采集部件;所述音频采集部件设置有穿戴部,至少两个所述音频采集部件能够通过所述穿戴部分别固定在人体的不同位置;所述音频采 集部件能够与所述第一音频处理部件建立第一无线通讯连接;
    所述方法包括:
    获取所述音频采集部件的穿戴位置信息;
    通过所述第一无线通讯连接接收由至少两个所述音频采集部件分别采集的音频信号;
    基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声。
  83. 根据权利要求82所述的方法,其特征在于,所述音频采集部件包括供电模块;
    当所述音频采集部件独立于所述第一音频处理部件放置时,所述音频采集部件基于所述供电模块工作,所述音频采集部件与所述第一音频处理部件建立所述第一无线通讯连接,所述音频采集部件将采集的音频信号经由所述第一无线通讯连接发送给所述第一音频处理部件。
  84. 根据权利要求82所述的方法,其特征在于,所述方法还包括:
    通过第二无线通讯连接将所述立体声发送到远端的其他音频设备。
  85. 根据权利要求84所述的方法,其特征在于,所述方法还包括第二音频处理部件;
    所述方法还包括:
    与所述第二音频处理部件建立第二无线通讯连接,通过所述第二无线通讯连接将所述立体声发送给所述第二音频处理部件以使所述第二音频处理部件将所述立体声传输给影像采集设备,以将所述立体声与所述影像采集设备采集的影像信号合成为音视频数据流。
  86. 根据权利要求85所述的方法,其特征在于,在所述音频采集部件与所述第一音频处理部件建立第一无线通讯连接的情况下,所述第一无线通讯连接的信号强度大于所述第二无线通讯连接的信号强度。
  87. 根据权利要求82所述的方法,其特征在于,在获取至少两个所述音频采集部件的穿戴位置信息之后,所述方法还包括:
    若所述穿戴位置信息与预设穿戴位置条件符合,基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声;
    若所述穿戴位置信息与预设穿戴位置条件不符合,基于所述穿戴位置信息发出提示信息。
  88. 根据权利要求87所述的方法,其特征在于,所述预设穿戴位置条件包括:至少两个所述音频采集部件中的其中两个相对于人体中轴对称放置、或者至少两个所述音频采集部件分别穿戴于人体的预设部位。
  89. 根据权利要求87所述的方法,其特征在于,所述获取所述音频采集部件的穿戴 位置信息,包括:
    接收所述音频采集部件经由所述第一无线通讯连接发送的所述音频采集部件当前的穿戴位置信息;
    其中,所述音频采集部件设置有接近传感器和除所述接近传感器之外的预设传感器;
    所述接近传感器用于在所述音频采集部件独立于所述第一音频处理部件放置的情况下,确定所述音频采集部件是否与人体接触;
    所述音频采集部件还用于若确定与人体接触,使用所述预设传感器获取人体特征参数,并基于所述人体特征参数确定所述音频采集部件当前的穿戴位置信息。
  90. 根据权利要求89所述的方法,其特征在于,所述预设传感器包括骨传导传感器,所述人体特征参数包括从穿戴部位采集的骨传导信号;
    和/或,所述预设传感器包括视觉传感器,所述人体特征参数包括有关于穿戴部位的第一影像。
  91. 根据权利要求90所述的方法,其特征在于,
    所述音频采集部件当前的穿戴位置信息根据所述骨传导信号与预设语音信号之间的相关性,从预设语音信号与穿戴部位的映射关系中确定;
    和/或,所述音频采集部件当前的穿戴位置信息根据从所述第一影像中提取的轮廓信息确定。
  92. 根据权利要求82所述的方法,其特征在于,所述基于所述穿戴位置信息将至少两个所述音频采集部件分别采集的音频信号合成为立体声,包括:
    基于所述穿戴位置信息,确定所述音频信号的幅度、相位和/或频率的调制方式;
    基于所述调制方式对至少两个所述音频采集部件分别采集的音频信号进行调制,得到所述立体声。
  93. 根据权利要求92所述的方法,其特征在于,所述穿戴位置信息不同,所述音频信号的幅度、相位和/或频率的调制方式也不同。
  94. 根据权利要求92所述的方法,其特征在于,所述调制方式根据所述穿戴位置信息指示的穿戴部位与音源之间的相对位置关系和/或距离确定。
  95. 根据权利要求92所述的方法,其特征在于,所述第一音频处理部件预存有针对于音频信号的幅度、相位和/或频率的多种候选调制方式;其中,不同的候选调制方式对应不同的穿戴位置信息;
    所述调制方式根据所述穿戴位置信息,从多种候选调制方式中选择得到。
  96. 根据权利要求82至95任意一项所述的方法,其特征在于,所述第一音频处理部 件设置有麦克风;
    所述方法还包括:
    将所述麦克风采集的音频信号叠加到所述立体声中;通过所述第二无线通讯连接将叠加后的立体声发送到远端的其他音频设备。
  97. 根据权利要求96所述的方法,其特征在于,所述方法还包括:
    确定所述麦克风的采集位置;
    根据所述采集位置与参考位置之间的差异,输出位置提示信息;所述位置提示信息用于提醒用户将所述第一音频处理部件移动至所述参考位置。
  98. 根据权利要求97所述的方法,其特征在于,所述第一音频处理部件还设置有视觉传感器;
    所述麦克风的采集位置根据所述视觉传感器采集的第二影像的识别结果确定。
  99. 根据权利要求82所述的方法,其特征在于,所述音频采集部件能够装设于所述第一音频处理部件;
    所述第一音频处理部件设置有第一导电端子,所述音频采集部件设置有第二导电端子;
    当所述音频采集部件装设于所述第一音频处理部件时,所述第一导电端子与所述第二导电端子接触并建立有线通讯连接,所述音频采集部件采集的音频信号经由所述有线通讯连接传输给所述第一音频处理部件。
  100. 根据权利要求99所述的方法,其特征在于,所述方法还包括:
    当所述音频采集部件装设于所述第一音频处理部件时,通过所述第一导电端子与所述第二导电端子的接触为所述音频采集部件供电。
  101. 根据权利要求99所述的方法,其特征在于,所述第一音频处理部件设置有容纳槽,用于容纳所述音频采集部件;
    当所述音频采集部件装设于所述第一音频处理部件时,所述音频采集部件置于所述容纳槽中。
  102. 根据权利要求99~101任意一项所述的方法,其特征在于,所述方法还包括:
    当所述音频采集部件装设于所述第一音频处理部件时,通过第二无线通讯连接将所述音频采集部件采集的音频信号发送到远端的其他音频设备。
  103. 根据权利要求102所述的方法,其特征在于,所述第一音频处理部件设置有麦克风;
    所述方法还包括:
    通过所述第二无线通讯连接将所述音频采集部件采集的音频信号和所述麦克风采集 的音频信号发送到远端的其他音频设备;其中,所述麦克风采集的音频信号用于对所述音频采集部件采集的音频信号进行音频处理。
  104. 根据权利要求96或103所述的方法,其特征在于,所述麦克风和至少两个所述音频采集部件同时采集音频信号。
  105. 根据权利要求82至104任意一项所述的方法,其特征在于,所述音频采集部件的体积小于所述第一音频处理部件的体积;
    和/或,所述音频采集部件的重量小于所述第一音频处理部件的重量。
  106. 根据权利要求82所述的方法,其特征在于,所述方法还包括:
    对所述立体声进行编辑处理,并通过第二无线通讯连接将处理后的立体声发送到远端的其他音频设备。
  107. 根据权利要求106所述的方法,其特征在于,所述编辑处理包括:增强处理、降噪处理和/或滤波处理。
  108. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有可执行指令,所述可执行指令被处理器执行时实现如权利要求55~107任意一项所述的方法。
  109. 一种音频处理部件,其特征在于,所述音频处理部件包括存储器和处理器,所述存储器上存储有可执行指令,所述处理器被配置为执行权利要求55~107任意一项所述的方法的步骤。
PCT/CN2021/121445 2021-09-28 2021-09-28 音频采集方法、系统及计算机可读存储介质 WO2023050089A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2021/121445 WO2023050089A1 (zh) 2021-09-28 2021-09-28 音频采集方法、系统及计算机可读存储介质
CN202180101377.4A CN117795978A (zh) 2021-09-28 2021-09-28 音频采集方法、系统及计算机可读存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/121445 WO2023050089A1 (zh) 2021-09-28 2021-09-28 音频采集方法、系统及计算机可读存储介质

Publications (1)

Publication Number Publication Date
WO2023050089A1 true WO2023050089A1 (zh) 2023-04-06

Family

ID=85780983

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/121445 WO2023050089A1 (zh) 2021-09-28 2021-09-28 音频采集方法、系统及计算机可读存储介质

Country Status (2)

Country Link
CN (1) CN117795978A (zh)
WO (1) WO2023050089A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3228096A1 (en) * 2014-10-01 2017-10-11 Binauric SE Audio terminal
CN207200952U (zh) * 2017-08-26 2018-04-06 江西创成微电子有限公司 一种音频处理系统
CN112204999A (zh) * 2020-03-02 2021-01-08 深圳市大疆创新科技有限公司 音频处理方法、设备、可移动平台和计算机可读存储介质
CN113316050A (zh) * 2021-06-29 2021-08-27 北京明略昭辉科技有限公司 便携式音频采集传输装置、音频处理系统及采集传输方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3228096A1 (en) * 2014-10-01 2017-10-11 Binauric SE Audio terminal
CN207200952U (zh) * 2017-08-26 2018-04-06 江西创成微电子有限公司 一种音频处理系统
CN112204999A (zh) * 2020-03-02 2021-01-08 深圳市大疆创新科技有限公司 音频处理方法、设备、可移动平台和计算机可读存储介质
CN113316050A (zh) * 2021-06-29 2021-08-27 北京明略昭辉科技有限公司 便携式音频采集传输装置、音频处理系统及采集传输方法

Also Published As

Publication number Publication date
CN117795978A (zh) 2024-03-29

Similar Documents

Publication Publication Date Title
US9510112B2 (en) External microphone array and hearing aid using it
JP6986112B2 (ja) 無線イヤホンのインイヤー装着検知方法及び無線イヤホン
CN101843118B (zh) 用于无线听力辅助的方法和系统
CN103874000B (zh) 一种听力仪器
US20060039577A1 (en) Method and apparatus for wireless communication using an inductive interface
US9866947B2 (en) Dual-microphone headset and noise reduction processing method for audio signal in call
US20150326973A1 (en) Portable Binaural Recording & Playback Accessory for a Multimedia Device
CN109327758B (zh) 一种无线播放设备及其播放控制方法和装置
CN108886647A (zh) 耳机降噪方法及装置、主耳机、从耳机及耳机降噪系统
WO2023005412A1 (zh) 录音方法、装置、无线耳机及存储介质
WO2020113587A1 (zh) 一种使用蓝牙耳机进行通话的方法、设备及系统
CN113411726A (zh) 一种音频处理方法、装置及系统
CN113411417A (zh) 无线扩音系统及终端
CN209642920U (zh) 环境感知降噪入耳式蓝牙耳机
WO2023050089A1 (zh) 音频采集方法、系统及计算机可读存储介质
CN116033312B (zh) 耳机控制方法及耳机
WO2020042491A1 (zh) 一种耳机远场交互方法、耳机远场交互配件及无线耳机
WO2022199222A1 (zh) 音频播放设备的降噪方法、装置、电子设备以及存储介质
KR101664195B1 (ko) 스피커를 포함하는 블루투스 헤드셋
CN113099371B (zh) 一种新型无线助听器系统以及自助替换耳机实现方法
CN211089900U (zh) 一种k歌耳机
CN210579229U (zh) 具有骨传导和气导功能的助听器
US20170094412A1 (en) Wearable recording and playback system
CN113709906A (zh) 无线音频系统、无线通讯方法及设备
CN209803796U (zh) 基于中近程无线接收与发射的中外语言翻译器

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21958684

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202180101377.4

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE