WO2022048599A1 - 音箱位置调节方法、音频渲染方法和装置 - Google Patents

音箱位置调节方法、音频渲染方法和装置 Download PDF

Info

Publication number
WO2022048599A1
WO2022048599A1 PCT/CN2021/116239 CN2021116239W WO2022048599A1 WO 2022048599 A1 WO2022048599 A1 WO 2022048599A1 CN 2021116239 W CN2021116239 W CN 2021116239W WO 2022048599 A1 WO2022048599 A1 WO 2022048599A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
speaker
audio
user
angle
Prior art date
Application number
PCT/CN2021/116239
Other languages
English (en)
French (fr)
Inventor
李向宇
杜旭浩
蔡佳纹
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP21863663.7A priority Critical patent/EP4199543A4/en
Priority to JP2023515026A priority patent/JP2023539774A/ja
Publication of WO2022048599A1 publication Critical patent/WO2022048599A1/zh
Priority to US18/177,652 priority patent/US20230209297A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/302Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303Tracking of listener position or orientation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/165Management of the audio stream, e.g. setting of volume, audio stream path
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/20Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/323Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only for loudspeakers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00Stereophonic arrangements
    • H04R5/02Spatial or constructional arrangements of loudspeakers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00Stereophonic arrangements
    • H04R5/04Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2400/00Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/13Aspects of volume control, not necessarily automatic, in stereophonic sound systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2420/00Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Definitions

  • the present application relates to the technical field of audio processing, and in particular, to a method for adjusting the position of a speaker box, an audio rendering method, and an apparatus.
  • people may arrange a 5.1 or 5.1.2 home theater system, or use a stereo playback system such as a soundbar to obtain a cinema-like sound and image space.
  • a stereo playback system such as a soundbar
  • the first step is to design the user's sweet point, which refers to the best listening position.
  • sweet spot design methods There are usually two sweet spot design methods, one is a cross-talk cancellation (cross-talk cancellation) method that virtualizes the surround speakers according to the head-related transfer function and the room response, the other is to form a directional sound wave by controlling the speaker array, and then With the help of reflectors such as walls, sound waves are transmitted to the human ear from a fixed angle, so as to achieve a beam-forming method of surround feeling.
  • the present application provides a sound box position adjustment method, audio rendering method and device, so as to achieve more accurate crosstalk cancellation, eliminate the influence of different rooms, enhance the sound and image effect, and truly restore the original sound effect.
  • the present application provides a method for adjusting the position of a speaker, comprising: an electronic device sending a first playback instruction to the speaker, where the first playback instruction is used to instruct the speaker to rotate from a first position to a second position along a preset direction. position, and play positional audio during the rotation, and the loudness of the positional audio is stable during playback; the electronic device receives the positional audio; the electronic device determines the indication information according to the positional audio, and the The instruction information is used to determine the target position of the sound box, and the target position is the position of the sound box when the received audio loudness is the largest during the process of receiving the positioning audio by the electronic device, and the target position is the position of the sound box.
  • the sound box is rotated from the first position to a position in the process of the second position; the electronic device sends the instruction information to the sound box.
  • the speaker receives the first playback instruction from the electronic device; the speaker rotates from the first position to the second position along the preset direction according to the first playback instruction, and plays the positioning audio during the rotation, and the The loudness of the positioning audio is stable during playback; the sound box receives the indication information from the electronic device, and the indication information is used to determine the target position, and the target position is the location where the positioning audio is received by the electronic device.
  • the position of the sound box when the received audio loudness is the largest the target position is a position in the process of the sound box being rotated from the first position to the second position; the sound box according to the instruction Information is rotated from the second position to the target position.
  • the angle difference between the first position and the second position is related to the binaural distance of the user; or, the angle difference between the first position and the second position is the same as a preset value.
  • the fine-tuning range is related.
  • the indication information is further used to instruct the sound box to move from the second position to the target position.
  • the preset direction includes a horizontal clockwise direction or a horizontal counterclockwise direction.
  • the rotating includes rotating at a constant speed around a rotating axis of the sound box in the vertical direction.
  • the rotation axis of the speaker in the vertical direction can be the vertical axis of the fixed speaker, the speaker rotates clockwise or counterclockwise around the axis in the horizontal direction, and the speaker can also rotate clockwise or counterclockwise in the horizontal direction under the drive of this axis.
  • the axis of rotation of the sound box in the vertical direction may be an axis passing through the center of the sound box itself or its extension line passing through the center of the sound box.
  • the center of the cabinet refers to the geometric center of the cabinet.
  • the shape of the sound box includes a bar, a square or a ring.
  • the method for adjusting the position of the sound box of the present application can also be applied to the position adjustment of a device with a speaker, that is, the sound box in this application can be understood as an external device with a speaker.
  • the user may issue a dessert positioning instruction through an interactive interface provided by an application (application, APP) installed on the electronic device.
  • application application, APP
  • the electronic device starts to execute the steps of the method for adjusting the position of the sound box, and the first step is to send a first playback instruction to the sound bar.
  • the first play instruction is used to instruct the sound bar to rotate from the first position to the second position at a constant speed, and play positioning audio during the rotation.
  • Positioning audio is full-band audio that meets the set conditions.
  • positioning audio can be full-band audio with a sound pressure level of not less than 65dB and a signal-to-noise ratio of not less than 20dB, including white noise, pink noise, or frequency sweep signals.
  • the energy of each frame of positional audio is the same.
  • the stable loudness of positioning audio during playback can be understood as the energy of each audio frame remains unchanged when positioning audio is playing, and the playback parameters of the speaker also need to remain unchanged, so that the playback energy when the speaker plays the audio. constant.
  • the positioning audio may be audio pre-stored in the speaker, user-defined audio, or audio sent by the electronic device to the speaker. The present application does not specifically limit the method for obtaining the positioning audio from the speaker.
  • the position of the sound bar may be represented by the angle of the first included angle a between the sound bar and the vertical plane of the vertical plane, and the vertical plane may, for example, refer to: The wall to which the sound bar is placed or mounted.
  • the angle of the first included angle When the sound bar is parallel to the vertical plane, the angle of the first included angle is 0°; the sound bar starts to rotate counterclockwise from the angle 0°, and when it is turned to be perpendicular to the vertical plane, the angle of the first included angle is 90°, the angle of the first included angle changes from 0° to 90° during the rotation; the sound bar starts to rotate clockwise from the angle 0°, and when it is turned to be perpendicular to the vertical plane, the angle of the first included angle is -90°, the angle of the first included angle changes from 0° to -90° during the rotation. It can be seen that when the opening of the first included angle is to the left, the angle value of the first included angle is positive, and when the opening of the first included angle is to the right, the angle value of the first included angle is negative.
  • the position of the sound bar may also pass through the angle of the second included angle b between the vertical line of the center of the sound bar and the vertical line of the vertical plane of the vertical plane.
  • the angle of the second included angle is 0°; the sound bar starts from the angle of 0° Rotate counterclockwise, when turned to be perpendicular to the vertical plane, the vertical line of the center of the sound bar and the vertical line of the vertical plane are perpendicular to each other, and the angle of the second included angle is 90°.
  • the angle of the angle changes from 0° to 90°; the sound bar is turned clockwise from the angle 0°, when turned to be perpendicular to the vertical plane, the vertical line of the center of the sound bar and the vertical line of the vertical plane are mutually Vertical, at this time, the angle of the second included angle is -90°, and the angle of the second included angle changes from 0° to -90° during the rotation. It can be seen that when the vertical line of the center of the sound bar is located to the right of the vertical line of the vertical plane, the angle value of the second included angle is positive, and the vertical line of the center of the sound bar is located to the left of the vertical line of the vertical plane. , the angle value of the second included angle is negative.
  • both the first position and the second position can be represented by the angle value of the first included angle or the second included angle, and the sound bar rotates at a constant speed from the first position to the second position, which can be described as the sound bar from the first position.
  • the first angle and the second angle are respectively two angle values of the first included angle, or the first angle and the second angle are respectively two angle values of the second included angle.
  • the initial position of the center of the sound bar and the user's position may be obtained, and the sound bar may be calculated according to the initial position and the user's position.
  • the fine-tuning angle is obtained, and then the first position and the second position are obtained according to the theoretical sweet-spot position and the fine-tuning angle.
  • the line connecting the user's position and the center of the sound bar is perpendicular to the sound bar's external surface, and the external surface faces the user.
  • the external surface of the sound bar refers to the surface on which the external speaker of the sound bar is located.
  • the speaker is placed on one side of the speaker, so the surface of the speaker at this time refers to that side.
  • the first position is the position where the sound bar is rotated by the fine-tuning angle from the theoretical sweet spot position to the preset direction
  • the second position is the position where the sound bar is rotated by the fine-tuning angle from the theoretical sweet spot position to the opposite direction of the preset direction.
  • the present application can provide an interactive interface (such as a room configuration interface, please refer to the description of FIG. 11 below) provided by the APP, and the user inputs a first virtual position on the interface, and the first virtual position is used to simulate that the center of the sound bar is in the room
  • the initial position of the center of the sound bar can be calculated based on the first virtual position, and the initial position can be expressed in the form of coordinates.
  • the user can also input a second virtual position on the above-mentioned interactive interface, the second virtual position is used to simulate the user's position in the room, and the user's position can be calculated based on the second virtual position, and the user's position can also be The form of coordinates.
  • the theoretical sweet spot position of the sound bar can be obtained according to the following formulas (1) to (3):
  • d represents the straight-line distance between the user's location and the center of the sound bar
  • (x c , y c ) represents the user's location
  • (x s0 , y s0 ) represents the initial location of the center of the sound bar.
  • h represents the vertical distance between the user's location and the center of the soundbar.
  • A represents the angle value corresponding to the theoretical sweet spot position of the sound bar.
  • A the angle corresponding to the above-mentioned second angle.
  • the purpose of dessert positioning is to make the line between the center of the sound bar and the user's position perpendicular to the external surface of the sound bar, and the external surface faces the user, so the sound bar needs to be rotated horizontally and clockwise. A can achieve this purpose, and the angle A corresponds to the theoretical sweet spot position of the sound bar.
  • the fine-tuning angle ⁇ is calculated by formula (4):
  • w represents twice the binaural distance, and w may adopt a preset fixed value, or may be preset by the user.
  • the fine-tuning angle ⁇ can be directly input by the user in an interactive interface (eg, a precise dessert positioning interface).
  • an interactive interface eg, a precise dessert positioning interface
  • the first angle corresponding to the first position may be A- ⁇ , and the second angle corresponding to the second position may be A+ ⁇ ; or, the first angle corresponding to the first position may be A+ ⁇ , the second angle corresponding to the second position may be A- ⁇ .
  • the sound bar After the sound bar receives the first play instruction, it obtains the first position and the second position from the first play instruction, according to the preset rotation direction, such as from A- ⁇ to A+ ⁇ , or from A+ ⁇ to A- ⁇ , which plays positional audio, such as pre-recorded rain sounds, while turning.
  • the preset rotation direction such as from A- ⁇ to A+ ⁇ , or from A+ ⁇ to A- ⁇ , which plays positional audio, such as pre-recorded rain sounds, while turning.
  • the sound bar plays positional audio while rotating, so the positional audio received by the microphone of the electronic device may vary in loudness. That is, when the sound bar is rotated away from the electronic device, the loudness of the positional audio received by the electronic device becomes smaller, while the loudness of the positioning audio received by the electronic device becomes smaller. As the soundbar is rotated closer to the electronic device, the positional audio received by the electronic device becomes louder.
  • the purpose of fine-tuning is to find the position of the soundbar when the loudness of the positional audio being received by the electronics is at its maximum. Since the loudness is detected by the user's electronic device, when the sound bar is in this position, it can be considered that the sweet spot of the sound bar is exactly where the user is.
  • the electronic device may detect the received positioning audio at a set frequency from the moment when the positioning audio is initially received to obtain a loudness.
  • the electronic device determines the difference between the time corresponding to the largest one of the obtained multiple loudnesses and the starting receiving time as the target time.
  • the electronic device can synchronize the reception of positional audio and the detection of loudness.
  • the electronic device may detect the positioning audio to obtain the maximum loudness, and then determine the difference between the time corresponding to the maximum loudness and the initial receiving time of the positioning audio as the target time.
  • the electronic device may also detect the entire segment of the location audio after receiving all the location audio.
  • the electronic device can perform an energy comparison between the received positional audio and the pre-stored positional audio, that is, compare the first position of the received positional audio.
  • the angle value corresponding to the target position of the sound bar can be calculated according to the following formula:
  • the angle value B corresponding to the target position is calculated according to formula (5):
  • the sound bar Since the sound bar is rotated to the second position (the corresponding second angle is A+ ⁇ ) when the positioning audio is played, the sound bar needs to be rotated to the target position (the corresponding angle is B), which is reversed from the second position.
  • the angle value B corresponding to the target position is calculated according to formula (6):
  • v represents the rotation speed of the sound bar, which can be preset
  • t represents the target time
  • the sound bar Since the sound bar is rotated to the second position (the corresponding second angle is A- ⁇ ) when the positioning audio is played, the sound bar needs to be rotated to the target position (the corresponding angle is B), which is reversed from the second position.
  • the electronic device determines the target time as the indication information.
  • the fine-tuning angle ⁇ in the above formula can be obtained from the previous interaction information with the electronic device, which will not be repeated here; the rotation speed can be preset.
  • the target time can be obtained from the indication information.
  • the direction of rotation can also be preset. Therefore, the sound bar can calculate the angle ⁇ that needs to be rotated based on this information.
  • the electronic device determines the target time and the opposite direction of the preset direction as the indication information.
  • the fine-tuning angle ⁇ in the above formula can be obtained from the previous interaction information with the electronic device, which will not be repeated here; the rotation speed can be preset.
  • the target time and turning direction (the opposite of the preset direction) can be obtained from the indication information. Therefore, the sound bar can calculate the angle ⁇ that needs to be rotated based on this information.
  • the electronic device determines the target time, the opposite direction of the preset direction, and the fine-tuning angle as the indication information.
  • the fine-tuning angle ⁇ and the target time in the above formula, as well as the rotation direction (the opposite direction of the preset direction) can be obtained from the indication information.
  • the rotation speed can be preset. Therefore, the sound bar can calculate the angle ⁇ that needs to be rotated based on this information.
  • the electronic device determines the reverse direction of the preset direction and the target rotation angle as the indication information.
  • the rotation direction (the opposite direction of the preset direction) can be obtained from the indication information.
  • the sound bar does not need to calculate the angle ⁇ to be rotated through the above formula, and the angle can also be obtained from the indication information.
  • the duration T of the positioning audio, the target time t, the fine-tuning angle ⁇ and the rotation speed v are mutually constrained, that is, the result of the fine-tuning obtains the angle value B corresponding to the target position, and the angle value B corresponding to the target position falls within the Within the angular range [A- ⁇ , A+ ⁇ ], therefore, - ⁇ vt ⁇ , t ⁇ T.
  • the indication information determined by the electronic device may include the angle value B corresponding to the target position, or may include the target time t, both of which may enable the sound bar to determine its target position.
  • the instruction information also has the function of instructing the sound bar to go from the second position to the target position, so after the sound bar receives the instruction information, it first determines the target position, and then turns from the current position to the target position.
  • the sound bar is turned from the position corresponding to A- ⁇ to the position corresponding to A+ ⁇ , then after receiving the instruction information, the sound bar starts to reversely rotate the angle (2 ⁇ ) from the position corresponding to A+ ⁇ -vt) to reach the position corresponding to B.
  • the sound bar is turned from the position corresponding to A+ ⁇ to the position corresponding to A- ⁇ , then after receiving the instruction information, the sound bar starts to reverse the rotation angle from the position corresponding to A- ⁇ ( 2 ⁇ -vt) to the position corresponding to B.
  • the sound bar and the electronic device cooperate with each other.
  • the sound bar rotates from the first position to the second position at a constant speed while playing the positioning audio. , and control the sound bar to go to this position, which can achieve more accurate crosstalk cancellation according to the user's position, eliminate the influence of different rooms, enhance the sound and image effect, and truly restore the original sound effect.
  • the electronic device sends a second playback instruction to the sound bar, where the second playback instruction is used to instruct the sound bar to play the test audio; the electronic device receives the collected audio, and the The collected audio is the audio received by the microphone of the earphone worn by the user during the playback of the test audio; the electronic device calculates the binaural room impulse response BRIR according to the collected audio and the test audio; the electronic The device obtains the filter coefficients of the sound bar according to the BRIR.
  • BRIR can be calculated by Equation (7):
  • 0 ⁇ p ⁇ P P represents the number of users; 0 ⁇ k ⁇ K, K represents the number of speaker units; i is 0 for the left ear, i is 1 for the right ear; f is the frequency; H 2p+i ,k (f) represents the BRIR of the p-th user corresponding to the k-th speaker unit; Y i,p,k (f) represents the echoed audio of the p-th user’s headphones corresponding to the k-th sound bar; T( f) represents the test audio.
  • H(f) ⁇ C K ⁇ K represents a matrix composed of the BRIR calculated by formula (7) as an element, and the matrix covers the room transfer functions of all users corresponding to all speaker units respectively;
  • * H represents the conjugate Matrix;
  • I k (f) ⁇ C K ⁇ K represents the identity matrix;
  • D(f) ⁇ R 2P ⁇ R represents the ideal transfer function,
  • the sound bar processes the audio played by the sound bar by formula (9) according to the updated filter coefficients:
  • X(f) represents the processed audio
  • S(f) represents the audio played by the soundbar
  • C(f) represents the filter coefficients
  • the above filter coefficients are obtained after accurate sweet spot positioning, so it can achieve more accurate crosstalk cancellation according to the location of the user, eliminate the influence of different rooms, enhance the sound and image effect, and truly restore the original sound effect.
  • the method before the electronic device acquires the filter coefficients of the sound bar according to the BRIR, the method further includes: the electronic device receives a virtual space instruction, where the virtual space instruction includes a listening space ; the electronic device obtains the transfer function of the listening space; the electronic device obtains the filter coefficients of the sound bar according to the BRIR, including: the electronic device obtains the filter coefficients of the sound bar according to the BRIR and the listening space
  • the transfer function calculates the filter coefficients of the soundbar.
  • the listening space is the "Golden Hall”.
  • the electronic device calculates the filter coefficient by formula (10):
  • H(f) ⁇ C K ⁇ K represents the matrix composed of the BRIR calculated by formula (7) as the element, and the matrix covers the room transfer functions of all users corresponding to all sound bars respectively;
  • * H represents the total Yoke matrix;
  • I k (f) ⁇ C K ⁇ K representing the identity matrix;
  • the sound bar processes the audio played by the sound bar by formula (11) according to the updated filter coefficients:
  • S(f) represents the audio played by the soundbar
  • filter coefficients represents the filter coefficients
  • the above filter coefficients are obtained after exclusive customization, so it can achieve more accurate crosstalk cancellation according to the user's location, eliminate the influence of different rooms, achieve enhanced sound and image effects, and truly restore the original sound effects.
  • the location renders the sound field, giving the user an immersive experience.
  • the present application provides a method for adjusting the position of a speaker, comprising: an electronic device sending a first playback instruction to the i-th speaker, where the first playback instruction is used to instruct the i-th speaker to move from a first position along a preset direction. Set the direction to rotate to the second position at a constant speed, and play positional audio during the rotation.
  • the loudness of the positional audio during playback is stable and unchanged, and the i-th speaker is one of the N speakers, and 1 ⁇ i ⁇ N, if N is greater than 1, it is a positive integer;
  • the electronic device receives a mixed signal, and the mixed signal is an audio signal formed by mixing the positioning audio played by the N speakers;
  • the mixing signal determines the ith indication information, and the ith indication information is used to determine the target position of the ith speaker, and the target position of the ith speaker is to receive the mixed sound at the electronic device.
  • the position of the i-th speaker corresponding to the received audio loudness is the largest; the electronic device sends the i-th indication information to the i-th speaker.
  • the preset direction includes a horizontal clockwise direction or a horizontal counterclockwise direction.
  • the method before the electronic device sends the first playback instruction to the ith speaker, the method further includes: the electronic device obtains the initial position of the center of the ith speaker and the position of the user; The electronic device calculates the theoretical sweet spot position of the i-th speaker relative to the user's position according to the initial position and the user's position, when the i-th speaker is located at the theoretical sweet spot position , the connection line between the position of the user and the center of the i-th speaker is perpendicular to the external surface of the i-th speaker, and the external surface faces the user; the electronic device obtains the fine-tuning angle ; the electronic device acquires the first position and the second position of the i-th speaker according to the theoretical sweet spot position and the fine-tuning angle.
  • the first position of the i-th speaker is the position where the i-th speaker rotates the fine-tuning angle from the theoretical sweet spot position to the preset direction;
  • the second position of each speaker is the position where the i-th speaker rotates the fine-tuning angle from the theoretical sweet spot position to the opposite direction of the preset direction.
  • the difference between this embodiment and the above-mentioned first aspect is that the number of sound bars in the room is changed from one to a plurality of sound bars, and the plurality of sound bars are arranged in a row, and their external surfaces are all facing the user.
  • multiple sound bars in the room play positional audio at the same time, and the microphone of the user terminal receives the mixed signals of the positioning audio played by the multiple sound bars respectively. Since the positions of each sound bar relative to the user are different, Therefore, the position of each sound bar corresponding to the maximum loudness of the received positioning audio is also different.
  • the target position and indication information needs to be obtained separately for each sound bar.
  • a plurality of sound bars and electronic devices cooperate with each other, and the plurality of sound bars rotate from the first position to the second position at a constant speed while playing the positional audio, and the electronic device finds the loudness according to the received mixed signal of the positional audio
  • the position of each sound bar is controlled, and each sound bar is controlled to move to its corresponding position, which can achieve more accurate crosstalk cancellation according to the user's position, eliminate the influence of different rooms, enhance the sound and image effect, and restore the true Original sound.
  • the electronic device sends a first playback instruction to the speaker, where the first playback instruction is used to instruct the speaker to rotate from a first position to a second position along a preset direction, and during the rotation process
  • the positional audio is played during playback, and the loudness of the positional audio is stable during playback
  • the electronic device receives a plurality of collected audios, and the plurality of collected audios are terminals of a plurality of users during the playback of the positional audio.
  • the audio received by the microphones respectively; the electronic device determines the indication information according to the plurality of collected audios, and the indication information is used to determine the target position of the speaker, and the target position is the electronic device of the plurality of users.
  • the The electronic device sends the instruction information to the sound box.
  • the method before the electronic device sends the first playback instruction to the sound box, the method further includes: obtaining, by the electronic device, the initial position of the center of the sound box and the positions of the multiple users; the The electronic device determines the central positions of the plurality of users according to the positions of the plurality of users; the electronic device calculates the sound box relative to the plurality of users according to the initial position and the central positions of the plurality of users The theoretical sweet spot position of the central position of the sound box, when the sound box is located at the theoretical sweet spot position, the line connecting the center positions of the plurality of users and the center of the sound box is perpendicular to the external surface of the sound box, and the The lay-out surface faces the plurality of users; the electronic device obtains a fine-tuning angle; the electronic device obtains the first position and the second position according to the theoretical sweet spot position and the fine-tuning angle.
  • the difference between this embodiment and the above-mentioned first aspect is that the number of users in the room changes from one to multiple.
  • the microphones of multiple user terminals in the room receive positioning audio respectively.
  • the position of the soundbar when the loudest positional audio is received also varies.
  • the reference for finding the target position of the sound bar is the sum of the loudness of the sound bar received by each user terminal at each sampling time.
  • the sound bar and the electronic device cooperate with each other.
  • the sound bar rotates from the first position to the second position at a constant speed while playing the positioning audio.
  • the position of the sound bar and control the sound bar to go to this position which can achieve more accurate crosstalk cancellation for the positions of multiple users, eliminate the influence of different rooms, enhance the sound and image effect, and truly restore the original sound effect.
  • the electronic device divides the space into a plurality of subspaces according to the number of N speakers, each of the subspaces corresponds to one of the speakers, and N is greater than 1 is a positive integer; the electronic devices are respectively Send a first play instruction to the N speakers, the first play instruction is used to instruct the corresponding speaker to rotate from the first position to the second position along the preset direction, and play the positioning audio during the rotation, The loudness of the positioning audio is stable during playback; the electronic device determines N indication information, the N indication information corresponds to the N speakers, and the indication information is used to determine the corresponding sound box. Target position; the electronic device sends the N pieces of indication information to the corresponding speakers respectively.
  • the electronic device determining the N pieces of indication information includes: the electronic device receiving the first positioning audio played by the i-th speaker, where the i-th speaker is one of the N speakers. One, 1 ⁇ i ⁇ N, there is only one first user in the subspace corresponding to the first speaker; the electronic device determines first indication information according to the first positioning audio, and the first indication information is used for Determine the first target position of the i-th sound box, and the first target position is the i-th sound box when the received audio loudness is the largest during the process of receiving the first positioning audio by the electronic device the location.
  • the method before the electronic device respectively sends the first playback instruction to the N speakers, the method further includes: acquiring, by the electronic device, the first initial position of the center of the i-th speaker and the the position of the first user; the electronic device calculates the first theoretical sweet spot position of the i-th speaker relative to the position of the user according to the first initial position and the position of the first user , when the i-th speaker is located at the first theoretical sweet spot position, the connection between the position of the first user and the center of the i-th speaker is perpendicular to the external surface of the i-th speaker , and the external surface faces the first user; the electronic device obtains a first fine-tuning angle; the electronic device obtains the the first position and the second position.
  • the electronic device determining the N pieces of indication information includes: the electronic device receives a plurality of collected audios, and the plurality of collected audios is a process of playing the second positioning audio in the jth speaker , the audio received by the microphones of the electronic devices of multiple second users, the jth speaker is one of the N speakers, 1 ⁇ j ⁇ N, the multiple second users are located in the In the subspace corresponding to the j speakers; the electronic device determines the second indication information according to the plurality of collected audios, and the second indication information is used to determine the second target position of the jth speaker, the The second target position is the position where the jth speaker is located when the sum of the received audio loudness is the largest during the process of receiving the second positioning audio by the electronic devices of the plurality of second users, and the second target position A position in the process of rotating the first position to the second position.
  • the method further includes: acquiring, by the electronic device, the second initial position of the center point of the jth speaker and the the positions of the plurality of second users; the electronic device determines the central positions of the plurality of second users according to the positions of the plurality of second users; the electronic device determines the center positions of the plurality of second users according to the second initial position and the The center positions of the plurality of second users calculate the second theoretical sweet spot position of the jth speaker relative to the center positions of the plurality of second users, when the jth speaker is located at the second theoretical sweet spot position, the line connecting the center positions of the plurality of second users and the center of the jth speaker is perpendicular to the external surface of the jth speaker, and the external surface faces the plurality of Two users; the electronic device obtains a second fine-tuning angle; the electronic device obtains the first position and the second position of the j-th speaker according to the second theoretical sweet
  • the electronic device determining the N pieces of indication information includes: the electronic device receives a plurality of collected audios, and the plurality of collected audios is a process of playing the third positioning audio in the kth speaker , the audio received by the microphones of the electronic devices of multiple third users respectively, the kth speaker is one of the N speakers, 1 ⁇ k ⁇ N, in the subspace corresponding to the kth speaker There is no user, and the plurality of third users refer to all users in the space; the electronic device determines third indication information according to the plurality of collected audios, and the third indication information is used to determine the kth The third target position of each speaker, the third target position is the kth position when the sum of the received audio loudness is the largest during the process of receiving the third positioning audio by the electronic devices of the plurality of third users The position where the sound box is located, and the third target position is a position in the process of rotating the first position to the second position.
  • the method before the electronic device sends the first playback instruction to the N speakers respectively, the method further includes: acquiring, by the electronic device, the third initial position of the kth speaker and the multiple the positions of the third users; the electronic device determines the central positions of the plurality of third users according to the positions of the plurality of third users; the electronic device determines the central positions of the plurality of third users according to the positions of the plurality of third users; The third theoretical sweet spot position of the kth speaker relative to the center positions of the multiple users is calculated from the center positions of the third users.
  • the The electronic device acquires a third fine-tuning angle; the electronic device acquires the first position and the second position of the k-th speaker according to the third theoretical sweet spot position and the third fine-tuning angle.
  • the electronic equipment first divides the space in the room according to the number of sound bars, and each sound bar corresponds to a subspace.
  • each sound bar corresponds to a subspace.
  • the center of the sound bar is the vertex, and the horizontal space in front of the sound bar can be divided into 3 subspaces according to the method of dividing the 180° angle in the horizontal direction.
  • the left subspace corresponds to sound bar 1, in which there is 1 user
  • the middle subspace corresponds to Soundbar 2, which has 2 users
  • the right subspace corresponds to Soundbar 3, which has no users. That is, in the scenario shown in Figure 15, three sound bars correspond to three subspaces, respectively.
  • the relationship between the three sound bars and the number of users is one-to-one, one-to-many, and one-to-one. to empty.
  • the electronic device determines the target position for each sound bar according to the number of users in the subspace according to the result of the division of the space.
  • the method determines the target position of the corresponding sound bar, and then determines its indication information, but when the theoretical sweet spot position is obtained, the position of the user based on it becomes the center position of all users in the subspace; for the subspace without users,
  • the target position of the corresponding sound bar can also be determined with reference to the method of the second aspect above, and then its indication information can be determined, except that when the theoretical sweet spot position is obtained, the user's position based on it becomes the center position of all users in the room.
  • a plurality of sound bars and electronic devices cooperate with each other, and the plurality of sound bars rotate from the first position to the second position at a constant speed while playing the positioning audio, and the electronic device for each sound bar, according to its corresponding Find the position of the sound bar when the loudness or the sum of the loudness is the largest in the sampled audio received by the user's terminal in the subspace of the subspace, and control the sound bar to go to this position, so that it can be more accurate for the positions of multiple users.
  • Crosstalk cancellation eliminate the influence of different rooms, enhance the sound and image effect, and restore the original sound effect.
  • the present application provides a control device, comprising: a sending module configured to send a first playback instruction to a speaker, where the first playback instruction is used to instruct the speaker to rotate from a first position to a second position along a preset direction two positions, and play the positioning audio during the rotation, and the loudness of the positioning audio is stable during playback;
  • the receiving module is used to receive the positioning audio;
  • the processing module is used to determine the indication information according to the positioning audio , the indication information is used to determine the target position of the sound box, and the target position is the position of the sound box when the received audio loudness is the largest during the process of receiving the positioning audio by the electronic device, and the target position is The position is a position in the process of rotating the sound box from the first position to the second position; the sending module is further configured to send the instruction information to the sound box.
  • the angle difference between the first position and the second position is related to the binaural distance of the user; or, the angle between the first position and the second position The difference is relative to the preset fine-tuning range.
  • the indication information is further used to instruct the sound box to move from the second position to the target position.
  • the preset direction includes a horizontal clockwise direction or a horizontal counterclockwise direction.
  • the rotating includes rotating at a constant speed around a rotating axis of the sound box in the vertical direction.
  • the shape of the sound box includes a bar, a square or a ring.
  • the processing module is further configured to obtain the initial position of the center of the sound box and the position of the user;
  • the theoretical sweet spot position of the user when the sound box is located at the theoretical sweet spot position, the line connecting the user's position with the center of the sound box is perpendicular to the external surface of the sound box, and the external sound box is a surface facing the user; obtaining a fine-tuning angle; obtaining the first position and the second position according to the theoretical sweet spot position and the fine-tuning angle.
  • the first position is the position where the sound box rotates the fine adjustment angle clockwise from the theoretical sweet spot position;
  • the second position is the sound box from the theoretical sweet spot position.
  • the sweet spot position rotates the position of the fine-tuning angle counterclockwise horizontally.
  • the processing module is specifically configured to display a room configuration interface, where the room configuration interface is used to simulate the space where the user and the speaker are located; receive the user's configuration in the room
  • the first virtual position input on the interface, the first virtual position is used to simulate the initial position; the initial position is calculated according to the first virtual position; the first virtual position input by the user on the room configuration interface is received;
  • the processing module is specifically configured to calculate the fine-tuning angle according to the initial position, the position of the user, and the binaural distance of the user.
  • the processing module is specifically configured to display a precise dessert positioning interface, and the precise dessert positioning interface includes a pop-up window for setting a fine-tuning angle;
  • the input preset experience value; the size of the fine-tuning angle is set as the preset experience value.
  • the processing module is specifically configured to detect the received positioning audio at a set frequency from the initial receiving time of the positioning audio to obtain a loudness;
  • the target time is determined as the indication information; or, determine the target time and the opposite direction of the preset direction as the indication information; or, determine the target time, the opposite direction of the preset direction, and the fine-tuning angle as the indication information ;
  • the opposite direction of the preset direction and a target rotation angle are determined as the indication information, and the target rotation angle is used to instruct the sound box to rotate from the second position to the target position.
  • the processing module is specifically configured to detect the positioning audio to obtain the maximum loudness; the difference between the time corresponding to the maximum loudness and the initial receiving time of the positioning audio
  • the target time is determined as the target time; the target time is determined as the indication information; or, the target time and the opposite direction of the preset direction are determined as the indication information;
  • the reverse direction of the preset direction and the fine-tuning angle are determined as the instruction information; or, the reverse direction of the preset direction and the target rotation angle are determined as the instruction information, and the target rotation angle is used to indicate the sound box. Rotate from the second position to the target position.
  • the sending module is further configured to send a second playback instruction to the speaker, where the second playback instruction is used to instruct the speaker to play the test audio;
  • the receiving module is further configured to use
  • the collected audio is the audio received by the microphone of the earphone worn by the user during the playback of the test audio;
  • the processing module is also used to calculate according to the collected audio and the test audio
  • the binaural room impulse response BRIR; the filter coefficient of the speaker is obtained according to the BRIR.
  • the processing module is further configured to receive a virtual space instruction, where the virtual space instruction includes a listening space; acquire a transfer function of the listening space; according to the BRIR and the listening space The transfer function of the sound space calculates the filter coefficients of the cabinet.
  • the present application provides an audio playback device, comprising: a receiving module for receiving a first playback instruction from an electronic device; a processing module for starting from a first position along a preset direction according to the first playback instruction Rotate to the second position, and play the positioning audio during the rotation, and the loudness of the positioning audio is stable during playback; the receiving module is also used for receiving the instruction information from the electronic device, the instruction The information is used to determine the target position, the target position is the position of the speaker when the received audio loudness is the largest during the process of receiving the positioning audio by the electronic device, and the target position is the sound box from the A position in the process of rotating the first position to the second position; the processing module is further configured to rotate from the second position to the target position according to the instruction information.
  • the angle difference between the first position and the second position is related to the binaural distance of the user; or, the angle between the first position and the second position The difference is relative to the preset fine-tuning range.
  • the preset direction includes a horizontal clockwise direction or a horizontal counterclockwise direction.
  • the rotating along the preset direction includes rotating at a constant speed along the preset direction.
  • the shape of the sound box includes a bar, a square or a ring.
  • the receiving module is further configured to receive the theoretical sweet spot position and the fine-tuning angle from the electronic device.
  • the position of the user is different from the position of the user.
  • the connection line of the center of the speaker is perpendicular to the external surface of the speaker, and the external surface faces the user;
  • the processing module is further configured to determine the first position according to the theoretical sweet spot position and the fine-tuning angle. a position; rotated to the first position.
  • the first position is the position where the sound box rotates the fine adjustment angle clockwise from the theoretical sweet spot position;
  • the second position is the sound box from the theoretical sweet spot position.
  • the sweet spot position rotates the position of the fine-tuning angle counterclockwise horizontally.
  • the present application provides a control device, comprising: a sending module configured to send a first playback instruction to the i-th speaker, where the first playback instruction is used to instruct the i-th speaker to move from the first position along the The preset direction is rotated to the second position at a constant speed, and the positioning audio is played during the rotation.
  • the loudness of the positioning audio is stable during playback.
  • the i-th speaker is one of the N speakers, and 1 ⁇ i ⁇ N, if N is greater than 1, it is a positive integer; the receiving module is used to receive a mixed signal, and the mixed signal is an audio signal formed by mixing the positioning audio played by the N speakers; the processing module is used for The i-th indication information is determined according to the mixed sound signal, and the i-th indication information is used to determine the target position of the i-th speaker, and the target position of the i-th speaker is received by the electronic device. In the process of the mixing signal, the position of the i-th sound box corresponding to the time when the received audio loudness is the largest; the sending module is also used to send the i-th instruction information to the i-th sound box .
  • the preset direction includes a horizontal clockwise direction or a horizontal counterclockwise direction.
  • the processing module is further configured to acquire the initial position of the center of the i-th speaker and the position of the user;
  • the first position of the i-th speaker is the position where the i-th speaker rotates the fine-tuning angle from the theoretical sweet spot position to the preset direction;
  • the second position of each speaker is the position where the i-th speaker rotates the fine-tuning angle from the theoretical sweet spot position to the opposite direction of the preset direction.
  • the sending module is further configured to send a first playback instruction to the speaker, where the first playback instruction is used to instruct the speaker to rotate from a first position to a second position along a preset direction , and play the positioning audio during the rotation, and the loudness of the positioning audio is stable during playback;
  • the receiving module is also used to receive a plurality of collected audios, and the multiple collected audios are in the positioning audio During the playback of the audios, the audios received by the microphones of the terminals of multiple users respectively;
  • the processing module is further configured to determine indication information according to the plurality of collected audios, and the indication information is used to determine the target position of the speaker , the target position is the position where the speaker is located when the sum of the received audio loudness is the largest during the process of receiving the positioning audio by the electronic devices of the multiple users, and the target position is the rotation of the first position to a position in the process of the second position;
  • the sending module is further configured to send the indication information to the sound box.
  • the processing module is further configured to acquire the initial position of the center of the speaker and the positions of the multiple users; determine the multiple users according to the positions of the multiple users The center position of the user; calculate the theoretical sweet spot position of the speaker relative to the center positions of the multiple users according to the initial position and the center positions of the multiple users, when the speaker is located at the theoretical sweet spot position,
  • the line connecting the center positions of the plurality of users and the center of the sound box is perpendicular to the external surface of the sound box, and the external surface faces the user; obtain the fine-tuning angle; according to the theoretical sweet spot position and all The fine adjustment angle obtains the first position and the second position.
  • the processing module is further configured to divide the space into a plurality of subspaces according to the number of N speakers, each of the subspaces corresponds to one of the speakers, and a positive integer if N is greater than 1
  • the sending module is also used to send a first play instruction to the N speakers respectively, and the first play instruction is used to instruct the corresponding speaker to rotate from the first position to the second position along the preset direction, And play the positioning audio in the process of rotation, and the loudness of the positioning audio when playing is stable;
  • the processing module is also used to determine N pieces of indication information, and the N pieces of indication information correspond to the N speakers , the indication information is used to determine the target position of the corresponding sound box;
  • the sending module is further used to send the N pieces of indication information to the corresponding sound box respectively.
  • the present application provides an electronic device, comprising: one or more processors; a memory for storing one or more programs; when the one or more programs are executed by the one or more processors , so that the one or more processors implement the method described in any one of the first to second aspects above.
  • the present application provides an electronic device, comprising: one or more processors; a memory for storing one or more programs; when the one or more programs are executed by the one or more processors , causing the one or more processors to implement the method described in any one of the above first aspects.
  • the present application provides a computer-readable storage medium, comprising a computer program, which, when executed on a computer, causes the computer to execute the method according to any one of the first to second aspects above.
  • the present application provides a computer program product, the computer program product includes computer program code, when the computer program code is run on a computer or a processor, the computer or processor is made to execute the above-mentioned first to second aspects The method of any of the above.
  • FIG. 1 is an exemplary structural diagram of an audio playback device in the application
  • FIG. 2 is an exemplary structural diagram of the control device in the application
  • FIG. 3 is an exemplary schematic diagram of the electronic device in the application.
  • FIG. 4 is an exemplary flowchart of a process 400 of the method for adjusting the speaker position provided by the present application
  • FIG. 5 is an exemplary flowchart of a process 500 of the method for adjusting the speaker position provided by the application
  • FIG. 6 is an exemplary flowchart of a process 600 of the method for adjusting the speaker position provided by the present application
  • FIG. 7 is an exemplary flowchart of a process 700 of the method for adjusting the speaker position provided by the present application.
  • FIG. 8 is an exemplary flowchart of a process 800 of the rendering method provided by the present application.
  • FIG. 9 is an exemplary schematic diagram of a login interface in this application.
  • FIG. 10 is an exemplary schematic diagram of a function selection interface in the application.
  • FIG. 11 is an exemplary schematic diagram of the room configuration interface in the application.
  • FIG. 13 is an exemplary schematic diagram of the initial horizontal angle in the application.
  • Fig. 14 is another exemplary schematic diagram of the initial horizontal angle in the application.
  • Fig. 15 is another exemplary schematic diagram of the initial horizontal angle in the application.
  • Fig. 16 is another exemplary schematic diagram of the initial horizontal angle in the application.
  • 17a-17d are several exemplary schematic diagrams of the exclusive private customization interface in this application.
  • 18a-18c are several exemplary schematic diagrams of the void mode interface in this application.
  • At least one (item) refers to one or more, and "a plurality” refers to two or more.
  • “And/or” is used to describe the relationship between related objects, indicating that there can be three kinds of relationships, for example, “A and/or B” can mean: only A, only B, and both A and B exist , where A and B can be singular or plural.
  • the character “/” generally indicates that the associated objects are an “or” relationship.
  • At least one item(s) below” or similar expressions thereof refer to any combination of these items, including any combination of single item(s) or plural items(s).
  • At least one (a) of a, b or c can mean: a, b, c, "a and b", “a and c", “b and c", or "a and b and c" ", where a, b, c can be single or multiple.
  • FIG. 1 is an exemplary structural diagram of an audio playback device in this application.
  • the audio playback device includes a base, a turntable, and a soundbar.
  • the structure is arranged on the turntable, and the turntable is embedded on the base.
  • the turntable drives the sound bar to rotate, which can be rotated left and right in the horizontal direction and up and down in the vertical direction.
  • the turntable can also provide signals and power.
  • the above-mentioned audio playback device is an independent entity separate from the video playback device (eg, TV, computer, etc.), and when the sound bar is rotated, the video playback device does not move.
  • the audio playback device shown in FIG. 1 is only used as an example to describe a possible implementation manner of the audio playback device adopted in the present application, but it does not constitute a limitation on the audio playback device.
  • a soundbar can be placed on the bottom of a TV, mounted on a swivel base. If you want to rotate the sound bar, you can control the base to rotate, which in turn drives the sound bar to rotate without the TV needing to rotate.
  • the sound bar may be arranged on the bottom of the TV set, and both are installed on a rotatable base together with the TV set. If you want to rotate the sound bar, you can control the base to rotate, which in turn drives the sound bar and the TV to rotate together.
  • the present application provides a method for adjusting the position of a sound box and an audio rendering method, so as to accurately locate the user's position, and then control the rotation direction of the sound bar, so that the audio played by the sound bar can be played
  • the best listening position is exactly where the user is.
  • the above-mentioned speaker position adjustment method and audio rendering method can be applied to a control device, and the control device can be set on an electronic device that can communicate with the sound bar (such as Bluetooth connection), and the electronic device can be, for example, a mobile phone, a tablet computer or a smart phone. TV etc.
  • the sound bar such as Bluetooth connection
  • FIG. 2 is an exemplary structural diagram of the control device in this application. As shown in FIG. 2 , the control device includes a function module and a database module. in,
  • the functional module includes a receiving module, a processing module and a sending module.
  • the receiving module is used for receiving audio data and instructions obtained by the electronic device.
  • the processing module is used to calculate and process the target position according to the instruction and audio data, and then calculate the audio filter coefficients to realize audio rendering.
  • the sending module is used to send commands to the sound bar to control the sound bar to rotate to the target position.
  • the database module is used to store the information of the historical sweet spot, including the coordinates of the sweet spot, and the corresponding target horizontal angle and audio filter coefficient.
  • the information of the sweet spot can be directly obtained from the database module, which can reduce the amount of calculation and improve the efficiency of sweet spot location and audio rendering.
  • FIG. 3 is an exemplary schematic diagram of the electronic device in the present application, and FIG. 3 shows a schematic structural diagram when the electronic device is a mobile phone.
  • the mobile phone 300 may include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a charging management module 340, a power management module 341, a battery 332, an antenna 1 , Antenna 2, Mobile Communication Module 350, Wireless Communication Module 360, Audio Module 370, Speaker 370A, Receiver 370B, Microphone 370C, Headphone Interface 370D, Sensor Module 380, Key 390, Motor 391, Indicator 392, Camera 393, Display Screen 394, and a subscriber identification module (subscriber identification module, SIM) card interface 395 and so on.
  • a subscriber identification module subscriber identification module
  • the sensor module 380 may include a pressure sensor 380A, a gyroscope sensor 380B, an air pressure sensor 380C, a magnetic sensor 380D, an acceleration sensor 380E, a distance sensor 380F, a proximity light sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor 380K, and ambient light.
  • the structure illustrated in this embodiment does not constitute a specific limitation on the mobile phone 300 .
  • the mobile phone 300 may include more or less components than shown, or combine some components, or separate some components, or arrange different components.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 310 may include one or more processing units, for example, the processor 310 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processor
  • image signal processor image signal processor
  • ISP image signal processor
  • controller video codec
  • digital signal processor digital signal processor
  • baseband processor baseband processor
  • neural-network processing unit neural-network processing unit
  • the controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 310 for storing instructions and data.
  • the memory in processor 310 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 310 . If the processor 310 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided, and the waiting time of the processor 310 is reduced, thereby increasing the efficiency of the system.
  • the processor 310 may cooperate with the mobile communication module 350 or the wireless communication module 360 to realize the functions of the above-mentioned control apparatus.
  • the processor 310 may also cooperate with the audio module 370 and the microphone 370C to receive the audio played by the sound bar, thereby implementing the functions of the above control device.
  • processor 310 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / or universal serial bus (universal serial bus, USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transceiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB universal serial bus
  • the I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL).
  • processor 310 may contain multiple sets of I2C buses.
  • the processor 310 can be respectively coupled to the touch sensor 380K, the charger, the flash, the camera 393 and the like through different I2C bus interfaces.
  • the processor 310 can couple the touch sensor 380K through the I2C interface, so that the processor 310 and the touch sensor 380K communicate with each other through the I2C bus interface, so as to realize the touch function of the mobile phone 300 .
  • the I2S interface can be used for audio communication.
  • processor 310 may contain multiple sets of I2S buses.
  • the processor 310 may be coupled with the audio module 370 through an I2S bus to implement communication between the processor 310 and the audio module 370 .
  • the audio module 370 can transmit audio signals to the wireless communication module 360 through the I2S interface, so as to realize the function of answering calls through a Bluetooth headset.
  • the PCM interface can also be used for audio communications, sampling, quantizing and encoding analog signals.
  • the audio module 370 and the wireless communication module 360 may be coupled through a PCM bus interface.
  • the audio module 370 can also transmit audio signals to the wireless communication module 360 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
  • the UART interface is a universal serial data bus used for asynchronous communication.
  • the bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication.
  • a UART interface is typically used to connect the processor 310 with the wireless communication module 360 .
  • the processor 310 communicates with the Bluetooth module in the wireless communication module 360 through the UART interface to implement the Bluetooth function.
  • the audio module 370 can transmit audio signals to the wireless communication module 360 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.
  • the MIPI interface can be used to connect the processor 310 with peripheral devices such as the display screen 394 and the camera 393 .
  • MIPI interfaces include camera serial interface (CSI), display serial interface (DSI), etc.
  • the processor 310 communicates with the camera 393 through the CSI interface, so as to realize the shooting function of the mobile phone 300 .
  • the processor 310 communicates with the display screen 394 through the DSI interface to realize the display function of the mobile phone 300 .
  • the GPIO interface can be configured by software.
  • the GPIO interface can be configured as a control signal or as a data signal.
  • the GPIO interface may be used to connect the processor 310 with the camera 393, the display screen 394, the wireless communication module 360, the audio module 370, the sensor module 380, and the like.
  • the GPIO interface can also be configured as I2C interface, I2S interface, UART interface, MIPI interface, etc.
  • the USB interface 330 is an interface that conforms to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
  • the USB interface 330 can be used to connect a charger to charge the mobile phone 300, and can also be used to transmit data between the mobile phone 300 and peripheral devices. It can also be used to connect headphones to play audio through the headphones.
  • the interface can also be used to connect other mobile phones, such as AR devices.
  • the interface connection relationship between the modules illustrated in this embodiment is only a schematic illustration, and does not constitute a structural limitation of the mobile phone 300.
  • the mobile phone 300 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the charging management module 340 is used to receive charging input from the charger.
  • the charger may be a wireless charger or a wired charger.
  • the charging management module 340 may receive charging input from the wired charger through the USB interface 330 .
  • the charging management module 340 may receive wireless charging input through the wireless charging coil of the mobile phone 300 . While the charging management module 340 charges the battery 332 , it can also supply power to the mobile phone through the power management module 341 .
  • the power management module 341 is used to connect the battery 332 , the charging management module 340 and the processor 310 .
  • the power management module 341 receives input from the battery 332 and/or the charging management module 340, and supplies power to the processor 310, the internal memory 321, the display screen 394, the camera 393, and the wireless communication module 360.
  • the power management module 341 can also be used to monitor battery capacity, battery cycle times, battery health status (leakage, impedance) and other parameters.
  • the power management module 341 may also be provided in the processor 310 .
  • the power management module 341 and the charging management module 340 may also be provided in the same device.
  • the wireless communication function of the mobile phone 300 can be realized by the antenna 1, the antenna 2, the mobile communication module 350, the wireless communication module 360, the modulation and demodulation processor, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in handset 300 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 350 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied on the mobile phone 300 .
  • the mobile communication module 350 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), and the like.
  • the mobile communication module 350 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.
  • the mobile communication module 350 can also amplify the signal modulated by the modulation and demodulation processor, and then convert it into electromagnetic waves for radiation through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 350 may be provided in the processor 310 .
  • at least part of the functional modules of the mobile communication module 350 may be provided in the same device as at least part of the modules of the processor 310 .
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low frequency baseband signal is processed by the baseband processor and passed to the application processor.
  • the application processor outputs sound signals through audio devices (not limited to the speaker 370A, the receiver 370B, etc.), or displays images or videos through the display screen 394 .
  • the modem processor may be a stand-alone device.
  • the modem processor may be independent of the processor 310, and may be provided in the same device as the mobile communication module 350 or other functional modules.
  • the wireless communication module 360 can provide applications on the mobile phone 300 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • WLAN wireless local area networks
  • BT wireless fidelity
  • GNSS global navigation satellite system
  • frequency modulation frequency modulation, FM
  • NFC near field communication technology
  • infrared technology infrared, IR
  • the wireless communication module 360 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 360 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 310.
  • the wireless communication module 360 can also receive the signal to be sent from the processor 310 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for
  • the antenna 1 of the mobile phone 300 is coupled with the mobile communication module 350, and the antenna 2 is coupled with the wireless communication module 360, so that the mobile phone 300 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the mobile phone 300 realizes the display function through the GPU, the display screen 394, and the application processor.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 394 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 310 may include one or more GPUs that execute program instructions to generate or alter display information.
  • Display screen 394 is used to display images, videos, and the like.
  • Display screen 394 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light).
  • LED diode AMOLED
  • flexible light-emitting diode flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on.
  • cell phone 300 may include 1 or N display screens 394, where N is a positive integer greater than 1.
  • the mobile phone 300 can realize the shooting function through the ISP, the camera 393, the video codec, the GPU, the display screen 394 and the application processor.
  • the ISP is used to process the data fed back by the camera 393 .
  • the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin tone.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be located in the camera 393 .
  • Camera 393 is used to capture still images or video.
  • the object is projected through the lens to generate an optical image onto the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the mobile phone 300 may include one or N cameras 393 , where N is a positive integer greater than one.
  • a digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the mobile phone 300 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, and the like.
  • Video codecs are used to compress or decompress digital video.
  • Cell phone 300 may support one or more video codecs.
  • the mobile phone 300 can play or record videos in various encoding formats, such as: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
  • MPEG moving picture experts group
  • MPEG2 moving picture experts group
  • MPEG3 MPEG4
  • MPEG4 moving picture experts group
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • Applications such as intelligent cognition of the mobile phone 300 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
  • the external memory interface 320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 300 .
  • the external memory card communicates with the processor 310 through the external memory interface 320 to realize the data storage function. For example to save files like music, video etc in external memory card.
  • Internal memory 321 may be used to store computer executable program code, which includes instructions.
  • the internal memory 321 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like.
  • the storage data area can store data (such as audio data, phone book, etc.) created during the use of the mobile phone 300 and the like.
  • the internal memory 321 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • the processor 310 executes various functional applications and data processing of the mobile phone 300 by executing the instructions stored in the internal memory 321 and/or the instructions stored in the memory provided in the processor.
  • the mobile phone 300 may implement audio functions through an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, an earphone interface 370D, and an application processor. Such as music playback, recording, etc.
  • the audio module 370 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 370 may also be used to encode and decode audio signals. In some embodiments, the audio module 370 may be provided in the processor 310 , or some functional modules of the audio module 370 may be provided in the processor 310 .
  • Speaker 370A also referred to as "horn" is used to convert audio electrical signals into sound signals.
  • the mobile phone 300 can listen to music through the speaker 370A, or listen to a hands-free call.
  • the receiver 370B also referred to as "earpiece" is used to convert audio electrical signals into sound signals.
  • the voice can be received by placing the receiver 370B close to the human ear.
  • the microphone 370C also called “microphone” or “microphone”, is used to convert sound signals into electrical signals.
  • the user can make a sound by approaching the microphone 370C through a human mouth, and input the sound signal into the microphone 370C.
  • the mobile phone 300 may be provided with at least one microphone 370C. In other embodiments, the mobile phone 300 may be provided with two microphones 370C, which can implement a noise reduction function in addition to collecting sound signals. In other embodiments, the mobile phone 300 may further be provided with three, four or more microphones 370C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.
  • the headphone jack 370D is used to connect wired headphones.
  • the earphone interface 370D may be a USB interface 330, or a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the pressure sensor 380A is used to sense pressure signals, and can convert the pressure signals into electrical signals.
  • the pressure sensor 380A may be provided on the display screen 394 .
  • the capacitive pressure sensor may be comprised of at least two parallel plates of conductive material. .
  • the gyroscope sensor 380B can be used to determine the motion attitude of the mobile phone 300 .
  • Air pressure sensor 380C is used to measure air pressure.
  • Magnetic sensor 380D includes a Hall sensor.
  • the acceleration sensor 380E can detect the magnitude of the acceleration of the mobile phone 300 in various directions (generally three axes).
  • Distance sensor 380F for measuring distance.
  • Proximity light sensor 380G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes.
  • the light emitting diodes may be infrared light emitting diodes.
  • the ambient light sensor 380L is used to sense ambient light brightness.
  • the fingerprint sensor 380H is used to collect fingerprints.
  • the temperature sensor 380J is used to detect the temperature.
  • Touch sensor 380K also called “touch device”.
  • the touch sensor 380K may be disposed on the display screen 394, and the touch sensor 380K and the display screen 394 form a touch screen, also called a "touch screen”.
  • the touch sensor 380K is used to detect a touch operation on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • Visual output related to touch operations may be provided through display screen 394 .
  • the touch sensor 380K may also be disposed on the surface of the mobile phone 300 , which is different from the location where the display screen 394 is located.
  • the bone conduction sensor 380M can acquire vibration signals.
  • the keys 390 include a power-on key, a volume key, and the like. Keys 390 may be mechanical keys. It can also be a touch key.
  • the cell phone 300 can receive key input and generate key signal input related to user settings and function control of the cell phone 300 .
  • Motor 391 can generate vibrating cues.
  • the motor 391 can be used for incoming call vibration alerts, and can also be used for touch vibration feedback.
  • the indicator 392 can be an indicator light, which can be used to indicate the charging status, the change of power, and can also be used to indicate messages, missed calls, notifications, and the like.
  • the SIM card interface 395 is used to connect a SIM card.
  • the SIM card can be contacted and separated from the mobile phone 300 by inserting into the SIM card interface 395 or pulling out from the SIM card interface 395 .
  • the mobile phone 300 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • the SIM card interface 395 can support Nano SIM card, Micro SIM card, SIM card and so on.
  • the mobile phone 300 interacts with the network through the SIM card to realize functions such as call and data communication.
  • the handset 300 employs an eSIM, ie an embedded SIM card.
  • the eSIM card can be embedded in the mobile phone 300 and cannot be separated from the mobile phone 300 .
  • the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device.
  • the electronic device may include more or less components than shown, or combine some components, or separate some components, or arrange different components.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • FIG. 4 is an exemplary flowchart of a process 400 of the method for adjusting the position of a speaker provided by the present application.
  • Process 400 may be performed jointly by the electronic device and the sound bar shown in FIG. 3 .
  • Process 400 is described as a series of steps or operations, and it should be understood that process 400 may be performed in various orders and/or concurrently, and is not limited to the order of execution shown in FIG. 4 .
  • Process 400 may include:
  • the electronic device sends a first play instruction to the sound bar.
  • the user may issue a dessert positioning instruction through an interactive interface provided by an application (application, APP) installed on the electronic device.
  • the electronic device starts to execute the steps of the method for adjusting the position of the sound box, and the first step is to send a first playback instruction to the sound bar.
  • the first play instruction is used to instruct the sound bar to rotate from the first position to the second position along the preset direction, and to play positional audio during the rotation.
  • the preset direction includes a horizontal clockwise direction or a horizontal counterclockwise direction.
  • rotating along the preset direction includes rotating at a constant speed along the preset direction.
  • the shape of the sound box includes a bar, a square, or a ring shape, and the present application does not specifically limit the shape of the sound box.
  • the following description takes a soundbar as an example. It should be understood that the method for adjusting the position of a sound box provided in the present application can also be applied to the position adjustment of a square sound box, a ring sound box and the like.
  • Positioning audio is full-band audio that meets the set conditions.
  • positioning audio can be full-band audio with a sound pressure level of not less than 65dB and a signal-to-noise ratio of not less than 20dB, including white noise, pink noise, or frequency sweep signals.
  • the loudness of the positional audio is stable during playback.
  • the position of the sound bar may be represented by the angle of the first included angle between the sound bar and the wall.
  • the angle of the first included angle is 0°; the sound bar starts to rotate counterclockwise from the angle 0°, and when it is turned to be perpendicular to the wall, the angle of the first included angle is 90°, and the rotation During the process, the angle of the first included angle changes from 0° to 90°; the sound bar starts to rotate clockwise from the angle 0°, and when it is turned to be perpendicular to the wall, the angle of the first included angle is -90°, and the rotation process
  • the angle of the first included angle varies from 0° to -90°. It can be seen that when the opening of the first included angle is to the left, the angle value of the first included angle is positive, and when the opening of the first included angle is to the right, the angle value of the first included angle is negative.
  • the position of the sound bar may also be represented by the angle of the second included angle between the vertical line of the center of the sound bar and the vertical line of the wall.
  • the sound bar When the sound bar is parallel to the wall, the vertical line of the center of the sound bar is parallel or coincident with the vertical line of the wall, and the angle of the second included angle is 0°; the sound bar starts to rotate counterclockwise from the angle 0°, When turning to be perpendicular to the wall, the vertical line of the center of the sound bar and the vertical line of the wall are perpendicular to each other, at this time the angle of the second included angle is 90°, and the angle of the second included angle changes from 0° during the rotation to 90°; the sound bar starts to rotate clockwise from the angle 0°, when turned to be perpendicular to the wall, the vertical line of the center of the sound bar and the vertical line of the wall are perpendicular to each other, at this time the angle of the second included angle is - 90°, the angle of the second included angle changes
  • the angle value of the second included angle is positive, and when the vertical line of the center of the sound bar is on the left side of the vertical line of the wall, the second angle is positive.
  • the angle value of the included angle is negative.
  • both the first position and the second position can be represented by the angle value of the first included angle or the second included angle, and the sound bar rotates at a constant speed from the first position to the second position, which can be described as the sound bar from the first position.
  • the first angle and the second angle are respectively two angle values of the first included angle, or the first angle and the second angle are respectively two angle values of the second included angle.
  • the initial position of the center of the sound bar and the user's position may be obtained, and the sound bar may be calculated according to the initial position and the user's position.
  • the fine-tuning angle is obtained, and then the first position and the second position are obtained according to the theoretical sweet-spot position and the fine-tuning angle.
  • the line connecting the user's position and the center of the sound bar is perpendicular to the sound bar's external surface, and the external surface faces the user.
  • the external surface of the sound bar refers to the surface on which the external speaker of the sound bar is located.
  • the speaker is placed on one side of the speaker, so the surface of the speaker at this time refers to that side.
  • the first position is the position where the sound bar is rotated by the fine-tuning angle from the theoretical sweet spot position to the preset direction
  • the second position is the position where the sound bar is rotated by the fine-tuning angle from the theoretical sweet spot position to the opposite direction of the preset direction.
  • the present application can provide an interactive interface (such as a room configuration interface, please refer to the description of FIG. 11 below) provided by the APP, and the user inputs a first virtual position on the interface, and the first virtual position is used to simulate that the center of the sound bar is in the room
  • the initial position of the center of the sound bar can be calculated based on the first virtual position, and the initial position can be expressed in the form of coordinates.
  • the user can also input a second virtual position on the above-mentioned interactive interface, the second virtual position is used to simulate the user's position in the room, and the user's position can be calculated based on the second virtual position.
  • the form of coordinates is provided by the APP, and the user inputs a first virtual position on the interface, and the first virtual position is used to simulate that the center of the sound bar is in the room
  • the initial position of the center of the sound bar can be calculated based on the first virtual position, and the initial position can be expressed in the form of coordinates.
  • the user can also input
  • the theoretical sweet spot position of the sound bar can be obtained according to formulas (1) to (3):
  • d represents the straight-line distance between the user's location and the center of the sound bar
  • (x c , y c ) represents the user's location
  • (x s0 , y s0 ) represents the initial location of the center of the sound bar.
  • h represents the vertical distance between the user's location and the center of the soundbar.
  • A represents the angle value corresponding to the theoretical sweet spot position of the sound bar.
  • A the angle corresponding to the above-mentioned second angle.
  • the purpose of dessert positioning is to make the connection between the center of the sound bar and the user's position perpendicular to the external surface of the sound bar, so the sound bar needs to be rotated clockwise by angle A to achieve this purpose.
  • one side of the included angle corresponding to the fine-tuning angle ⁇ is the line connecting the user's position and the center of the sound bar.
  • the fine-tuning angle ⁇ is calculated by formula (4):
  • w represents twice the binaural distance, and w may adopt a preset fixed value, or may be preset by the user.
  • the fine-tuning angle ⁇ can also be directly input by the user on an interactive interface (eg, a precise dessert positioning interface, see FIG. 12k below).
  • an interactive interface eg, a precise dessert positioning interface, see FIG. 12k below.
  • the first angle corresponding to the first position may be A- ⁇ , and the second angle corresponding to the second position may be A+ ⁇ ; or, the first angle corresponding to the first position may be A+ ⁇ , the second angle corresponding to the second position may be A- ⁇ .
  • the sound bar is rotated from the first position to the second position along the preset direction according to the first playback instruction, and plays positional audio during the rotation.
  • the sound bar After the sound bar receives the first play instruction, it obtains the first position and the second position from the first play instruction, according to the preset rotation direction, such as from A- ⁇ to A+ ⁇ , or from A+ ⁇ to A- ⁇ , which plays positional audio, such as pre-recorded rain sounds, while turning.
  • the preset rotation direction such as from A- ⁇ to A+ ⁇ , or from A+ ⁇ to A- ⁇ , which plays positional audio, such as pre-recorded rain sounds, while turning.
  • the electronic device receives positioning audio.
  • Microphones on electronic devices receive positional audio.
  • the electronic device determines the indication information according to the positioning audio.
  • the sound bar plays positional audio while rotating, so the positional audio received by the microphone of the electronic device may vary in loudness. That is, when the sound bar is rotated away from the electronic device, the loudness of the positional audio received by the electronic device becomes smaller, while the loudness of the positioning audio received by the electronic device becomes smaller. As the soundbar is rotated closer to the electronic device, the positional audio received by the electronic device becomes louder.
  • the purpose of fine-tuning is to find the position of the soundbar when the loudness of the positional audio being received by the electronics is at its maximum. Since the loudness is detected by the user's electronic device, when the sound bar is in this position, it can be considered that the sweet spot of the sound bar is exactly where the user is.
  • the electronic device may detect the positioning audio received within the set time at intervals of a set period from the moment when the positioning audio is initially received to obtain a loudness.
  • the electronic device determines the difference between the end time of the set time corresponding to the maximum of the obtained multiple loudnesses and the start time of reception as the target time.
  • the electronic device can synchronize the reception of positional audio and the detection of loudness.
  • the electronic device may detect the positioning audio to obtain the maximum loudness, and then determine the difference between the time corresponding to the maximum loudness and the initial receiving time of the positioning audio as the target time.
  • the electronic device may also detect the entire segment of the location audio after receiving all the location audio.
  • the angle value corresponding to the target position of the sound bar can be calculated:
  • the angle value B corresponding to the target position is calculated according to formula (5):
  • the sound bar Since the sound bar is rotated to the second position (the corresponding second angle is A+ ⁇ ) when the positioning audio is played, the sound bar needs to be rotated to the target position (the corresponding angle is B), which is reversed from the second position.
  • the angle value B corresponding to the target position is calculated according to formula (6):
  • v represents the rotation speed of the sound bar, which can be preset
  • t represents the target time
  • the sound bar Since the sound bar is rotated to the second position (the corresponding second angle is A- ⁇ ) when the positioning audio is played, the sound bar needs to be rotated to the target position (the corresponding angle is B), which is reversed from the second position.
  • the electronic device determines the target time as the indication information.
  • the fine-tuning angle ⁇ in the above formula can be obtained from the previous interaction information with the electronic device, which will not be repeated here; the rotation speed can be preset.
  • the target time can be obtained from the indication information.
  • the direction of rotation can also be preset. Therefore, the sound bar can calculate the angle ⁇ that needs to be rotated based on this information.
  • the electronic device determines the target time and the opposite direction of the preset direction as the indication information.
  • the fine-tuning angle ⁇ in the above formula can be obtained from the previous interaction information with the electronic device, which will not be repeated here; the rotation speed can be preset.
  • the target time and turning direction (the opposite of the preset direction) can be obtained from the indication information. Therefore, the sound bar can calculate the angle ⁇ that needs to be rotated based on this information.
  • the electronic device determines the target time, the opposite direction of the preset direction, and the fine-tuning angle as the indication information.
  • the fine-tuning angle ⁇ and target time in the above formula, as well as the rotation direction (the opposite direction of the preset direction) can be obtained from the indication information.
  • the rotation speed can be preset. Therefore, the sound bar can calculate the angle ⁇ that needs to be rotated based on this information.
  • the electronic device determines the reverse direction of the preset direction and the target rotation angle as the indication information.
  • the direction of rotation (the opposite of the preset direction) can be obtained from the indication information.
  • the sound bar does not need to calculate the angle ⁇ to be rotated through the above formula, and the angle can also be obtained from the indication information.
  • the duration T of the positioning audio, the target time t, the fine-tuning angle ⁇ and the rotation speed v are mutually constrained, that is, the result of the fine-tuning obtains the angle value B corresponding to the target position, and the angle value B corresponding to the target position falls within the Within the angular range [A- ⁇ , A+ ⁇ ], therefore, - ⁇ vt ⁇ , t ⁇ T.
  • the indication information determined by the electronic device may include the angle value B corresponding to the target position, or may include the target time t, both of which may enable the sound bar to determine its target position.
  • the electronic device sends the instruction information to the sound bar.
  • the sound bar is rotated to the target position according to the instruction information.
  • the instruction information also has the function of instructing the sound bar to go from the second position to the target position, so after the sound bar receives the instruction information, it first determines the target position, and then turns from the current position to the target position.
  • the sound bar is turned from the position corresponding to A- ⁇ to the position corresponding to A+ ⁇ , then after receiving the instruction information, the sound bar starts to reversely rotate the angle (2 ⁇ ) from the position corresponding to A+ ⁇ -vt) to reach the position corresponding to B.
  • the sound bar is turned from the position corresponding to A+ ⁇ to the position corresponding to A- ⁇ , then after receiving the instruction information, the sound bar starts to reverse the rotation angle from the position corresponding to A- ⁇ ( 2 ⁇ -vt) to the position corresponding to B.
  • the sound bar and the electronic device cooperate with each other.
  • the sound bar rotates from the first position to the second position at a constant speed while playing the positioning audio. , and control the sound bar to go to this position, which can achieve more accurate crosstalk cancellation according to the user's position, eliminate the influence of different rooms, enhance the sound and image effect, and truly restore the original sound effect.
  • FIG. 5 is an exemplary flowchart of a process 500 of the method for adjusting the position of a speaker provided by the present application.
  • Process 500 may be performed jointly by the electronic device and the sound bar shown in FIG. 3 .
  • Process 500 is described as a series of steps or operations, and it should be understood that process 500 may be performed in various orders and/or concurrently, and is not limited to the order of execution shown in FIG. 5 .
  • Process 500 may include:
  • the electronic device sends a first play instruction to the sound bar.
  • S501 reference may be made to S401 in the embodiment shown in FIG. 4, and details are not repeated here.
  • the sound bar is rotated from the first position to the second position along the preset direction according to the first playback instruction, and the positioning audio is played during the rotation.
  • S501 to S502 reference may be made to S401 to S401 of the embodiment shown in FIG. 4 , and details are not described herein again. The difference is that in the calculation involving the user's location, the user's location is changed to the central location of multiple users.
  • the user terminal receives the positioning audio.
  • the difference between this embodiment and the embodiment shown in FIG. 4 is that the number of users in the room changes from one to multiple.
  • the microphones of multiple user terminals in the room receive positioning audio respectively, and each user terminal is located at different locations. , so the position of the corresponding sound bar when the loudness of the positional audio received is also different.
  • the reference for finding the target position of the sound bar is the sum of the loudness of the sound bar received by each user terminal at each sampling time.
  • the electronic device receives a plurality of collected audio data.
  • the user terminal stores the received positioning audio, and after receiving it, sends it to the electronic device in the form of audio data, and the electronic device performs the calculation.
  • the electronic device determines the indication information according to the plurality of collected audios.
  • S505 may refer to S404 in the embodiment shown in FIG. 4 , the difference is that when determining the target time, the time based on the maximum loudness is changed to the time based on the sum of the maximum loudness.
  • the electronic device sends the instruction information to the sound bar.
  • the sound bar rotates to the target position according to the instruction information.
  • S506-S507 reference may be made to S405-S406 in the embodiment shown in FIG. 4, and details are not described herein again.
  • the sound bar and the electronic device cooperate with each other.
  • the sound bar rotates from the first position to the second position at a constant speed while playing the positioning audio.
  • the position of the sound bar and control the sound bar to go to this position which can achieve more accurate crosstalk cancellation for the positions of multiple users, eliminate the influence of different rooms, enhance the sound and image effect, and truly restore the original sound effect.
  • FIG. 6 is an exemplary flowchart of a process 600 of the method for adjusting the speaker position provided by the present application.
  • Process 600 may be performed jointly by the electronic device and the sound bar shown in FIG. 3 .
  • Process 600 is described as a series of steps or operations, and it should be understood that process 600 may be performed in various orders and/or concurrently, and is not limited to the order of execution shown in FIG. 6 .
  • Process 600 may include:
  • the electronic device divides the space into multiple subspaces according to the number of the multiple sound bars.
  • the electronic equipment first divides the space in the room according to the number of sound bars, and each sound bar corresponds to a subspace.
  • each sound bar corresponds to a subspace.
  • the center of the sound bar is the vertex, and the horizontal space in front of the sound bar can be divided into 3 subspaces according to the method of dividing the 180° angle in the horizontal direction.
  • the left subspace corresponds to sound bar 1, in which there is 1 user
  • the middle subspace corresponds to Soundbar 2, which has 2 users
  • the right subspace corresponds to Soundbar 3, which has no users. That is, in the scenario shown in Figure 15, three sound bars correspond to three subspaces, respectively.
  • the relationship between the three sound bars and the number of users is one-to-one, one-to-many, and one-to-one. to empty.
  • the electronic device sends a first play instruction to the plurality of sound bars respectively.
  • the electronic device determines multiple pieces of indication information, where the multiple pieces of indication information correspond to multiple sound bars.
  • the electronic device determines its target position for each sound bar according to the result of the division of the space and the number of users in the subspace.
  • the difference is: multiple users are limited to 2 users in the middle subspace; the right subspace in FIG.
  • the target position of the sound bar 2 can be determined with reference to A502 to S505 of the embodiment shown in FIG. 5 , and then its indication information can be determined, the difference is that the multiple users include all users in the three subspaces of left, middle and right.
  • the electronic device sends a plurality of indication information to the corresponding sound bar respectively.
  • a plurality of sound bars and electronic devices cooperate with each other, and the plurality of sound bars rotate from the first position to the second position at a constant speed while playing the positioning audio, and the electronic device for each sound bar, according to its corresponding Find the position of the sound bar when the loudness or the sum of the loudness is the largest in the sampled audio received by the user's terminal in the subspace of the subspace, and control the sound bar to go to this position, so that it can be more accurate for the positions of multiple users.
  • Crosstalk cancellation eliminate the influence of different rooms, enhance the sound and image effect, and restore the original sound effect.
  • FIG. 7 is an exemplary flowchart of a process 700 of the method for adjusting the speaker position provided by the present application.
  • Process 700 may be performed jointly by the electronic device and sound bar shown in FIG. 3 .
  • Process 700 is described as a series of steps or operations, and it should be understood that process 700 may be performed in various orders and/or concurrently, and is not limited to the order of execution shown in FIG. 7 .
  • Process 700 may include:
  • the electronic device sends a first play instruction to a plurality of sound bars respectively.
  • the plurality of sound bars are arranged in a row, and the external surfaces of the plurality of sound bars face the user.
  • the electronic device receives the mixed signal.
  • the electronic device since there are multiple sound bars and only one user, the electronic device receives a mixed sound signal formed by mixing the positioning audio played by the multiple sound bars.
  • the electronic device determines a plurality of indication information according to the mixed sound signal.
  • S703 may refer to S404 in the embodiment shown in FIG. 4 , the difference is that: the electronic device determines its indication information for each sound bar in the plurality of sound bars respectively, and the position involved in each calculation includes the position of a single sound bar. The initial location of the center and the location of the user.
  • the electronic device sends a plurality of indication information to the corresponding sound bar respectively.
  • a plurality of sound bars and electronic devices cooperate with each other, and the plurality of sound bars rotate from the first position to the second position at a constant speed while playing the positional audio, and the electronic device finds the loudness according to the received mixed signal of the positional audio
  • the position of each sound bar is controlled, and each sound bar is controlled to move to its corresponding position, which can achieve more accurate crosstalk cancellation according to the user's location, eliminate the influence of different rooms, enhance the sound and image effect, and restore the true Original sound.
  • FIG. 8 is an exemplary flowchart of a process 800 of the rendering method provided by the present application.
  • Process 800 may be performed jointly by the electronic device and sound bar shown in FIG. 3 .
  • Process 800 is described as a series of steps or operations, and it should be understood that process 800 may be performed in various orders and/or concurrently, and is not limited to the order of execution shown in FIG. 8 .
  • Process 800 may include:
  • the electronic device sends a second play instruction to the sound bar.
  • the test audio is a full-band audio that meets the set conditions.
  • the test audio can be a full-band audio with a sound pressure level of not less than 65dB and a signal-to-noise ratio of not less than 20dB, including white noise, pink noise or frequency sweep signals.
  • the sound bar plays the test audio according to the second play instruction.
  • the microphone of the earphone worn by the user receives the test audio.
  • the test audio played by the sound bar in this embodiment is received by the microphone of the earphone worn by the user. After the earphone receives the test audio, it stores it and sends it to the electronic device in the form of audio data.
  • the electronic device receives and collects audio data.
  • the electronic device calculates the BRIR according to the collected audio and the test audio.
  • the electronic device can calculate the BRIR by formula (7):
  • 0 ⁇ p ⁇ P P represents the number of users; 0 ⁇ k ⁇ K, K represents the number of speaker units; i is 0 for the left ear, i is 1 for the right ear; f is the frequency; H 2p+i ,k (f) represents the BRIR of the p-th user corresponding to the k-th speaker unit; Y i,p,k (f) represents the echoed audio of the p-th user’s earphone corresponding to the k-th speaker unit; T(f ) indicates test audio.
  • the electronic device obtains the filter coefficient of the sound bar according to the BRIR.
  • the electronic device calculates the filter coefficients by formula (8):
  • H(f) ⁇ C K ⁇ K represents a matrix composed of the BRIR calculated by formula (7) as an element, and the matrix covers the room transfer functions of all users corresponding to all speaker units respectively;
  • * H represents the conjugate Matrix;
  • I k (f) ⁇ C K ⁇ K represents the identity matrix;
  • D(f) ⁇ R 2P ⁇ R represents the ideal transfer function,
  • the electronic device sends filter coefficients to the sound bar.
  • the sound bar processes the audio according to the filter coefficient.
  • the sound bar processes the audio played by the sound bar by formula (9) according to the updated filter coefficients:
  • X(f) represents the processed audio
  • S(f) represents the audio played by the soundbar
  • C(f) represents the filter coefficients
  • the above filter coefficients are obtained after accurate sweet spot positioning, so it can achieve more accurate crosstalk cancellation according to the location of the user, eliminate the influence of different rooms, enhance the sound and image effect, and truly restore the original sound effect.
  • the electronic device may receive a virtual space instruction, where the virtual space instruction includes the listening space selected by the user on the void mode interface, obtain the transfer function of the listening space, and then obtain the sound bar's value according to the BRIR. filter coefficients.
  • the listening space is the "Golden Hall”.
  • the electronic device calculates the filter coefficient by formula (10):
  • H(f) ⁇ C K ⁇ K represents the matrix composed of the BRIR calculated by formula (7) as the element, and the matrix covers the room transfer functions of all users corresponding to all sound bars respectively;
  • * H represents the total Yoke matrix;
  • I k (f) ⁇ C K ⁇ K representing the identity matrix;
  • the sound bar processes the audio played by the sound bar by formula (11) according to the updated filter coefficients:
  • S(f) represents the audio played by the soundbar
  • filter coefficients represents the filter coefficients
  • the above filter coefficients are obtained after exclusive customization, so it can not only achieve more accurate crosstalk cancellation according to the location of the user, eliminate the influence of different rooms, enhance the sound and image effect, and truly restore the original sound effect, but also can be used in the user.
  • the location renders the sound field, giving the user an immersive experience.
  • Each user holds an electronic device, which may be, for example, a mobile phone, a tablet computer, or the like. If there is another administrator, the administrator can be one of multiple users, and the administrator also holds the aforementioned electronic equipment; the administrator can also be other people, then the administrator holds a control device, and the control device can It is the aforementioned electronic device, it can also be a computer, and it can also be a video playback device, and the video playback device includes a sound bar.
  • an electronic device which may be, for example, a mobile phone, a tablet computer, or the like.
  • the administrator can be one of multiple users, and the administrator also holds the aforementioned electronic equipment; the administrator can also be other people, then the administrator holds a control device, and the control device can It is the aforementioned electronic device, it can also be a computer, and it can also be a video playback device, and the video playback device includes a sound bar.
  • FIG. 9 is an exemplary schematic diagram of the login interface in this application. As shown in FIG. 9 , in addition to the user name and password input areas, the login interface also includes a “common user” control and an “administrator” control.
  • the user is the administrator, click the "Administrator” control; if there are multiple users in the real room, one of the multiple users is the administrator, click the "Administrator” control, Other users click the "common user” control; or, if the multiple users are all common users, click the "common user” control, and another administrator (the administrator may not be in the same room), click the "administrator” control.
  • FIG. 10 is an exemplary schematic diagram of the function selection interface in the application. As shown in FIG. 10 , on the function selection interface, “Room Configuration”, “Precise Dessert Positioning”, “Exclusive Private Order” and “Void” are displayed. Mode” four controls.
  • FIG. 11 is an exemplary schematic diagram of the room configuration interface in the application. As shown in FIG. 11 , the room configuration interface includes a simulated room area and an input area.
  • the room configuration interface shown in FIG. 11 may only be displayed in the APP in the "administrator” mode. Only the app in “Administrator” mode allows the administrator to lay out the simulated room area and enter the length and width of the room. At this time, after the administrator completes the settings, the APP in the "administrator” mode can send the input information obtained through the room configuration interface to the APP in the "common user” mode, so that the APP in the "common user” mode can also display the simulated room. Areas and their arrangement.
  • the APP in "Administrator” mode and the APP in "Common User” mode are in the same local area network.
  • the room configuration interface shown in Figure 11 can be displayed in both the "Administrator” mode APP and the "Normal User” mode APP, so that anyone using the APP can arrange the simulated room area , enter the length and width of the room.
  • the APP can send the input information obtained through the room configuration interface to the APP in the "administrator” mode, so that the APP in the "administrator” mode can integrate the input information and identify the same appliance (for example, the sound box) to eliminate input errors from different people.
  • the input area in the room configuration interface is used to input the length (for example, 6m) and width (for example, 4m) of the real room, and the simulated room area is used for the administrator or user to simulate the layout of the real room in this area.
  • a TV with a soundbar is placed next to the TV wall, and the sofa is placed directly opposite the TV.
  • the administrator or user can identify the TV (and sound bar) with an icon near the upper side of the simulated room area, which can be a 2D or 3D model of the TV, a schematic diagram, or a is a point (corresponding to the center of the soundbar);
  • the sofa is identified by an icon near the lower side of the simulated room area, facing the TV, which can also be a 2D or 3D model of the sofa, or a bar It can also be a point (the point corresponds to the center of the sofa).
  • the APP displays a schematic diagram of the TV in the simulated room area, and the user drags the schematic diagram of the TV to the position corresponding to the actual position of the TV in the simulated room area; the user clicks on the sofa, and the APP displays in the simulated room area
  • a schematic diagram of a sofa the user drags the schematic diagram of the sofa to a position corresponding to the actual position of the sofa in the simulated room area.
  • the present application does not specifically limit the way of identifying real furniture in the simulated room area. And in the simulated room area, except that the number and position of the icons of the sound bar must be consistent with the number and position of the sound bar in the real room, whether the icons of other furniture are displayed in the simulated room area depends on the user's operation. For example, a user may place an icon identifying a sofa in the simulated room area, or may not place an icon identifying a sofa.
  • the precise dessert positioning interface includes a simulated room area, and the icons displayed in this area are set by the user in the room configuration interface.
  • Scenario 1 There is a soundbar and a user in the room
  • the above-mentioned user is the administrator, and the administrator holds a control device, such as a mobile phone, and the APP installed on the mobile phone enters the "administrator" mode.
  • the user clicks the corresponding position on the simulated room area according to his position in the room, and the APP displays a logo (such as a smiling face) at the corresponding position, indicating that the user is here.
  • a logo such as a smiling face
  • the coordinate system of the real room is the first coordinate system
  • the coordinate system of the simulated room is the second coordinate system
  • the ratio of the two coordinate systems is 100:1
  • the origin (0,0) is the wall near the sound bar (TV wall).
  • the left endpoint, from the origin to the right is the positive x-axis, from the origin down to the positive y-axis.
  • the actual room is 6 meters long and 4 meters wide, and the simulated room area is 0.06 meters long and 0.04 meters wide.
  • the coordinates of the center of the sound bar are (0.03, 0), and it can be calculated that under the first coordinate system, the The coordinates of the center are (3,0);
  • the center of the sofa is in the middle of the lower side, that is, in the second coordinate system, the coordinates of the center of the sofa are (0.03, 0.04), which can be calculated in the first coordinate system.
  • the coordinates of the center of the sofa are (3,4).
  • the APP can obtain the location of the user in the first coordinate system.
  • the APP calculates the initial horizontal angle A according to the coordinates of the user's position (x c , y c ) and the coordinates of the center of the sound bar (x s0 , y s0 ), and the vertex of the angle corresponding to the initial horizontal angle A is a bar
  • the center of the speaker, one side of the angle is perpendicular to the sound bar, and the other side of the angle is the line between the user's location and the center of the sound bar.
  • the value of the initial horizontal angle A is positive;
  • the initial horizontal angle A has a negative value when the line between the centers of the sound bar is on the left side perpendicular to the side of the sound bar.
  • the initial horizontal angle A can be calculated according to the following method:
  • the fine-tuning angle ⁇ can be calculated by formula (4) according to the above-mentioned linear distance d and vertical distance h:
  • w represents twice the binaural distance, and w may adopt a preset fixed value, or may be preset by the user.
  • the sound bar After receiving this command, the sound bar can be rotated to the angle A- ⁇ or A+ ⁇ .
  • the user holds the mobile phone at the above-mentioned position in the room (the position corresponding to the smiling face in Figure 12a) and stands still, clicks the "fine adjustment" control on the precise dessert positioning interface, and the APP sends an instruction to the sound bar Fine-tune the start of the playback command.
  • the APP can display the sound bar rotated by A- ⁇ or A+ ⁇ in the simulated room area.
  • the sound bar After receiving the playback instruction, the sound bar starts to play the pre-acquired and stored local positional audio (such as the sound of rain), and during the process of playing the positional audio, it rotates at a constant speed from the first angle to the second angle at the speed v.
  • the first angle and the second angle are one of A- ⁇ and A+ ⁇ respectively, that is, the first angle is A- ⁇ , the second angle is A+ ⁇ , or the first angle is A+ ⁇ , the first angle is A- ⁇ , the second angle is A+ ⁇ , and the first angle is A+ ⁇ .
  • the second angle is A- ⁇ .
  • the captured audio is received by the microphone of the user's phone.
  • the APP may start from the start time of the audio recapture, and obtain a loudness by detecting the audio recapitulation received within the set time at intervals of a set period of time.
  • the APP determines the difference between the end time of the set time corresponding to the maximum of the obtained multiple loudnesses and the start reception time as the target time. For example, the APP records the start time of the recovered audio as 0ms, and the initial maximum loudness is recorded as 0; the time after a set period of time (for example, 1ms) is recorded as 1ms.
  • a loudness at a time of 1ms (for example, by detecting the replayed audio samples received within 1ms, obtaining multiple loudness values, and then averaging the multiple loudness values), record the maximum loudness as the loudness at time 1ms;
  • the time is recorded as 2ms, and a loudness corresponding to the time 2ms is obtained by detecting the recapitulated audio received within 1ms, and the loudness at the time 2ms is compared with the current maximum loudness, and the maximum loudness is the larger one.
  • the APP obtains the time corresponding to the maximum loudness (for example, time 3ms), and calculates the difference between the time 3ms and the start receiving time 0ms as the target time.
  • the APP detects the captured audio to obtain the maximum loudness, and determines the difference between the time corresponding to the maximum loudness and the start time of the captured audio as the target time. For example, the APP receives a total of 10ms of echoed audio, samples and detects the echoed audio, and obtains the loudness at multiple times, such as 1ms loudness, 2ms loudness, ... Then, the difference between the time corresponding to the largest one (eg, 3 ms) and the initial receiving time 0 ms is determined as the target time.
  • the APP can calculate the target horizontal angle B according to the above target time, the initial horizontal angle A and the fine-tuning angle ⁇ .
  • the formula used for this calculation is related to the direction of rotation of the sound bar:
  • the target horizontal angle B is calculated according to formula (5):
  • the target horizontal angle B is calculated according to formula (6):
  • v represents the rotational speed
  • t represents the target time
  • the duration T, the target time t, the fine-tuning angle ⁇ and the rotation speed v of the recovered audio are mutually constrained, that is, the purpose of fine-tuning is to obtain the target horizontal angle B, and the target horizontal angle B should fall within the angle range [A- ⁇ , A+ ⁇ ], therefore, - ⁇ vt ⁇ , t ⁇ T.
  • the APP After the APP obtains the target horizontal angle B, it sends the target horizontal angle B to the sound bar.
  • the APP can display the sound bar rotated by the target horizontal angle B in the simulated room area, and display a pop-up window on the precise dessert positioning interface, which displays the text "fine adjustment completed".
  • the sound bar After the sound bar receives the target horizontal angle B, it rotates to reach the target horizontal angle B. At this time, the sweet spot of the sound bar is exactly where the user is.
  • the precise dessert positioning function is completed. Thereafter, as long as the user does not move, the sound bar plays in stereo, such as the sound of a TV or movie, for optimal listening at the user's location.
  • One of the above-mentioned multiple users is an administrator, and the administrator holds a control device, such as a mobile phone.
  • the APP installed on the administrator's mobile phone enters the "administrator" mode, and other users except the administrator hold electronic devices.
  • the electronic device is also a mobile phone, and the APPs installed on the mobile phones of other users enter the "normal user" mode.
  • a certain user clicks the corresponding position on the simulated room area according to his position in the room, and the user's APP displays a logo (such as a smiley face), indicating that the user is here.
  • the above-mentioned multiple users can perform the above operations, so the APPs of the multiple users will display a logo (such as a smiley face) in the simulated room area, indicating the location of the corresponding user, and the APPs of all users except the administrator will be displayed. Send the coordinates of the respective identified locations in the second coordinate system to the administrator's APP.
  • a logo such as a smiley face
  • the administrator's APP not only displays the administrator's logo, but also displays the logos of all other users (such as user 1 to user 3), that is, after the administrator's APP receives the coordinates sent by the APPs of all other users , in the simulated room area, a logo (such as a smiling face) is displayed at the positions corresponding to the aforementioned coordinates.
  • the administrator's APP can use formulas (1) to (4) in scenario 1 to obtain the initial horizontal angle A and the fine-tuning angle ⁇ .
  • the difference is that the coordinates (x c , y c ) in formulas (1) and (2) represent Central location for multiple users. at this time P represents the number of multiple users, ( xi , y i ) is the coordinates of the location of the ith user among the multiple users, 1 ⁇ i ⁇ P.
  • the vertex of the angle corresponding to the initial horizontal angle A is the center of the sound bar, one side of the angle is perpendicular to the sound bar, and the other side of the angle is the center position and the Connect the wires between the center of the soundbar as shown in Figure 14.
  • the sound bar After receiving this command, the sound bar can be rotated to the angle A- ⁇ or A+ ⁇ .
  • the administrator clicks the "fine-tuning" control on the precise dessert positioning interface, and the administrator's APP sends a playback instruction indicating the start of fine-tuning to the sound bar.
  • the APPs of multiple users can display the sound bar rotated by A- ⁇ or A+ ⁇ in the simulated room area.
  • the sound bar After receiving the playback instruction, the sound bar starts to play the pre-acquired and stored local positional audio (such as the sound of rain), and during the process of playing the positional audio, it rotates at a constant speed from the first angle to the second angle at the speed v.
  • the first angle and the second angle are one of A- ⁇ and A+ ⁇ respectively, that is, the first angle is A- ⁇ , the second angle is A+ ⁇ , or the first angle is A+ ⁇ , the first angle is A- ⁇ , the second angle is A+ ⁇ , and the first angle is A+ ⁇ .
  • the second angle is A- ⁇ .
  • the microphones of the mobile phones of multiple users all receive the recaptured audio.
  • the APPs of all users except the administrator send the acquired audio to the APP of the administrator, and the APP of the administrator receives the audio from the APP of all other users and the microphone of the administrator's mobile phone.
  • the recaptured audio is detected, the loudness of each recaptured audio at each sampling time is obtained, the sum of the loudness of each sampling time is calculated, and then the sampling time corresponding to the sum of the maximum loudness is determined, and then the target time is obtained.
  • the administrator's APP can detect and obtain the loudness of the captured audio by referring to the description of scene 1.
  • the APPs of multiple users respectively detect the received recapitulated audio to obtain the loudness of each sampling time, and then the APPs of all users except the administrator send the obtained loudness of each sampling time to the APP of the administrator.
  • the administrator's APP calculates the sum of the loudness at each sampling moment, and then determines the sampling moment corresponding to the sum of the maximum loudness, and then obtains the target time.
  • APPs of multiple users can also detect and obtain the loudness of the captured audio by referring to the description of scene 1.
  • the administrator's APP can use formulas (5) to (6) in scenario 1 to calculate the target horizontal angle B.
  • the administrator's APP sends the target horizontal angle B to the sound bar.
  • the administrator's APP can display the sound bar after turning the target horizontal angle B in the simulated room area, and display a pop-up window on the precise dessert positioning interface, which displays the text "fine adjustment completed”. .
  • the administrator's APP can also send the target horizontal angle B to the APPs of all other users, so that the APPs of multiple users can display the sound bar after turning the target horizontal angle B in the simulated room area, and A pop-up window is displayed on the precise dessert positioning interface, and the text "fine-tuning completed" is displayed in the pop-up window.
  • the sound bar After the sound bar receives the target horizontal angle B, it rotates to reach the target horizontal angle B. At this time, the sweet spot of the sound bar is the center position of multiple users.
  • the sound bar plays a stereo sound (such as the sound of a TV or movie) for optimal listening at the center of the multiple users.
  • the above-mentioned multiple users hold electronic equipment, such as mobile phones, the APP installed on the mobile phones of the multiple users enters the "normal user" mode, and there is another administrator, the administrator holds a control device, for example, the control device is Tablet PC, the APP installed on the administrator's tablet PC enters the "Administrator" mode.
  • the control device is Tablet PC
  • the APP installed on the administrator's tablet PC enters the "Administrator" mode.
  • a certain user clicks the corresponding position on the simulated room area according to his position in the room, and the user's APP displays a logo (such as a smiley face), indicating that the user is here.
  • the above-mentioned multiple users can perform the above operations, so the APPs of the multiple users all display a logo (such as a smiling face) in the simulated room area, indicating the location of the corresponding user, and the APPs of the multiple users will display the respective logos.
  • the coordinates of the position in the second coordinate system are sent to the administrator's APP.
  • the administrator's APP displays the identifiers of multiple users (such as user 1 to user 3) in the simulated room area, that is, after the administrator's APP receives the coordinates sent by the APPs of multiple users, In the area, a logo (for example, a smiling face) is displayed at the position corresponding to each of the aforementioned coordinates.
  • a logo for example, a smiling face
  • the administrator's APP first divides the space in the room according to the number of sound bars.
  • Each sound bar corresponds to a subspace.
  • the center of the sound bar is the vertex, and the horizontal space in front of the sound bar can be divided into 3 subspaces by dividing the 180° angle in the horizontal direction.
  • the left subspace corresponds to sound bar 1, of which there is 1 Users
  • the middle subspace corresponds to Sound Bar 2, which has 2 users
  • the right subspace corresponds to Sound Bar 3, which has no users. That is, in the scenario shown in Figure 15, three sound bars correspond to three subspaces, respectively.
  • the relationship between the three sound bars and the number of users is one-to-one, one-to-many, and one-to-one. to empty.
  • the administrator's APP sequentially determines the sweet spot for the three soundbars.
  • the administrator's APP can use formulas (1) to (4) in scenario 1 to obtain the initial horizontal angle A1 and the fine-tuning angle ⁇ 1 of the sound bar 1.
  • the difference is: the coordinates (x s0 ) in formulas (1) and (2) ,y s0 ) represents the center of the sound bar 1; the administrator's APP can obtain the initial horizontal angle A2 and the fine-tuning angle ⁇ 2 of the sound bar 2 using the method described in scenario 2, the difference is: formulas (1) and (2)
  • the coordinates in (x s0 , y s0 ) represent the center of the sound bar 2
  • the coordinates (x c , y c ) represent the center positions of 2 users in the middle subspace corresponding to the sound bar 2 .
  • the initial horizontal angle A2 and the fine-tuning angle ⁇ 2 of the sound bar 2 are sent to the sound bar 2 in the form of instructions, and the calculated initial horizontal angle A3 and the fine-tuning angle ⁇ 3 of the sound bar 3 are sent to the sound bar 3 in the form of commands.
  • the sound bar 1 After receiving the instruction, the sound bar 1 can rotate to the angle A1- ⁇ 1 or A1+ ⁇ 1.
  • the sound bar 2 After receiving this command, the sound bar 2 can rotate to the angle A2- ⁇ 2 or A2+ ⁇ 2.
  • the sound bar 3 After receiving this command, the sound bar 3 can be rotated to the angle A3- ⁇ 3 or A3+ ⁇ 3.
  • the administrator clicks the "fine-tuning" control on the precise dessert positioning interface, and the administrator's APP sends a playback instruction indicating the start of fine-tuning to sound bars 1 to 3.
  • the APPs of multiple users can display the sound bar 1 after rotating A1- ⁇ 1 or A1+ ⁇ 1, and the sound bar 2 after rotating A2- ⁇ 2 or A2+ ⁇ 2 in the simulated room area. Sound bar 3 after A3- ⁇ 3 or A3+ ⁇ 3.
  • the sound bar 1 After receiving the playback instruction, the sound bar 1 starts to play the pre-acquired and locally stored positioning audio (such as the sound of rain), and during the playback of the positioning audio, it rotates at a constant speed from the first angle to the second angle at a speed v.
  • the first angle and the second angle are one of A1- ⁇ 1 and A1+ ⁇ 1 respectively, that is, the first angle is A1- ⁇ 1, the second angle is A1+ ⁇ 1, or the first angle is A1+ ⁇ 1, the first angle is A1- ⁇ 1, and the second angle is A1+ ⁇ 1.
  • the second angle is A1- ⁇ 1.
  • the microphone of the user's mobile phone in the left subspace receives the captured audio, and sends the captured audio to the administrator's APP.
  • the administrator's APP can obtain the target horizontal angle B1 of the sound bar 1 by referring to the description of scenario 2.
  • the sound bar 2 After receiving the playback instruction, the sound bar 2 starts to play the pre-acquired and locally stored positioning audio (such as the sound of rain), and in the process of playing the positioning audio, it rotates at a constant speed from the first angle to the second angle at the speed v.
  • the first angle and the second angle are one of A2- ⁇ 2 and A2+ ⁇ 2 respectively, that is, the first angle is A2- ⁇ 2, the second angle is A2+ ⁇ 2, or the first angle is A2+ ⁇ 2, the first angle is A2- ⁇ 2, and the second angle is A2+ ⁇ 2.
  • the second angle is A2- ⁇ 2.
  • the microphone of the user's mobile phone in the middle subspace receives the captured audio, and sends the captured audio to the administrator's APP.
  • the administrator's APP can obtain the target horizontal angle B2 of the sound bar 2 by referring to the description of the second scenario.
  • the sound bar 3 After receiving the playback instruction, the sound bar 3 starts to play the pre-acquired and locally stored positioning audio (such as the sound of rain), and in the process of playing the positioning audio, it rotates at a constant speed from the first angle to the second angle at a speed v.
  • the first angle and the second angle are one of A3- ⁇ 3 and A3+ ⁇ 3 respectively, that is, the first angle is A3- ⁇ 3, the second angle is A3+ ⁇ 3, or the first angle is A3+ ⁇ 3, the first angle is A3- ⁇ 3, the second angle is A3+ ⁇ 3, The second angle is A3- ⁇ 3.
  • the microphones of the mobile phones of all users in the room receive the captured audio, and send the captured audio to the administrator's APP.
  • the administrator's APP can obtain the target horizontal angle B3 of the sound bar 3 with reference to the description of scenario 2.
  • the administrator's APP After the administrator's APP obtains the target horizontal angles B1 to B3, it sends the target horizontal angle B1 to the sound bar 1, the target horizontal angle B2 to the sound bar 2, and the target horizontal angle B3 to the sound bar 2.
  • the administrator's APP can display the sound bar 1 rotated to the target horizontal angle B1, the sound bar 2 rotated to the target horizontal angle B2, and the sound bar 3 rotated to the target horizontal angle B3 in the simulated room area. , and a pop-up window is displayed on the precise dessert positioning interface, which displays the text "fine adjustment completed".
  • the sound bar 1 After receiving the target horizontal angle B1, the sound bar 1 rotates to reach the target horizontal angle B1. At this time, the sweet spot of the sound bar 1 is the position of the user in the left subspace.
  • the sound bar 2 After the sound bar 2 receives the target horizontal angle B2, it rotates to reach the target horizontal angle B2. At this time, the sweet spot of the sound bar 2 is the center position of the two users in the middle subspace.
  • the sound bar 3 After receiving the target horizontal angle B3, the sound bar 3 rotates to reach the target horizontal angle B3. At this time, the sweet spot of the sound bar 3 is the center position of all users in the room.
  • the precise dessert positioning function is completed. Thereafter, as long as the multiple users do not move their positions, the stereo (such as the sound of a TV or movie) played by the multiple sound bars forms the best listening effect at the positions associated with the users in their respective subspaces.
  • the stereo such as the sound of a TV or movie
  • the above-mentioned user is the administrator, and the administrator holds a control device, such as a mobile phone, and the APP installed on the mobile phone enters the "administrator" mode.
  • the user clicks the corresponding position on the simulated room area according to his position in the room, and the APP displays a logo (such as a smiling face) at the corresponding position, indicating that the user is here.
  • a logo such as a smiling face
  • the user's APP can use formulas (1) to (4) in scenario 1 to obtain the initial horizontal angle A1 and the fine-tuning angle ⁇ 1 of the sound bar 1, and the initial horizontal angle A2 of the sound bar 2 and Fine-tuning angle ⁇ 2, initial horizontal angle A3 of sound bar 3 and fine-tuning angle ⁇ 3.
  • the initial horizontal angle A2 and the fine-tuning angle ⁇ 2 of 2 are sent to the sound bar 2 in the form of commands, and the calculated initial horizontal angle A3 and the fine-tuning angle ⁇ 3 of the sound bar 3 are sent to the sound bar 3 in the form of commands.
  • the sound bar 1 After receiving the instruction, the sound bar 1 can rotate to the angle A1- ⁇ 1 or A1+ ⁇ 1.
  • the sound bar 2 After receiving this command, the sound bar 2 can rotate to the angle A2- ⁇ 2 or A2+ ⁇ 2.
  • the sound bar 3 After receiving this command, the sound bar 3 can be rotated to the angle A3- ⁇ 3 or A3+ ⁇ 3.
  • the user holds the phone and stands still at a selected location in the room (the location corresponding to the smiling face in Figure 12e).
  • the user clicks the "fine-tuning" control on the precise dessert positioning interface and the user's APP sends a playback instruction indicating the start of fine-tuning to the sound bars 1-3.
  • the user's APP can display the sound bar 1 after rotating A1- ⁇ 1 or A1+ ⁇ 1, the sound bar 2 after rotating A2- ⁇ 2 or A2+ ⁇ 2, and the sound bar 2 after rotating A3 in the simulated room area. Sound bar 3 after - ⁇ 3 or A3+ ⁇ 3.
  • the sound bar 1 After receiving the playback instruction, the sound bar 1 starts to play the pre-acquired and locally stored positioning audio (such as the sound of rain), and during the playback of the positioning audio, it rotates at a constant speed from the first angle to the second angle at a speed v.
  • the first angle and the second angle are one of A1- ⁇ 1 and A1+ ⁇ 1 respectively, that is, the first angle is A1- ⁇ 1, the second angle is A1+ ⁇ 1, or the first angle is A1+ ⁇ 1, the first angle is A1- ⁇ 1, and the second angle is A1+ ⁇ 1.
  • the second angle is A1- ⁇ 1.
  • the sound bar 2 After receiving the playback instruction, the sound bar 2 starts to play the pre-acquired and locally stored positioning audio (such as the sound of rain), and in the process of playing the positioning audio, it rotates at a constant speed from the first angle to the second angle at the speed v.
  • the first angle and the second angle are one of A2- ⁇ 2 and A2+ ⁇ 2 respectively, that is, the first angle is A2- ⁇ 2, the second angle is A2+ ⁇ 2, or the first angle is A2+ ⁇ 2, the first angle is A2- ⁇ 2, and the second angle is A2+ ⁇ 2.
  • the second angle is A2- ⁇ 2.
  • the sound bar 3 After receiving the playback instruction, the sound bar 3 starts to play the pre-acquired and locally stored positioning audio (such as the sound of rain), and in the process of playing the positioning audio, it rotates at a constant speed from the first angle to the second angle at a speed v.
  • the first angle and the second angle are one of A3- ⁇ 3 and A3+ ⁇ 3 respectively, that is, the first angle is A3- ⁇ 3, the second angle is A3+ ⁇ 3, or the first angle is A3+ ⁇ 3, the first angle is A3- ⁇ 3, the second angle is A3+ ⁇ 3, The second angle is A3- ⁇ 3.
  • the three soundbars mentioned above play positional audio at the same time and start turning at the same time.
  • the captured audio is received by the microphone of the user's phone.
  • the user's APP can refer to the description of scene 1 to obtain and detect the loudness of the captured audio, determine the time corresponding to the maximum loudness, and determine the difference between this moment and the start time of the captured audio as the target time, and then use the Formulas (5) or (6) respectively calculate the target horizontal angles B1 to B3 of the three sound bars.
  • the user's APP After the user's APP obtains the target horizontal angles B1 to B3, it sends the target horizontal angle B1 to the sound bar 1, the target horizontal angle B2 to the sound bar 2, and the target horizontal angle B3 to the sound bar.
  • Sound box 3 the user's APP can display the sound bar 1 rotated to the target horizontal angle B1, the sound bar 2 rotated to the target horizontal angle B2, and the sound bar 3 rotated to the target horizontal angle B3 in the simulated room area, And a pop-up window is displayed on the precise dessert positioning interface, and the text "fine adjustment completed" is displayed in the pop-up window.
  • the sound bar 1 After the sound bar 1 receives the target horizontal angle B1, it rotates to reach the target horizontal angle B1, after the sound bar 2 receives the target horizontal angle B2, it rotates to reach the target horizontal angle B2, and after the sound bar 3 receives the target horizontal angle B3, When the rotation reaches the target horizontal angle B3, the sweet spots of the sound bar 1, the sound bar 2 and the sound bar 3 are all the positions of the user.
  • the precise dessert positioning function is completed. After that, as long as the user doesn't move, the stereo sound (such as the sound of a TV or movie) played by the multiple soundbars creates the best listening effect at the user's location.
  • the stereo sound such as the sound of a TV or movie
  • a “Settings” control on the upper right of the precise dessert positioning interface.
  • a drop-down menu is displayed on the precise dessert positioning interface. There are two items on the drop-down menu, one is "maximum rotation angle measurement”, and the other is "custom fine-tuning angle”.
  • the APP receives the command generated by the operation, it sends the maximum rotation angle measurement command to the sound bar. Based on the maximum rotation angle measurement command, the sound bar starts to rotate horizontally, stops rotating when it touches the wall, and records the angle M when it stops rotating as the maximum rotation angle.
  • the sound bar sends the maximum rotation angle M to the APP.
  • the APP constrains the initial horizontal angle A according to the maximum rotation angle M, that is, if the calculated initial horizontal angle A is greater than the maximum rotation angle M, the initial horizontal angle A is modified to the maximum rotation angle M; if the calculated initial horizontal angle A is smaller than or equal to the maximum rotation angle M, the initial horizontal angle A remains unchanged. Further, the APP constrains the fine-tuning angle ⁇ according to the maximum rotation angle M, that is, if the fine-tuning angle ⁇ is calculated to be greater than MA, the fine-tuning angle ⁇ is modified to MA; Change.
  • the APP can also actively execute the process of obtaining the maximum rotation angle M once every time the user configures the room.
  • the APP receives the instruction generated by the operation, it determines the value input by the user as the fine-tuning angle ⁇ . That is, the fine-tuning angle ⁇ in the present application can be calculated and obtained by formula (4), or obtained by the user's input in the item of "custom fine-tuning angle".
  • FIGs 17a to 17d are several exemplary schematic diagrams of the exclusive private customization interface in this application.
  • the exclusive customization interface includes a simulated room area that displays furniture models set by the user in the room configuration interface.
  • the APP can first execute the process of precise dessert positioning to obtain the target horizontal angle B, and then rotate the angle of the sound bar to the target horizontal angle B in the simulated room area .
  • the APP sends the target horizontal angle B to the sound bar, so that the sound bar also rotates to the target horizontal angle B.
  • the APP before entering the exclusive private customization function, the APP must first complete the precise dessert positioning function. For example, if the user clicks the "exclusive personal order" control on the function selection interface, the APP will first determine whether the user has clicked the "precise dessert" on the function selection interface before clicking the "exclusive private order” control on the function selection interface.
  • the APP will display a pop-up window on the exclusive custom interface, which displays the text "Please select the precise dessert positioning first", as shown in Figure 17a , remind the user to click the "Precise Dessert Positioning” control first, and then click the "Exclusive Private Order” control when a pop-up window is displayed on the Precise Dessert Positioning interface and the text "Fine-tuning completed” is displayed in the pop-up window.
  • the exclusive personal customization interface the APP rotates the angle of the sound bar to the target horizontal angle B in the simulated room area. And the sound bar has been rotated to reach the target horizontal angle B at the end of the precise sweet spot positioning function.
  • the APP also displays a pop-up window on the exclusive private customization interface.
  • the pop-up window displays the text "Please wear earphones", reminding the user to wear earphones. After putting on the headset, the user clicks the "OK" control on the exclusive customization interface, and the APP sends the second playback instruction to the sound bar.
  • the APP displays a pop-up window on the exclusive private customization interface, and the pop-up window displays the text "ordering".
  • the sound bar After receiving the second play instruction, the sound bar starts to play the pre-acquired and locally stored test audio.
  • the headset receives the test audio, and then sends the retrieved audio corresponding to the test audio to the mobile phone.
  • the mobile phone calculates the binaural room impulse response (BRIR) based on the test audio from the sound bar and the retrieved audio from the headphones.
  • BRIR binaural room impulse response
  • the exclusive private customization function can also be used as a precise dessert positioning function, which is applicable to multiple scenarios, that is, one sound bar and one user, one sound bar and multiple users, and multiple sound bars and multiple users. user, multiple soundbars, and one user.
  • BRIR can be calculated by Equation (7):
  • 0 ⁇ p ⁇ P P represents the number of users; 0 ⁇ k ⁇ K, K represents the number of speaker units; i is 0 for the left ear, i is 1 for the right ear; f is the frequency; H 2p+i ,k (f) represents the BRIR of the p-th user corresponding to the k-th speaker unit; Y i,p,k (f) represents the echoed audio of the p-th user’s earphone corresponding to the k-th speaker unit; T(f ) indicates test audio.
  • H(f) ⁇ C K ⁇ K represents a matrix composed of the BRIR calculated by formula (7) as an element, and the matrix covers the room transfer functions of all users corresponding to all speaker units respectively;
  • * H represents the conjugate Matrix;
  • I k (f) ⁇ C K ⁇ K represents the identity matrix;
  • D(f) ⁇ R 2P ⁇ R represents the ideal transfer function,
  • the APP processes the audio played by the sound bar through formula (9) according to the updated filter coefficients:
  • X(f) represents the processed audio
  • S(f) represents the audio played by the soundbar
  • C(f) represents the filter coefficients
  • the above filter coefficients are obtained after accurate sweet spot positioning, so it can achieve more accurate crosstalk cancellation according to the location of the user, eliminate the influence of different rooms, enhance the sound and image effect, and truly restore the original sound effect.
  • the APP displays a pop-up window on the exclusive private customization interface, and the pop-up window displays the text "customization completed".
  • the exclusive private customization function is completed.
  • the stereo for example, the sound of a TV or movie
  • the sound bar creates the best listening effect at the user's position, and the original sound effect is highly restored.
  • the Void Mode interface includes a simulated room area that displays furniture models set by the user in the room configuration interface.
  • the APP can first perform the process of precise dessert positioning to obtain the target horizontal angle B, and then rotate the angle of the sound bar to the target horizontal angle B in the simulated room area, and then Execute the process in the exclusive private order to get BRIR.
  • the APP sends the target horizontal angle B to the sound bar, so that the sound bar also rotates to reach the target horizontal angle B.
  • the APP before entering the void mode function, the APP must first complete the precise dessert positioning function and the exclusive private customization function. For example, if the user clicks the "Void Mode" control on the function selection interface, the APP will first determine whether the user has clicked the "Precise Dessert Positioning" control on the function selection interface before clicking the "Void Mode” control on the function selection interface.
  • the "Exclusive Customization” control if the user has not clicked the "Precise Dessert Positioning" control and/or the “Exclusive Customization” control, the APP will display a pop-up window on the Void Mode interface, which displays "Please select in turn The text "Precise Dessert Positioning and Exclusive Customization", as shown in Figure 18a, reminds the user to click the "Precise Dessert Positioning" control first, when a pop-up window is displayed on the Precise Dessert Positioning interface, the pop-up window displays "fine adjustment completed” When entering text, click the "Exclusive Customization” control, and when a pop-up window is displayed on the exclusive private customization interface, the popup window displays the text "Customization Completed", and then click the "Void Mode” control.
  • the APP rotates the angle of the sound bar to the target horizontal angle B in the simulated room area. And the sound bar has been rotated to reach the target horizontal angle B at the end of the precise sweet spot positioning function.
  • the pull-up menu There are four items on the pull-up menu, namely "None” and “Golden Hall”. , "Concert” and "Tiananmen Square”.
  • the APP obtains the room transfer function corresponding to the "Golden Hall", and calculates the filter coefficient by formula (10) according to the BRIR and the room transfer function corresponding to the "Golden Hall”:
  • H(f) ⁇ C K ⁇ K represents the matrix composed of the BRIR calculated by formula (7) as the element, and the matrix covers the room transfer functions of all users corresponding to all sound bars respectively;
  • * H represents the total Yoke matrix;
  • I k (f) ⁇ C K ⁇ K representing the identity matrix;
  • the APP processes the audio played by the sound bar by formula (11) according to the updated filter coefficients:
  • S(f) represents the audio played by the soundbar
  • filter coefficients represents the filter coefficients
  • the above filter coefficients are obtained after exclusive customization, so it can achieve more accurate crosstalk cancellation according to the user's location, eliminate the influence of different rooms, achieve enhanced sound and image effects, and truly restore the original sound effects.
  • the location renders the sound field, giving the user an immersive experience.
  • the APP displays a pop-up window on the void mode interface, and the pop-up window displays the text "customization completed".
  • the Void Mode function is complete. After that, as long as the user does not move the position, the stereo (such as the sound of a TV or movie) played by the sound bar will form the best listening effect at the user's location, and the original sound effect will be highly restored, giving the user an immersive experience. .
  • the sending module is used to send a first play instruction to the speaker, and the first play instruction is used to instruct the speaker from the first sound bar.
  • the position is rotated to the second position along the preset direction, and the positioning audio is played during the rotation, and the loudness of the positioning audio is stable during playback;
  • the receiving module is used for receiving the positioning audio;
  • the processing module is used for
  • the indication information is determined according to the positional audio, and the indication information is used to determine the target position of the sound box, and the target position is the position when the loudness of the received audio is the maximum during the process of receiving the positional audio by the electronic device.
  • the position where the speaker is located, and the target position is a position in the process of the speaker being rotated from the first position to the second position;
  • the sending module is also used to send the instruction information to the speaker .
  • the angle difference between the first position and the second position is related to the binaural distance of the user; or, the angle between the first position and the second position The difference is relative to the preset fine-tuning range.
  • the indication information is further used to instruct the sound box to move from the second position to the target position.
  • the preset direction includes a horizontal clockwise direction or a horizontal counterclockwise direction.
  • the rotating along the preset direction includes rotating at a constant speed along the preset direction.
  • the shape of the sound box includes a bar, a square or a ring.
  • the processing module is further configured to acquire the initial position of the center of the sound box and the position of the user;
  • the theoretical sweet spot position of the user when the sound box is located at the theoretical sweet spot position, the connection line between the position of the user and the center of the sound box is perpendicular to the external surface of the sound box; obtain the fine-tuning angle; according to The theoretical sweet spot position and the fine-tuning angle obtain the first position and the second position.
  • the first position is the position where the sound box rotates the fine adjustment angle clockwise from the theoretical sweet spot position;
  • the second position is the sound box from the theoretical sweet spot position.
  • the sweet spot position rotates the position of the fine-tuning angle counterclockwise horizontally.
  • the processing module is specifically configured to display a room configuration interface, where the room configuration interface is used to simulate the space where the user and the speaker are located; receive the user's configuration in the room
  • the first virtual position input on the interface, the first virtual position is used to simulate the initial position; the initial position is calculated according to the first virtual position; the first virtual position input by the user on the room configuration interface is received;
  • the processing module is specifically configured to calculate the fine-tuning angle according to the initial position, the position of the user, and the binaural distance of the user.
  • the processing module is specifically configured to display a precise dessert positioning interface, and the precise dessert positioning interface includes a pop-up window for setting a fine-tuning angle;
  • the input preset experience value; the size of the fine-tuning angle is set as the preset experience value.
  • the processing module is specifically configured to detect the received positioning audio at a set frequency from the initial receiving time of the positioning audio to obtain a loudness;
  • the target time is determined as the indication information; or, determine the target time and the opposite direction of the preset direction as the indication information; or, determine the target time, the opposite direction of the preset direction, and the fine-tuning angle as the indication information ;
  • the opposite direction of the preset direction and a target rotation angle are determined as the indication information, and the target rotation angle is used to instruct the sound box to rotate from the second position to the target position.
  • the processing module is specifically configured to detect the positioning audio to obtain the maximum loudness; the difference between the time corresponding to the maximum loudness and the initial receiving time of the positioning audio
  • the target time is determined as the target time; the target time is determined as the indication information; or, the target time and the opposite direction of the preset direction are determined as the indication information;
  • the reverse direction of the preset direction and the fine-tuning angle are determined as the instruction information; or, the reverse direction of the preset direction and the target rotation angle are determined as the instruction information, and the target rotation angle is used to indicate the sound box. Rotate from the second position to the target position.
  • the sending module is further configured to send a second playback instruction to the speaker, where the second playback instruction is used to instruct the speaker to play the test audio;
  • the receiving module is further configured to use
  • the collected audio is the audio received by the microphone of the earphone worn by the user during the playback of the test audio;
  • the processing module is also used to calculate according to the collected audio and the test audio
  • the binaural room impulse response BRIR; the filter coefficient of the speaker is obtained according to the BRIR.
  • the processing module is further configured to receive a virtual space instruction, where the virtual space instruction includes a listening space; acquire a transfer function of the listening space; according to the BRIR and the listening space The transfer function of the sound space calculates the filter coefficients of the cabinet.
  • the present application provides an audio playback device, comprising: a receiving module for receiving a first playback instruction from an electronic device; a processing module for starting from a first position along a preset direction according to the first playback instruction Rotate to the second position, and play the positioning audio during the rotation, and the loudness of the positioning audio is stable during playback; the receiving module is also used for receiving the instruction information from the electronic device, the instruction The information is used to determine the target position, the target position is the position of the speaker when the received audio loudness is the largest during the process of receiving the positioning audio by the electronic device, and the target position is the sound box from the The first position is rotated to a position in the process of the second position; the processing module is further configured to rotate to the target position according to the instruction information.
  • the angle difference between the first position and the second position is related to the binaural distance of the user; or, the angle between the first position and the second position The difference is relative to the preset fine-tuning range.
  • the preset direction includes a horizontal clockwise direction or a horizontal counterclockwise direction.
  • the rotating along the preset direction includes rotating at a constant speed along the preset direction.
  • the shape of the sound box includes a bar, a square or a ring.
  • the receiving module is further configured to receive the theoretical sweet spot position and the fine-tuning angle from the electronic device.
  • the position of the user is different from the position of the user.
  • the connection line of the center of the sound box is perpendicular to the external surface of the sound box; the processing module is further configured to determine the first position and the second position according to the theoretical sweet spot position and the fine-tuning angle; rotate to the first position.
  • the first position is the position where the sound box rotates the fine adjustment angle clockwise from the theoretical sweet spot position;
  • the second position is the sound box from the theoretical sweet spot position.
  • the sweet spot position rotates the position of the fine-tuning angle counterclockwise horizontally.
  • the sending module is configured to send a first playback instruction to the i-th speaker, where the first playback instruction is used to instruct the i-th speaker to move from the first position along the
  • the preset direction is rotated to the second position at a constant speed, and the positioning audio is played during the rotation.
  • the loudness of the positioning audio is stable during playback.
  • the i-th speaker is one of the N speakers, and 1 ⁇ i ⁇ N, if N is greater than 1, it is a positive integer; the receiving module is used to receive a mixed signal, and the mixed signal is an audio signal formed by mixing the positioning audio played by the N speakers; the processing module is used for The i-th indication information is determined according to the mixed sound signal, and the i-th indication information is used to determine the target position of the i-th speaker, and the target position of the i-th speaker is received by the electronic device. In the process of the mixing signal, the position of the corresponding i-th speaker when the received audio loudness is the largest; the sending module is also used to send the i-th instruction information to the i-th speaker .
  • the preset direction includes a horizontal clockwise direction or a horizontal counterclockwise direction.
  • the processing module is further configured to acquire the initial position of the center of the i-th speaker and the position of the user; The theoretical sweet spot position of the ith speaker relative to the position of the user, when the ith speaker is located at the theoretical sweet spot position, the connection between the user's position and the center of the ith speaker be perpendicular to the external surface of the ith sound box; obtain a fine-tuning angle; obtain the first position and the second position of the ith sound box according to the theoretical sweet spot position and the fine-tuning angle.
  • the first position is the position where the i-th speaker rotates the fine-tuning angle from the theoretical sweet spot position to the preset direction;
  • the second position is the position of the i-th speaker. i speakers rotate the position of the fine-tuning angle from the theoretical sweet spot position to the opposite direction of the preset direction.
  • the sending module is further configured to send a first play instruction to the speaker, where the first play instruction is used to instruct the speaker to move along a preset direction from a first position Rotate to the second position, and play the positioning audio during the rotation, and the loudness of the positioning audio is stable during playback;
  • the receiving module is also used to receive a plurality of collected audios, and the multiple collected audios are During the playback of the positioning audio, the audios respectively received by the microphones of the terminals of multiple users;
  • the processing module is further configured to determine indication information according to the plurality of collected audios, where the indication information is used to determine the The target position of the sound box, the target position is the position where the sound box is located when the sum of the received audio loudness is the largest in the process of receiving the positioning audio by the electronic devices of the plurality of users, and the target position is the position of the sound box.
  • the sending module is further configured to send the instruction information to the sound
  • the processing module is further configured to acquire the initial position of the center of the speaker and the positions of the multiple users; determine the multiple users according to the positions of the multiple users The center position of the user; calculate the theoretical sweet spot position of the speaker relative to the center positions of the multiple users according to the initial position and the center positions of the multiple users, when the speaker is located at the theoretical sweet spot position,
  • the line connecting the center positions of the plurality of users and the center of the sound box is perpendicular to the external surface of the sound box; obtaining a fine-tuning angle; obtaining the first position and all the fine-tuning angles according to the theoretical sweet spot position and the fine-tuning angle. the second position.
  • the processing module is further configured to divide the space into multiple sub-spaces according to the number of N speakers, and each of the The subspace corresponds to one of the speakers, and if N is greater than 1, it is a positive integer; the sending module is further configured to send a first playback instruction to the N speakers respectively, and the first playback instruction is used to indicate the corresponding The speaker is rotated from the first position to the second position along the preset direction, and the positioning audio is played during the rotation, and the loudness of the positioning audio is stable during playback; the processing module is also used to determine N indications The N pieces of indication information correspond to the N sound boxes, and the indication pieces of information are used to determine the target position of the corresponding sound box; the sending module is also used to send the N pieces of indication information to the corresponding speaker.
  • the processing module is specifically configured to receive the first positioning audio played by the i-th sound bar, where the i-th sound bar is one of the N sound bars, and 1 ⁇ i ⁇ N, there is only one first user in the subspace corresponding to the first sound bar; the first indication information is determined according to the first positioning audio, and the first indication information is used to determine the i-th The first target position of the sound box, the first target position is the position where the i-th sound box is located when the received audio loudness is the largest during the process of receiving the first positioning audio by the electronic device.
  • the processing module is further configured to obtain the first initial position of the center of the i-th sound box and the position of the first user; according to the first initial position and the Calculate the first theoretical sweet spot position of the i-th sound bar relative to the position of the user at the position of the first user; obtain a first fine-tuning angle; according to the first theoretical sweet spot position and the first theoretical sweet spot position A fine-tuned angle obtains the first position and the second position of the first sound bar.
  • the receiving module is further configured to receive a plurality of collected audios, and the plurality of collected audios are obtained when the jth sound bar is playing the second positioning audio.
  • Audio received respectively by the microphones of the user's electronic device the j-th sound bar is one of N sound bars, 1 ⁇ j ⁇ N, and the plurality of second users are located in the j-th sound bar in the subspace corresponding to the sound bar;
  • the processing module is further configured to determine second indication information according to the plurality of collected audios, where the second indication information is used to determine the second indication of the jth sound bar
  • the target position, the second target position is the jth sound bar where the jth sound bar is located when the sum of the received audio loudness is the largest during the process of receiving the second positioning audio by the electronic devices of the plurality of second users. position, and the second target position is a position in the process of turning the first position to the second position.
  • the processing module is further configured to acquire the second initial position of the center point of the jth sound bar and the positions of the plurality of second users;
  • the positions of the second users determine the central positions of the plurality of second users; according to the second initial position and the central positions of the plurality of second users, calculate the relative position of the j-th sound bar relative to the obtaining the second theoretical sweet spot position of the center positions of multiple users; obtaining a second fine-tuning angle; obtaining the first position and the j-th sound bar according to the second theoretical sweet spot position and the second fine-tuning angle the second position.
  • the receiving module is further configured to receive a plurality of collected audios, and the plurality of collected audios are in the process of playing the third positioning audio on the kth sound bar, and the plurality of third Audio received by the microphone of the user's electronic device, the kth sound bar is one of the N sound bars, 1 ⁇ k ⁇ N, in the subspace corresponding to the kth sound bar If there is no user, the multiple third users refer to all users in the space; the processing module is further configured to determine third indication information according to the multiple collected audios, where the third indication information is used to determine The third target position of the k-th sound bar, where the third target position is the maximum sum of the received audio loudness during the process of receiving the third positioning audio by the electronic devices of the plurality of third users When the k-th sound bar is located, the third target position is a position in the process of rotating the first position to the second position.
  • the processing module is further configured to acquire the third initial position of the kth sound bar and the positions of the plurality of third users; according to the plurality of third The position of the user determines the central position of the plurality of third users; according to the third initial position and the central position of the plurality of third users, the k-th sound bar is calculated relative to the plurality of users
  • the apparatus of this embodiment can be used to implement the technical solutions of the method embodiments shown in FIG. 4 to FIG. 8 , and the implementation principles and technical effects thereof are similar, and will not be repeated here.
  • each step of the above method embodiments may be completed by a hardware integrated logic circuit in a processor or an instruction in the form of software.
  • the processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other Programming logic devices, discrete gate or transistor logic devices, discrete hardware components.
  • DSP digital signal processor
  • ASIC application-specific integrated circuit
  • FPGA field programmable gate array
  • a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
  • the steps of the methods disclosed in the embodiments of the present application may be directly embodied as executed by a hardware coding processor, or executed by a combination of hardware and software modules in the coding processor.
  • the software modules may be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other storage media mature in the art.
  • the storage medium is located in the memory, and the processor reads the information in the memory, and completes the steps of the above method in combination with its hardware.
  • the memory mentioned in the above embodiments may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory.
  • the non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically programmable Erase programmable read-only memory (electrically EPROM, EEPROM) or flash memory.
  • Volatile memory may be random access memory (RAM), which acts as an external cache.
  • RAM random access memory
  • DRAM dynamic random access memory
  • SDRAM synchronous DRAM
  • SDRAM double data rate synchronous dynamic random access memory
  • ESDRAM enhanced synchronous dynamic random access memory
  • SLDRAM synchronous link dynamic random access memory
  • direct rambus RAM direct rambus RAM
  • the disclosed system, apparatus and method may be implemented in other manners.
  • the apparatus embodiments described above are only illustrative.
  • the division of the units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented.
  • the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, which may be electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
  • the functions, if implemented in the form of software functional units and sold or used as independent products, may be stored in a computer-readable storage medium.
  • the technical solution of the present application can be embodied in the form of a software product in essence, or the part that contributes to the prior art or the part of the technical solution.
  • the computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program codes .

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Otolaryngology (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Multimedia (AREA)
  • Stereophonic System (AREA)
  • Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)
  • Stereophonic Arrangements (AREA)
  • Details Of Audible-Bandwidth Transducers (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

本申请提供一种音箱位置调节方法、音频渲染方法和装置。本申请音箱位置调节方法,包括: 电子设备向音箱发送第一播放指令,第一播放指令用于指示音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,定位音频在播放时的响度稳定不变; 电子设备接收定位音频; 电子设备根据定位音频确定指示信息,指示信息用于确定音箱的目标位置,目标位置为在电子设备接收定位音频的过程中,接收的音频响度最大时音箱所在的位置,目标位置为音箱从第一位置转动至第二位置过程中的一个位置; 电子设备将指示信息发送给音箱。本申请实现更精准的串扰消除,消除不同房间影响,增强声像效果,真实还原原始音效。

Description

音箱位置调节方法、音频渲染方法和装置 技术领域
本申请涉及音频处理技术领域,尤其涉及一种音箱位置调节方法、音频渲染方法和装置。
背景技术
在室内使用场景下,人们可能会布置5.1或者5.1.2的家庭影院系统,或者采用条形音箱(soundbar)等立体声的播放系统,以得到像电影院一样的声像空间感。
要模拟真实的声像空间感,第一步需要设计用户的甜点位(sweet point),甜点位指的是听感最佳的位置。通常有两种甜点位设计方法,一种是根据头相关传输函数与房间响应虚拟出环绕声音箱的串扰消除(cross-talk cancellation)方法,另一种是通过控制扬声器阵列来形成定向声波,再借助墙面等反射物让声波从固定角度传到人耳,从而达到环绕感的波束赋型(beam forming)方法。
但这两种方法均无法在室内使用场景下获得优秀的音效体验。
发明内容
本申请提供一种音箱位置调节方法、音频渲染方法和装置,以实现更精准的串扰消除,消除不同房间影响,增强声像效果,真实还原原始音效。
第一方面,本申请提供一种音箱位置调节方法,包括:电子设备向音箱发送第一播放指令,所述第一播放指令用于指示所述音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;所述电子设备接收所述定位音频;所述电子设备根据所述定位音频确定指示信息,所述指示信息用于确定所述音箱的目标位置,所述目标位置为在所述电子设备接收所述定位音频的过程中,接收的音频响度最大时所述音箱所在的位置,所述目标位置为所述音箱从所述第一位置转动至所述第二位置过程中的一个位置;所述电子设备将所述指示信息发送给所述音箱。
相应的,音箱接收来自电子设备的第一播放指令;所述音箱根据所述第一播放指令从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;所述音箱接收来自所述电子设备的指示信息,所述指示信息用于确定目标位置,所述目标位置为在所述电子设备接收所述定位音频的过程中,接收的音频响度最大时所述音箱所在的位置,所述目标位置为所述音箱从所述第一位置转动至所述第二位置过程中的一个位置;所述音箱根据所述指示信息从所述第二位置转动至所述目标位置。
可选的,所述第一位置和所述第二位置之间的角度差与用户的双耳距离有关;或者,所述第一位置和所述第二位置之间的角度差与预设的微调范围相关。
可选的,所述指示信息还用于指示所述音箱从所述第二位置转到所述目标位置。
可选的,所述预设方向包括水平顺时针方向或者水平逆时针方向。
可选的,所述转动包括围绕所述音箱在竖直方向的转动轴匀速转动。音箱在竖直方向的转动轴可以是固定音箱的竖直轴,音箱围绕该轴沿水平方向顺时针或逆时针转动,音箱 也可以在该轴的带动下沿水平方向顺时针或逆时针转动。可选的,音箱在竖直方向的转动轴可以是本身穿过音箱的中心或者其延长线穿过音箱的中心的轴。例如,音箱的中心是指音箱的几何中心。
可选的,所述音箱的形状包括条形、方形或者环形。
本申请的音箱位置调节方法也可以适用于对有扬声器的设备的位置调节,即本申请中的音箱可以理解为有扬声器的外放设备。
在音箱位置调节方法开始之前,用户可以通过安装于电子设备上的应用程序(application,APP)提供的交互界面,发出甜点定位指令。基于该指令,电子设备开始执行音箱位置调节方法的步骤,首先就是向条形音箱发送第一播放指令。第一播放指令用于指示条形音箱从第一位置匀速转动至第二位置,并在转动的过程中播放定位音频。
定位音频是符合设定条件的全频带音频,例如,定位音频可以是声压级不小于65dB且信噪比不小于20dB的全频带音频,包括白噪声、粉噪声或扫频信号。可选的,定位音频每一帧能量都是相同的。定位音频在播放时的响度稳定不变可以理解为定位音频在播放时,每一帧音频帧的能量保持不变,音箱的播放的参数也需要保持不变,从而使得音箱播放该音频时播放能量保持不变。可选的,定位音频可以是音箱中预存的音频,也可以是用户定义的音频,还可以是电子设备发送给音箱的音频,本申请对音箱获取定位音频的方法不做具体限定。
可选的,为了方便理解,如图12l所示,条形音箱的位置可以通过条形音箱与竖直平面竖直平面之间的第一夹角a的角度表示,竖直平面例如可以是指条形音箱所靠近或安装的墙面。当条形音箱与竖直平面平行时,第一夹角的角度为0°;条形音箱从角度0°开始逆时针转动,当转到垂直于竖直平面时,第一夹角的角度为90°,转动过程中第一夹角的角度变化为从0°到90°;条形音箱从角度0°开始顺时针转动,当转到垂直于竖直平面时,第一夹角的角度为-90°,转动过程中第一夹角的角度变化为从0°到-90°。可见,第一夹角的开口向左时,第一夹角的角度值为正,第一夹角的开口向右时,第一夹角的角度值为负。
可选的,为了方便理解,如图12m所示,条形音箱的位置也可以通过条形音箱的中心的垂直线和竖直平面竖直平面的垂直线之间的第二夹角b的角度表示。当条形音箱与竖直平面平行时,条形音箱的中心的垂直线和竖直平面的垂直线平行或者重合,此时第二夹角的角度为0°;条形音箱从角度0°开始逆时针转动,当转到垂直于竖直平面时,条形音箱的中心的垂直线和竖直平面的垂直线相互垂直,此时第二夹角的角度为90°,转动过程中第二夹角的角度变化为从0°到90°;条形音箱从角度0°开始顺时针转动,当转到垂直于竖直平面时,条形音箱的中心的垂直线和竖直平面的垂直线相互垂直,此时第二夹角的角度为-90°,转动过程中第二夹角的角度变化为从0°到-90°。可见,条形音箱的中心的垂直线位于竖直平面的垂直线的右侧时,第二夹角的角度值为正,条形音箱的中心的垂直线位于竖直平面的垂直线的左侧时,第二夹角的角度值为负。
因此,第一位置和第二位置均可以采用上述第一夹角或者第二夹角的角度值表示,而条形音箱从第一位置匀速转动至第二位置,可以描述为条形音箱从第一角度匀速转动至第二角度,第一角度和第二角度分别是第一夹角的两个角度值,或者,第一角度和第二角度分别是第二夹角的两个角度值。
在一种可能的实现方式中,电子设备向条形音箱发送第一播放指令之前可以先获取条 形音箱的中心的初始位置和用户所在的位置,根据初始位置和用户所在的位置计算条形音箱相对于用户的理论甜点位置,再获取微调角度,然后根据理论甜点位置和微调角度获取第一位置和第二位置。
当条形音箱位于理论甜点位置时,用户所在的位置与条形音箱的中心的连线与条形音箱的外放表面垂直,且外放表面朝向用户。条形音箱的外放表面是指条形音箱的外放所在面的表面。通常外放设置于音箱的一个面上,那么此时外放表面是指该面。也有音箱的外放设置于音箱的多个面上,那么此时的外放表面是指音箱面对用户的一个面。
第一位置是条形音箱从理论甜点位置向预设方向转动微调角度的位置;第二位置是条形音箱从理论甜点位置向预设方向的反方向转动微调角度的位置。
本申请可以通过APP提供的交互界面(例如房间配置界面,可参见下文图11的描述),用户在该界面上输入第一虚拟位置,该第一虚拟位置用于模拟条形音箱的中心在房间中的位置,基于第一虚拟位置可以计算得到条形音箱的中心的初始位置,该初始位置可以以坐标的形式表示。用户也可以在上述交互界面上输入第二虚拟位置,该第二虚拟位置用于模拟用户在房间中的位置,基于第二虚拟位置可以计算得到用户所在的位置,该用户所在的位置也可以以坐标的形式表示。
可以根据以下公式(1)~(3)获取条形音箱的理论甜点位置:
Figure PCTCN2021116239-appb-000001
其中,d表示用户所在的位置和条形音箱的中心之间的直线距离,(x c,y c)表示用户所在的位置,(x s0,y s0)表示条形音箱的中心的初始位置。
h=|y c-y s0|      (2)
其中,h表示用户所在的位置和条形音箱的中心之间的垂直距离。
Figure PCTCN2021116239-appb-000002
其中,A表示条形音箱的理论甜点位置对应的角度值。例如,条形音箱发生转动之前,对应于上述第二夹角的角度为A。而甜点定位的目的是让条形音箱的中心和用户所在的位置之间的连线垂直于条形音箱的外放表面,且该外放表面朝向用户,因此条形音箱需要水平顺时针转动角度A才能达到该目的,角度A便是对应于条形音箱的理论甜点位置。
但是由于用户所在的位置是用户在交互界面上输入的,该位置可能与用户的实际位置之间存在误差,因此需要在理论甜点位置的基础上微调条形音箱的位置,以确定出精确的目标位置。
微调角度θ对应的夹角的一条边是用户所在的位置和条形音箱的中心之间的连线。通过公式(4)计算得到微调角度θ:
Figure PCTCN2021116239-appb-000003
其中,w表示二倍的双耳距离,w可以采用预先设定的固定值,也可以由用户预先设置。
可选的,微调角度θ可以由用户在交互界面(例如精准甜点定位界面)直接输入。
可选的,对应于第一位置的第一角度可以是A-θ,对应于第二位置的第二角度可以是A+θ;或者,对应于第一位置的第一角度可以是A+θ,对应于第二位置的第二角度可以是A-θ。
在一种可能的实现方式中,当根据条形音箱的中心的初始位置和用户所在的位置已经满足条形音箱的中心和用户所在的位置之间的连线垂直于条形音箱的目的时,就没有必要再进行甜点定位,因此也可以在甜点定位之前,先基于该原则,根据条形音箱的中心的初始位置和用户所在的位置确定是否需要进行甜点定位,如果需要,则开始甜点定位的过程。
条形音箱收到第一播放指令后,从第一播放指令中获取第一位置和第二位置,按照预先设定的转动方向,例如从A-θ到A+θ,或从A+θ到A-θ,一边转动一边播放定位音频,例如预先录好的雨声。
条形音箱是一边转动一边播放定位音频,因此电子设备的麦克风收到的定位音频可能存在响度差异,即条形音箱转动的位置远离电子设备时,电子设备接收的定位音频的响度变小,而条形音箱转动的位置趋近电子设备时,电子设备接收的定位音频的响度变大。微调的目的就是在找到电子设备接收的定位音频的响度最大时,条形音箱的位置。由于响度大小是由用户的电子设备检测出来的,因此条形音箱处于该位置时可以认为条形音箱的甜点位精准的落在用户所在的位置。
在一种可能的实现方式中,电子设备可以从定位音频的起始接收时刻开始,以设定频率对接收的定位音频进行检测得到一个响度。当到达定位音频的结束接收时刻时,电子设备将得到的多个响度中的最大者对应的时刻与起始接收时刻之间的差值确定为目标时间。电子设备可以将接收定位音频和检测响度同步进行。
在一种可能的实现方式中,电子设备可以对定位音频进行检测得到最大响度,然后将最大响度对应的时刻与定位音频的起始接收时刻之间的差值确定为目标时间。电子设备也可以接收完全部定位音频后,对整段定位音频进行检测。
可选的,条形音箱播放定位音频时,如果定位音频的响度是变化的,则电子设备可以对接收的定位音频和预先存储的所述定位音频进行能量比较,即比较接收的定位音频的第i帧和预先存储的定位音频的第i帧的能量,i=0,1,…,m-1,m表示定位音频的总帧数,然后将能量差值最大的帧对应的时刻确定为目标时间。
根据以下公式可以计算得到条形音箱的目标位置对应的角度值:
当第一角度为A-θ,第二角度为A+θ时,根据公式(5)计算得到目标位置对应的角度值B:
B=(A-θ)+vt     (5)
由于播放定位音频结束时,条形音箱转到了第二位置(对应的第二角度为A+θ),因此条形音箱要转动到目标位置(对应的角度为B),是从第二位置反向转动,即从角度A+θ转动至角度B,根据上述公式可以计算得到条形音箱需转动的角度大小为β=2θ-vt。
当第一角度为A+θ,第二角度为A-θ时,根据公式(6)计算得到目标位置对应的角度值B:
B=(A+θ)-vt     (6)
其中,v表示条形音箱的转动速度,该转动速度可以预先设定,t表示目标时间。
由于播放定位音频结束时,条形音箱转到了第二位置(对应的第二角度为A-θ),因此条形音箱要转动到目标位置(对应的角度为B),是从第二位置反向转动,即从角度A-θ转动至角度B,根据公式(6)可以计算得到条形音箱需转动的角度大小为β=2θ-vt。
由此可见,基于上述方法得到的目标时间,电子设备可以采用以下几种方式确定指示 信息,进而条形音箱根据该指示信息获取需转动的角度大小β=2θ-vt:
(1)电子设备将目标时间确定为指示信息。
上述公式中的微调角度θ可以在之前与电子设备的交互信息中获取,此处不再赘述;转动速度可以是预先设置的。目标时间可以从指示信息中获取。转动方向也可以是预先设置的。因此条形音箱可以基于这些信息计算得到需转动的角度大小β。
(2)电子设备将目标时间和预设方向的反方向确定为指示信息。
上述公式中的微调角度θ可以在之前与电子设备的交互信息中获取,此处不再赘述;转动速度可以是预先设置的。目标时间和转动方向(预设方向的反方向)可以从指示信息中获取。因此条形音箱可以基于这些信息计算得到需转动的角度大小β。
(3)电子设备将目标时间、预设方向的反方向以及微调角度确定为指示信息。
上述公式中的微调角度θ和目标时间,以及转动方向(预设方向的反方向)均可以从指示信息中获取。转动速度可以是预先设置的。因此条形音箱可以基于这些信息计算得到需转动的角度大小β。
(4)电子设备将预设方向的反方向和目标旋转角度确定为指示信息。
转动方向(预设方向的反方向)可以从指示信息中获取。此时条形音箱不需要在通过上述公式计算需转动的角度大小β,该角度也可以从指示信息中获取。
需要说明的是,定位音频的时长T、目标时间t、微调角度θ以及转动速度v相互约束,即微调的结果得到了目标位置对应的角度值B,而目标位置对应的角度值B要落在角度范围[A-θ,A+θ]内,因此,-θ≤vt≤θ,t≤T。
因此,电子设备确定的指示信息中可以包括目标位置对应的角度值B,或者可以包括目标时间t,这两个值均可以使得条形音箱确定出其目标位置。
指示信息还具有指示条形音箱从第二位置转到目标位置的功能,因此条形音箱接收到指示信息后,先确定目标位置,然后从当前的位置转到目标位置。
例如,在微调过程中,条形音箱从A-θ对应的位置转到A+θ对应的位置,那么收到指示信息后,条形音箱从A+θ对应的位置开始反向转动角度(2θ-vt)到达B对应的位置。
又例如,在微调过程中,条形音箱从A+θ对应的位置转到A-θ对应的位置,那么收到指示信息后,条形音箱从A-θ对应的位置开始反向转动角度(2θ-vt)到达B对应的位置。
本申请中条形音箱和电子设备相互配合,条形音箱一边从第一位置匀速转动到第二位置,一边播放定位音频,而电子设备根据接收的定位音频找到响度最大时,条形音箱的位置,并控制条形音箱转到该位置,这样可以针对用户所在的位置,实现更精准的串扰消除,消除不同房间影响,增强声像效果,真实还原原始音效。
在一种可能的实现方式中,电子设备向所述条形音箱发送第二播放指令,所述第二播放指令用于指示所述条形音箱播放测试音频;所述电子设备接收采集音频,所述采集音频是在所述测试音频的播放过程中,用户所戴耳机的麦克风接收到的音频;所述电子设备根据所述采集音频和所述测试音频计算双耳房间脉冲响应BRIR;所述电子设备根据所述BRIR获取所述条形音箱的滤波器系数。
可以通过公式(7)计算BRIR:
Figure PCTCN2021116239-appb-000004
其中,0≤p<P,P表示用户的人数;0≤k<K,K表示扬声器单元的个数;i为0对应 左耳,i为1对应右耳;f表示频率;H 2p+i,k(f)表示第p个用户对应于第k个扬声器单元的BRIR;Y i,p,k(f)表示第p个用户的耳机对应于第k个条形音箱的回采音频;T(f)表示测试音频。
然后通过公式(8)计算滤波器系数:
C(f)=(H(f) HH(f)+βI k(f)) -1H(f) HD(f)     (8)
其中,H(f)∈C K×K,表示由公式(7)计算得到的BRIR作为元素所组成的矩阵,该矩阵涵盖所有用户分别对应于所有扬声器单元的房间传递函数;* H表示共轭矩阵;I k(f)∈C K×K,表示单位矩阵;D(f)∈R 2P×R,表示理想传递函数,R表示声道数,若音频为立体声,则R=2,
Figure PCTCN2021116239-appb-000005
最后条形音响根据更新后的滤波器系数,通过公式(9)对条形音箱播放的音频进行处理:
X(f)=C(f)S(f)     (9)
其中,X(f)表示处理后的音频,S(f)表示条形音箱播放的音频,C(f)表示滤波器系数。
上述滤波器系数是在精准甜点定位后得到的,因此可以针对用户所在的位置,实现更精准的串扰消除,消除不同房间影响,达到增强声像效果,真实还原原始音效。
在一种可能的实现方式中,所述电子设备根据所述BRIR获取所述条形音箱的滤波器系数之前,还包括:所述电子设备接收虚拟空间指令,所述虚拟空间指令包括听音空间;所述电子设备获取所述听音空间的传递函数;所述电子设备根据所述BRIR获取所述条形音箱的滤波器系数,包括:所述电子设备根据所述BRIR和所述听音空间的传递函数计算所述条形音箱的滤波器系数。
例如,听音空间是“金色大厅”。电子设备通过公式(10)计算得到滤波器系数:
Figure PCTCN2021116239-appb-000006
其中,H(f)∈C K×K,表示由公式(7)计算得到的BRIR作为元素所组成的矩阵,该矩阵涵盖所有用户分别对应于所有条形音箱的房间传递函数;* H表示共轭矩阵;I k(f)∈C K×K,表示单位矩阵;
Figure PCTCN2021116239-appb-000007
表示听音空间(例如金色大厅)的传递函数,R表示声道数,若音频为立体声,则R=2,
Figure PCTCN2021116239-appb-000008
Figure PCTCN2021116239-appb-000009
表示第p个用户选择的听音空间。
条形音响根据更新后的滤波器系数,通过公式(11)对条形音箱播放的音频进行处理:
Figure PCTCN2021116239-appb-000010
其中,
Figure PCTCN2021116239-appb-000011
表示处理后的音频,S(f)表示条形音箱播放的音频,
Figure PCTCN2021116239-appb-000012
表示滤波器系数。
上述滤波器系数是在专属私人订制后得到的,因此既可以针对用户所在的位置,实现更精准的串扰消除,消除不同房间影响,达到增强声像效果,真实还原原始音效,又可以在用户所在的位置渲染声场,给用户身临其境的体验。
第二方面,本申请提供一种音箱位置调节方法,包括:电子设备向第i个音箱发送第 一播放指令,所述第一播放指令用于指示所述第i个音箱从第一位置沿预设方向匀速转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变,所述第i个音箱是N个音箱的其中之一,1≤i≤N,N大于1的为正整数;所述电子设备接收混音信号,所述混音信号是所述N个音箱各自播放的定位音频混合而成的音频信号;所述电子设备根据所述混音信号确定第i个指示信息,所述第i个指示信息用于确定所述第i个音箱的目标位置,所述第i个音箱的目标位置为在所述电子设备接收所述混音信号的过程中,接收的音频响度最大时对应的所述第i个音箱所在的位置;所述电子设备将所述第i个指示信息发送给所述第i个音箱。
在一种可能的实现方式中,所述预设方向包括水平顺时针方向或者水平逆时针方向。
在一种可能的实现方式中,所述电子设备向第i个音箱发送第一播放指令之前,还包括:所述电子设备获取所述第i个音箱的中心的初始位置和用户所在的位置;所述电子设备根据所述初始位置和所述用户所在的位置计算所述第i个音箱相对于所述用户所在的位置的理论甜点位置,当所述第i个音箱位于所述理论甜点位置时,所述用户所在的位置与所述第i个音箱的中心的连线与所述第i个音箱的外放表面垂直,且所述外放表面朝向所述用户;所述电子设备获取微调角度;所述电子设备根据所述理论甜点位置和所述微调角度获取所述第i个音箱的所述第一位置和所述第二位置。
在一种可能的实现方式中,所述第i个音箱的第一位置是所述第i个音箱从所述理论甜点位置向所述预设方向转动所述微调角度的位置;所述第i个音箱的第二位置是所述第i个音箱从所述理论甜点位置向所述预设方向的反方向转动所述微调角度的位置。
本实施例与上述第一方面的区别在于,房间内的条形音箱的数量从一个变成多个,多个条形音箱排列成一排,其外放表面均朝向用户。此时房间中的多个条形音箱同时播放定位音频,由用户终端的麦克风接收多个条形音箱分别播放的定位音频的混音信号,由于各个条形音箱相对于用户的位置各不相同,因此接收到定位音频的响度最大时对应的各个条形音箱的位置也各不相同。需要针对每个条形音箱分别获取其目标位置和指示信息。
本申请中多个条形音箱和电子设备相互配合,多个条形音箱一边从第一位置匀速转动到第二位置,一边播放定位音频,而电子设备根据接收的定位音频的混音信号找到响度最大时,各个条形音箱的位置,并控制各个条形音箱转到各自对应的位置,这样可以针对用户所在的位置,实现更精准的串扰消除,消除不同房间影响,增强声像效果,真实还原原始音效。
在一种可能的实现方式中,电子设备向音箱发送第一播放指令,所述第一播放指令用于指示所述音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;所述电子设备接收多个采集音频,所述多个采集音频是在所述定位音频的播放过程中,多个用户的终端的麦克风分别接收到的音频;所述电子设备根据所述多个采集音频确定指示信息,所述指示信息用于确定所述音箱的目标位置,所述目标位置为在所述多个用户的电子设备接收所述定位音频的过程中,接收的音频响度之和最大时所述音箱所在的位置,所述目标位置为所述第一位置转动至所述第二位置过程中的一个位置;所述电子设备将所述指示信息发送给所述音箱。
在一种可能的实现方式中,所述电子设备向音箱发送第一播放指令之前,还包括:所述电子设备获取所述音箱的中心的初始位置和所述多个用户所在的位置;所述电子设备根 据所述多个用户所在的位置确定所述多个用户的中心位置;所述电子设备根据所述初始位置和所述多个用户的中心位置计算所述音箱相对于所述多个用户的中心位置的理论甜点位置,当所述音箱位于所述理论甜点位置时,所述多个用户的中心位置与所述音箱的中心的连线与所述音箱的外放表面垂直,且所述外放表面朝向所述多个用户;所述电子设备获取微调角度;所述电子设备根据所述理论甜点位置和所述微调角度获取所述第一位置和所述第二位置。
本实施例与上述第一方面的区别在于,房间内的用户人数从一个变成多个,此时房间中由多个用户终端的麦克风分别接收定位音频,各个用户终端由于所在的位置不同,因此接收到定位音频的响度最大时对应的条形音箱的位置也各不相同。该情况下,找条形音箱的目标位置所参考的是在各个采样时刻上,各个用户终端接收的条形音箱的响度之和。而获取理论甜点位置时,基于的用户所在的位置变成多个用户的中心位置。
本申请中条形音箱和电子设备相互配合,条形音箱一边从第一位置匀速转动到第二位置,一边播放定位音频,而电子设备根据接收的多个采样音频中找到响度之和最大时,条形音箱的位置,并控制条形音箱转到该位置,这样可以针对多个用户所在的位置,实现更精准的串扰消除,消除不同房间影响,增强声像效果,真实还原原始音效。
在一种可能的实现方式中,电子设备根据N个音箱的数量将空间划分为多个子空间,每个所述子空间对应一个所述音箱,N大于1的为正整数;所述电子设备分别向所述N个音箱发送第一播放指令,所述第一播放指令用于指示对应的所述音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;所述电子设备确定N个指示信息,所述N个指示信息和所述N个音箱对应,所述指示信息用于确定对应的所述音箱的目标位置;所述电子设备将所述N个指示信息分别发送给对应的所述音箱。
在一种可能的实现方式中,所述电子设备确定N个指示信息,包括:所述电子设备接收第i个形音箱播放的第一定位音频,所述第i个音箱是N个音箱的其中之一,1≤i≤N,所述第一音箱对应的子空间中只有一个第一用户;所述电子设备根据所述第一定位音频确定第一指示信息,所述第一指示信息用于确定所述第i个形音箱的第一目标位置,所述第一目标位置为在所述电子设备接收所述第一定位音频的过程中,接收的音频响度最大时所述第i个形音箱所在的位置。
在一种可能的实现方式中,所述电子设备分别向所述N个音箱发送第一播放指令之前,还包括:所述电子设备获取所述第i个形音箱的中心的第一初始位置和所述第一用户所在的位置;所述电子设备根据所述第一初始位置和所述第一用户所在的位置计算所述第i个音箱相对于所述用户所在的位置的第一理论甜点位置,当所述第i个音箱位于所述第一理论甜点位置时,所述第一用户所在的位置与所述第i个音箱的中心的连线与所述第i个音箱的外放表面垂直,且所述外放表面朝向所述第一用户;所述电子设备获取第一微调角度;所述电子设备根据所述第一理论甜点位置和所述第一微调角度获取所述第一音箱的所述第一位置和所述第二位置。
在一种可能的实现方式中,所述电子设备确定N个指示信息,包括:所述电子设备接收多个采集音频,所述多个采集音频是在第j个音箱播放第二定位音频的过程中,多个第二用户的电子设备的麦克风分别接收到的音频,所述第j个音箱是N个音箱的其中之一, 1≤j≤N,所述多个第二用户位于所述第j个音箱对应的子空间中;所述电子设备根据所述多个采集音频确定第二指示信息,所述第二指示信息用于确定所述第j个音箱的第二目标位置,所述第二目标位置为在所述多个第二用户的电子设备接收所述第二定位音频的过程中,接收的音频响度之和最大时所述第j个音箱所在的位置,所述第二目标位置为所述第一位置转动至所述第二位置过程中的一个位置。
在一种可能的实现方式中,所述电子设备分别向所述N个音箱发送第一播放指令之前,还包括:所述电子设备获取所述第j个音箱的中心点的第二初始位置和所述多个第二用户所在的位置;所述电子设备根据所述多个第二用户所在的位置确定所述多个第二用户的中心位置;所述电子设备根据所述第二初始位置和所述多个第二用户的中心位置计算所述第j个音箱相对于所述多个第二用户的中心位置的第二理论甜点位置,当所述第j个音箱位于所述第二理论甜点位置时,所述多个第二用户的中心位置与所述第j个音箱的中心的连线与所述第j个音箱的外放表面垂直,且所述外放表面朝向所述多个第二用户;所述电子设备获取第二微调角度;所述电子设备根据所述第二理论甜点位置和所述第二微调角度获取所述第j个音箱的所述第一位置和所述第二位置。
在一种可能的实现方式中,所述电子设备确定N个指示信息,包括:所述电子设备接收多个采集音频,所述多个采集音频是在第k个音箱播放第三定位音频的过程中,多个第三用户的电子设备的麦克风分别接收到的音频,所述第k个音箱是N个音箱的其中之一,1≤k≤N,所述第k个音箱对应的子空间中没有用户,所述多个第三用户是指所述空间中的所有用户;所述电子设备根据所述多个采集音频确定第三指示信息,所述第三指示信息用于确定所述第k个音箱的第三目标位置,所述第三目标位置为在所述多个第三用户的电子设备接收所述第三定位音频的过程中,接收的音频响度之和最大时所述第k个音箱所在的位置,所述第三目标位置为所述第一位置转动至所述第二位置过程中的一个位置。
在一种可能的实现方式中,所述电子设备分别向所述N个音箱发送第一播放指令之前,还包括:所述电子设备获取所述第k个音箱的第三初始位置和所述多个第三用户所在的位置;所述电子设备根据所述多个第三用户所在的位置确定所述多个第三用户的中心位置;所述电子设备根据所述第三初始位置和所述多个第三用户的中心位置计算所述第k个音箱相对于所述多个用户的中心位置的第三理论甜点位置,当所述第k个音箱位于所述第三理论甜点位置时,所述多个第三用户的中心位置与所述第k个音箱的中心的连线与所述第k个音箱的外放表面垂直,且所述外放表面朝向所述多个第三用户;所述电子设备获取第三微调角度;所述电子设备根据所述第三理论甜点位置和所述第三微调角度获取所述第k个音箱的所述第一位置和所述第二位置。
电子设备先根据条形音箱的个数对房间内的空间进行划分,每个条形音箱对应一个子空间,例如,如图15所示,有3个条形音箱,以位于中间的条形音箱的中心为顶点,将条形音箱前方水平方向空间可以按照水平方向上对180°的角平均划分的方式,划分成3个子空间,左侧子空间对应条形音箱1,其中有1个用户,中间子空间对应条形音箱2,其中有2个用户,右侧子空间对应条形音箱3,其中没有用户。即图15所示的场景中,三个条形音箱分别对应三个子空间,根据各个子空间中的用户数,三个条形音箱和用户数的关系分别是一对一、一对多以及一对空。
电子设备根据空间的划分结果,根据子空间中的用户人数,对每个条形音箱确定其目 标位置。
例如,针对只有一个用户的子空间,可以参照上述第一方面的方法确定对应的条形音箱的目标位置,进而确定其指示信息;针对有多个用户的子空间,可以参照上述第二方面的方法确定对应的条形音箱的目标位置,进而确定其指示信息,只是获取理论甜点位置时,基于的用户所在的位置变成该子空间中的所有用户的中心位置;针对没有用户的子空间,也可以参照上述第二方面的方法确定对应的条形音箱的目标位置,进而确定其指示信息,只是获取理论甜点位置时,基于的用户所在的位置变成房间中的所有用户的中心位置。
本申请中多个条形音箱和电子设备相互配合,多个条形音箱一边从第一位置匀速转动到第二位置,一边播放定位音频,而电子设备针对每个条形音箱,根据其所对应的子空间内用户的终端接收的采样音频中找到响度或响度之和最大时,条形音箱的位置,并控制条形音箱转到该位置,这样可以针对多个用户所在的位置,实现更精准的串扰消除,消除不同房间影响,增强声像效果,真实还原原始音效。
第三方面,本申请提供一种控制装置,包括:发送模块,用于向音箱发送第一播放指令,所述第一播放指令用于指示所述音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;接收模块,用于接收所述定位音频;处理模块,用于根据所述定位音频确定指示信息,所述指示信息用于确定所述音箱的目标位置,所述目标位置为在所述电子设备接收所述定位音频的过程中,接收的音频响度最大时所述音箱所在的位置,所述目标位置为所述音箱从所述第一位置转动至所述第二位置过程中的一个位置;所述发送模块,还用于将所述指示信息发送给所述音箱。
在一种可能的实现方式中,所述第一位置和所述第二位置之间的角度差与用户的双耳距离有关;或者,所述第一位置和所述第二位置之间的角度差与预设的微调范围相关。
在一种可能的实现方式中,所述指示信息还用于指示所述音箱从所述第二位置转到所述目标位置。
在一种可能的实现方式中,所述预设方向包括水平顺时针方向或者水平逆时针方向。
在一种可能的实现方式中,所述转动包括围绕所述音箱在竖直方向的转动轴匀速转动。
在一种可能的实现方式中,所述音箱的形状包括条形、方形或者环形。
在一种可能的实现方式中,所述处理模块,还用于获取所述音箱的中心的初始位置和用户所在的位置;根据所述初始位置和所述用户所在的位置计算所述音箱相对于所述用户的理论甜点位置,当所述音箱位于所述理论甜点位置时,所述用户所在的位置与所述音箱的中心的连线与所述音箱的外放表面垂直,且所述外放表面朝向所述用户;获取微调角度;根据所述理论甜点位置和所述微调角度获取所述第一位置和所述第二位置。
在一种可能的实现方式中,所述第一位置是所述音箱从所述理论甜点位置向水平顺时针方向转动所述微调角度的位置;所述第二位置是所述音箱从所述理论甜点位置向水平逆时针方向转动所述微调角度的位置。
在一种可能的实现方式中,所述处理模块,具体用于显示房间配置界面,所述房间配置界面用于模拟所述用户和所述音箱所在的空间;接收所述用户在所述房间配置界面上输入的第一虚拟位置,所述第一虚拟位置用于模拟所述初始位置;根据所述第一虚拟位置计算所述初始位置;接收所述用户在所述房间配置界面上输入的第二虚拟位置,所述第二虚拟位置用于模拟所述用户所在的位置;根据所述第二虚拟位置计算所述用户所在的位置。
在一种可能的实现方式中,所述处理模块,具体用于根据所述初始位置、所述用户所在的位置以及所述用户的双耳距离计算所述微调角度。
在一种可能的实现方式中,所述处理模块,具体用于显示精准甜点定位界面,所述精准甜点定位界面上包括用于设置微调角度的弹窗;接收所述用户在所述弹窗上输入的预设经验值;将所述微调角度的大小设置为预设经验值。
在一种可能的实现方式中,所述处理模块,具体用于从所述定位音频的起始接收时刻开始,以设定频率对接收的所述定位音频进行检测得到一个响度;当到达所述定位音频的结束接收时刻时,将得到的多个所述响度中的最大者对应的时刻与所述起始接收时刻之间的差值确定为目标时间;将所述目标时间确定为所述指示信息;或者,将所述目标时间和所述预设方向的反方向确定为所述指示信息;或者,将所述目标时间、所述预设方向的反方向以及微调角度确定为所述指示信息;或者,将所述预设方向的反方向和目标旋转角度确定为所述指示信息,所述目标旋转角度用于指示所述音箱从第二位置旋转到所述目标位置。
在一种可能的实现方式中,所述处理模块,具体用于对所述定位音频进行检测得到最大响度;将所述最大响度对应的时刻与所述定位音频的起始接收时刻之间的差值确定为目标时间;将所述目标时间确定为所述指示信息;或者,将所述目标时间和所述预设方向的反方向确定为所述指示信息;或者,将所述目标时间、所述预设方向的反方向以及微调角度确定为所述指示信息;或者,将所述预设方向的反方向和目标旋转角度确定为所述指示信息,所述目标旋转角度用于指示所述音箱从第二位置旋转到所述目标位置。
在一种可能的实现方式中,所述发送模块,还用于向所述音箱发送第二播放指令,所述第二播放指令用于指示所述音箱播放测试音频;所述接收模块,还用于接收采集音频,所述采集音频是在所述测试音频的播放过程中,用户所戴耳机的麦克风接收到的音频;所述处理模块,还用于根据所述采集音频和所述测试音频计算双耳房间脉冲响应BRIR;根据所述BRIR获取所述音箱的滤波器系数。
在一种可能的实现方式中,所述处理模块,还用于接收虚拟空间指令,所述虚拟空间指令包括听音空间;获取所述听音空间的传递函数;根据所述BRIR和所述听音空间的传递函数计算所述音箱的滤波器系数。
第四方面,本申请提供一种音频播放装置,包括:接收模块,用于接收来自电子设备的第一播放指令;处理模块,用于根据所述第一播放指令从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;所述接收模块,还用于接收来自所述电子设备的指示信息,所述指示信息用于确定目标位置,所述目标位置为在所述电子设备接收所述定位音频的过程中,接收的音频响度最大时所述音箱所在的位置,所述目标位置为所述音箱从所述第一位置转动至所述第二位置过程中的一个位置;所述处理模块,还用于根据所述指示信息从所述第二位置转动至所述目标位置。
在一种可能的实现方式中,所述第一位置和所述第二位置之间的角度差与用户的双耳距离有关;或者,所述第一位置和所述第二位置之间的角度差与预设的微调范围相关。
在一种可能的实现方式中,所述预设方向包括水平顺时针方向或者水平逆时针方向。
在一种可能的实现方式中,所述沿预设方向转动包括沿所述预设方向匀速转动。
在一种可能的实现方式中,所述音箱的形状包括条形、方形或者环形。
在一种可能的实现方式中,所述接收模块,还用于接收来自所述电子设备的理论甜点位置和微调角度,当所述音箱位于所述理论甜点位置时,用户所在的位置与所述音箱的中心的连线与所述音箱的外放表面垂直,且所述外放表面朝向所述用户;所述处理模块,还用于根据所述理论甜点位置和所述微调角度确定所述第一位置;转动至所述第一位置。
在一种可能的实现方式中,所述第一位置是所述音箱从所述理论甜点位置向水平顺时针方向转动所述微调角度的位置;所述第二位置是所述音箱从所述理论甜点位置向水平逆时针方向转动所述微调角度的位置。
第五方面,本申请提供一种控制装置,包括:发送模块,用于向第i个音箱发送第一播放指令,所述第一播放指令用于指示所述第i个音箱从第一位置沿预设方向匀速转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变,所述第i个音箱是N个音箱的其中之一,1≤i≤N,N大于1的为正整数;接收模块,用于接收混音信号,所述混音信号是所述N个音箱各自播放的定位音频混合而成的音频信号;处理模块,用于根据所述混音信号确定第i个指示信息,所述第i个指示信息用于确定所述第i个音箱的目标位置,所述第i个音箱的目标位置为在所述电子设备接收所述混音信号的过程中,接收的音频响度最大时对应的所述第i个音箱所在的位置;所述发送模块,还用于将所述第i个指示信息发送给所述第i个音箱。
在一种可能的实现方式中,所述预设方向包括水平顺时针方向或者水平逆时针方向。
在一种可能的实现方式中,所述处理模块,还用于获取所述第i个音箱的中心的初始位置和用户所在的位置;根据所述初始位置和所述用户所在的位置计算所述第i个音箱相对于所述用户所在的位置的理论甜点位置,当所述第i个音箱位于所述理论甜点位置时,所述用户所在的位置与所述第i个音箱的中心的连线与所述第i个音箱的外放表面垂直,且所述外放表面朝向所述用户;获取微调角度;根据所述理论甜点位置和所述微调角度获取所述第i个音箱的所述第一位置和所述第二位置。
在一种可能的实现方式中,所述第i个音箱的第一位置是所述第i个音箱从所述理论甜点位置向所述预设方向转动所述微调角度的位置;所述第i个音箱的第二位置是所述第i个音箱从所述理论甜点位置向所述预设方向的反方向转动所述微调角度的位置。
在一种可能的实现方式中,所述发送模块,还用于向音箱发送第一播放指令,所述第一播放指令用于指示所述音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;所述接收模块,还用于接收多个采集音频,所述多个采集音频是在所述定位音频的播放过程中,多个用户的终端的麦克风分别接收到的音频;所述处理模块,还用于根据所述多个采集音频确定指示信息,所述指示信息用于确定所述音箱的目标位置,所述目标位置为在所述多个用户的电子设备接收所述定位音频的过程中,接收的音频响度之和最大时所述音箱所在的位置,所述目标位置为所述第一位置转动至所述第二位置过程中的一个位置;所述发送模块,还用于将所述指示信息发送给所述音箱。
在一种可能的实现方式中,所述处理模块,还用于获取所述音箱的中心的初始位置和所述多个用户所在的位置;根据所述多个用户所在的位置确定所述多个用户的中心位置;根据所述初始位置和所述多个用户的中心位置计算所述音箱相对于所述多个用户的中心位置的理论甜点位置,当所述音箱位于所述理论甜点位置时,所述多个用户的中心位置与 所述音箱的中心的连线与所述音箱的外放表面垂直,且所述外放表面朝向所述用户;获取微调角度;根据所述理论甜点位置和所述微调角度获取所述第一位置和所述第二位置。
在一种可能的实现方式中,所述处理模块,还用于根据N个音箱的数量将空间划分为多个子空间,每个所述子空间对应一个所述音箱,N大于1的为正整数;所述发送模块,还用于分别向所述N个音箱发送第一播放指令,所述第一播放指令用于指示对应的所述音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;所述处理模块,还用于确定N个指示信息,所述N个指示信息和所述N个音箱对应,所述指示信息用于确定对应的所述音箱的目标位置;所述发送模块,还用于将所述N个指示信息分别发送给对应的所述音箱。
第六方面,本申请提供一种电子设备,包括:一个或多个处理器;存储器,用于存储一个或多个程序;当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现上述第一至二方面中任一项所述的方法。
第七方面,本申请提供一种电子设备,包括:一个或多个处理器;存储器,用于存储一个或多个程序;当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现上述第一方面中任一项所述的方法。
第八方面,本申请提供一种计算机可读存储介质,包括计算机程序,所述计算机程序在计算机上被执行时,使得所述计算机执行上述第一至二方面中任一项所述的方法。
第九方面,本申请提供一种计算机程序产品,所述计算机程序产品包括计算机程序代码,当所述计算机程序代码在计算机或处理器上运行时,使得计算机或处理器执行上述第一至二方面中任一项所述的方法。
附图说明
图1为本申请中的音频播放装置的一个示例性的结构图;
图2为本申请中的控制装置的一个示例性的结构图;
图3为本申请中的电子设备的一个示例性的示意图;
图4为本申请提供的音箱位置调节方法的过程400的一个示例性的流程图;
图5为本申请提供的音箱位置调节方法的过程500的一个示例性的流程图;
图6为本申请提供的音箱位置调节方法的过程600的一个示例性的流程图;
图7为本申请提供的音箱位置调节方法的过程700的一个示例性的流程图;
图8为本申请提供的渲染方法的过程800的一个示例性的流程图;
图9为本申请中的登录界面的一个示例性的示意图;
图10为本申请中的功能选择界面的一个示例性的示意图;
图11为本申请中的房间配置界面的一个示例性的示意图;
图12a~图12m为本申请中的精准甜点定位界面的几个示例性的示意图;
图13为本申请中的初始水平角度的一个示例性的示意图;
图14为本申请中的初始水平角度的另一个示例性的示意图;
图15为本申请中的初始水平角度的又一个示例性的示意图;
图16为本申请中的初始水平角度的再一个示例性的示意图;
图17a~图17d为本申请中的专属私人订制界面的几个示例性的示意图;
图18a~图18c为本申请中的虚空模式界面的几个示例性的示意图。
具体实施方式
为使本申请的目的、技术方案和优点更加清楚,下面将结合本申请中的附图,对本申请中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
本申请的说明书实施例和权利要求书及附图中的术语“第一”、“第二”等仅用于区分描述的目的,而不能理解为指示或暗示相对重要性,也不能理解为指示或暗示顺序。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元。方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
应当理解,在本申请中,“至少一个(项)”是指一个或者多个,“多个”是指两个或两个以上。“和/或”,用于描述关联对象的关联关系,表示可以存在三种关系,例如,“A和/或B”可以表示:只存在A,只存在B以及同时存在A和B三种情况,其中A,B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。“以下至少一项(个)”或其类似表达,是指这些项中的任意组合,包括单项(个)或复数项(个)的任意组合。例如,a,b或c中的至少一项(个),可以表示:a,b,c,“a和b”,“a和c”,“b和c”,或“a和b和c”,其中a,b,c可以是单个,也可以是多个。
图1为本申请中的音频播放装置的一个示例性的结构图,如图1所示,该音频播放装置包括底座、转台和条形音箱(soundbar),条形音箱通过磁吸结构或者直插结构设置于转台上,转台嵌于底座上。转台带动着条形音箱转动,既可以沿水平方向左右转动,又可以沿竖直方向上下转动。另外,转台还可以提供信号和供电。
上述音频播放装置是与视频播放装置(例如电视、电脑等)分开的独立个体,转动条形音箱时,视频播放装置不动。
需要说明的是,图1所示的音频播放装置仅作为示例描述本申请采用的音频播放装置的一个可能的实现方式,但其并不对音频播放装置构成限定。
例如,条形音箱可以设置于电视机的底部,安装在可旋转的底座上。如果要转动条形音箱,可以控制底座转动,进而带动条形音箱转动,而电视机无需转动。又例如,条形音箱可以设置于电视机的底部,与电视机一起均安装在可旋转的底座上。如果要转动条形音箱,可以控制底座转动,进而带动条形音箱和电视机一起转动。
基于上述可转动条形音箱的音频播放装置,本申请提供了一种音箱位置调节方法和音频渲染方法,以精准定位用户的位置,进而控制条形音箱转动方向,使得条形音箱播放的音频的听感最佳位置(甜点位)正好是用户所在的位置。
上述音箱位置调节方法和音频渲染方法可以应用于控制装置上,该控制装置可以设置于能与条形音箱通信(例如蓝牙连接)的电子设备上,该电子设备例如可以是手机、平板电脑或智能电视等。
图2为本申请中的控制装置的一个示例性的结构图,如图2所示,该控制装置中包括功能模块和数据库模块。其中,
功能模块包括接收模块、处理模块和发送模块。接收模块用于接收电子设备获取到的音频数据和指令。处理模块用于根据指令和音频数据进行计算和处理得到目标位置,进而计算音频滤波器系数,实现音频渲染。发送模块用于向条形音箱发送指令,以控制条形音箱转动至目标位置。
数据库模块用于存储历史甜点位的信息,包括甜点位的坐标,以及与其对应的目标水平角度和音频滤波器系数。当用户所在的位置与曾经计算过的甜点位一致时,可以直接从数据库模块中获取该甜点位的信息,这样可以减少计算量,提高甜点定位和音频渲染的效率。
需要说明的是,图2所示的控制装置的框架仅是一种示例,并不对本申请方法的执行主体构成限定。
图3为本申请中的电子设备的一个示例性的示意图,图3示出了电子设备为手机时的结构示意图。
如图3,手机300可以包括处理器310,外部存储器接口320,内部存储器321,通用串行总线(universal serial bus,USB)接口330,充电管理模块340,电源管理模块341,电池332,天线1,天线2,移动通信模块350,无线通信模块360,音频模块370,扬声器370A,受话器370B,麦克风370C,耳机接口370D,传感器模块380,按键390,马达391,指示器392,摄像头393,显示屏394,以及用户标识模块(subscriber identification module,SIM)卡接口395等。其中传感器模块380可以包括压力传感器380A,陀螺仪传感器380B,气压传感器380C,磁传感器380D,加速度传感器380E,距离传感器380F,接近光传感器380G,指纹传感器380H,温度传感器380J,触摸传感器380K,环境光传感器380L,骨传导传感器380M等。
可以理解的是,本实施例示意的结构并不构成对手机300的具体限定。在本申请另一些实施例中,手机300可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器310可以包括一个或多个处理单元,例如:处理器310可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器310中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器310中的存储器为高速缓冲存储器。该存储器可以保存处理器310刚用过或循环使用的指令或数据。如果处理器310需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器310的等待时间,因而提高了系统的效率。
本申请中,处理器310可以配合移动通信模块350或无线通信模块360实现上述控制装置的功能。可选的,处理器310还可以配合音频模块370和麦克风370C接收条形音箱播放的音频,进而实现上述控制装置的功能。
在一些实施例中,处理器310可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
I2C接口是一种双向同步串行总线,包括一根串行数据线(serial data line,SDA)和一根串行时钟线(derail clock line,SCL)。在一些实施例中,处理器310可以包含多组I2C总线。处理器310可以通过不同的I2C总线接口分别耦合触摸传感器380K,充电器,闪光灯,摄像头393等。例如:处理器310可以通过I2C接口耦合触摸传感器380K,使处理器310与触摸传感器380K通过I2C总线接口通信,实现手机300的触摸功能。
I2S接口可以用于音频通信。在一些实施例中,处理器310可以包含多组I2S总线。处理器310可以通过I2S总线与音频模块370耦合,实现处理器310与音频模块370之间的通信。在一些实施例中,音频模块370可以通过I2S接口向无线通信模块360传递音频信号,实现通过蓝牙耳机接听电话的功能。
PCM接口也可以用于音频通信,将模拟信号抽样,量化和编码。在一些实施例中,音频模块370与无线通信模块360可以通过PCM总线接口耦合。在一些实施例中,音频模块370也可以通过PCM接口向无线通信模块360传递音频信号,实现通过蓝牙耳机接听电话的功能。所述I2S接口和所述PCM接口都可以用于音频通信。
UART接口是一种通用串行数据总线,用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。在一些实施例中,UART接口通常被用于连接处理器310与无线通信模块360。例如:处理器310通过UART接口与无线通信模块360中的蓝牙模块通信,实现蓝牙功能。在一些实施例中,音频模块370可以通过UART接口向无线通信模块360传递音频信号,实现通过蓝牙耳机播放音乐的功能。
MIPI接口可以被用于连接处理器310与显示屏394,摄像头393等外围器件。MIPI接口包括摄像头串行接口(camera serial interface,CSI),显示屏串行接口(display serial interface,DSI)等。在一些实施例中,处理器310和摄像头393通过CSI接口通信,实现手机300的拍摄功能。处理器310和显示屏394通过DSI接口通信,实现手机300的显示功能。
GPIO接口可以通过软件配置。GPIO接口可以被配置为控制信号,也可被配置为数据信号。在一些实施例中,GPIO接口可以用于连接处理器310与摄像头393,显示屏394,无线通信模块360,音频模块370,传感器模块380等。GPIO接口还可以被配置为I2C接口,I2S接口,UART接口,MIPI接口等。
USB接口330是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。USB接口330可以用于连接充电器为手机300充电,也可以用于手机300与外围设备之间传输数据。也可以用于连接耳机,通过耳机播放音频。该接口还可以用于连接其他手机,例如AR设备等。
可以理解的是,本实施例示意的各模块间的接口连接关系,只是示意性说明,并不构 成对手机300的结构限定。在本申请另一些实施例中,手机300也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
充电管理模块340用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块340可以通过USB接口330接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块340可以通过手机300的无线充电线圈接收无线充电输入。充电管理模块340为电池332充电的同时,还可以通过电源管理模块341为手机供电。
电源管理模块341用于连接电池332,充电管理模块340与处理器310。电源管理模块341接收电池332和/或充电管理模块340的输入,为处理器310,内部存储器321,显示屏394,摄像头393,和无线通信模块360等供电。电源管理模块341还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块341也可以设置于处理器310中。在另一些实施例中,电源管理模块341和充电管理模块340也可以设置于同一个器件中。
手机300的无线通信功能可以通过天线1,天线2,移动通信模块350,无线通信模块360,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。手机300中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块350可以提供应用在手机300上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块350可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块350可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块350还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块350的至少部分功能模块可以被设置于处理器310中。在一些实施例中,移动通信模块350的至少部分功能模块可以与处理器310的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器370A,受话器370B等)输出声音信号,或通过显示屏394显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器310,与移动通信模块350或其他功能模块设置在同一个器件中。
无线通信模块360可以提供应用在手机300上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块360可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块360经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将 处理后的信号发送到处理器310。无线通信模块360还可以从处理器310接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在一些实施例中,手机300的天线1和移动通信模块350耦合,天线2和无线通信模块360耦合,使得手机300可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system,GPS),全球导航卫星系统(global navigation satellite system,GLONASS),北斗卫星导航系统(beidou navigation satellite system,BDS),准天顶卫星系统(quasi-zenith satellite system,QZSS)和/或星基增强系统(satellite based augmentation systems,SBAS)。
手机300通过GPU,显示屏394,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏394和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器310可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏394用于显示图像,视频等。显示屏394包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。在一些实施例中,手机300可以包括1个或N个显示屏394,N为大于1的正整数。
手机300可以通过ISP,摄像头393,视频编解码器,GPU,显示屏394以及应用处理器等实现拍摄功能。
ISP用于处理摄像头393反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度,肤色进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头393中。
摄像头393用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,手机300可以包括1个或N个摄像头393,N为大于1的正整数。
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当手机300在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。手机300可以支持一种或多种视频编解 码器。这样,手机300可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。
NPU为神经网络(neural-network,NN)计算处理器,通过借鉴生物神经网络结构,例如借鉴人脑神经元之间传递模式,对输入信息快速处理,还可以不断的自学习。通过NPU可以实现手机300的智能认知等应用,例如:图像识别,人脸识别,语音识别,文本理解等。
外部存储器接口320可以用于连接外部存储卡,例如Micro SD卡,实现扩展手机300的存储能力。外部存储卡通过外部存储器接口320与处理器310通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器321可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。内部存储器321可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储手机300使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器321可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。处理器310通过运行存储在内部存储器321的指令,和/或存储在设置于处理器中的存储器的指令,执行手机300的各种功能应用以及数据处理。
手机300可以通过音频模块370,扬声器370A,受话器370B,麦克风370C,耳机接口370D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块370用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块370还可以用于对音频信号编码和解码。在一些实施例中,音频模块370可以设置于处理器310中,或将音频模块370的部分功能模块设置于处理器310中。
扬声器370A,也称“喇叭”,用于将音频电信号转换为声音信号。手机300可以通过扬声器370A收听音乐,或收听免提通话。
受话器370B,也称“听筒”,用于将音频电信号转换成声音信号。当手机300接听电话或语音信息时,可以通过将受话器370B靠近人耳接听语音。
麦克风370C,也称“话筒”,“传声器”,用于将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风370C发声,将声音信号输入到麦克风370C。手机300可以设置至少一个麦克风370C。在另一些实施例中,手机300可以设置两个麦克风370C,除了采集声音信号,还可以实现降噪功能。在另一些实施例中,手机300还可以设置三个,四个或更多麦克风370C,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。
耳机接口370D用于连接有线耳机。耳机接口370D可以是USB接口330,也可以是3.5mm的开放移动手机平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口。
压力传感器380A用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器380A可以设置于显示屏394。压力传感器380A的种类很多,如电阻式压 力传感器,电感式压力传感器,电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。。
陀螺仪传感器380B可以用于确定手机300的运动姿态。
气压传感器380C用于测量气压。
磁传感器380D包括霍尔传感器。
加速度传感器380E可检测手机300在各个方向上(一般为三轴)加速度的大小。
距离传感器380F,用于测量距离。
接近光传感器380G可以包括例如发光二极管(LED)和光检测器,例如光电二极管。发光二极管可以是红外发光二极管。
环境光传感器380L用于感知环境光亮度。
指纹传感器380H用于采集指纹。
温度传感器380J用于检测温度。
触摸传感器380K,也称“触控器件”。触摸传感器380K可以设置于显示屏394,由触摸传感器380K与显示屏394组成触摸屏,也称“触控屏”。触摸传感器380K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。可以通过显示屏394提供与触摸操作相关的视觉输出。在另一些实施例中,触摸传感器380K也可以设置于手机300的表面,与显示屏394所处的位置不同。
骨传导传感器380M可以获取振动信号。
按键390包括开机键,音量键等。按键390可以是机械按键。也可以是触摸式按键。手机300可以接收按键输入,产生与手机300的用户设置以及功能控制有关的键信号输入。
马达391可以产生振动提示。马达391可以用于来电振动提示,也可以用于触摸振动反馈。
指示器392可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。
SIM卡接口395用于连接SIM卡。SIM卡可以通过插入SIM卡接口395,或从SIM卡接口395拔出,实现和手机300的接触和分离。手机300可以支持1个或N个SIM卡接口,N为大于1的正整数。SIM卡接口395可以支持Nano SIM卡,Micro SIM卡,SIM卡等。手机300通过SIM卡和网络交互,实现通话以及数据通信等功能。在一些实施例中,手机300采用eSIM,即:嵌入式SIM卡。eSIM卡可以嵌在手机300中,不能和手机300分离。
可以理解的是,本实施例示意的结构并不构成对电子设备的具体限定。在本申请另一些实施例中,电子设备可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
图4为本申请提供的音箱位置调节方法的过程400的一个示例性的流程图。过程400可以由图3所示的电子设备和条形音箱共同执行。过程400描述为一系列的步骤或操作,应当理解的是,过程400可以以各种顺序执行和/或同时发生,不限于图4所示的执行顺序。过程400可以包括:
S401、电子设备向条形音箱发送第一播放指令。
在音箱位置调节方法开始之前,用户可以通过安装于电子设备上的应用程序(application,APP)提供的交互界面,发出甜点定位指令。基于该指令,电子设备开始执行音箱位置调节方法的步骤,首先就是向条形音箱发送第一播放指令。第一播放指令用于指示条形音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频。可选的,预设方向包括水平顺时针方向或者水平逆时针方向。可选的,沿预设方向转动包括沿预设方向匀速转动。
可选的,音箱的形状包括条形、方形或者环形等,本申请对音箱的形状不做具体限定。下文以条形音箱(soundbar)为例进行描述,应当理解的,本申请提供的音箱位置调节方法还可以应用于对方形音箱、环形音箱等音箱的位置调节。
定位音频是符合设定条件的全频带音频,例如,定位音频可以是声压级不小于65dB且信噪比不小于20dB的全频带音频,包括白噪声、粉噪声或扫频信号。该定位音频在播放时的响度稳定不变。
可选的,条形音箱的位置可以通过条形音箱与墙之间的第一夹角的角度表示。当条形音箱与墙平行时,第一夹角的角度为0°;条形音箱从角度0°开始逆时针转动,当转到垂直于墙时,第一夹角的角度为90°,转动过程中第一夹角的角度变化为从0°到90°;条形音箱从角度0°开始顺时针转动,当转到垂直于墙时,第一夹角的角度为-90°,转动过程中第一夹角的角度变化为从0°到-90°。可见,第一夹角的开口向左时,第一夹角的角度值为正,第一夹角的开口向右时,第一夹角的角度值为负。
可选的,条形音箱的位置也可以通过条形音箱的中心的垂直线和墙的垂直线之间的第二夹角的角度表示。当条形音箱与墙平行时,条形音箱的中心的垂直线和墙的垂直线平行或者重合,此时第二夹角的角度为0°;条形音箱从角度0°开始逆时针转动,当转到垂直于墙时,条形音箱的中心的垂直线和墙的垂直线相互垂直,此时第二夹角的角度为90°,转动过程中第二夹角的角度变化为从0°到90°;条形音箱从角度0°开始顺时针转动,当转到垂直于墙时,条形音箱的中心的垂直线和墙的垂直线相互垂直,此时第二夹角的角度为-90°,转动过程中第二夹角的角度变化为从0°到-90°。可见,条形音箱的中心的垂直线位于墙的垂直线的右侧时,第二夹角的角度值为正,条形音箱的中心的垂直线位于墙的垂直线的左侧时,第二夹角的角度值为负。
因此,第一位置和第二位置均可以采用上述第一夹角或者第二夹角的角度值表示,而条形音箱从第一位置匀速转动至第二位置,可以描述为条形音箱从第一角度匀速转动至第二角度,第一角度和第二角度分别是第一夹角的两个角度值,或者,第一角度和第二角度分别是第二夹角的两个角度值。
在一种可能的实现方式中,电子设备向条形音箱发送第一播放指令之前可以先获取条形音箱的中心的初始位置和用户所在的位置,根据初始位置和用户所在的位置计算条形音箱相对于用户所在的位置的理论甜点位置,再获取微调角度,然后根据理论甜点位置和微调角度获取第一位置和第二位置。
当条形音箱位于理论甜点位置时,用户所在的位置与条形音箱的中心的连线与条形音箱的外放表面垂直,且外放表面朝向用户。条形音箱的外放表面是指条形音箱的外放所在面的表面。通常外放设置于音箱的一个面上,那么此时外放表面是指该面。也有音箱的外放设置于音箱的多个面上,那么此时的外放表面是指音箱面对用户的一个面。
第一位置是条形音箱从理论甜点位置向预设方向转动微调角度的位置;第二位置是条形音箱从理论甜点位置向预设方向的反方向转动微调角度的位置。
本申请可以通过APP提供的交互界面(例如房间配置界面,可参见下文图11的描述),用户在该界面上输入第一虚拟位置,该第一虚拟位置用于模拟条形音箱的中心在房间中的位置,基于第一虚拟位置可以计算得到条形音箱的中心的初始位置,该初始位置可以以坐标的形式表示。用户也可以在上述交互界面上输入第二虚拟位置,该第二虚拟位置用于模拟用户在房间中的位置,基于第二虚拟位置可以计算得到用户所在的位置,该用户所在的位置也可以以坐标的形式表示。
例如,可以根据公式(1)~(3)获取条形音箱的理论甜点位置:
Figure PCTCN2021116239-appb-000013
其中,d表示用户所在的位置和条形音箱的中心之间的直线距离,(x c,y c)表示用户所在的位置,(x s0,y s0)表示条形音箱的中心的初始位置。
h=|y c-y s0|     (2)
其中,h表示用户所在的位置和条形音箱的中心之间的垂直距离。
Figure PCTCN2021116239-appb-000014
其中,A表示条形音箱的理论甜点位置对应的角度值。例如,如图13所示,条形音箱发生转动之前,对应于上述第二夹角的角度为A。而甜点定位的目的是让条形音箱的中心和用户所在的位置之间的连线垂直于条形音箱的外放表面,因此条形音箱需要顺时针转动角度A才能达到该目的,角度A便是对应于条形音箱的理论甜点位置。
但是由于用户所在的位置是用户在交互界面上输入的,该位置可能与用户的实际位置之间存在误差,因此需要在理论甜点位置的基础上微调条形音箱的位置,以确定出精确的目标位置。
如图13所示,微调角度θ对应的夹角的一条边是用户所在的位置和条形音箱的中心之间的连线。通过公式(4)计算得到微调角度θ:
Figure PCTCN2021116239-appb-000015
其中,w表示二倍的双耳距离,w可以采用预先设定的固定值,也可以由用户预先设置。
可选的,微调角度θ也可以由用户在交互界面(例如精准甜点定位界面,可参见下文图12k)直接输入。
可选的,对应于第一位置的第一角度可以是A-θ,对应于第二位置的第二角度可以是A+θ;或者,对应于第一位置的第一角度可以是A+θ,对应于第二位置的第二角度可以是A-θ。
在一种可能的实现方式中,当根据条形音箱的中心的初始位置和用户所在的位置已经满足条形音箱的中心和用户所在的位置之间的连线垂直于条形音箱的外放表面的目的时,就没有必要再进行甜点定位,因此也可以在甜点定位之前,先基于该原则,根据条形音箱的中心的初始位置和用户所在的位置确定是否需要进行甜点定位,如果需要,则开始甜点定位的过程。
S402、条形音箱根据第一播放指令从第一位置沿预设方向转动至第二位置,并在转动 的过程中播放定位音频。
条形音箱收到第一播放指令后,从第一播放指令中获取第一位置和第二位置,按照预先设定的转动方向,例如从A-θ到A+θ,或从A+θ到A-θ,一边转动一边播放定位音频,例如预先录好的雨声。
S403、电子设备接收定位音频。
电子设备上的麦克风接收定位音频。
S404、电子设备根据定位音频确定指示信息。
条形音箱是一边转动一边播放定位音频,因此电子设备的麦克风收到的定位音频可能存在响度差异,即条形音箱转动的位置远离电子设备时,电子设备接收的定位音频的响度变小,而条形音箱转动的位置趋近电子设备时,电子设备接收的定位音频的响度变大。微调的目的就是在找到电子设备接收的定位音频的响度最大时,条形音箱的位置。由于响度大小是由用户的电子设备检测出来的,因此条形音箱处于该位置时可以认为条形音箱的甜点位精准的落在用户所在的位置。
在一种可能的实现方式中,电子设备可以从定位音频的起始接收时刻开始,每间隔一段设定时间对设定时间内接收的定位音频进行检测得到一个响度。当到达定位音频的结束接收时刻时,电子设备将得到的多个响度中的最大者对应的设定时间的结束时刻与起始接收时刻之间的差值确定为目标时间。电子设备可以将接收定位音频和检测响度同步进行。
在一种可能的实现方式中,电子设备可以对定位音频进行检测得到最大响度,然后将最大响度对应的时刻与定位音频的起始接收时刻之间的差值确定为目标时间。电子设备也可以接收完全部定位音频后,对整段定位音频进行检测。
根据公式(5)或(6)可以计算得到条形音箱的目标位置对应的角度值:
当第一角度为A-θ,第二角度为A+θ时,根据公式(5)计算得到目标位置对应的角度值B:
B=(A-θ)+vt     (5)
由于播放定位音频结束时,条形音箱转到了第二位置(对应的第二角度为A+θ),因此条形音箱要转动到目标位置(对应的角度为B),是从第二位置反向转动,即从角度A+θ转动至角度B,根据公式(5)可以计算得到条形音箱需转动的角度大小为β=2θ-vt。
当第一角度为A+θ,第二角度为A-θ时,根据公式(6)计算得到目标位置对应的角度值B:
B=(A+θ)-vt     (6)
其中,v表示条形音箱的转动速度,该转动速度可以预先设定,t表示目标时间。
由于播放定位音频结束时,条形音箱转到了第二位置(对应的第二角度为A-θ),因此条形音箱要转动到目标位置(对应的角度为B),是从第二位置反向转动,即从角度A-θ转动至角度B,根据公式(6)可以计算得到条形音箱需转动的角度大小为β=2θ-vt。
由此可见,基于上述方法得到的目标时间,电子设备可以采用以下几种方式确定指示信息,进而条形音箱根据该指示信息获取需转动的角度大小β=2θ-vt:
(1)电子设备将目标时间确定为指示信息。
在条形音箱中,上述公式中的微调角度θ可以在之前与电子设备的交互信息中获取,此处不再赘述;转动速度可以是预先设置的。目标时间可以从指示信息中获取。转动方向 也可以是预先设置的。因此条形音箱可以基于这些信息计算得到需转动的角度大小β。
(2)电子设备将目标时间和预设方向的反方向确定为指示信息。
在条形音箱中,上述公式中的微调角度θ可以在之前与电子设备的交互信息中获取,此处不再赘述;转动速度可以是预先设置的。目标时间和转动方向(预设方向的反方向)可以从指示信息中获取。因此条形音箱可以基于这些信息计算得到需转动的角度大小β。
(3)电子设备将目标时间、预设方向的反方向以及微调角度确定为指示信息。
在条形音箱中,上述公式中的微调角度θ和目标时间,以及转动方向(预设方向的反方向)均可以从指示信息中获取。转动速度可以是预先设置的。因此条形音箱可以基于这些信息计算得到需转动的角度大小β。
(4)电子设备将预设方向的反方向和目标旋转角度确定为指示信息。
在条形音箱中,转动方向(预设方向的反方向)可以从指示信息中获取。此时条形音箱不需要在通过上述公式计算需转动的角度大小β,该角度也可以从指示信息中获取。
需要说明的是,定位音频的时长T、目标时间t、微调角度θ以及转动速度v相互约束,即微调的结果得到了目标位置对应的角度值B,而目标位置对应的角度值B要落在角度范围[A-θ,A+θ]内,因此,-θ≤vt≤θ,t≤T。
因此,电子设备确定的指示信息中可以包括目标位置对应的角度值B,或者可以包括目标时间t,这两个值均可以使得条形音箱确定出其目标位置。
S405、电子设备将指示信息发送给条形音箱。
S406、条形音箱根据指示信息转动至目标位置。
指示信息还具有指示条形音箱从第二位置转到目标位置的功能,因此条形音箱接收到指示信息后,先确定目标位置,然后从当前的位置转到目标位置。
例如,在微调过程中,条形音箱从A-θ对应的位置转到A+θ对应的位置,那么收到指示信息后,条形音箱从A+θ对应的位置开始反向转动角度(2θ-vt)到达B对应的位置。
又例如,在微调过程中,条形音箱从A+θ对应的位置转到A-θ对应的位置,那么收到指示信息后,条形音箱从A-θ对应的位置开始反向转动角度(2θ-vt)到达B对应的位置。
本申请中条形音箱和电子设备相互配合,条形音箱一边从第一位置匀速转动到第二位置,一边播放定位音频,而电子设备根据接收的定位音频找到响度最大时,条形音箱的位置,并控制条形音箱转到该位置,这样可以针对用户所在的位置,实现更精准的串扰消除,消除不同房间影响,增强声像效果,真实还原原始音效。
图5为本申请提供的音箱位置调节方法的过程500的一个示例性的流程图。过程500可以由图3所示的电子设备和条形音箱共同执行。过程500描述为一系列的步骤或操作,应当理解的是,过程500可以以各种顺序执行和/或同时发生,不限于图5所示的执行顺序。过程500可以包括:
S501、电子设备向条形音箱发送第一播放指令。
S501可以参照图4所示实施例的S401,此处不再赘述。
S502、条形音箱根据第一播放指令从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频。
S501~S502可以参照图4所示实施例的S401~S401,此处不再赘述。区别在于,在涉及用户所在的位置的计算中,将用户所在的位置变为多个用户的中心位置。
S503、用户终端接收定位音频。
本实施例与图4所示实施例的区别在于,房间内的用户人数从一个变成多个,此时房间中由多个用户终端的麦克风分别接收定位音频,各个用户终端由于所在的位置不同,因此接收到定位音频的响度最大时对应的条形音箱的位置也各不相同。该情况下,找条形音箱的目标位置所参考的是在各个采样时刻上,各个用户终端接收的条形音箱的响度之和。
S504、电子设备接收多个采集音频数据。
用户终端将接收的定位音频存储下来,并在接收完后以音频数据的形式发送给电子设备,由电子设备实施计算。
S505、电子设备根据多个采集音频确定指示信息。
S505可以参照图4所示实施例的S404,区别在于确定目标时间时,从基于最大响度的时刻变为基于最大响度之和的时刻。
S506、电子设备将指示信息发送给条形音箱。
S507、条形音箱根据指示信息转动至目标位置。
S506~S507可以参照图4所示实施例的S405~S406,此处不再赘述。
本申请中条形音箱和电子设备相互配合,条形音箱一边从第一位置匀速转动到第二位置,一边播放定位音频,而电子设备根据接收的多个采样音频中找到响度之和最大时,条形音箱的位置,并控制条形音箱转到该位置,这样可以针对多个用户所在的位置,实现更精准的串扰消除,消除不同房间影响,增强声像效果,真实还原原始音效。
图6为本申请提供的音箱位置调节方法的过程600的一个示例性的流程图。过程600可以由图3所示的电子设备和条形音箱共同执行。过程600描述为一系列的步骤或操作,应当理解的是,过程600可以以各种顺序执行和/或同时发生,不限于图6所示的执行顺序。过程600可以包括:
S601、电子设备根据多个条形音箱的数量将空间划分为多个子空间。
电子设备先根据条形音箱的个数对房间内的空间进行划分,每个条形音箱对应一个子空间,例如,如图15所示,有3个条形音箱,以位于中间的条形音箱的中心为顶点,将条形音箱前方水平方向空间可以按照水平方向上对180°的角平均划分的方式,划分成3个子空间,左侧子空间对应条形音箱1,其中有1个用户,中间子空间对应条形音箱2,其中有2个用户,右侧子空间对应条形音箱3,其中没有用户。即图15所示的场景中,三个条形音箱分别对应三个子空间,根据各个子空间中的用户数,三个条形音箱和用户数的关系分别是一对一、一对多以及一对空。
S602、电子设备分别向多个条形音箱发送第一播放指令。
S603、电子设备确定多个指示信息,多个指示信息和多个条形音箱对应。
电子设备根据空间的划分结果,根据子空间中的用户人数,对每个条形音箱确定其目标位置。
例如,图15中的左侧子空间,可以参照图4所示实施例的A402~S404确定条形音箱1的目标位置,进而确定其指示信息;图15中的中间子空间,可以参照图5所示实施例的A502~S505确定条形音箱2的目标位置,进而确定其指示信息,区别在于:多个用户只限于中间子空间内的2个用户;图15中的右侧子空间,也可以参照图5所示实施例的A502~S505确定条形音箱2的目标位置,进而确定其指示信息,区别在于:多个用户包括 左中右三个子空间内的所有用户。
S604、电子设备将多个指示信息分别发送给对应的条形音箱。
S605、条形音箱根据指示信息转动至目标位置。
S604~S605可以参照图4所示实施例的S405~S406,此处不再赘述。
本申请中多个条形音箱和电子设备相互配合,多个条形音箱一边从第一位置匀速转动到第二位置,一边播放定位音频,而电子设备针对每个条形音箱,根据其所对应的子空间内用户的终端接收的采样音频中找到响度或响度之和最大时,条形音箱的位置,并控制条形音箱转到该位置,这样可以针对多个用户所在的位置,实现更精准的串扰消除,消除不同房间影响,增强声像效果,真实还原原始音效。
图7为本申请提供的音箱位置调节方法的过程700的一个示例性的流程图。过程700可以由图3所示的电子设备和条形音箱共同执行。过程700描述为一系列的步骤或操作,应当理解的是,过程700可以以各种顺序执行和/或同时发生,不限于图7所示的执行顺序。过程700可以包括:
S701、电子设备分别向多个条形音箱发送第一播放指令。
可选的,该多个条形音箱排列成一排,且多个条形音箱的外放表面朝向用户。
S702、电子设备接收混音信号。
本实施例中由于条形音箱是多个,用户只有一个,因此电子设备收到的是多个条形音箱播放的定位音频的混合而成的混音信号。
S703、电子设备根据混音信号确定多个指示信息。
S703可以参照图4所示实施例的S404,区别在于:电子设备针对多个条形音箱中的每个条形音箱分别确定其指示信息,每次计算中涉及到的位置包括单个条形音箱的中心的初始位置和用户所在的位置。
S704、电子设备将多个指示信息分别发送给对应的条形音箱。
S705、条形音箱根据指示信息转动至目标位置。
S704~S705可以参照图4所示实施例的S405~S406,此处不再赘述。
本申请中多个条形音箱和电子设备相互配合,多个条形音箱一边从第一位置匀速转动到第二位置,一边播放定位音频,而电子设备根据接收的定位音频的混音信号找到响度最大时,各个条形音箱的位置,并控制各个条形音箱转到各自对应的位置,这样可以针对用户所在的位置,实现更精准的串扰消除,消除不同房间影响,增强声像效果,真实还原原始音效。
图8为本申请提供的渲染方法的过程800的一个示例性的流程图。过程800可以由图3所示的电子设备和条形音箱共同执行。过程800描述为一系列的步骤或操作,应当理解的是,过程800可以以各种顺序执行和/或同时发生,不限于图8所示的执行顺序。过程800可以包括:
S801、电子设备向条形音箱发送第二播放指令。
测试音频是符合设定条件的全频带音频,例如,测试音频可以是声压级不小于65dB且信噪比不小于20dB的全频带音频,包括白噪声、粉噪声或扫频信号。
S802、条形音箱根据第二播放指令播放测试音频。
S803、用户所戴耳机的麦克风接收测试音频。
本实施例中条形音箱播放的测试音频由用户所戴的耳机的麦克风接收。耳机收到该测试音频后,将其存储下来以音频数据的形式发送给电子设备。
S804、电子设备接收采集音频数据。
S805、电子设备根据采集音频和测试音频计算BRIR。
电子设备可以通过公式(7)计算BRIR:
Figure PCTCN2021116239-appb-000016
其中,0≤p<P,P表示用户的人数;0≤k<K,K表示扬声器单元的个数;i为0对应左耳,i为1对应右耳;f表示频率;H 2p+i,k(f)表示第p个用户对应于第k个扬声器单元的BRIR;Y i,p,k(f)表示第p个用户的耳机对应于第k个扬声器单元的回采音频;T(f)表示测试音频。
S806、电子设备根据BRIR获取条形音箱的滤波器系数。
电子设备通过公式(8)计算滤波器系数:
C(f)=(H(f) HH(f)+βI k(f)) -1H(f) HD(f)      (8)
其中,H(f)∈C K×K,表示由公式(7)计算得到的BRIR作为元素所组成的矩阵,该矩阵涵盖所有用户分别对应于所有扬声器单元的房间传递函数;* H表示共轭矩阵;I k(f)∈C K×K,表示单位矩阵;D(f)∈R 2P×R,表示理想传递函数,R表示声道数,若音频为立体声,则R=2,
Figure PCTCN2021116239-appb-000017
S807、电子设备向条形音箱发送滤波器系数。
S808、条形音箱根据滤波器系数对音频进行处理。
条形音箱根据更新后的滤波器系数,通过公式(9)对条形音箱播放的音频进行处理:
X(f)=C(f)S(f)      (9)
其中,X(f)表示处理后的音频,S(f)表示条形音箱播放的音频,C(f)表示滤波器系数。
上述滤波器系数是在精准甜点定位后得到的,因此可以针对用户所在的位置,实现更精准的串扰消除,消除不同房间影响,达到增强声像效果,真实还原原始音效。
在一种可能的实现方式中,电子设备可以接收虚拟空间指令,该虚拟空间指令包括用户在虚空模式界面选择的听音空间,获取该听音空间的传递函数,然后根据BRIR获取条形音箱的滤波器系数。
例如,听音空间是“金色大厅”。电子设备通过公式(10)计算得到滤波器系数:
Figure PCTCN2021116239-appb-000018
其中,H(f)∈C K×K,表示由公式(7)计算得到的BRIR作为元素所组成的矩阵,该矩阵涵盖所有用户分别对应于所有条形音箱的房间传递函数;* H表示共轭矩阵;I k(f)∈C K×K,表示单位矩阵;
Figure PCTCN2021116239-appb-000019
表示听音空间(例如金色大厅)的传递函数,R表示声道数,若音频为立体声,则R=2,
Figure PCTCN2021116239-appb-000020
Figure PCTCN2021116239-appb-000021
表示第p个用户选择的听音空间。
条形音箱根据更新后的滤波器系数,通过公式(11)对条形音箱播放的音频进行处理:
Figure PCTCN2021116239-appb-000022
其中,
Figure PCTCN2021116239-appb-000023
表示处理后的音频,S(f)表示条形音箱播放的音频,
Figure PCTCN2021116239-appb-000024
表示滤波器系数。
上述滤波器系数是在专属私人订制后得到的,因此既可以针对用户所在的位置,实现更精准的串扰消除,消除不同房间影响,达到增强声像效果,真实还原原始音效,又可以在用户所在的位置渲染声场,给用户身临其境的体验。
以下通过具体的实施例对本申请提供的音箱位置调节方法和音频渲染方法进行描述。
真实房间中有一个或多个用户,该房间例如是客厅、卧室、会议室、电影院、剧场等。每个用户持有一个电子设备,该电子设备例如可以是手机、平板电脑等。另有管理员,该管理员可以是多个用户的其中之一,则该管理员也持有前述电子设备;管理员也可以是其他人,则该管理员持有控制装置,该控制装置可以是前述电子设备,也可以是计算机,还可以是视频播放设备,该视频播放设备包括条形音箱。
一、登录
所有人(包括一个或多个用户,以及管理员)持有的设备上均安装应用程序(application,APP)(例如华为智慧屏)。该APP分为“普通用户”和“管理员”两种模式,所有人可以通过登录界面上的控件选择要进入的模式。图9为本申请中的登录界面的一个示例性的示意图,如图9所示,登录界面上除了用户名和密码的输入区域外,还包括“普通用户”控件和“管理员”控件。如果真实房间中只有一个用户,该用户即为管理员,点击“管理员”控件;如果真实房间中有多个用户,该多个用户的其中之一为管理员,点击“管理员”控件,其他用户点击“普通用户”控件;或者,该多个用户均为普通用户,点击“普通用户”控件,另有一个管理员(该管理员可以不在同一房间内),点击“管理员”控件。
二、功能选择
所有人分别通过已注册的用户名/密码登录APP后,进入功能选择界面。APP提供了四个功能,包括房间配置、精准甜点定位、专属私人订制和虚空模式。图10为本申请中的功能选择界面的一个示例性的示意图,如图10所示,在功能选择界面上显示了“房间配置”、“精准甜点定位”、“专属私人订制”和“虚空模式”四个控件。
三、房间配置
点击功能选择界面上的“房间配置”控件,APP显示房间配置界面。图11为本申请中的房间配置界面的一个示例性的示意图,如图11所示,房间配置界面包括模拟房间区域和输入区域。
可选的,图11所示的房间配置界面可以只显示于“管理员”模式的APP中。只有“管理员”模式的APP可以让管理员布置模拟房间区域,输入房间的长度和宽度。此时“管理员”模式的APP在管理员完成设置后,可以将通过房间配置界面获取到的输入信息发送给“普通用户”模式的APP,使得“普通用户”模式的APP也可以显示模拟房间区域及其中的布置。“管理员”模式的APP和“普通用户”模式的APP均处于同一局域网中。
可选的,图11所示的房间配置界面既可以显示于“管理员”模式的APP中,又可以显示于“普通用户”模式的APP中,这样任何使用APP的人都可以布置模拟房间区域,输入房间的长度和宽度。此时APP在完成设置后,可以将通过房间配置界面获取到的输入信息发送给“管理员”模式的APP,使得“管理员”模式的APP对这些输入信息进行整合,明确 同一家电(例如条形音箱)的位置,以消除不同人的输入误差。
房间配置界面中的输入区域用于输入真实房间的长度(例如6m)和宽度(例如4m),模拟房间区域用于让管理员或用户将真实房间的布置在该区域中模拟出来。例如,客厅中,带条形音箱的电视放在电视墙旁边,沙发放在电视的正对面。那么按照这个布置,管理员或用户可以在模拟房间区域的上方侧边附近用图标标识电视(亦是标识条形音箱),该图标可以是电视的2D或3D模型,也可以是示意图,还可以是一个点(该点对应条形音箱的中心);在模拟房间区域的下方侧边附近、正对电视的位置用图标标识沙发,该图标同样可以是沙发的2D或3D模型,也可以是条状示意图,还可以是一个点(该点对应沙发的中心)。例如,用户点击电视,APP在模拟房间区域显示一个电视的示意图,用户将该电视的示意图拖动至模拟房间区域中与电视的实际位置对应的位置上;用户点击沙发,APP在模拟房间区域显示一个沙发的示意图,用户将该沙发的示意图拖动至模拟房间区域中与沙发的实际位置对应的位置上。
需要说明的是,本申请对模拟房间区域中针对真实家具的标识方式不做具体限定。而且模拟房间区域中除条形音箱的图标数量、位置必须和真实房间中的条形音箱的数量、位置保持一致外,其他家具的图标是否在模拟房间区域中显示,均取决于用户的操作,例如用户可以在模拟房间区域中放置标识沙发的图标,也可以不放置标识沙发的图标。
四、精准甜点定位
点击功能选择界面上的“精准甜点定位”控件,APP显示精准甜点定位界面。图12a~图12m为本申请中的精准甜点定位界面的几个示例性的示意图。精准甜点定位界面包括模拟房间区域,该区域中显示的图标是用户在房间配置界面中设置的。
场景一、房间中有一个条形音箱和一个用户
上述用户亦即管理员,管理员持有控制装置,该控制装置例如是手机,手机上安装的APP进入“管理员”模式。
如图12a所示,用户根据自己在房间中的位置,在模拟房间区域上点击对应的位置,APP在该对应的位置显示一个标识(例如笑脸),表示用户在此处。
真实房间的坐标系为第一坐标系,模拟房间的坐标系为第二坐标系,两个坐标系的比例为100:1,原点(0,0)均为条形音箱附近的墙(电视墙)的左端点,从原点向右为x轴正向,从原点向下为y轴正向。
例如,房间实际长6米、宽4米,模拟房间区域的长0.06米、宽0.04米。如果条形音箱的中心在上方侧边的正中间,即在第二坐标系下,条形音箱的中心的坐标为(0.03,0),可以计算得到在第一坐标系下,条形音箱的中心的坐标为(3,0);如果沙发的中心在下方侧边的正中间,即在第二坐标系下,沙发的中心的坐标为(0.03,0.04),可以计算得到在第一坐标系下,沙发的中心的坐标为(3,4)。
因此,基于条形音箱的中心和用户分别在模拟房间区域内的位置,根据模拟房间区域的边长和房间的实际长宽之间的比例关系,APP可以得到在第一坐标系下,用户所在的位置的坐标(x c,y c)和条形音箱的中心的坐标(x s0,y s0)。
APP根据用户所在的位置的坐标(x c,y c)和条形音箱的中心的坐标(x s0,y s0)计算初始水平角度A,该初始水平角度A对应的夹角的顶点为条形音箱的中心,该夹角的一条边垂直于条形音箱,该夹角的另一条边是用户所在的位置和条形音箱的中心之间的连线。需要说明 的是,当用户所在的位置和条形音箱的中心之间的连线位于垂直于条形音箱的边的右侧时,初始水平角度A的值为正;当用户所在的位置和条形音箱的中心之间的连线位于垂直于条形音箱的边的左侧时,初始水平角度A的值为负。
例如,如图13所示,可以根据以下方法计算初始水平角度A:
根据公式(1)计算用户所在的位置和条形音箱的中心之间的直线距离d:
Figure PCTCN2021116239-appb-000025
再根据公式(2)计算用户所在的位置和条形音箱的中心之间的垂直距离h:
h=|y c-y s0|     (2)
然后根据上述直线距离d和垂直距离h,通过公式(3)计算得到初始水平角度A:
Figure PCTCN2021116239-appb-000026
微调角度θ对应的夹角的一条边是用户所在的位置和条形音箱的中心之间的连线。例如,如图13所示,可以根据上述直线距离d和垂直距离h,通过公式(4)计算得到微调角度θ:
Figure PCTCN2021116239-appb-000027
其中,w表示二倍的双耳距离,w可以采用预先设定的固定值,也可以由用户预先设置。
用户点击精准甜点定位界面上的“确定”控件,APP将计算得到的初始水平角度A和微调角度θ以指令形式发送给条形音箱。
条形音箱收到该指令后,可以转动至角度A-θ或者A+θ。
如图12b所示,用户手持手机在房间中的上述位置(与图12a中的笑脸对应的位置)站定不动,点击精准甜点定位界面上的“微调”控件,APP向条形音箱发送指示微调开始的播放指令。可选的,APP可以在模拟房间区域中显示转动了A-θ或者A+θ后的条形音箱。
条形音箱收到播放指令后,开始播放预先获取并存储在本地的定位音频(例如雨声),并在播放定位音频的过程中,以速度v从第一角度匀速转动至第二角度。其中,第一角度和第二角度分别为A-θ和A+θ的其中之一,即第一角度是A-θ,第二角度是A+θ,或者第一角度是A+θ,第二角度是A-θ。
用户的手机的麦克风接收到回采音频。
在一种可能的实现方式中,APP可以从回采音频的起始时刻开始,每间隔一段设定时间对设定时间内接收的回采音频进行检测得到一个响度。当到达回采音频的结束时刻时,APP将得到的多个响度中的最大者对应的设定时间的结束时刻与起始接收时刻之间的差值确定为目标时间。例如,APP将回采音频的起始时刻记为0ms,初始化最大响度记为0;间隔一段设定时间(例如1ms)后的时刻记为1ms,对该1ms内接收的回采音频进行检测得到对应于时刻1ms的一个响度(例如对该1ms内接收的回采音频采样检测,得到多个响度值,然后对该多个响度值求平均),将最大响度记为时刻1ms的响度;再间隔1ms后的时刻记为2ms,对该1ms内接收的回采音频进行检测得到对应于时刻2ms的一个响度,将时刻2ms的响度与当前的最大响度比较,最大响度取较大者。以此类推,直到到达回采音频的结束时刻(例如时刻10ms)时,APP获取最大响度对应的时刻(例如时刻3ms),计算时刻3ms与起始接收时刻0ms之间的差值确定为目标时间。
在一种可能的实现方式中,APP对回采音频进行检测得到最大响度,将最大响度对应的时刻与回采音频的起始时刻之间的差值确定为目标时间。例如,APP一共接收到10ms的回采音频,对该回采音频进行采样检测,得到在多个时刻的响度,例如1ms的响度、2ms的响度、…、10ms的响度,对这些响度比较取最大者,然后将该最大者对应的时刻(例如3ms)与起始接收时刻0ms之间的差值确定为目标时间。
APP可以根据上述目标时间、初始水平角度A和微调角度θ计算目标水平角度B。而该计算采用的公式和条形音箱的转动方向有关:
当第一角度为A-θ,第二角度为A+θ时,根据公式(5)计算得到目标水平角度B:
B=(A-θ)+vt     (5)
当第一角度为A+θ,第二角度为A-θ时,根据公式(6)计算得到目标水平角度B:
B=(A+θ)-vt     (6)
其中,v表示转动速度,t表示目标时间。
需要说明的是,回采音频的时长T、目标时间t、微调角度θ以及转动速度v相互约束,即微调的目的是为了得到目标水平角度B,而目标水平角度B要落在角度范围[A-θ,A+θ]内,因此,-θ≤vt≤θ,t≤T。
如图12c所示,APP得到目标水平角度B后,将目标水平角度B发送给条形音箱。可选的,APP可以在模拟房间区域中显示转动了目标水平角度B后的条形音箱,并在精准甜点定位界面上显示一个弹窗,该弹窗中显示“微调完成”的文字。
条形音箱收到目标水平角度B后,转动达到目标水平角度B,此时条形音箱的甜点位正是用户所在的位置。为达到该目的,条形音箱可以根据转动前的角度确定转动方向和转动角度。例如,微调时条形音箱从A-θ转动到A+θ,那么此时条形音箱从A+θ开始反向转动,转动角度为(A+θ)-B=2θ-vt;微调时条形音箱从A+θ转动到A-θ,那么此时条形音箱从A-θ开始反向转动,转动角度为B-(A-θ)=2θ-vt。
至此,精准甜点定位功能完成。此后,只要用户不移动位置,条形音箱播放的立体声(例如电视或电影的声音)便在用户所在的位置形成最佳听音效果。
场景二、房间中有一个条形音箱和多个用户
上述多个用户的其中之一为管理员,管理员持有控制装置,该控制装置例如是手机,管理员的手机上安装的APP进入“管理员”模式,除管理员外的其他用户持有电子设备,该电子设备例如也是手机,其他用户的手机上安装的APP进入“普通用户”模式。
如图12a所示,某个用户(上述多个用户中的任意一个)根据自己在房间中的位置,在模拟房间区域上点击对应的位置,该用户的APP在该对应的位置显示一个标识(例如笑脸),表示该用户在此处。该用户点击精准甜点定位界面上的“确定”控件,APP将该用户的标识的位置在第二坐标系下的坐标发送给管理员的APP。
上述多个用户均可以执行上述操作,因此该多个用户的APP均在模拟房间区域中显示一个标识(例如笑脸),表示对应的用户的位置,并且除管理员外的其他所有用户的APP均会将各自标识的位置在第二坐标系下的坐标发送给管理员的APP。
如图12d所示,管理员的APP除了显示管理员的标识,还会显示其他所有用户(例如用户1~用户3)的标识,即管理员的APP收到其他所有用户的APP发送的坐标后,在模拟房间区域中,与前述各个坐标对应的位置分别显示一个标识(例如笑脸)。
管理员的APP可以采用场景一中的公式(1)~(4)获取初始水平角度A和微调角度θ,区别在于:公式(1)和(2)中的坐标(x c,y c)表示多个用户的中心位置。此时
Figure PCTCN2021116239-appb-000028
Figure PCTCN2021116239-appb-000029
P表示多个用户的人数,(x i,y i)是多个用户中第i个用户所在位置的坐标,1≤i≤P。
可见,场景二下,初始水平角度A对应的夹角的顶点为条形音箱的中心,该夹角的一条边垂直于条形音箱,该夹角的另一条边是多个用户的中心位置和条形音箱的中心之间的连线,如图14所示。
管理员点击精准甜点定位界面上的“确定”控件,管理员的APP将计算得到的初始水平角度A和微调角度θ以指令形式发送给条形音箱。
条形音箱收到该指令后,可以转动至角度A-θ或者A+θ。
多个用户手持手机在房间中的选定位置(与图12a中的笑脸对应的位置)站定不动。如图12b所示,管理员点击精准甜点定位界面上的“微调”控件,管理员的APP向条形音箱发送指示微调开始的播放指令。可选的,多个用户的APP均可以在模拟房间区域中显示转动了A-θ或者A+θ后的条形音箱。
条形音箱收到播放指令后,开始播放预先获取并存储在本地的定位音频(例如雨声),并在播放定位音频的过程中,以速度v从第一角度匀速转动至第二角度。其中,第一角度和第二角度分别为A-θ和A+θ的其中之一,即第一角度是A-θ,第二角度是A+θ,或者第一角度是A+θ,第二角度是A-θ。
多个用户的手机的麦克风均接收到回采音频。可选的,除管理员外的其他所有用户的APP将各自获取的回采音频发送给管理员的APP,由管理员的APP对来自其他所有用户的APP的回采音频和管理员的手机的麦克风接收到回采音频进行检测,获取各个回采音频在各个采样时刻的响度,再计算每个采样时刻的响度之和,然后确定最大响度之和对应的采样时刻,进而得到目标时间。管理员的APP可以参照场景一的描述检测并获取回采音频的响度。可选的,多个用户的APP分别对接收的回采音频进行检测,获取各个采样时刻的响度,然后除管理员外的其他所有用户的APP将各自得到的各个采样时刻的响度发送给管理员的APP,由管理员的APP计算每个采样时刻的响度之和,然后确定最大响度之和对应的采样时刻,进而得到目标时间。多个用户的APP也可以参照场景一的描述检测并获取回采音频的响度。
管理员的APP可以采用场景一中的公式(5)~(6)计算目标水平角度B。
如图12c所示,管理员的APP得到目标水平角度B后,将目标水平角度B发送给条形音箱。可选的,管理员的APP可以在模拟房间区域中显示转动了目标水平角度B后的条形音箱,并在精准甜点定位界面上显示一个弹窗,该弹窗中显示“微调完成”的文字。
可选的,管理员的APP也可以将目标水平角度B发送给其他所有用户的APP,这样多个用户的APP均可以在模拟房间区域中显示转动了目标水平角度B后的条形音箱,并在精准甜点定位界面上显示一个弹窗,该弹窗中显示“微调完成”的文字。
条形音箱收到目标水平角度B后,转动达到目标水平角度B,此时条形音箱的甜点位是多个用户的中心位置。
至此,精准甜点定位功能完成。此后,只要多个用户不移动位置,条形音箱播放的立体声(例如电视或电影的声音)便在多个用户的中心位置形成最佳听音效果。
场景三、房间中有多个条形音箱和多个用户
上述多个用户持有电子设备,该电子设备例如是手机,该多个用户的手机上安装的APP进入“普通用户”模式,另有一管理员,管理员持有控制装置,该控制装置例如是平板电脑,管理员的平板电脑上安装的APP进入“管理员”模式。
如图12e所示,某个用户(上述多个用户中的任意一个)根据自己在房间中的位置,在模拟房间区域上点击对应的位置,该用户的APP在该对应的位置显示一个标识(例如笑脸),表示该用户在此处。该用户点击精准甜点定位界面上的“确定”控件,APP将该用户的标识的位置在第二坐标系下的坐标发送给管理员的APP。
上述多个用户均可以执行上述操作,因此该多个用户的APP均在模拟房间区域中显示一个标识(例如笑脸),表示对应的用户的位置,并且多个用户的APP均会将各自标识的位置在第二坐标系下的坐标发送给管理员的APP。
如图12f所示,管理员的APP在模拟房间区域中显示多个用户(例如用户1~用户3)的标识,即管理员的APP收到多个用户的APP发送的坐标后,在模拟房间区域中,与前述各个坐标对应的位置分别显示一个标识(例如笑脸)。
管理员的APP先根据条形音箱的个数对房间内的空间进行划分,每个条形音箱对应一个子空间,例如,如图15所示,有3个条形音箱,以位于中间的条形音箱的中心为顶点,将条形音箱前方水平方向空间可以按照水平方向上对180°的角平均划分的方式,划分成3个子空间,左侧子空间对应条形音箱1,其中有1个用户,中间子空间对应条形音箱2,其中有2个用户,右侧子空间对应条形音箱3,其中没有用户。即图15所示的场景中,三个条形音箱分别对应三个子空间,根据各个子空间中的用户数,三个条形音箱和用户数的关系分别是一对一、一对多以及一对空。管理员的APP依次确定三个条形音箱的甜点位。
管理员的APP可以采用场景一中的公式(1)~(4)获取条形音箱1的初始水平角度A1和微调角度θ1,区别在于:公式(1)和(2)中的坐标(x s0,y s0)表示条形音箱1的中心;管理员的APP可以采用场景二中描述的方法获取条形音箱2的初始水平角度A2和微调角度θ2,区别在于:公式(1)和(2)中的坐标(x s0,y s0)表示条形音箱2的中心,坐标(x c,y c)表示条形音箱2对应的中间子空间内的2个用户的中心位置。此时
Figure PCTCN2021116239-appb-000030
P为2,(x i,y i)是条形音箱2对应的中间子空间内的2个用户中的第i个用户所在位置的坐标,1≤i≤P;管理员的APP也可以采用场景二中描述的方法获取条形音箱3的初始水平角度A3和微调角度θ3,区别在于:公式(1)和(2)中的坐标(x s0,y s0)表示条形音箱3的中心,坐标(x c,y c)表示房间内的所有用户的中心位置。此时
Figure PCTCN2021116239-appb-000031
P表示所有用户的人数(P=3),(x i,y i)是所有用户中第i个用户所在位置的坐标,1≤i≤P。
管理员点击精准甜点定位界面上的“确定”控件,管理员的APP将计算得到的条形音箱1的初始水平角度A1和微调角度θ1以指令形式发送给条形音箱1,将计算得到的条形音箱2的初始水平角度A2和微调角度θ2以指令形式发送给条形音箱2,将计算得到的条形音箱3的初始水平角度A3和微调角度θ3以指令形式发送给条形音箱3。
条形音箱1收到该指令后,可以转动至角度A1-θ1或者A1+θ1。
条形音箱2收到该指令后,可以转动至角度A2-θ2或者A2+θ2。
条形音箱3收到该指令后,可以转动至角度A3-θ3或者A3+θ3。
多个用户手持手机在房间中的选定位置(与图12e中的笑脸对应的位置)站定不动。如图12g所示,管理员点击精准甜点定位界面上的“微调”控件,管理员的APP向条形音箱1~3发送指示微调开始的播放指令。可选的,多个用户的APP均可以在模拟房间区域中显示转动了A1-θ1或者A1+θ1后的条形音箱1、转动了A2-θ2或者A2+θ2后的条形音箱2,转动了A3-θ3或者A3+θ3后的条形音箱3。
条形音箱1收到播放指令后,开始播放预先获取并存储在本地的定位音频(例如雨声),并在播放定位音频的过程中,以速度v从第一角度匀速转动至第二角度。其中,第一角度和第二角度分别为A1-θ1和A1+θ1的其中之一,即第一角度是A1-θ1,第二角度是A1+θ1,或者第一角度是A1+θ1,第二角度是A1-θ1。
左侧子空间内的用户的手机的麦克风接收到回采音频,将该回采音频发送给管理员的APP,管理员的APP可以参照场景二的描述获取条形音箱1的目标水平角度B1。
条形音箱2收到播放指令后,开始播放预先获取并存储在本地的定位音频(例如雨声),并在播放定位音频的过程中,以速度v从第一角度匀速转动至第二角度。其中,第一角度和第二角度分别为A2-θ2和A2+θ2的其中之一,即第一角度是A2-θ2,第二角度是A2+θ2,或者第一角度是A2+θ2,第二角度是A2-θ2。
中间子空间内的用户的手机的麦克风接收到回采音频,将该回采音频发送给管理员的APP,管理员的APP可以参照场景二的描述获取条形音箱2的目标水平角度B2。
条形音箱3收到播放指令后,开始播放预先获取并存储在本地的定位音频(例如雨声),并在播放定位音频的过程中,以速度v从第一角度匀速转动至第二角度。其中,第一角度和第二角度分别为A3-θ3和A3+θ3的其中之一,即第一角度是A3-θ3,第二角度是A3+θ3,或者第一角度是A3+θ3,第二角度是A3-θ3。
房间内的所有用户的手机的麦克风接收到回采音频,将该回采音频发送给管理员的APP,管理员的APP可以参照场景二的描述获取条形音箱3的目标水平角度B3。
如图12g所示,管理员的APP得到目标水平角度B1~B3后,将目标水平角度B1发送给条形音箱1,将目标水平角度B2发送给条形音箱2,将目标水平角度B3发送给条形音箱3。可选的,管理员的APP可以在模拟房间区域中显示转动至目标水平角度B1的条形音箱1、转动至目标水平角度B2的条形音箱2以及转动至目标水平角度B3的条形音箱3,并在精准甜点定位界面上显示一个弹窗,该弹窗中显示“微调完成”的文字。
条形音箱1收到目标水平角度B1后,转动达到目标水平角度B1,此时条形音箱1的甜点位是左侧子空间内的用户所在的位置。
条形音箱2收到目标水平角度B2后,转动达到目标水平角度B2,此时条形音箱2的甜点位是中间子空间内的2个用户的中心位置。
条形音箱3收到目标水平角度B3后,转动达到目标水平角度B3,此时条形音箱3的甜点位是房间内的所有用户的中心位置。
至此,精准甜点定位功能完成。此后,只要多个用户不移动位置,多个条形音箱播放的立体声(例如电视或电影的声音)分别在各自对应的子空间内与用户关联的位置形成最佳听音效果。
场景四、房间中有多个条形音箱和一个用户
上述用户亦即管理员,管理员持有控制装置,该控制装置例如是手机,手机上安装的 APP进入“管理员”模式。
如图12e所示,用户根据自己在房间中的位置,在模拟房间区域上点击对应的位置,APP在该对应的位置显示一个标识(例如笑脸),表示用户在此处。
如图16所示,用户的APP可以采用场景一中的公式(1)~(4),分别获取条形音箱1的初始水平角度A1和微调角度θ1,条形音箱2的初始水平角度A2和微调角度θ2,条形音箱3的初始水平角度A3和微调角度θ3。区别在于:针对条形音箱1,公式(1)和(2)中的坐标(x s0,y s0)表示条形音箱1的中心;针对条形音箱2,公式(1)和(2)中的坐标(x s0,y s0)表示条形音箱2的中心;针对条形音箱3,公式(1)和(2)中的坐标(x s0,y s0)表示条形音箱3的中心。
用户点击精准甜点定位界面上的“确定”控件,用户的APP将计算得到的条形音箱1的初始水平角度A1和微调角度θ1以指令形式发送给条形音箱1,将计算得到的条形音箱2的初始水平角度A2和微调角度θ2以指令形式发送给条形音箱2,将计算得到的条形音箱3的初始水平角度A3和微调角度θ3以指令形式发送给条形音箱3。
条形音箱1收到该指令后,可以转动至角度A1-θ1或者A1+θ1。
条形音箱2收到该指令后,可以转动至角度A2-θ2或者A2+θ2。
条形音箱3收到该指令后,可以转动至角度A3-θ3或者A3+θ3。
用户手持手机在房间中的选定位置(与图12e中的笑脸对应的位置)站定不动。如图12i所示,用户点击精准甜点定位界面上的“微调”控件,用户的APP向条形音箱1~3发送指示微调开始的播放指令。可选的,用户的APP均可以在模拟房间区域中显示转动了A1-θ1或者A1+θ1后的条形音箱1、转动了A2-θ2或者A2+θ2后的条形音箱2,转动了A3-θ3或者A3+θ3后的条形音箱3。
条形音箱1收到播放指令后,开始播放预先获取并存储在本地的定位音频(例如雨声),并在播放定位音频的过程中,以速度v从第一角度匀速转动至第二角度。其中,第一角度和第二角度分别为A1-θ1和A1+θ1的其中之一,即第一角度是A1-θ1,第二角度是A1+θ1,或者第一角度是A1+θ1,第二角度是A1-θ1。
条形音箱2收到播放指令后,开始播放预先获取并存储在本地的定位音频(例如雨声),并在播放定位音频的过程中,以速度v从第一角度匀速转动至第二角度。其中,第一角度和第二角度分别为A2-θ2和A2+θ2的其中之一,即第一角度是A2-θ2,第二角度是A2+θ2,或者第一角度是A2+θ2,第二角度是A2-θ2。
条形音箱3收到播放指令后,开始播放预先获取并存储在本地的定位音频(例如雨声),并在播放定位音频的过程中,以速度v从第一角度匀速转动至第二角度。其中,第一角度和第二角度分别为A3-θ3和A3+θ3的其中之一,即第一角度是A3-θ3,第二角度是A3+θ3,或者第一角度是A3+θ3,第二角度是A3-θ3。
上述三个条形音箱同时播放定位音频,并同时开始转动。
用户的手机的麦克风接收到回采音频。用户的APP可以参照场景一的描述获取检测回采音频的响度,并确定最大响度对应的时刻,将该时刻和回采音频的起始时刻之间的差值确定为目标时间,再采用场景一中的公式(5)或(6)分别计算得到三个条形音箱的目标水平角度B1~B3。
如图12j所示,用户的APP得到目标水平角度B1~B3后,将目标水平角度B1发送给 条形音箱1,将目标水平角度B2发送给条形音箱2,将目标水平角度B3发送给条形音箱3。可选的,用户的APP可以在模拟房间区域中显示转动至目标水平角度B1的条形音箱1、转动至目标水平角度B2的条形音箱2以及转动至目标水平角度B3的条形音箱3,并在精准甜点定位界面上显示一个弹窗,该弹窗中显示“微调完成”的文字。
条形音箱1收到目标水平角度B1后,转动达到目标水平角度B1,条形音箱2收到目标水平角度B2后,转动达到目标水平角度B2,条形音箱3收到目标水平角度B3后,转动达到目标水平角度B3,此时条形音箱1、条形音箱2和条形音箱3各自的甜点位均是用户所在的位置。
至此,精准甜点定位功能完成。此后,只要用户不移动位置,多个条形音箱播放的立体声(例如电视或电影的声音)在用户所在的位置形成最佳听音效果。
可选的,精准甜点定位界面的右上方有一个“设置”控件。如图12k所示,用户点击“设置”控件。APP接收到该操作产生的指令后,在精准甜点定位界面上显示一个下拉菜单,该下拉菜单上有两个项目,一个是“最大旋转角度测量”,另一个是“自定义微调角度”。
用户点击“最大旋转角度测量”的项目。APP接收到该操作产生的指令后,向条形音箱发送最大旋转角度测量指令。条形音箱基于最大旋转角度测量指令,开始水平转动,当触碰到墙壁时停止转动,并记录停止转动时的角度M为最大旋转角度。条形音箱将最大旋转角度M发送给APP。APP根据最大旋转角度M对初始水平角度A进行约束,即若计算得到初始水平角度A大于最大旋转角度M,则将初始水平角度A修改为最大旋转角度M;若计算得到初始水平角度A小于或等于最大旋转角度M,则初始水平角度A不变。进一步的,APP根据最大旋转角度M对微调角度θ进行约束,即若计算得到微调角度θ大于M-A,则微调角度θ修改为M-A;若计算得到微调角度θ小于或等于M-A,则微调角度θ不变。
需要说明的是,APP还可以在每次用户进行了房间配置后,主动执行一次最大旋转角度M的获取流程。
用户点击“自定义微调角度”的项目,并在该项目中输入用户设定的微调角度θ的值。APP接收到该操作产生的指令后,将用户输入的值确定为微调角度θ。即本申请中的微调角度θ可以通过公式(4)计算获得,也可以通过用户在“自定义微调角度”的项目中的输入获取。
五、专属私人订制
点击功能选择界面上的“专属私人订制”控件,APP显示专属私人订制界面。图17a~图17d为本申请中的专属私人订制界面的几个示例性的示意图。专属私人订制界面包括模拟房间区域,该区域中显示的家具模型是用户在房间配置界面中设置的。
在一种可能的实现方式中,进入专属私人订制功能,APP可以先执行精准甜点定位中的流程得到目标水平角度B,并在模拟房间区域中将条形音箱的角度转动至目标水平角度B。APP将目标水平角度B发送给条形音箱,使得条形音箱也配合转动至目标水平角度B。
在一种可能的实现方式中,进入专属私人订制功能之前,APP必须先完成精准甜点定位功能。例如,如果用户点击功能选择界面上的“专属私人订制”控件,APP会先判断用户在点击功能选择界面上的“专属私人订制”控件之前,是否点击过功能选择界面上的“精准甜点定位”控件,如果用户没有点击过“精准甜点定位”控件,则APP在专属私人订制界面上显示一个弹窗,该弹窗显示“请先选择精准甜点定位”的文字,如图17a所示,提醒用户 先点击“精准甜点定位”控件,当精准甜点定位界面上显示一个弹窗,该弹窗中显示“微调完成”的文字时,再点击“专属私人订制”控件。同样的,当用户执行上述操作后,在专属私人订制界面上,APP在模拟房间区域中将条形音箱的角度转动至目标水平角度B。而条形音箱在精准甜点定位功能结束时已转动至角度达到目标水平角度B。
如图17b所示,APP在专属私人订制界面上还显示一个弹窗,该弹窗显示“请佩戴耳机”的文字,提醒用户带上耳机。用户戴上耳机后点击专属私人订制界面上的“确定”控件,APP向条形音箱发送第二播放指令。
如图17c所示,APP发出第二播放指令后,APP在专属私人订制界面上显示一个弹窗,该弹窗显示“订制中…”的文字。
条形音箱收到第二播放指令后,开始播放预先获取并存储在本地的测试音频。
耳机接收测试音频,然后将与测试音频对应的回采音频发送给手机。
手机根据来自条形音箱的测试音频和来自耳机的回采音频,计算得到双耳房间脉冲响应(binaural room impulse response,BRIR)。
需要说明的是,专属私人订制功能也可以如精准甜点定位功能,适用于多个场景,即一个条形音箱和一个用户、一个条形音箱和多个用户、多个条形音箱和多个用户、多个条形音箱和一个用户。
例如,可以通过公式(7)计算BRIR:
Figure PCTCN2021116239-appb-000032
其中,0≤p<P,P表示用户的人数;0≤k<K,K表示扬声器单元的个数;i为0对应左耳,i为1对应右耳;f表示频率;H 2p+i,k(f)表示第p个用户对应于第k个扬声器单元的BRIR;Y i,p,k(f)表示第p个用户的耳机对应于第k个扬声器单元的回采音频;T(f)表示测试音频。
再通过公式(8)计算滤波器系数:
C(f)=(H(f) HH(f)+βI k(f)) -1H(f) HD(f)        (8)
其中,H(f)∈C K×K,表示由公式(7)计算得到的BRIR作为元素所组成的矩阵,该矩阵涵盖所有用户分别对应于所有扬声器单元的房间传递函数;* H表示共轭矩阵;I k(f)∈C K×K,表示单位矩阵;D(f)∈R 2P×R,表示理想传递函数,R表示声道数,若音频为立体声,则R=2,
Figure PCTCN2021116239-appb-000033
APP根据更新后的滤波器系数,通过公式(9)对条形音箱播放的音频进行处理:
X(f)=C(f)S(f)     (9)
其中,X(f)表示处理后的音频,S(f)表示条形音箱播放的音频,C(f)表示滤波器系数。
上述滤波器系数是在精准甜点定位后得到的,因此可以针对用户所在的位置,实现更精准的串扰消除,消除不同房间影响,达到增强声像效果,真实还原原始音效。
如图17d所示,APP在专属私人订制界面上显示一个弹窗,该弹窗显示“订制完成”的文字。至此,专属私人订制功能完成。此后,只要用户不移动位置,条形音箱播放的立体声(例如电视或电影的声音)便在用户所在的位置形成最佳听音效果,且高度还原原始音 效。
六、虚空模式
点击功能选择界面上的“虚空模式”控件,APP显示虚空模式界面。图18a~图18c为本申请中的虚空模式界面的几个示例性的示意图。虚空模式界面包括模拟房间区域,该区域中显示的家具模型是用户在房间配置界面中设置的。
在一种可能的实现方式中,进入虚空模式功能,APP可以先执行精准甜点定位中的流程得到目标水平角度B,并在模拟房间区域中将条形音箱的角度转动至目标水平角度B,再执行专属私人订制中的流程得到BRIR。APP将目标水平角度B发送给条形音箱,使得条形音箱也配合转动至角度达到目标水平角度B。
在一种可能的实现方式中,进入虚空模式功能之前,APP必须先完成精准甜点定位功能和专属私人订制功能。例如,如果用户点击功能选择界面上的“虚空模式”控件,APP会先判断用户在点击功能选择界面上的“虚空模式”控件之前,是否点击过功能选择界面上的“精准甜点定位”控件和“专属私人订制”控件,如果用户没有点击过“精准甜点定位”控件和/或“专属私人订制”控件,则APP在虚空模式界面上显示一个弹窗,该弹窗显示“请依次选择精准甜点定位和专属私人订制”的文字,如图18a所示,提醒用户先点击“精准甜点定位”控件,当精准甜点定位界面上显示一个弹窗,该弹窗中显示“微调完成”的文字时,再点击“专属私人订制”控件,当专属私人订制界面上显示一个弹窗,该弹窗显示“订制完成”的文字时,再点击“虚空模式”控件。同样的,当用户执行上述操作后,在虚空界面上,APP在模拟房间区域中将条形音箱的角度转动至目标水平角度B。而条形音箱在精准甜点定位功能结束时已转动至角度达到目标水平角度B。
如图18b所示,用户点击虚空模式界面上的“空间”控件,APP在虚空模式界面上显示一个上拉菜单,该上拉菜单上有四个项目,分别是“无”、“金色大厅”、“演唱会”和“天安门广场”。
用户点击“金色大厅”的项目,并点击虚空模式界面上的“确定”控件。
APP获取“金色大厅”对应的房间传递函数,根据BRIR和“金色大厅”对应的房间传递函数,通过公式(10)计算得到滤波器系数:
Figure PCTCN2021116239-appb-000034
其中,H(f)∈C K×K,表示由公式(7)计算得到的BRIR作为元素所组成的矩阵,该矩阵涵盖所有用户分别对应于所有条形音箱的房间传递函数;* H表示共轭矩阵;I k(f)∈C K×K,表示单位矩阵;
Figure PCTCN2021116239-appb-000035
表示听音空间(例如金色大厅)的传递函数,R表示声道数,若音频为立体声,则R=2,
Figure PCTCN2021116239-appb-000036
Figure PCTCN2021116239-appb-000037
表示第p个用户选择的听音空间。
APP根据更新后的滤波器系数,通过公式(11)对条形音箱播放的音频进行处理:
Figure PCTCN2021116239-appb-000038
其中,
Figure PCTCN2021116239-appb-000039
表示处理后的音频,S(f)表示条形音箱播放的音频,
Figure PCTCN2021116239-appb-000040
表示滤波器系数。
上述滤波器系数是在专属私人订制后得到的,因此既可以针对用户所在的位置,实现更精准的串扰消除,消除不同房间影响,达到增强声像效果,真实还原原始音效,又可以 在用户所在的位置渲染声场,给用户身临其境的体验。
如图18c所示,APP在虚空模式界面上显示一个弹窗,该弹窗显示“订制完成”的文字。至此,虚空模式功能完成。此后,只要用户不移动位置,条形音箱播放的立体声(例如电视或电影的声音)便在用户所在的位置形成最佳听音效果,且高度还原原始音效,并给用户身临其境的体验。
参照图2所示的控制装置,当房间中包括一个条形音箱和一个用户时,发送模块,用于向音箱发送第一播放指令,所述第一播放指令用于指示所述音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;接收模块,用于接收所述定位音频;处理模块,用于根据所述定位音频确定指示信息,所述指示信息用于确定所述音箱的目标位置,所述目标位置为在所述电子设备接收所述定位音频的过程中,接收的音频响度最大时所述音箱所在的位置,所述目标位置为所述音箱从所述第一位置转动至所述第二位置过程中的一个位置;所述发送模块,还用于将所述指示信息发送给所述音箱。
在一种可能的实现方式中,所述第一位置和所述第二位置之间的角度差与用户的双耳距离有关;或者,所述第一位置和所述第二位置之间的角度差与预设的微调范围相关。
在一种可能的实现方式中,所述指示信息还用于指示所述音箱从所述第二位置转到所述目标位置。
在一种可能的实现方式中,所述预设方向包括水平顺时针方向或者水平逆时针方向。
在一种可能的实现方式中,所述沿预设方向转动包括沿所述预设方向匀速转动。
在一种可能的实现方式中,所述音箱的形状包括条形、方形或者环形。
在一种可能的实现方式中,所述处理模块,还用于获取所述音箱的中心的初始位置和用户所在的位置;根据所述初始位置和所述用户所在的位置计算所述音箱相对于所述用户的理论甜点位置,当所述音箱位于所述理论甜点位置时,所述用户所在的位置与所述音箱的中心的连线与所述音箱的外放表面垂直;获取微调角度;根据所述理论甜点位置和所述微调角度获取所述第一位置和所述第二位置。
在一种可能的实现方式中,所述第一位置是所述音箱从所述理论甜点位置向水平顺时针方向转动所述微调角度的位置;所述第二位置是所述音箱从所述理论甜点位置向水平逆时针方向转动所述微调角度的位置。
在一种可能的实现方式中,所述处理模块,具体用于显示房间配置界面,所述房间配置界面用于模拟所述用户和所述音箱所在的空间;接收所述用户在所述房间配置界面上输入的第一虚拟位置,所述第一虚拟位置用于模拟所述初始位置;根据所述第一虚拟位置计算所述初始位置;接收所述用户在所述房间配置界面上输入的第二虚拟位置,所述第二虚拟位置用于模拟所述用户所在的位置;根据所述第二虚拟位置计算所述用户所在的位置。
在一种可能的实现方式中,所述处理模块,具体用于根据所述初始位置、所述用户所在的位置以及所述用户的双耳距离计算所述微调角度。
在一种可能的实现方式中,所述处理模块,具体用于显示精准甜点定位界面,所述精准甜点定位界面上包括用于设置微调角度的弹窗;接收所述用户在所述弹窗上输入的预设经验值;将所述微调角度的大小设置为预设经验值。
在一种可能的实现方式中,所述处理模块,具体用于从所述定位音频的起始接收时刻 开始,以设定频率对接收的所述定位音频进行检测得到一个响度;当到达所述定位音频的结束接收时刻时,将得到的多个所述响度中的最大者对应的时刻与所述起始接收时刻之间的差值确定为目标时间;将所述目标时间确定为所述指示信息;或者,将所述目标时间和所述预设方向的反方向确定为所述指示信息;或者,将所述目标时间、所述预设方向的反方向以及微调角度确定为所述指示信息;或者,将所述预设方向的反方向和目标旋转角度确定为所述指示信息,所述目标旋转角度用于指示所述音箱从第二位置旋转到所述目标位置。
在一种可能的实现方式中,所述处理模块,具体用于对所述定位音频进行检测得到最大响度;将所述最大响度对应的时刻与所述定位音频的起始接收时刻之间的差值确定为目标时间;将所述目标时间确定为所述指示信息;或者,将所述目标时间和所述预设方向的反方向确定为所述指示信息;或者,将所述目标时间、所述预设方向的反方向以及微调角度确定为所述指示信息;或者,将所述预设方向的反方向和目标旋转角度确定为所述指示信息,所述目标旋转角度用于指示所述音箱从第二位置旋转到所述目标位置。
在一种可能的实现方式中,所述发送模块,还用于向所述音箱发送第二播放指令,所述第二播放指令用于指示所述音箱播放测试音频;所述接收模块,还用于接收采集音频,所述采集音频是在所述测试音频的播放过程中,用户所戴耳机的麦克风接收到的音频;所述处理模块,还用于根据所述采集音频和所述测试音频计算双耳房间脉冲响应BRIR;根据所述BRIR获取所述音箱的滤波器系数。
在一种可能的实现方式中,所述处理模块,还用于接收虚拟空间指令,所述虚拟空间指令包括听音空间;获取所述听音空间的传递函数;根据所述BRIR和所述听音空间的传递函数计算所述音箱的滤波器系数。
第四方面,本申请提供一种音频播放装置,包括:接收模块,用于接收来自电子设备的第一播放指令;处理模块,用于根据所述第一播放指令从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;所述接收模块,还用于接收来自所述电子设备的指示信息,所述指示信息用于确定目标位置,所述目标位置为在所述电子设备接收所述定位音频的过程中,接收的音频响度最大时所述音箱所在的位置,所述目标位置为所述音箱从所述第一位置转动至所述第二位置过程中的一个位置;所述处理模块,还用于根据所述指示信息转动至所述目标位置。
在一种可能的实现方式中,所述第一位置和所述第二位置之间的角度差与用户的双耳距离有关;或者,所述第一位置和所述第二位置之间的角度差与预设的微调范围相关。
在一种可能的实现方式中,所述预设方向包括水平顺时针方向或者水平逆时针方向。
在一种可能的实现方式中,所述沿预设方向转动包括沿所述预设方向匀速转动。
在一种可能的实现方式中,所述音箱的形状包括条形、方形或者环形。
在一种可能的实现方式中,所述接收模块,还用于接收来自所述电子设备的理论甜点位置和微调角度,当所述音箱位于所述理论甜点位置时,用户所在的位置与所述音箱的中心的连线与所述音箱的外放表面垂直;所述处理模块,还用于根据所述理论甜点位置和所述微调角度确定所述第一位置和所述第二位置;转动至所述第一位置。
在一种可能的实现方式中,所述第一位置是所述音箱从所述理论甜点位置向水平顺时针方向转动所述微调角度的位置;所述第二位置是所述音箱从所述理论甜点位置向水平逆 时针方向转动所述微调角度的位置。
当房间中包括多个条形音箱和一个用户时,发送模块,用于向第i个音箱发送第一播放指令,所述第一播放指令用于指示所述第i个音箱从第一位置沿预设方向匀速转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变,所述第i个音箱是N个音箱的其中之一,1≤i≤N,N大于1的为正整数;接收模块,用于接收混音信号,所述混音信号是所述N个音箱各自播放的定位音频混合而成的音频信号;处理模块,用于根据所述混音信号确定第i个指示信息,所述第i个指示信息用于确定所述第i个音箱的目标位置,所述第i个音箱的目标位置为在所述电子设备接收所述混音信号的过程中,接收的音频响度最大时对应的所述第i个音箱所在的位置;所述发送模块,还用于将所述第i个指示信息发送给所述第i个音箱。
在一种可能的实现方式中,所述预设方向包括水平顺时针方向或者水平逆时针方向。
在一种可能的实现方式中,所述处理模块,还用于获取所述第i个音箱的中心的初始位置和用户所在的位置;根据所述初始位置和所述用户所在的位置计算所述第i个音箱相对于所述用户所在的位置的理论甜点位置,当所述第i个音箱位于所述理论甜点位置时,所述用户所在的位置与所述第i个音箱的中心的连线与所述第i个音箱的外放表面垂直;获取微调角度;根据所述理论甜点位置和所述微调角度获取所述第i个音箱的所述第一位置和所述第二位置。
在一种可能的实现方式中,所述第一位置是所述第i个音箱从所述理论甜点位置向所述预设方向转动所述微调角度的位置;所述第二位置是所述第i个音箱从所述理论甜点位置向所述预设方向的反方向转动所述微调角度的位置。
当房间中包括一个条形音箱和多个用户时,所述发送模块,还用于向音箱发送第一播放指令,所述第一播放指令用于指示所述音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;所述接收模块,还用于接收多个采集音频,所述多个采集音频是在所述定位音频的播放过程中,多个用户的终端的麦克风分别接收到的音频;所述处理模块,还用于根据所述多个采集音频确定指示信息,所述指示信息用于确定所述音箱的目标位置,所述目标位置为在所述多个用户的电子设备接收所述定位音频的过程中,接收的音频响度之和最大时所述音箱所在的位置,所述目标位置为所述第一位置转动至所述第二位置过程中的一个位置;所述发送模块,还用于将所述指示信息发送给所述音箱。
在一种可能的实现方式中,所述处理模块,还用于获取所述音箱的中心的初始位置和所述多个用户所在的位置;根据所述多个用户所在的位置确定所述多个用户的中心位置;根据所述初始位置和所述多个用户的中心位置计算所述音箱相对于所述多个用户的中心位置的理论甜点位置,当所述音箱位于所述理论甜点位置时,所述多个用户的中心位置与所述音箱的中心的连线与所述音箱的外放表面垂直;获取微调角度;根据所述理论甜点位置和所述微调角度获取所述第一位置和所述第二位置。
当房间中包括多个条形音箱和多个用户时,在一种可能的实现方式中,所述处理模块,还用于根据N个音箱的数量将空间划分为多个子空间,每个所述子空间对应一个所述音箱,N大于1的为正整数;所述发送模块,还用于分别向所述N个音箱发送第一播放指令,所述第一播放指令用于指示对应的所述音箱从第一位置沿预设方向转动至第二位置, 并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;所述处理模块,还用于确定N个指示信息,所述N个指示信息和所述N个音箱对应,所述指示信息用于确定对应的所述音箱的目标位置;所述发送模块,还用于将所述N个指示信息分别发送给对应的所述音箱。
在一种可能的实现方式中,所述处理模块,具体用于接收第i个形音箱播放的第一定位音频,所述第i个条形音箱是N个条形音箱的其中之一,1≤i≤N,所述第一条形音箱对应的子空间中只有一个第一用户;根据所述第一定位音频确定第一指示信息,所述第一指示信息用于确定所述第i个形音箱的第一目标位置,所述第一目标位置为在所述电子设备接收所述第一定位音频的过程中,接收的音频响度最大时所述第i个形音箱所在的位置。
在一种可能的实现方式中,所述处理模块,还用于获取所述第i个形音箱的中心的第一初始位置和所述第一用户所在的位置;根据所述第一初始位置和所述第一用户所在的位置计算所述第i个条形音箱相对于所述用户所在的位置的第一理论甜点位置;获取第一微调角度;根据所述第一理论甜点位置和所述第一微调角度获取所述第一条形音箱的所述第一位置和所述第二位置。
在一种可能的实现方式中,所述接收模块,还用于接收多个采集音频,所述多个采集音频是在第j个条形音箱播放第二定位音频的过程中,多个第二用户的电子设备的麦克风分别接收到的音频,所述第j个条形音箱是N个条形音箱的其中之一,1≤j≤N,所述多个第二用户位于所述第j个条形音箱对应的子空间中;所述处理模块,还用于根据所述多个采集音频确定第二指示信息,所述第二指示信息用于确定所述第j个条形音箱的第二目标位置,所述第二目标位置为在所述多个第二用户的电子设备接收所述第二定位音频的过程中,接收的音频响度之和最大时所述第j个条形音箱所在的位置,所述第二目标位置为所述第一位置转动至所述第二位置过程中的一个位置。
在一种可能的实现方式中,所述处理模块,还用于获取所述第j个条形音箱的中心点的第二初始位置和所述多个第二用户所在的位置;根据所述多个第二用户所在的位置确定所述多个第二用户的中心位置;根据所述第二初始位置和所述多个第二用户的中心位置计算所述第j个条形音箱相对于所述多个用户的中心位置的第二理论甜点位置;获取第二微调角度;根据所述第二理论甜点位置和所述第二微调角度获取所述第j个条形音箱的所述第一位置和所述第二位置。
在一种可能的实现方式中,所述接收模块,还用于接收多个采集音频,所述多个采集音频是在第k个条形音箱播放第三定位音频的过程中,多个第三用户的电子设备的麦克风分别接收到的音频,所述第k个条形音箱是N个条形音箱的其中之一,1≤k≤N,所述第k个条形音箱对应的子空间中没有用户,所述多个第三用户是指所述空间中的所有用户;所述处理模块,还用于根据所述多个采集音频确定第三指示信息,所述第三指示信息用于确定所述第k个条形音箱的第三目标位置,所述第三目标位置为在所述多个第三用户的电子设备接收所述第三定位音频的过程中,接收的音频响度之和最大时所述第k个条形音箱所在的位置,所述第三目标位置为所述第一位置转动至所述第二位置过程中的一个位置。
在一种可能的实现方式中,所述处理模块,还用于获取所述第k个条形音箱的第三初始位置和所述多个第三用户所在的位置;根据所述多个第三用户所在的位置确定所述多个第三用户的中心位置;根据所述第三初始位置和所述多个第三用户的中心位置计算所述第 k个条形音箱相对于所述多个用户的中心位置的第三理论甜点位置;所述电子设备获取第三微调角度;根据所述第三理论甜点位置和所述第三微调角度获取所述第k个条形音箱的所述第一位置和所述第二位置。
本实施例的装置,可以用于执行图4~图8所示方法实施例的技术方案,其实现原理和技术效果类似,此处不再赘述。
在实现过程中,上述方法实施例的各步骤可以通过处理器中的硬件的集成逻辑电路或者软件形式的指令完成。处理器可以是通用处理器、数字信号处理器(digital signal processor,DSP)、特定应用集成电路(application-specific integrated circuit,ASIC)、现场可编程门阵列(field programmable gate array,FPGA)或其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。本申请实施例公开的方法的步骤可以直接体现为硬件编码处理器执行完成,或者用编码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器,处理器读取存储器中的信息,结合其硬件完成上述方法的步骤。
上述各实施例中提及的存储器可以是易失性存储器或非易失性存储器,或可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(read-only memory,ROM)、可编程只读存储器(programmable ROM,PROM)、可擦除可编程只读存储器(erasable PROM,EPROM)、电可擦除可编程只读存储器(electrically EPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(random access memory,RAM),其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用,例如静态随机存取存储器(static RAM,SRAM)、动态随机存取存储器(dynamic RAM,DRAM)、同步动态随机存取存储器(synchronous DRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(double data rate SDRAM,DDR SDRAM)、增强型同步动态随机存取存储器(enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(synchlink DRAM,SLDRAM)和直接内存总线随机存取存储器(direct rambus RAM,DR RAM)。应注意,本文描述的系统和方法的存储器旨在包括但不限于这些和任意其它适合类型的存储器。
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间 接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(个人计算机,服务器,或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(read-only memory,ROM)、随机存取存储器(random access memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。

Claims (68)

  1. 一种音箱位置调节方法,其特征在于,包括:
    电子设备向音箱发送第一播放指令,所述第一播放指令用于指示所述音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;
    所述电子设备接收所述定位音频;
    所述电子设备根据所述定位音频确定指示信息,所述指示信息用于确定所述音箱的目标位置,所述目标位置为在所述电子设备接收所述定位音频的过程中,接收的音频响度最大时所述音箱所在的位置,所述目标位置为所述音箱从所述第一位置转动至所述第二位置过程中的一个位置;
    所述电子设备将所述指示信息发送给所述音箱。
  2. 根据权利要求1所述的方法,其特征在于,所述第一位置和所述第二位置之间的角度差与用户的双耳距离有关;或者,所述第一位置和所述第二位置之间的角度差与预设的微调范围相关。
  3. 根据权利要求1或2所述的方法,其特征在于,所述指示信息还用于指示所述音箱从所述第二位置转到所述目标位置。
  4. 根据权利要求1-3中任一项所述的方法,其特征在于,所述预设方向包括水平顺时针方向或者水平逆时针方向。
  5. 根据权利要求1-4中任一项所述的方法,其特征在于,所述转动包括围绕所述音箱在竖直方向的转动轴匀速转动。
  6. 根据权利要求1-5中任一项所述的方法,其特征在于,所述音箱的形状包括条形、方形或者环形。
  7. 根据权利要求1-6中任一项所述的方法,其特征在于,所述电子设备向音箱发送第一播放指令之前,还包括:
    所述电子设备获取所述音箱的中心的初始位置和用户所在的位置;
    所述电子设备根据所述初始位置和所述用户所在的位置计算所述音箱相对于所述用户的理论甜点位置,当所述音箱位于所述理论甜点位置时,所述用户所在的位置与所述音箱的中心的连线与所述音箱的外放表面垂直,且所述外放表面朝向所述用户;
    所述电子设备获取微调角度;
    所述电子设备根据所述理论甜点位置和所述微调角度获取所述第一位置和所述第二位置。
  8. 根据权利要求7所述的方法,其特征在于,所述第一位置是所述音箱从所述理论甜点位置向水平顺时针方向转动所述微调角度的位置;所述第二位置是所述音箱从所述理论甜点位置向水平逆时针方向转动所述微调角度的位置。
  9. 根据权利要求7或8所述的方法,其特征在于,所述电子设备获取所述音箱的中心的初始位置和用户所在的位置,包括:
    所述电子设备显示房间配置界面,所述房间配置界面用于模拟所述用户和所述音箱所在的空间;
    所述电子设备接收所述用户在所述房间配置界面上输入的第一虚拟位置,所述第一虚拟位置用于模拟所述初始位置;
    所述电子设备根据所述第一虚拟位置计算所述初始位置;
    所述电子设备接收所述用户在所述房间配置界面上输入的第二虚拟位置,所述第二虚拟位置用于模拟所述用户所在的位置;
    所述电子设备根据所述第二虚拟位置计算所述用户所在的位置。
  10. 根据权利要求7-9中任一项所述的方法,其特征在于,所述电子设备获取微调角度,包括:
    所述电子设备根据所述初始位置、所述用户所在的位置以及所述用户的双耳距离计算所述微调角度。
  11. 根据权利要求7-9中任一项所述的方法,其特征在于,所述电子设备获取微调角度,包括:
    所述电子设备显示精准甜点定位界面,所述精准甜点定位界面上包括用于设置微调角度的弹窗;
    所述电子设备接收所述用户在所述弹窗上输入的预设经验值;
    所述电子设备将所述微调角度的大小设置为预设经验值。
  12. 根据权利要求1-11中任一项所述的方法,其特征在于,所述电子设备根据所述定位音频确定指示信息,包括:
    所述电子设备从所述定位音频的起始接收时刻开始,以设定频率对接收的所述定位音频进行检测得到一个响度;
    当到达所述定位音频的结束接收时刻时,所述电子设备将得到的多个所述响度中的最大者对应的时刻与所述起始接收时刻之间的差值确定为目标时间;
    所述电子设备将所述目标时间确定为所述指示信息;或者,
    所述电子设备将所述目标时间和所述预设方向的反方向确定为所述指示信息;或者,
    所述电子设备将所述目标时间、所述预设方向的反方向以及微调角度确定为所述指示信息;或者,
    所述电子设备将所述预设方向的反方向和目标旋转角度确定为所述指示信息,所述目标旋转角度用于指示所述音箱从第二位置旋转到所述目标位置。
  13. 根据权利要求1-11中任一项所述的方法,其特征在于,所述电子设备根据所述定位音频确定指示信息,包括:
    所述电子设备对所述定位音频进行检测得到最大响度;
    所述电子设备将所述最大响度对应的时刻与所述定位音频的起始接收时刻之间的差值确定为目标时间;
    所述电子设备将所述目标时间确定为所述指示信息;或者,
    所述电子设备将所述目标时间和所述预设方向的反方向确定为所述指示信息;或者,
    所述电子设备将所述目标时间、所述预设方向的反方向以及微调角度确定为所述指示信息;或者,
    所述电子设备将所述预设方向的反方向和目标旋转角度确定为所述指示信息,所述目标旋转角度用于指示所述音箱从第二位置旋转到所述目标位置。
  14. 根据权利要求1-13中任一项所述的方法,其特征在于,所述电子设备将所述指示信息发送给所述音箱之后,还包括:
    所述电子设备向所述音箱发送第二播放指令,所述第二播放指令用于指示所述音箱播放测试音频;
    所述电子设备接收采集音频,所述采集音频是在所述测试音频的播放过程中,用户所戴耳机的麦克风接收到的音频;
    所述电子设备根据所述采集音频和所述测试音频计算双耳房间脉冲响应BRIR;
    所述电子设备根据所述BRIR获取所述音箱的滤波器系数。
  15. 根据权利要求14所述的方法其特征在于,所述电子设备根据所述BRIR获取所述音箱的滤波器系数之前,还包括:
    所述电子设备接收虚拟空间指令,所述虚拟空间指令包括听音空间;
    所述电子设备获取所述听音空间的传递函数;
    所述电子设备根据所述BRIR获取所述音箱的滤波器系数,包括:
    所述电子设备根据所述BRIR和所述听音空间的传递函数计算所述音箱的滤波器系数。
  16. 一种音箱位置调节方法,其特征在于,包括:
    音箱接收来自电子设备的第一播放指令;
    所述音箱根据所述第一播放指令从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;
    所述音箱接收来自所述电子设备的指示信息,所述指示信息用于确定目标位置,所述目标位置为在所述电子设备接收所述定位音频的过程中,接收的音频响度最大时所述音箱所在的位置,所述目标位置为所述音箱从所述第一位置转动至所述第二位置过程中的一个位置;
    所述音箱根据所述指示信息从所述第二位置转动至所述目标位置。
  17. 根据权利要求16所述的方法,其特征在于,所述第一位置和所述第二位置之间的角度差与用户的双耳距离有关;或者,所述第一位置和所述第二位置之间的角度差与预设的微调范围相关。
  18. 根据权利要求16或27所述的方法,其特征在于,所述预设方向包括水平顺时针方向或者水平逆时针方向。
  19. 根据权利要求16-18中任一项所述的方法,其特征在于,所述转动包括围绕所述音箱在竖直方向的转动轴匀速转动。
  20. 根据权利要求16-19中任一项所述的方法,其特征在于,所述音箱的形状包括条形、方形或者环形。
  21. 根据权利要求16-20中任一项所述的方法,其特征在于,所述音箱接收来自电子设备的第一播放指令之前,还包括:
    所述音箱接收来自所述电子设备的理论甜点位置和微调角度,当所述音箱位于所述理论甜点位置时,用户所在的位置与所述音箱的中心的连线与所述音箱的外放表面垂直,且所述外放表面朝向所述用户;
    所述音箱根据所述理论甜点位置和所述微调角度确定所述第一位置;
    所述音箱转动至所述第一位置。
  22. 根据权利要求21所述的方法,其特征在于,所述第一位置是所述音箱从所述理论甜点位置向水平顺时针方向转动所述微调角度的位置;所述第二位置是所述音箱从所述理论甜点位置向水平逆时针方向转动所述微调角度的位置。
  23. 一种音箱位置调节方法,其特征在于,包括:
    电子设备向第i个音箱发送第一播放指令,所述第一播放指令用于指示所述第i个音箱从第一位置沿预设方向匀速转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变,所述第i个音箱是N个音箱的其中之一,1≤i≤N,N大于1的为正整数;
    所述电子设备接收混音信号,所述混音信号是所述N个音箱各自播放的定位音频混合而成的音频信号;
    所述电子设备根据所述混音信号确定第i个指示信息,所述第i个指示信息用于确定所述第i个音箱的目标位置,所述第i个音箱的目标位置为在所述电子设备接收所述混音信号的过程中,接收的音频响度最大时对应的所述第i个音箱所在的位置;
    所述电子设备将所述第i个指示信息发送给所述第i个音箱。
  24. 根据权利要求23所述的方法,其特征在于,所述预设方向包括水平顺时针方向或者水平逆时针方向。
  25. 根据权利要求23或24所述的方法,其特征在于,所述电子设备向第i个音箱发送第一播放指令之前,还包括:
    所述电子设备获取所述第i个音箱的中心的初始位置和用户所在的位置;
    所述电子设备根据所述初始位置和所述用户所在的位置计算所述第i个音箱相对于所述用户所在的位置的理论甜点位置,当所述第i个音箱位于所述理论甜点位置时,所述用户所在的位置与所述第i个音箱的中心的连线与所述第i个音箱的外放表面垂直,且所述外放表面朝向所述用户;
    所述电子设备获取微调角度;
    所述电子设备根据所述理论甜点位置和所述微调角度获取所述第i个音箱的所述第一位置和所述第二位置。
  26. 根据权利要求25所述的方法,其特征在于,所述第i个音箱的第一位置是所述第i个音箱从所述理论甜点位置向所述预设方向转动所述微调角度的位置;所述第i个音箱的第二位置是所述第i个音箱从所述理论甜点位置向所述预设方向的反方向转动所述微调角度的位置。
  27. 一种音箱位置调节方法,其特征在于,包括:
    电子设备向音箱发送第一播放指令,所述第一播放指令用于指示所述音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;
    所述电子设备接收多个采集音频,所述多个采集音频是在所述定位音频的播放过程中,多个用户的终端的麦克风分别接收到的音频;
    所述电子设备根据所述多个采集音频确定指示信息,所述指示信息用于确定所述音箱的目标位置,所述目标位置为在所述多个用户的电子设备接收所述定位音频的过程中,接收的音频响度之和最大时所述音箱所在的位置,所述目标位置为所述第一位置转动至所述 第二位置过程中的一个位置;
    所述电子设备将所述指示信息发送给所述音箱。
  28. 根据权利要求27所述的方法,其特征在于,所述电子设备向音箱发送第一播放指令之前,还包括:
    所述电子设备获取所述音箱的中心的初始位置和所述多个用户所在的位置;
    所述电子设备根据所述多个用户所在的位置确定所述多个用户的中心位置;
    所述电子设备根据所述初始位置和所述多个用户的中心位置计算所述音箱相对于所述多个用户的中心位置的理论甜点位置,当所述音箱位于所述理论甜点位置时,所述多个用户的中心位置与所述音箱的中心的连线与所述音箱的外放表面垂直,且所述外放表面朝向所述用户;
    所述电子设备获取微调角度;
    所述电子设备根据所述理论甜点位置和所述微调角度获取所述第一位置和所述第二位置。
  29. 一种音箱位置调节方法,其特征在于,包括:
    电子设备根据N个音箱的数量将空间划分为多个子空间,每个所述子空间对应一个所述音箱,N大于1的为正整数;
    所述电子设备分别向所述N个音箱发送第一播放指令,所述第一播放指令用于指示对应的所述音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;
    所述电子设备确定N个指示信息,所述N个指示信息和所述N个音箱对应,所述指示信息用于确定对应的所述音箱的目标位置;
    所述电子设备将所述N个指示信息分别发送给对应的所述音箱。
  30. 根据权利要求29所述的方法,其特征在于,所述电子设备确定N个指示信息,包括:
    所述电子设备接收第i个形音箱播放的第一定位音频,所述第i个音箱是N个音箱的其中之一,1≤i≤N,所述第一音箱对应的子空间中只有一个第一用户;
    所述电子设备根据所述第一定位音频确定第一指示信息,所述第一指示信息用于确定所述第i个形音箱的第一目标位置,所述第一目标位置为在所述电子设备接收所述第一定位音频的过程中,接收的音频响度最大时所述第i个形音箱所在的位置。
  31. 根据权利要求30所述的方法,其特征在于,所述电子设备分别向所述N个音箱发送第一播放指令之前,还包括:
    所述电子设备获取所述第i个形音箱的中心的第一初始位置和所述第一用户所在的位置;
    所述电子设备根据所述第一初始位置和所述第一用户所在的位置计算所述第i个音箱相对于所述用户所在的位置的第一理论甜点位置,当所述第i个音箱位于所述第一理论甜点位置时,所述第一用户所在的位置与所述第i个音箱的中心的连线与所述第i个音箱的外放表面垂直,且所述外放表面朝向所述第一用户;
    所述电子设备获取第一微调角度;
    所述电子设备根据所述第一理论甜点位置和所述第一微调角度获取所述第一音箱的 所述第一位置和所述第二位置。
  32. 根据权利要求29-31中任一项所述的方法,其特征在于,所述电子设备确定N个指示信息,包括:
    所述电子设备接收多个采集音频,所述多个采集音频是在第j个音箱播放第二定位音频的过程中,多个第二用户的电子设备的麦克风分别接收到的音频,所述第j个音箱是N个音箱的其中之一,1≤j≤N,所述多个第二用户位于所述第j个音箱对应的子空间中;
    所述电子设备根据所述多个采集音频确定第二指示信息,所述第二指示信息用于确定所述第j个音箱的第二目标位置,所述第二目标位置为在所述多个第二用户的电子设备接收所述第二定位音频的过程中,接收的音频响度之和最大时所述第j个音箱所在的位置,所述第二目标位置为所述第一位置转动至所述第二位置过程中的一个位置。
  33. 根据权利要求32所述的方法,其特征在于,所述电子设备分别向所述N个音箱发送第一播放指令之前,还包括:
    所述电子设备获取所述第j个音箱的中心点的第二初始位置和所述多个第二用户所在的位置;
    所述电子设备根据所述多个第二用户所在的位置确定所述多个第二用户的中心位置;
    所述电子设备根据所述第二初始位置和所述多个第二用户的中心位置计算所述第j个音箱相对于所述多个第二用户的中心位置的第二理论甜点位置,当所述第j个音箱位于所述第二理论甜点位置时,所述多个第二用户的中心位置与所述第j个音箱的中心的连线与所述第j个音箱的外放表面垂直,且所述外放表面朝向所述多个第二用户;
    所述电子设备获取第二微调角度;
    所述电子设备根据所述第二理论甜点位置和所述第二微调角度获取所述第j个音箱的所述第一位置和所述第二位置。
  34. 根据权利要求29-33中任一项所述的方法,其特征在于,所述电子设备确定N个指示信息,包括:
    所述电子设备接收多个采集音频,所述多个采集音频是在第k个音箱播放第三定位音频的过程中,多个第三用户的电子设备的麦克风分别接收到的音频,所述第k个音箱是N个音箱的其中之一,1≤k≤N,所述第k个音箱对应的子空间中没有用户,所述多个第三用户是指所述空间中的所有用户;
    所述电子设备根据所述多个采集音频确定第三指示信息,所述第三指示信息用于确定所述第k个音箱的第三目标位置,所述第三目标位置为在所述多个第三用户的电子设备接收所述第三定位音频的过程中,接收的音频响度之和最大时所述第k个音箱所在的位置,所述第三目标位置为所述第一位置转动至所述第二位置过程中的一个位置。
  35. 根据权利要求34所述的方法,其特征在于,所述电子设备分别向所述N个音箱发送第一播放指令之前,还包括:
    所述电子设备获取所述第k个音箱的第三初始位置和所述多个第三用户所在的位置;
    所述电子设备根据所述多个第三用户所在的位置确定所述多个第三用户的中心位置;
    所述电子设备根据所述第三初始位置和所述多个第三用户的中心位置计算所述第k个音箱相对于所述多个用户的中心位置的第三理论甜点位置,当所述第k个音箱位于所述第三理论甜点位置时,所述多个第三用户的中心位置与所述第k个音箱的中心的连线与所 述第k个音箱的外放表面垂直,且所述外放表面朝向所述多个第三用户;
    所述电子设备获取第三微调角度;
    所述电子设备根据所述第三理论甜点位置和所述第三微调角度获取所述第k个音箱的所述第一位置和所述第二位置。
  36. 一种控制装置,其特征在于,包括:
    发送模块,用于向音箱发送第一播放指令,所述第一播放指令用于指示所述音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;
    接收模块,用于接收所述定位音频;
    处理模块,用于根据所述定位音频确定指示信息,所述指示信息用于确定所述音箱的目标位置,所述目标位置为在所述电子设备接收所述定位音频的过程中,接收的音频响度最大时所述音箱所在的位置,所述目标位置为所述音箱从所述第一位置转动至所述第二位置过程中的一个位置;
    所述发送模块,还用于将所述指示信息发送给所述音箱。
  37. 根据权利要求36所述的装置,其特征在于,所述第一位置和所述第二位置之间的角度差与用户的双耳距离有关;或者,所述第一位置和所述第二位置之间的角度差与预设的微调范围相关。
  38. 根据权利要求36或37所述的装置,其特征在于,所述指示信息还用于指示所述音箱从所述第二位置转到所述目标位置。
  39. 根据权利要求36-38中任一项所述的装置,其特征在于,所述预设方向包括水平顺时针方向或者水平逆时针方向。
  40. 根据权利要求36-39中任一项所述的装置,其特征在于,所述转动包括围绕所述音箱在竖直方向的转动轴匀速转动。
  41. 根据权利要求36-40中任一项所述的装置,其特征在于,所述音箱的形状包括条形、方形或者环形。
  42. 根据权利要求36-41中任一项所述的装置,其特征在于,所述处理模块,还用于获取所述音箱的中心的初始位置和用户所在的位置;根据所述初始位置和所述用户所在的位置计算所述音箱相对于所述用户的理论甜点位置,当所述音箱位于所述理论甜点位置时,所述用户所在的位置与所述音箱的中心的连线与所述音箱的外放表面垂直,且所述外放表面朝向所述用户;获取微调角度;根据所述理论甜点位置和所述微调角度获取所述第一位置和所述第二位置。
  43. 根据权利要求42所述的装置,其特征在于,所述第一位置是所述音箱从所述理论甜点位置向水平顺时针方向转动所述微调角度的位置;所述第二位置是所述音箱从所述理论甜点位置向水平逆时针方向转动所述微调角度的位置。
  44. 根据权利要求42或43所述的装置,其特征在于,所述处理模块,具体用于显示房间配置界面,所述房间配置界面用于模拟所述用户和所述音箱所在的空间;接收所述用户在所述房间配置界面上输入的第一虚拟位置,所述第一虚拟位置用于模拟所述初始位置;根据所述第一虚拟位置计算所述初始位置;接收所述用户在所述房间配置界面上输入的第二虚拟位置,所述第二虚拟位置用于模拟所述用户所在的位置;根据所述第二虚拟位置计 算所述用户所在的位置。
  45. 根据权利要求42-44中任一项所述的装置,其特征在于,所述处理模块,具体用于根据所述初始位置、所述用户所在的位置以及所述用户的双耳距离计算所述微调角度。
  46. 根据权利要求42-44中任一项所述的装置,其特征在于,所述处理模块,具体用于显示精准甜点定位界面,所述精准甜点定位界面上包括用于设置微调角度的弹窗;接收所述用户在所述弹窗上输入的预设经验值;将所述微调角度的大小设置为预设经验值。
  47. 根据权利要求36-46中任一项所述的装置,其特征在于,所述处理模块,具体用于从所述定位音频的起始接收时刻开始,以设定频率对接收的所述定位音频进行检测得到一个响度;当到达所述定位音频的结束接收时刻时,将得到的多个所述响度中的最大者对应的时刻与所述起始接收时刻之间的差值确定为目标时间;将所述目标时间确定为所述指示信息;或者,将所述目标时间和所述预设方向的反方向确定为所述指示信息;或者,将所述目标时间、所述预设方向的反方向以及微调角度确定为所述指示信息;或者,将所述预设方向的反方向和目标旋转角度确定为所述指示信息,所述目标旋转角度用于指示所述音箱从第二位置旋转到所述目标位置。
  48. 根据权利要求36-46中任一项所述的装置,其特征在于,所述处理模块,具体用于对所述定位音频进行检测得到最大响度;将所述最大响度对应的时刻与所述定位音频的起始接收时刻之间的差值确定为目标时间;将所述目标时间确定为所述指示信息;或者,将所述目标时间和所述预设方向的反方向确定为所述指示信息;或者,将所述目标时间、所述预设方向的反方向以及微调角度确定为所述指示信息;或者,将所述预设方向的反方向和目标旋转角度确定为所述指示信息,所述目标旋转角度用于指示所述音箱从第二位置旋转到所述目标位置。
  49. 根据权利要求36-48中任一项所述的装置,其特征在于,所述发送模块,还用于向所述音箱发送第二播放指令,所述第二播放指令用于指示所述音箱播放测试音频;
    所述接收模块,还用于接收采集音频,所述采集音频是在所述测试音频的播放过程中,用户所戴耳机的麦克风接收到的音频;
    所述处理模块,还用于根据所述采集音频和所述测试音频计算双耳房间脉冲响应BRIR;根据所述BRIR获取所述音箱的滤波器系数。
  50. 根据权利要求49所述的装置,其特征在于,所述处理模块,还用于接收虚拟空间指令,所述虚拟空间指令包括听音空间;获取所述听音空间的传递函数;根据所述BRIR和所述听音空间的传递函数计算所述音箱的滤波器系数。
  51. 一种音频播放装置,其特征在于,包括:
    接收模块,用于接收来自电子设备的第一播放指令;
    处理模块,用于根据所述第一播放指令从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;
    所述接收模块,还用于接收来自所述电子设备的指示信息,所述指示信息用于确定目标位置,所述目标位置为在所述电子设备接收所述定位音频的过程中,接收的音频响度最大时所述音箱所在的位置,所述目标位置为所述音箱从所述第一位置转动至所述第二位置过程中的一个位置;
    所述处理模块,还用于根据所述指示信息从所述第二位置转动至所述目标位置。
  52. 根据权利要求51所述的装置,其特征在于,所述第一位置和所述第二位置之间的角度差与用户的双耳距离有关;或者,所述第一位置和所述第二位置之间的角度差与预设的微调范围相关。
  53. 根据权利要求51或52所述的装置,其特征在于,所述预设方向包括水平顺时针方向或者水平逆时针方向。
  54. 根据权利要求51-53中任一项所述的装置,其特征在于,所述转动包括围绕所述音箱在竖直方向的转动轴匀速转动。
  55. 根据权利要求51-54中任一项所述的装置,其特征在于,所述音箱的形状包括条形、方形或者环形。
  56. 根据权利要求51-55中任一项所述的装置,其特征在于,所述接收模块,还用于接收来自所述电子设备的理论甜点位置和微调角度,当所述音箱位于所述理论甜点位置时,用户所在的位置与所述音箱的中心的连线与所述音箱的外放表面垂直,且所述外放表面朝向所述用户;
    所述处理模块,还用于根据所述理论甜点位置和所述微调角度确定所述第一位置;转动至所述第一位置。
  57. 根据权利要求56所述的装置,其特征在于,所述第一位置是所述音箱从所述理论甜点位置向水平顺时针方向转动所述微调角度的位置;所述第二位置是所述音箱从所述理论甜点位置向水平逆时针方向转动所述微调角度的位置。
  58. 一种控制装置,其特征在于,包括:
    发送模块,用于向第i个音箱发送第一播放指令,所述第一播放指令用于指示所述第i个音箱从第一位置沿预设方向匀速转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变,所述第i个音箱是N个音箱的其中之一,1≤i≤N,N大于1的为正整数;
    接收模块,用于接收混音信号,所述混音信号是所述N个音箱各自播放的定位音频混合而成的音频信号;
    处理模块,用于根据所述混音信号确定第i个指示信息,所述第i个指示信息用于确定所述第i个音箱的目标位置,所述第i个音箱的目标位置为在所述电子设备接收所述混音信号的过程中,接收的音频响度最大时对应的所述第i个音箱所在的位置;
    所述发送模块,还用于将所述第i个指示信息发送给所述第i个音箱。
  59. 根据权利要求58所述的装置,其特征在于,所述预设方向包括水平顺时针方向或者水平逆时针方向。
  60. 根据权利要求58或59所述的装置,其特征在于,所述处理模块,还用于获取所述第i个音箱的中心的初始位置和用户所在的位置;根据所述初始位置和所述用户所在的位置计算所述第i个音箱相对于所述用户所在的位置的理论甜点位置,当所述第i个音箱位于所述理论甜点位置时,所述用户所在的位置与所述第i个音箱的中心的连线与所述第i个音箱的外放表面垂直,且所述外放表面朝向所述用户;获取微调角度;根据所述理论甜点位置和所述微调角度获取所述第i个音箱的所述第一位置和所述第二位置。
  61. 根据权利要求60所述的装置,其特征在于,所述第i个音箱的第一位置是所述第i个音箱从所述理论甜点位置向所述预设方向转动所述微调角度的位置;所述第i个音箱 的第二位置是所述第i个音箱从所述理论甜点位置向所述预设方向的反方向转动所述微调角度的位置。
  62. 根据权利要求58-61中任一项所述的装置,其特征在于,所述发送模块,还用于向音箱发送第一播放指令,所述第一播放指令用于指示所述音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;
    所述接收模块,还用于接收多个采集音频,所述多个采集音频是在所述定位音频的播放过程中,多个用户的终端的麦克风分别接收到的音频;
    所述处理模块,还用于根据所述多个采集音频确定指示信息,所述指示信息用于确定所述音箱的目标位置,所述目标位置为在所述多个用户的电子设备接收所述定位音频的过程中,接收的音频响度之和最大时所述音箱所在的位置,所述目标位置为所述第一位置转动至所述第二位置过程中的一个位置;
    所述发送模块,还用于将所述指示信息发送给所述音箱。
  63. 根据权利要求62所述的装置,其特征在于,所述处理模块,还用于获取所述音箱的中心的初始位置和所述多个用户所在的位置;根据所述多个用户所在的位置确定所述多个用户的中心位置;根据所述初始位置和所述多个用户的中心位置计算所述音箱相对于所述多个用户的中心位置的理论甜点位置,当所述音箱位于所述理论甜点位置时,所述多个用户的中心位置与所述音箱的中心的连线与所述音箱的外放表面垂直,且所述外放表面朝向所述用户;获取微调角度;根据所述理论甜点位置和所述微调角度获取所述第一位置和所述第二位置。
  64. 根据权利要求58-63中任一项所述的装置,其特征在于,所述处理模块,还用于根据N个音箱的数量将空间划分为多个子空间,每个所述子空间对应一个所述音箱,N大于1的为正整数;
    所述发送模块,还用于分别向所述N个音箱发送第一播放指令,所述第一播放指令用于指示对应的所述音箱从第一位置沿预设方向转动至第二位置,并在转动的过程中播放定位音频,所述定位音频在播放时的响度稳定不变;
    所述处理模块,还用于确定N个指示信息,所述N个指示信息和所述N个音箱对应,所述指示信息用于确定对应的所述音箱的目标位置;
    所述发送模块,还用于将所述N个指示信息分别发送给对应的所述音箱。
  65. 一种电子设备,其特征在于,包括:
    一个或多个处理器;
    存储器,用于存储一个或多个程序;
    当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现权利要求1-15或者23-35中任一项所述的方法。
  66. 一种音箱,其特征在于,包括:
    一个或多个处理器;
    存储器,用于存储一个或多个程序;
    当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现权利要求16-22中任一项所述的方法。
  67. 一种计算机可读存储介质,其特征在于,包括计算机程序,所述计算机程序在计 算机上被执行时,使得所述计算机执行权利要求1-35中任一项所述的方法。
  68. 一种计算机程序产品,其特征在于,所述计算机程序产品包括计算机程序代码,当所述计算机程序代码在计算机或处理器上运行时,使得计算机或处理器执行权利要求1-35中任一项所述的方法。
PCT/CN2021/116239 2020-09-04 2021-09-02 音箱位置调节方法、音频渲染方法和装置 WO2022048599A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP21863663.7A EP4199543A4 (en) 2020-09-04 2021-09-02 ACOUSTIC PLAYER POSITION ADJUSTMENT METHOD, AND AUDIO RENDERING METHOD AND APPARATUS
JP2023515026A JP2023539774A (ja) 2020-09-04 2021-09-02 サウンドボックス位置調整方法、オーディオレンダリング方法、および装置
US18/177,652 US20230209297A1 (en) 2020-09-04 2023-03-02 Sound box position adjustment method, audio rendering method, and apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010923763.9A CN114143696B (zh) 2020-09-04 2020-09-04 音箱位置调节方法、音频渲染方法和装置
CN202010923763.9 2020-09-04

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/177,652 Continuation US20230209297A1 (en) 2020-09-04 2023-03-02 Sound box position adjustment method, audio rendering method, and apparatus

Publications (1)

Publication Number Publication Date
WO2022048599A1 true WO2022048599A1 (zh) 2022-03-10

Family

ID=80438386

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/116239 WO2022048599A1 (zh) 2020-09-04 2021-09-02 音箱位置调节方法、音频渲染方法和装置

Country Status (5)

Country Link
US (1) US20230209297A1 (zh)
EP (1) EP4199543A4 (zh)
JP (1) JP2023539774A (zh)
CN (1) CN114143696B (zh)
WO (1) WO2022048599A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116156368A (zh) * 2023-04-03 2023-05-23 江西斐耳科技有限公司 一种音箱、音响系统及音箱校准方法

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220352755A1 (en) * 2021-04-30 2022-11-03 Nucurrent, Inc. Wirelessly Powered Battery Pack For Retrofit In Battery Powered Devices
CN117729472B (zh) * 2024-01-31 2024-09-27 深圳市丰禾原电子科技有限公司 家庭影院系统的音效设置方法、装置和计算机存储介质
CN117676420B (zh) * 2024-02-01 2024-10-01 深圳市丰禾原电子科技有限公司 家庭影院左右音箱音效校准方法、装置和计算机存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101296529A (zh) * 2007-04-25 2008-10-29 哈曼贝克自动系统股份有限公司 声音调谐方法
CN104954930A (zh) * 2015-06-03 2015-09-30 冠捷显示科技(厦门)有限公司 一种自动调整音响装置声音方向和时延以达到最佳音响效果的方法
US20160330562A1 (en) * 2014-01-10 2016-11-10 Dolby Laboratories Licensing Corporation Calibration of virtual height speakers using programmable portable devices
CN106817657A (zh) * 2015-12-02 2017-06-09 瑞轩科技股份有限公司 自动调整发声方向的系统、音频信号输出装置及其方法
CN110072172A (zh) * 2019-04-25 2019-07-30 广州小鹏汽车科技有限公司 一种音频信号的输出方法和装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104604257B (zh) * 2012-08-31 2016-05-25 杜比实验室特许公司 用于在各种收听环境中渲染并且回放基于对象的音频的系统
CN207269261U (zh) * 2017-10-12 2018-04-24 广州杰士莱电子有限公司 可调角度音箱
CN110798775A (zh) * 2018-08-02 2020-02-14 长城汽车股份有限公司 车辆的扬声器角度调节方法、系统及车辆
CN111050269B (zh) * 2018-10-15 2021-11-19 华为技术有限公司 音频处理方法和电子设备
US11503423B2 (en) * 2018-10-25 2022-11-15 Creative Technology Ltd Systems and methods for modifying room characteristics for spatial audio rendering over headphones

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101296529A (zh) * 2007-04-25 2008-10-29 哈曼贝克自动系统股份有限公司 声音调谐方法
US20160330562A1 (en) * 2014-01-10 2016-11-10 Dolby Laboratories Licensing Corporation Calibration of virtual height speakers using programmable portable devices
CN104954930A (zh) * 2015-06-03 2015-09-30 冠捷显示科技(厦门)有限公司 一种自动调整音响装置声音方向和时延以达到最佳音响效果的方法
CN106817657A (zh) * 2015-12-02 2017-06-09 瑞轩科技股份有限公司 自动调整发声方向的系统、音频信号输出装置及其方法
CN110072172A (zh) * 2019-04-25 2019-07-30 广州小鹏汽车科技有限公司 一种音频信号的输出方法和装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4199543A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116156368A (zh) * 2023-04-03 2023-05-23 江西斐耳科技有限公司 一种音箱、音响系统及音箱校准方法
CN116156368B (zh) * 2023-04-03 2023-08-15 江西斐耳科技有限公司 一种音箱、音响系统及音箱校准方法

Also Published As

Publication number Publication date
US20230209297A1 (en) 2023-06-29
CN114143696A (zh) 2022-03-04
EP4199543A4 (en) 2024-01-31
EP4199543A1 (en) 2023-06-21
CN114143696B (zh) 2022-12-30
JP2023539774A (ja) 2023-09-19

Similar Documents

Publication Publication Date Title
WO2022048599A1 (zh) 音箱位置调节方法、音频渲染方法和装置
CN113220139B (zh) 控制大屏设备显示的方法、移动终端及第一系统
US12101621B2 (en) Multimedia information processing method and apparatus, and storage medium
US9075572B2 (en) Media enhancement dock
WO2020259542A1 (zh) 一种显示设备的控制方法及相关装置
WO2017181365A1 (zh) 一种耳机声道控制方法、相关设备及系统
WO2021036776A1 (zh) 一种无线充电方法及电子设备
WO2022007944A1 (zh) 一种设备控制方法及相关装置
CN107889044B (zh) 音频数据的处理方法及装置
CN110996305A (zh) 连接蓝牙设备的方法、装置、电子设备及介质
CN111741511B (zh) 快速匹配方法及头戴电子设备
WO2023125847A1 (zh) 一种音频处理方法、系统及相关装置
EP4203447A1 (en) Sound processing method and apparatus thereof
CN111338474A (zh) 虚拟对象位姿校准方法及装置、存储介质和电子设备
WO2022206825A1 (zh) 一种调节音量的方法、系统及电子设备
CN114598984B (zh) 立体声合成方法和系统
WO2022161036A1 (zh) 天线选择方法、装置、电子设备及可读存储介质
US20230319217A1 (en) Recording Method and Device
CN106255004A (zh) 声音调整方法、耳机和音源设备
WO2021159943A1 (zh) 一种拍摄控制方法、装置及终端设备
CN111982293A (zh) 体温测量方法、装置、电子设备及存储介质
WO2024159885A1 (zh) 空间音频渲染方法和装置
CN112463086A (zh) 一种显示控制方法及电子设备
WO2024051638A1 (zh) 声场校准方法、电子设备及系统
US20240354359A1 (en) Audio processing method, system, and related apparatus

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21863663

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2023515026

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 202317016691

Country of ref document: IN

ENP Entry into the national phase

Ref document number: 2021863663

Country of ref document: EP

Effective date: 20230317

NENP Non-entry into the national phase

Ref country code: DE