CN114915674A

CN114915674A - Mobile terminal and sound playing method

Info

Publication number: CN114915674A
Application number: CN202110182268.1A
Authority: CN
Inventors: 朱博通
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2021-02-09
Filing date: 2021-02-09
Publication date: 2022-08-16

Abstract

The disclosure relates to a mobile terminal and a sound playing method. Wherein, mobile terminal includes: a plurality of ultrasonic assemblies disposed on the mobile terminal, wherein each of the ultrasonic assemblies comprises an ultrasonic transducer; the ultrasonic assemblies emit ultrasonic waves loaded with audio signals through the ultrasonic transducers and enable the audio signals to be generated at one or more specified positions, wherein the number of the ultrasonic assemblies is larger than or equal to twice the number of the specified positions. A plurality of ultrasonic transducers arranged on the mobile terminal emit ultrasonic waves loaded with audio signals and generate the audio signals at the designated positions, so that a user can hear sounds at the designated positions. And the audio signal is formed only at a designated position, which ensures privacy. And the elements such as earphones and the like are not needed for sound playing, so that the comfort of the user is improved.

Description

Mobile terminal and sound playing method

Technical Field

The present disclosure relates to the field of sound processing, and in particular, to a mobile terminal and a sound playing method.

Background

At present, mobile terminals such as mobile phones and tablet computers are often equipped with sound playing elements such as earphones and speakers, and can also play sound through wired or wireless earphones.

The earphone is used for playing sound, the distance is required to be very close, and the earphone is generally required to be attached to the ear to hear the sound. The earphone is used for playing sound, and the earphone is a wired earphone or a wireless earphone, and is worn by a user, so that fatigue and discomfort are caused after the earphone is worn for a long time, and the hearing is influenced. When the sound is played through the loudspeaker, the privacy is poor, and people around the loudspeaker can hear the played sound.

Disclosure of Invention

In order to overcome the problems in the related art, the present disclosure provides a mobile terminal and a sound playing method.

According to a first aspect of the embodiments of the present disclosure, there is provided a mobile terminal, including: a plurality of ultrasonic assemblies disposed on the mobile terminal, wherein each of the ultrasonic assemblies comprises one or more ultrasonic transducers; the ultrasonic assemblies emit ultrasonic waves loaded with audio signals through the ultrasonic transducers and enable the audio signals to be generated at one or more specified positions, wherein the number of the ultrasonic assemblies is larger than or equal to twice the number of the specified positions.

In some embodiments, the mobile terminal further comprises: the control component is used for loading the audio signal to the ultrasonic wave and controlling the ultrasonic component to emit the ultrasonic wave loaded with the audio signal.

In some embodiments, the control component loads the audio signal into ultrasonic waves through a parametric array algorithm, so as to obtain ultrasonic waves correspondingly emitted by each ultrasonic transducer.

In some embodiments, the mobile terminal further comprises: a positioning component for determining a target location; the control component determines the specified location based on the target location.

In some embodiments, the target location is a location of the head of the identified person; when a plurality of heads of people are identified, a plurality of designated positions are determined, ultrasonic waves for loading the audio signals are emitted through a plurality of ultrasonic transducers respectively, and the audio signals are generated at the plurality of designated positions.

In some embodiments, the positioning assembly comprises one or more of: the device comprises a visible light camera, an infrared camera, a UWB component, a distance sensor and a depth of field camera.

In some embodiments, the target position is an identified human ear position, including a left ear position and a right ear position.

In some embodiments, the positioning assembly is configured to: determining the target position at a first frequency when the target position change amplitude exceeds a threshold range; determining the target position at a second frequency when the target position variation amplitude does not exceed a threshold range; wherein the first frequency is greater than the second frequency.

In some embodiments, the control component is further configured to determine one or more adaptive positions adjacent to the designated position based on the designated position, emit ultrasonic waves loading audio signals through the ultrasonic component, and cause the audio signals to be generated at the designated position and the adaptive positions adjacent thereto.

In some embodiments, each of the ultrasonic assemblies comprises a plurality of ultrasonic transducers, including: at least one first ultrasonic transducer, and at least one second ultrasonic transducer; the center frequencies of the first ultrasonic transducer and the second ultrasonic transducer are different.

In some embodiments, the distance between any two of the ultrasonic transducers is greater than or equal to λ/2, where λ is the wavelength of the ultrasonic waves emitted by the ultrasonic transducers.

In some embodiments, the specified location is greater than or equal to a near field length N of the ultrasound assembly,

d is the equivalent diameter of the ultrasonic transducer; λ is the wavelength of the ultrasonic wave.

In some embodiments, a plurality of the ultrasonic components are arranged on the front face of the mobile terminal and located on at least one side of the mobile terminal, and the ultrasonic waves are emitted towards the direction perpendicular to the front face of the mobile terminal.

In some embodiments, the mobile terminal further comprises: the display screen is arranged on the front side of the mobile terminal; the ultrasonic components are arranged on the periphery of the display screen.

In some embodiments, the ultrasound assembly is disposed on a back side of the mobile terminal; and is located in the middle and/or at least one side of the back of the mobile terminal.

In some embodiments, the ultrasonic transducer is a piezoelectric micromachined ultrasonic transducer comprising: a silicon-based stent; the silicon film is arranged on the silicon-based support; and the piezoelectric module is arranged on the silicon film and comprises a first conducting layer, a second conducting layer and a piezoelectric layer arranged between the first conducting layer and the second conducting layer.

According to a second aspect of an embodiment of the present disclosure, there is provided a sound playing method applied to the mobile terminal according to the first aspect; the sound playing method comprises the following steps: transmitting, by the one or more ultrasonic transducers, ultrasonic waves loading an audio signal and causing the audio signal to be generated at one or more designated locations.

In some embodiments, the method further comprises: determining the audio signal; and loading the audio signal into ultrasonic waves through a parametric array algorithm to obtain the ultrasonic waves correspondingly transmitted by each ultrasonic transducer.

In some embodiments, the method further comprises: determining a target position; determining the specified location based on the target location.

In some embodiments, the determining the target location comprises: identifying a position of a person's head; determining the target location based on the position of the person's head.

In some embodiments, the method further comprises: determining a human ear position based on the position of the human head, the human ear position comprising a left ear position and a right ear position; and respectively loading the audio signal of the left channel and the audio signal of the right channel into ultrasonic waves for transmission, and respectively generating the signals at the left ear position and the right ear position.

In some embodiments, the method further comprises: determining a variation amplitude of the target position based on the target position; determining the target position at a first frequency when the target position change amplitude exceeds a threshold range; when the target position change amplitude does not exceed a threshold range, determining the target position at a second frequency; wherein the first frequency is greater than the second frequency.

In some embodiments, the method further comprises: based on the designated position, one or more adaptive positions adjacent to the designated position are determined, ultrasonic waves loading audio signals are emitted through the ultrasonic assembly, and the audio signals are generated at the designated position and the adaptive positions adjacent to the designated position.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: the ultrasonic waves loaded with the audio signals are emitted by a plurality of ultrasonic transducers arranged on the mobile terminal, and the audio signals are generated at the designated positions, so that a user can hear the sound at the designated positions. And the audio signal is formed only at a designated position, which ensures privacy. And elements such as earphones and the like are not needed for playing the sound, so that the comfort of the user is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a block diagram of a mobile terminal according to an exemplary embodiment.

FIG. 2 is a schematic diagram illustrating the structure of an ultrasound assembly according to an exemplary embodiment.

Fig. 3 is a schematic diagram illustrating an ultrasonic transducer according to an exemplary embodiment.

Fig. 4 is a flow chart illustrating a method of sound playback according to an exemplary embodiment.

Fig. 5 is a flow chart illustrating another sound playing method according to an example embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

In order to solve the above problem, the present disclosure provides a mobile terminal 10, where the mobile terminal 10 may be a mobile phone, a tablet computer, or other portable devices. As shown in fig. 1, the mobile terminal 10 may include: the ultrasonic module 11, the ultrasonic module 11 may be provided in plurality. The ultrasonic component 11 may be disposed on the front surface of the mobile terminal 10, or may be disposed on the back surface of the mobile terminal 10, or may be disposed on both the front surface and the back surface of the mobile terminal 10. Wherein the ultrasound assembly 11 may include one or more ultrasound transducers 111; the ultrasonic assembly 11 emits ultrasonic waves loaded with audio signals through one or more ultrasonic transducers 111 and causes audio signals to be generated at one or more designated locations. Wherein the number of ultrasound assemblies 11 is greater than or equal to twice the number of designated positions.

In the disclosed embodiment, the audio signal may be a sound that can be heard by a human, i.e. the frequency of the audio signal is within a range that can be accepted by the human ear. The ultrasonic wave has directivity, and the ultrasonic wave can be loaded on the audio signal by modulating the audio signal and the ultrasonic wave, so that the directivity propagation of the audio signal is realized. Meanwhile, the audio signal can be regenerated because the ultrasonic waves can generate a nonlinear effect when propagating in the air, namely nonlinear attenuation of the ultrasonic waves. Through certain calculation, the audio signal can be determined to be regenerated at the specified position, so that people at the specified position can hear the sound, and other positions can not hear or can not clearly hear the sound, and the privacy of playing the sound by the mobile terminal can be improved.

Multiple ultrasound assemblies 11 may form an array, with audio signals formed at designated locations by the phase differences of the sound emissions of the different ultrasound assemblies 11. It is necessary to ensure that the number of ultrasonic assemblies 11 is greater than or equal to twice the number of designated positions. The number of the ultrasonic assemblies 11 may be set according to the number of the designated positions preset as required, or the upper limit value of the number of the designated positions may be determined according to the number of the ultrasonic assemblies 11.

The ultrasonic transducers 111 on the same side of the present disclosure may face in the same direction, for example, the ultrasonic transducers 111 on the front side of the mobile terminal 10 may all emit ultrasonic waves perpendicular to the front side of the mobile terminal 10.

In some embodiments, the mobile terminal 10 may further include: a control unit (not shown) for applying an audio signal to the ultrasonic wave and controlling the ultrasonic unit 11 to emit the ultrasonic wave applied with the audio signal. In this embodiment, the control component may include a chip of the mobile terminal, or may include a chip independently disposed corresponding to the ultrasound component 11. And an encoder, an amplifier and the like can be included. The control module may modulate the remaining ultrasonic waves according to the audio signal, thereby applying the audio signal to the ultrasonic waves and further controlling the ultrasonic module 11 to emit the ultrasonic waves.

In the embodiment of the present disclosure, the designated location may be a factory preset location of the mobile terminal 10, or may be a location determined by a user, and an audible sound may be formed within a certain range near the designated location.

In some embodiments, the control component may apply an audio signal to the ultrasonic waves through a parametric array algorithm, resulting in the ultrasonic waves emitted by each ultrasonic transducer 111. The acoustic parametric array is characterized in that an amplitude modulation technology is applied to load an audio signal on an ultrasonic carrier, then the audio signal is transmitted to the air by using a transducer, and the original audio signal is subjected to continuous self-demodulation under the action of air nonlinearity in the transmission process, and the carrier is ultrasonic and has strong directivity, so that the directional transmission of sound is realized. The audio directional propagation established according to the acoustic parametric array can adopt a classical berktay far-field solution as a theoretical basis, namely, a modulated signal taking ultrasonic waves as carriers is subjected to air nonlinear action, and an audio signal self-demodulated by the air nonlinear action is in direct proportion to a second derivative of the square of an envelope of an original modulated signal, so that the modulated signal needs to be preprocessed to improve the audio reduction quality and achieve optimal harmonic distortion and amplitude output.

In addition, in the embodiment of the present disclosure, the ultrasonic transducer 111 may be a piezoelectric micro-mechanical ultrasonic transducer (PMUT). To ensure miniaturization, many settings can be made on the mobile terminal 10. The larger the number, the better the focusing effect and the larger the sound pressure level. Since the piezoelectric Micro-Mechanical ultrasonic transducer is manufactured by a Micro-Electro-Mechanical System (MEMS) process, the piezoelectric Micro-Mechanical ultrasonic transducer has greater process compatibility with an integrated circuit. Miniaturization can be achieved, and the size of one ultrasonic transducer 111 is less than 1 mm. Large-scale preparation and packaging can be realized.

In some embodiments of the present disclosure, the mobile terminal 10 may further include: the positioning component is used for determining the target position; the control component determines a specified location based on the target location. In this embodiment, the mobile terminal 10 may be provided with an element for determining a target position, so as to determine a position conveniently and efficiently, so as to enable the control component to determine a designated position, and then modulate the audio signal and the ultrasonic wave according to the designated position, so that the ultrasonic wave emitted by the ultrasonic component 11 can regenerate an audio signal that can be heard by a person at the designated position.

In the embodiment of the present disclosure, the designated position may be one or more. The designated location needs to be on the side of the ultrasound assembly 11 that is facing. For example, in the case where the ultrasound assembly 11 is provided only on the front side of the mobile terminal 10, the designated position also needs to be within a space in the front direction of the mobile terminal 10. For another example, in the case where the ultrasonic module 11 is provided on both the front and rear surfaces of the mobile terminal 10, the designated location may have a plurality and be located on both the front and rear surfaces of the mobile terminal 10. If there are a plurality of designated positions, audible sound can be formed by superimposing ultrasonic waves of a part of the ultrasonic assemblies 11 for different designated positions, respectively. In some embodiments of the present disclosure, the target location may be a location of the head of the identified person; when a plurality of heads of persons are recognized, a plurality of designated positions are determined, and ultrasonic waves to which audio signals are applied are emitted by the plurality of ultrasonic transducers 111 and audio signals are generated at the plurality of designated positions, respectively.

In some embodiments of the present disclosure, the positioning assembly may include one or more of: the device comprises a visible light camera, an infrared camera, a UWB component, a distance sensor and a depth of field camera. The visible light camera can be used for collecting images and identifying the position of the head of a person through the images. And information such as the distance of a target can be acquired by a principle similar to a binocular camera formed by a plurality of visible light cameras. Infrared cameras may also perform image acquisition and distance acquisition in some environments. The UWB (Ultra Wide Band) technology is a wireless carrier communication technology, which does not use a sinusoidal carrier but uses nanosecond-level non-sinusoidal narrow pulses to transmit data, and thus occupies a Wide frequency spectrum. And UWB enables relatively accurate positioning. The distance sensor may be a visible light sensor, an infrared sensor, an ultrasonic sensor, or the like that can detect the distance to the target. The depth camera may capture a depth image. The head position of the person can be conveniently and accurately determined by using the components singly or in combination.

In some embodiments of the present disclosure, the target position is an identified human ear position, including a left ear position and a right ear position. In this embodiment, can confirm the position more accurately, distinguish left and right ears. Carry out accurate input, another part supersound subassembly 11 carries out accurate input to the auricle position through some supersound subassembly 11 to left ear position, distinguishes left right sound channel, and everyone can receive two sound sources promptly, forms the stereo effect.

In some embodiments of the present disclosure, the positioning assembly is configured to: determining the target position at a first frequency when the target position variation amplitude exceeds a threshold range; when the target position variation amplitude does not exceed the threshold range, determining the target position at a second frequency; wherein the first frequency is greater than the second frequency. In this embodiment, the variation range of the target position may be determined by the positioning component or the control component. For example, the moving distance of the object per unit time in the image. When the change amplitude of the target position exceeds the threshold range, the target position is determined at a relatively high first frequency, so that the target can be ensured to clearly listen to sound all the time in the moving process. When the target position variation amplitude does not exceed the threshold range, the target position is determined at a relatively low second frequency, and the power consumption of the positioning assembly is reduced as much as possible under the condition that the target basically keeps the position.

In some embodiments of the present disclosure, the control component is further configured to determine one or more adaptive positions adjacent to the designated position based on the designated position, emit ultrasonic waves loading the audio signal through the ultrasonic component 11, and generate the audio signal at the designated position and the adaptive positions adjacent thereto. In this embodiment, after the designated position is determined, a plurality of fitting positions may be further determined near the corresponding designated position, and the ultrasonic waves may be delivered to the fitting positions. Therefore, when the personnel move within the range of the specified position in a small range, the personnel can be ensured to receive the audio signal.

In some embodiments of the present disclosure, the designated location needs to satisfy a near field length N that is greater than or equal to the ultrasonic assembly 11, i.e., the designated location needs to be located in the far field range of the ultrasonic assembly 11 in order to regenerate the audio information in the far field. And the near field length N satisfies:

where D is the equivalent diameter of the ultrasonic transducer 111 as the sound source, and λ is the wavelength of the sound wave, i.e., the ultrasonic wave.

According to the disclosed embodiment, the transmitting signal of each ultrasonic assembly 11 is determined according to the designated position, the ultrasonic transducer 111 of each ultrasonic assembly 11 is used for transmitting ultrasonic waves, the focusing of the sound waves is realized, and audible sound is formed near the designated position. The privacy of sound is guaranteed, and the comfort of a user is improved.

For example, the ultrasound assembly 11 is disposed on the front side of the mobile terminal 10, and the front camera, which may be a screen camera or a top camera, is also disposed on the front side of the mobile terminal 10. For another example, an ultrasonic module 11 is disposed on the back of the mobile terminal 10, and a rear camera is also disposed on the back of the mobile terminal 10. For another example, in a case where the ultrasound components 11 are disposed on the front and back sides of the mobile terminal 10 at the same time, the mobile terminal 10 may perform image acquisition through the front camera and the rear camera at the same time, determine persons in front of and behind the mobile terminal, and further determine a designated position. Each face position can be respectively determined as a designated position; or only the face with the largest area (namely the face closest to the user) can be determined as a designated position; it is also possible that after each face location is identified, the user determines one or more of them as designated locations. After a plurality of designated positions are determined, audible sound can be formed at different designated positions through different ultrasonic assemblies, so that the requirements of multiple people are met.

In some embodiments of the present disclosure, as shown in fig. 2, each ultrasonic assembly 11 may include a plurality of ultrasonic transducers 111, wherein the plurality of ultrasonic transducers 111 may include: at least one first ultrasonic transducer 111a, and at least one second ultrasonic transducer 111 b; the center frequencies of the first ultrasonic transducer 111a and the second ultrasonic transducer 111b are different. Because each ultrasonic transducer 111 needs to be communicated with a control line to realize control, a plurality of ultrasonic transducers 111 can be set as a group to form an ultrasonic assembly 11, and all the ultrasonic transducers 111 in one ultrasonic assembly 11 are controlled by one control line, so that the ultrasonic assembly is more convenient, the space is saved, and the cost is reduced.

The center frequency of the ultrasonic transducer 111 determines the bandwidth. For example, the ultrasonic transducer 111 with a center frequency of 100Hz has a bandwidth of 100Hz + -10%, i.e., 90Hz-110 Hz. If the center frequencies of all the ultrasonic transducers 111 in an ultrasonic assembly 11 are the same, the bandwidth of the ultrasonic assembly 11 is + -10% of the center frequency. Whereas if the center frequencies between the ultrasonic transducers 111 in one ultrasonic assembly 11 are not exactly the same, the bandwidth of this ultrasonic assembly 11 is determined on a ± 10% basis of each center frequency. For example, one ultrasound assembly 11 includes a first ultrasound transducer 111a and a second ultrasound transducer 111b, the first ultrasound transducer 111a having a center frequency of 100Hz and the second ultrasound transducer 111b having a center frequency of 90 Hz. The bandwidth of the ultrasonic assembly 11 is obtained by combining the bandwidths of the first ultrasonic transducer 111a and the second ultrasonic transducer 111b, wherein the bandwidth of the first ultrasonic transducer 111a is 90Hz to 110Hz, the bandwidth of the second ultrasonic transducer 111b is 81Hz to 99Hz, and the bandwidth of the ultrasonic assembly 11 is 81Hz to 110 Hz.

Therefore, the ultrasonic assembly 11 has a wider bandwidth by having a plurality of ultrasonic transducers 111 with different sizes and different center frequencies inside the ultrasonic assembly 11. In the embodiment disclosed, it is not excluded that the ultrasonic assembly 11 further has the ultrasonic transducers 111 other than the first ultrasonic transducer and the second ultrasonic transducer, resulting in an ultrasonic assembly with more center frequencies.

In some embodiments of the present disclosure, as shown in fig. 1 and fig. 2, a distance between any two ultrasonic transducers 111 is greater than or equal to λ/2, where λ is a wavelength of the ultrasonic wave emitted by the ultrasonic transducers 111. In the embodiment of the present disclosure, the distance between any two ultrasound transducers 111 includes the distance between the ultrasound transducers 111 of different ultrasound assemblies 11, and also includes the distance between the ultrasound transducers 111 in the same ultrasound assembly 11, which are all required to be greater than or equal to λ/2. Thereby ensuring the propagation and superposition of the ultrasonic waves.

In some embodiments of the present disclosure, as shown in fig. 1, a plurality of ultrasonic components 11 are disposed on the front surface of the mobile terminal 10 and located on at least one side of the mobile terminal 10 to emit ultrasonic waves in a direction perpendicular to the front surface of the mobile terminal 10. In this embodiment, the ultrasonic module 11 is disposed on the front surface of the mobile terminal 10, and may be disposed on one side of the top edge of the mobile terminal 10, one side of the bottom edge of the mobile terminal 10, or two sides of the mobile terminal 10. In some embodiments of the present disclosure, as shown in fig. 1, the mobile terminal 10 further includes: a display 13 disposed on the front side of the mobile terminal 10; a plurality of ultrasound components 11 are disposed around the display screen. In this embodiment, the front surface of the mobile terminal 10 is further provided with a display screen, and the ultrasonic transducers 111 may be disposed around the display screen, so as to avoid shielding. In the embodiment of the present disclosure, the periphery of the display screen is the peripheral side of the display screen, is located outside the display screen area, and does not include the area of the display screen. By providing the ultrasonic unit 11 on the front surface, it is possible to easily perform fixed-point delivery of sound when the user uses the mobile terminal 10 on the front surface. And when a user watches the picture of the display screen, the corresponding sound can be played, and the user experience is improved.

In some embodiments of the present disclosure, the ultrasound assembly 11 is disposed on the back side of the mobile terminal 10; and is located in the middle and/or at least one side of the rear surface of the mobile terminal 10. In this embodiment, the back of the mobile terminal 10 is provided with the ultrasonic component 11, and the ultrasonic component 11 provided on the back of the mobile terminal 10 may be provided in the middle of the back and at any position of the side. Because the back of the mobile terminal 10 is generally not provided with a display screen, and there is no large-area shielding, the ultrasound components 11 can be distributed more widely, and more ultrasound components 11 can be provided to improve the focusing effect and increase the sound pressure level.

In some embodiments of the present disclosure, as shown in fig. 3, the ultrasonic transducer 111 is a Piezoelectric Micromachined Ultrasonic Transducer (PMUT), comprising: a silicon-based support 21; the silicon film 22 is arranged on the silicon-based support 21; and a piezoelectric module 23 disposed on the silicon thin film 22, wherein the piezoelectric module 23 includes a first conductive layer 231, a second conductive layer 233, and a piezoelectric layer 232 disposed between the first conductive layer 231 and the second conductive layer 233. The ultrasonic transducer 111 can be fabricated by MEMS process, resulting in the above-mentioned result, thereby realizing miniaturization. More ultrasonic transducers 111 can be provided at more locations of the mobile terminal 10 or in a certain area.

Based on the same inventive concept, as shown in fig. 4, the present disclosure also provides a sound playing method, which can be applied to the mobile terminal 10 according to any of the foregoing embodiments; the sound playing method may include: step S11, emitting ultrasonic waves loading the audio signal through one or more ultrasonic transducers, and causing the audio signal to be regenerated at one or more designated locations. By emitting ultrasonic waves loading an audio signal through the plurality of ultrasonic transducers 111 provided to the mobile terminal 10 and reproducing the audio signal at a designated position, a user can hear a sound near the designated position. Privacy is guaranteed, and comfort of the user is improved.

In some embodiments of the present disclosure, the sound playing method may further include: determining an audio signal; and loading the audio signal into the ultrasonic wave through a parametric array algorithm to obtain the ultrasonic wave correspondingly transmitted by each ultrasonic transducer.

In some embodiments of the present disclosure, as shown in fig. 5, the sound playing method may further include: step S12, determining the target position; in step S13, the specified position is determined based on the target position. In this embodiment, the target position may be determined by the positioning component, and then the specified position may be determined by the control component. In some embodiments, step S12 may include identifying a location of a person' S head; based on the position of the person's head, a target position is determined. In this example, the corresponding position is determined to be the target position by recognizing the head of the person. For example, a camera acquires a current image in real time, and further determines a face position in the image, i.e., a target position, in a face recognition mode or the like. Further, the designated position can be determined according to the face position. The position of a person can be conveniently determined by the method of the embodiment, the person needing to listen to the sound is determined, and then the ultrasonic wave is emitted by the ultrasonic transducer 111 and the person is in the position, namely the designated position, to form the audible sound.

In some embodiments of the present disclosure, the sound playing method may further include: determining human ear positions based on the position of the head of the person, wherein the human ear positions comprise a left ear position and a right ear position; and respectively loading the audio signal of the left channel and the audio signal of the right channel into ultrasonic waves for transmission, and respectively generating the signals at the left ear position and the right ear position. In this application implementation, can carry out accurate input, another part supersound subassembly 11 carries out accurate input to the auricle position to the left ear position through some supersound subassembly 11, distinguishes left right sound channel, and everyone can receive two sound sources promptly, forms the stereo effect.

In some embodiments of the present disclosure, the sound playing method may further include: determining the variation amplitude of the target position based on the target position; determining the target position at a first frequency when the target position variation amplitude exceeds a threshold range; when the target position change amplitude does not exceed the threshold range, determining the target position at a second frequency; wherein the first frequency is greater than the second frequency. In this embodiment, the variation range of the target position may be determined by the positioning component or the control component. For example, the moving distance of the object per unit time in the image. When the change amplitude of the target position exceeds the threshold range, the target position is determined at a relatively high first frequency, so that the target can be ensured to clearly listen to sound all the time in the moving process. When the target position variation amplitude does not exceed the threshold range, the target position is determined at a relatively low second frequency, and the power consumption of the positioning assembly is reduced as much as possible under the condition that the target basically keeps the position.

In some embodiments of the present disclosure, the sound playing method may further include: based on the designated position, one or more adapted positions adjacent to the designated position are determined, ultrasonic waves loading the audio signal are emitted through the ultrasonic assembly, and the audio signal is generated at the designated position and the adapted positions adjacent to the designated position. In this embodiment, after the designated position is determined, a plurality of fitting positions may be further determined near the corresponding designated position, and the ultrasonic waves may be delivered to the fitting positions. Therefore, when the personnel move within the range of the specified position in a small range, the personnel can be ensured to receive the audio signal.

It is understood that "plurality" in this disclosure means two or more, and other terms are analogous. "and/or" describes the association relationship of the associated object, indicating that there may be three relationships, for example, a and/or B, which may indicate: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. The singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

It will be further understood that the terms "first," "second," and the like are used to describe various information and that such information should not be limited by these terms. These terms are only used to distinguish one type of information from another and do not denote a particular order or importance. Indeed, the terms "first," "second," and the like are fully interchangeable. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure.

It will be further understood that the terms "central," "longitudinal," "lateral," "front," "rear," "upper," "lower," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are used in an orientation or positional relationship indicated in the drawings for convenience in describing the present embodiment and to simplify the description, but do not indicate or imply that the referenced device or element must have a particular orientation, be constructed and operated in a particular orientation.

It is further understood that, unless otherwise specified, "connected" includes direct connections between the two without other elements and indirect connections between the two with other elements.

It is further to be understood that while operations are depicted in the drawings in a particular order, this is not to be understood as requiring that such operations be performed in the particular order shown or in serial order, or that all illustrated operations be performed, to achieve desirable results. In certain environments, multitasking and parallel processing may be advantageous.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice in the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A mobile terminal, characterized in that the mobile terminal comprises:

a plurality of ultrasonic assemblies disposed on the mobile terminal, wherein each of the ultrasonic assemblies comprises an ultrasonic transducer;

the ultrasonic assemblies emit ultrasonic waves loaded with audio signals through the ultrasonic transducers and enable the audio signals to be generated at one or more specified positions, wherein the number of the ultrasonic assemblies is larger than or equal to twice the number of the specified positions.

2. The mobile terminal of claim 1, wherein the mobile terminal further comprises: the control component is used for loading the audio signal to the ultrasonic wave and controlling the ultrasonic component to emit the ultrasonic wave loaded with the audio signal.

3. The mobile terminal according to claim 2, wherein the control component loads the audio signal into ultrasonic waves through a parametric array algorithm, so as to obtain ultrasonic waves transmitted by each ultrasonic transducer correspondingly.

4. The mobile terminal of claim 2, wherein the mobile terminal further comprises: a positioning component for determining a target location; the control component determines the specified location based on the target location.

5. The mobile terminal of claim 4, wherein the target location is a location of a head of the identified person; when the heads of a plurality of persons are identified, a plurality of designated positions are determined, ultrasonic waves for loading audio signals are transmitted through a plurality of ultrasonic transducers respectively, and the audio signals are generated at the designated positions.

6. The mobile terminal of claim 4, wherein the positioning component comprises one or more of: the device comprises a visible light camera, an infrared camera, a UWB component, a distance sensor and a depth of field camera.

7. The mobile terminal of claim 4, wherein the target location is an identified human ear location, comprising a left ear location and a right ear location.

8. The mobile terminal of claim 4, wherein the positioning component is configured to: determining the target position at a first frequency when the target position change amplitude exceeds a threshold range; determining the target position at a second frequency when the target position variation amplitude does not exceed a threshold range; wherein the first frequency is greater than the second frequency.

9. The mobile terminal of claim 4, wherein the control component is further configured to determine one or more adaptive positions adjacent to the designated position based on the designated position, transmit ultrasonic waves loading audio signals through the ultrasonic component, and enable the audio signals to be generated at the designated position and the adaptive positions adjacent thereto.

10. The mobile terminal of any of claims 1-9, wherein each of the ultrasonic assemblies comprises a plurality of ultrasonic transducers, comprising: at least one first ultrasonic transducer, and at least one second ultrasonic transducer;

the center frequencies of the first ultrasonic transducer and the second ultrasonic transducer are different.

11. The mobile terminal according to any of claims 1-9, wherein the distance between any two of the ultrasonic transducers is greater than or equal to λ/2, where λ is the wavelength of the ultrasonic waves emitted by the ultrasonic transducers.

12. The mobile terminal of any of claims 1-9, wherein the specified location is greater than or equal to a near-field length N of the ultrasound assembly,

13. The mobile terminal according to any of claims 1-9, wherein a plurality of said ultrasound components are disposed on a front face of said mobile terminal and located on at least one side of said mobile terminal, and emit ultrasound waves in a direction perpendicular to said front face of said mobile terminal.

14. The mobile terminal of claim 13, wherein the mobile terminal further comprises: the display screen is arranged on the front side of the mobile terminal;

the ultrasonic components are arranged on the periphery of the display screen.

15. The mobile terminal of any of claims 1-9, wherein the ultrasound assembly is disposed on a back side of the mobile terminal; and is located in the middle and/or at least one side of the back of the mobile terminal.

16. A mobile terminal according to any of claims 1-9, wherein the ultrasonic transducer is a piezoelectric micromachined ultrasonic transducer comprising:

a silicon-based stent;

the silicon film is arranged on the silicon-based support;

and the piezoelectric module is arranged on the silicon film and comprises a first conducting layer, a second conducting layer and a piezoelectric layer arranged between the first conducting layer and the second conducting layer.

17. A sound playing method, characterized by being applied to a mobile terminal according to any one of claims 1-16; the sound playing method comprises the following steps:

transmitting, by the one or more ultrasonic transducers, ultrasonic waves loading an audio signal and causing the audio signal to be generated at one or more designated locations.

18. The sound playing method of claim 17, wherein the method further comprises:

determining the audio signal;

and loading the audio signal into ultrasonic waves through a parametric array algorithm to obtain the ultrasonic waves correspondingly transmitted by each ultrasonic transducer.

19. The sound playing method of claim 17, wherein the method further comprises:

determining a target position;

determining the specified location based on the target location.

20. The sound playing method of claim 19, wherein the determining the target location comprises:

identifying a position of a person's head;

determining the target location based on the position of the person's head.

21. The sound playing method of claim 20, wherein the method further comprises:

determining a human ear position based on the position of the human head, the human ear position comprising a left ear position and a right ear position;

and respectively loading the audio signal of the left channel and the audio signal of the right channel into ultrasonic waves for transmission, and respectively generating the signals at the left ear position and the right ear position.

22. The sound playing method of claim 19, wherein the method further comprises:

determining a variation amplitude of the target position based on the target position;

when the target position change amplitude exceeds a threshold range, determining the target position at a first frequency;

when the target position change amplitude does not exceed a threshold range, determining the target position at a second frequency;

wherein the first frequency is greater than the second frequency.

23. The sound playing method of claim 19, wherein the method further comprises:

based on the designated position, one or more adaptive positions adjacent to the designated position are determined, ultrasonic waves loading audio signals are emitted through the ultrasonic assembly, and the audio signals are generated at the designated position and the adaptive positions adjacent to the designated position.