CN111756929A - Multi-screen terminal audio playing method and device, terminal equipment and storage medium - Google Patents
Multi-screen terminal audio playing method and device, terminal equipment and storage medium Download PDFInfo
- Publication number
- CN111756929A CN111756929A CN202010594658.5A CN202010594658A CN111756929A CN 111756929 A CN111756929 A CN 111756929A CN 202010594658 A CN202010594658 A CN 202010594658A CN 111756929 A CN111756929 A CN 111756929A
- Authority
- CN
- China
- Prior art keywords
- screen
- terminal
- audio
- transfer function
- audio playing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Stereophonic System (AREA)
- Telephone Function (AREA)
Abstract
The application discloses a multi-screen terminal audio playing method, a multi-screen terminal audio playing device, terminal equipment and a storage medium, wherein the use scene information of a terminal screen is detected; selecting a corresponding preset audio transfer function according to the detected using scene information of the terminal screen; and processing the audio output by the terminal by using the selected audio transfer function and then outputting the processed audio. The invention solves the problem that the difference of audio playing effects is larger when a multi-screen terminal (such as a front-screen and back-screen mobile phone) uses different screens, so that stereo output can be adjusted in real time by using different screens, and the optimal listening effect is achieved.
Description
Technical Field
The present application relates to the field of audio playing technologies, and in particular, to an audio playing method and apparatus for a multi-screen terminal, a terminal device, and a storage medium.
Background
With the development of electronic technology, electronic devices, especially mobile phones, are pursuing screen occupation ratio more and more. In order to form a higher screen ratio on a limited body, some mobile phones use front and back double screens, some mobile phones use a flexible screen folding mode, and other mobile phones use flexible screens to wrap the front and back surfaces of the body of the mobile phone, so that screens are formed on the front and back surfaces of the body of the mobile phone.
The front and back screen mobile phone is characterized in that the mobile phone can be used in a forward mode or a reverse mode without distinguishing the front side from the back side. The use mode without distinguishing the front side and the back side presents a great challenge to the design experience of the mobile phone although certain technological sense and convenience are brought.
For example, stereo implementations need to be optimized. Many portable electronic devices can achieve a stereo effect at present. Which is generally done by configuring two independent audio channels and then implementing surround sound in an object-based manner.
In an object based system different audio elements are encoded with position equal element data and vector information at the time of mixing, combined with Head Related Transfer Functions (HRTFs), to output the same immersive surround sound either through standard stereo headphones or two separate stereo channels.
In addition to the HRTF, it is also possible to form an optimal sound field in a direction pointing to the human head using a beamforming (beamforming) technique of two speakers.
However, for a front-back screen mobile phone, basically, the audio difference when different screens are used is not distinguished, but the relative position relationship between the human ear and the loudspeaker is changed, the effect of synthesizing a stereo sound field is also changed, the fixed HRTF and beamforming parameters can only satisfy the use of one side, and when a user rotates one side, if the same parameters are used, the hearing effect is deteriorated.
Disclosure of Invention
The present application mainly aims to provide an audio playing method and apparatus for a multi-screen terminal, a terminal device, and a storage medium, and aims to solve the problem that when a multi-screen terminal (e.g., a front-back screen mobile phone) uses different screens, the audio playing effect is greatly different.
In order to achieve the above object, the present application provides a multi-screen terminal audio playing method, where the multi-screen terminal audio playing method includes the following steps:
detecting the use scene information of a terminal screen;
selecting a corresponding preset audio transfer function according to the detected using scene information of the terminal screen;
and processing the audio output by the terminal by using the selected audio transfer function and then outputting the processed audio.
The embodiment of the present application further provides a multi-screen terminal audio playing device, where the multi-screen terminal audio playing device includes:
the detection module is used for detecting the use scene information of the terminal screen;
the selection module is used for selecting a corresponding preset audio transfer function according to the detected using scene information of the terminal screen;
and the playing module is used for processing the audio output by the terminal by using the selected audio transfer function and then outputting the processed audio.
The embodiment of the present application further provides a terminal device, where the terminal device includes a memory, a processor, and a multi-screen terminal audio playing program stored in the memory and capable of running on the processor, and the multi-screen terminal audio playing program is executed by the processor to implement the steps of the multi-screen terminal audio playing method described above.
The embodiment of the present application further provides a computer-readable storage medium, where a multi-screen terminal audio playing program is stored on the computer-readable storage medium, and when the multi-screen terminal audio playing program is executed by a processor, the steps of the multi-screen terminal audio playing method described above are implemented.
According to the multi-screen terminal audio playing method, the multi-screen terminal audio playing device, the terminal equipment and the storage medium, the use scene information of the terminal screen is detected; selecting a corresponding preset audio transfer function according to the detected using scene information of the terminal screen; and processing the audio output by the terminal by using the selected audio transfer function and then outputting the processed audio. Therefore, the corresponding preset audio transfer function is selected to perform audio processing according to different screen use scenes, so that the technical problem that the difference of audio playing effects of a multi-screen terminal (such as a front-screen mobile phone and a rear-screen mobile phone) is large when different screens are used is solved, stereo output can be adjusted in real time by using different screens, and the optimal listening effect is achieved. For example, according to the scheme, two different audio transfer functions are preset for the front and rear screen mobile phones, and each audio transfer function corresponds to audio processing in different screen use scenes. When the user uses the front screen, the audio transfer function A is used for audio processing; when it is judged that the user uses the back screen, the audio is processed using the audio transfer function B. Therefore, the output audio effect is adjusted according to different screen use scenes of the mobile phone, and the stereo effect is kept consistent when the front and back screen mobile phones are used on the front and back sides. In addition, the structure design of the mobile phone can be combined, the opening of the loudspeaker at the position of the receiver faces the top, and therefore the difference of audio effects caused by the use of a front screen and a rear screen in the structure is avoided.
Drawings
Fig. 1 is a schematic diagram of functional modules of a terminal device to which a multi-screen terminal audio playing device of the present application belongs;
fig. 2 is a flowchart illustrating an exemplary embodiment of an audio playing method for a multi-screen terminal according to the present application;
fig. 3 is a flowchart illustrating another exemplary embodiment of an audio playing method for a multi-screen terminal according to the present application.
The implementation, functional features and advantages of the objectives of the present application will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The main solution of the embodiment of the application is as follows: detecting the use scene information of a terminal screen; selecting a corresponding preset audio transfer function according to the detected using scene information of the terminal screen; and processing the audio output by the terminal by using the selected audio transfer function and then outputting the processed audio. Therefore, for different screen use scenes, the corresponding preset audio transfer function is selected for audio processing, and the technical problem that the difference of audio playing effects is large when a multi-screen terminal (such as a front-back screen mobile phone) uses different screens is solved. For example, according to the scheme, two different audio transfer functions are preset for the front and rear screen mobile phones, and each audio transfer function corresponds to audio processing in different screen use scenes. When the user uses the front screen, the audio transfer function A is used for audio processing; when it is judged that the user uses the back screen, the audio is processed using the audio transfer function B. Therefore, the output audio effect is adjusted according to different screen use scenes of the mobile phone, and the stereo effect is kept consistent when the front and back screen mobile phones are used on the front and back sides. In addition, the structure design of the mobile phone can be combined, the opening of the loudspeaker at the position of the receiver faces the top, and therefore the difference of audio effects caused by the use of a front screen and a rear screen in the structure is avoided.
The technical terms related to the embodiments of the present application are:
HRTF: Head-Response Transfer Function, Head-related Transfer Function or Head-Response Transfer Function. The sound positioning algorithm is a sound positioning algorithm, a sound positioning processing technology, the principle is complex, and because sound can be reflected to the inside of human ears from auricles or shoulders, when two sound boxes are used for simulating sound positioning, the size, tone and the like generated by sound in different directions or positions can be calculated by utilizing the HD ITD operation mode, and further the stereo space sound positioning effect is manufactured. Besides using two technologies of HD ITD, the HRTF also utilizes the technology of making a dummy head to pick up sound to calculate a stereo sound surrounding model, so that better sound effect than the HD ITD can be obtained.
In particular, the functional principle of the HRTF can be described in several main steps:
the first step is as follows: making a head model and installing a microphone to the position of the eardrum;
the second step is that: emitting some sound from a fixed location;
the third step: analyzing the sound obtained from the microphone and obtaining specific data changed by the model;
the fourth step: designing an audio filter to mimic that effect;
the fifth step: when it is desired to mimic the sound emitted from a location, the audio filter described above is used to mimic it. The response of the audio filter is considered to be an HRTF, which theoretically needs to be set for each place where a sound source may be present. In fact, an infinite number of HRTFs is not required. Because the human brain is not so accurate, it is sufficient to distribute approximately 1000 such functions over a hemispherical surface with the origin at the human head, while the other half should be symmetrical. The distance sense can be realized by data changes such as reverberation and loudness.
Front and back screen mobile phone: the front and back screen mobile phone related in the scheme of the embodiment of the application comprises: front and back double screens, flexible folding screens, mobile phones with the body directly wrapped by the flexible screens, and the like.
The front screen and the rear screen are double screens, namely two screens are used and cover the front side and the back side of the mobile phone.
The flexible folding screen is a folding screen using a flexible screen folding mode, is a large plane when unfolded for use, is located on the outer side after being folded, wraps the machine body, and is provided with a screen at the front and the back.
The flexible screen is directly wrapped, namely the screen is directly fixed around the machine body in a circle, so that a 'whole body screen' is realized.
In the present application, these types of mobile phones are referred to as front-back screen mobile phones.
Stereo, refers to an audio construction and generation format in which multiple audio signals are summed into two pairs of audio channels. Compared with a monaural audio system, a stereo audio signal contains information of the intensity and arrival time of sound, and both ears of a person act simultaneously, and direction and depth cues are simulated or generated by using the information. A stereo audio system requires two or more speakers, or a pair of headphones, to create a stereo sound effect.
At present, many electronic devices use a plurality of speakers to copy a single-channel audio signal, and simulate the spatialization effect of sound through a signal processing technology: panning (changing the amplitude of the input signal to the speaker) to achieve the sensation of left-right displacement or movement of the signal source; a low-pass filter (a filter that attenuates a signal of a predetermined frequency or higher and passes only a frequency of a predetermined frequency or lower) simulates a movement of a sound in a front-rear distance direction and mixes reverberation to realize an ambience effect.
Surround sound, refers to an enhanced audio system that combines digital signal processing techniques with four or more independent audio channels to input audio signals to surround a central auditory site to position an array of speakers according to a certain rule to produce a semi-immersive sound field. The sound field obtained by stereo sound is a sector area formed by the central auditory position and two speakers (head area for headphones). While surround sound is different, it expands the perceived sound field to a 360 ° circular area centered around the listener.
Such a surround sound implementation based on multiple independent audio channels is not practical for portable electronic products. Surround sound is generally achieved by configuring two independent audio channels and then by an object-based approach.
In an object-based system, different audio elements are encoded by position-like element data and vector information at the time of mixing. In conjunction with Head Related Transfer Functions (HRTFs) to output the same immersive surround sound through standard stereo headphones or two separate stereo channels.
In addition to HRTFs, a beam forming (beamforming) technique of two speakers may be used to form an optimal sound field in a direction pointing to a human head, but for front and rear screen mobile phones, fixed HRTFs and beamforming parameters can only satisfy one-sided use, and when a user turns over one side, if the same parameters are used, the auditory effect may be deteriorated.
The embodiment of the application considers that for a front-back screen mobile phone, basically, audio difference when different screens are used is not distinguished, the relative position relationship between human ears and a loudspeaker is changed, the effect of synthesizing a stereo sound field is also changed, fixed HRTF and beamforming parameters can only meet the use of one surface, and when a user rotates one surface, if the same parameters are used, the auditory effect is deteriorated.
In addition, the conventional mobile phone uses the position of the top receiver as one of the sound channels, and when the mobile phone is used in reverse, the speaker at the receiver is pointed to the back, so that the stereo effect is greatly reduced.
Therefore, the scheme provided by the embodiment of the application can solve the problem that the difference of audio playing effects is large when a multi-screen terminal (such as a front-back screen mobile phone) uses different screens, especially the problem that the difference of stereo playing effects is large when the front-back screen mobile phone is used on the front side and the back side.
Specifically, referring to fig. 1, fig. 1 is a schematic view of functional modules of a terminal device to which the multi-screen terminal audio playing device of the present application belongs. The multi-screen terminal audio playing device can be a device which is independent of the terminal equipment and can play audio, especially can realize a stereo effect, and can be borne on the terminal equipment in a hardware or software mode. The terminal device can be an intelligent mobile terminal with audio playing and data processing functions, such as a mobile phone and a tablet personal computer, and can also be a fixed terminal device or a server with audio playing and data processing functions.
In this embodiment, the terminal device to which the multi-screen terminal audio playing apparatus belongs at least includes an output module 110, a processor 120, a memory 130 and a communication module 140.
The memory 130 stores an operating system and a multi-screen terminal audio playing program, and the multi-screen terminal audio playing device can store information such as a preset audio transfer function, audio output by a terminal, detected use scene information of a terminal screen, and the like in the memory 130; the output module 110 may be a display screen, a speaker, etc. The communication module 140 may include a WIFI module, a mobile communication module, a bluetooth module, and the like, and communicates with an external device or a server through the communication module 140.
Wherein, the multi-screen terminal audio playing program in the memory 130 realizes the following steps when being executed by the processor:
detecting the use scene information of a terminal screen;
selecting a corresponding preset audio transfer function according to the detected using scene information of the terminal screen;
and processing the audio output by the terminal by using the selected audio transfer function and then outputting the processed audio.
Further, when being executed by the processor, the multi-screen terminal audio playing program in the memory 130 further implements the following steps:
and detecting whether the current screen used by the terminal is a front screen or a rear screen.
Further, when being executed by the processor, the multi-screen terminal audio playing program in the memory 130 further implements the following steps:
detecting the position information of a terminal screen relative to a user;
and detecting the position information of the terminal screen relative to the sound box.
Further, when being executed by the processor, the multi-screen terminal audio playing program in the memory 130 further implements the following steps:
if the current screen used by the terminal is detected to be a front screen, selecting a preset audio transfer function corresponding to the front screen;
and if the current screen used by the terminal is detected to be the rear screen, selecting the audio transfer function corresponding to the rear screen.
Further, when being executed by the processor, the multi-screen terminal audio playing program in the memory 130 further implements the following steps:
phase, pitch and/or frequency adjustment of audio output by the terminal is performed using the selected audio transfer function.
Further, when being executed by the processor, the multi-screen terminal audio playing program in the memory 130 further implements the following steps:
and configuring corresponding audio transfer functions according to different preset use scenes of the terminal screen.
Further, when being executed by the processor, the multi-screen terminal audio playing program in the memory 130 further implements the following steps:
and configuring a corresponding audio transfer function according to the front screen or the rear screen of the terminal use screen.
According to the scheme, the use scene information of the terminal screen is detected; selecting a corresponding preset audio transfer function according to the detected using scene information of the terminal screen; and processing the audio output by the terminal by using the selected audio transfer function and then outputting the processed audio. Therefore, for different screen use scenes, the corresponding preset audio transfer function is selected for audio processing, and the technical problem that the difference of audio playing effects is large when a multi-screen terminal (such as a front-back screen mobile phone) uses different screens is solved. For example, according to the scheme, two different audio transfer functions are preset for the front and rear screen mobile phones, and each audio transfer function corresponds to audio processing in different screen use scenes. When the user uses the front screen, the audio transfer function A is used for audio processing; when it is judged that the user uses the back screen, the audio is processed using the audio transfer function B. Therefore, the output audio effect is adjusted according to different screen use scenes of the mobile phone, and the stereo effect is kept consistent when the front and back screen mobile phones are used on the front and back sides. In addition, the structure design of the mobile phone can be combined, the opening of the loudspeaker at the position of the receiver faces the top, and therefore the difference of audio effects caused by the use of a front screen and a rear screen in the structure is avoided.
Based on the above terminal device architecture but not limited to the above architecture, embodiments of the method of the present application are provided.
Referring to fig. 2, fig. 2 is a flowchart illustrating an exemplary embodiment of an audio playing method for a multi-screen terminal according to the present application. The multi-screen terminal stereo realization method comprises the following steps:
step S101, detecting the use scene information of a terminal screen;
the execution main body of the method of the embodiment may be a multi-screen terminal audio playing device, or may also be a multi-screen terminal device, and the multi-screen terminal device may be a multi-screen mobile phone, and the like. In this embodiment, the mobile phone with front and rear screens is used as an example, and other multi-screen terminals can realize that the playing sound effects of different screen stereos are consistent according to the principle.
The scheme of the embodiment mainly solves the problem that the difference of audio playing effects is large when a multi-screen terminal (such as a front-back screen mobile phone) uses different screens, especially the problem that the difference of stereo playing effects is large when the front-back screen mobile phone is used on the front side and the back side.
In this embodiment, the implementation principle of the terminal stereo is as described above.
Stereo, as used herein, refers to an audio creation and generation format in which a plurality of audio signals are combined into two pairs of audio channels. Compared with a monaural audio system, a stereo audio signal contains information of the intensity and arrival time of sound, and both ears of a person act simultaneously, and direction and depth cues are simulated or generated by using the information. A stereo audio system requires two or more speakers, or a pair of headphones, to create a stereo sound effect. The scheme of the embodiment is suitable for a scene that the mobile phone realizes the stereo effect through the loudspeaker playing audio.
At present, many electronic devices use a plurality of speakers to copy a single-channel audio signal, and simulate the spatialization effect of sound through a signal processing technology: panning (changing the amplitude of the input signal to the speaker) to achieve the sensation of left-right displacement or movement of the signal source; a low-pass filter (a filter that attenuates signals above a predetermined frequency and passes only frequencies below the predetermined frequency) is used to simulate the movement of sound in the front-rear distance direction and to mix reverberation, thereby achieving an ambience effect.
In an object based system different audio elements are encoded with position equal element data and vector information at the time of mixing, combined with Head Related Transfer Functions (HRTFs), to output the same immersive surround sound either through standard stereo headphones or two separate stereo channels.
However, for a front-back screen mobile phone, the fixed HRTF and beamforming parameters can only satisfy the use of one surface, and when the user rotates one surface, if the same parameters are used, the auditory effect is deteriorated.
The scheme of the embodiment is that the audio transfer function is dynamically selected to adjust the output audio effect according to different screen use scenes of the mobile phone, so that the stereo effect of the front and rear screen mobile phones is kept consistent when the front and rear screens are used.
Specifically, the usage scenario information of the terminal screen is first detected.
Taking a mobile phone with a front screen and a rear screen as an example, in this embodiment, detecting the usage scenario information of the terminal screen may include detecting whether a current usage screen of the mobile phone is a front screen or a rear screen, so as to select a corresponding preset audio transfer function according to different screen usage scenarios, thereby implementing effective playing of audio.
The method comprises the steps of detecting whether a currently used screen of the mobile phone is a front screen or a rear screen, namely judging which screen is currently used by a user, and determining the screen according to the screen which is lightened recently. If the screen is bright recently (such as the screen selected when the mobile phone is used last time or used for a period of time recently) or the screen which is bright is the front screen, judging that the screen which is currently used by the mobile phone is the front screen; and if the screen is highlighted recently or the screen which is being highlighted is the back screen, selecting and judging that the currently used screen of the mobile phone is the back screen.
Further, detecting the usage scenario information of the terminal screen may further include: detecting the position information of a terminal screen relative to a user; if a sound box is arranged in the scene of playing the audio by the mobile phone, detecting the use scene information of the terminal screen can further comprise: and detecting the position information of the terminal screen relative to the sound box. Of course, in other embodiments, various other screen usage scenario information may also be detected according to the usage scenario of the mobile phone, for example, collecting environmental sound of the usage of the mobile phone, spatial information of the usage location of the mobile phone, and the like.
When the usage scene information of the terminal screen is detected, as an implementation manner, the usage scene information of the terminal screen can be triggered and detected when a user uses a mobile phone to play audio. For example, when it is detected that the user starts an audio playing application program on a mobile phone, the usage scenario information of the terminal screen is triggered and detected.
As another embodiment, the usage scenario information of the terminal screen may be triggered and detected when the mobile phone is powered on.
As another embodiment, an option may be provided to allow a user to select whether to start detecting usage scenario information of the terminal screen, for example, when the mobile phone is turned on or the user starts an audio playing application on the mobile phone, the user is prompted whether to start a terminal screen usage scenario detection function, if so, the terminal screen usage scenario detection function is started, and the usage scenario information of the terminal screen is detected, so as to select a corresponding audio transfer function according to different screen scenarios used by the mobile phone, and implement effective playing of audio.
Step S102, selecting a corresponding preset audio transfer function according to the detected using scene information of the terminal screen;
the method comprises the steps of detecting whether a current use screen of the terminal is a front screen or a rear screen, further detecting position information of the terminal screen relative to a user, position information of the terminal screen relative to a sound box and the like, obtaining use scene information of the detected terminal screen, and selecting a corresponding preset audio transfer function according to the detected use scene information of the terminal screen.
In practical application, the audio transfer function is related to external scene factors, such as a position of a sound box, a structure of a mobile phone, a shape and a size of the mobile phone, and in specific application, the audio transfer function can be arranged in an audio system similar to an audio box, and under different scenes, the phase, the frequency and the like of the current input audio are adjusted through the audio transfer function according to external factor conditions (such as a front screen and a rear screen of the mobile phone, the shape of the mobile phone, the relative position of a human body, a sound propagation path and the like) of the current scene, so as to meet the optimal effect of stereo sound under the current scene.
The embodiment is provided with a corresponding audio transfer function in advance according to the use scene information of the terminal screen. This is mainly to consider that the difference of audio playing effect is large when different screens are used, and it is not suitable to use the same audio transfer function. Therefore, different audio transfer functions are used according to the characteristics of different screens.
For example, for a front-screen and back-screen mobile phone, the corresponding audio transfer function when the front screen of the mobile phone is used is set as a, and the corresponding audio transfer function when the back screen of the mobile phone is used is set as B. The difference between the audio transfer functions of the two screens can be set according to the characteristics of different screens, for example, the appearance structure characteristics of a mobile phone at the screen side, the position of a mobile phone receiver and the like can be considered.
Further, when configuring the corresponding audio transfer function according to different preset usage scenarios of the terminal screen, the corresponding audio transfer function may be configured by combining one or more of the following information:
the position information of the terminal screen relative to the user, the position information of the terminal screen relative to the sound box, the external shape, structure and size of the terminal, the audio content and the like.
Specifically, for example, the usage scene information of the screen of the detection terminal includes whether the current usage screen of the detection terminal is a front screen or a rear screen, and if the current usage screen of the detection terminal is detected to be the front screen, a preset audio transfer function corresponding to the front screen is selected;
and if the current screen used by the terminal is detected to be the rear screen, selecting the audio transfer function corresponding to the rear screen.
And step S103, processing the audio output by the terminal by using the selected audio transfer function and then outputting the processed audio.
In this embodiment, the effect achieved by the terminal playing the audio includes, but is not limited to, a stereo audio playing effect.
Generally, a stereo audio signal includes information such as intensity and arrival time of sound, and after an audio transfer function is selected, the selected audio transfer function is used to perform phase, tone and/or frequency adjustment on audio output by a terminal, so as to achieve a better audio output effect.
Taking a front-screen mobile phone and a rear-screen mobile phone as an example, when the user is judged to use the front screen, the audio transfer function A is used for carrying out audio processing such as phase, tone and/or frequency adjustment; when the user is judged to use the back screen, audio processing such as phase, tone and/or frequency adjustment is performed on the audio using the audio transfer function B.
Examples are as follows:
whether the currently used screen of the mobile phone is a front screen or a rear screen is detected, namely which screen is currently used by the user is judged, and the current screen can be determined according to the screen which is lightened recently. If the most recently highlighted or currently highlighted screen is the front screen, the audio transfer function corresponding to the front screen is selected. If the screen that was recently highlighted or is being highlighted is the back screen, the audio transfer function corresponding to the back screen is selected. And then, processing the audio output by the mobile phone according to the audio transfer function selected by the user and outputting the processed audio.
According to the scheme, the use scene information of the terminal screen is detected; selecting a corresponding preset audio transfer function according to the detected using scene information of the terminal screen; and processing the audio output by the terminal by using the selected audio transfer function and then outputting the processed audio. Therefore, the corresponding preset audio transfer function is selected to perform audio processing according to different screen use scenes, so that the technical problem that the difference of audio playing effects of a multi-screen terminal (such as a front-screen mobile phone and a rear-screen mobile phone) is large when different screens are used is solved, stereo output can be adjusted in real time by using different screens, and the optimal listening effect is achieved. For example, according to the scheme, two different audio transfer functions are preset for the front and rear screen mobile phones, and each audio transfer function corresponds to audio processing in different screen use scenes. When the user uses the front screen, the audio transfer function A is used for audio processing; when it is judged that the user uses the back screen, the audio is processed using the audio transfer function B. Therefore, the output audio effect is adjusted according to different screen use scenes of the mobile phone, and the stereo effect is kept consistent when the front and back screen mobile phones are used on the front and back sides.
Furthermore, the structure design of the mobile phone can be combined, the opening of the loudspeaker at the position of the receiver faces the top, and therefore the difference of audio effects caused by the use of a front screen and a rear screen in the structure is avoided.
Referring to fig. 3, fig. 3 is a flowchart illustrating another exemplary embodiment of an audio playing method for a multi-screen terminal according to the present application. Based on the embodiment shown in fig. 2, in this embodiment, before the step S101, detecting the usage scenario information of the terminal screen, the method further includes:
and S100, configuring corresponding audio transfer functions according to different preset use scenes of the terminal screen.
Compared with the above embodiments, the present embodiment further includes a scheme of configuring an audio transfer function.
Specifically, the present embodiment sets a corresponding audio transfer function according to the usage scenario information of the terminal screen. This is mainly to consider that the difference of audio playing effect is large when different screens are used, and it is not suitable to use the same audio transfer function. Therefore, different audio transfer functions are used according to the characteristics of different screens.
For example, for a front and back screen mobile phone, as an implementation, the corresponding audio transfer function may be configured according to whether the screen used by the mobile phone is a front screen or a back screen. If the corresponding audio transfer function when the front screen of the mobile phone is used is set as A, and the corresponding audio transfer function when the back screen of the mobile phone is used is set as B. The difference between the audio transfer functions of the two screens can be set according to the characteristics of different screens, for example, the appearance structure characteristics of a mobile phone at the screen side, the position of a mobile phone receiver and the like can be considered.
Further, when configuring the corresponding audio transfer function according to different preset usage scenarios of the terminal screen, the corresponding audio transfer function may be configured by combining one or more of the following information:
for example, the corresponding audio transfer function is configured according to the position information of the terminal screen relative to the user, the position information of the terminal screen relative to the sound box, the external shape, structure, size, audio content and the like of the terminal.
According to the scheme, the corresponding audio transfer function is configured according to different preset use scenes of the terminal screen; detecting the use scene information of a terminal screen; selecting a corresponding preset audio transfer function according to the detected using scene information of the terminal screen; and processing the audio output by the terminal by using the selected audio transfer function and then outputting the processed audio. Therefore, the corresponding preset audio transfer function is selected to perform audio processing according to different screen use scenes, so that the technical problem that the difference of audio playing effects of a multi-screen terminal (such as a front-screen mobile phone and a rear-screen mobile phone) is large when different screens are used is solved, stereo output can be adjusted in real time by using different screens, and the optimal listening effect is achieved. For example, according to the scheme, two different audio transfer functions are preset for the front and rear screen mobile phones, and each audio transfer function corresponds to audio processing in different screen use scenes. When the user uses the front screen, the audio transfer function A is used for audio processing; when it is judged that the user uses the back screen, the audio is processed using the audio transfer function B. Therefore, the output audio effect is adjusted according to different screen use scenes of the mobile phone, and the stereo effect is kept consistent when the front and back screen mobile phones are used on the front and back sides.
Furthermore, the structure design of the mobile phone can be combined, the opening of the loudspeaker at the position of the receiver faces the top, and therefore the difference of audio effects caused by the use of a front screen and a rear screen in the structure is avoided.
Furthermore, as a modified implementation mode, the structure design of the mobile phone can be combined, for the problem of the front and back orientation of the loudspeaker at the position of the receiver, besides the opening towards the top, for a non-folding mobile phone, the front and back can be opened simultaneously, so that audio output can be ensured on both sides. For the mobile phone with the external folding screen, two top receiver loudspeakers can be arranged, and the corresponding loudspeakers are selected to be opened according to different screens.
In addition, for the sound effect difference of the HRTF caused by different problems of the using distance and the human head, the position and the model of the human head can be detected in real time by using the depth camera, and the HRTF is adjusted in real time, so that the stereo sound effect can be better output.
In addition, this application embodiment still provides a many screen terminals audio playback device, many screen terminals audio playback device includes:
the detection module is used for detecting the use scene information of the terminal screen;
the selection module is used for selecting a corresponding preset audio transfer function according to the detected using scene information of the terminal screen;
and the playing module is used for processing the audio output by the terminal by using the selected audio transfer function and then outputting the processed audio.
For the principle and implementation process for implementing audio playing of a multi-screen terminal, please refer to the above embodiments, which are not described herein again.
In addition, an embodiment of the present application further provides a terminal device, where the terminal device includes a memory, a processor, and a multi-screen terminal audio playing program that is stored in the memory and is capable of running on the processor, and when the multi-screen terminal audio playing program is executed by the processor, the steps of the above-described picture restoration method are implemented.
Since the multi-screen terminal audio playing program is executed by the processor, all technical solutions of all the embodiments are adopted, so that at least all the beneficial effects brought by all the technical solutions of all the embodiments are achieved, and detailed description is omitted here.
In addition, an embodiment of the present application further provides a computer-readable storage medium, where a multi-screen terminal audio playing program is stored on the computer-readable storage medium, and when the multi-screen terminal audio playing program is executed by a processor, the steps of the multi-screen terminal audio playing method described above are implemented.
Since the multi-screen terminal audio playing program is executed by the processor, all technical solutions of all the embodiments are adopted, so that at least all the beneficial effects brought by all the technical solutions of all the embodiments are achieved, and detailed description is omitted here.
Compared with the prior art, the multi-screen terminal audio playing method, the multi-screen terminal audio playing device, the terminal equipment and the storage medium provided by the embodiment of the application detect the use scene information of the terminal screen; selecting a corresponding preset audio transfer function according to the detected using scene information of the terminal screen; and processing the audio output by the terminal by using the selected audio transfer function and then outputting the processed audio. Therefore, corresponding preset audio transfer functions are selected for audio processing according to different screen use scenes, and the technical problem that the difference of stereo effects is large when front and back screen mobile phones are used on the front and back sides is solved. For example, according to the scheme, two different audio transfer functions are preset for the front and rear screen mobile phones, and each audio transfer function corresponds to audio processing in different screen use scenes. When the user uses the front screen, the audio transfer function A is used for audio processing; when it is judged that the user uses the back screen, the audio is processed using the audio transfer function B. Therefore, the output audio effect is adjusted according to different screen use scenes of the mobile phone, and the stereo effect is kept consistent when the front and back screen mobile phones are used on the front and back sides. In addition, the structure design of the mobile phone can be combined, the opening of the loudspeaker at the position of the receiver faces the top, and therefore the difference of audio effects caused by the use of a front screen and a rear screen in the structure is avoided.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, a controlled terminal, or a network device) to execute the method of each embodiment of the present application.
The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application, or which are directly or indirectly applied to other related technical fields, are included in the scope of the present application.
Claims (12)
1. A multi-screen terminal audio playing method is characterized by comprising the following steps:
detecting the use scene information of a terminal screen;
selecting a corresponding preset audio transfer function according to the detected using scene information of the terminal screen;
and processing the audio output by the terminal by using the selected audio transfer function and then outputting the processed audio.
2. A multi-screen terminal audio playing method according to claim 1, wherein the terminal is a front-back screen terminal, and the step of detecting the usage scenario information of the terminal screen includes:
and detecting whether the current screen used by the terminal is a front screen or a rear screen.
3. A multi-screen terminal audio playing method according to claim 1, wherein the terminal is a front-back screen terminal, and the step of detecting the usage scenario information of the terminal screen further includes one or more of the following:
detecting the position information of a terminal screen relative to a user;
and detecting the position information of the terminal screen relative to the sound box.
4. A multi-screen terminal audio playing method according to claim 1, wherein the step of selecting the corresponding preset audio transfer function according to the detected usage scenario information of the terminal screen comprises:
if the current screen used by the terminal is detected to be a front screen, selecting a preset audio transfer function corresponding to the front screen;
and if the current screen used by the terminal is detected to be the rear screen, selecting the audio transfer function corresponding to the rear screen.
5. A multi-screen terminal audio playing method according to claim 1, wherein the step of processing and outputting the audio output by the terminal using the selected audio transfer function comprises:
phase, pitch and/or frequency adjustment of audio output by the terminal is performed using the selected audio transfer function.
6. A multi-screen terminal audio playing method according to any one of claims 1 to 5, wherein the step of detecting usage scenario information of the terminal screen is preceded by the step of:
and configuring corresponding audio transfer functions according to different preset use scenes of the terminal screen.
7. A multi-screen terminal audio playing method according to claim 6, wherein the step of configuring the corresponding audio transfer function according to different preset usage scenarios of the terminal screen comprises:
and configuring a corresponding audio transfer function according to the front screen or the rear screen of the terminal use screen.
8. A multi-screen terminal audio playing method according to claim 7, wherein the step of configuring corresponding audio transfer functions according to different preset usage scenarios of the terminal screen further comprises:
configuring a corresponding audio transfer function in conjunction with one or more of the following information:
the position information of the terminal screen relative to the user, the position information of the terminal screen relative to the sound box, the external shape, structure and size of the terminal and the audio content.
9. A multi-screen terminal audio playing method according to any of claims 1-5, wherein speaker openings at an earpiece position of the terminal are directed towards a top of the terminal.
10. The utility model provides a many screen terminals audio playback device which characterized in that, many screen terminals audio playback device includes:
the detection module is used for detecting the use scene information of the terminal screen;
the selection module is used for selecting a corresponding preset audio transfer function according to the detected using scene information of the terminal screen;
and the playing module is used for processing the audio output by the terminal by using the selected audio transfer function and then outputting the processed audio.
11. A terminal device, characterized in that the terminal device comprises a memory, a processor and a multi-screen terminal audio playing program stored on the memory and operable on the processor, and when the multi-screen terminal audio playing program is executed by the processor, the steps of the picture restoration method according to any one of claims 1 to 9 are implemented.
12. A computer-readable storage medium, wherein a multi-screen terminal audio playing program is stored on the computer-readable storage medium, and when executed by a processor, the multi-screen terminal audio playing program implements the steps of the multi-screen terminal audio playing method according to any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010594658.5A CN111756929A (en) | 2020-06-24 | 2020-06-24 | Multi-screen terminal audio playing method and device, terminal equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010594658.5A CN111756929A (en) | 2020-06-24 | 2020-06-24 | Multi-screen terminal audio playing method and device, terminal equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111756929A true CN111756929A (en) | 2020-10-09 |
Family
ID=72677414
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010594658.5A Pending CN111756929A (en) | 2020-06-24 | 2020-06-24 | Multi-screen terminal audio playing method and device, terminal equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111756929A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114915812A (en) * | 2021-02-08 | 2022-08-16 | 华为技术有限公司 | Method for distributing audio of spliced screen and related equipment thereof |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103716729A (en) * | 2012-09-29 | 2014-04-09 | 联想(北京)有限公司 | Audio outputting method and electronic device |
| CN109348399A (en) * | 2018-08-09 | 2019-02-15 | 瑞声科技(新加坡)有限公司 | The control method of terminal and its stereo audio |
| CN110351407A (en) * | 2019-08-08 | 2019-10-18 | 维沃移动通信有限公司 | A kind of audio frequency playing method and mobile terminal |
| CN110677802A (en) * | 2018-07-03 | 2020-01-10 | 百度在线网络技术（北京）有限公司 | Method and apparatus for processing audio |
| CN110989961A (en) * | 2019-10-30 | 2020-04-10 | 华为终端有限公司 | Sound processing method and device |
| US20200175997A1 (en) * | 2017-08-17 | 2020-06-04 | Gaudio Lab, Inc. | Audio signal processing method and apparatus using ambisonics signal |
-
2020
- 2020-06-24 CN CN202010594658.5A patent/CN111756929A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103716729A (en) * | 2012-09-29 | 2014-04-09 | 联想(北京)有限公司 | Audio outputting method and electronic device |
| US20200175997A1 (en) * | 2017-08-17 | 2020-06-04 | Gaudio Lab, Inc. | Audio signal processing method and apparatus using ambisonics signal |
| CN110677802A (en) * | 2018-07-03 | 2020-01-10 | 百度在线网络技术（北京）有限公司 | Method and apparatus for processing audio |
| CN109348399A (en) * | 2018-08-09 | 2019-02-15 | 瑞声科技(新加坡)有限公司 | The control method of terminal and its stereo audio |
| CN110351407A (en) * | 2019-08-08 | 2019-10-18 | 维沃移动通信有限公司 | A kind of audio frequency playing method and mobile terminal |
| CN110989961A (en) * | 2019-10-30 | 2020-04-10 | 华为终端有限公司 | Sound processing method and device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114915812A (en) * | 2021-02-08 | 2022-08-16 | 华为技术有限公司 | Method for distributing audio of spliced screen and related equipment thereof |
| CN114915812B (en) * | 2021-02-08 | 2023-08-22 | 华为技术有限公司 | Method for distributing spliced screen audio and related equipment thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8587631B2 (en) | Facilitating communications using a portable communication device and directed sound output | |
| US8073125B2 (en) | Spatial audio conferencing | |
| US8488820B2 (en) | Spatial audio processing method, program product, electronic device and system | |
| CN110049428B (en) | Method, playing device and system for realizing multi-channel surround sound playing | |
| EP3629145B1 (en) | Method for processing 3d audio effect and related products | |
| AU2012394979A1 (en) | Method for outputting a modified audio signal and graphical user interfaces produced by an application program | |
| US9769585B1 (en) | Positioning surround sound for virtual acoustic presence | |
| CN109195063B (en) | Stereo sound generating system and method | |
| JP6111611B2 (en) | Audio amplifier | |
| US9226091B2 (en) | Acoustic surround immersion control system and method | |
| JP4364024B2 (en) | Mobile device | |
| US20230247384A1 (en) | Information processing device, output control method, and program | |
| JP2003009296A (en) | Acoustic processing unit and acoustic processing method | |
| US10440495B2 (en) | Virtual localization of sound | |
| CN111756929A (en) | Multi-screen terminal audio playing method and device, terminal equipment and storage medium | |
| Cuevas-Rodríguez et al. | The 3D Tune-In Toolkit–3D audio spatialiser, hearing loss and hearing aid simulations | |
| WO2023087031A2 (en) | Systems and methods for rendering spatial audio using spatialization shaders | |
| JP5281695B2 (en) | Acoustic transducer | |
| US20230370801A1 (en) | Information processing device, information processing terminal, information processing method, and program | |
| US20090052676A1 (en) | Phase decorrelation for audio processing | |
| KR100566131B1 (en) | Apparatus and Method for Creating 3D Sound Having Sound Localization Function | |
| De Sena | Analysis, design and implementation of multichannel audio systems | |
| US20230011591A1 (en) | System and method for virtual sound effect with invisible loudspeaker(s) | |
| CN116193196A (en) | Virtual surround sound rendering method, device, equipment and storage medium | |
| CN118170339A (en) | Audio control method, audio control device, medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201009 |
|
| RJ01 | Rejection of invention patent application after publication |