CN115495038A - Audio adjusting method and device, electronic equipment and readable storage medium - Google Patents
Audio adjusting method and device, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN115495038A CN115495038A CN202211204147.3A CN202211204147A CN115495038A CN 115495038 A CN115495038 A CN 115495038A CN 202211204147 A CN202211204147 A CN 202211204147A CN 115495038 A CN115495038 A CN 115495038A
- Authority
- CN
- China
- Prior art keywords
- information
- audio
- change
- target user
- compensation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Stereophonic System (AREA)
Abstract
The application discloses an audio adjusting method, an audio adjusting device, electronic equipment and a storage medium, which are applied to audio playing equipment, wherein the audio adjusting method comprises the following steps: acquiring first relative position information between a target user and the playing equipment and human body space posture change information of the target user; determining displacement state information of the target user according to the first relative position information and the human body space posture change information; and carrying out audio adjustment on the audio playing equipment according to the displacement state information. The application solves the technical problem that the spatial audio adjustment precision is low in the prior art.
Description
Technical Field
The application belongs to the technical field of audio processing, and relates to an audio adjusting method, an audio adjusting device, electronic equipment and a readable storage medium.
Background
Spatial audio is a far-super-stereo and surround audio technology, and aims to improve the immersion of a user through surround sound and bring more spatial audio content experience to the user.
At present, common spatial audio is mainly realized by mixing and overlapping a plurality of playing devices, manual intervention is needed when a user interacts with the playing devices, and when the user is in a mobile state, the audio is difficult to accurately adjust to be suitable audio for the user, so that the user is difficult to feel the suitable audio at different relative positions, and the audio experience of the user is poor.
Disclosure of Invention
The present application mainly aims to provide an audio adjusting method, which aims to solve the technical problem of low spatial audio adjusting precision in the prior art.
In order to achieve the above object, the present application provides an audio adjusting method applied to an audio playing device, where the audio adjusting method includes:
acquiring first relative position information between a target user and the playing equipment and human body space posture change information of the target user;
determining displacement state information of the target user according to the first relative position information and the human body space posture change information;
and carrying out audio adjustment on the audio playing equipment according to the displacement state information.
The application also provides an audio frequency adjustment detection device, is applied to audio playback equipment, audio frequency adjustment detection device includes:
the acquisition module is used for acquiring first relative position information between a target user and the playing equipment and human body space posture change information of the target user;
the displacement state determining module is used for determining displacement state information of the target user according to the first relative position information and the human body space posture change information;
and the audio adjusting module is used for adjusting the audio of the audio playing equipment according to the displacement state information.
The present application further provides an electronic device, including: a memory, a processor and a program of the audio adaptation method stored on the memory and executable on the processor, which program, when executed by the processor, may implement the steps of the audio adaptation method as described above.
The present application also provides a computer-readable storage medium having stored thereon a program for implementing an audio adjustment method, which when executed by a processor implements the steps of the audio adjustment method as described above.
The present application also provides a computer program product comprising a computer program which, when executed by a processor, performs the steps of the method of audio conditioning as described above.
The application provides an audio adjusting method, an audio adjusting device, an electronic device and a readable storage medium, and specifically, displacement state information of a target user is determined according to first relative position information between the target user and a playing device and human body space posture change information of the target user by obtaining the first relative position information and the human body space posture change information, so that audio adjustment is performed on the audio playing device according to the displacement state information. The displacement state information of the target user is determined according to the first relative position and the human body space posture change information, so that the first relative position information and the human body space posture change information are considered when the displacement state information of the target user is determined, accurate prediction of the displacement state of the target user is guaranteed, the spatial audio can be automatically adjusted according to the accurate displacement state, and the accuracy of automatic adjustment of the spatial audio can be improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and, together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art to obtain other drawings without inventive labor.
FIG. 1 is a flowchart illustrating a first embodiment of an audio adjusting method according to the present application;
FIG. 2 is a flowchart illustrating a second embodiment of an audio adjustment method according to the present application;
FIG. 3 is a schematic structural diagram of an embodiment of an audio adjusting apparatus according to the present application;
fig. 4 is a schematic device structure diagram of a hardware operating environment related to an audio adjusting method in this embodiment.
The objectives, features, and advantages of the present application will be further described with reference to the accompanying drawings.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, embodiments of the present application are described in detail below with reference to the accompanying drawings. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Example one
In a first embodiment of the audio adjustment method, the audio adjustment method includes:
step S10, acquiring first relative position information between a target user and the playing equipment and human body space posture change information of the target user;
in this embodiment, it should be noted that the playing device may be a sound box, the first relative position information is relative position information between the target user and the playing device, the relative position information may be one or more of a relative position coordinate, a relative position distance, and a relative position and orientation, the human body space posture change information refers to posture change information between a current human body space posture of the target user and a preset human body standard space posture, and the posture change information may be one or more of space posture coordinate change information, space posture distance change information, or space posture and orientation change information.
As an example, step S10 includes: acquiring first relative position information between a target user and the playing equipment; and identifying the human body space posture of the target user, and calculating the difference between the preset human body standard space posture and the current human body space posture to obtain the human body space posture change information of the target user. The first relative position information and the human body space posture can be obtained by detecting through a sensor module, and the sensor module can be a camera, an infrared detector, a radar and the like.
Step S20, determining displacement state information of the target user according to the first relative position information and the human body space posture change information;
in this embodiment, it should be noted that the displacement state information is state information representing the listening position movement of the target user, and the displacement state information may be one or more of distance change information and azimuth change information.
As an example, step S20 includes determining position compensation information of the first relative position according to the human body space posture change information; and performing position compensation on the first relative position information through position compensation information, and determining the displacement state information of the target user. Wherein the position compensation information may be one or more of distance change compensation information and orientation change compensation information.
And S30, carrying out audio adjustment on the audio playing equipment according to the displacement state information.
As an example, a mapping relationship may be set between the displacement state information and the audio information, it may be ensured that the corresponding audio information exists in each displacement state, and it is ensured that the target user has a comfortable audio experience in different displacement states, and the audio information may be audio loudness or audio channels.
As an example, step S30 includes: matching audio information corresponding to the displacement state information according to the mapping relation between the displacement state information and the audio information; and performing audio adjustment on the audio playing device according to the audio information, for example, adjusting the audio loudness of the audio playing device to be in an audio channel, and the like.
Wherein the step of determining the displacement state information of the target user according to the first relative position information and the human body space posture change information comprises:
step A10, determining initial displacement state information of the target user according to the first relative position information and second relative position information of the previous time step;
in this embodiment, it should be noted that the initial displacement state information is the relative position change information of the target user at the current time step and the previous time step, and the initial displacement state information may be determined according to the difference between the first relative position of the target user at the current time step and the second relative position at the previous time step.
As an example, step a10 includes: acquiring first relative position information of a target user and second relative position information of the target user at the last time step; calculating a position information difference value between the first relative position information and the second relative position information, wherein the position information difference value can be a relative position coordinate difference value or a relative position distance difference value and the like; and if the position information difference value is larger than a preset position information difference threshold value, taking the position information difference value as initial displacement state information. For example, if the position information difference value between the first relative position information and the second relative position information is 1 meter of distance change and 5 degrees of orientation change, and the preset position difference information threshold value is 0.5 meter of distance change and 3 degrees of orientation change, the distance change of 1 meter and the orientation change of 5 degrees are taken as the initial displacement state information.
Step A20, determining position change compensation information corresponding to the initial displacement state information based on the human body space posture change information, wherein the position change compensation information at least comprises one of distance change compensation information and azimuth change compensation information;
and A30, compensating the initial displacement state information according to the position change compensation information to obtain displacement state information.
In this embodiment, it should be noted that the position variation compensation information may be determined according to human body spatial posture variation information of the current human body spatial posture and a preset human body standard spatial posture, the position compensation information may include one or more of distance variation compensation information and orientation variation compensation information, and the human body spatial posture variation information at least includes one of human body head distance variation information and human body head orientation variation information.
As an example, steps a20 to a30 include: generating corresponding distance change compensation information according to the human head distance change information, and generating corresponding direction change compensation information according to the human head direction change information; and performing distance compensation and azimuth compensation on the initial displacement state information according to the distance change compensation information and the azimuth change compensation information to obtain the displacement state information.
The initial displacement state information at least includes one of initial distance change information and initial azimuth change information, the displacement state information at least includes one of target distance change information and target azimuth change information, and the step of compensating the initial displacement state information according to the position change compensation information to obtain the displacement state information includes:
step B10, according to the distance change compensation information, compensating the initial distance change information to obtain target distance change information; and/or
And B20, compensating the initial azimuth change information according to the azimuth change compensation information to obtain target azimuth change information.
As an example, the distance change compensation information may be a distance change compensation value, the initial distance change information may be an initial distance change value, and the target distance change information may be a target distance change value, wherein the distance change compensation value, the initial distance change value, and the target distance change value have positive and negative values, and positive values indicate that the distance is increased, and negative values indicate that the distance is decreased.
As an example, step B10 includes: and summing the distance change compensation value and the initial distance change value to perform distance compensation on the initial distance change value by using the distance change compensation value to obtain a target distance change value.
As an example, the azimuth change compensation information may be an angle change compensation value, the initial azimuth change information may be an initial angle change value, and the target azimuth change information may be a target angle change value, where the angle change compensation value, the initial angle change value, and the target angle change value all have positive and negative values, and positive indicates that the angle is increased, and negative indicates that the angle is decreased.
As an example, step B20 includes: and summing the angle change compensation value and the initial angle change value to perform angle compensation on the initial angle change value by using the angle change compensation value to obtain a target angle change value.
The step of determining the position change compensation information corresponding to the initial displacement state information according to the human body space posture change information comprises the following steps:
step C10, determining a first displacement change value of the head of the target user in the vertical direction, a second displacement change value of the head of the target user in the horizontal direction and a third displacement change value of the head of the target user in the front-back direction according to the human body space posture change information;
step C20, a first included angle between the vertical plane of the relative position between the head of the target user and the audio playing device and a preset position is obtained, and the vertical direction distance compensation value is calculated according to the first displacement change value and the first included angle;
step C30, acquiring a second included angle between the relative direction between the head of the target user and the audio playing device and the preset direction on the horizontal plane, and calculating the horizontal direction distance compensation value according to the second displacement change value and the second included angle;
and step C40, calculating the distance compensation value in the front-back direction according to the third displacement change value.
In this embodiment, it should be noted that the listening position of the human body is generally the position of the head of the human body, and when the human body image is shot by using the camera at present, the human body image is usually obtained by focusing on the whole human body to shoot, and the relative position information determined based on the human body image is the relative position information between the whole human body and the audio playing device, rather than the relative position between the human body head and the audio playing device, and the posture of the human body head may change, and the listening effect may also be affected by the change of the posture of the human body head.
As an example, the human body spatial posture change information may be distance change information of a head of a human body in a vertical direction, distance change information in a horizontal direction, and distance change information in a front-back direction, the first displacement change value is a distance deviation value of the current head of the human body in the vertical direction from a preset human body standard spatial posture, the second displacement change value is a distance deviation value of the human body spatial posture in the horizontal direction from the preset human body standard spatial posture, and the third displacement change value is a distance deviation value of the human body spatial posture in the front-back direction from the preset human body standard spatial posture.
The preset orientation is a relative orientation between the head in the preset human body standard space posture and the playing device, and the relative orientation is a relative orientation between the whole human body and the audio playing device, for example, the relative orientation may be an orientation between the audio playing device and a human body center position, and the human body center position may be a human body geometric center position or an image center position of an image obtained by focusing on the human body.
As an example, steps C10 to C40 include: determining a first displacement change value of the head of the target user in the vertical direction, a second displacement change value of the head of the target user in the horizontal direction and a third displacement change value of the head of the target user in the front-back direction according to the human body space posture change information; identifying a first included angle between a vertical plane and a relative position between the head of the target user and the audio playing device and a preset position, and calculating a vertical direction distance compensation value according to the first included angle and the first displacement change value, wherein the vertical direction distance compensation value is a distance compensation value generated by the displacement of the head of the target user in the vertical direction relative to a preset human body standard space posture; identifying a second included angle between the relative position between the head of the target user and the audio playing device and a horizontal plane of the preset position, and calculating the horizontal direction distance compensation value according to the second included angle and the second displacement change value, wherein the horizontal direction distance compensation value is a distance compensation value generated by the displacement of the head of the target user relative to the preset human body standard space posture in the horizontal direction; and taking the third displacement change value as the front-back direction distance compensation value, wherein the front-back direction distance compensation value is a distance compensation value generated by displacement of the head of the target user in the front-back direction relative to the preset human body standard space posture.
As an example, according to the first included angle and the first displacement variation value, a specific formula for calculating the vertical distance compensation value is as follows:
wherein D is 1 For said vertical distance compensation value, X 1 Is the first displacement variation value, alpha 1 Is the first included angle.
As an example, according to the second included angle and the second displacement variation value, a specific formula for calculating the horizontal distance compensation value is as follows:
wherein D is 1 For said horizontal direction distance compensation value, X 1 Is the second shift variation value, alpha 1 Is the second included angle.
Wherein, the step of adjusting the audio of the audio playing device according to the displacement state information comprises:
step F10, adjusting the directivity parameters of the audio playing equipment according to the target direction change information; and/or
And F20, adjusting the distance parameter of the audio playing equipment according to the target distance change information.
In this embodiment, it should be noted that the directivity parameter may be a sound channel parameter, and the distance parameter may be one or more of a volume parameter and an equalizer parameter, where the directivity parameter needs to be adjusted when a relative position of the listening position of the target user with respect to the audio playing device changes, and the distance parameter needs to be adjusted when a relative distance of the listening position of the target user with respect to the audio playing device changes. The sample application embodiment can be used for pertinently adjusting the directivity parameters corresponding to the azimuth change when the listening position of the target user is changed relative to the audio playing, and the distance parameters corresponding to the distance change are pertinently adjusted when the listening position of the target user is changed relative to the audio playing, so that the audio parameters of the audio playing device can be always adapted to the listening position of the target user, and the purpose of accurately adjusting the audio parameters of the audio playing device based on the listening position of the target user is achieved.
The embodiment of the application provides audio adjustment, specifically, first relative position information between a target user and a playing device and human body space posture change information of the target user are obtained, and then displacement state information of the target user is determined according to the first relative position information and the human body space posture change information, so that the audio adjustment is carried out on the audio playing device according to the displacement state information. The displacement state information of the target user is determined according to the first relative position and the human body space posture change information, so that the first relative position information and the human body space posture change information are considered when the displacement state information of the target user is determined, accurate prediction of the displacement state of the target user is guaranteed, the spatial audio can be automatically adjusted according to the accurate displacement state, and the accuracy of automatic adjustment of the spatial audio can be improved.
Example two
Further, referring to fig. 2, based on the first embodiment of the present application, in another embodiment of the present application, the same or similar contents to those of the above embodiment may be referred to the above description, and are not repeated herein. On this basis, the step of determining the position change compensation information corresponding to the initial displacement state information according to the human body space posture change information includes:
step D10, acquiring a third included angle between the relative position between the target user and the audio playing device and a vertical plane of a preset position, and determining a vertical plane position compensation value according to the third included angle;
and D20, acquiring a fourth included angle between the relative position between the target user and the audio playing device and the preset position on the horizontal plane, and determining the horizontal plane position compensation value according to the fourth included angle.
As an example, the body space posture change information may be orientation change information on a vertical plane and orientation change information on a horizontal plane in the body space posture relative to a preset standard body space posture, the third included angle may be a deviation angle of the whole body on the vertical plane relative to the preset standard body space posture, and the fourth included angle may be a deviation angle of the whole body on the horizontal plane relative to the preset standard body space posture. The vertical plane orientation compensation value is an orientation compensation value generated by generating orientation deviation on a vertical plane of the whole body of the target user relative to a preset human body standard space posture, and the horizontal plane orientation compensation value is an orientation compensation value generated by generating orientation deviation on a horizontal plane of the whole body of the target user relative to the preset human body standard space posture.
As an example, steps D10 to D20 include: acquiring a third included angle between the vertical plane and the relative direction between the whole body of the target user and the audio playing device, and a fourth included angle between the horizontal plane and the relative direction between the whole body of the target user and the audio playing device; and taking the third included angle as a compensation value of the vertical plane azimuth, and taking the fourth included angle as a compensation value of the vertical plane azimuth. According to the embodiment of the application, the position deviation of the whole body of the target user in the vertical plane and the horizontal plane relative to the preset standard human body space posture is realized, the relative position between the target user and the audio playing equipment is compensated, and the accuracy of determining the relative position between the target user and the audio playing equipment can be improved. The vertical plane may be a plane perpendicular to the ground, and the horizontal plane may be a plane parallel to the ground.
Wherein the audio adjusting method further comprises:
step E10, identifying the face inclination of the target user;
in this embodiment, it should be noted that the listening position of the human body is generally the position of the head of the human body, and when the human body image is shot by using the camera at present, the human body image is usually obtained by focusing on the whole human body to shoot, and the relative position information determined based on the human body image is the relative position information between the whole human body and the audio playing device, rather than the relative position between the human body head and the audio playing device, and the posture of the human body head may change, and the listening effect may also be affected by the change of the posture of the human body head.
As an example, step E10 includes: the method comprises the steps of obtaining a shot image of a target user, and identifying the face inclination of the target user by carrying out image identification on the shot image.
The step of determining the compensation value of the vertical plane azimuth according to the third included angle includes:
step E20, correcting the third included angle according to the face inclination to obtain the vertical plane azimuth compensation value;
as an example, the face inclination includes a first face inclination of the target user in a vertical plane, for example, the first face inclination is a bending angle of the neck of the target user in the vertical plane.
Step E20 includes: for example, when the first face gradient is the same as the offset direction of the third angle, the first face gradient and the first angle may be added to obtain a vertical plane azimuth compensation value, and when the first face gradient is opposite to the offset direction of the first angle, the first face gradient and the first angle may be subtracted to obtain a vertical plane azimuth compensation value, where the offset direction may be upward or downward.
Wherein the step of determining the horizontal plane orientation compensation value according to the fourth angle comprises:
and E30, correcting the fourth included angle according to the face inclination to obtain the horizontal plane azimuth compensation value.
As an example, the face inclination includes a second face inclination of the target user in a horizontal plane, for example, the second face inclination is a rotation angle of the neck of the target user in the horizontal plane.
As an example, step E30 includes: according to the second face inclination, the fourth included angle is calibrated, and a horizontal plane azimuth compensation value is determined, for example, when the second face inclination is the same as the offset direction of the fourth included angle, the second face inclination and the fourth included angle may be added to obtain the horizontal plane azimuth compensation value, and when the second face inclination is opposite to the offset direction of the fourth included angle, the second face inclination and the fourth included angle may be subtracted to obtain the horizontal plane azimuth compensation value, and the offset direction may be left or right. The embodiment of the application further corrects the direction change compensation information through the face inclination, and considers the influence of the rotation of the head of the user on the direction of the listening position, so that the relative direction between the target user and the playing equipment can be more accurately measured, the accuracy of the displacement state information measurement is improved, and the accuracy of the space audio automatic adjustment is further ensured.
The application provides an audio adjusting method, an audio adjusting device, an electronic device and a readable storage medium, namely identifying the face inclination of a target user; acquiring a third included angle between the relative azimuth between the target user and the audio playing device and a preset azimuth between vertical planes, and correcting the third included angle according to the face inclination to obtain an azimuth compensation value of the vertical planes; and acquiring a fourth included angle between the relative direction between the target user and the audio playing equipment and a preset direction between the horizontal planes, and correcting the fourth included angle according to the face gradient to obtain the horizontal plane direction compensation value. According to the embodiment of the application, how to accurately measure the displacement state information is considered from the two aspects of the azimuth deviation of the current human body space posture relative to the preset standard human body space posture and the face inclination of the target user, so that the measurement accuracy of the displacement state information is improved, and the accuracy of audio characteristics of the audio playing equipment is improved.
EXAMPLE III
Referring to fig. 3, an embodiment of the present application further provides an audio adjusting apparatus, where the audio adjusting apparatus includes:
an obtaining module 10, configured to obtain first relative position information between a target user and the playback device and human body space posture change information of the target user;
a displacement state determination module 20, configured to determine displacement state information of the target user according to the first relative position information and the human body spatial posture change information;
and the audio adjusting module 30 is configured to perform audio adjustment on the audio playing device according to the displacement state information.
Optionally, the displacement state determination module 20 is further configured to:
determining initial displacement state information of the target user according to the first relative position information and second relative position information of the last time step;
determining position change compensation information corresponding to the initial displacement state information based on the human body space attitude change information, wherein the position change compensation information at least comprises one of distance change compensation information and azimuth change compensation information;
and compensating the initial displacement state information according to the position change compensation information to obtain displacement state information.
Optionally, the initial displacement state information at least includes one of initial distance change information and initial orientation change information, the displacement state information at least includes one of target distance change information and target orientation change information, and the displacement state determination module 20 is further configured to:
compensating the initial distance change information according to the distance change compensation information to obtain target distance change information; and/or
And compensating the initial azimuth change information according to the azimuth change compensation information to obtain target azimuth change information.
Optionally, the position change compensation information includes distance change compensation information, the distance change compensation information includes a vertical direction distance compensation value, a horizontal direction distance compensation value, and a front-back direction distance compensation value, and the displacement state determination module 20 is further configured to:
determining a first displacement change value of the head of the target user in the vertical direction, a second displacement change value of the head of the target user in the horizontal direction and a third displacement change value of the head of the target user in the front-back direction according to the human body space posture change information;
acquiring a first included angle between the relative position between the head of the target user and the audio playing device and a vertical plane of a preset position, and calculating the distance compensation value in the vertical direction according to the first displacement change value and the first included angle;
acquiring a second included angle between the relative direction between the head of the target user and the audio playing device and the horizontal plane of the preset direction, and calculating the horizontal direction distance compensation value according to the second displacement change value and the second included angle;
and calculating the distance compensation value in the front-back direction according to the third displacement change value.
Optionally, the position change compensation information includes azimuth change compensation information, the azimuth change compensation information includes a vertical plane azimuth compensation value and a horizontal plane azimuth compensation value, and the displacement state determination module 20 is further configured to:
acquiring a third included angle between the relative position between the target user and the audio playing device and a vertical plane of a preset position, and determining a vertical plane position compensation value according to the third included angle;
and acquiring a fourth included angle between the relative position between the target user and the audio playing equipment and the preset position between the horizontal planes, and determining the horizontal plane position compensation value according to the fourth included angle.
Optionally, the displacement state determination module 20 is further configured to:
identifying a face inclination of the target user;
correcting the third included angle according to the face inclination to obtain the vertical plane azimuth compensation value;
and correcting the fourth included angle according to the face inclination to obtain the horizontal plane azimuth compensation value.
Optionally, the displacement state information at least includes one of target distance change information and target orientation change information, and the audio adjustment module 30 is further configured to:
adjusting the directivity parameters of the audio playing equipment according to the target direction change information; and/or
And adjusting the distance parameter of the audio playing equipment according to the target distance change information.
The audio adjusting device provided by the application adopts the audio adjusting method in the embodiment, and solves the technical problem of low spatial audio adjusting precision. Compared with the prior art, the beneficial effect of the audio adjustment provided by the embodiment of the present application is the same as that of the audio adjustment method provided by the above embodiment, and other technical features in the audio adjustment device are the same as those disclosed in the above embodiment method, which are not described herein again.
Example four
An embodiment of the present application provides an electronic device, where the electronic device may be a playback device, and the electronic device includes: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the audio adjusting method according to the first embodiment.
Referring now to FIG. 4, shown is a block diagram of an electronic device suitable for use in implementing embodiments of the present disclosure. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., car navigation terminals), and the like, and fixed terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 4 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 4, the electronic device may include a processing means (e.g., a central processing unit, a graphic processor, etc.) that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) or a program loaded from a storage means into a Random Access Memory (RAM). In the RAM, various programs and data necessary for the operation of the electronic apparatus are also stored. The processing device, the ROM, and the RAM are connected to each other through a bus. An input/output (I/O) interface is also connected to the bus.
Generally, the following systems may be connected to the I/O interface: input devices including, for example, touch screens, touch pads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, and the like; output devices including, for example, liquid Crystal Displays (LCDs), speakers, vibrators, and the like; storage devices including, for example, magnetic tape, hard disk, and the like; and a communication device. The communication means may allow the electronic device to communicate wirelessly or by wire with other devices to exchange data. While the figures illustrate an electronic device with various systems, it is to be understood that not all illustrated systems are required to be implemented or provided. More or fewer systems may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer-readable medium, the computer program comprising program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means, or installed from a storage means, or installed from a ROM. The computer program, when executed by a processing device, performs the above-described functions defined in the methods of the embodiments of the present disclosure.
The electronic device provided by the application adopts the audio adjusting method in the embodiment to solve the technical problem of low spatial audio adjusting precision. Compared with the prior art, the beneficial effects of the audio adjustment provided by the embodiment of the present application are the same as the beneficial effects of the audio adjustment method provided by the above embodiment, and other technical features in the audio adjustment device are the same as the features disclosed in the above embodiment method, which are not repeated herein.
It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the foregoing description of embodiments, the particular features, structures, materials, or characteristics may be combined in any suitable manner in any one or more embodiments or examples.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
EXAMPLE five
The present embodiment provides a computer-readable storage medium having computer-readable program instructions stored thereon for performing the method of audio adjustment in the first embodiment.
The computer readable storage medium provided by the embodiments of the present application may be, for example, a usb disk, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, or device, or a combination of any of the above. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present embodiment, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, or device. Program code embodied on a computer readable storage medium may be transmitted using any appropriate medium, including but not limited to: displacement state information, distance change compensation information, and orientation change compensation information, or any suitable combination of the foregoing.
The computer-readable storage medium may be embodied in an electronic device; or may be separate and not incorporated into the electronic device.
The computer readable storage medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring first relative position information between a target user and the playing equipment and human body space posture change information of the target user; determining displacement state information of the target user according to the first relative position information and the human body space posture change information; and carrying out audio adjustment on the audio playing equipment according to the displacement state information.
Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules described in the embodiments of the present disclosure may be implemented by software or hardware. Wherein the names of the modules do not in some cases constitute a limitation of the unit itself.
The computer-readable storage medium provided by the application stores computer-readable program instructions for executing the audio adjusting method, and solves the technical problem of low spatial audio adjusting precision. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the embodiment of the present application are the same as the beneficial effects of the audio adjustment method provided by the first embodiment, and are not described herein again.
Example six
The present application also provides a computer program product comprising a computer program which, when executed by a processor, performs the steps of the audio adaptation prediction method as described above.
The computer program product provided by the application solves the technical problem of low spatial audio adjustment precision. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the present application are the same as those of the audio adjusting method provided by the above embodiment, and are not described herein again.
The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all equivalent structures or equivalent processes, which are directly or indirectly applied to other related technical fields, and which are not limited by the present application, are also included in the scope of the present application.
Claims (10)
1. An audio adjusting method is applied to an audio playing device, and includes:
acquiring first relative position information between a target user and the playing equipment and human body space posture change information of the target user;
determining displacement state information of the target user according to the first relative position information and the human body space posture change information;
and carrying out audio adjustment on the audio playing equipment according to the displacement state information.
2. The audio adjustment method of claim 1, wherein the step of determining the displacement state information of the target user according to the first relative position information and the human body spatial posture change information comprises:
determining initial displacement state information of the target user according to the first relative position information and second relative position information of the last time step;
determining position change compensation information corresponding to the initial displacement state information based on the human body space attitude change information, wherein the position change compensation information at least comprises one of distance change compensation information and azimuth change compensation information;
and compensating the initial displacement state information according to the position change compensation information to obtain displacement state information.
3. The audio adjusting method according to claim 2, wherein the initial displacement state information includes at least one of initial distance change information and initial orientation change information, the displacement state information includes at least one of target distance change information and target orientation change information,
the step of compensating the initial displacement state information according to the position change compensation information to obtain the displacement state information comprises the following steps:
compensating the initial distance change information according to the distance change compensation information to obtain target distance change information; and/or
And compensating the initial azimuth change information according to the azimuth change compensation information to obtain target azimuth change information.
4. The audio adjusting method of claim 2, wherein the position variation compensation information includes distance variation compensation information including a vertical direction distance compensation value, a horizontal direction distance compensation value, and a front-rear direction distance compensation value,
the step of determining the position change compensation information corresponding to the initial displacement state information according to the human body space posture change information comprises the following steps:
determining a first displacement change value of the head of the target user in the vertical direction, a second displacement change value of the head of the target user in the horizontal direction and a third displacement change value of the head of the target user in the front-back direction according to the human body space posture change information;
acquiring a first included angle between the relative position between the head of the target user and the audio playing device and a vertical plane of a preset position, and calculating the distance compensation value in the vertical direction according to the first displacement change value and the first included angle;
acquiring a second included angle between the relative direction between the head of the target user and the audio playing equipment and a preset direction in a horizontal plane, and calculating the horizontal direction distance compensation value according to the second displacement change value and the second included angle;
and calculating the distance compensation value in the front-back direction according to the third displacement change value.
5. The audio adjustment method of claim 2, wherein the position variation compensation information includes azimuth variation compensation information, the azimuth variation compensation information including a vertical plane azimuth compensation value and a horizontal plane azimuth compensation value,
the step of determining the position change compensation information corresponding to the initial displacement state information according to the human body space posture change information comprises the following steps:
acquiring a third included angle between the relative position between the target user and the audio playing device and a vertical plane of a preset position, and determining a vertical plane position compensation value according to the third included angle;
and acquiring a fourth included angle between the relative position between the target user and the audio playing equipment and the preset position between the horizontal planes, and determining the horizontal plane position compensation value according to the fourth included angle.
6. The audio adjustment method of claim 5, wherein the audio adjustment method further comprises:
identifying a face inclination of the target user;
the step of determining the compensation value of the vertical plane azimuth according to the third included angle includes:
correcting the third included angle according to the face inclination to obtain the vertical plane azimuth compensation value;
the step of determining the horizontal plane orientation compensation value according to the fourth angle comprises:
and correcting the fourth included angle according to the face inclination to obtain the horizontal plane azimuth compensation value.
7. The audio adjusting method according to claim 1, wherein the displacement state information includes at least one of target distance change information and target orientation change information,
the step of adjusting the audio frequency of the audio playing device according to the displacement state information comprises:
adjusting the directivity parameters of the audio playing equipment according to the target direction change information; and/or
And adjusting the distance parameter of the audio playing equipment according to the target distance change information.
8. An audio adjusting apparatus, applied to an audio playing device, the audio adjusting apparatus comprising:
the acquisition module is used for acquiring first relative position information between a target user and the playing equipment and human body space posture change information of the target user;
the displacement state determining module is used for determining displacement state information of the target user according to the first relative position information and the human body space posture change information;
and the audio adjusting module is used for adjusting the audio of the audio playing equipment according to the displacement state information.
9. An electronic device, characterized in that the electronic device comprises:
at least one processor;
and a memory communicatively coupled to the at least one processor;
wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the audio adaptation method of any of claims 1 to 7.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a program for implementing an audio adjusting method, the program being executed by a processor to implement the steps of the audio adjusting method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211204147.3A CN115495038A (en) | 2022-09-29 | 2022-09-29 | Audio adjusting method and device, electronic equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211204147.3A CN115495038A (en) | 2022-09-29 | 2022-09-29 | Audio adjusting method and device, electronic equipment and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115495038A true CN115495038A (en) | 2022-12-20 |
Family
ID=84472913
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211204147.3A Pending CN115495038A (en) | 2022-09-29 | 2022-09-29 | Audio adjusting method and device, electronic equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115495038A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116674205A (en) * | 2023-08-01 | 2023-09-01 | 易加三维增材技术(杭州)有限公司 | Displacement control method and device, nonvolatile storage medium and electronic equipment |
-
2022
- 2022-09-29 CN CN202211204147.3A patent/CN115495038A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116674205A (en) * | 2023-08-01 | 2023-09-01 | 易加三维增材技术(杭州)有限公司 | Displacement control method and device, nonvolatile storage medium and electronic equipment |
| CN116674205B (en) * | 2023-08-01 | 2023-12-15 | 易加三维增材技术(杭州)有限公司 | Displacement control method and device, nonvolatile storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9229084B2 (en) | Magnetometer calibration | |
| CN108362310B (en) | Method and device for determining geomagnetic accuracy, storage medium and terminal | |
| US20180372497A1 (en) | Method and apparatus for measuring posture angle of object | |
| CN114579933B (en) | Error measurement optimization method and device, electronic equipment and readable storage medium | |
| CN115495038A (en) | Audio adjusting method and device, electronic equipment and readable storage medium | |
| CN114125659A (en) | Volume real-time compensation method, electronic device and readable storage medium | |
| CN117191080A (en) | Calibration method, device, equipment and storage medium for camera and IMU external parameters | |
| CN113129366B (en) | Monocular SLAM initialization method and device and electronic equipment | |
| CN115431302B (en) | Robot joint idle stroke measuring method and device, electronic equipment and storage medium | |
| CN116033131B (en) | Image correction method, device, electronic equipment and readable storage medium | |
| CN109963139B (en) | Automatic calibration method for layout of naked eye 3D display screen and electronic equipment | |
| CN113407045B (en) | Cursor control method and device, electronic equipment and storage medium | |
| CN115550619A (en) | Projection correction method and device, electronic equipment and readable storage medium | |
| CN115546417A (en) | Three-dimensional reconstruction method, system, electronic device and computer-readable storage medium | |
| CN114063964A (en) | Volume compensation optimization method and device, electronic equipment and readable storage medium | |
| CN116156132A (en) | Projection image correction method, projection image correction device, electronic equipment and readable storage medium | |
| CN114089945A (en) | Volume real-time adjustment method, electronic device and readable storage medium | |
| CN114407884A (en) | Automatic driving optimization method and device, electronic equipment and readable storage medium | |
| CN113938792A (en) | Audio playing optimization method, device and readable storage medium | |
| CN111125465B (en) | Information display quantity adjusting method and device, electronic equipment and readable medium | |
| CN115201796B (en) | External reference correction method of vehicle sensor | |
| CN114125138B (en) | Volume adjustment optimization method and device, electronic equipment and readable storage medium | |
| CN114863650B (en) | Obstacle early warning method and device, electronic equipment and readable storage medium | |
| CN114724528B (en) | Display control method and device of display device, electronic device and storage medium | |
| CN116372942B (en) | Robot joint compensation method and device, electronic equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |