CN114390403A - Audio playing effect display method and device - Google Patents
Audio playing effect display method and device Download PDFInfo
- Publication number
- CN114390403A CN114390403A CN202111616406.9A CN202111616406A CN114390403A CN 114390403 A CN114390403 A CN 114390403A CN 202111616406 A CN202111616406 A CN 202111616406A CN 114390403 A CN114390403 A CN 114390403A
- Authority
- CN
- China
- Prior art keywords
- space
- virtual space
- sound source
- audio playing
- physical space
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R5/00—Stereophonic arrangements
- H04R5/02—Spatial or constructional arrangements of loudspeakers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
- H04S7/303—Tracking of listener position or orientation
Abstract
The present disclosure provides a method and a device for displaying audio playing effect, wherein the method comprises the following steps: for a physical space to be displayed, constructing a virtual space matched with the physical space according to the space characteristics of the physical space, wherein the virtual space has the space characteristics matched with the physical space; acquiring the position of a user in a physical space, and taking a virtual position matched with the position in a virtual space as a sound source position; and displaying the audio playing effect of the sound source in the virtual space according to the spatial characteristics of the virtual space and the position of the sound source so as to monitor the audio playing effect of the sound source at each position in the virtual space and assist the deployment work of the audio playing equipment. According to the method, the sound source position is set by acquiring the position of the user, and the sound effect testing equipment and the audio simulation tool do not need to be repeatedly installed, so that the modification difficulty of the deployment scheme of the audio playing equipment is greatly reduced, and the deployment efficiency of the equipment is improved.
Description
Technical Field
The present disclosure relates to the field of data processing technologies, and in particular, to a method and an apparatus for displaying an audio playing effect.
Background
Audio is one of the important information communication carriers. For example, in a live event such as a concert or concert, the audio playing effect may directly affect the audience experience.
In the related art, audio playing equipment is required to be arranged on an activity site as a sound source, sound effect testing equipment is required to be arranged on the activity site as sound effect testing points, and then a professional audio simulation tool is adopted to analyze audio data collected by the sound effect testing points, so that the deployment scheme of the audio playing equipment on the activity site can be adjusted by combining sound effect analysis results, and a better activity sound effect is achieved.
However, in the related art, if the deployment scheme of the audio playing device is to be modified, the audio playing device and the audio test point need to be adjusted in the activity field (for example, the audio test device is disassembled, the audio playing device is disassembled, the test parameters are adjusted, and the like), and the audio simulation tool performs offline modeling again to calculate the audio analysis result of the new scheme, which consumes a long time and has low deployment efficiency of the audio playing device.
Disclosure of Invention
The present disclosure provides a method and an apparatus for displaying an audio playing effect, which are used to display the audio playing effect of a sound source in a virtual space, assist the deployment of audio playing devices, and improve the deployment efficiency.
According to a first aspect of an embodiment of the present disclosure, the present disclosure provides a method for displaying an audio playing effect, including:
for a physical space to be displayed, constructing a virtual space matched with the physical space according to the space characteristics of the physical space, wherein the virtual space has the space characteristics matched with the physical space;
acquiring the position of a user in a physical space, and taking a virtual position matched with the position in a virtual space as a sound source position;
and displaying the audio playing effect of the sound source in the virtual space according to the spatial characteristics and the sound source position of the virtual space.
According to a second aspect of the embodiments of the present disclosure, the present disclosure provides an apparatus for displaying an audio playing effect, including:
the building module is configured to build a virtual space matched with the physical space according to the space characteristics of the physical space for the physical space to be displayed, wherein the virtual space has the space characteristics matched with the physical space;
the acquisition module is configured to acquire the position of a user in a physical space and take a virtual position matched with the position in a virtual space as a sound source position;
and the showing module is configured to show the audio playing effect of the sound source in the virtual space according to the spatial characteristics of the virtual space and the sound source position.
According to a third aspect of the embodiments of the present disclosure, an electronic device is provided, which includes a processor and a memory, where the memory stores executable codes thereon, and when the executable codes are executed by the processor, the processor is enabled to at least implement the method for presenting an audio playing effect in the first aspect.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium, where instructions, when executed by an electronic device, enable the electronic device to perform a presentation method that can achieve at least the audio playing effect of the first aspect.
According to a fifth aspect of embodiments of the present disclosure, there is provided a computer program product comprising computer programs/instructions which, when executed by a processor, implement the presentation method of audio playback effect in the first aspect.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
in the disclosure, for a physical space to be displayed, a virtual space matched with the physical space is constructed according to the spatial features of the physical space. Further, the position of the user in the physical space is acquired, and a virtual position in the virtual space that matches the position is taken as the sound source position. Because the virtual space has the spatial characteristics matched with the physical space, the audio playing effect of the sound source in the virtual space can be displayed according to the spatial characteristics and the sound source position of the virtual space, so that the audio playing effect of the sound source at each position in the virtual space can be monitored, and the deployment work of the audio playing equipment can be assisted. The sound source position is set by acquiring the position of the user, sound effect testing equipment does not need to be installed repeatedly, an audio simulation tool does not need to be set, the modification difficulty of the deployment scheme of the audio playing equipment is greatly reduced, and the deployment efficiency of the equipment is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
Fig. 1 is a flowchart illustrating a presentation method of an audio playing effect according to an exemplary embodiment.
FIG. 2 is a schematic diagram illustrating a test interface in accordance with an exemplary embodiment.
Fig. 3 is a schematic structural diagram illustrating an apparatus for presenting an audio playing effect according to an exemplary embodiment.
Fig. 4 is a schematic structural diagram of an electronic device according to an exemplary embodiment.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
As mentioned above, audio is one of the important information communication carriers. For example, in a live event such as a concert or concert, the audio playing effect may directly affect the audience experience.
In the related art, audio playing equipment is required to be arranged on an activity site as a sound source, sound effect testing equipment is required to be arranged on the activity site as sound effect testing points, and then a professional audio simulation tool is adopted to analyze audio data collected by the sound effect testing points, so that the deployment scheme of the audio playing equipment on the activity site can be adjusted by combining sound effect analysis results, and a better activity sound effect is achieved. However, if the deployment scheme of the audio playing device is to be modified, the audio playing device and the audio test point need to be adjusted in the activity field (for example, the audio test device is disassembled, the audio playing device is disassembled, the test parameters are adjusted, and the like), and the audio simulation tool performs offline modeling again to calculate the audio analysis result of the new scheme, which consumes a long time and has low deployment efficiency of the audio playing device.
In addition, the audio simulation tool in the related art is complex in function and needs a certain professional knowledge, so that a certain learning threshold exists in the use of the audio simulation tool.
In summary, a solution for improving the deployment efficiency of an audio playback device is desired.
In order to solve at least one technical problem in the related art, the present disclosure provides a method and an apparatus for displaying an audio playing effect.
The core idea of the technical scheme is as follows: for a physical space to be shown (such as a concert hall, an auditorium, a shopping mall and the like), a virtual space matched with the physical space is constructed according to the spatial characteristics of the physical space. Further, the position of the user in the physical space is acquired, and a virtual position in the virtual space that matches the position is taken as the sound source position. Because the virtual space has the spatial characteristics matched with the physical space, the audio playing effect of the sound source in the virtual space can be displayed according to the spatial characteristics and the sound source position of the virtual space, so that the audio playing effect of the sound source at each position in the virtual space can be monitored, and the deployment work of the audio playing equipment can be assisted. The sound source position is set by acquiring the position of the user, sound effect testing equipment does not need to be installed repeatedly, an audio simulation tool does not need to be set, the modification difficulty of the deployment scheme of the audio playing equipment is greatly reduced, and the deployment efficiency of the equipment is improved.
Based on the core ideas introduced in the foregoing, an embodiment of the present disclosure provides a method for displaying an audio playing effect, and fig. 1 is a flowchart illustrating the method for displaying an audio playing effect according to an exemplary embodiment of the present disclosure. As shown in fig. 1, the method includes:
101. for a physical space to be displayed, constructing a virtual space matched with the physical space according to the space characteristics of the physical space;
102. acquiring the position of a user in a physical space, and taking a virtual position matched with the position in a virtual space as a sound source position;
103. and displaying the audio playing effect of the sound source in the virtual space according to the spatial characteristics and the sound source position of the virtual space.
In the above method, the physical space includes, but is not limited to, an indoor space, such as a concert hall, an auditorium, a mall, a home space, and the like. It is worth noting that the virtual space has spatial characteristics that match the physical space. In short, the virtual space and the physical space have the same (or similar) spatial structure, which provides a basis for the simulation of the audio playing effect in the subsequent steps. In the present disclosure, optionally, the spatial characteristics of the virtual space are the same as the spatial characteristics of the physical space, for example, the virtual space is the same as the physical space in terms of spatial structure characteristics and surface material characteristics. Optionally, the spatial characteristics of the virtual space are proportional to the spatial characteristics of the physical space, for example, the virtual space and the physical space are 1 to 16 in terms of spatial structure characteristics and surface material characteristics.
The spatial characteristics of the physical space comprise spatial structure characteristics and/or surface material characteristics. In particular, spatial structural features include, but are not limited to, building structures, areas, relative positional relationships between building structures. For example, the spatial structure characteristics of a concert hall include building structures such as inner wall structures, pillars, stages, seats, steps, etc. of the concert hall, areas of the respective building structures, and relative positional relationships between the respective building structures. The surface material characteristics include, but are not limited to, surface material texture (e.g., whether or not there is a concave-convex texture), sound absorption rate of the surface material, reflectivity, and sound insulation effect parameters. For example, the surface material characteristics of the concert hall include surface material texture of the inner wall surface of the concert hall, sound absorption rate, sound reflection rate, and sound insulation effect parameters of each wall surface, surface material texture of the ground surface, sound absorption rate, sound reflection rate, and sound insulation effect parameters, and surface material texture of the seat surface, sound absorption rate, sound reflection rate, and sound insulation effect parameters.
According to the method, the deployment work of the audio playing equipment is assisted by outputting the audio playing effect of the sound source in the virtual space, and the sound source position is set by acquiring the position of the user without repeatedly installing sound effect testing equipment and setting an audio simulation tool, so that the modification difficulty of the deployment scheme of the audio playing equipment is greatly reduced, and the deployment efficiency of the equipment is improved.
In practical applications, each step of the method may be implemented by one electronic device, and the electronic device may be a terminal device such as a mobile phone, an intelligent bracelet, a tablet computer, a PC, a notebook computer, and the like. Taking a mobile phone as an example, the method can be realized by calling a special application program carried in the mobile phone, can also be realized by calling a small program set in an instant messaging application or other types of applications, and can also be realized by calling a cloud server through mobile phone application. The steps of the above method can also be implemented by cooperation of a plurality of electronic devices. For example, the server may send the execution result to the terminal device for rendering and displaying the execution result by the terminal device. The server may be a physical server including an independent host, or may also be a virtual server borne by a host cluster, or may also be a cloud server, which is not limited in the present disclosure. Optionally, the method may be implemented by a cloud service system.
The following describes steps of a method for displaying an audio playing effect according to an embodiment.
In 101, for a physical space to be displayed, a virtual space matched with the physical space is constructed according to the space characteristics of the physical space. The physical space to be exhibited in the present disclosure is, for example, a physical space that requires sound effect measurement, or a physical space that requires sound effect design.
Optionally, before 101, spatial features of the physical space are acquired. Specifically, in an alternative embodiment, an aerial image acquired in the physical space may be acquired, and spatial structural features and/or surface texture features may be identified from the aerial image as spatial features of the physical space. In the present disclosure, the aerial image includes, but is not limited to, one or more of a panorama, a partial map, and a scan model map. In practice, the aerial image may be acquired from a physical space by an image acquisition device. For example by scanning the physical space by means of a depth information acquisition device. Alternatively, the image may be captured by a device such as a camera or a mobile phone, which is not limited herein. In addition, in another alternative embodiment, the spatial features of the physical space may also be extracted from the spatial design model. For example, the spatial features of the physical space can be extracted from the three-dimensional design model of the physical space, so that the accuracy of virtual space modeling is improved. In any way, the step is essentially to provide a basis for constructing a virtual space matched with the physical space by extracting the spatial features of the physical space. The specific implementation is not limited to the above two.
Furthermore, in 101, a three-dimensional model is constructed according to the spatial structure characteristics of the physical space; and setting sound characteristic parameters of each surface in the three-dimensional model according to the surface material characteristics of the physical space, and rendering the surface material of each surface in the three-dimensional model to obtain a virtual space matched with the physical space.
For example, it is assumed that the spatial structural features of the auditorium include building structures such as inner wall structures, pillars, stages, seats, steps, etc. of the auditorium, areas of the building structures, and relative positional relationships between the building structures. The surface material characteristic of the assumed auditorium includes the surface material texture of the inner wall surface in the auditorium, the absorption rate, the reflection rate and the sound insulation effect parameter of each wall surface to sound, the surface material texture of the ground, the absorption rate, the reflection rate and the sound insulation effect parameter to sound, and the surface material texture of the seat surface, the absorption rate, the reflection rate and the sound insulation effect parameter to sound.
Based on the above assumptions, in 101, a three-dimensional model of the auditorium is constructed based on the building structures of the auditorium, the areas of the building structures, and the relative positional relationship between the building structures. Further, in the three-dimensional model, sound characteristic parameters of the inner wall surface, the floor surface, and the seat surface in the three-dimensional model are set based on various surface material parameters of the inner wall surface, the floor surface, and the seat surface in the auditorium, respectively. And according to various surface material parameters of the inner wall surface, the ground surface and the seat surface in the auditorium, the surface material of the inner wall surface, the ground surface and the seat surface in the three-dimensional model of the auditorium is rendered by adopting a three-dimensional rendering engine so as to obtain a virtual space matched with the auditorium.
It is further assumed that the surface material characteristics of the physical space include the absorption and/or reflection of sound by the respective surfaces in the physical space. Based on this, optionally, the step of setting the sound characteristic parameters of each surface in the three-dimensional model according to the surface material characteristics of the physical space may be implemented as: and identifying the sound characteristic parameters of each surface in the three-dimensional model according to the sound absorption rate and the sound reflectivity of each surface in the physical space.
Continuing with the example of the auditorium, it is assumed that the surface material characteristics of the auditorium include a first absorption rate, a first reflectivity, and a first sound insulation effect parameter of the inner wall surface of the auditorium to sound, a second absorption rate, a second reflectivity, and a second sound insulation effect parameter of the ground to sound, and a third absorption rate, a third reflectivity, and a third sound insulation effect parameter of the seat surface to sound. Based on the above hypothesis, the sound characteristic parameter of the inner wall surface can be identified in the three-dimensional model of the auditorium according to the first absorption rate, the first reflectivity and the first sound insulation effect parameter, the sound characteristic parameter of the ground can be identified in the three-dimensional model of the auditorium according to the second absorption rate, the second reflectivity and the second sound insulation effect parameter, and the sound characteristic parameter of the seat surface can be identified in the three-dimensional model of the auditorium according to the third absorption rate, the third reflectivity and the third sound insulation effect parameter.
It can be understood that the virtual space corresponding to other physical spaces, such as a concert hall, a shopping mall, a supermarket, a living space, etc., is constructed in a similar manner, and is not specifically developed here.
Further, after the virtual space is constructed, 102, the position of the user in the physical space is obtained, and the virtual position in the virtual space matching the position is used as the sound source position. By the method, the position (namely the sound source position) of the audio playing equipment to be deployed can be modified without repeatedly deploying the audio playing equipment, so that the deployment scheme of the audio playing equipment is convenient to adjust, and the deployment efficiency of the audio playing equipment is improved.
A virtual location in a virtual space that matches the location in the present disclosure may be understood as a mapped point where the location is mapped from a physical space to the virtual space. Based on this, in an optional embodiment, in 102, the initial position of the user in the physical space is taken as the origin of the physical space coordinate system, and the position information of the user in the physical space is determined by acquiring the position information of the user in the physical space to obtain the position coordinates of the user in the physical space coordinate system. And then, acquiring the corresponding relation between the physical space coordinate system and the virtual space, and converting the position coordinates of the user in the physical space coordinate system into corresponding virtual position coordinates in the virtual space according to the corresponding relation, so that the virtual position coordinates are used as the sound source position in the virtual space.
For example, after a user accesses a cloud computing platform for constructing a virtual space through a client, the client uploads position information of the user in a physical space to the cloud computing platform, the cloud computing platform calculates a corresponding virtual position of the user in the virtual space according to the position information, and the virtual position is used as a sound source position in the virtual space. In practical application, a user can carry the mobile terminal with the client to move in a physical space so as to test sound effects at various positions in the physical space.
In practical application, besides the above-mentioned manner of using the user position as the sound source position, a sound source to be simulated can be placed in a virtual space by dragging the sound source identifier in the client. For example, the position of the sound source may also be set in the virtual space by inputting position information (such as position coordinates and the like). For example, it is also possible to automatically set the sound source position in the virtual space according to the design preference of the user and the number of sound sources to be simulated. Of course, a plurality of sound source setting schemes can be displayed for the user according to the design preference of the user and the number of the sound sources to be simulated, so that the sound source simulation efficiency is improved in an auxiliary manner.
Further, in practical applications, besides the sound source position, other parameters of the sound source, including but not limited to the playback device type, the sound channel, the volume range, and the playback power, may be set in the client. Optionally, in response to a selection instruction of the user position, a sound source setting control is presented in the client, where the control is used to trigger setting items of one or more parameters of a playback device type, a sound channel, a volume range, and a playback power of the sound source.
And 103, displaying an audio playing effect of the sound source in the virtual space according to the spatial characteristics and the sound source position of the virtual space. Specifically, an audio playback effect of the sound source in the virtual space is generated according to the spatial features of the virtual space and the sound source position, and the audio playback effect is output to the user.
In an optional embodiment, in 103, the step of presenting an audio playing effect of the sound source in the virtual space according to the spatial feature of the virtual space and the sound source position may be implemented as:
generating an audio playing effect of a sound source in a virtual space according to the spatial characteristics and the sound source position of the virtual space; playing audio playing effects of the sound source at each position in the virtual space; and/or visually displaying audio playing parameters of the sound source in the virtual space by adopting a mesh graph, wherein the audio playing parameters comprise one or more of sound wave paths, sound wave intensities and surrounding effects of the sound source at each position in the virtual space.
In the above steps, the step of generating an audio playing effect of the sound source in the virtual space according to the spatial characteristics and the sound source position of the virtual space may be implemented as follows: acquiring audio test data played in a sound source; converting the audio test data into sound wave data; according to the space structure characteristics, the sound source position and the surface material characteristics of the virtual space, the sound wave path, the sound wave intensity and/or the surrounding effect of the sound wave data in the virtual space are determined through an audio simulation algorithm, so that the audio playing effect of the sound source in the virtual space is obtained. Further, it is assumed that the audio playback parameters include one or more of a sound wave path, a sound wave intensity, and a surround effect of the sound source at each position in the virtual space. Based on the method, after the audio playing effect is obtained, the audio playing effect of the sound source at each position in the virtual space can be played, and the audio playing parameters of the sound source in the virtual space can also be visually displayed by adopting a network curve graph.
For example, assume that audio test data includes test audio and test parameters. Assume that the test audio is a song. Assume that the test parameter is playback volume. It is assumed that the user movement route includes the location points a, b, c shown in fig. 2.
Based on the above assumptions, song audio to be played is acquired, and the song audio is converted into corresponding sound wave data. Furthermore, for each sound source position point, according to the spatial structure characteristics of the virtual space, the coordinates of the sound source position point and the surface material characteristics, by combining the path distance of the sound wave data transmission, the contact area of the surface of the reflecting object and the audio simulation algorithm, the sound wave path, the sound wave intensity and the surrounding effect of the sound wave data in the virtual space are calculated, and based on the sound wave path, the sound wave intensity and the surrounding effect of the sound wave data in the virtual space, the audio playing effect, the audio playing parameters and/or the propagation diagram containing the audio playing parameters (namely, the audio playing effect of the sound source) of the sound source are generated. Alternatively, the propagation map may be implemented as a mesh profile.
In the present disclosure, optionally, a mesh graph is used to show the audio playing effect of the sound source in the virtual space. In the mesh graph, each mesh intersection point represents the corresponding audio playing parameter of the point in the virtual space, such as sound wave intensity, audio volume, and the like. Therefore, whether the audio playing effect in the virtual space is balanced can be reflected through the grid fluctuation in the network surface curve graph, and if the grid fluctuation is smaller, the audio playing effect is more balanced. Optionally, in response to a selection operation on any position in the propagation map, an audio playing effect and/or an audio playing parameter corresponding to the sound source in the position is presented. For example, audio that can be heard at the position is played, and audio playing parameters such as sound wave intensity, audio volume and the like of the sound source at the position are shown through a pop window or other front-end controls.
Optionally, in the present disclosure, in response to a modification of the sound source position and/or the sound source parameter in the mesh profile, a real-time mesh profile is generated according to the spatial feature of the virtual space and the modified sound source position. And the real-time network profile curve chart is used for showing the audio playing parameters of the modified sound source at each position in the virtual space. In practical applications, the sound source parameters include, but are not limited to, one or more of a playback device type, a sound channel, a volume range, and a playback power of the sound source. The real-time playing effect of different sound sources at each position in the virtual space can be monitored more intuitively through the real-time network surface curve graph, and the adjustment of the placement plan of the audio playing equipment is assisted. For example, the real-time calculation of the audio playing effect of the sound source at each position in the virtual space can be triggered by adjusting the sound source position and the sound source parameter in the net surface graph. Therefore, by displaying the real-time network profile curve chart corresponding to the modified sound source, the audio playing effect corresponding to various deployment schemes can be monitored.
Optionally, in this disclosure, a prompt message for instructing the deployment scenario of the audio playback device is generated according to the audio playback effect, and the prompt message is pushed to the user. Specifically, the sound wave intensity difference between each position point and the surrounding position points is obtained from the audio playing effect, the target position point with the sound wave intensity difference larger than the threshold value is identified in the network surface curve graph, and therefore a sound source position correction scheme is generated according to the preset strategy and the target position point, and the correction scheme is displayed for a user.
In the method for displaying the audio playing effect shown in fig. 1, the sound source position is set by obtaining the user position, and the sound effect testing equipment and the audio simulation tool do not need to be repeatedly installed, so that the difficulty in modifying the deployment scheme of the audio playing equipment is greatly reduced, and the deployment efficiency of the equipment is improved.
Fig. 3 is a device for displaying an audio playing effect according to an embodiment of the present disclosure. As shown in fig. 3, the apparatus for presenting the audio playing effect includes:
a building module 301 configured to build, for a physical space to be displayed, a virtual space matched with the physical space according to a spatial feature of the physical space, the virtual space having a spatial feature matched with the physical space;
an obtaining module 302 configured to obtain a position of a user in a physical space, and take a virtual position in a virtual space matching the position as a sound source position;
the presentation module 303 is configured to present an audio playing effect of the sound source in the virtual space according to the spatial feature of the virtual space and the sound source position.
Optionally, the presentation module 303 is specifically configured to: generating an audio playing effect of the sound source in the virtual space according to the spatial characteristics of the virtual space and the sound source position; playing audio playing effects of the sound source at each position in the virtual space; and/or visually displaying the audio playing parameters of the sound source in the virtual space by adopting a mesh surface graph, wherein the audio playing parameters comprise one or more of sound wave paths, sound wave intensity and surrounding effect of the sound source at each position in the virtual space.
Optionally, the presentation module 303 is further configured to: and responding to the modification of the sound source position and/or the sound source parameter in the network profile graph, and generating a real-time network profile graph according to the spatial characteristics of the virtual space and the modified sound source position.
And the real-time network profile graph is used for displaying the audio playing parameters of the sound source at each position in the virtual space after modification.
Optionally, the spatial features of the physical space include spatial structure features and surface texture features.
The acquisition module 302 is specifically configured to: acquiring audio test data played in the sound source, wherein the audio test data comprises test audio and test parameters; converting the audio test data into acoustic data; and calculating the sound wave path, the sound wave intensity and/or the surrounding effect of the sound wave data in the virtual space through an audio simulation algorithm according to the space structure characteristics of the virtual space, the sound source position and the surface material characteristics so as to obtain the audio playing effect of the sound source in the virtual space.
Optionally, the system further comprises a prompt module configured to generate a prompt message for instructing the deployment scheme of the audio playing device according to the audio playing effect, and push the prompt message to the user.
Optionally, the spatial features of the physical space include spatial structure features and surface material features;
the building block 301 is specifically configured to: constructing a three-dimensional model according to the spatial structure characteristics of the physical space; and setting sound characteristic parameters of each surface in the three-dimensional model according to the surface material characteristics of the physical space, and rendering the surface material of each surface in the three-dimensional model to obtain the virtual space.
Optionally, the surface material characteristics of the physical space include an absorption rate and/or a reflection rate of sound by each surface in the physical space.
In the process that the building module 301 sets the sound characteristic parameters of each surface in the three-dimensional model according to the surface material characteristics of the physical space, the building module is specifically configured to: sound characteristic parameters of the respective surfaces are identified in the three-dimensional model from the absorption rate and the reflection rate.
Optionally, the virtual space has spatial features matching the physical space, including: the spatial characteristics of the virtual space are the same as the spatial characteristics of the physical space; or the spatial characteristics of the virtual space are proportional to the spatial characteristics of the physical space.
The above-mentioned display device for audio playing effect may execute the systems or methods provided in the foregoing embodiments, and parts not described in detail in this embodiment may refer to the related descriptions of the foregoing embodiments, which are not described herein again.
In one possible design, the structure of the apparatus for displaying an audio playing effect may be implemented as an electronic device. As shown in fig. 4, the electronic device may include: a processor 21 and a memory 22. Wherein the memory 22 has stored thereon executable code, which when executed by the processor 21, at least makes the processor 21 capable of implementing the presentation method of audio playing effect as provided in the foregoing embodiments.
The electronic device may further include a communication interface 23 for communicating with other devices or a communication network.
In addition, the present disclosure also provides a computer-readable storage medium comprising instructions, which stores executable code thereon, and when the executable code is executed by a processor of a wireless router, the processor is caused to execute the neural network-based feature data processing method provided in the foregoing embodiments. Alternatively, the computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
In an exemplary embodiment, a computer program product is also provided, which includes computer programs/instructions, when executed by a processor, implement the neural network-based feature data processing methods provided in the foregoing embodiments. The computer program/instructions are implemented by a program running on a terminal or a server.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (12)
1. A method for displaying audio playing effect is characterized by comprising the following steps:
for a physical space to be displayed, constructing a virtual space matched with the physical space according to the space characteristics of the physical space, wherein the virtual space has the space characteristics matched with the physical space;
acquiring the position of a user in the physical space, and taking a virtual position matched with the position in the virtual space as a sound source position;
and displaying the audio playing effect of the sound source in the virtual space according to the spatial characteristics of the virtual space and the sound source position.
2. The method according to claim 1, wherein said presenting an audio playing effect of the sound source in the virtual space according to the spatial characteristics of the virtual space and the sound source position comprises:
generating an audio playing effect of the sound source in the virtual space according to the spatial characteristics of the virtual space and the sound source position;
playing audio playing effects of the sound source at each position in the virtual space; and/or
And visually displaying the audio playing parameters of the sound source in the virtual space by adopting a net surface curve graph, wherein the audio playing parameters comprise one or more of sound wave paths, sound wave intensity and surrounding effect of the sound source at each position in the virtual space.
3. The method of claim 2, further comprising:
responding to modification of sound source positions and/or sound source parameters in the network profile curve graph, and generating a real-time network profile curve graph according to the spatial characteristics of the virtual space and the modified sound source positions;
and the real-time network profile graph is used for displaying the audio playing parameters of the sound source at each position in the virtual space after modification.
4. The method of claim 2, wherein the spatial characteristics of the physical space comprise spatial structural characteristics and surface texture characteristics;
generating an audio playing effect of the sound source in the virtual space according to the spatial features of the virtual space and the sound source position, including:
acquiring audio test data played in the sound source, wherein the audio test data comprises test audio and test parameters;
converting the audio test data into acoustic data;
and calculating the sound wave path, the sound wave intensity and/or the surrounding effect of the sound wave data in the virtual space through an audio simulation algorithm according to the space structure characteristics of the virtual space, the sound source position and the surface material characteristics so as to obtain the audio playing effect of the sound source in the virtual space.
5. The method of claim 1, further comprising:
and generating a prompt message for indicating the deployment scheme of the audio playing equipment according to the audio playing effect, and pushing the prompt message to a user.
6. The method of claim 1, wherein the spatial characteristics of the physical space comprise spatial structure characteristics and surface texture characteristics;
the constructing of the virtual space matched with the physical space according to the spatial features of the physical space includes:
constructing a three-dimensional model according to the spatial structure characteristics of the physical space;
and setting sound characteristic parameters of each surface in the three-dimensional model according to the surface material characteristics of the physical space, and rendering the surface material of each surface in the three-dimensional model to obtain the virtual space.
7. The method of claim 6, wherein the surface material characteristics of the physical space include sound absorption and/or reflection from each surface in the physical space;
the setting of the sound characteristic parameters of each surface in the three-dimensional model according to the surface material characteristics of the physical space comprises:
sound characteristic parameters of the respective surfaces are identified in the three-dimensional model from the absorption rate and the reflection rate.
8. The method of claim 1, wherein the virtual space has spatial features that match the physical space, comprising:
the spatial characteristics of the virtual space are the same as the spatial characteristics of the physical space; or
The spatial characteristics of the virtual space are proportional to the spatial characteristics of the physical space.
9. An apparatus for displaying audio playing effect, comprising:
the building module is configured to build a virtual space matched with a physical space according to the space characteristics of the physical space for the physical space to be displayed, wherein the virtual space has the space characteristics matched with the physical space;
an obtaining module configured to obtain a position of a user in the physical space, and take a virtual position in the virtual space matching the position as a sound source position;
and the display module is configured to display the audio playing effect of the sound source in the virtual space according to the spatial characteristics of the virtual space and the position of the sound source.
10. An electronic device, comprising:
a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the presentation method of the audio playback effect according to any one of claims 1 to 8.
11. A computer-readable storage medium, wherein the instructions, when executed by an electronic device, enable the electronic device to perform the method of presenting an audio playback effect of any one of claims 1 to 8.
12. A computer program product comprising computer programs/instructions, characterized in that said computer programs/instructions, when executed by a processor, implement the method of presenting audio playback effects of any of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111616406.9A CN114390403A (en) | 2021-12-27 | 2021-12-27 | Audio playing effect display method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111616406.9A CN114390403A (en) | 2021-12-27 | 2021-12-27 | Audio playing effect display method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114390403A true CN114390403A (en) | 2022-04-22 |
Family
ID=81197031
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111616406.9A Pending CN114390403A (en) | 2021-12-27 | 2021-12-27 | Audio playing effect display method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114390403A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104010265A (en) * | 2013-02-22 | 2014-08-27 | 杜比实验室特许公司 | Audio space rendering device and method |
| US20160360334A1 (en) * | 2014-02-26 | 2016-12-08 | Tencent Technology (Shenzhen) Company Limited | Method and apparatus for sound processing in three-dimensional virtual scene |
| CN106465037A (en) * | 2014-06-20 | 2017-02-22 | 微软技术许可有限责任公司 | Parametric wave field coding for real-time sound propagation for dynamic sources |
| US20180232471A1 (en) * | 2017-02-16 | 2018-08-16 | The University Of North Carolina At Chapel Hill | Methods, systems, and computer readable media for acoustic classification and optimization for multi-modal rendering of real-world scenes |
| TWI640983B (en) * | 2017-06-23 | 2018-11-11 | 國立臺灣科技大學 | Method for simulating room acoustics effect |
| WO2020187807A1 (en) * | 2019-03-19 | 2020-09-24 | Koninklijke Philips N.V. | Audio apparatus and method therefor |
| CN113365191A (en) * | 2021-06-04 | 2021-09-07 | 广州酷狗计算机科技有限公司 | Music playing method, device, equipment and storage medium |
-
2021
- 2021-12-27 CN CN202111616406.9A patent/CN114390403A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104010265A (en) * | 2013-02-22 | 2014-08-27 | 杜比实验室特许公司 | Audio space rendering device and method |
| US20160360334A1 (en) * | 2014-02-26 | 2016-12-08 | Tencent Technology (Shenzhen) Company Limited | Method and apparatus for sound processing in three-dimensional virtual scene |
| CN106465037A (en) * | 2014-06-20 | 2017-02-22 | 微软技术许可有限责任公司 | Parametric wave field coding for real-time sound propagation for dynamic sources |
| US20180232471A1 (en) * | 2017-02-16 | 2018-08-16 | The University Of North Carolina At Chapel Hill | Methods, systems, and computer readable media for acoustic classification and optimization for multi-modal rendering of real-world scenes |
| TWI640983B (en) * | 2017-06-23 | 2018-11-11 | 國立臺灣科技大學 | Method for simulating room acoustics effect |
| WO2020187807A1 (en) * | 2019-03-19 | 2020-09-24 | Koninklijke Philips N.V. | Audio apparatus and method therefor |
| CN113365191A (en) * | 2021-06-04 | 2021-09-07 | 广州酷狗计算机科技有限公司 | Music playing method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11632645B2 (en) | Improving computer performance of executing binaural sound | |
| CN106465037B (en) | The parameter wave field coding that live sound for dynamic source is propagated | |
| CN109285220A (en) | A kind of generation method, device, equipment and the storage medium of three-dimensional scenic map | |
| US11948343B2 (en) | Image matching method and apparatus and non-transitory computer-readable medium | |
| WO2014146668A2 (en) | Method and device for modelling room acoustic based on measured geometrical data | |
| CN110677802B (en) | Method and apparatus for processing audio | |
| JP2014106681A5 (en) | ||
| CN109754821A (en) | Information processing method and its system, computer system and computer readable medium | |
| US10911885B1 (en) | Augmented reality virtual audio source enhancement | |
| CN106658538B (en) | Mobile phone base station signal coverage area simulation method based on Thiessen polygon | |
| CN109348359B (en) | Sound equipment and sound effect adjusting method, device, equipment and medium thereof | |
| CN107450882B (en) | Method and device for adjusting sound loudness and storage medium | |
| CN116506806B (en) | Positioning method, device, storage medium and device based on Bluetooth device | |
| CN114390403A (en) | Audio playing effect display method and device | |
| US8644520B2 (en) | Morphing of aural impulse response signatures to obtain intermediate aural impulse response signals | |
| US20230401789A1 (en) | Methods and systems for unified rendering of light and sound content for a simulated 3d environment | |
| CN114386252A (en) | Audio playing effect simulation method and device | |
| KR20220123184A (en) | Audio data processing method, apparatus, electronic device and recording medium | |
| CN113344212B (en) | Model training method, device, computer equipment and readable storage medium | |
| CN115371671A (en) | Equipment position determining method and device based on indoor map | |
| CN113936106A (en) | Three-dimensional visualization method and system of monitoring map and related equipment | |
| Baldwin et al. | Towards the design and evaluation of delay-based modeling of acoustic scenes in mobile augmented reality | |
| JP2021124439A (en) | Collected sound data display program | |
| Somayazulu et al. | ActiveRIR: Active Audio-Visual Exploration for Acoustic Environment Modeling | |
| CN113110176B (en) | Robot-based running state control method and related equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| CB02 | Change of applicant information |
Address after: 200245 Building 8, No. 207, Zhongqing Road, Minhang District, Shanghai Applicant after: Dayu robot Co.,Ltd. Address before: 200245 Building 8, No. 207, Zhongqing Road, Minhang District, Shanghai Applicant before: Dalu Robot Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |