CN114915874B - Audio processing method, device, equipment and medium - Google Patents

Audio processing method, device, equipment and medium Download PDF

Info

Publication number
CN114915874B
CN114915874B CN202110182857.XA CN202110182857A CN114915874B CN 114915874 B CN114915874 B CN 114915874B CN 202110182857 A CN202110182857 A CN 202110182857A CN 114915874 B CN114915874 B CN 114915874B
Authority
CN
China
Prior art keywords
sound
directional
signal
channel
audio processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110182857.XA
Other languages
Chinese (zh)
Other versions
CN114915874A (en
Inventor
潘兴德
吴超刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Panoramic Sound Information Technology Co ltd
Original Assignee
Beijing Panoramic Sound Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Panoramic Sound Information Technology Co ltd filed Critical Beijing Panoramic Sound Information Technology Co ltd
Priority to CN202110182857.XA priority Critical patent/CN114915874B/en
Priority to PCT/CN2021/100382 priority patent/WO2022170716A1/en
Publication of CN114915874A publication Critical patent/CN114915874A/en
Application granted granted Critical
Publication of CN114915874B publication Critical patent/CN114915874B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/20Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/323Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only for loudspeakers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/20Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/302Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303Tracking of listener position or orientation

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Stereophonic System (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
  • Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)

Abstract

The application provides an audio processing method, an audio processing device, audio processing equipment, audio processing media and an audio processing program product, wherein the audio processing method, the audio processing device, the audio processing equipment, the audio processing media and the audio processing program product are characterized in that media information is obtained, the media information comprises sound orientation information configured for each target position in a preset range, and the sound orientation information is used for determining the transmission direction of sound signals in the media information; and then transmitting sound signals to each target position according to the sound orientation information so that the sound signals received by each target position accord with the corresponding target characteristics. The method solves the technical problem that the prior audio-visual media technology cannot meet different requirements of users on sound characteristics at different positions, and realizes the technical effect of directionally transmitting different sounds to the users at specific positions so as to meet the different sound requirements of the users.

Description

Audio processing method, device, equipment and medium
Technical Field
The present disclosure relates to the field of electronic technologies, and in particular, to an audio processing method, apparatus, device, medium, and program product.
Background
With the continuous development of the audio-visual media technology, the audio-visual media successively goes through silent video media, mono audio media, stereo media, surround sound media (4 channels, 5.1 channels, 7.1 channels) and panoramic audio media.
Conventional media typically employ sound technology that allows all users to hear sound synchronized with the picture, such as a movie viewer at a theatre, to hear the same movie sound regardless of the location in the theatre. However, with the continuous development of the video media technology, the user needs for video media gradually diversified, and the existing video media technology not only limits the creation space of video producers, but also cannot meet the different needs of different video media audiences in the same space for sound.
Therefore, the existing audio-visual media technology has the technical problem that different requirements of users on sound at different positions cannot be met.
Disclosure of Invention
The application provides an audio processing method, an audio processing device, audio processing equipment, an audio processing medium and an audio processing program product, which are used for solving the technical problem that the existing audio-video media technology cannot meet different requirements of users on sound characteristics at different positions.
In a first aspect, the present application provides an audio processing method, including:
acquiring media information, wherein the media information comprises sound orientation information configured for each target position in a preset range, and the sound orientation information is used for determining the transmission direction of sound signals in the media information;
And transmitting sound signals to each target position according to the sound orientation information so that the sound signals received by each target position accord with corresponding target characteristics.
In one possible design, the conforming the sound signals received at the respective target locations to the corresponding target features includes:
the sound signals received by the respective target locations are not identical or not identical.
In one possible design, the conforming the sound signals received at the respective target locations to the corresponding target features includes:
the sound signals received by the respective target locations have the same attribute characteristics.
In one possible design, the transmitting the sound signal to each of the target locations according to the sound orientation information includes:
loading the sound signal into an ultrasonic signal;
and transmitting the sound signal to each target position according to the sound orientation information by using the ultrasonic signal.
In one possible design, the sound signal comprises a directional sound signal, and before the loading of the sound signal into the ultrasonic signal, further comprising:
Extracting the directional sound signal from a directional sound channel of the media information, wherein the directional sound channel is a channel other than a conventional channel;
correspondingly, loading the directional acoustic signal into the ultrasonic signal;
and transmitting the directional sound signals to each target position according to the sound directional information by utilizing the ultrasonic signals.
Optionally, the regular channels include: stereo, 5.1 channel, 7.1 channel, 5.1.4 channel, 7.1.2 channel, 7.1.4 channel, and 13.1 channel.
In one possible design, the sound signal comprises a directional sound signal, and before the loading of the sound signal into the ultrasonic signal, further comprising:
extracting the directional sound signal from the sound object of the media information;
correspondingly, loading the directional acoustic signal into the ultrasonic signal;
and transmitting the directional sound signals to each target position according to the sound directional information by utilizing the ultrasonic signals.
Optionally, before the acquiring the media information, the method further includes:
acquiring the directional sound signal;
newly building the directional sound channel and adding the directional sound signal into the directional sound channel;
And when the media information is produced, adding the directional sound channel and the conventional sound channel into an audio data file corresponding to the media information.
In one possible design, before the acquiring the media information, the method further includes:
acquiring the directional sound signal;
the sound object is utilized to carry the directional sound signal when the media information is produced.
In a second aspect, the present application provides an audio processing apparatus comprising:
the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring media information, the media information comprises sound orientation information configured for each target position in a preset range, and the sound orientation information is used for determining the transmission direction of sound signals in the media information;
and the directional transmission module is used for transmitting the sound signals to each target position according to the sound directional information so that the sound signals received by each target position accord with the corresponding target characteristics.
In one possible design, the sound signals received by the respective target locations are not identical or not identical.
In one possible design, the sound signals received by the respective target locations have the same attribute characteristics.
In one possible design, the directional transmission module is specifically configured to:
loading the sound signal into an ultrasonic signal;
and transmitting the sound signal to each target position according to the sound orientation information by using the ultrasonic signal.
In one possible design, the directional transmission module is further configured to extract the directional sound signal from a directional sound channel of the media information, where the directional sound channel is a channel other than a regular channel;
correspondingly, the directional transmission module is used for loading the directional sound signal into the ultrasonic signal; and transmitting the directional sound signals to each target position according to the sound directional information by utilizing the ultrasonic signals.
Optionally, the regular channels include: stereo, 5.1 channel, 7.1 channel, 5.1.4 channel, 7.1.2 channel, 7.1.4 channel, and 13.1 channel.
In one possible design, the sound signal includes a directional sound signal, and the directional transmission module is further configured to extract the directional sound signal from a sound object of the media information;
correspondingly, the directional transmission module is used for loading the directional sound signal into the ultrasonic signal; and transmitting the directional sound signals to each target position according to the sound directional information by utilizing the ultrasonic signals.
Optionally, the acquiring module is further configured to acquire the directional acoustic signal;
the media information making module is used for creating the directional sound channel and adding the directional sound signal into the directional sound channel;
the media information making module is further configured to add the directional sound channel and the regular sound channel to an audio data file corresponding to the media information when the media information is made.
In one possible design, the acquisition module is further configured to acquire the directional acoustic signal;
and the media information making module is used for bearing the directional sound signal by utilizing the sound object when the media information is made.
The media information creation module may be included in the audio processing device or may be a separate media information creation device.
In a third aspect, the present application provides an electronic device, comprising:
a processor; and
a memory for storing a computer program of the processor;
wherein the processor is configured to implement any one of the possible audio processing methods provided in the first aspect by executing the computer program.
In a fourth aspect, the present application provides an audio processing system comprising: a directional speaker and an electronic device provided by the third aspect; wherein,,
the directional loudspeaker is used to implement any one of the possible audio processing methods provided in the first aspect, the step of transmitting the sound signal to the target location.
In a fifth aspect, the present application also provides a storage medium having stored therein a computer program for executing any one of the possible audio processing methods provided in the first aspect.
In a sixth aspect, the present application also provides a computer program product comprising a computer program which, when executed by a processor, implements any one of the possible audio processing methods provided in the first aspect.
The application provides an audio processing method, an audio processing device, audio processing equipment, audio processing media and an audio processing program product, wherein the audio processing method, the audio processing device, the audio processing equipment, the audio processing media and the audio processing program product are characterized in that media information is obtained, the media information comprises sound orientation information configured for each target position in a preset range, and the sound orientation information is used for determining the transmission direction of sound signals in the media information; and then transmitting sound signals to each target position according to the sound orientation information so that the sound signals received by each target position accord with the corresponding target characteristics. The method solves the technical problem that the prior audio-visual media technology cannot meet different requirements of users on sound characteristics at different positions, and realizes the technical effect of directionally transmitting different sounds to the users at specific positions so as to meet the different sound requirements of the users.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief description will be given below of the drawings that are needed in the embodiments or the prior art descriptions, it being obvious that the drawings in the following description are some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort to a person skilled in the art.
Fig. 1 is a schematic view of an application scenario of an audio processing method according to an exemplary embodiment of the present application;
FIG. 2 is a flow chart of an audio processing method according to an exemplary embodiment of the present application;
FIG. 3 is a flow chart of an audio processing method according to another exemplary embodiment of the present application;
fig. 4 is a schematic structural diagram of an audio processing device according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device provided in the present application.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
The terms "first," "second," "third," "fourth" and the like in the description and in the claims of this application and in the above-described figures, if any, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the present application described herein may be implemented, for example, in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The following describes the technical solutions of the present application and how the technical solutions of the present application solve the above technical problems in detail with specific embodiments. The following embodiments may be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.
Conventional audio processing technology for audio-visual media has undergone a development history from silent media, mono audio media, stereo media, surround sound media (4 channels, 5.1 channels, 7.1 channels) to panoramic audio media (e.g., dolby panoramic sound). Wherein recording sound in the medium is accomplished from silence to mono sound and reproducing sound to the audience while the presentation is being played. Whereas the conversion from mono to stereo, surround sound is mainly reflected in the increase of channels and the concept of a so-called sound field. The latest panoramic sound is added into the attribute characteristics of the sound expression according to the motion characteristics of the sound objects in the media display content, so that an audience or a user can more experience the motion feeling of the sound, and the sound effect scene in reality is truly restored.
However, the inventor of the present application found that, in the course of development of the whole audio processing technology, the audience or user of the media information is a direct perceptron of the sound effect on the surface, but the audio processing technology is rarely focused on the individual requirements of the audience or user, and the audience or user is enabled to perceive the on-site sound effect of the sound source object when being recorded by using the sound source object in the media information such as a movie as the processing core. However, such inertial thinking has abandoned the most important "user-centric" concept, which defaults to all users wanting to get a consistent look and feel or hear consistent audio content. The thinking inertia not only limits the creation thought of the video and audio media, but also can not effectively meet different demands of users.
For example, some users are particularly sensitive to specific frequency sounds such as metal fricatives during braking of a train, too real sound effect restoration can affect the look and feel of the users, so that the viewing experience is reduced, and other users are lovers of the detail sounds, such as users watching racing videos, bombing sounds of engines and sounds of mechanical operation, which are all the sounds pursuing the most important users want to acquire. These two conflicting requirements are obviously not fulfilled in the same viewing environment by existing audio processing techniques.
In the prior art, when facing different demands of different users, the adopted solutions only classify the users, and respectively manufacture audio versions meeting different user types, so that the different types of users can watch or listen to the audio content of different versions in different times or scenes. But cannot simultaneously meet different requirements of different types of users under the same scene and the same time and space.
This prior art solution has in reality too many limitations, for example, when one looks at a movie, two people are in line with each other, and watch the same movie, but cannot watch it together because they are separated into different user types. Or the collection and classification of the types of the users are too troublesome, the preparation steps of the user for watching the movies are increased, the use experience of the users is affected, the final classification cannot be effectively carried out, the types are misplaced, and the influence on the users is great.
To solve the above problems, the inventive concept of the present application is:
and according to different target positions of users with different requirements in film watching, different sound signals are sent in a directional mode. It is understood that, for example, in a large sound field of a cinema, several small-range sound fields are established, and the sound characteristics, i.e., target characteristics, transmitted in each of the small-range sound fields are different. Thus, different audio requirements of different users can be met.
Fig. 1 is a schematic application scenario diagram of an audio processing method according to an exemplary embodiment of the present application. The scene is a movie theatre viewing scene, as shown in fig. 1, a plurality of target positions 110 are set within a preset range 100, and at least one seat can be arranged on each target position 110. In this embodiment there is no obstruction or sound insulation between the individual target locations. In this scenario, a plurality of normal speakers for playing existing base audio are arranged, as well as a plurality of directional speakers, such as: the directional loudspeaker is used for transmitting directional sound information to the target positions, so that sound signals received by each target position accord with corresponding target characteristics, and different requirements of users at different target positions are met. The steps of the audio processing method provided in the present application are specifically described below.
Fig. 2 is a flow chart illustrating an audio processing method according to an exemplary embodiment of the present application.
As shown in fig. 2, the audio processing method provided in this embodiment specifically includes:
s201, acquiring media information, wherein the media information comprises sound orientation information configured for each target position in a preset range.
In this step, the sound direction information is used to determine a transmission direction of a sound signal in the media information.
In this embodiment, the media information is a DCP (Digital Cinema Package) digital cinema package, specifically, a player of the cinema obtains a DCP digital cinema package, and then decodes the DCP digital cinema package through a decoding program to obtain a directional sound signal, where attribute features of the directional sound signal include sound directional information, and the sound directional information may be coordinates of a target position.
It should be noted that, as shown in fig. 1, one embodiment of the coordinate system is set as an origin of a rectangular coordinate system or a polar coordinate system at the geometric center of the preset range 100, and then the coordinates of the target position may be represented by coordinates of the center point of the target position with respect to the origin.
S202, transmitting sound signals to each target position according to the sound orientation information so that the sound signals received by each target position accord with corresponding target characteristics.
In this embodiment, the sound signals in the media information are divided into two types, one being a base sound signal and the other being a directional sound signal. The player performs sound field rendering, amplification and output on the basic sound signal to a common loudspeaker array of the cinema, so that cinema sound reproduction is realized.
That is, the basic sound signal is transmitted to the normal speaker, and the normal speaker plays the basic sound signal to the whole preset range 100, and the basic sound signal includes: at least one of a mono signal, a stereo signal, a surround signal, and a panoramic signal. The basic sound signal is used to transmit a sound signal commonly required by all users, such as background music, main character, etc., to each position in the preset range 100.
Meanwhile, the player sends the directional sound signal to the directional sound loudspeaker, the directional sound loudspeaker loads the directional sound signal into the ultrasonic signal, ultrasonic waves are generated through the ultrasonic transducer, the ultrasonic waves are sent to the target positions indicated by the sound directional information, and the sub-sound field is generated, so that only the audience of the coverage area of the directional sound loudspeaker can hear the directional sound, namely, the sound signals received by all the target positions are different or not identical.
The ultrasonic signal generates a beat signal due to the nonlinear effect of the air medium, so that the directional sound signal loaded in the ultrasonic wave is restored to visible sound through the beat signal, and is perceived by a user.
It should be further noted that the basic sound field generated within the preset range 100 in the prior art cannot enable each target location to generate the same sound effect characteristic. The audio processing method provided by the embodiment can solve the problem, and by utilizing the characteristics of low attenuation (namely small attenuation amplitude, long sound propagation distance, clear sound and same far and near volume) of the ultrasonic directional sound technology, all audiences can experience the effect of sound at the ear without wearing headphones, and the directional loudspeaker can give better sound effect to the audiences under the condition of the same power consumption or lower power consumption under the condition of the same sound effect in a large cinema or a large music scene. And the audience at each position can feel the same sound effect, namely the sound signals received by the target positions have the same attribute characteristics.
In one possible implementation, the steps of the present embodiment are implemented with an audio processing system, including: the system comprises a server and a directional loudspeaker, wherein the server is used for acquiring media information, the media information comprises sound directional information configured for each target position in a preset range, and the sound directional information is used for determining the transmission direction of sound signals in the media information;
The server is further configured to deliver the media information to the directional sound speaker;
and the directional sound loudspeaker is used for transmitting sound signals to each target position according to the sound directional information so that the sound signals received by each target position accord with the corresponding target characteristics.
It should be noted that the server may be a cinema player or a cinema audio processor, or may be a central controller integrated in the directional speaker, that is, the server and the directional speaker are integrated into a whole as an intelligent directional speaker. The intelligent directional loudspeaker can be applied to scenes such as home cinema, amusement parks, concerts and the like.
The embodiment provides an audio processing method, by acquiring media information, the media information includes sound orientation information configured for each target position in a preset range, and the sound orientation information is used for determining a transmission direction of a sound signal in the media information; and then transmitting sound signals to each target position according to the sound orientation information so that the sound signals received by each target position accord with the corresponding target characteristics. The method solves the technical problem that the prior audio-visual media technology cannot meet different requirements of users on sound characteristics at different positions, and realizes the technical effect of directionally transmitting different sounds to the users at specific positions so as to meet the different sound requirements of the users.
Fig. 3 is a flow chart illustrating an audio processing method according to another exemplary embodiment of the present application. As shown in fig. 3, the audio processing method provided in this embodiment specifically includes:
s301, acquiring a directional sound signal.
In this step, the directional sound signal is used to provide a specific sound signal to a preset target user to meet the special requirements of the user.
In this embodiment, the explanation is performed with an application scenario meeting the special requirement of the visually impaired user on the audio-visual media, and further, the audio processing method provided by this embodiment, in which the audio-visual media is a movie, can be used to solve the problem how to enable the visually impaired user to walk into a movie theater like a normal person to view the movie.
When the movie is required to be produced, the side-white audio for the scenario explanation is added, and the part of the side-white audio can be directionally transmitted to the video watching special area, namely the target position, of the vision-impaired person specially arranged in the cinema. Thus, the visually impaired person can watch the movie in the cinema like a normal person without wearing special headphones.
In the process of movie production, directional sound information such as side-note audio which needs to be added into a movie is firstly obtained.
S302, adding a directional sound signal when media information is produced.
In this step, two implementations are included:
1. when the directional sound signal is carried in channels:
firstly, creating a directional sound channel, and adding a directional sound signal into the directional sound channel; the directional channels are then added to the audio data file corresponding to the media information along with the regular channels at the time of media information production.
In this embodiment, the conventional channels include: 5.1 channel, 7.1 channel, 7.1.2 channel, 13.1 channel, etc. The conventional channels include other channel construction types in the prior art, and the application is not limited only to indicate that the directional channel in the embodiment of the application is a new channel specially used for carrying directional sound, which is different from the conventional channel. Of course, it will be appreciated that one skilled in the art may also use one or more of the conventional channels as a directional channel that is dedicated to carrying directional sound.
Specifically, when the directional sound is placed in the channels, it is placed in the channels other than stereo, 5.1 channels, 7.1 channels, 5.1.4 channels, 7.1.2 channels, 7.1.4 channels, and 13.1 channels, and is typically placed in the last 4 channels of the 16 channels (Sch 1, sch2, … …, sch 16), that is, sch1 to Sch12 are basic sound signals, sch13 to Sch16 are directional sound signals, and 1 or more channels of Sch13 to Sch16 may be included in each movie program as directional sound signals.
2. When carrying directional sound signals with sound objects:
in the production of media information, a sound object is used to carry a directional sound signal.
In particular, if the directional sound is placed in a sound object, metadata of the sound object may store various attribute information of the directional sound, such as direction, position, frequency band, and the like.
In one possible design, the directional sound is placed in a sound object, and the object type in the metadata of the directional sound object is marked as directional sound. And the base sound object and the directional sound object can be coded by adopting audio coding schemes such as WANOS, AVS2 and the like.
Further, the metadata of the directional sound object further includes information required for performing directional sound rendering, including, but not limited to, position coordinate information (x, y, z) of the sound object, the center of the cinema viewing area, i.e., the preset area, is taken as an origin of a coordinate system, and coordinates of a center point of the target position are taken as position coordinate information.
Of course, the location where the directional speaker is installed may be taken as the origin of the coordinate system, and those skilled in the art may select the number and location of the directional speakers according to the actual situation, which is not limited in this application.
After the media information is produced, the basic sound signal and the directional sound signal are output together into a film sound stream (or file) containing the directional sound, and the film sound file (stream) containing the directional sound and the film video file (stream) are printed together into a film DCP package and distributed to a cinema through a network, a hard disk and the like.
S303, acquiring media information, wherein the media information comprises sound orientation information configured for each target position in a preset range.
In this step, the sound direction information is used to determine a transmission direction of a sound signal in the media information.
In this embodiment, the player of the cinema reads the movie DCP package, i.e., the media information, through a network or a hard disk or the like.
S304, extracting the directional sound signal from the media information.
In this step, there are two extraction methods corresponding to the two methods in step S302.
1. Extracting the directional sound signal from a directional sound channel of the media information, wherein the directional sound channel is a channel other than a conventional channel;
2. the directional sound signal is extracted from a sound object of the media information.
In the present embodiment, the cinema sound decoder receives a movie sound stream containing directional sound output from a movie player (server) and decodes two types of sound signals, i.e., a base sound signal and a directional sound signal. And send these two types of sound signals to the normal loudspeaker array of the cinema and the directional sound loudspeaker respectively.
S305, loading the directional sound signal into the ultrasonic signal.
In the step, the directional sound loudspeaker utilizes the ultrasonic directional sound technology to load the directional sound signal into the ultrasonic signal, and utilizes the characteristic of the ultrasonic high-frequency signal to realize directional transmission.
It should be noted that the ultrasonic directional sound technique has the following characteristics:
a) Superstrong directivity, directional sound transmission
i. The ultra-strong directivity controls the sound to propagate in a local range;
specific sounds are directed to audience in specific areas and do not interfere with each other.
b) Low attenuation
i. The attenuation amplitude is small, and the sound propagation distance is long;
and ii, the sound is clear, and the far and near sound volumes are the same.
c) Refractive characteristics
i. The sound encountering plane may reflect, virtual sound sources may be implemented, and stereo sound may be realized.
d) Simple installation
i. Various installation forms, ultra-thin characteristic and simple installation.
By utilizing the refraction characteristic, the stereo effect can be generated even by using the ultrasonic speakers, and the number of the speakers is greatly reduced compared with that of the common speakers, so that the cost is saved, and the special effect of sound effect is ensured.
S306, transmitting the directional sound signals to each target position according to the sound directional information by utilizing the ultrasonic signals.
In this step, the sound orientation information includes coordinates of the target position, and the sound orientation information is included in the attribute information of the oriented sound signal.
The directional sound speaker will send directional sound signals to each target location so that the sound signals received at each target location conform to the corresponding target characteristics.
It should be noted that, making the sound signal received by each target position conform to the corresponding target feature includes:
the sound signals received by the target positions are different or not identical;
alternatively, the sound signals received by the respective target locations have the same attribute characteristics.
Specifically, for users with special requirements, the sound signals received by the corresponding target positions of the users also comprise special customized directional sound signals besides basic sound signals. For example, in this embodiment, for the visually impaired user, the signal of the explanation of the movie scenario may be included, so that the visually impaired user can also watch the movie with the ordinary person, and the use experience of the visually impaired user is greatly improved without any additional devices such as headphones.
In one possible design, when a cinema plays a movie, a cinema sound decoder receives a movie sound stream containing directional sound output from a movie player (server) and decodes two types of sound signals, i.e., a base sound signal and a directional sound signal. And the basic sound signals are rendered, amplified and output to a common loudspeaker array of the cinema through the sound field, so that cinema sound reproduction is realized. The cinema sound decoder carries out ultrasonic frequency modulator on the directional sound signals according to the metadata of the directional sound objects, the cinema space dimensions (height, width, length) and the like, and outputs the directional sound signals to the directional sound loudspeaker for presentation after ultrasonic modulation.
It should be noted that, the audio processing method provided in this embodiment is also applicable to scenes such as home theatres, living rooms, and the like.
In a possible implementation manner, the above-mentioned process may also be implemented by an audio processing system, which includes: the system comprises a media information making server, a playing server and a directional loudspeaker; wherein,,
the media information making server is used for acquiring the directional sound signals;
the media information making server is also used for newly establishing the directional sound channel and adding the directional sound signal into the directional sound channel; or,
the media information making server is also used for adding the directional sound signal into the sound object;
further, the media information making server is further configured to add the directional sound channel and the regular sound channel to an audio data file corresponding to the media information when the media information is made; or,
the media information production server is further configured to carry the directional sound signal with the sound object when the media information is produced;
the playing server is used for acquiring media information, wherein the media information comprises sound orientation information configured for each target position in a preset range, and the sound orientation information is used for determining the transmission direction of sound signals in the media information;
The playing server is further used for transmitting the media information to the directional sound loudspeaker;
and the directional sound loudspeaker is used for transmitting sound signals to each target position according to the sound directional information so that the sound signals received by each target position accord with the corresponding target characteristics.
Optionally, the sound signal includes a directional sound signal, and the directional sound speaker is configured to transmit the sound signal to each target location according to the sound directional information, including:
the directional sound speaker is used for loading the sound signal into an ultrasonic signal;
the directional sound speaker is further configured to transmit the sound signal to each of the target positions according to the sound directional information by using the ultrasonic signal.
Optionally, the sound signal includes a directional sound signal, and the playing server is further configured to transfer the media information to the directional sound speaker, including:
the playing server is further configured to extract the directional sound signal from a directional sound channel of the media information, where the directional sound channel is a channel other than a conventional channel;
correspondingly, the directional sound loudspeaker is used for loading the directional sound signal into the ultrasonic signal; and transmitting the directional sound signals to the target positions according to the sound directional information by utilizing the ultrasonic signals.
In one possible design, the playback server is integrated into the directional speaker to form an intelligent directional speaker playback terminal.
In another possible design, the media production server and the play server are integrated into one server to form an intelligent directional media center server integrating production and play functions.
The embodiment provides an audio processing method, by acquiring media information, the media information includes sound orientation information configured for each target position in a preset range, and the sound orientation information is used for determining a transmission direction of a sound signal in the media information; and then transmitting sound signals to each target position according to the sound orientation information so that the sound signals received by each target position accord with the corresponding target characteristics. The method solves the technical problem that the prior audio-visual media technology cannot meet different requirements of users on sound characteristics at different positions, and realizes the technical effect of directionally transmitting different sounds to the users at specific positions so as to meet the different sound requirements of the users.
Fig. 4 is a schematic structural diagram of an audio processing device according to an embodiment of the present application. As shown in fig. 4, the audio processing apparatus 400 provided in this embodiment includes:
An obtaining module 401, configured to obtain media information, where the media information includes sound orientation information configured for each target position within a preset range, and the sound orientation information is used to determine a transmission direction of a sound signal in the media information;
and the directional transmission module 402 is configured to transmit the sound signal to each target location according to the sound directional information, so that the sound signal received by each target location accords with the corresponding target feature.
In one possible design, the sound signals received by the respective target locations are not identical or not identical.
In one possible design, the sound signals received by the respective target locations have the same attribute characteristics.
In one possible design, the directional transmission module 402 is specifically configured to:
loading the sound signal into an ultrasonic signal;
and transmitting the sound signal to each target position according to the sound orientation information by using the ultrasonic signal.
In one possible design, the sound signal includes a directional sound signal, and the directional transmission module 402 is further configured to extract the directional sound signal from a directional sound channel of the media information, where the directional sound channel is a channel other than a regular channel;
Correspondingly, the directional transmission module 402 is configured to load the directional acoustic signal into the ultrasonic signal; and transmitting the directional sound signals to each target position according to the sound directional information by utilizing the ultrasonic signals.
Optionally, the regular channels include: stereo, 5.1 channel, 7.1 channel, 5.1.4 channel, 7.1.2 channel, 7.1.4 channel, and 13.1 channel.
In one possible design, the sound signal includes a directional sound signal, and the directional transmission module 402 is further configured to extract the directional sound signal from the sound object of the media information;
correspondingly, the directional transmission module 402 is configured to load the directional acoustic signal into the ultrasonic signal; and transmitting the directional sound signals to each target position according to the sound directional information by utilizing the ultrasonic signals.
Optionally, the acquiring module 401 is further configured to acquire the directional acoustic signal;
the media information making module is used for creating the directional sound channel and adding the directional sound signal into the directional sound channel;
the media information making module is further configured to add the directional sound channel and the regular sound channel to an audio data file corresponding to the media information when the media information is made.
In one possible design, before the obtaining module 401 is configured to obtain the media information, the method further includes:
the acquisition module 401 is further configured to acquire the directional acoustic signal;
and the media information making module is used for bearing the directional sound signal by utilizing the sound object when the media information is made.
In one possible design, the audio processing device 400 is one of the constituent devices of a directional sound-containing media production system, and the directional sound-containing media production system further includes:
the media information making module is used for newly establishing the directional sound channel and adding the directional sound signal into the directional sound channel when the media information is made; and/or for carrying the directional acoustic signal with the acoustic object at the time of the production of the media information.
In one possible design, a media information production module, an acquisition module, and a directional transmission module are integrated into a media production system that includes directional sound. The audio effect of the directional sound can be monitored simultaneously in the process of producing the media program.
The media information making module is used for newly establishing the directional sound channel and adding the directional sound signal into the directional sound channel when the media information is made; or/and for carrying the directional acoustic signal with the acoustic object when the media information is produced.
The system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring media information, the media information comprises sound orientation information configured for each target position in a preset range, and the sound orientation information is used for determining the transmission direction of sound signals in the media information;
and the directional transmission module is used for transmitting the sound signals to each target position according to the sound directional information so that the sound signals received by each target position accord with the corresponding target characteristics.
It should be noted that, the audio processing apparatus 400 provided in the embodiment of fig. 4 may perform the method provided in any of the above method embodiments, and the specific implementation principles, technical features, terms and explanations and technical effects are similar, and are not repeated herein.
Fig. 5 is a schematic structural diagram of an electronic device provided in the present application. As shown in fig. 5, the electronic device 500 may include: at least one processor 501 and a memory 502. Fig. 5 shows an electronic device, for example a processor.
A memory 502 for storing a program. In particular, the program may include program code including computer-operating instructions.
The memory 502 may comprise high-speed RAM memory or may further comprise non-volatile memory (non-volatile memory), such as at least one disk memory.
The processor 501 is configured to execute computer-executable instructions stored in the memory 502 to implement the methods described in the method embodiments above.
The processor 501 may be a central processing unit (central processing unit, abbreviated as CPU), or an application specific integrated circuit (application specific integrated circuit, abbreviated as ASIC), or one or more integrated circuits configured to implement embodiments of the present application.
Alternatively, the memory 502 may be separate or integrated with the processor 501. When the memory 502 is a device separate from the processor 501, the electronic device 500 may further include:
a bus 503 for connecting the processor 501 and the memory 502. The bus may be an industry standard architecture (industry standard architecture, abbreviated ISA) bus, an external device interconnect (peripheral component, PCI) bus, or an extended industry standard architecture (extended industry standard architecture, EISA) bus, among others. Buses may be divided into address buses, data buses, control buses, etc., but do not represent only one bus or one type of bus.
Alternatively, in a specific implementation, if the memory 502 and the processor 501 are integrated on a chip, the memory 502 and the processor 501 may complete communication through an internal interface.
It should be noted that the electronic device 500 may correspond to the server in the embodiment shown in fig. 2, or the media creation server and/or the play server in the embodiment shown in fig. 3.
The application also provides an audio processing system comprising: a directional speaker and the electronic device shown in fig. 5; wherein,,
the directional loudspeaker is used to implement the step of transmitting the sound signal to the target location in any one of the possible audio processing methods provided by the method embodiments described above.
It should be noted that, the audio processing system provided in this embodiment introduces directional sound in the production and playing links of media information, so as to effectively improve the immersion and interactivity of sound in media information such as a movie or provide assistance for visually impaired viewers.
The specific effects include:
(1) Improving immersion: usually, the number of cinema loudspeakers is small, and accurate sound field rendering technologies such as Wave Field Synthesis (WFS) and harmonic synthesis (Ambiosonic) are difficult to use, so that specific sounds in a movie are effectively positioned at the ears of a spectator. The specific sound can be presented at the ear of the audience in the area covered by the directional sound loudspeaker through the directional sound loudspeaker, so that the immersion of the cinema sound is greatly enhanced.
(2) Improving interactivity: the high directivity of the directional sound technology can be utilized to match with the movie plot, provide specific sound for audience in specific areas (areas covered by the directional sound speakers), and the sound of different directional sound speaker coverage areas can be different, so that the interactivity and entertainment experience of the movie are improved.
(3) Providing assistance to visually impaired viewers: because the directional sound loudspeaker has very high directional directivity, only the visually impaired people who cover the area of the directional sound loudspeaker can hear the sound of the movie explanation provided for the person, thereby helping the visually impaired people to better understand the movie scenario. In the SMPTE standard, a vision-impaired auxiliary channel is also defined, which can also be provided to a vision-impaired person via directional sound speakers if there is a vision-impaired auxiliary channel signal in the movie.
The present application also provides a computer-readable storage medium, which may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a read-only memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, specifically, the computer readable storage medium stores program instructions for the methods in the above embodiments.
The present application also provides a computer program product comprising a computer program which, when executed by a processor, implements the method of the above-described method embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

Claims (17)

1. An audio processing method, comprising:
acquiring media information, wherein the sound signal of the media information comprises: a base sound signal and a directional sound signal, the base sound signal comprising: at least one of a mono signal, a stereo signal, a surround signal, and a panoramic signal; the directional sound signals comprise sound directional information configured for each target position in a preset range, and the sound directional information is used for determining the transmission direction of the directional sound signals in the media information; the basic sound signal is used for playing to the whole preset range; the directional sound signal is used for playing to a target position indicated by the sound directional information;
Transmitting sound signals to each target position according to the sound orientation information so that the sound signals received by each target position accord with corresponding target characteristics;
the transmitting the sound signal to each target position according to the sound orientation information comprises the following steps: loading the sound signal into an ultrasonic signal; transmitting the sound signal to each of the target positions according to the sound orientation information by using the ultrasonic signal;
before said loading of said sound signal into the ultrasound signal, further comprising: extracting the directional sound signal from a directional sound channel of the media information, wherein the directional sound channel is a channel other than a conventional channel; correspondingly, loading the directional acoustic signal into the ultrasonic signal; and transmitting the directional sound signals to each target position according to the sound directional information by utilizing the ultrasonic signals.
2. The audio processing method according to claim 1, wherein said conforming the sound signals received at the respective target positions to the corresponding target features includes:
the sound signals received by the respective target locations are not identical or not identical.
3. The audio processing method according to claim 1, wherein said conforming the sound signals received at the respective target positions to the corresponding target features includes:
the sound signals received by the respective target locations have the same attribute characteristics.
4. The audio processing method of claim 1, wherein the regular channel comprises: stereo, 5.1 channel, 7.1 channel, 5.1.4 channel, 7.1.2 channel, 7.1.4 channel, and 13.1 channel.
5. The audio processing method according to claim 1, characterized by further comprising, before said loading the sound signal into an ultrasonic signal:
extracting the directional sound signal from the sound object of the media information;
correspondingly, loading the directional acoustic signal into the ultrasonic signal;
and transmitting the directional sound signals to each target position according to the sound directional information by utilizing the ultrasonic signals.
6. The audio processing method according to claim 1 or 4, further comprising, before the acquiring the media information:
acquiring the directional sound signal;
newly building the directional sound channel and adding the directional sound signal into the directional sound channel;
And when the media information is produced, adding the directional sound channel and the conventional sound channel into an audio data file corresponding to the media information.
7. The audio processing method of claim 5, further comprising, prior to said obtaining media information:
acquiring the directional sound signal;
the sound object is utilized to carry the directional sound signal when the media information is produced.
8. An audio processing apparatus, comprising:
the acquisition module is used for acquiring media information, and the sound signal of the media information comprises: a base sound signal and a directional sound signal, the base sound signal comprising: at least one of a mono signal, a stereo signal, a surround signal, and a panoramic signal; the directional sound signals comprise sound directional information configured for each target position in a preset range, and the sound directional information is used for determining the transmission direction of the directional sound signals in the media information; the basic sound signal is used for playing to the whole preset range; the directional sound signal is used for playing to a target position indicated by the sound directional information;
The directional transmission module is used for transmitting sound signals to each target position according to the sound directional information so that the sound signals received by each target position accord with corresponding target characteristics;
the directional transmission module is specifically configured to: loading the sound signal into an ultrasonic signal; transmitting the sound signal to each of the target positions according to the sound orientation information by using the ultrasonic signal;
the directional transmission module is further configured to extract the directional sound signal from a directional sound channel of the media information, where the directional sound channel is a channel other than a conventional channel; correspondingly, the directional transmission module is used for loading the directional sound signal into the ultrasonic signal; and transmitting the directional sound signals to each target position according to the sound directional information by utilizing the ultrasonic signals.
9. The audio processing apparatus of claim 8, wherein the sound signals received by the respective target locations are not identical or identical.
10. The audio processing device of claim 8, wherein the sound signals received by each of the target locations have the same attribute characteristics.
11. The audio processing apparatus of claim 8, wherein the regular channel comprises: stereo, 5.1 channel, 7.1 channel, 5.1.4 channel, 7.1.2 channel, 7.1.4 channel, and 13.1 channel.
12. The audio processing device of claim 8, wherein the sound signal comprises a directional sound signal, the directional transmission module further configured to extract the directional sound signal from a sound object of the media information;
correspondingly, the directional transmission module is used for loading the directional sound signal into the ultrasonic signal; and transmitting the directional sound signals to each target position according to the sound directional information by utilizing the ultrasonic signals.
13. The audio processing apparatus according to claim 8 or 11, wherein the acquisition module is further configured to acquire the directional sound signal;
the media information making module is used for creating the directional sound channel and adding the directional sound signal into the directional sound channel;
the media information making module is further configured to add the directional sound channel and the regular sound channel to an audio data file corresponding to the media information when the media information is made.
14. The audio processing apparatus of claim 12, wherein the acquisition module is further configured to acquire the directional acoustic signal;
and the media information making module is used for bearing the directional sound signal by utilizing the sound object when the media information is made.
15. An electronic device, comprising:
a processor; and
a memory for storing a computer program of the processor;
wherein the processor is configured to implement the audio processing method of any one of claims 1 to 7 by executing the computer program.
16. An audio processing system, comprising: a directional speaker and the electronic device of claim 15; wherein,,
the directional loudspeaker being adapted to implement the step of transmitting sound signals to a target location in the audio processing method of any one of claims 1 to 7.
17. A computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the audio processing method of any one of claims 1 to 7.
CN202110182857.XA 2021-02-10 2021-02-10 Audio processing method, device, equipment and medium Active CN114915874B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110182857.XA CN114915874B (en) 2021-02-10 2021-02-10 Audio processing method, device, equipment and medium
PCT/CN2021/100382 WO2022170716A1 (en) 2021-02-10 2021-06-16 Audio processing method and apparatus, and device, medium and program product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110182857.XA CN114915874B (en) 2021-02-10 2021-02-10 Audio processing method, device, equipment and medium

Publications (2)

Publication Number Publication Date
CN114915874A CN114915874A (en) 2022-08-16
CN114915874B true CN114915874B (en) 2023-07-25

Family

ID=82761462

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110182857.XA Active CN114915874B (en) 2021-02-10 2021-02-10 Audio processing method, device, equipment and medium

Country Status (2)

Country Link
CN (1) CN114915874B (en)
WO (1) WO2022170716A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115695902B (en) * 2022-11-07 2024-09-10 百视通网络电视技术发展有限责任公司 Barrier-free movie audio processing method and device for blind people and storage medium
CN115604647B (en) * 2022-11-28 2023-03-10 北京天图万境科技有限公司 Method and device for sensing panorama by ultrasonic waves

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103650539A (en) * 2011-07-01 2014-03-19 杜比实验室特许公司 System and method for adaptive audio signal generation, coding and rendering
CN104469595A (en) * 2014-10-30 2015-03-25 苏州上声电子有限公司 Multi-area sound reproduction method and device based on error model
CN104902388A (en) * 2015-05-06 2015-09-09 苏州上声电子有限公司 Sound reproduction method and system for realizing multi-area volume difference
CN106941645A (en) * 2016-01-04 2017-07-11 哈曼贝克自动系统股份有限公司 The audio reproduction of a large amount of audiences
US10063972B1 (en) * 2017-12-30 2018-08-28 Wipro Limited Method and personalized audio space generation system for generating personalized audio space in a vehicle
CN109040907A (en) * 2018-09-11 2018-12-18 戴姆勒股份公司 Interior sound zone control system
CN109218859A (en) * 2017-06-29 2019-01-15 长城汽车股份有限公司 Vehicle-mounted orientation sound system, control method and vehicle
CN110234048A (en) * 2019-02-02 2019-09-13 上海蔚来汽车有限公司 Interior sound zone control device and method, controller and medium
CN209487146U (en) * 2018-01-19 2019-10-11 深圳市编际智能科技有限公司 A kind of audio frequency directional household audio and video system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8929575B2 (en) * 2012-08-16 2015-01-06 Turtle Beach Corporation Hearing enhancement systems and methods
US20150078595A1 (en) * 2013-09-13 2015-03-19 Sony Corporation Audio accessibility
CN106231503B (en) * 2016-09-19 2018-05-29 清华大学 A kind of audio system and control method for interior subregion control
CN107592588B (en) * 2017-07-18 2020-07-10 科大讯飞股份有限公司 Sound field adjusting method and device, storage medium and electronic equipment

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103650539A (en) * 2011-07-01 2014-03-19 杜比实验室特许公司 System and method for adaptive audio signal generation, coding and rendering
CN104469595A (en) * 2014-10-30 2015-03-25 苏州上声电子有限公司 Multi-area sound reproduction method and device based on error model
CN104902388A (en) * 2015-05-06 2015-09-09 苏州上声电子有限公司 Sound reproduction method and system for realizing multi-area volume difference
CN106941645A (en) * 2016-01-04 2017-07-11 哈曼贝克自动系统股份有限公司 The audio reproduction of a large amount of audiences
CN109218859A (en) * 2017-06-29 2019-01-15 长城汽车股份有限公司 Vehicle-mounted orientation sound system, control method and vehicle
US10063972B1 (en) * 2017-12-30 2018-08-28 Wipro Limited Method and personalized audio space generation system for generating personalized audio space in a vehicle
CN209487146U (en) * 2018-01-19 2019-10-11 深圳市编际智能科技有限公司 A kind of audio frequency directional household audio and video system
CN109040907A (en) * 2018-09-11 2018-12-18 戴姆勒股份公司 Interior sound zone control system
CN110234048A (en) * 2019-02-02 2019-09-13 上海蔚来汽车有限公司 Interior sound zone control device and method, controller and medium

Also Published As

Publication number Publication date
CN114915874A (en) 2022-08-16
WO2022170716A1 (en) 2022-08-18

Similar Documents

Publication Publication Date Title
US10952009B2 (en) Audio parallax for virtual reality, augmented reality, and mixed reality
Rumsey Spatial audio
CN104981869B (en) Audio spatial cue is indicated with signal in bit stream
Bleidt et al. Object-based audio: Opportunities for improved listening experience and increased listener involvement
JP2019533404A (en) Binaural audio signal processing method and apparatus
KR101381396B1 (en) Multiple viewer video and 3d stereophonic sound player system including stereophonic sound controller and method thereof
JP2011515942A (en) Object-oriented 3D audio display device
US20180091919A1 (en) Method and device for processing binaural audio signal
US9467792B2 (en) Method for processing of sound signals
US11223920B2 (en) Methods and systems for extended reality audio processing for near-field and far-field audio reproduction
KR102149411B1 (en) Apparatus and method for generating audio data, apparatus and method for playing audio data
Larsson et al. Auditory-induced presence in mixed reality environments and related technology
CN114915874B (en) Audio processing method, device, equipment and medium
US9820076B2 (en) Information processing method and electronic device
US20110109722A1 (en) Apparatus for processing a media signal and method thereof
JP7371968B2 (en) Audio signal processing method and device using metadata
JP2018110366A (en) 3d sound video audio apparatus
CN103609143A (en) Method for capturing and playback of sound originating from a plurality of sound sources
CN101458951A (en) Video and audio program signal processing system having multiple functions
JPH10336798A (en) Sound field correction circuit
CN110191745B (en) Game streaming using spatial audio
US11102604B2 (en) Apparatus, method, computer program or system for use in rendering audio
WO2018150774A1 (en) Voice signal processing device and voice signal processing system
KR101534295B1 (en) Method and Apparatus for Providing Multiple Viewer Video and 3D Stereophonic Sound
CN114128312B (en) Audio rendering for low frequency effects

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant