WO2022038931A1 - 情報処理方法、プログラム、及び、音響再生装置 - Google Patents

情報処理方法、プログラム、及び、音響再生装置 Download PDF

Info

Publication number
WO2022038931A1
WO2022038931A1 PCT/JP2021/026589 JP2021026589W WO2022038931A1 WO 2022038931 A1 WO2022038931 A1 WO 2022038931A1 JP 2021026589 W JP2021026589 W JP 2021026589W WO 2022038931 A1 WO2022038931 A1 WO 2022038931A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound
predetermined
arrival direction
external
type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/026589
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
耕 水野
智一 石川
成悟 榎本
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Intellectual Property Corp of America
Original Assignee
Panasonic Intellectual Property Corp of America
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Intellectual Property Corp of America filed Critical Panasonic Intellectual Property Corp of America
Priority to CN202180056218.7A priority Critical patent/CN116018637A/zh
Priority to JP2022543321A priority patent/JP7673076B2/ja
Priority to EP21858080.1A priority patent/EP4203521A4/en
Publication of WO2022038931A1 publication Critical patent/WO2022038931A1/ja
Priority to US18/108,910 priority patent/US20230199428A1/en
Anticipated expiration legal-status Critical
Priority to JP2025071529A priority patent/JP2025100877A/ja
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1781—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions
    • G10K11/17821—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions characterised by the analysis of the input signals only
    • G10K11/17823—Reference signals, e.g. ambient acoustic environment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/40—Visual indication of stereophonic sound image
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1785—Methods, e.g. algorithms; Devices
    • G10K11/17853—Methods, e.g. algorithms; Devices of the filter
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
    • G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
    • G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
    • G10K11/1787—General system configurations
    • G10K11/17873—General system configurations using a reference signal without an error signal, e.g. pure feedforward
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
    • H04S7/306—For headphones
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
    • G10K2210/10—Applications
    • G10K2210/111—Directivity control or beam pattern
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/13—Aspects of volume control, not necessarily automatic, in stereophonic sound systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/15—Aspects of sound capture and related signal processing for recording or reproduction

Definitions

  • This disclosure relates to an audio reproduction device and an information processing method and program related to the sound reproduction device.
  • the information processing method uses the predetermined sound as a sound arriving from the arrival direction on the three-dimensional sound field corresponding to the predetermined direction from the sound information including the information regarding the predetermined sound and the information regarding the predetermined direction.
  • An information processing method for generating an output sound signal to be perceived by the user, the first analysis step of analyzing the type of the predetermined sound and the type of the external sound heard by the user as an external sound are analyzed.
  • the second analysis step, the third analysis step of analyzing the arrival direction of the external sound, and the type of the analyzed predetermined sound and the type of the analyzed external sound the predetermined sound of the predetermined sound is compared.
  • the predetermined sound of the predetermined sound Based on the second determination step of determining whether or not the arrival direction and the arrival direction of the external sound overlap, and the determination results of the first determination step and the second determination step, (a) the predetermined sound and the said It includes adjusting the sound pressure of at least one of the external sounds, and (b) adjusting at least one of adjusting the arrival direction of the predetermined sound.
  • the sound reproduction device is the predetermined sound coming from the arrival direction on the three-dimensional sound field corresponding to the predetermined direction from the sound information including the information regarding the predetermined sound and the information regarding the predetermined direction.
  • An acoustic reproduction device that generates and reproduces an output sound signal for making the user perceive the sound, and is an acquisition unit that acquires the sound information, a first analysis unit that analyzes the type of the predetermined sound, and an external device.
  • the second analysis unit that analyzes the type of external sound heard by the user as the sound of the above
  • the third analysis unit that analyzes the arrival direction of the external sound, and the analyzed type of the predetermined sound and the analysis.
  • the first determination unit for determining whether or not the type of the predetermined sound and the type of the external sound match, and the external analyzed with the arrival direction of the predetermined sound.
  • a second determination unit that determines whether or not the arrival direction of the predetermined sound and the arrival direction of the external sound overlap by comparing with the arrival direction of the sound, and the first determination step and the second determination step. Based on the determination result of, (a) adjusting the sound pressure of at least one of the predetermined sound and the external sound, and (b) adjusting the arrival direction of the predetermined sound.
  • an output unit that outputs a sound by the output sound signal generated by the adjustment.
  • one aspect of the present disclosure can also be realized as a program for causing a computer to execute the sound reproduction method described above.
  • FIG. 1 is a schematic diagram showing a use case of the sound reproduction device according to the embodiment.
  • FIG. 2 is a block diagram showing a functional configuration of the sound reproduction device according to the embodiment.
  • FIG. 3 is a block diagram showing a functional configuration of the acquisition unit according to the embodiment.
  • FIG. 4 is a block diagram showing a functional configuration of the filter selection unit according to the embodiment.
  • FIG. 5 is a block diagram showing a functional configuration of the output sound generation unit according to the embodiment.
  • FIG. 6 is a flowchart showing the operation of the sound reproduction device according to the embodiment.
  • FIG. 7 is a flowchart showing the operation of the first analysis unit and the second analysis unit according to the embodiment.
  • FIG. 8 is a diagram illustrating the arrival direction of a predetermined sound by the selected stereophonic filter according to the embodiment.
  • FIG. 9 is a second diagram illustrating an arrival direction of a predetermined sound by the selected stereophonic filter according to the embodiment.
  • FIG. 10 is a third diagram illustrating an arrival direction of a predetermined sound by the selected stereophonic filter according to the embodiment.
  • a process of convolving a head-related transfer function for perceiving it as a sound arriving from a predetermined direction with a signal of a target sound is known.
  • the realistic sensation experienced by the user is improved.
  • the sound becomes difficult to hear due to the duplication of external sounds coming from the outside and being heard by the user 99.
  • the information processing method is a sound arriving from the arrival direction on the three-dimensional sound field corresponding to the predetermined direction from the sound information including the information regarding the predetermined sound and the information regarding the predetermined direction.
  • This is an information processing method for generating an output sound signal for the user to perceive a predetermined sound, and is a first analysis step for analyzing the type of the predetermined sound and the type of the external sound heard by the user as an external sound.
  • the third analysis step for analyzing the arrival direction of the external sound, and the type of the analyzed predetermined sound and the type of the analyzed external sound the type of the predetermined sound and the type of the predetermined sound are compared.
  • the sound pressure of at least one of the predetermined sound and the external sound is adjusted. This includes, and (b) an adjustment step of adjusting at least one of adjusting the arrival direction of a predetermined sound.
  • the external sound and the predetermined sound are mutually caused by at least one of the overlapping directions of the external sound and the predetermined sound and the matching of the types of the external sound and the predetermined sound.
  • both of them affect each other and it becomes difficult for the user to hear them, by adjusting at least one of (a) and (b), it is easy to hear at least one of the external sound and the predetermined sound. It is possible to make the user perceive a three-dimensional sound more appropriately.
  • the adjustment step it is determined in the determination in the first determination step that the type of the predetermined sound and the type of the external sound match, and in the determination in the second determination step, the predetermined sound has arrived.
  • the direction and the arrival direction of the external sound overlap at least one of (a) and (b) may be performed.
  • the sound pressure of the external sound may be attenuated by generating and superimposing the superimposed sound having the opposite phase to the external sound.
  • the sound pressure of the external sound can be attenuated and the user can more appropriately perceive the predetermined sound.
  • the arrival direction of the predetermined sound may be changed by a preset angle in a direction far from the arrival direction of the external sound.
  • the arrival direction of the predetermined sound and the arrival direction of the external sound do not overlap, so that at least one of the external sound and the predetermined sound can be easily heard, and the user can more appropriately obtain a three-dimensional sound. Can be perceived.
  • the information regarding the predetermined direction may be corrected so as to change the arrival direction of the predetermined sound by a preset angle in a direction far from the arrival direction of the external sound. ..
  • the arrival direction of the predetermined sound and the arrival direction of the external sound do not overlap, so that at least one of the external sound and the predetermined sound can be easily heard, and the user can more appropriately obtain a three-dimensional sound. Can be perceived.
  • the stereophonic filter selected thereafter is a stereophonic filter for preventing the arrival direction of the predetermined sound and the arrival direction of the external sound from overlapping. Can be made to. As a result, it is possible to facilitate listening to at least one of the external sound and the predetermined sound, and to make the user perceive a three-dimensional sound more appropriately.
  • the sound to be analyzed is divided into unit times in the time region, and the divided sound is input to the machine learning model in advance.
  • the likelihood for each of the plurality of types may be calculated, and an analysis result indicating that the input sound type corresponds to the type with the highest calculated probability may be output.
  • the type of the predetermined sound and the type of the external sound may be composed of two types, that is, voice and voice.
  • whether or not the arrival direction of the predetermined sound and the arrival direction of the external sound overlap is determined depending on whether or not the angle difference between the arrival direction of the predetermined sound and the arrival direction of the external sound is smaller than the threshold value.
  • the first threshold value which is the threshold value when the arrival direction of the predetermined sound and the arrival direction of the external sound are on the rear surface side of the boundary surface with respect to the virtual boundary surface that divides the user's head into front and back, is the predetermined sound.
  • the arrival direction of the sound and the arrival direction of the external sound may be larger than the second threshold value which is the threshold value when the arrival direction of the external sound is on the front side of the boundary surface.
  • the external sound and the predetermined sound are based on a larger reference than the front side of the boundary surface. It is possible to determine whether or not the arrival directions of and are overlapped.
  • program according to one aspect of the present disclosure is a program for causing a computer to execute the information processing method described above.
  • the sound reproduction device obtains a predetermined sound as a sound arriving from the arrival direction on the three-dimensional sound field corresponding to the predetermined direction from the sound information including the information regarding the predetermined sound and the information regarding the predetermined direction.
  • An acoustic reproduction device that generates and reproduces an output sound signal for the user to perceive, such as an acquisition unit that acquires sound information, a first analysis unit that analyzes a predetermined sound type, and a user as external sound.
  • the second analysis unit that analyzes the type of external sound heard in, the third analysis unit that analyzes the arrival direction of the external sound, and the type of the analyzed predetermined sound and the type of the analyzed external sound are compared.
  • the first determination unit that determines whether or not the type of the predetermined sound and the type of the external sound match is compared with the arrival direction of the predetermined sound and the arrival direction of the analyzed external sound. Based on the second determination unit that determines whether the arrival direction of the sound and the arrival direction of the external sound overlap, and the determination results of the first determination step and the second determination step, (a) the predetermined sound and the external sound.
  • An adjustment unit that adjusts at least one sound pressure and (b) adjusts the arrival direction of a predetermined sound, and an output unit that outputs sound by an output sound signal generated by the adjustment.
  • ordinal numbers such as 1, 2, and 3 may be attached to the elements. These ordsinal numbers are attached to the elements to identify them and do not necessarily correspond to a meaningful order. These ordinals may be replaced, newly added, or removed as appropriate.
  • FIG. 1 is a schematic diagram showing a use case of the sound reproduction device according to the embodiment.
  • FIG. 1 shows a user 99 who uses the sound reproduction device 100.
  • the sound reproduction device 100 shown in FIG. 1 is used at the same time as the stereoscopic image reproduction device 200.
  • the image enhances the auditory sense of presence and the sound enhances the visual sense of presence, as if you were in the scene where the image and sound were taken. You can experience it.
  • the user 99 is emitted from the person's mouth even when the localization of the sound image of the conversation sound is deviated from the person's mouth. It is known to be perceived as a conversational sound.
  • the visual information corrects the position of the sound image, and the image and the sound may be combined to enhance the sense of presence.
  • the stereoscopic image reproduction device 200 is an image display device mounted on the head of the user 99. Therefore, the stereoscopic image reproduction device 200 moves integrally with the head of the user 99.
  • the stereoscopic image reproduction device 200 is a glasses-type device supported by the user 99's ears and nose, as shown in the figure.
  • the stereoscopic image reproduction device 200 changes the image to be displayed according to the movement of the head of the user 99, so that the user 99 is perceived as moving the head in the three-dimensional image space. That is, when an object in the three-dimensional image space is located in front of the user 99, when the user 99 turns to the right, the object moves to the left of the user 99, and when the user 99 turns to the left, the object moves to the left. Moves to the right of the user. In this way, the stereoscopic image reproduction device 200 moves the three-dimensional image space in the direction opposite to the movement of the user 99 with respect to the movement of the user 99.
  • the stereoscopic image reproduction device 200 displays two images in which a difference in visual difference occurs in each of the left and right eyes of the user 99.
  • the user 99 can perceive the three-dimensional position of the object on the image based on the deviation of the visual difference of the displayed image.
  • the stereoscopic image reproduction device 200 is not an essential component of the present disclosure.
  • the sound reproduction device 100 is a sound presentation device mounted on the head of the user 99. Therefore, the sound reproduction device 100 moves integrally with the head of the user 99.
  • the sound reproduction device 100 in the present embodiment is a so-called over-ear headphone type device.
  • the form of the sound reproduction device 100 is not particularly limited, and may be, for example, two earplug-type devices that are independently attached to the left and right ears of the user 99. By communicating with each other, these two devices simultaneously present the sound for the right ear and the sound for the left ear.
  • the sound reproduction device 100 changes the sound presented according to the movement of the head of the user 99, so that the user 99 perceives that the user 99 is moving the head in the three-dimensional sound field. Therefore, as described above, the sound reproduction device 100 moves the three-dimensional sound field in the direction opposite to the movement of the user with respect to the movement of the user 99.
  • the sound reproduction device 100 can make the user 99 perceive at least one of the sound image and the external sound by correcting the sound presented by the information processing so as to avoid this phenomenon. That is, the sound reproduction device 100 operates so as to detect the overlap between the sound image and the external sound and eliminate the overlap, so that the user 99 perceives at least one of the sound image and the external sound.
  • FIG. 2 is a block diagram showing a functional configuration of the sound reproduction device according to the embodiment.
  • the sound reproduction device 100 includes a processing module 101, a communication module 102, a detector 103, and a driver 104.
  • the processing module 101 is an arithmetic unit for performing various signal processing in the sound reproduction device 100.
  • the processing module 101 includes, for example, a processor and a memory, and a program stored in the memory is executed by the processor. So, it exerts various functions.
  • the processing module 101 has an acquisition unit 111, a filter selection unit 121, an output sound generation unit 131, and a signal output unit 141.
  • the details of each functional unit of the processing module 101 will be described below together with the details of the configurations other than the processing module 101.
  • the communication module 102 is an interface device for receiving input of sound information to the sound reproduction device 100.
  • the communication module 102 includes, for example, an antenna and a signal converter, and receives sound information from an external device by wireless communication. More specifically, the communication module 102 receives a radio signal indicating sound information converted into a format for wireless communication by using an antenna, and reconverts the wireless signal into sound information by a signal converter. ..
  • the sound reproduction device 100 acquires sound information from an external device by wireless communication.
  • the sound information acquired by the communication module 102 is acquired by the acquisition unit 111. In this way, the sound information is input to the processing module 101.
  • the communication between the sound reproduction device 100 and the external device may be performed by wire communication.
  • the sound information acquired by the sound reproduction device 100 is encoded in a predetermined format such as MPEG-H 3D Audio (ISO / IEC 23008-3).
  • a predetermined format such as MPEG-H 3D Audio (ISO / IEC 23008-3).
  • information about a predetermined sound reproduced by the sound reproduction device 100 and a sound image of the sound are localized at a predetermined position in a three-dimensional sound field (that is, a sound arriving from a predetermined direction).
  • Information on the localization position at the time of (perceived as), that is, information on a predetermined direction is included.
  • the sound information includes information on a plurality of sounds including the first predetermined sound and the second predetermined sound, and the sound image when each sound is reproduced is a sound arriving from different directions in the three-dimensional sound field. The sound image is localized so that it is perceived as.
  • the sound information may include only information about a predetermined sound. In this case, information regarding a predetermined direction may be acquired separately. Further, as described above, the sound information includes the first sound information regarding the first predetermined sound and the second sound information regarding the second predetermined sound, but a plurality of sound information including these separately is acquired. However, the sound image may be localized at different positions in the three-dimensional sound field by simultaneously reproducing the sound. As described above, the form of the input sound information is not particularly limited, and the sound reproduction device 100 may be provided with the acquisition unit 111 corresponding to various forms of sound information.
  • FIG. 3 is a block diagram showing a functional configuration of the acquisition unit according to the embodiment.
  • the acquisition unit 111 in the present embodiment includes, for example, an encoded sound information input unit 112, a decoding processing unit 113, and a sensing information input unit 114.
  • the encoded sound information input unit 112 is a processing unit for inputting encoded (in other words, encoded) sound information acquired by the acquisition unit 111.
  • the encoded sound information input unit 112 outputs the input sound information to the decoding processing unit 113.
  • the decoding processing unit 113 decodes (in other words, decodes) the sound information output from the encoded sound information input unit 112, thereby processing the information regarding the predetermined sound included in the sound information and the information regarding the predetermined direction in the subsequent processing. It is a processing unit generated in the format used for.
  • the sensing information input unit 114 will be described below together with the functions of the detector 103.
  • the detector 103 is a device for detecting the movement speed of the head of the user 99.
  • the detector 103 is configured by combining various sensors used for motion detection such as a gyro sensor and an acceleration sensor.
  • the detector 103 is built in the sound reproduction device 100, and for example, a stereoscopic image reproduction device 200 or the like that operates according to the movement of the head of the user 99 like the sound reproduction device 100. It may be built in an external device. In this case, the detector 103 does not have to be included in the sound reproduction device 100.
  • the movement of the head of the user 99 may be captured by using an external image pickup device or the like, and the movement of the user 99 may be detected by processing the captured image.
  • the detector 103 is integrally fixed to the housing of the sound reproduction device 100, for example, and detects the speed of movement of the housing. Since the sound reproduction device 100 including the above housing moves integrally with the head of the user 99 after being worn by the user 99, the detector 103 detects the speed of movement of the head of the user 99 as a result. can do.
  • the detector 103 may detect, for example, as the amount of movement of the head of the user 99, the amount of rotation having at least one of the three axes orthogonal to each other in the three-dimensional space as the rotation axis, or the above three axes.
  • the amount of displacement may be detected with at least one of the above as the displacement direction. Further, the detector 103 may detect both the rotation amount and the displacement amount as the amount of movement of the head of the user 99.
  • the sensing information input unit 114 acquires the movement speed of the head of the user 99 from the detector 103. More specifically, the sensing information input unit 114 acquires the amount of movement of the head of the user 99 detected by the detector 103 per unit time as the speed of movement. In this way, the sensing information input unit 114 acquires at least one of the rotation speed and the displacement speed from the detector 103.
  • the amount of movement of the user 99's head acquired here is used to determine the coordinates and orientation of the user 99 in the three-dimensional sound field.
  • the relative position of the sound image is determined based on the determined coordinates and orientation of the user 99, and the sound is reproduced. Specifically, the above function is realized by the filter selection unit 121 and the output sound generation unit 131.
  • the filter selection unit 121 determines from which direction in the three-dimensional sound field the user 99 perceives the predetermined sound as the sound arriving from the predetermined sound, and determines with respect to the predetermined sound. It is a processing unit that selects the stereophonic filter to be applied.
  • the stereophonic filter is a function that causes the user 99 to perceive the above-mentioned predetermined sound as a sound arriving from a predetermined direction based on the specific head-related transfer function by convolving a specific head-related transfer function into the input predetermined sound. It is a filter.
  • a sound pressure difference, a time difference, a phase difference, etc. are generated in the left and right sound signals of the predetermined sound, and the arrival direction is controlled. It is possible to output a sound signal capable of reproducing the predetermined sound.
  • a plurality of stereophonic filters that are candidates for selection are, for example, adjusted and prepared in advance for each user 99.
  • the plurality of stereophonic filters are calculated and generated for each direction of arrival, and are stored in a storage device (not shown) for storing the plurality of stereophonic filters.
  • FIG. 4 is a block diagram showing a functional configuration of the filter selection unit according to the embodiment.
  • the filter selection unit 121 in the present embodiment includes, for example, the first analysis unit 122, the second analysis unit 123, the third analysis unit 124, the first determination unit 125, and the second determination unit 126. It also includes an adjusting unit 127.
  • the first analysis unit 122 is a processing unit that analyzes the type of predetermined sound included in the sound information. As an analysis result, the first analysis unit 122 outputs information as to which of the plurality of preset types the predetermined sound corresponds to.
  • the type of predetermined sound may be, for example, whether or not it is a human voice, that is, two types other than voice and voice, and is classified by frequency characteristics from the source of sound and the like. It may be a type that does not require a specific object such as the first type, the second type, and the like. Further, the number of types is not particularly limited, and the number may be set according to the type of predetermined sound included in the sound information and the type of external sound assumed from the environment in which the sound reproduction device 100 is used. The description regarding the type of the predetermined sound is similarly applied to the type of the external sound.
  • the second analysis unit 123 is a processing unit that comes from the outside of the sound reproduction device 100 and analyzes the type of external sound heard by the user 99.
  • the second analysis unit 123 outputs, as an analysis result, information as to which of the plurality of preset types the predetermined sound corresponds to. Further, the analysis result of the type of external sound by the second analysis unit 123 is used for comparison with the above-mentioned predetermined sound type. Therefore, as the external sound, a sound that is expected to make it difficult to hear at least one of the predetermined sound and the external sound when overlapping with the predetermined sound is used, and the other sounds may be deleted.
  • the sound pressure of a predetermined sound is determined in advance by sound information and a volume set by the user 99 of the sound reproduction device 100. Therefore, a threshold value for whether or not to use as an external sound may be provided depending on whether or not the sound is within a sound pressure range that can sufficiently interfere with the predetermined sound being reproduced.
  • the third analysis unit 124 is a processing unit that analyzes the arrival direction of the external sound.
  • the third analysis unit 124 acquires the external sound picked up by each of the two or more sound collecting devices as the respective external sound information, and is the same as the external sound by the external sound information between these two or more sound collecting devices.
  • One external sound is specified, and the arrival direction of the external sound is analyzed by calculation based on the arrival time difference, sound pressure difference, phase difference, and the like.
  • the third analysis unit 124 outputs information from which direction the external sound arrives at the user 99.
  • the first determination unit 125 is a processing unit that determines whether or not the type of the predetermined sound and the type of the external sound match. Therefore, the first determination unit 125 acquires the analysis results of the first analysis unit 122 and the second analysis unit 123. Based on these analysis results, the first determination unit 125 determines whether or not the arrival directions of the predetermined sound and the external sound match. As a determination result, the first determination unit 125 outputs information indicating whether or not the type of the predetermined sound and the type of the external sound match. When a plurality of predetermined sounds and a plurality of external sounds are present, the first determination unit 125 may determine all combinations of the predetermined sound and the external sound, or only within the predetermined range as seen from the user 99. Judgment may be made for all combinations of predetermined sounds and external sounds.
  • the second determination unit 126 is a processing unit that determines whether or not the arrival direction of the predetermined sound and the arrival direction of the external sound based on the analysis result of the third analysis unit 124 overlap.
  • the second determination unit 126 calculates the arrival direction of the predetermined sound based on the predetermined direction included in the sound information and the coordinates and direction of the user 99, and determines the arrival direction of the predetermined sound and the arrival direction of the external sound after the calculation. It is determined whether or not these are duplicated by comparing. In the determination of the second determination unit 126, the arrival direction of the predetermined sound and the arrival direction of the external sound do not have to be completely the same.
  • a threshold value of such an angle range is provided. May be done. Since this threshold value is affected by the sound pressure of a predetermined sound, the sound pressure of an external sound, the minimum discrimination angle of the user 99, etc., it may be set for each user 99, or is set on average among a plurality of users 99. It may be set as a fixed value such as 5 degrees, 10 degrees, 15 degrees, and 20 degrees.
  • the adjustment unit 127 Based on the determination result of the first determination unit 125 and the determination result of the second determination unit 126, the adjustment unit 127 makes adjustments for improving the distinctiveness of at least one of the predetermined sound and the external sound, and makes a stereophonic filter. It is a processing unit that selects. The user 99 can set in advance whether the adjusting unit 127 improves the distinction between the predetermined sound and the external sound. The adjusting unit 127 reads this set value and performs adjustment for improving the distinctiveness of at least one of the predetermined sound and the external sound according to the set value. The adjustment by the adjustment unit 127 will be described later together with the operation of the sound reproduction device 100.
  • the sound adjustment by the adjustment unit 127 is performed by changing the stereophonic filter from the stereophonic filter based on the predetermined direction on the original sound information to the stereophonic filter in the direction of arrival of the sound for realizing the adjustment. That is, the adjustment of the sound by the adjustment unit 127 can be regarded as the determination of the stereophonic filter after the change. As a result, the changed stereophonic filter obtained by changing the stereophonic filter as the initial value is selected and output from the filter selection unit 121. The direction of arrival of the sound in the output sound signal at this time is a direction different from the predetermined direction on the sound information.
  • stereophonic filter may be directly determined without setting the initial value of the stereophonic filter as described above. That is, the modification of the stereophonic filter is an expression used for convenience for explanation, and the present disclosure also includes directly selecting and outputting the stereophonic filter without using the initial value.
  • the output sound generation unit 131 generates an output sound signal by inputting information about a predetermined sound included in the sound information to the selected stereophonic filter by using the stereophonic filter selected by the filter selection unit 121. It is a processing unit.
  • FIG. 5 is a block diagram showing a functional configuration of the output sound generation unit according to the embodiment.
  • the output sound generation unit 131 in the present embodiment includes, for example, a filter processing unit 132.
  • the filter processing unit 132 sequentially reads the filters continuously selected by the filter selection unit 121, and inputs information about the corresponding predetermined sound on the time axis, so that the predetermined sound arrives on the three-dimensional sound field. Continuously outputs the controlled sound signal.
  • the sound information divided for each time of the processing unit on the time axis is output as a continuous sound signal (output sound signal) on the time axis.
  • the signal output unit 141 is a functional unit that outputs the generated output sound signal to the driver 104.
  • the signal output unit 141 generates a waveform signal by performing signal conversion from a digital signal to an analog signal based on the output sound signal, generates a sound wave in the driver 104 based on the waveform signal, and makes a sound to the user 99.
  • the driver 104 has, for example, a diaphragm and a drive mechanism such as a magnet and a voice coil.
  • the driver 104 operates the drive mechanism in response to the waveform signal, and the drive mechanism vibrates the diaphragm. In this way, the driver 104 generates a sound wave by the vibration of the diaphragm in response to the output sound signal, the sound wave propagates through the air and is transmitted to the user 99's ear, and the user 99 perceives the sound.
  • FIG. 6 is a flowchart showing the operation of the sound reproduction device according to the embodiment.
  • FIG. 7 is a flowchart showing the operation of the first analysis unit and the second analysis unit according to the embodiment.
  • a stereophonic filter that reproduces a predetermined sound so as to be in the arrival direction preset in the content is read from a storage device or the like.
  • the sound reproduction device 100 selects and applies a stereophonic filter so that a predetermined sound arrives from the arrival direction, and reproduces the sound.
  • the first analysis unit 122 analyzes the type of the predetermined sound being reproduced (S101) and continuously outputs the analysis result so as to be parallel to the reproduction of the sound.
  • the analysis of the predetermined sound type by the first analysis unit 122 is performed as shown in FIG. 7.
  • the first analysis unit 122 divides a predetermined sound into a predetermined processing unit time and generates divided data (S201).
  • the first analysis unit 122 inputs the divided data into a machine learning model such as a neural network constructed for clustering into the classes associated with the types, and causes the likelihood to be calculated for each class. (S202).
  • the first analysis unit 122 outputs an analysis result indicating that the input divided data corresponds to the type having the highest likelihood as the type corresponding to the class having the highest likelihood (S203). ).
  • the sound collecting device for collecting the external sound starts collecting the external sound at the same time as the operation of the sound reproducing device 100 starts, and the external sound information is sequentially output to the second analysis unit 123. is doing.
  • the second analysis unit 123 analyzes the type of external sound for the acquired external sound information in the same manner as the first analysis unit 122 (S102), and continuously outputs the analysis result.
  • the third analysis unit 124 analyzes the arrival direction of the external sound with respect to the acquired external sound information and continuously outputs the analysis result. Since the analysis by the first analysis unit 122, the second analysis unit 123, and the third analysis unit 124 is performed in parallel, the order of steps S101 and S102 in the figure may be changed.
  • the first determination unit 125 determines whether or not the type of the predetermined sound and the type of the external sound match (S103).
  • the second determination unit 126 further determines whether or not the arrival direction of the predetermined sound and the arrival direction of the external sound overlap. Is determined (S104).
  • the adjusting unit 127 adjusts the stereophonic filter so as to improve the distinctiveness of the sound (S105).
  • the adjusting unit 127 changes the stereophonic filter of the change destination in order to change from the stereophonic filter of the initial value in which the predetermined direction and the arrival direction match to the stereophonic filter in which the predetermined direction and the arrival direction are different. decide.
  • the filter selection unit 121 ends the processing and outputs the initial value stereophonic filter as the selected stereophonic filter.
  • FIG. 8 is a diagram illustrating the arrival direction of a predetermined sound by the selected stereophonic filter according to the embodiment.
  • FIG. 9 is a second diagram illustrating an arrival direction of a predetermined sound by the selected stereophonic filter according to the embodiment.
  • FIG. 10 is a third diagram illustrating an arrival direction of a predetermined sound by the selected stereophonic filter according to the embodiment. 8 to 10 schematically show a user 99 in a posture with the paper surface facing forward in a circular shape with a "U", and the user 99 is in an upright posture in a direction perpendicular to the paper surface. There is.
  • FIGS. 8 to 10 the position where the predetermined sound is localized is shown as a black circle, and the icon of the virtual sound source according to the type of sound is also shown.
  • the position where the first predetermined sound at a certain time point is localized is the first position S1.
  • the first external sound arrives from the second position S2.
  • the same speaker icon is attached to the first predetermined sound and the first external sound, and it can be seen that they are of the same type. Therefore, the determination result by the first determination unit 125 indicates the matching of the types.
  • the range with dot hatching in the figure is a range that spreads around the arrival direction of the first predetermined sound and can be regarded as an arrival direction overlapping with the first predetermined sound. be. Since the arrival direction of the first external sound is within this range, it can be seen that the first predetermined sound and the first external sound overlap.
  • the determination result by the second determination unit 126 indicates the overlap in the arrival direction.
  • the stereophonic filter is changed so as to lower the sound pressure of the first external sound and improve the distinctiveness of the first predetermined sound.
  • the adjusting unit 127 changes the stereophonic filter so as to generate a signal having the opposite phase of the first external sound from the external sound information of the first external sound and superimpose the signal.
  • the output sound signal obtained by inputting information about a predetermined sound to the three-dimensional acoustic filter is a signal to which a signal having the opposite phase of the first external sound is added, and is a signal with the incoming first external sound. By canceling out, the sound pressure of the first external sound is lowered.
  • the alternate long and short dash line extending to the left and right of the user 99 indicates a virtual boundary surface that divides the head of the user 99 into front and back.
  • This boundary surface may be a surface along the ear canal of the user 99, a surface passing through the last point of the auricle of the user 99, or simply a surface passing through the center of gravity of the head of the user 99. May be. It is known that there is a difference in the ease of hearing the sound before and after such a boundary surface, that is, before and after the user 99. Therefore, it is effective to make the changing characteristics of the stereophonic filter different between the front surface side and the rear surface side with the boundary surface as a boundary.
  • the position where the second predetermined sound at a certain point in time is localized is the third position S3.
  • the second external sound arrives from the fourth position S4.
  • the same speaker icon is attached to the second predetermined sound and the second external sound, and it can be seen that they are of the same type. Therefore, the determination result by the first determination unit 125 indicates the matching of the types.
  • the range with dot hatching in the figure is a range that spreads around the arrival direction of the second predetermined sound and can be regarded as an arrival direction overlapping with the second predetermined sound. be. Since the arrival direction of the second external sound is within this range, it can be seen that the second predetermined sound and the second external sound overlap. Therefore, the determination result by the second determination unit 126 indicates the overlap in the arrival direction.
  • the stereophonic filter is changed so as to lower the sound pressure of the second external sound and improve the distinctiveness of the second predetermined sound.
  • the first predetermined sound and the second predetermined sound are the same sound different only in the arrival direction, and the first external sound and the second external sound are the same sound different only in the arrival direction.
  • the range in which the arrival directions of the second predetermined sound and the second external sound on the rear side of the boundary surface can be considered to overlap is the range of the first predetermined sound and the first external sound on the front side of the boundary surface.
  • the direction of arrival is set to be larger than the range that can be considered to overlap. In this way, a configuration corresponding to a wide minimum discrimination angle with respect to the arrival direction of the sound arriving from the rear surface side (that is, behind the user 99) as compared with the front surface side may be provided.
  • the stereophonic filter that rotates the arrival direction is changed so that the localization position of the first predetermined sound is the fifth position S1a.
  • the arrival direction of the first predetermined sound is rotationally changed in a direction far from the arrival direction of the first external sound until the range with dot hatching does not overlap with the arrival direction of the external sound.
  • both the first predetermined sound and the first external sound have improved distinguishability and can be heard by the user 99.
  • the adjusting unit 127 may simply lower the sound pressure of the first predetermined sound to improve the distinctiveness of the first external sound and make it audible.
  • the adjusting unit 127 does not have to change the stereophonic filter in particular.
  • the third external sound arrives from the sixth position S5, and the fourth external sound arrives from the seventh position S6.
  • the first predetermined sound and the third external sound are different types of sounds with different icons, it is possible to identify and listen even if the arrival directions overlap. Is.
  • the first predetermined sound and the fourth predetermined sound are the same type of sounds with the same speaker icon, the arrival directions are sufficiently different, so that they can be identified and listened to. Is.
  • the determination result of the first determination unit 125 shows that the identification unit 127 is of a different type
  • the determination result of the second determination unit 126 it is shown that the arrival directions do not overlap. If so, it is not necessary to change the stereophonic filter.
  • the predetermined sound and the external sound it is difficult to distinguish between the predetermined sound and the external sound because the types of the predetermined sound and the external sound match and the arrival directions of the predetermined sound and the external sound overlap.
  • at least one of (a) adjusting the sound pressure of at least one of the predetermined sound and the external sound and (b) adjusting the arrival direction of the predetermined sound is performed, whereby the predetermined sound and the external sound are performed. Since it is possible to improve the distinctiveness of at least one of the above and facilitate listening to the one with the improved distinctiveness, it is possible to make the user 99 more appropriately perceive a three-dimensional sound.
  • the content of the present disclosure is also effective when the sound follows the movement of the user's head. That is, in the operation of causing the user to perceive a predetermined sound as a sound arriving from the first position that moves relatively with the movement of the user's head, the types of the predetermined sound and the external sound match, and the arrival directions overlap.
  • the stereophonic filter may be changed to improve the distinctiveness of at least one of them.
  • the sound reproduction device described in the above embodiment may be realized as one device including all the components, or each function is assigned to a plurality of devices, and the plurality of devices cooperate with each other. It may be realized by.
  • an information processing device such as a smartphone, a tablet terminal, or a PC may be used as the device corresponding to the processing module.
  • the modified stereophonic filter can be selected by correcting the original sound information by the decoding processing unit.
  • the decoding processing unit in this example is a processing unit that generates information about a predetermined direction included in the sound information and corrects the original sound information.
  • the decoding processing unit performs the same operations as the first analysis unit, the second analysis unit, the third analysis unit, the first determination unit, and the second determination unit, and then, if necessary, sets the arrival direction of the predetermined sound to the outside.
  • the information about the predetermined direction is corrected so as to fluctuate by a preset angle in the direction far from the arrival direction of the sound.
  • the stereophonic filter that defines the arrival direction in which the predetermined sound arrives is selected based on the corrected predetermined direction information output from the decoding processing unit, and the modified stereophonic filter in the above embodiment is selected.
  • a stereophonic filter will be applied.
  • the information processing method and the like disclosed in the present application may be realized by correcting the information regarding the predetermined direction in the original sound information.
  • the decoding processing unit as described above can be inserted in place of the processing unit that performs the decoding processing of the conventional stereophonic sound reproduction device, thereby realizing an sound reproduction device capable of achieving the same effect as that disclosed in the present application. Can be done.
  • the sound reproduction device of the present disclosure is connected to a reproduction device provided with only a driver, and outputs an output sound signal to the reproduction device using a stereophonic filter selected based on the acquired sound information. It can also be realized as an acoustic processing device that only does.
  • the sound processing device may be realized as hardware provided with a dedicated circuit, or may be realized as software for causing a general-purpose processor to execute a specific process.
  • another processing unit may execute the processing executed by the specific processing unit. Further, the order of the plurality of processes may be changed, or the plurality of processes may be executed in parallel.
  • each component may be realized by executing a software program suitable for each component.
  • Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.
  • each component may be realized by hardware.
  • each component may be a circuit (or an integrated circuit). These circuits may form one circuit as a whole, or may be separate circuits from each other. Further, each of these circuits may be a general-purpose circuit or a dedicated circuit.
  • the general or specific aspects of the present disclosure may be realized by a recording medium such as an apparatus, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable CD-ROM.
  • the general or specific aspects of the present disclosure may be realized by any combination of devices, devices, methods, integrated circuits, computer programs and recording media.
  • the present disclosure may be realized as an audio signal reproduction method executed by a computer, or may be realized as a program for causing an audio signal reproduction method computer to execute.
  • the present disclosure may be realized as a computer-readable non-temporary recording medium in which such a program is recorded.
  • This disclosure is useful for acoustic reproduction such as making a user perceive a three-dimensional sound.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Stereophonic System (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)
PCT/JP2021/026589 2020-08-20 2021-07-15 情報処理方法、プログラム、及び、音響再生装置 Ceased WO2022038931A1 (ja)

Priority Applications (5)

Application Number Priority Date Filing Date Title
CN202180056218.7A CN116018637A (zh) 2020-08-20 2021-07-15 信息处理方法、程序及音响再现装置
JP2022543321A JP7673076B2 (ja) 2020-08-20 2021-07-15 情報処理方法、プログラム、及び、音響再生装置
EP21858080.1A EP4203521A4 (en) 2020-08-20 2021-07-15 Information processing method, program, and acoustic reproduction device
US18/108,910 US20230199428A1 (en) 2020-08-20 2023-02-13 Information processing method, recording medium, and sound reproduction device
JP2025071529A JP2025100877A (ja) 2020-08-20 2025-04-23 音声信号処理方法、プログラム、及び、音声信号処理装置

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US202063068103P 2020-08-20 2020-08-20
US63/068,103 2020-08-20
JP2021090992 2021-05-31
JP2021-090992 2021-05-31

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/108,910 Continuation US20230199428A1 (en) 2020-08-20 2023-02-13 Information processing method, recording medium, and sound reproduction device

Publications (1)

Publication Number Publication Date
WO2022038931A1 true WO2022038931A1 (ja) 2022-02-24

Family

ID=80350296

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/026589 Ceased WO2022038931A1 (ja) 2020-08-20 2021-07-15 情報処理方法、プログラム、及び、音響再生装置

Country Status (5)

Country Link
US (1) US20230199428A1 (https=)
EP (1) EP4203521A4 (https=)
JP (2) JP7673076B2 (https=)
CN (1) CN116018637A (https=)
WO (1) WO2022038931A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024180595A1 (ja) * 2023-02-27 2024-09-06 日本電信電話株式会社 再生音方向距離定位制御装置、再生音方向距離定位制御方法

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2024130966A (ja) * 2023-03-15 2024-09-30 本田技研工業株式会社 情報処理装置、情報処理方法、及びプログラム
CN119110215B (zh) * 2024-09-19 2025-08-05 江苏奥格视特信息科技有限公司 一种元宇宙空间的音响定向系统及方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007036610A (ja) * 2005-07-26 2007-02-08 Yamaha Corp 発音装置
JP2018528485A (ja) * 2015-07-24 2018-09-27 オロサウンド 能動型雑音制御装置
JP2020018620A (ja) 2018-08-01 2020-02-06 株式会社カプコン 仮想空間における音声生成プログラム、四分木の生成方法、および音声生成装置

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5255467B2 (ja) 2009-02-02 2013-08-07 クラリオン株式会社 雑音抑制装置、雑音抑制方法、及び、プログラム
JP4883103B2 (ja) * 2009-02-06 2012-02-22 ソニー株式会社 信号処理装置、信号処理方法及びプログラム
WO2012093352A1 (en) * 2011-01-05 2012-07-12 Koninklijke Philips Electronics N.V. An audio system and method of operation therefor
JP5952692B2 (ja) * 2012-09-13 2016-07-13 本田技研工業株式会社 音源方向推定装置、音響処理システム、音源方向推定方法、及び音源方向推定プログラム
CN105378826B (zh) * 2013-05-31 2019-06-11 诺基亚技术有限公司 音频场景装置
US10575117B2 (en) 2014-12-08 2020-02-25 Harman International Industries, Incorporated Directional sound modification
JP6644197B2 (ja) 2017-09-07 2020-02-12 三菱電機株式会社 雑音除去装置および雑音除去方法
EP3588926B1 (en) * 2018-06-26 2021-07-21 Nokia Technologies Oy Apparatuses and associated methods for spatial presentation of audio
US10638248B1 (en) 2019-01-29 2020-04-28 Facebook Technologies, Llc Generating a modified audio experience for an audio system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007036610A (ja) * 2005-07-26 2007-02-08 Yamaha Corp 発音装置
JP2018528485A (ja) * 2015-07-24 2018-09-27 オロサウンド 能動型雑音制御装置
JP2020018620A (ja) 2018-08-01 2020-02-06 株式会社カプコン 仮想空間における音声生成プログラム、四分木の生成方法、および音声生成装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4203521A4

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024180595A1 (ja) * 2023-02-27 2024-09-06 日本電信電話株式会社 再生音方向距離定位制御装置、再生音方向距離定位制御方法

Also Published As

Publication number Publication date
JPWO2022038931A1 (https=) 2022-02-24
CN116018637A (zh) 2023-04-25
US20230199428A1 (en) 2023-06-22
JP7673076B2 (ja) 2025-05-08
EP4203521A1 (en) 2023-06-28
JP2025100877A (ja) 2025-07-03
EP4203521A4 (en) 2024-01-24

Similar Documents

Publication Publication Date Title
US8787584B2 (en) Audio metrics for head-related transfer function (HRTF) selection or adaptation
JP7821354B2 (ja) 情報処理方法、プログラム、及び、音響再生装置
JP2025100877A (ja) 音声信号処理方法、プログラム、及び、音声信号処理装置
CN111372167B (zh) 音效优化方法及装置、电子设备、存储介质
US12003954B2 (en) Audio system and method of determining audio filter based on device position
US20240381051A1 (en) Acoustic reproduction method, recording medium, and acoustic reproduction system
JP2026035806A (ja) 音声拡張現実オブジェクト再生装置及び音声拡張現実オブジェクト再生方法
WO2023166721A1 (ja) 情報処理装置、情報処理システムおよび情報処理方法
EP4447493A1 (en) Acoustic processing apparatus, acoustic processing method, and program
US20250362862A1 (en) Information processing method, information processing device, acoustic reproduction system, and recording medium
US12389182B2 (en) Information processing method, recording medium, and information processing system
JP2024152931A (ja) 音響処理装置、音響処理方法、及び音響処理プログラム
JP2024159912A (ja) 音響処理方法、音響処理装置、及び音響処理プログラム
JP2024056580A (ja) 情報処理装置及びその制御方法及びプログラム
JP2023049852A (ja) 音声出力装置、制御システムおよびキャリブレーション方法
JP2007318188A (ja) 音像提示方法および音像提示装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21858080

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022543321

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2021858080

Country of ref document: EP

Effective date: 20230320