WO2020071728A1 - Procédé et dispositif de commande de signal audio pour appliquer un effet de zoom audio dans une réalité virtuelle - Google Patents

Procédé et dispositif de commande de signal audio pour appliquer un effet de zoom audio dans une réalité virtuelle

Info

Publication number
WO2020071728A1
WO2020071728A1 PCT/KR2019/012812 KR2019012812W WO2020071728A1 WO 2020071728 A1 WO2020071728 A1 WO 2020071728A1 KR 2019012812 W KR2019012812 W KR 2019012812W WO 2020071728 A1 WO2020071728 A1 WO 2020071728A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound
acoustic
activated
user
effect
Prior art date
Application number
PCT/KR2019/012812
Other languages
English (en)
Korean (ko)
Inventor
장대영
유재현
이용주
이태진
김상욱
Original Assignee
한국전자통신연구원
중앙대학교 산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020190004781A external-priority patent/KR102458962B1/ko
Application filed by 한국전자통신연구원, 중앙대학교 산학협력단 filed Critical 한국전자통신연구원
Priority to CN201980004342.1A priority Critical patent/CN111344785B/zh
Priority to DE112019000115.9T priority patent/DE112019000115T5/de
Priority to US16/647,458 priority patent/US11330387B2/en
Publication of WO2020071728A1 publication Critical patent/WO2020071728A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H04S7/304—For headphones
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/15—Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/13—Aspects of volume control, not necessarily automatic, in stereophonic sound systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
    • H04S7/306—For headphones

Definitions

  • the embodiments below relate to an acoustic signal control method and apparatus for applying an acoustic enlargement effect in virtual reality.
  • the sound enlargement effect means that you can concentrate on the voice of the person you are talking to in a noisy place such as a cocktail party. In other words, it can be selectively focused by using the characteristics of the space of the sound source, such as reflection and reverberation sound, and the characteristics of the transmission path of the sound source, such as the difference in level / time / frequency characteristics of the sound signal transmitted to both ears. .
  • a method and apparatus for controlling an acoustic signal may be provided for reproducing an acoustic enlargement effect corresponding to a specific acoustic object according to a listener moving freely in virtual reality.
  • a sound signal control method and apparatus for playing content by applying a sound enlargement effect corresponding to a sound object activated in virtual reality may be provided.
  • the sound magnification effect field included in the metadata identifying whether to use an audio zooming effect for at least one sound object existing in virtual reality; And when it is identified that the audio zooming effect is used, controlling the sound signal corresponding to the sound object based on a preset method.
  • the step of identifying whether to use an audio zooming effect for the at least one acoustic object is used to determine whether to activate the acoustic zooming effect for the acoustic object when the acoustic zooming effect corresponding to the acoustic object is used. It may be a sound signal control method, including the step of determining.
  • the activation is determined according to the user's gaze, the activation is determined according to the distance between the user and the acoustic object, or the activation is determined according to the user's random selection , It may be a sound signal control method.
  • Controlling the sound signal corresponding to the acoustic object based on a preset method comprises: a volume level adjustment method for controlling the volume level of the activated acoustic object to be increased by a preset level from the volume level of the unactivated acoustic object.
  • Direct sound to indirect control based on or controlling the ratio of the direct sound to the direct sound ratio (R / D ratio) of an activated sound object and the direct sound to indirect sound ratio of an inactive sound object.
  • Controlling the sound signal corresponding to the sound object based on a preset method may be a sound signal control method for determining whether the sound object is emphasized in inverse proportion to the distance between the user and the activated sound object.
  • identifying at least one acoustic object constituting the content Determining whether an audio zooming effect corresponding to the identified acoustic object is activated; And when the sound amplification effect is activated, applying the sound amplification effect to the content by controlling the sound signal corresponding to the sound object based on a preset method.
  • Determining whether to activate an audio zooming effect corresponding to the identified acoustic object may include determining whether to activate it according to an acoustic object corresponding to a user's gaze in the virtual reality, or the virtual reality It may be a sound signal control method for determining whether to activate or not depending on the distance between the user and the acoustic object in the user, or determining whether to activate according to the user's random selection.
  • the step of applying a sound magnification effect to the content may include setting the volume level of the activated sound object to a preset level than the volume level of the unactivated sound object. Based on the method of adjusting the volume level to control the increase, the sound expansion effect is applied to the content, or the direct sound to indirect sound ratio (R / D ratio: Reflection sound to Direct sound ratio) and activation of the activated sound object are activated.
  • R / D ratio Reflection sound to Direct sound ratio
  • the frequency characteristic control method for controlling the frequency characteristics of the acoustic object that is not, Applying acoustic zoom effects on Massachusetts it may be a sound signal control method.
  • the step of applying a sound enlargement effect to the content may include the user and the activated sound object than when the distance between the user and the activated sound object is far
  • it may be an acoustic signal control method that applies an acoustic enlargement effect to the sound object that emphasizes the acoustic object at the close distance.
  • the acoustic signal control apparatus includes a processor and a memory including a computer-readable instruction, and when the instruction is executed in the processor, the processor may display a sound amplification effect field included in metadata. Through, it is identified whether an audio zooming effect is used for at least one acoustic object existing in virtual reality, and when it is determined that the audio zooming effect is used, it corresponds to the acoustic object It may be a sound signal control device for controlling the sound signal to be based on a preset method.
  • the processor determines whether to use an audio zooming effect for the at least one acoustic object, when the acoustic zooming effect corresponding to the acoustic object is used, the processor activates the acoustic zooming effect for the acoustic object It may be a sound signal control device for determining whether or not.
  • the processor determines whether to activate according to the user's gaze, or determines whether to activate according to the distance between the user and the acoustic object, or determines whether to activate according to the user's random selection, acoustic signal control device Can be
  • the volume level that controls the volume level of the activated sound object to be increased by a preset level from the volume level of the unactivated sound object Control based on the adjustment method, or direct to control the ratio of the direct sound to the direct sound of an activated sound object (R / D ratio) and the direct sound to indirect sound ratio of an inactive sound object
  • R / D ratio the ratio of the direct sound to the direct sound of an activated sound object
  • the processor may be an acoustic signal control device for determining whether to highlight the acoustic object in inverse proportion to a distance between a user and an activated acoustic object when controlling the acoustic signal corresponding to the acoustic object based on a preset method. have.
  • the acoustic signal control apparatus includes a processor and a memory including a computer-readable instruction, and when the instruction is executed in the processor, the processor may perform the process in order to reproduce content in virtual reality. Identify at least one acoustic object constituting the content, determine whether an audio zooming effect corresponding to the identified acoustic object is activated, and if the acoustic zooming effect is activated, corresponds to the acoustic object By controlling the sound signal based on a preset method, it may be a sound signal control device that applies a sound enlargement effect to the content.
  • the processor determines whether to activate according to the acoustic object corresponding to the gaze of the user in the virtual reality, or determines whether to activate according to the distance between the user in the virtual reality and the acoustic object, or the user's It may be a sound signal control device for determining whether to activate according to a random selection.
  • the processor controls the sound signal corresponding to the sound object based on a preset method, so that when applying the sound enlargement effect to the content, the volume level of the activated sound object is higher than the volume level of the unactivated sound object.
  • the sound magnification effect is applied to the content, or the ratio of the direct sound to the indirect sound of the activated sound object (R / D ratio: Reflection sound to Direct sound ratio) )
  • the direct sound to indirect sound ratio adjustment method for controlling the direct sound to indirect sound ratio of the inactive sound object, applying a sound magnification effect to the content or applying a filter to the frequency of the activated sound object Based on the frequency characteristic control method to control the characteristic and frequency characteristics of an inactive acoustic object.
  • It may be a sound signal control device which applies an acoustic zoom effects on the contents.
  • the processor controls the sound signal corresponding to the sound object based on a preset method, so that when the sound enlargement effect is applied to the content, the user and the activation are activated when the distance between the user and the activated sound object is far away.
  • a preset method a preset method
  • the distance of the acoustic object may be an acoustic signal control device that applies an acoustic enlargement effect that emphasizes the acoustic object at the close distance to the content.
  • it may be an acoustic signal control method for reproducing an acoustic enlargement effect corresponding to a specific acoustic object according to a listener moving freely in virtual reality.
  • it may be a method of controlling an acoustic signal for reproducing content by applying an acoustic enlargement effect corresponding to an acoustic object activated in virtual reality.
  • FIG. 1 is a view showing a user wearing a HMD (Head Mounted Display).
  • HMD Head Mounted Display
  • FIG. 2 is a diagram illustrating whether an acoustic enlargement effect is used for an acoustic object when playing content including at least one acoustic object according to an embodiment.
  • FIG. 3 is a diagram illustrating whether to use an acoustic enlargement effect on an acoustic object when playing content including at least one acoustic object according to another embodiment.
  • FIG. 4 is a diagram illustrating whether an acoustic enlargement effect corresponding to an acoustic object is activated according to a user's gaze according to an embodiment.
  • FIG. 5 is a diagram illustrating whether an acoustic enlargement effect corresponding to an acoustic object is activated according to a distance between a user and an acoustic object, according to an embodiment.
  • FIG. 6 is a diagram illustrating whether an acoustic enlargement effect corresponding to an acoustic object is activated according to a user's random selection according to an embodiment.
  • FIG. 7 illustrates a method of controlling an acoustic signal corresponding to an acoustic object, according to an embodiment.
  • FIG. 8 illustrates a method of controlling an acoustic signal corresponding to an acoustic object, according to another embodiment.
  • FIG. 9 illustrates an acoustic signal control method performed by an acoustic signal control device according to an embodiment.
  • FIG. 10 illustrates an acoustic signal control method performed by an acoustic signal control device according to another embodiment.
  • first or second may be used to describe various components, but these terms should be understood only for the purpose of distinguishing one component from other components.
  • first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component.
  • FIG. 1 is a view showing a user wearing a HMD (Head Mounted Display).
  • HMD Head Mounted Display
  • an acoustic enlargement effect may be applied through a separate method. That is, in the case of an acoustic signal transmitted through the media, an acoustic enlargement effect such as a cocktail party effect may be applied.
  • an acoustic enlargement effect such as a cocktail party effect may be applied.
  • the content reproduced in virtual reality may include at least one acoustic object, and the acoustic object may be selectively reproduced.
  • the acoustic object may be reproduced in response to interaction with the user, or the acoustic object may not be reproduced according to the user's preference.
  • the acoustic signal corresponding to the acoustic object is controlled based on a preset method, so that an acoustic enlargement effect can be applied.
  • a detailed method of controlling an acoustic signal to apply an acoustic enlargement effect in virtual reality will be discussed.
  • FIG. 2 is a diagram illustrating whether an acoustic enlargement effect is used for an acoustic object when playing content including at least one acoustic object according to an embodiment.
  • Content played in virtual reality may include at least one acoustic object.
  • FIG. 2 may include acoustic objects 1 to 8 for reproduction of content.
  • an acoustic enlargement effect for each acoustic object may or may not be used.
  • the user can set the acoustic object 1 and the acoustic object 5 to off so as not to use the acoustic enlargement effect corresponding to the acoustic object 1 and the acoustic object 5.
  • the user may select the acoustic object 2, the acoustic object 3, the acoustic object 4, the acoustic object 6, the acoustic object 7 It can be set to on to use the sound magnification effect corresponding to.
  • the acoustic enlargement effect when it is set to be on so that the acoustic enlargement effect can be used, it may be determined whether or not to activate the acoustic enlargement effect corresponding to the acoustic object by interaction between the user and the acoustic object in virtual reality. For example, when the user and the acoustic object 2 are activated by interaction, a sound enlargement effect corresponding to the acoustic object 2 is applied to reproduce the content. Therefore, the user can more easily listen to the acoustic object 2 through the acoustic enlargement effect corresponding to the acoustic object 2.
  • information on whether to use the sound magnification effect corresponding to each sound object may be included in the sound magnification effect field of metadata provided for rendering the object-based sound.
  • whether to use an acoustic enlargement effect on an acoustic object may be applied to 6-degree-of-freedom virtual reality content, 6-degree-of-freedom virtual reality games, and 6-degree-of-freedom virtual reality-based social communication.
  • a user moving a virtual reality can listen by applying a sound enlargement effect to a conversation sound of interest, or in a six-degree-degree-of-freedom virtual reality-based social communication, a user applies a sound enlargement effect to the voice of a conversation partner To listen.
  • FIG. 3 is a diagram illustrating whether to use an acoustic enlargement effect on an acoustic object when playing content including at least one acoustic object according to another embodiment.
  • FIG. 3 shows whether the sound magnification effect is used through the content creator flag.
  • the creator of the content reproduced in the virtual reality can pre-set whether to use the sound enlargement effect when playing the content using the content creator flag.
  • the sound magnification effect corresponding to the content producer flag is activated without interaction with the user. You can.
  • the content creator flag may be included in metadata and transmitted.
  • the sound magnification effect corresponding to the acoustic object 2 is applied even if there is no interaction between the user and the acoustic object 2, so that the content can be reproduced. have.
  • the creator of the 6-degree-of-freedom virtual reality content sets a content creator flag for an acoustic object that is determined to need to draw the listener's attention based on a preset story, between the listener and the acoustic object
  • the content may be reproduced by applying an acoustic enlargement effect corresponding to the corresponding acoustic object regardless of distance or direction.
  • the creator of the content may perform marketing or announcement by setting the content creator flag in advance.
  • FIG. 4 is a diagram illustrating whether an acoustic enlargement effect corresponding to an acoustic object is activated according to a user's gaze according to an embodiment.
  • the sound magnification effect corresponding to the sound object when the sound magnification effect corresponding to the sound object is set to be used, the sound magnification effect corresponding to the sound object may be activated according to the user's gaze.
  • the acoustic object included in the content corresponding to the user's gaze direction may be activated.
  • the head direction of the user wearing the HMD is measured using head tracking, and the user's head direction is tracked according to the user's head direction to determine an acoustic object corresponding to the user's eye direction.
  • whether to use the sound enlargement effect is set to on, or may be set through a content creator flag.
  • the content reproduced in the virtual reality may include at least one acoustic object, and at this time, the content may be reproduced by applying an acoustic enlargement effect corresponding to the acoustic object that the user is viewing rather than all acoustic objects.
  • the content played in the virtual reality includes a plurality of performers (performer 1 corresponding to acoustic object 1, performer 2 corresponding to acoustic object 2) and the user views performer 2, corresponding to performer 2 Content may be reproduced by applying an acoustic enlargement effect.
  • the gaze direction may be tracked to determine the performer 2, which is the acoustic object 2 corresponding to the user's gaze direction, and the acoustic enlargement effect corresponding to the performer 2 may be activated and reproduced. Therefore, the user can selectively listen to the sound of the acoustic object of interest without any additional manipulation.
  • FIG. 5 is a diagram illustrating whether an acoustic enlargement effect corresponding to an acoustic object is activated according to a distance between a user and an acoustic object, according to an embodiment.
  • the user can wear an HMD or similar equipment, and the user's location in virtual reality can be measured in real time using the HMD to measure the user's location and orientation. Accordingly, the distance between the acoustic object included in the content reproduced in the virtual reality and the user freely moving in the virtual reality can be measured in real time.
  • the sound magnification effect when the sound magnification effect corresponding to the sound object is set to be used, the sound magnification effect may be activated according to the distance between the sound object and the user.
  • the distance d1 between the user wearing the HMD and the acoustic object 1 and the distance d2 between the user and the acoustic object 2 may be measured in real time. At this time, when d1> d2, an acoustic enlargement effect corresponding to the acoustic object 2 closer to the user may be activated and reproduced.
  • both the acoustic enlargement effect corresponding to the acoustic object 1 and the acoustic enlargement effect corresponding to the acoustic object 2 may be activated and reproduced, but the user may more easily listen to the acoustic enlargement effect corresponding to the acoustic object 2 at a short distance. You can.
  • FIG. 6 is a diagram illustrating whether an acoustic enlargement effect corresponding to an acoustic object is activated according to a user's random selection according to an embodiment.
  • the sound magnification effect when the sound magnification effect corresponding to the sound object is set to be used, the sound magnification effect may be activated when the sound object is arbitrarily selected by the user.
  • a sound enlargement effect corresponding to a sound object randomly selected by the user may be activated.
  • a sound enlargement effect corresponding to the selected sound object may be applied regardless of the direction or distance between the user and the sound object.
  • the user can listen to the acoustic object 2 remotely regardless of the distance or direction between the user and the acoustic object 2.
  • FIG. 7 illustrates a method of controlling an acoustic signal corresponding to an acoustic object, according to an embodiment.
  • the acoustic signal corresponding to the acoustic object may be controlled based on a preset method, and thus correspond to the activated acoustic object The sound magnification effect can be corrected and reproduced.
  • the sound magnification effect corresponding to the activated sound object is controlled, so that it can be applied to the content.
  • the volume level of the acoustic signal corresponding to the activated acoustic object may be controlled to be increased by a preset level than the volume level of the acoustic signal corresponding to the unactivated acoustic object.
  • a sound enlargement effect corresponding to an activated sound object may be controlled and applied to the content. That is, by controlling the ratio of the direct sound to indirect sound of the activated sound object and the direct sound to indirect sound ratio of the sound object that is not activated, the sound enlargement effect can be controlled.
  • the ratio of direct sound to indirect sound for example, reflected sound and reverberation sound
  • the ratio of direct sound to indirect sound is reduced from the direct sound to indirect sound ratio for an inactivated acoustic object, and activated. It is possible to increase the ratio of the direct sound from the sound object. As the ratio of the direct sound to the sound object increases, the sound enlargement effect on the sound object may increase. Further, as the ratio of the indirect sound composed of the reflected sound and the reverberation sound to the sound object increases, the sound enlargement effect on the sound object may decrease.
  • the acoustic magnification effect can be controlled.
  • a frequency characteristic of an acoustic object activated using a filter may be emphasized, or a frequency characteristic of an acoustic object that is not activated may be attenuated.
  • FIG. 8 illustrates a method of controlling an acoustic signal corresponding to an acoustic object, according to another embodiment.
  • the acoustic signal corresponding to the acoustic object is controlled according to the distance from the acoustic object, so that the acoustic enlargement effect can be applied and reproduced.
  • the acoustic enlargement effect corresponding to the acoustic object is activated by the user's gaze or the distance between the user and the acoustic object or the user's random selection
  • different acoustic enlargement effects may be applied according to the distance between the acoustic object and the user.
  • the sound enlargement effect may be emphasized in inverse proportion to the distance between the activated acoustic object and the user.
  • the sound magnification effect experienced by the user 820 from the activated sound object may be more emphasized than the sound magnification effect experienced by the user 810 from the activated sound object.
  • the sound magnification effect experienced by the user 830 from the activated sound object may be more emphasized than the sound magnification effect experienced by the user 820 from the activated sound object.
  • the degree of the sound magnification effect emphasized according to the distance from the user may be processed by a preset value of the playback device.
  • FIG. 9 illustrates an acoustic signal control method performed by an acoustic signal control device according to an embodiment.
  • the acoustic signal control device may identify whether to use an audio zooming effect for at least one acoustic object existing in virtual reality through an acoustic enlargement effect field included in metadata. .
  • the acoustic signal control device may identify whether to use an acoustic enlargement effect on an acoustic object included in the content using metadata.
  • the use of the sound enlargement effect may be applied to the above-described matters in FIGS. 2 and 3.
  • the acoustic signal control device may determine whether to activate the acoustic enlargement effect. Whether or not the sound magnification effect is activated for the acoustic object viewed by the user is tracked by tracking the user's gaze direction, or whether the sound magnification effect is activated according to the distance between the user and the sound object, or the sound is magnified according to the user's random selection Whether to activate the effect can be determined. Details of activating the sound enlargement effect may be applied to the above-described matters in FIGS. 4 to 6.
  • the acoustic signal control device may control the acoustic signal corresponding to the acoustic object based on a preset method. Therefore, the sound enlargement effect corresponding to the sound object can be adjusted and reproduced.
  • the acoustic signal control apparatus controls a volume level adjustment method to control the volume level of the acoustic object corresponding to the activated acoustic enlargement effect to be increased by a preset level from the volume level of the acoustic object corresponding to the unactivated acoustic enlargement effect
  • a volume level adjustment method to control the volume level of the acoustic object corresponding to the activated acoustic enlargement effect to be increased by a preset level from the volume level of the acoustic object corresponding to the unactivated acoustic enlargement effect
  • the acoustic signal control device may correspond to an R / D ratio (reflection sound to direct sound ratio) of an acoustic object corresponding to an activated sound magnification effect and an inactivated sound magnification effect.
  • R / D ratio reflection sound to direct sound ratio
  • the sound enlargement effect can be adjusted and reproduced.
  • the acoustic signal control apparatus may apply a filter to control the acoustic signal based on the frequency characteristic control method of controlling the frequency characteristic of each activated acoustic object and the frequency characteristic of the inactive acoustic object, thereby expanding the acoustic You can play by adjusting the effect.
  • the acoustic signal control device may be closer to the user if the distance between the user and the acoustic object corresponding to the activated acoustic enlargement effect is relatively closer than when the user and the acoustic object corresponding to the activated acoustic enlargement effect are distant.
  • the sound magnification effect can be adjusted and reproduced so that the sound object in the distance is more emphasized.
  • FIG. 10 illustrates an acoustic signal control method performed by an acoustic signal control device according to another embodiment.
  • the acoustic signal control device may identify at least one acoustic object constituting the content in order to reproduce the content in virtual reality.
  • the acoustic signal control device may determine whether to activate the acoustic enlargement effect corresponding to the identified acoustic object.
  • the acoustic signal control device may apply the acoustic enlargement effect to the content by controlling the acoustic signal corresponding to the acoustic object based on a preset method when the acoustic enlargement effect is activated. For details applied to each step, refer to the contents described above with reference to FIGS. 1 to 9.
  • the device described above may be implemented with hardware components, software components, and / or combinations of hardware components and software components.
  • the devices and components described in the embodiments include, for example, processors, controllers, arithmetic logic units (ALUs), digital signal processors (micro signal processors), microcomputers, field programmable arrays (FPAs), It may be implemented using one or more general purpose computers or special purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions.
  • the processing device may run an operating system (OS) and one or more software applications running on the operating system.
  • the processing device may access, store, manipulate, process, and generate data in response to the execution of the software.
  • OS operating system
  • the processing device may access, store, manipulate, process, and generate data in response to the execution of the software.
  • a processing device may be described as one being used, but a person having ordinary skill in the art, the processing device may include a plurality of processing elements and / or a plurality of types of processing elements. It can be seen that may include.
  • the processing device may include a plurality of processors or a processor and a controller.
  • other processing configurations such as parallel processors, are possible.
  • the software may include a computer program, code, instruction, or a combination of one or more of these, and configure the processing device to operate as desired, or process independently or collectively You can command the device.
  • Software and / or data may be interpreted by a processing device, or to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. , Or may be permanently or temporarily embodied in the transmitted signal wave.
  • the software may be distributed on networked computer systems, and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.
  • the method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium.
  • Computer-readable media may include program instructions, data files, data structures, or the like alone or in combination.
  • the program instructions recorded on the medium may be specially designed and constructed for the embodiments or may be known and usable by those skilled in computer software.
  • Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs, DVDs, and magnetic media such as floptical disks. Includes hardware devices specifically configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like.
  • program instructions include high-level language code that can be executed by a computer using an interpreter, etc., as well as machine language codes produced by a compiler.
  • the hardware device described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Computational Linguistics (AREA)
  • Quality & Reliability (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Stereophonic System (AREA)

Abstract

L'invention concerne un procédé de commande d'un signal audio qui peut comprendre les étapes consistant : à déterminer, par l'intermédiaire d'un champ d'effet de zoom audio inclus dans des métadonnées, si un effet de zoom audio sur au moins un objet acoustique existant dans une réalité virtuelle est utilisé ; et, lorsqu'il est déterminé que l'effet de zoom audio est utilisé, à commander le signal audio correspondant à l'objet acoustique sur la base d'un procédé prédéfini.
PCT/KR2019/012812 2018-10-02 2019-10-01 Procédé et dispositif de commande de signal audio pour appliquer un effet de zoom audio dans une réalité virtuelle WO2020071728A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201980004342.1A CN111344785B (zh) 2018-10-02 2019-10-01 在虚拟现实使用音频放大效果的音频信号控制方法及装置
DE112019000115.9T DE112019000115T5 (de) 2018-10-02 2019-10-01 Verfahren und Vorrichtung zum Steuern eines Audiosignals zum Anwenden des Audio-Zoom-Effekts in der virtuellen Realität
US16/647,458 US11330387B2 (en) 2018-10-02 2019-10-01 Method and apparatus for controlling audio signal for applying audio zooming effect in virtual reality

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2018-0117832 2018-10-02
KR20180117832 2018-10-02
KR10-2019-0004781 2019-01-14
KR1020190004781A KR102458962B1 (ko) 2018-10-02 2019-01-14 가상 현실에서 음향 확대 효과 적용을 위한 음향 신호 제어 방법 및 장치

Publications (1)

Publication Number Publication Date
WO2020071728A1 true WO2020071728A1 (fr) 2020-04-09

Family

ID=70054675

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2019/012812 WO2020071728A1 (fr) 2018-10-02 2019-10-01 Procédé et dispositif de commande de signal audio pour appliquer un effet de zoom audio dans une réalité virtuelle

Country Status (1)

Country Link
WO (1) WO2020071728A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120094046A (ko) * 2009-11-17 2012-08-23 퀄컴 인코포레이티드 무선 디바이스에서 3차원 사운드를 제공하는 시스템 및 방법
KR20130130740A (ko) * 2010-12-16 2013-12-02 마이크로소프트 코포레이션 증강 현실 디스플레이를 위한 이해 및 의도-기반 컨텐트
JP2014204320A (ja) * 2013-04-05 2014-10-27 日本放送協会 音響信号再生装置、音響信号作成装置
US20170230760A1 (en) * 2016-02-04 2017-08-10 Magic Leap, Inc. Technique for directing audio in augmented reality system
KR20180032690A (ko) * 2011-07-01 2018-03-30 돌비 레버러토리즈 라이쎈싱 코오포레이션 향상된 3d 오디오 오서링과 렌더링을 위한 시스템 및 툴들

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120094046A (ko) * 2009-11-17 2012-08-23 퀄컴 인코포레이티드 무선 디바이스에서 3차원 사운드를 제공하는 시스템 및 방법
KR20130130740A (ko) * 2010-12-16 2013-12-02 마이크로소프트 코포레이션 증강 현실 디스플레이를 위한 이해 및 의도-기반 컨텐트
KR20180032690A (ko) * 2011-07-01 2018-03-30 돌비 레버러토리즈 라이쎈싱 코오포레이션 향상된 3d 오디오 오서링과 렌더링을 위한 시스템 및 툴들
JP2014204320A (ja) * 2013-04-05 2014-10-27 日本放送協会 音響信号再生装置、音響信号作成装置
US20170230760A1 (en) * 2016-02-04 2017-08-10 Magic Leap, Inc. Technique for directing audio in augmented reality system

Similar Documents

Publication Publication Date Title
US10924875B2 (en) Augmented reality platform for navigable, immersive audio experience
KR102458962B1 (ko) 가상 현실에서 음향 확대 효과 적용을 위한 음향 신호 제어 방법 및 장치
WO2013019022A2 (fr) Procédé et appareil conçus pour le traitement d'un signal audio
WO2015152661A1 (fr) Procédé et appareil pour restituer un objet audio
US20170188176A1 (en) Sound object control apparatus and method based on additional image object
KR102527336B1 (ko) 가상 공간에서 사용자의 이동에 따른 오디오 신호 재생 방법 및 장치
JP7536733B2 (ja) オーディオと関連してユーザカスタム型臨場感を実現するためのコンピュータシステムおよびその方法
WO2014061931A1 (fr) Dispositif et procédé de lecture de son
JP2022058215A (ja) 音声コマンドに基づいて複数のコンピューティング・デバイス間の通信を行うための方法、コンピュータ・プログラム及びコンピュータ・システム（音声コマンドの実行）
WO2020071728A1 (fr) Procédé et dispositif de commande de signal audio pour appliquer un effet de zoom audio dans une réalité virtuelle
WO2019164029A1 (fr) Procédé et système de reproduction audio par des canaux multiples
WO2023085858A1 (fr) Procédé de fourniture de mode d'écouteur d'appareil auditif fournissant un mode audition et un mode musique, et système associé
CA3044260A1 (fr) Plate-forme de realite augmentee pour une experience audio a navigation facile et immersive
WO2018194320A1 (fr) Dispositif de commande audio spatial selon le suivi du regard et procédé associé
WO2018070564A1 (fr) Procédé et dispositif de sortie sonore d'affichages multiples
US10448186B2 (en) Distributed audio mixing
WO2020055027A1 (fr) Appareil d'apprentissage de langue
Austin-Stewart et al. The Extended Stereo Speaker Configuration as an Individual Spatial Experience
WO2024014711A1 (fr) Procédé de rendu audio basé sur un paramètre de distance d'enregistrement et appareil pour sa mise en œuvre
KR102687136B1 (ko) 사운드 생성 방법 및 이를 수행하는 장치들
WO2024096314A1 (fr) Dispositif électronique et procédé d'émission de son
KR20190081163A (ko) 입체 음향 컨텐츠 저작 툴을 이용한 선택적 광고 제공 방법 및 이를 위한 어플리케이션
WO2024106883A1 (fr) Dispositif électronique et son procédé de sortie acoustique
Cohen et al. Networked speaker array streaming back to client: The world’s most expensive sound spatializer?
WO2024177629A1 (fr) Mixage audio dynamique dans un environnement de haut-parleur sans fil multiple

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19869918

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 19869918

Country of ref document: EP

Kind code of ref document: A1