WO2014077234A1 - Sound system and electronic equipment - Google Patents

Sound system and electronic equipment Download PDF

Info

Publication number
WO2014077234A1
WO2014077234A1 PCT/JP2013/080505 JP2013080505W WO2014077234A1 WO 2014077234 A1 WO2014077234 A1 WO 2014077234A1 JP 2013080505 W JP2013080505 W JP 2013080505W WO 2014077234 A1 WO2014077234 A1 WO 2014077234A1
Authority
WO
WIPO (PCT)
Prior art keywords
parametric
parametric speaker
acoustic system
speaker array
region
Prior art date
Application number
PCT/JP2013/080505
Other languages
French (fr)
Japanese (ja)
Inventor
黒田 淳
康晴 大西
重夫 佐藤
Original Assignee
Necカシオモバイルコミュニケーションズ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Necカシオモバイルコミュニケーションズ株式会社 filed Critical Necカシオモバイルコミュニケーションズ株式会社
Publication of WO2014077234A1 publication Critical patent/WO2014077234A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00Stereophonic arrangements
    • H04R5/04Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/20Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/403Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers loud-speakers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R17/00Piezoelectric transducers; Electrostrictive transducers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2217/00Details of magnetostrictive, piezoelectric, or electrostrictive transducers covered by H04R15/00 or H04R17/00 but not provided for in any of their subgroups
    • H04R2217/03Parametric transducers where sound is generated or captured by the acoustic demodulation of amplitude modulated ultrasonic waves
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/12Circuits for transducers, loudspeakers or microphones for distributing signals to two or more loudspeakers

Definitions

  • the present invention is based on a Japanese patent application: Japanese Patent Application No. 2012-249068 (filed on November 13, 2012), and the entire description of the application is incorporated herein by reference.
  • the present invention relates to an acoustic system and an electronic device.
  • the present invention relates to an acoustic system including a parametric speaker and an electronic apparatus.
  • An acoustic system including a parametric speaker can be heard only at a target place (spot), and thus can be expected to be used in a noisy situation.
  • Patent Document 1 discloses a projector that controls the radiation characteristics of an ultrasonic speaker so that the acoustic characteristics (realism) do not change greatly even if the size of the projected image varies.
  • Electronic devices such as mobile phones and smartphones are equipped with speakers for providing voice to users.
  • a speaker does not cause a problem when monaural (one channel) sound is reproduced.
  • stereo two-channel sound in an electronic device having a normal speaker. This is because the housing of a smartphone or the like is small and it is difficult to secure a distance between a speaker that reproduces L-channel sound and a speaker that reproduces R-channel sound.
  • a parametric speaker array configured to include a plurality of parametric speakers, a first amplifier that drives a parametric speaker included in a first region of the parametric speaker array, and A second amplifier for driving a parametric speaker included in the second region of the parametric speaker array, and a first amplifier supplied to the first amplifier by modulating a carrier wave in the ultrasonic region based on a plurality of audio signals.
  • an acoustic system including a digital signal processing device that generates one modulation signal and a second modulation signal to be supplied to the second amplifier.
  • an electronic device including the acoustic system is provided.
  • an acoustic system and an electronic device that contribute to clearly feeling the left and right localization of a sound image when a stereo sound source is reproduced are provided.
  • FIG. 1 is a diagram illustrating an example of a cross section of a parametric speaker 10.
  • FIG. It is a figure which shows an example of the parametric speaker array 20 which arranged the some parametric speaker 10 in the array form.
  • 1 is a diagram illustrating an example of a configuration of an acoustic system including a parametric speaker array 20.
  • FIG. FIG. 5 is a diagram illustrating an example of a sound pressure distribution when an ultrasonic carrier wave is radiated from the parametric speaker array 20 in the acoustic system illustrated in FIG. 4. It is a figure which shows an example of a sound pressure distribution map.
  • the acoustic system shown in FIG. 1 includes a parametric speaker array 100, a first amplifier 101, a second amplifier 102, and a digital signal processing device 103.
  • the parametric speaker array 100 includes a plurality of parametric speakers.
  • the first amplifier 101 drives parametric speakers included in the first region of the parametric speaker array 100.
  • the second amplifier 102 drives a parametric speaker included in the second region of the parametric speaker array 100.
  • the digital signal processing device 103 modulates a carrier wave in the ultrasonic region based on a plurality of audio signals, thereby providing a first modulation signal to be supplied to the first amplifier 101 and a second modulation signal to be supplied to the second amplifier 102. 2 modulation signals.
  • the size of the housing of an electronic device such as a smartphone is limited. Therefore, reproduction of a stereo sound source using a normal speaker is difficult.
  • the parametric speaker since the parametric speaker has high directivity, it is possible to restore sound (sound source audible) at a specific spot. Therefore, by using a plurality of parametric speakers, the sound pressure required for practical use is secured, and by arranging them, the area required for installing the speakers is reduced. Further, the area of the parametric speaker array is divided into first and second areas, and the reproduction of the L channel audio signal and the R channel audio signal is assigned to each area.
  • FIG. 2 is a diagram showing an example of a cross section of the parametric speaker 10.
  • the parametric speaker 10 is configured by adhering a metal cone 13 to a vibration plate in which a piezoelectric element 11 and a metal plate 12 are bonded.
  • An adhesive 14 is used for bonding the metal plate 12 and the metal cone 13.
  • the diaphragm is fixed to the frame 16 via the elastic material 15.
  • a signal for vibrating the diaphragm is supplied from the terminal 17.
  • FIG. 3 is a diagram showing an example of a parametric speaker array 20 in which a plurality of parametric speakers 10 are arranged in an array.
  • the parametric speaker array 20 shown in FIG. 3 is formed by arranging sixteen parametric speakers 10 horizontally and two vertically.
  • parametric speakers have extremely high directivity. It can be understood from the sound pressure distribution diagram of FIG. 5 that the parametric speaker exhibits high directivity. Details of FIG. 5 will be described later.
  • FIG. 4 is a diagram illustrating an example of the configuration of an acoustic system including the parametric speaker array 20. Note that the sound system shown in FIG. 4 is based on the reproduction of a monaural sound source.
  • the acoustic system includes a CPU (Central Processing Unit) 30, a DSP (Digital Signal Processing) 40, a DA (Digital Signal Processing) converter 50, an audio amplifier 60, and a parametric speaker array 20. .
  • the parametric speaker array 20 is driven by each module (circuit block) shown in FIG.
  • the CPU 30 includes a data loader 31 and a decoder 32.
  • the data loader 31 is means for reading an audio signal from an external storage (for example, an SD card, a hard disk, a flash memory, etc.).
  • audio signals stored in an external storage are often compressed by MPEG (Moving / Pictures / Experts / Group) or the like.
  • a means for decoding such a compressed audio signal is the decoder 32.
  • the CPU 30 outputs an audio signal to the DSP 40.
  • the DSP 40 includes an upsampling unit 41, an ultrasonic carrier wave generation unit 42, and a modulation processing unit 43.
  • the DSP 40 uses the upsampling unit 41 to upsample the audio signal decoded by the decoder 32.
  • a sampling rate of 48 kHz or less is often used for audio signals stored in an SD card or the like. Therefore, the upsampling unit 41 needs to upsample to a frequency higher than 48 kHz such as 192 kHz or 96 kHz.
  • a carrier wave in an ultrasonic region that is a frequency region higher than the audible band (for example, 40 kHz or more) is used.
  • the carrier in the ultrasonic region is referred to as an ultrasonic carrier.
  • the Nyquist frequency of the sampling rate is considered. More specifically, the sampling rate is selected such that the frequency of the ultrasonic carrier wave has a sufficient margin with respect to the Nyquist frequency of the sampling rate and is equal to or lower than the Nyquist frequency.
  • the modulation processor 43 modulates the ultrasonic carrier wave generated by the ultrasonic carrier wave generator 42 with the upsampled audio signal.
  • FM Frequency modulation
  • AM Amplitude modulation
  • SSB Single side band modulation
  • the DSP 40 outputs the signal modulated by the modulation processing unit 43 to the DA converter 50.
  • the DA converter 50 converts the received signal into an analog signal and outputs it to the audio amplifier 60.
  • the audio amplifier 60 amplifies the modulated signal converted into the analog signal to an appropriate power and supplies it to the parametric speaker array 20.
  • the parametric speaker array 20 is driven by the audio amplifier 60, and sound waves are radiated into the space.
  • a low pass filter (not shown) is inserted between the audio amplifier 60 and the parametric speaker array 20 in order to remove the oscillation frequency of the digital amplifier. To do.
  • FIG. 5 is a diagram showing an example of a sound pressure distribution when an ultrasonic carrier wave is radiated from the parametric speaker array 20 in the acoustic system shown in FIG.
  • the parametric speaker array 20 is arranged at the center of the figure, and the sound pressure distribution in the two-dimensional space is expressed by color shading. It shows that the sound pressure is higher in the darker region than in the lighter region.
  • the conditions for driving the parametric speaker array 20 are, for example, as follows. ⁇ The frequency of the ultrasonic carrier wave is 80 kHz. -The size of the parametric speaker array 20 shall be 1.8 cm x 7.2 cm. The ultrasonic wave emission surface is in the Y-axis direction in FIG. 5 (upward in FIG. 5).
  • the sound waves radiated from the individual parametric speakers 10 constituting the parametric speaker array 20 modulate an ultrasonic carrier wave using an audio signal output from the CPU 30. Therefore, Fourier components other than the frequency of the ultrasonic carrier wave are included.
  • a modulation parameter for example, modulation degree, modulation index
  • energy of Fourier components other than the carrier wave is converted to the carrier wave. 1/5 or less of the energy. Therefore, the directivity of the ultrasonic carrier wave can be understood as the directivity of the entire modulated wave.
  • a region 200 is a region where the sound pressure of the ultrasonic carrier wave is higher than that of other regions by 10 dB or more. Therefore, it can be said that the region 200 is a region where the audible sound is demodulated almost as it is. If the same signal is input to all of the parametric speakers 10 included in the parametric speaker array 20, a monaural audible sound is heard by the user as shown in FIG.
  • the audio signal of a stereo sound source is demodulated to an audible sound with high directivity (narrow directivity), good left and right panning ( Realize high sound image localization on the left and right.
  • the acoustic system uses a parametric speaker array 20 in which a plurality of parametric speakers 10 are arranged in an array as shown in FIG.
  • the parametric speaker array 20 is mounted on a substrate (on a plane) used for a smartphone or the like, for example.
  • the number of parametric speakers 10 constituting the parametric speaker array 20 may be arbitrary, but is preferably 50 or less in consideration of mounting area, cost, and the like.
  • the left half 8 parametric speakers 10 have an L channel
  • the right half 8 parametric speakers 10 have an R channel
  • the final ultrasonic radiation source Use as That is, the parametric loudspeaker array is divided into first and second areas, and the respective areas are assigned to play audio signals of the L channel and the R channel.
  • FIG. 6 is a diagram showing an example of a sound pressure distribution diagram.
  • FIG. 6 shows a sound pressure distribution when an ultrasonic carrier wave of 80 kHz is radiated from the right half, that is, eight R channel parametric speakers 10.
  • an ultrasonic audible band 201 (a region where the sound pressure of the ultrasonic carrier is about 10 dB higher than other regions) is formed in front of the parametric speaker for the R channel (upper side in FIG. 6).
  • FIG. 6 shows that the modulated waves of the L channel and the R channel can be separated into left and right (LR separation), and it is possible to separate stereo sound sources in the audible band.
  • the stereo sound source separation is extremely clear when the stereo mounted on a mobile phone, a tablet terminal, a smartphone or a television device is compared with a speaker. More specifically, it is close to the case where a stereo sound source is viewed using headphones.
  • FIG. 7 is a diagram illustrating an example of the internal configuration of the acoustic system according to the present embodiment.
  • stereo processing is performed from reading of a sound source to driving of a parametric speaker. This is the difference between the acoustic system shown in FIG. 4 and the acoustic system shown in FIG.
  • the DA converters 50-1 and 50-2, the audio amplifiers 60-1 and 60-2, and the parametric speaker arrays 20-1 and 20-2 are also modules provided corresponding to stereo sound sources, respectively. Since the individual functions are not different from the modules already described, further description is omitted.
  • the audio amplifier 60-1 may be configured to drive the parametric speakers included in the parametric speaker array 20-1 in common, or may be configured to individually drive the parametric speakers. The same applies to the audio amplifier 60-2.
  • the DSP 40a is also configured to support a stereo sound source.
  • the upsampling unit 41 performs upsampling on a stereo audio signal.
  • the left and right up-sampled audio signals are respectively subjected to modulation processing by the modulation processing units 43-1 and 43-2.
  • the DSP 40a corresponds to the digital signal processing device 103 described above.
  • the signal modulated by the modulation processing unit 43-1 is output to the multipliers 44-1 and 44-4.
  • the signal modulated by the modulation processing unit 43-2 is output to the multipliers 44-2 and 44-3.
  • the multiplication coefficients of the multipliers 44-1 to 44-4 are as follows. - multiplier 44-1 comprises a multiplier factor of X L.
  • Multiplier 44-2 includes a multiplier coefficient 1-X L.
  • Multiplier 44-3 includes a multiplier coefficient X R.
  • Multiplier 44-4 includes a multiplier coefficient 1-X R. In this way, the multipliers 44-1 to 44-4 multiply the amplitude of the upsampled stereo audio signal by a predetermined coefficient.
  • X L and X R can be regarded as parameters for controlling panning.
  • the calculation results by the multipliers 44-1 and 44-2 are sent to the adder 45-1.
  • the calculation results by the multipliers 44-3 and 44-4 are sent to the adder 45-2.
  • the calculation result of the adder 45-1 is output to the DA converter 50-1 as a modulation signal for the L channel.
  • the calculation result of the adder 45-2 is output to the DA converter 50-2 as a modulation signal for the R channel.
  • the L channel modulation signal corresponds to the first modulation signal described above
  • the R channel modulation signal corresponds to the second modulation signal described above.
  • the processing in the DSP 40a can be expressed by the following equation (1).
  • U L and U R are input signals to DSP40a.
  • Y L and Y R are the output signals from the DSP40a. Referring to equation (1), according to the value of X L and X R, it is understood that can control the panning of the sound source.
  • the DSP 40a generates a modulation signal to be supplied to the audio amplifiers 60-1 and 60-2 that drive the parametric speaker arrays 20-1 and 20-2 according to the equation (1).
  • Localization of a sound image to be reproduced by a parametric speaker array 20-1 and 20-2 are adjustable (controlled) by changing the X L and X R in Formula (1).
  • the range of changing the value of X L and X R is, 1/2 ⁇ X L, and X R ⁇ 1. For example, when the both X L and X R "1", the sound image is localized as faithful stereo signals to the sound source. Also, if both X L and X R "1/2", the sound image as in the monophonic sound source is localized.
  • an electronic device such as a mobile phone or a smartphone that includes the acoustic system shown in FIG. 7, it is usual to include a control unit that controls the entire electronic device.
  • the DSP 40a is configured to be able to change the internal coefficient from the outside, and the control unit of the electronic device can change the multiplication coefficient of the multipliers 44-1 to 44-4. For this reason, it is preferable to change the coefficient in conjunction with the type of content to be played back on the electronic device. For example, it is possible to provide a user with sound image localization that faithfully reproduces a stereo sound source, or to provide a stereo sound source to the user in a form close to a monaural sound source, depending on the situation in which the electronic device is used. .
  • panning sound image localization
  • panning can be controlled by changing the coefficient in conjunction with the moving image displayed on the display as well as the sound.
  • the internal configuration of the DSP 40a shown in FIG. 7 is an example, and is not intended to limit the configuration of the DSP 40a.
  • the processing corresponding to Equation (1) is executed (calculations by multipliers 44-1 to 44-4 and adders 45-1 and 45-2), and then the stereo audio signal is modulated. May be.
  • the sound source is not a stereo but a multi-channel sound source.
  • a specific sound may be rendered in the left and right localization.
  • FIG. 9 is a diagram illustrating an example of an internal configuration of an acoustic system that supports multi-channel.
  • each module of the data loader 31b, the decoder 32b, the upsampling unit 41a, and the modulation processing unit 43a is associated with a multi-channel sound source.
  • the L channel modulation signal and the R channel modulation signal may be generated by the LR mixer 46 that executes the processing of the following equation (2).
  • a1 to an and b1 to bn (where n is a natural number) are coefficients that are multiplied when mixing (mixing) the input signals U1 to Un when generating a modulation signal.
  • the acoustic system according to the present embodiment can be mounted on electronic devices such as a mobile phone, a portable audio player, a television device, a tablet terminal, and a game machine.
  • the region of the parametric speaker array composed of a plurality of parametric speakers is separated into an L channel region and an R channel region. Further, a modulation signal for driving the parametric speaker included in each separated region is generated from the stereo sound source, and the directivity of the sound wave radiated from the parametric speaker array is controlled using the DSP. As a result, it is possible to provide an acoustic system and an electronic device that contribute to clearly feeling the left and right localization of a sound image when content having a stereo sound source is reproduced.
  • the digital signal processing device includes: The result of multiplying the first modulated signal by the first coefficient to the amplitude of the first audio signal included in the plurality of audio signals and the amplitude of the second audio signal included in the plurality of audio signals. A result obtained by multiplying the second coefficient is added to Adding the result of multiplying the amplitude of the first audio signal by a third coefficient to the amplitude of the first audio signal and the result of multiplying the amplitude of the second audio signal by a fourth coefficient.
  • the digital signal processing device includes: The acoustic system according to appendix 1 or 2, wherein the plurality of audio signals are up-sampled to a sampling rate in an ultrasonic region, and a carrier wave in the ultrasonic region is modulated based on the plurality of up-sampled audio signals.
  • [Appendix 4] The acoustic system according to appendix 2 or 3, wherein the first to fourth coefficients can be changed from outside the digital signal processing device.
  • [Appendix 5] The acoustic system according to any one of appendices 2 to 4, wherein the values of the first and third coefficients are 0.5 or more and 1 or less, respectively.
  • the digital signal processing device includes: The acoustic system according to appendix 1, wherein the first and second modulated signals are generated by multiplying each of the plurality of audio signals by a predetermined coefficient and adding the multiplication results.
  • Appendix 7 As in the electronic apparatus according to the second aspect.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

Provided is a sound system by which sound image localisation can be clearly sensed when reproducing a stereo sound source. The sound system includes a parametric speaker array, a first amp, a second amp, and a digital signal processing device. The parametric speaker array is configured to include a plurality of parametric speakers. The first amp drives the parametric speakers included in a first region of the parametric speaker array. The second amp drives the parametric speakers included in a second region of the parametric speaker array. The digital signal processing device generates a first modulation signal to supply to the first amp, and a second modulation signal to supply to the second amp, by modulating a carrier wave of an ultrasonic region on the basis of a plurality of audio signals.

Description

音響システム及び電子機器Acoustic system and electronic equipment
 [関連出願についての記載]
 本発明は、日本国特許出願:特願2012-249068号(2012年11月13日出願)に基づくものであり、同出願の全記載内容は引用をもって本書に組み込み記載されているものとする。
本発明は、音響システム及び電子機器に関する。特に、パラメトリックスピーカを含んで構成される音響システム及び電子機器に関する。
[Description of related applications]
The present invention is based on a Japanese patent application: Japanese Patent Application No. 2012-249068 (filed on November 13, 2012), and the entire description of the application is incorporated herein by reference.
The present invention relates to an acoustic system and an electronic device. In particular, the present invention relates to an acoustic system including a parametric speaker and an electronic apparatus.
 近年、高い指向性を持つパラメトリックスピーカ(所謂、超音波スピーカ)を使用した製品の研究開発が進んでいる。パラメトリックスピーカを含む音響システムは、目的とする場所(スポット)だけに向けて音を聞かせることができるので、ノイズの多い状況下での利用が期待できる。 In recent years, research and development of products using parametric speakers with high directivity (so-called ultrasonic speakers) are progressing. An acoustic system including a parametric speaker can be heard only at a target place (spot), and thus can be expected to be used in a noisy situation.
 ここで、特許文献1において、投影される映像のサイズが変動したとしても、音響特性(臨場感)が大きく変わることがないように超音波スピーカの放射特性を制御するプロジェクタが開示されている。 Here, Patent Document 1 discloses a projector that controls the radiation characteristics of an ultrasonic speaker so that the acoustic characteristics (realism) do not change greatly even if the size of the projected image varies.
特開2006-025108号公報JP 2006-025108 A
 なお、上記先行技術文献の開示を、本書に引用をもって繰り込むものとする。以下の分析は、本発明者らによってなされたものである。 It should be noted that the disclosure of the above prior art document is incorporated herein by reference. The following analysis was made by the present inventors.
 携帯電話やスマートフォン等の電子機器は、ユーザに音声を提供するためのスピーカを備えている。このようなスピーカにより、モノラル(1チャンネル)の音声を再生する場合には問題は生じない。しかし、通常のスピーカを備える電子機器において、ステレオ(2チャンネル)の音声を再生する際に問題が生じる。スマートフォン等の筐体は小さく、Lチャンネルの音声を再生するスピーカとRチャンネルの音声を再生するスピーカの距離を確保することが難しいためである。 Electronic devices such as mobile phones and smartphones are equipped with speakers for providing voice to users. Such a speaker does not cause a problem when monaural (one channel) sound is reproduced. However, there is a problem in reproducing stereo (two-channel) sound in an electronic device having a normal speaker. This is because the housing of a smartphone or the like is small and it is difficult to secure a distance between a speaker that reproduces L-channel sound and a speaker that reproduces R-channel sound.
 双方のスピーカの間の距離を確保することができないと、ユーザは、音声が明確に左右に分離しているように感じ取ることができない(左右の音像定位が不明瞭に感じられる)。なお、このような問題は、特許文献1が開示するプロジェクタ等の大型な電子機器には生じない。2つのスピーカ間の距離を確保することができるためである。 If the distance between the two speakers cannot be secured, the user cannot feel as if the sound is clearly separated into left and right (the left and right sound image localization is felt indistinct). Such a problem does not occur in a large electronic device such as a projector disclosed in Patent Document 1. This is because the distance between the two speakers can be secured.
 以上のような状況を鑑み、ステレオ音源を再生した際に、音像の左右定位が明確に感じとれる音響システム及び電子機器が、望まれる。 In view of the above situation, an acoustic system and an electronic device that can clearly feel the left and right localization of a sound image when a stereo sound source is reproduced are desired.
 本発明の第1の視点によれば、複数のパラメトリックスピーカを含んで構成されるパラメトリックスピーカアレイと、前記パラメトリックスピーカアレイの第1の領域に含まれるパラメトリックスピーカを駆動する第1のアンプと、前記パラメトリックスピーカアレイの第2の領域に含まれるパラメトリックスピーカを駆動する第2のアンプと、複数のオーディオ信号に基づいて、超音波領域の搬送波を変調することで、前記第1のアンプに供給する第1の変調信号と、前記第2のアンプに供給する第2の変調信号と、を生成するデジタル信号処理装置と、を含む音響システムが提供される。 According to a first aspect of the present invention, a parametric speaker array configured to include a plurality of parametric speakers, a first amplifier that drives a parametric speaker included in a first region of the parametric speaker array, and A second amplifier for driving a parametric speaker included in the second region of the parametric speaker array, and a first amplifier supplied to the first amplifier by modulating a carrier wave in the ultrasonic region based on a plurality of audio signals. There is provided an acoustic system including a digital signal processing device that generates one modulation signal and a second modulation signal to be supplied to the second amplifier.
 本発明の第2の視点によれば、上記音響システムを含む電子機器が提供される。 According to a second aspect of the present invention, an electronic device including the acoustic system is provided.
 本発明の各視点によれば、ステレオ音源を再生した際に、音像の左右定位が明確に感じとれることに寄与する音響システム及び電子機器が、提供される。 According to each viewpoint of the present invention, an acoustic system and an electronic device that contribute to clearly feeling the left and right localization of a sound image when a stereo sound source is reproduced are provided.
一実施形態の概要を説明するための図である。It is a figure for demonstrating the outline | summary of one Embodiment. パラメトリックスピーカ10の断面の一例を示す図である。1 is a diagram illustrating an example of a cross section of a parametric speaker 10. FIG. 複数のパラメトリックスピーカ10をアレイ状に並べたパラメトリックスピーカアレイ20の一例を示す図である。It is a figure which shows an example of the parametric speaker array 20 which arranged the some parametric speaker 10 in the array form. パラメトリックスピーカアレイ20を含む音響システムの構成の一例を示す図である。1 is a diagram illustrating an example of a configuration of an acoustic system including a parametric speaker array 20. FIG. 図4に示す音響システムにおいて、パラメトリックスピーカアレイ20から超音波搬送波を放射した際の音圧分布の一例を示す図である。FIG. 5 is a diagram illustrating an example of a sound pressure distribution when an ultrasonic carrier wave is radiated from the parametric speaker array 20 in the acoustic system illustrated in FIG. 4. 音圧分布図の一例を示す図である。It is a figure which shows an example of a sound pressure distribution map. 第1の実施形態に係る音響システムの内部構成の一例を示す図である。It is a figure which shows an example of the internal structure of the acoustic system which concerns on 1st Embodiment. 第1の実施形態に係る音響システムの内部構成の別の一例を示す図である。It is a figure which shows another example of the internal structure of the acoustic system which concerns on 1st Embodiment. マルチチャンネルに対応する音響システムの内部構成の一例を示す図である。It is a figure which shows an example of the internal structure of the acoustic system corresponding to a multichannel.
 初めに、図1を用いて一実施形態の概要について説明する。なお、この概要に付記した図面参照符号は、理解を助けるための一例として各要素に便宜上付記したものであり、この概要の記載はなんらの限定を意図するものではない。 First, an outline of an embodiment will be described with reference to FIG. Note that the reference numerals of the drawings attached to the outline are attached to the respective elements for convenience as an example for facilitating understanding, and the description of the outline is not intended to be any limitation.
 上述のように、ステレオ音源を再生した際に、音像の左右定位が明確に感じとれる音響システムと、そのような音響システムを備える電子機器が、望まれる。 As described above, when a stereo sound source is reproduced, an acoustic system in which the left and right localization of a sound image can be clearly sensed and an electronic device including such an acoustic system are desired.
 そこで、一例として図1に示す音響システムを提供する。図1に示す音響システムは、パラメトリックスピーカアレイ100と、第1のアンプ101と、第2のアンプ102と、デジタル信号処理装置103と、を含んでいる。パラメトリックスピーカアレイ100は、複数のパラメトリックスピーカを含んで構成される。第1のアンプ101は、パラメトリックスピーカアレイ100の第1の領域に含まれるパラメトリックスピーカを駆動する。第2のアンプ102は、パラメトリックスピーカアレイ100の第2の領域に含まれるパラメトリックスピーカを駆動する。デジタル信号処理装置103は、複数のオーディオ信号に基づいて、超音波領域の搬送波を変調することで、第1のアンプ101に供給する第1の変調信号と、第2のアンプ102に供給する第2の変調信号と、を生成する。 Therefore, the acoustic system shown in FIG. 1 is provided as an example. The acoustic system shown in FIG. 1 includes a parametric speaker array 100, a first amplifier 101, a second amplifier 102, and a digital signal processing device 103. The parametric speaker array 100 includes a plurality of parametric speakers. The first amplifier 101 drives parametric speakers included in the first region of the parametric speaker array 100. The second amplifier 102 drives a parametric speaker included in the second region of the parametric speaker array 100. The digital signal processing device 103 modulates a carrier wave in the ultrasonic region based on a plurality of audio signals, thereby providing a first modulation signal to be supplied to the first amplifier 101 and a second modulation signal to be supplied to the second amplifier 102. 2 modulation signals.
 上述したように、スマートフォン等の電子機器の筐体の大きさは限られている。そのため、通常のスピーカを用いたステレオ音源の再生は困難である。しかし、パラメトリックスピーカは高い指向性を備えるため、特定のスポットにおける音声の復元(音源の可聴化)が可能である。そこで、複数のパラメトリックスピーカを使用することで、実用上求められる音圧を確保すると共に、それらを並べることでスピーカの設置に必要な面積を小さくする。さらに、パラメトリックスピーカアレイの領域を第1及び第2の領域に分離し、それぞれの領域にLチャンネル用のオーディオ信号とRチャンネル用のオーディオ信号の再生を担当させる。その結果、第1の領域に含まれるパラメトリックスピーカからは左耳に向けて音波が放射され、第2の領域に含まれるパラメトリックスピーカからは右耳に向けて音波が放射される。すると、パラメトリックスピーカの持つ高い指向性から、左右の可聴音における混在は少なく、ユーザは音像の左右定位を明確に感じ取ることができる。 As described above, the size of the housing of an electronic device such as a smartphone is limited. Therefore, reproduction of a stereo sound source using a normal speaker is difficult. However, since the parametric speaker has high directivity, it is possible to restore sound (sound source audible) at a specific spot. Therefore, by using a plurality of parametric speakers, the sound pressure required for practical use is secured, and by arranging them, the area required for installing the speakers is reduced. Further, the area of the parametric speaker array is divided into first and second areas, and the reproduction of the L channel audio signal and the R channel audio signal is assigned to each area. As a result, sound waves are emitted toward the left ear from the parametric speaker included in the first region, and sound waves are emitted toward the right ear from the parametric speaker included in the second region. Then, due to the high directivity of the parametric speaker, there is little mixing in the left and right audible sounds, and the user can clearly sense the left and right localization of the sound image.
 次に、具体的な実施形態の説明に先立ち、パラメトリックスピーカを含む音響システムについて説明する。 Next, prior to the description of a specific embodiment, an acoustic system including a parametric speaker will be described.
 図2は、パラメトリックスピーカ10の断面の一例を示す図である。図2を参照すると、パラメトリックスピーカ10は、圧電素子11と金属板12を貼り合わせた振動板に金属コーン13を接着することで構成される。金属板12と金属コーン13の接着に、接着剤14を使用する。また、振動板は、弾性材15を介して、フレーム16に固定される。振動板を振動させるための信号は、端子17から供給される。 FIG. 2 is a diagram showing an example of a cross section of the parametric speaker 10. Referring to FIG. 2, the parametric speaker 10 is configured by adhering a metal cone 13 to a vibration plate in which a piezoelectric element 11 and a metal plate 12 are bonded. An adhesive 14 is used for bonding the metal plate 12 and the metal cone 13. The diaphragm is fixed to the frame 16 via the elastic material 15. A signal for vibrating the diaphragm is supplied from the terminal 17.
 図3は、複数のパラメトリックスピーカ10をアレイ状に並べたパラメトリックスピーカアレイ20の一例を示す図である。図3に示すパラメトリックスピーカアレイ20は、16個のパラメトリックスピーカ10を横に8個、縦に2個並べて形成されている。 FIG. 3 is a diagram showing an example of a parametric speaker array 20 in which a plurality of parametric speakers 10 are arranged in an array. The parametric speaker array 20 shown in FIG. 3 is formed by arranging sixteen parametric speakers 10 horizontally and two vertically.
 上述したように、パラメトリックスピーカは極めて高い指向性を備えている。パラメトリックスピーカが高い指向性を示すことは、図5の音圧分布図から理解できる。なお、図5の詳細については後述する。 As described above, parametric speakers have extremely high directivity. It can be understood from the sound pressure distribution diagram of FIG. 5 that the parametric speaker exhibits high directivity. Details of FIG. 5 will be described later.
 次に、パラメトリックスピーカアレイ20を含む音響システムの構成について説明する。図4は、パラメトリックスピーカアレイ20を含む音響システムの構成の一例を示す図である。なお、図4に示す音響システムは、モノラル音源の再生を前提としている。 Next, the configuration of an acoustic system including the parametric speaker array 20 will be described. FIG. 4 is a diagram illustrating an example of the configuration of an acoustic system including the parametric speaker array 20. Note that the sound system shown in FIG. 4 is based on the reproduction of a monaural sound source.
 音響システムは、CPU(Central Processing Unit)30と、DSP(Digital Signal Processor)40と、DA(Digital to Analog)変換器50と、オーディオアンプ60と、パラメトリックスピーカアレイ20と、を含んで構成される。パラメトリックスピーカアレイ20は、図4に示す各モジュール(回路ブロック)により、駆動される。 The acoustic system includes a CPU (Central Processing Unit) 30, a DSP (Digital Signal Processing) 40, a DA (Digital Signal Processing) converter 50, an audio amplifier 60, and a parametric speaker array 20. . The parametric speaker array 20 is driven by each module (circuit block) shown in FIG.
 さらに、CPU30は、データローダ31と、デコーダ32と、を含んでいる。データローダ31は、外部のストレージ(例えば、SDカード、ハードディスク、フラッシュメモリ等)からオーディオ信号を読み込む手段である。なお、外部のストレージに記憶されたオーディオ信号は、MPEG(Moving Picture Experts Group)等により圧縮されている場合が多い。このような圧縮されたオーディオ信号をデコードする手段が、デコーダ32である。CPU30は、オーディオ信号をDSP40に出力する。 Further, the CPU 30 includes a data loader 31 and a decoder 32. The data loader 31 is means for reading an audio signal from an external storage (for example, an SD card, a hard disk, a flash memory, etc.). Note that audio signals stored in an external storage are often compressed by MPEG (Moving / Pictures / Experts / Group) or the like. A means for decoding such a compressed audio signal is the decoder 32. The CPU 30 outputs an audio signal to the DSP 40.
 DSP40は、アップサンプリング部41と、超音波搬送波生成部42と、変調処理部43と、を含んでいる。 The DSP 40 includes an upsampling unit 41, an ultrasonic carrier wave generation unit 42, and a modulation processing unit 43.
 DSP40では、アップサンプリング部41を使用して、デコーダ32がデコードしたオーディオ信号をアップサンプリングする。SDカード等に格納されているオーディオ信号は、48kHz以下のサンプリングレートが使用されることが多い。そのため、アップサンプリング部41において、例えば、192kHzや96kHzといった48kHzよりも高い周波数へアップサンプリングする必要がある。その理由は、可聴帯域より高い周波数領域(例えば、40kHz以上)である超音波領域の搬送波を使用するためである。なお、以降の説明において、超音波領域の搬送波を超音波搬送波と表記する。 The DSP 40 uses the upsampling unit 41 to upsample the audio signal decoded by the decoder 32. A sampling rate of 48 kHz or less is often used for audio signals stored in an SD card or the like. Therefore, the upsampling unit 41 needs to upsample to a frequency higher than 48 kHz such as 192 kHz or 96 kHz. The reason is that a carrier wave in an ultrasonic region that is a frequency region higher than the audible band (for example, 40 kHz or more) is used. In the following description, the carrier in the ultrasonic region is referred to as an ultrasonic carrier.
 また、192kHz及び96kHzのいずれかをサンプリングレートとして選択するかを判断する際には、サンプリングレートのナイキスト周波数を考慮する。より具体的には、超音波搬送波の周波数がサンプリングレートのナイキスト周波数に対して十分な余裕を持ちつつ、かつ、ナイキスト周波数以下となるようなサンプリングレートを選択する。 Also, when determining whether to select either 192 kHz or 96 kHz as the sampling rate, the Nyquist frequency of the sampling rate is considered. More specifically, the sampling rate is selected such that the frequency of the ultrasonic carrier wave has a sufficient margin with respect to the Nyquist frequency of the sampling rate and is equal to or lower than the Nyquist frequency.
 変調処理部43は、アップサンプリングされたオーディオ信号により超音波搬送波生成部42が生成する超音波搬送波を変調する。その際の変調方式には、例えば、FM(Frequency modulation)、AM(Amplitude modulation)、SSB(Single side band modulation)等を使用することができる。DSP40は、変調処理部43により変調された信号を、DA変換器50に出力する。 The modulation processor 43 modulates the ultrasonic carrier wave generated by the ultrasonic carrier wave generator 42 with the upsampled audio signal. For example, FM (Frequency modulation), AM (Amplitude modulation), SSB (Single side band modulation), or the like can be used as the modulation method at that time. The DSP 40 outputs the signal modulated by the modulation processing unit 43 to the DA converter 50.
 DA変換器50は、受け付けた信号をアナログ信号に変換し、オーディオアンプ60に出力する。 The DA converter 50 converts the received signal into an analog signal and outputs it to the audio amplifier 60.
 オーディオアンプ60は、アナログ信号に変換された変調信号を適切な電力に増幅し、パラメトリックスピーカアレイ20に供給する。パラメトリックスピーカアレイ20は、オーディオアンプ60により駆動され、音波が空間に放射される。 The audio amplifier 60 amplifies the modulated signal converted into the analog signal to an appropriate power and supplies it to the parametric speaker array 20. The parametric speaker array 20 is driven by the audio amplifier 60, and sound waves are radiated into the space.
 なお、オーディオアンプ60がデジタルアンプ(例えば、D級アンプ)の場合には、デジタルアンプの発振周波数を除去するためにローパスフィルタ(図示せず)をオーディオアンプ60とパラメトリックスピーカアレイ20の間に挿入する。 When the audio amplifier 60 is a digital amplifier (for example, a class D amplifier), a low pass filter (not shown) is inserted between the audio amplifier 60 and the parametric speaker array 20 in order to remove the oscillation frequency of the digital amplifier. To do.
 図5は、図4に示す音響システムにおいて、パラメトリックスピーカアレイ20から超音波搬送波を放射した際の音圧分布の一例を示す図である。図5では、パラメトリックスピーカアレイ20を図の中心に配置し、2次元空間上での音圧分布を色の濃淡で表現している。色彩の濃い領域の方が、色彩の薄い領域よりも音圧が高いことを示す。 FIG. 5 is a diagram showing an example of a sound pressure distribution when an ultrasonic carrier wave is radiated from the parametric speaker array 20 in the acoustic system shown in FIG. In FIG. 5, the parametric speaker array 20 is arranged at the center of the figure, and the sound pressure distribution in the two-dimensional space is expressed by color shading. It shows that the sound pressure is higher in the darker region than in the lighter region.
 図5を参照すると、パラメトリックスピーカアレイ20が向く方向(図5のY軸方向)に強い指向性を確認することができる。なお、パラメトリックスピーカアレイ20を駆動する条件は、例えば、以下の通りとする。
・超音波搬送波の周波数は80kHzとする。
・パラメトリックスピーカアレイ20のサイズは、1.8cm×7.2cmとする。
・超音波の放射面は図5のY軸方向(図5の上方)とする。
Referring to FIG. 5, strong directivity can be confirmed in the direction in which the parametric speaker array 20 faces (Y-axis direction in FIG. 5). The conditions for driving the parametric speaker array 20 are, for example, as follows.
・ The frequency of the ultrasonic carrier wave is 80 kHz.
-The size of the parametric speaker array 20 shall be 1.8 cm x 7.2 cm.
The ultrasonic wave emission surface is in the Y-axis direction in FIG. 5 (upward in FIG. 5).
 ここで、パラメトリックスピーカアレイ20を構成する個々のパラメトリックスピーカ10から放射される音波は、超音波搬送波をCPU30が出力するオーディオ信号を使って変調するものである。そのため、超音波搬送波の周波数以外のフーリエ成分が含まれる。しかし、AM変調、FM変調又はSSB変調の変調方式において、パラメトリックスピーカ10の駆動に適した変調パラメータ(例えば、変調度、変調指数)を使用することにより、搬送波以外のフーリエ成分のエネルギーを、搬送波のエネルギーの1/5以下とすることができる。そのため、超音波搬送波の指向性を、変調波全体の指向性として捉えることができる。 Here, the sound waves radiated from the individual parametric speakers 10 constituting the parametric speaker array 20 modulate an ultrasonic carrier wave using an audio signal output from the CPU 30. Therefore, Fourier components other than the frequency of the ultrasonic carrier wave are included. However, in the modulation method of AM modulation, FM modulation, or SSB modulation, by using a modulation parameter (for example, modulation degree, modulation index) suitable for driving the parametric speaker 10, energy of Fourier components other than the carrier wave is converted to the carrier wave. 1/5 or less of the energy. Therefore, the directivity of the ultrasonic carrier wave can be understood as the directivity of the entire modulated wave.
 図5において、領域200は、他の領域よりも10dB以上、超音波搬送波の音圧が高い領域である。そのため、領域200は、ほぼそのまま可聴音の復調が起こる領域といえる。なお、パラメトリックスピーカアレイ20に含まれるパラメトリックスピーカ10の全てに同じ信号を入力すると、図5に示すようにモノラルの可聴音がユーザには聞き取られることになる。 In FIG. 5, a region 200 is a region where the sound pressure of the ultrasonic carrier wave is higher than that of other regions by 10 dB or more. Therefore, it can be said that the region 200 is a region where the audible sound is demodulated almost as it is. If the same signal is input to all of the parametric speakers 10 included in the parametric speaker array 20, a monaural audible sound is heard by the user as shown in FIG.
 以下に具体的な実施の形態について、図面を参照してさらに詳しく説明する。 Hereinafter, specific embodiments will be described in more detail with reference to the drawings.
[第1の実施形態]
 第1の実施形態について、図面を用いてより詳細に説明する。
[First Embodiment]
The first embodiment will be described in more detail with reference to the drawings.
 本実施形態に係る音響システムでは、ステレオ音源のオーディオ信号を、高い指向性(狭指向性)で可聴音に復調する場合において、音源から与えられるステレオの音像に対して、良好な左右のパンニング(左右の高い音像定位)を実現する。 In the acoustic system according to the present embodiment, when the audio signal of a stereo sound source is demodulated to an audible sound with high directivity (narrow directivity), good left and right panning ( Realize high sound image localization on the left and right.
 本実施形態に係る音響システムは、複数のパラメトリックスピーカ10を図3に示すようなアレイ状に配置したパラメトリックスピーカアレイ20を使用する。パラメトリックスピーカアレイ20は、例えば、スマートフォン等に用いられる基板上に(平面上に)、実装される。パラメトリックスピーカアレイ20を構成するパラメトリックスピーカ10の個数は任意とすることができるが、実装面積やコスト等を考慮して50個以下とするのが好ましい。 The acoustic system according to the present embodiment uses a parametric speaker array 20 in which a plurality of parametric speakers 10 are arranged in an array as shown in FIG. The parametric speaker array 20 is mounted on a substrate (on a plane) used for a smartphone or the like, for example. The number of parametric speakers 10 constituting the parametric speaker array 20 may be arbitrary, but is preferably 50 or less in consideration of mounting area, cost, and the like.
 例えば、図3に示すように、16個のパラメトリックスピーカ10を含むパラメトリックスピーカアレイ20を使用する場合を考える。この場合、16個のパラメトリックスピーカ10のうち、左半分の8個のパラメトリックスピーカ10にはLチャンネルを、右半分の8個のパラメトリックスピーカ10にはRチャンネルを、それぞれ最終的な超音波放射源として使用する。即ち、パラメトリックスピーカアレイの第1及び第2の領域に分割し、それぞれの領域にLチャンネル及びRチャンネルのオーディオ信号の再生を担当させる。 For example, consider the case of using a parametric speaker array 20 including 16 parametric speakers 10 as shown in FIG. In this case, among the 16 parametric speakers 10, the left half 8 parametric speakers 10 have an L channel, the right half 8 parametric speakers 10 have an R channel, and the final ultrasonic radiation source. Use as That is, the parametric loudspeaker array is divided into first and second areas, and the respective areas are assigned to play audio signals of the L channel and the R channel.
 図6は、音圧分布図の一例を示す図である。図6は、右半分、即ち、8個のRチャンネル用のパラメトリックスピーカ10から、80kHzの超音波搬送波を放射した場合の音圧分布を示している。図6を参照すると、Rチャンネル用のパラメトリックスピーカの正面(図6では上側)に、超音波の可聴帯域201(他の領域よりも超音波搬送波の音圧が10dB程高い領域)が形成されることが分かる。即ち、図6は、LチャンネルとRチャンネルの変調波は、左右に分離(LR分離)できることを示し、可聴帯域におけるステレオ音源の分離が可能であることを示している。 FIG. 6 is a diagram showing an example of a sound pressure distribution diagram. FIG. 6 shows a sound pressure distribution when an ultrasonic carrier wave of 80 kHz is radiated from the right half, that is, eight R channel parametric speakers 10. Referring to FIG. 6, an ultrasonic audible band 201 (a region where the sound pressure of the ultrasonic carrier is about 10 dB higher than other regions) is formed in front of the parametric speaker for the R channel (upper side in FIG. 6). I understand that. That is, FIG. 6 shows that the modulated waves of the L channel and the R channel can be separated into left and right (LR separation), and it is possible to separate stereo sound sources in the audible band.
 さらに、ステレオ音源の分離は、携帯電話、タブレット端末、スマートフォン又はテレビジョン装置等に搭載されたステレオをスピーカと比較して、極めて明瞭であることが発明者らの検討により判明している。より詳細には、ヘッドフォンを使用してステレオ音源を視聴する場合に近い。 Further, it has been found by the inventors that the stereo sound source separation is extremely clear when the stereo mounted on a mobile phone, a tablet terminal, a smartphone or a television device is compared with a speaker. More specifically, it is close to the case where a stereo sound source is viewed using headphones.
 図7は、本実施形態に係る音響システムの内部構成の一例を示す図である。図7に示す音響システムにおいては、音源の読み出しからパラメトリックスピーカの駆動までがステレオ処理されている。この点が、図4に示す音響システムと図7に示す音響システムの相違点である。 FIG. 7 is a diagram illustrating an example of the internal configuration of the acoustic system according to the present embodiment. In the acoustic system shown in FIG. 7, stereo processing is performed from reading of a sound source to driving of a parametric speaker. This is the difference between the acoustic system shown in FIG. 4 and the acoustic system shown in FIG.
 図7のCPU30aは、内部のモジュール(データローダ31a及びデコーダ32a)がステレオ音源に対応している点を除けば、CPU30と相違する点は存在しないので、さらなる説明を省略する。また、DA変換器50-1及び50-2、オーディオアンプ60-1及び60-2、パラメトリックスピーカアレイ20-1及び20-2についても、それぞれステレオ音源に対応して設けられたモジュールであって、それぞれ単体の機能は既に説明したモジュールと相違しないので、さらなる説明を省略する。なお、オーディオアンプ60-1は、パラメトリックスピーカアレイ20-1に含まれるパラメトリックスピーカを共通して駆動する形態であってもよいし、パラメトリックスピーカを個別に駆動する形態でもよい。オーディオアンプ60-2についても同様である。 7 is not different from the CPU 30 except that the internal modules (the data loader 31a and the decoder 32a) are compatible with stereo sound sources, and further description thereof is omitted. The DA converters 50-1 and 50-2, the audio amplifiers 60-1 and 60-2, and the parametric speaker arrays 20-1 and 20-2 are also modules provided corresponding to stereo sound sources, respectively. Since the individual functions are not different from the modules already described, further description is omitted. The audio amplifier 60-1 may be configured to drive the parametric speakers included in the parametric speaker array 20-1 in common, or may be configured to individually drive the parametric speakers. The same applies to the audio amplifier 60-2.
 DSP40aについても、ステレオ音源に対応するように、構成されている。アップサンプリング部41は、ステレオのオーディオ信号について、アップサンプリングを実行する。アップサンプリングされた左右それぞれのオーディオ信号は、変調処理部43-1及び43-2により、それぞれ変調処理が施される。なお、DSP40aが、上述のデジタル信号処理装置103に相当する。 The DSP 40a is also configured to support a stereo sound source. The upsampling unit 41 performs upsampling on a stereo audio signal. The left and right up-sampled audio signals are respectively subjected to modulation processing by the modulation processing units 43-1 and 43-2. The DSP 40a corresponds to the digital signal processing device 103 described above.
 変調処理部43-1により変調された信号は、乗算器44-1及び44-4に出力される。変調処理部43-2により変調された信号は、乗算器44-2及び44-3に出力される。乗算器44-1~44-4のそれぞれが持つ乗算係数は、以下の通りである。
・乗算器44-1は、Xの乗算係数を備える。
・乗算器44-2は、1-Xの乗算係数を備える。
・乗算器44-3は、Xの乗算係数を備える。
・乗算器44-4は、1-Xの乗算係数を備える。
 このように、乗算器44-1~44-4では、アップサンプリングされたステレオのオーディオ信号の振幅に対して、所定の係数を乗算する。なお、X及びXは、パンニングを制御するパラメータと捉えることができる。
The signal modulated by the modulation processing unit 43-1 is output to the multipliers 44-1 and 44-4. The signal modulated by the modulation processing unit 43-2 is output to the multipliers 44-2 and 44-3. The multiplication coefficients of the multipliers 44-1 to 44-4 are as follows.
- multiplier 44-1 comprises a multiplier factor of X L.
Multiplier 44-2 includes a multiplier coefficient 1-X L.
Multiplier 44-3 includes a multiplier coefficient X R.
Multiplier 44-4 includes a multiplier coefficient 1-X R.
In this way, the multipliers 44-1 to 44-4 multiply the amplitude of the upsampled stereo audio signal by a predetermined coefficient. X L and X R can be regarded as parameters for controlling panning.
 乗算器44-1及び44-2による演算結果は、加算器45-1に送られる。乗算器44-3及び44-4による演算結果は、加算器45-2に送られる。加算器45-1の演算結果は、Lチャンネル用の変調信号としてDA変換器50-1に出力される。加算器45-2の演算結果は、Rチャンネル用の変調信号としてDA変換器50-2に出力される。なお、Lチャンネル用の変調信号が上述の第1の変調信号に相当し、Rチャンネル用の変調信号が上述の第2の変調信号に相当する。 The calculation results by the multipliers 44-1 and 44-2 are sent to the adder 45-1. The calculation results by the multipliers 44-3 and 44-4 are sent to the adder 45-2. The calculation result of the adder 45-1 is output to the DA converter 50-1 as a modulation signal for the L channel. The calculation result of the adder 45-2 is output to the DA converter 50-2 as a modulation signal for the R channel. The L channel modulation signal corresponds to the first modulation signal described above, and the R channel modulation signal corresponds to the second modulation signal described above.
 DSP40aにおける処理は、以下の式(1)により表現することができる。

Figure JPOXMLDOC01-appb-I000001

 
 なお、U及びUは、DSP40aに対する入力信号である。Y及びYは、DSP40aからの出力信号である。式(1)を参照すると、X及びXの値に応じて、音源のパンニングを制御できることが理解される。
The processing in the DSP 40a can be expressed by the following equation (1).

Figure JPOXMLDOC01-appb-I000001


Incidentally, U L and U R are input signals to DSP40a. Y L and Y R are the output signals from the DSP40a. Referring to equation (1), according to the value of X L and X R, it is understood that can control the panning of the sound source.
 DSP40aは、式(1)に従って、パラメトリックスピーカアレイ20-1及び20-2を駆動するオーディオアンプ60-1及び60-2に供給する変調信号を生成する。 The DSP 40a generates a modulation signal to be supplied to the audio amplifiers 60-1 and 60-2 that drive the parametric speaker arrays 20-1 and 20-2 according to the equation (1).
 パラメトリックスピーカアレイ20-1及び20-2により再現される音像の定位は、式(1)におけるX及びXを変化させることで調整(制御)可能である。なお、X及びXの値を変化させる範囲は、1/2≦X、X≦1とする。例えば、X及びXを共に「1」とすれば、音源に忠実なステレオ信号として音像が定位する。また、X及びXを共に「1/2」とすれば、モノラルの音源のように音像が定位する。 Localization of a sound image to be reproduced by a parametric speaker array 20-1 and 20-2 are adjustable (controlled) by changing the X L and X R in Formula (1). The range of changing the value of X L and X R is, 1/2 ≦ X L, and X R ≦ 1. For example, when the both X L and X R "1", the sound image is localized as faithful stereo signals to the sound source. Also, if both X L and X R "1/2", the sound image as in the monophonic sound source is localized.
 また、図7に示す音響システムを内部に含む携帯電話やスマートフォン等の電子機器においては、電子機器全体を制御する制御部を備えるのが通常である。DSP40aは、外部から内部係数の変更が可能に構成されており、電子機器の制御部が乗算器44-1~44-4の乗算係数を変更することができる。そのため、電子機器で再生するコンテンツの種別等に連動させて、係数を変更するのが好ましい。例えば、電子機器が使用されている状況に応じて、ステレオ音源を忠実に再現するような音像定位をユーザに提供したり、ステレオ音源をモノラル音源に近い形でユーザに提供したりすることができる。 Further, in an electronic device such as a mobile phone or a smartphone that includes the acoustic system shown in FIG. 7, it is usual to include a control unit that controls the entire electronic device. The DSP 40a is configured to be able to change the internal coefficient from the outside, and the control unit of the electronic device can change the multiplication coefficient of the multipliers 44-1 to 44-4. For this reason, it is preferable to change the coefficient in conjunction with the type of content to be played back on the electronic device. For example, it is possible to provide a user with sound image localization that faithfully reproduces a stereo sound source, or to provide a stereo sound source to the user in a form close to a monaural sound source, depending on the situation in which the electronic device is used. .
 あるいは、音声だけではなく、ディスプレイに表示される動画に連動して、係数を変化させてパンニング(音像定位)を制御することもできる。 Alternatively, panning (sound image localization) can be controlled by changing the coefficient in conjunction with the moving image displayed on the display as well as the sound.
 なお、図7に示すDSP40aの内部構成は一例であって、DSP40aの構成を限定する趣旨ではない。図8に示すように、式(1)に相当する処理を実行(乗算器44-1~44-4と加算器45-1及び45-2による演算)した後に、ステレオのオーディオ信号を変調してもよい。 Note that the internal configuration of the DSP 40a shown in FIG. 7 is an example, and is not intended to limit the configuration of the DSP 40a. As shown in FIG. 8, the processing corresponding to Equation (1) is executed (calculations by multipliers 44-1 to 44-4 and adders 45-1 and 45-2), and then the stereo audio signal is modulated. May be.
 あるいは、音源がステレオではなく、マルチチャンネルの音源の場合が想定できる。例えば、特定の音を左右の定位の中にレンダリングする場合がある。 Alternatively, it can be assumed that the sound source is not a stereo but a multi-channel sound source. For example, a specific sound may be rendered in the left and right localization.
 図9は、マルチチャンネルに対応する音響システムの内部構成の一例を示す図である。図9において、データローダ31b、デコーダ32b、アップサンプリング部41a及び変調処理部43aの各モジュールをマルチチャンネルの音源に対応させる。その上で、下記の式(2)の処理を実行するLRミキサー46により、Lチャンネル用の変調信号とRチャンネル用の変調信号を生成すればよい。

Figure JPOXMLDOC01-appb-I000002


 なお、a1~an及びb1~bn(但し、nは自然数)は、変調信号を生成する際に入力信号U1~Unを混合(ミキシング)する際に乗じる係数である。
FIG. 9 is a diagram illustrating an example of an internal configuration of an acoustic system that supports multi-channel. In FIG. 9, each module of the data loader 31b, the decoder 32b, the upsampling unit 41a, and the modulation processing unit 43a is associated with a multi-channel sound source. Then, the L channel modulation signal and the R channel modulation signal may be generated by the LR mixer 46 that executes the processing of the following equation (2).

Figure JPOXMLDOC01-appb-I000002


Note that a1 to an and b1 to bn (where n is a natural number) are coefficients that are multiplied when mixing (mixing) the input signals U1 to Un when generating a modulation signal.
 本実施形態に係る音響システムは、携帯電話、ポータブルオーディオプレイヤー、テレビジョン装置、タブレット端末、ゲーム機等の電子機器に搭載することができる。 The acoustic system according to the present embodiment can be mounted on electronic devices such as a mobile phone, a portable audio player, a television device, a tablet terminal, and a game machine.
 以上のように、複数のパラメトリックスピーカからなるパラメトリックスピーカアレイの領域を、Lチャンネル用の領域とRチャンネル用の領域に分離する。さらに、分離されたそれぞれの領域に含まれるパラメトリックスピーカを駆動するための変調信号を、ステレオ音源から生成するとともに、パラメトリックスピーカアレイから放射される音波の指向性を、DSPを使用して制御する。その結果、ステレオ音源を持つコンテンツを再生した際に、音像の左右定位が明確に感じとれることに寄与する音響システム及び電子機器が提供できる。 As described above, the region of the parametric speaker array composed of a plurality of parametric speakers is separated into an L channel region and an R channel region. Further, a modulation signal for driving the parametric speaker included in each separated region is generated from the stereo sound source, and the directivity of the sound wave radiated from the parametric speaker array is controlled using the DSP. As a result, it is possible to provide an acoustic system and an electronic device that contribute to clearly feeling the left and right localization of a sound image when content having a stereo sound source is reproduced.
 上記の実施形態の一部又は全部は、以下の付記のようにも記載され得るが、以下には限られない。 Some or all of the above embodiments may be described as in the following supplementary notes, but are not limited to the following.
 [付記1]
 上記第1の視点に係る音響システムのとおりである。
 [付記2]
 前記デジタル信号処理装置は、
 前記第1の変調信号を、前記複数のオーディオ信号に含まれる第1のオーディオ信号の振幅に第1の係数を乗算した結果と、前記複数のオーディオ信号に含まれる第2のオーディオ信号の振幅に第2の係数を乗算した結果と、を加算することで生成する共に、
 前記第2の変調信号を、前記第1のオーディオ信号の振幅に第3の係数を乗算した結果と、前記第2のオーディオ信号の振幅に第4の係数を乗算した結果と、を加算することで生成する付記1の音響システム。
 [付記3]
 前記デジタル信号処理装置は、
 前記複数のオーディオ信号を、超音波領域のサンプリングレートにアップサンプリングすると共に、前記アップサンプリングされた複数のオーディオ信号に基づき、前記超音波領域の搬送波を変調する付記1又は2の音響システム。
 [付記4]
 前記第1乃至第4の係数は、前記デジタル信号処理装置の外部から変更可能である付記2又は3の音響システム。
 [付記5]
 前記第1及び第3の係数の値は、それぞれ0.5以上かつ1以下である付記2乃至4のいずれか一に記載の音響システム。
 [付記6]
 前記デジタル信号処理装置は、
 前記複数のオーディオ信号のそれぞれに対して所定の係数を乗算し、前記乗算の結果をそれぞれ加算することで、前記第1及び第2の変調信号を生成する付記1の音響システム。
 [付記7]
 上記第2の視点に係る電子機器のとおりである。
[Appendix 1]
The sound system according to the first aspect is as described above.
[Appendix 2]
The digital signal processing device includes:
The result of multiplying the first modulated signal by the first coefficient to the amplitude of the first audio signal included in the plurality of audio signals and the amplitude of the second audio signal included in the plurality of audio signals. A result obtained by multiplying the second coefficient is added to
Adding the result of multiplying the amplitude of the first audio signal by a third coefficient to the amplitude of the first audio signal and the result of multiplying the amplitude of the second audio signal by a fourth coefficient. The acoustic system of Supplementary Note 1 generated by
[Appendix 3]
The digital signal processing device includes:
The acoustic system according to appendix 1 or 2, wherein the plurality of audio signals are up-sampled to a sampling rate in an ultrasonic region, and a carrier wave in the ultrasonic region is modulated based on the plurality of up-sampled audio signals.
[Appendix 4]
The acoustic system according to appendix 2 or 3, wherein the first to fourth coefficients can be changed from outside the digital signal processing device.
[Appendix 5]
The acoustic system according to any one of appendices 2 to 4, wherein the values of the first and third coefficients are 0.5 or more and 1 or less, respectively.
[Appendix 6]
The digital signal processing device includes:
The acoustic system according to appendix 1, wherein the first and second modulated signals are generated by multiplying each of the plurality of audio signals by a predetermined coefficient and adding the multiplication results.
[Appendix 7]
As in the electronic apparatus according to the second aspect.
 なお、引用した上記の特許文献の開示は、本書に引用をもって繰り込むものとする。本発明の全開示(請求の範囲を含む)の枠内において、さらにその基本的技術思想に基づいて、実施形態ないし実施例の変更・調整が可能である。また、本発明の請求の範囲の枠内において種々の開示要素(各請求項の各要素、各実施形態ないし実施例の各要素、各図面の各要素等を含む)の多様な組み合わせ、ないし、選択が可能である。すなわち、本発明は、請求の範囲を含む全開示、技術的思想にしたがって当業者であればなし得るであろう各種変形、修正を含むことは勿論である。特に、本書に記載した数値範囲については、当該範囲内に含まれる任意の数値ないし小範囲が、別段の記載のない場合でも具体的に記載されているものと解釈されるべきである。 In addition, the disclosure of the cited patent document is incorporated herein by reference. Within the scope of the entire disclosure (including claims) of the present invention, the embodiments and examples can be changed and adjusted based on the basic technical concept. Various disclosed elements (including each element of each claim, each element of each embodiment or example, each element of each drawing, etc.) within the scope of the claims of the present invention, Selection is possible. That is, the present invention of course includes various variations and modifications that could be made by those skilled in the art according to the entire disclosure including the claims and the technical idea. In particular, with respect to the numerical ranges described in this document, any numerical value or small range included in the range should be construed as being specifically described even if there is no specific description.
10 パラメトリックスピーカ
11 圧電素子
12 金属板
13 金属コーン
14 接着剤
15 弾性材
16 フレーム
17 端子
20、20-1、20-2、100 パラメトリックスピーカアレイ
30、30a、30b CPU(Central Processing Unit)
31、31a、31b データローダ
32、32a、32b デコーダ
40、40a、40b DSP(Digital Signal Processor)
41、41a アップサンプリング部
42 超音波搬送波生成部
43、43-1、43-2、43a 変調処理部
44-1~44-4 乗算器
45-1、45-2 加算器
46 LRミキサー
50、50-1、50-2 DA変換器
60、60-1、60-2 オーディオアンプ
101、102 アンプ
103 デジタル信号処理装置
200、201 領域
DESCRIPTION OF SYMBOLS 10 Parametric speaker 11 Piezoelectric element 12 Metal plate 13 Metal cone 14 Adhesive 15 Elastic material 16 Frame 17 Terminal 20, 20-1, 20-2, 100 Parametric speaker array 30, 30a, 30b CPU (Central Processing Unit)
31, 31a, 31b Data loader 32, 32a, 32b Decoder 40, 40a, 40b DSP (Digital Signal Processor)
41, 41a Upsampling unit 42 Ultrasonic carrier wave generating units 43, 43-1, 43-2, 43a Modulation processing units 44-1 to 44-4 Multipliers 45-1, 45-2 Adder 46 LR mixers 50, 50 -1, 50-2 DA converters 60, 60-1, 60-2 Audio amplifier 101, 102 Amplifier 103 Digital signal processing device 200, 201

Claims (7)

  1.  複数のパラメトリックスピーカを含んで構成されるパラメトリックスピーカアレイと、
     前記パラメトリックスピーカアレイの第1の領域に含まれるパラメトリックスピーカを駆動する第1のアンプと、
     前記パラメトリックスピーカアレイの第2の領域に含まれるパラメトリックスピーカを駆動する第2のアンプと、
     複数のオーディオ信号に基づいて、超音波領域の搬送波を変調することで、前記第1のアンプに供給する第1の変調信号と、前記第2のアンプに供給する第2の変調信号と、を生成するデジタル信号処理装置と、
     を含む音響システム。
    A parametric speaker array including a plurality of parametric speakers;
    A first amplifier for driving a parametric speaker included in the first region of the parametric speaker array;
    A second amplifier for driving a parametric speaker included in a second region of the parametric speaker array;
    A first modulation signal supplied to the first amplifier and a second modulation signal supplied to the second amplifier by modulating a carrier wave in the ultrasonic region based on a plurality of audio signals. A digital signal processing device to generate;
    Including acoustic system.
  2.  前記デジタル信号処理装置は、
     前記第1の変調信号を、前記複数のオーディオ信号に含まれる第1のオーディオ信号の振幅に第1の係数を乗算した結果と、前記複数のオーディオ信号に含まれる第2のオーディオ信号の振幅に第2の係数を乗算した結果と、を加算することで生成する共に、
     前記第2の変調信号を、前記第1のオーディオ信号の振幅に第3の係数を乗算した結果と、前記第2のオーディオ信号の振幅に第4の係数を乗算した結果と、を加算することで生成する請求項1の音響システム。
    The digital signal processing device includes:
    The result of multiplying the first modulated signal by the first coefficient to the amplitude of the first audio signal included in the plurality of audio signals and the amplitude of the second audio signal included in the plurality of audio signals. A result obtained by multiplying the second coefficient is added to
    Adding the result of multiplying the amplitude of the first audio signal by a third coefficient to the amplitude of the first audio signal and the result of multiplying the amplitude of the second audio signal by a fourth coefficient. The acoustic system according to claim 1, which is generated by:
  3.  前記デジタル信号処理装置は、
     前記複数のオーディオ信号を、超音波領域のサンプリングレートにアップサンプリングすると共に、前記アップサンプリングされた複数のオーディオ信号に基づき、前記超音波領域の搬送波を変調する請求項1又は2の音響システム。
    The digital signal processing device includes:
    The acoustic system according to claim 1 or 2, wherein the plurality of audio signals are up-sampled to a sampling rate of an ultrasonic region, and a carrier wave of the ultrasonic region is modulated based on the plurality of up-sampled audio signals.
  4.  前記第1乃至第4の係数は、前記デジタル信号処理装置の外部から変更可能である請求項2又は3の音響システム。 4. The acoustic system according to claim 2, wherein the first to fourth coefficients can be changed from outside the digital signal processing device.
  5.  前記第1及び第3の係数の値は、それぞれ0.5以上かつ1以下である請求項2乃至4のいずれか一項に記載の音響システム。 The acoustic system according to any one of claims 2 to 4, wherein the values of the first and third coefficients are 0.5 or more and 1 or less, respectively.
  6.  前記デジタル信号処理装置は、
     前記複数のオーディオ信号のそれぞれに対して所定の係数を乗算し、前記乗算の結果をそれぞれ加算することで、前記第1及び第2の変調信号を生成する請求項1の音響システム。
    The digital signal processing device includes:
    The acoustic system according to claim 1, wherein the first and second modulated signals are generated by multiplying each of the plurality of audio signals by a predetermined coefficient and adding the results of the multiplication.
  7.  請求項1乃至6のいずれか一項に記載の音響システムを含む電子機器。 Electronic equipment including the acoustic system according to any one of claims 1 to 6.
PCT/JP2013/080505 2012-11-13 2013-11-12 Sound system and electronic equipment WO2014077234A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2012-249068 2012-11-13
JP2012249068 2012-11-13

Publications (1)

Publication Number Publication Date
WO2014077234A1 true WO2014077234A1 (en) 2014-05-22

Family

ID=50731145

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2013/080505 WO2014077234A1 (en) 2012-11-13 2013-11-12 Sound system and electronic equipment

Country Status (1)

Country Link
WO (1) WO2014077234A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106856042A (en) * 2015-12-08 2017-06-16 北京师范大学 A kind of near field communication devices control method based on sound wave signals
SE2151000A1 (en) * 2021-08-13 2022-12-20 Myvox Ab Sound generator, computer-implemented method for producing sound information, computer program and non-volatile data carrier

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09298800A (en) * 1996-05-08 1997-11-18 Hitachi Ltd Acoustic sound reproducing device
JP2001025081A (en) * 1999-06-14 2001-01-26 Nokia Mobile Phones Ltd Audio equipment
JP2005286579A (en) * 2004-03-29 2005-10-13 Mitsubishi Electric Engineering Co Ltd Modulator for super-directive speaker
JP2012134589A (en) * 2010-12-20 2012-07-12 Nec Casio Mobile Communications Ltd Electronic device and oscillation unit

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09298800A (en) * 1996-05-08 1997-11-18 Hitachi Ltd Acoustic sound reproducing device
JP2001025081A (en) * 1999-06-14 2001-01-26 Nokia Mobile Phones Ltd Audio equipment
JP2005286579A (en) * 2004-03-29 2005-10-13 Mitsubishi Electric Engineering Co Ltd Modulator for super-directive speaker
JP2012134589A (en) * 2010-12-20 2012-07-12 Nec Casio Mobile Communications Ltd Electronic device and oscillation unit

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106856042A (en) * 2015-12-08 2017-06-16 北京师范大学 A kind of near field communication devices control method based on sound wave signals
SE2151000A1 (en) * 2021-08-13 2022-12-20 Myvox Ab Sound generator, computer-implemented method for producing sound information, computer program and non-volatile data carrier
SE544881C2 (en) * 2021-08-13 2022-12-20 Myvox Ab Sound generator, computer-implemented method for producing sound information, computer program and non-volatile data carrier
WO2023018365A1 (en) * 2021-08-13 2023-02-16 Myvox Ab Sound generator, computer-implemented method for producing sound information, computer program and non-volatile data carrier

Similar Documents

Publication Publication Date Title
US7873174B2 (en) Method of controlling output of ultrasonic speaker, ultrasonic speaker system, and display device
US9743186B2 (en) Sound reproduction device
US7068800B2 (en) Speaker apparatus
US8699731B2 (en) Apparatus and method for generating a low-frequency channel
CN106507251B (en) Stereo and FILTER TO CONTROL for multiple loudspeaker device
US9363597B1 (en) Distance-based audio processing for parametric speaker system
US20070296818A1 (en) Audio/visual Apparatus With Ultrasound
CN105917674A (en) Method and mobile device for processing an audio signal
JP2011010224A (en) Super-directivity speaker
JP2004193811A (en) Array speaker system with projection screen
JP4625671B2 (en) Audio signal reproduction method and reproduction apparatus therefor
JP2011211312A (en) Sound image localization processing apparatus and sound image localization processing method
US8553914B2 (en) Apparatus for reproduction of stereo sound
WO2014077234A1 (en) Sound system and electronic equipment
JP2009278498A (en) Flexible stereo speaker
WO2008010086A2 (en) Loudspeaker system and loudspeaker having a tweeter array and an audio signal processing unit
CN117643072A (en) Apparatus and method for generating a steering signal for a sound generator or generating an extended multi-channel audio signal using similarity analysis
WO2022034340A1 (en) Loudspeaker apparatus, loudspeaker system, display panel and systems thereof
US20150146898A1 (en) Sound field supporting device and sound field supporting system
JP2006352571A (en) Sound-reproducing system
TWI840740B (en) Microphone, method for recording an acoustic signal, reproduction apparatus for an acoustic signal or method for reproducing an acoustic signal
JP2017175417A (en) Acoustic reproducing device
JP2007158784A (en) Three dimensional sound reproducing device
Aarts Hardware for ambient sound reproduction
JP2008099164A (en) Electrostatic ultrasonic transducer, method for manufacturing the electrostatic ultrasonic transducer, ultrasonic speaker, display device and directional acoustic system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13855169

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13855169

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP