JP5582508B2 - Data transmitting apparatus, data receiving apparatus, data transmitting method, and data receiving method - Google Patents

Data transmitting apparatus, data receiving apparatus, data transmitting method, and data receiving method Download PDF

Info

Publication number
JP5582508B2
JP5582508B2 JP2011522894A JP2011522894A JP5582508B2 JP 5582508 B2 JP5582508 B2 JP 5582508B2 JP 2011522894 A JP2011522894 A JP 2011522894A JP 2011522894 A JP2011522894 A JP 2011522894A JP 5582508 B2 JP5582508 B2 JP 5582508B2
Authority
JP
Japan
Prior art keywords
data
frequency
audio signal
frequency band
acoustic communication
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2011522894A
Other languages
Japanese (ja)
Other versions
JP2011530939A (en
Inventor
グンファン チェ
ムンキ キム
ミュンソン パク
ミンソク キム
ナムス キム
ファンシク ユン
キホ チョ
Original Assignee
エスケーテレコム株式会社Sk Telecom Co.,Ltd.
ソウル ナショナル ユニバーシティ アールアンドディビー ファウンデーション
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to KR1020080080188A priority Critical patent/KR101034693B1/en
Priority to KR1020080080185A priority patent/KR101040888B1/en
Priority to KR10-2008-0080185 priority
Priority to KR10-2008-0080188 priority
Application filed by エスケーテレコム株式会社Sk Telecom Co.,Ltd., ソウル ナショナル ユニバーシティ アールアンドディビー ファウンデーション filed Critical エスケーテレコム株式会社Sk Telecom Co.,Ltd.
Priority to PCT/KR2009/003725 priority patent/WO2010018929A2/en
Publication of JP2011530939A publication Critical patent/JP2011530939A/en
Application granted granted Critical
Publication of JP5582508B2 publication Critical patent/JP5582508B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/00086Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
    • G11B20/00884Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving a watermark, i.e. a barely perceptible transformation of the original data which can nevertheless be recognised by an algorithm
    • G11B20/00891Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving a watermark, i.e. a barely perceptible transformation of the original data which can nevertheless be recognised by an algorithm embedded in audio data
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/018Audio watermarking, i.e. embedding inaudible data in the audio signal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H20/00Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/28Arrangements for simultaneous broadcast of plural pieces of information
    • H04H20/30Arrangements for simultaneous broadcast of plural pieces of information by a single channel
    • H04H20/31Arrangements for simultaneous broadcast of plural pieces of information by a single channel using in-band signals, e.g. subsonic or cue signal
    • HELECTRICITY
    • H03BASIC ELECTRONIC CIRCUITRY
    • H03GCONTROL OF AMPLIFICATION
    • H03G1/00Details of arrangements for controlling amplification
    • H03G1/02Remote control of amplification, tone, or bandwidth
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B10/00Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
    • H04B10/11Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
    • H04B10/114Indoor or close-range type systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04KSECRET COMMUNICATION; JAMMING OF COMMUNICATION
    • H04K1/00Secret communication
    • H04K1/02Secret communication by adding a second signal to make the desired signal unintelligible

Description

  The present invention relates to a technique for transmitting data in an audible frequency band. More specifically, the present invention relates to acoustic communication in an audible frequency band by additionally inputting data to be transmitted to an audio signal and transmitting the data in the audible frequency band. The present invention relates to a data transmission / reception system and method in an audible frequency band.

  As an audio signal transmission method, an analog audio signal transmission method is used in which infrared signals are frequency-modulated with an analog audio signal to generate a transmission signal and transmitted spatially. Such an analog audio signal transmission system is used, for example, for audio signal transmission between a CD player and a speaker.

  However, the analog audio signal transmission method has a problem that the sound quality is likely to deteriorate during transmission because the frequency of infrared light is modulated into an analog audio signal.

  In addition, the analog audio signal transmission method is difficult to include in the same transmission signal a digital control signal for adjusting the sound quality between the analog audio signal and the audio device. It must be transmitted separately from the signal.

  For this reason, audio signal transmission devices that can optically transmit digital audio signals with little deterioration in sound quality on the transmission path due to the above problems have been developed. Research is being actively conducted to efficiently transmit the signal itself.

  On the other hand, research is also underway on a method for inserting specific data into an audio signal and transmitting it to the receiving side. However, there is a problem that the audio signal is distorted by inserting data into the audio signal, Since there are many disturbing elements such as the problem of ease of work of inserting data efficiently and detecting it on the receiving side, it is limited to practically implement acoustic communication in the audible frequency band. was there. Therefore, there is a need for a method for overcoming such limitations.

  Accordingly, the present invention has been created to solve the above-described problems, and its purpose is to additionally input data to be transmitted to an audio signal and transmit it in an audible frequency band. An object of the present invention is to provide a data transmission / reception system and method in an audible frequency band for implementing acoustic communication in a band.

  Another object of the present invention is to provide a data transmission / reception system in an audible frequency band for minimizing the distortion of an audio signal so that humans cannot perceive acoustic communication for transmitting and receiving data in the audible frequency band. It is to provide a method.

  Another object of the present invention is to efficiently input data for audio communication into an audio signal in consideration of an audible frequency band, and easily detect data from an audio signal including data on the receiving side. An object of the present invention is to provide a data transmission / reception system and method in an audible frequency band.

  In order to achieve the above object, a data transmission / reception system in an audio frequency band according to an embodiment of the present invention includes a data input unit for inputting audio communication target data into an audio signal, and an audio signal including the data as an audio frequency. A transmission unit for outputting in a band, and a reception unit for receiving an audio signal including the data and performing synchronization through matched filtering, and extracting the data according to preset data extraction processing .

  The transmission unit receives an audio signal including the data based on a communication network and transmits the audio signal to the reception unit, or receives an audio signal including the data via a storage medium and transmits the audio signal to the reception unit. It is desirable to do.

  In order to achieve the above object, a data input device for acoustic communication according to an embodiment of the present invention includes a frequency axis converter for converting a time axis signal for an audio signal into a frequency axis signal, based on the frequency axis signal. After selecting a frequency band for inputting data to be acoustically communicated, a frequency transforming unit for transforming a target frequency corresponding to the frequency band for inputting the data according to the format of the data, and the deformation A time axis inverse conversion unit for inversely converting the subsequent frequency axis signal into a corresponding time axis signal to form an audio signal including the data is included.

  The data input device to be acoustically communicated preferably further includes a transmitter for outputting an audio signal including the data in an audible frequency band.

  It is preferable that the frequency transformation unit re-inputs values corresponding to the transform coefficient magnitude and phase of the target frequency according to the data format, and executes the data input.

  The frequency transformation unit may readjust the level of the audio signal by adjusting the magnitude of the transform coefficient of the target frequency based on the frequency signal boundary formed by the power magnitude of the target frequency before the transformation. It is desirable to maintain the following.

  It is preferable that the frequency transformation unit readjust the conversion coefficient magnitude of the target frequency based on a human psychoacoustic model with a masking threshold already stored as a limit.

  It is desirable that the frequency transformation unit further inputs synchronization data in preparation for detection of the data.

  The frequency axis conversion unit converts the first section of the time axis signal before the deformation into the frequency axis signal before the deformation, and then converts the second section overlapping with the first section at a predetermined level before the deformation. It is preferable to sequentially convert the frequency domain signal to the frequency axis signal of the second segment and sequentially convert the Nth segment overlapping with the second segment at a predetermined level to the frequency axis signal before the transformation.

  The frequency transformation unit sequentially inputs the data based on the frequency axis signal corresponding to the second interval after executing the data input based on the frequency axis signal corresponding to the first interval, It is desirable to sequentially execute the data input based on the frequency axis signal corresponding to the Nth section.

  The time axis inverse transform unit inversely transforms the modified frequency axis signal corresponding to the first section into a corresponding time axis signal, and then converts the modified frequency axis signal corresponding to the second section to the corresponding time axis signal. The audio signal including the data is sequentially converted into a time axis signal, and the transformed frequency axis signal corresponding to the Nth section is sequentially converted into a corresponding time axis signal and overlapped with each other. It is desirable to form.

  In order to achieve the above object, a data transmission apparatus for acoustic communication according to an embodiment of the present invention includes a frequency axis conversion unit for converting a time axis signal for an audio signal into a frequency axis signal, based on the frequency axis signal. For setting the set section of the set frequency range and inputting the data for acoustic communication in the set section in accordance with the band selection criteria including whether or not the power magnitude component reaches the planned level A frequency band selecting unit for selecting a frequency band; when a frequency band for inputting the data is selected, a target frequency corresponding to the frequency band for inputting the data is modified according to the format of the data. And a time axis inverse transform unit for inversely transforming the transformed frequency axis signal into a corresponding time axis signal to form an audio signal including the data Including.

  The data transmission apparatus targeted for acoustic communication preferably further includes a transmission output unit for transmitting an audio signal including the data in an audible frequency band.

  When the data transmission device targeted for acoustic communication does not select a section for the input of the data, the audio signal is targeted for a time axis signal that is input as a result of the lapse of a preset time interval. It is desirable to further include a time domain selection unit that selects a section for inputting data.

  Preferably, the set section is at least one frequency set, and the frequency set is a set of frequencies having continuous frequency coefficients or a set of frequencies having non-continuous frequency coefficients.

  The set of frequencies having non-continuous frequency coefficients is preferably a set of frequencies that are filtered to a frequency component that has been set to a predetermined level.

  The frequency band selection unit determines whether or not the band selection criterion is satisfied by setting, as a priority, a frequency set that is a high frequency equal to or higher than a predetermined level among the at least one frequency set, or It is desirable to determine whether or not the band selection criterion is satisfied for each frequency set among at least one frequency set.

  The frequency band selection unit calculates a total power magnitude for each frequency set in the set section, determines a frequency set satisfying the band selection criterion based on the calculation result, and inputs the data It is desirable to select a band.

  The frequency band selection unit calculates a power magnitude for each frequency in the set section, determines at least one frequency satisfying the band selection criterion based on a calculation result, and then determines the at least one frequency. It is desirable to select the above frequency as a frequency band for inputting the data.

  In order to achieve the above object, an audio communication target data receiving apparatus according to an embodiment of the present invention includes a synchronization unit for receiving an audio signal including data and performing synchronization through matched filtering, and the synchronization A time domain selection unit for selecting a time domain including the data among time domains for the converted audio signal, a frequency axis conversion unit for converting a time axis signal for the time domain including the data into a frequency axis signal, and After selecting a frequency band for extracting the data from the frequency axis signal, a data extraction unit for extracting the data in accordance with a preset data extraction process is included.

It is desirable that the data receiving apparatus for acoustic communication further includes a program execution unit for executing an application program corresponding to the data.
The time domain selection unit extracts the synchronization data for performing the synchronization from the audio signal including the data, and then determines the insertion position of the synchronization data and selects the time domain including the data. desirable.

  The synchronization data is preferably located for each start frame in the time domain including the data, or according to a grouping of the start frames into at least two.

  Preferably, the time domain selection unit separately receives guidance information related to the time domain including the data and determines the time domain including the data.

  The time domain selector receives the guidance information through a communication channel that has received an audio signal including the data, or receives the guidance information through a communication channel different from the communication channel. Is desirable.

  The data extraction unit extracts the synchronization data for performing the synchronization from the audio signal including the data, determines the insertion position of the synchronization data, and selects a frequency band for extracting the data. Is desirable.

  Preferably, the data extraction unit separately receives guidance information for extracting the data and determines a frequency band including the data.

  The data extraction unit discriminates phases for a number of target frequencies forming the frequency axis signal, and if the phase is a preset phase, selects the corresponding frequency band as a frequency band for extracting the data. Is desirable.

  In order to achieve the above object, a method for transmitting and receiving data in an audible frequency band according to an embodiment of the present invention includes a data input step for inputting audio communication target data into an audio signal, and an audio signal including the data as an audio frequency A transmission stage for outputting in a band, a synchronization stage for receiving an audio signal including the data and performing synchronization through matched filtering, and data for extracting the data according to preset data extraction processing Includes an extraction stage.

  Preferably, the data transmission / reception method in the audible frequency band further includes a data execution step of executing an application program corresponding to the data.

  The data input step includes a frequency axis conversion step for converting a time axis signal for the audio signal into a frequency axis signal, and a frequency band selection step for selecting a frequency band for inputting the data based on the frequency axis signal. The frequency transformation stage for transforming the target frequency corresponding to the frequency band for inputting the data according to the format of the data, and the transformed frequency axis signal is inversely converted to the corresponding time axis signal. It is desirable to include an inverse transformation step that forms an audio signal containing the data.

  According to an embodiment of the present invention for achieving the above object, a method of transmitting data for acoustic communication includes a frequency axis conversion step for converting a time axis signal for an audio signal into a frequency axis signal, and based on the frequency axis signal. For setting the set section of the set frequency range and inputting the data for acoustic communication in the set section in accordance with the band selection criteria including whether or not the power magnitude component reaches the planned level A frequency band selecting step for selecting a frequency band; when a frequency band for inputting the data is selected, a target frequency corresponding to the frequency band for inputting the data is modified according to the format of the data. And a time for inversely transforming the transformed frequency axis signal into the transformed time axis signal to form an audio signal including the data. Including the inverse transform stage.

  Preferably, the data transmission method for acoustic communication further includes a transmission output step for transmitting an audio signal including the data in an audible frequency band.

  In the data transmission method of the acoustic communication target, when a frequency band for inputting the data is not selected, a time axis signal input when the audio signal elapses at a preset time interval is used. It is desirable to further include a time domain selection step of selecting a section for inputting the data to the object.

  In order to achieve the above object, a method for receiving data of an acoustic communication object according to an embodiment of the present invention includes a synchronization step for receiving an audio signal including data and performing synchronization through matched filtering, and the synchronization A time domain selection stage for selecting a time domain including the data among time domains for the converted audio signal, a frequency axis conversion stage for converting a time axis signal for the time domain including the data into a frequency axis signal, and After selecting a frequency band for extracting the data from the frequency axis signal, a data extraction step for extracting the data in accordance with a preset data extraction process is included.

  Preferably, the method for receiving data for acoustic communication further includes a program execution stage for executing an application program corresponding to the data.

  Therefore, according to the present invention, data to be transmitted to an audio signal is additionally input and transmitted in an audible frequency band, so that the data to be acoustically communicated is loaded into the audio signal in the audible frequency band and efficiently received on the receiving side. There is an advantage that can be transmitted to.

  In addition, in consideration of the peculiarity of the audible frequency band, the present invention can minimize noise that can be generated by inputting data into an audio signal to a level that cannot be recognized by humans. There is an advantage that an error that may occur when data is input and detected in the frequency band of the signal can be minimized.

  Then, by enhancing the functions for inputting data to the audio signal on the transmission side and detecting data from the audio signal on the reception side, the audio signal capable of acoustic communication is further expanded to activate acoustic communication. There is an advantage that it can contribute greatly.

1 is a configuration diagram for a data transmission / reception system in an audible frequency band according to an embodiment of the present invention; FIG. It is the figure which showed the execution process of the data input part in FIG. 1 as one Example. It is the figure which showed the frequency-axis conversion or time-axis reverse conversion process according to the fixed area through the data input part in FIG. It is the figure which showed the execution process of the receiving part in FIG. 1 as one Example. 2 is a flowchart illustrating an operation process of a data transmission / reception system in an audible frequency band in FIG. 1. It is a block diagram of the data transmission apparatus of the acoustic communication object by one Example of this invention. It is the flowchart which showed the operation | movement process of the data transmission apparatus of the acoustic communication object in FIG. It is a block diagram of the data receiver of acoustic communication object by one Example of this invention. It is the flowchart which showed the operation | movement process of the data receiver of acoustic communication object in FIG.

  Hereinafter, preferred embodiments of a data transmission / reception system in an audible frequency band according to the present invention will be described in more detail with reference to the accompanying drawings.

  FIG. 1 is a block diagram illustrating a data transmission / reception system in an audible frequency band according to an embodiment of the present invention. As shown merely as an example in FIG. 1, a data transmission / reception system in an audible frequency band is an audio signal including a data input unit 100 for inputting data to be acoustically communicated in a partial section of the audio signal. After receiving the transmission unit 200 for transmitting in the frequency band and the audio signal including the data, the synchronization through the matched filtering by the matched filter is executed, and the data input section selected through the synchronization is targeted. A receiving unit 300 for extracting input data according to the set data extraction processing is included.

  Here, the data input unit 100 may be implemented as an integrated type with the transmitting unit 200 or as a separated type from the transmitting unit 200. For example, when implemented in an integrated type, it is suitable for situations where an audio signal including data is transmitted through radio broadcasting, and when implemented in a separated type, data is included through an audio system in the vehicle. This is suitable for a situation where a configuration for reproducing a storage medium storing an audio signal is implemented.

  FIG. 2 is a diagram illustrating an execution process of the data input unit 100 in FIG. 1 as an example. As merely shown as an example in FIG. 2, the data input unit 100 is a frequency axis for converting a time axis signal for an audio signal into a frequency axis signal using a conversion tool such as MCLT (Modified Complex Lapped Transform). After selecting a frequency band for inputting data for acoustic communication based on the converted frequency axis signal, the conversion unit 110 is output as a result of MCLT for a target frequency corresponding to the frequency band for data input. The frequency transformation unit 120 for inputting data by re-inputting values corresponding to the magnitude and phase of the transform coefficient, and an audio signal including data by inversely transforming the transformed frequency axis signal into a time axis signal again Includes a time-axis inverse transform unit 130 for forming.

  Thereafter, an audio signal including data is transmitted through the transmission unit 200 in an audible frequency band.

  Further, it is desirable that the frequency transformation unit 120 additionally inputs synchronization data for enabling the reception unit 300 to easily detect data included in the audio signal.

  The frequency transformation unit 120 changes the transform coefficient magnitude and phase for the target frequency, inputs data, and changes the transform coefficient (that is, MCLT transform coefficient in the case of MCLT) phase as M-ary. The PSK method can be applied, and various other methods can be applied from the viewpoint of those skilled in the art.

  For example, in the binary PSK, the phase is changed to “0” when transmitting “0”, and the phase is changed to “π” when transmitting “1”. Can do.

  The data input unit 100 selects a partial frequency section for inputting data from the original audio signal (for example, can be selected by using a power level suitable for data transmission) and inputs the selected frequency section. The audio signal is scheduled to be distorted by re-adjusting the transform coefficient size with reference to the frequency signal boundary formed by the power magnitude of the target frequency in the selected frequency section selected above. It is desirable to reduce it below the specified level.

  In addition, the transform coefficient size is adjusted with a masking threshold value (Masking Threshold) that has been set using human psychoacoustics as a model, and this masking threshold value is a signal that is smaller than the same value. It means that you cannot hear it. As a result, when the transform coefficient size is smaller than the masking threshold, the signal size is increased to the masking threshold so that noise is not heard by the human ear, but the acoustic communication performance is more excellent. Can be implemented.

  FIG. 3 is a diagram illustrating a frequency axis transformation or time axis inverse transformation process for each predetermined section through the data input unit 100 in FIG. As merely shown as an example in FIG. 3, the data input unit 100 divides the audio signal into predetermined intervals and receives inputs to sequentially execute conversion. For example, after processing the conversion for the first input signal having a length of 2M, the second input signal is not provided with a signal that has advanced by 2M. After being provided and superimposing signals between each other, a matching process can be performed to reduce conversion errors.

  Specifically, the frequency axis conversion unit 110 of the data input unit 100 converts the first section of the time axis signal before the transformation into the frequency axis signal before the transformation with respect to the audio signal, and then A second section that overlaps with one section at a predetermined level is sequentially converted into the frequency axis signal before the transformation, and an Nth section that overlaps with the second section at a predetermined level is sequentially converted into the frequency axis signal before the transformation. To do.

  In a subsequent process, the frequency transformation unit 120 performs data input based on the frequency axis signal corresponding to the first interval, and then sequentially executes data input based on the frequency axis signal corresponding to the second interval. The data input is sequentially executed based on the frequency axis signal corresponding to the Nth section.

  Then, the time axis inverse transform unit 130 inversely transforms the transformed frequency axis signal corresponding to the first section into the transformed time axis signal, and then transforms the transformed frequency axis signal corresponding to the second section. Audio signals including data are sequentially converted back to time axis signals, and the transformed frequency axis signals corresponding to the Nth section are sequentially inverted to the transformed time axis signals and superimposed on each other. Form.

  FIG. 4 is a diagram illustrating an execution process of the reception unit 300 in FIG. 1 as an example. As merely shown as an example in FIG. 4, the receiving unit 300 that performs acoustic communication receives an audio signal including data from the transmitting unit 200 and performs synchronization through matched filtering. The frequency axis conversion unit 320 for converting the time axis signal with respect to the audio signal including data into the frequency axis signal, and the frequency band for data extraction based on the result of the synchronization are selected and set in advance. A data extraction unit 330 is included for extracting data according to data extraction processing (for example, in the case of conversion using the MCLT method, the phase of the MCLT conversion coefficient is determined and the corresponding data is confirmed).

  The receiving unit 300 may further include a program execution unit for executing an application program corresponding to the data.

  FIG. 5 is a flowchart showing an operation process of the data transmission / reception system in the audible frequency band in FIG. As merely shown as an example in FIG. 5, the data transmission / reception method in the audible frequency band receives an audio signal, converts a time axis signal into a frequency axis signal, and inputs data for acoustic communication. The process proceeds to select a band (S1 and S3).

  Thereafter, data input is executed by changing the conversion coefficient magnitude and phase of the target frequency corresponding to the frequency band for data input according to the data format (S5).

  The audio signal including the data formed through S5 is transmitted to the transmission unit 200, and is transmitted in the audible frequency band through the transmission unit 200 (S7 and S9).

  Therefore, the receiving unit 300 performs synchronization after receiving an audio signal including audible frequency band data through a configuration such as a microphone (S11 and S13).

  Thereafter, after determining a section in which data is input based on the synchronization result, the input data is extracted from the corresponding section through determination on a phase or the like (S15).

  Then, an application program for utilizing the extracted data is activated (S17).

  Hereinafter, a preferred embodiment of a data transmission / reception system in an audible frequency band according to another embodiment will be described in more detail.

  A data transmission / reception system in an audible frequency band includes a data input unit for inputting audio communication target data in a partial section of an audio signal, a transmission unit for transmitting an audio signal including data in an audible frequency band, and data After receiving the audio signal containing the data, perform synchronization through matched filtering by the matched filter, and extract the input data according to the preset data extraction processing for the data input section selected through synchronization Including a receiving unit.

  Here, the data input unit may be implemented in an integrated manner with the transmitting unit, or may be implemented in a separated type with the transmitting unit. For example, when implemented in an integrated type, it is suitable for situations where an audio signal including data is transmitted through radio broadcasting, and when implemented in a separated type, data is included through an audio system in the vehicle. This is suitable for a situation where a configuration for reproducing a storage medium storing an audio signal is implemented.

  FIG. 6 is a block diagram of a data transmission apparatus targeted for acoustic communication according to another embodiment of the present invention. As merely shown as an example in FIG. 6, the data transmission apparatus targeted for acoustic communication converts a time axis signal for an audio signal into a frequency axis signal using various conversion tools such as MCLT, DFT, DCT, and the like. Frequency axis conversion unit 420 for setting, after setting a set section of a preset frequency range based on the frequency axis signal, whether or not the power magnitude component of the set set section reaches a predetermined level or more If there is a frequency band that satisfies the above band selection criteria, a frequency band selection unit 430 that selects a frequency band for inputting data for acoustic communication in accordance with the band selection criteria such as A frequency transformation unit 440 for transforming the target frequency to be transformed according to the data format, and the transformed frequency axis signal into the corresponding time axis signal by inverse transformation. Including the time axis inverse transform part 450 for forming the audio signal.

  Furthermore, the data transmission device targeted for acoustic communication preferably further includes a transmission output unit 460 for transmitting an audio signal including data to the reception device in an audible frequency band.

  On the other hand, the data transmission apparatus for acoustic communication is for determining a power level component in each section of a time axis signal with respect to an audio signal and determining a section corresponding to an appropriate level for inputting data in the time domain. A time domain selection unit 410 may be further included.

  The time domain selection unit 410 is preferably provided before the time axis signal for the audio signal is converted into the frequency axis signal through the frequency axis conversion unit 420 and is preferably configured to first select a section for data input. When there is no frequency band that matches the band selection criteria described above through the band selection unit 430, data is input to a time axis signal that is newly input after the audio signal has passed at a preset time interval. It is also possible to implement so as to re-determine the interval.

  Since there is no frequency band that matches the band selection criteria, when the time domain selection unit 410 is implemented to re-discriminate in the time domain, frequency axis transformation and frequency band selection are additionally performed again. .

  Here, the set section refers to at least one frequency set, such as frequencies having frequency coefficients that are continuously listed or frequencies having frequency coefficients that are discontinuously listed. is there.

  In addition, the frequencies having frequency coefficients that are discontinuously arranged are a collection of frequencies corresponding to a case where a predetermined frequency component that is set is equal to or higher than a predetermined level.

  When the set section is composed of the first frequency set, the second frequency set, and the Nth frequency set, the frequency band selection unit 430 performs the operation at a high frequency that is possible when data is inserted. Among the first frequency set, the second frequency set, and the Nth frequency set, a frequency set having a relatively high frequency is preferentially set to determine whether or not the band selection criterion is satisfied.

  Further, the frequency band selection unit 430 calculates the total power magnitude for each frequency set among the first frequency set, the second frequency set, and the Nth frequency set, and based on such calculation results, It is possible to select the frequency band for data input by determining whether or not it is satisfactory, and in addition, calculate the power magnitude for each frequency including the first frequency set, the second frequency set, and the Nth frequency set, It is also possible to discriminate at least one or more frequencies that satisfy the band selection criteria based on such calculation results, and to select the discriminated at least one or more frequencies as a frequency band for distributed input of data.

  The frequency transformation unit 440 re-adjusts the transform coefficient magnitude with reference to the frequency signal boundary formed by the power magnitude of the target frequency in the selected partial frequency section, thereby distorting the audio signal at a predetermined level. It is desirable to reduce it to the following.

  Further, adjusting the magnitude of the conversion coefficient means adjusting the masking threshold (Masking Threshold), which has been set using human psychoacoustics as a model, as a limit value. When the transform coefficient size is smaller than the masking threshold value, the acoustic communication performance can be realized more excellently while increasing the signal size up to the masking threshold value so that the human ear does not hear noise.

  FIG. 7 is a flowchart showing an operation process of the data transmission apparatus targeted for acoustic communication in FIG. As shown merely as an example in FIG. 7, the data transmission method for acoustic communication proceeds to convert a time axis signal for an audio signal into a frequency axis signal (S501 and S503).

  After that, set the set section of the frequency range that has been set based on the frequency axis signal, and set the data for acoustic communication that meets the band selection criteria such as whether or not the power magnitude component is higher than the planned level. A frequency selection step of selecting a frequency band for input is executed (S505 and S507).

  If there is no frequency set that satisfies the band selection criteria in all the set sections in the above S507, the time axis signal of the next time zone as the audio signal has elapsed is received and used as the band selection criteria. It is determined again whether or not they match (S509).

  If there is a frequency set that satisfies the band selection criteria in all of the set sections in S507, the frequency set for the data input is set after the corresponding frequency set is set as a frequency band for data input, and the target corresponding to the frequency band for data input A process of transforming the frequency according to the data format is executed (S511 and S513).

  Thereafter, the transformed frequency axis signal is inversely converted into a corresponding time axis signal to form an audio signal including data, and transmitted in an audible frequency band (S515 and S517).

  FIG. 8 is a block diagram of a data receiving apparatus targeted for acoustic communication according to an embodiment of the present invention. As merely shown as an example in FIG. 8, a synchronization unit 610 that receives an audio signal including data from a transmission device and performs synchronization through matched filtering, data in the time domain for the synchronized audio signal A time domain selection unit 620 for selecting a time domain including a frequency axis conversion unit 630 for converting a time axis signal for the time domain including data into a frequency axis signal, and a frequency for extracting data from the frequency axis signal After the band is selected, a data extraction unit 640 for extracting data in accordance with preset data extraction processing and a program execution unit 650 for executing an application program corresponding to the data are included.

  The time region selection unit 620 determines the insertion position of the synchronization data and selects a time region including data, or separately receives guidance information related to the time region including data and determines the time region including data. It is possible.

  Further, the preset data extraction processing determines the phases for a number of target frequencies forming the frequency axis signal, and the phase is set to “0” or “0” when using a preset phase (for example, using BPSK). If “π” is detected, there is a high possibility that data is inserted. Conversely, if the phase is not detected as “0” or “π”, the possibility that data is inserted is low). Includes various methods including selecting a corresponding frequency band as a frequency band for data extraction.

  FIG. 9 is a flowchart showing an operation process of the data receiving apparatus targeted for acoustic communication in FIG. As illustrated by way of example only in FIG. 9, the method of receiving data for acoustic communication proceeds to receive an audio signal containing data and perform synchronization through matched filtering (S710 and S713).

  Thereafter, a time domain that is highly likely to contain data is selected from the time domain for the synchronized audio signal (S715), and frequency axis transformation is performed on the selected time domain (S717).

  After selecting a frequency band for data extraction from the frequency axis signal (S719), the data is extracted by discriminating a preset phase and the like (S721).

  Thereafter, an application program corresponding to the extracted data is activated to output the data (S723).

  Although the present invention has been described with reference to the preferred embodiments of the present invention, those skilled in the art will recognize that the present invention is within the scope of the spirit and scope of the present invention described in the claims. It will be understood that various modifications and changes are possible.

Since the present invention is for implementing acoustic communication in the audible frequency band by additionally inputting data to be transmitted to the audio signal and transmitting it in the audible frequency band, the possibility of being commercially available or operating This is an invention that has industrial applicability because it is not only sufficient, but is practically apparently feasible.

Claims (23)

  1. A frequency axis converter for converting a time axis signal to an audio signal into a frequency axis signal;
    Set a set section of the preset frequency range based on the frequency axis signal, and in accordance with the band selection criteria including whether or not the power magnitude component reaches a predetermined level, the target of acoustic communication in the set section A frequency band selection unit for selecting a frequency band for inputting the data of;
    When a frequency band for inputting the data is selected, a frequency changing unit for changing a target frequency corresponding to the frequency band for inputting the data according to the format of the data; and after the changing A time axis inverse transform unit for inversely transforming the frequency axis signal to a corresponding time axis signal to form an audio signal including the data.
  2. The data transmission apparatus for acoustic communication according to claim 1 , further comprising a transmission output unit for transmitting an audio signal including the data in an audible frequency band.
  3. When a section for inputting the data is not selected, a time for selecting a section for inputting the data with respect to a time axis signal input when the audio signal elapses at a preset time interval. The data transmission apparatus for acoustic communication according to claim 1 , further comprising an area selection unit.
  4. The set interval is
    In at least one or more frequency sets, said frequency set is either a set of frequency et al having successive frequency coefficients, that to claim 1, wherein the set of frequency et al having a non-contiguous frequency coefficients The data transmission apparatus of the acoustic communication object of description.
  5. A set of frequencies having the non-continuous frequency coefficient is
    The data transmission apparatus for acoustic communication according to claim 4 , wherein the preset frequency component is a set of frequencies equal to or higher than a predetermined level .
  6. The frequency band selector is
    Among the at least one or more frequency sets, a frequency set that is a high frequency equal to or higher than a predetermined level is set as a priority order to determine whether or not the band selection criterion is satisfied, or the at least one or more frequency sets The data transmission device for acoustic communication according to claim 4 , wherein whether or not the band selection criterion is satisfied is determined for each frequency set.
  7. The frequency band selector is
    Calculating a total power magnitude for each frequency set in the set section, determining a frequency set satisfying the band selection criteria based on the calculation result, and selecting a frequency band for inputting the data; The data transmission device for acoustic communication according to claim 1 .
  8. The frequency band selector is
    After calculating the power magnitude for each frequency in the set section and determining at least one frequency satisfying the band selection criteria based on the calculation result, the at least one frequency is used as the data. The data transmission device for acoustic communication according to claim 1 , wherein the data transmission device is selected as a frequency band for input.
  9. A time domain selecting unit for discriminating a power magnitude component in each section of the time axis signal with respect to the audio signal and determining a section corresponding to an appropriate level for inputting the data in the time domain;
      2. The frequency axis conversion unit converts the time axis signal of a section determined to correspond to an appropriate level for inputting data by the time domain selection unit to the frequency axis signal. The data transmission apparatus of the acoustic communication object described in 1.
  10.   The frequency transformation part is
      The data transmission for acoustic communication according to claim 1, wherein the data input is executed by re-inputting values corresponding to the transform coefficient magnitude and phase of the target frequency according to the format of the data. apparatus.
  11.   The frequency transformation part is
      Re-adjusting the transform coefficient magnitude of the target frequency based on the frequency signal boundary formed by the power magnitude for the target frequency before the deformation to maintain the distortion of the audio signal below a predetermined level. The data transmission device for acoustic communication according to claim 10, wherein:
  12.   The frequency transformation part is
      The acoustic communication target data according to claim 11, wherein the conversion coefficient magnitude of the target frequency is readjusted based on a human psychoacoustic model with a masking threshold stored in advance as a limit. Transmitter device.
  13. A synchronization unit for receiving an audio signal including data and performing synchronization through matched filtering;
    A time domain selection unit for selecting a time domain including the data from the time domain for the synchronized audio signal;
    A frequency axis conversion unit for converting a time axis signal for a time domain including the data into a frequency axis signal; and selecting a frequency band for extracting the data from the frequency axis signal, and then setting a data extraction already set data extraction unit for extracting the data according to processing; only contains,
    The data extraction unit
    An acoustic communication characterized by determining phases for a number of target frequencies forming the frequency axis signal and selecting the corresponding frequency band as a frequency band for extracting the data if the phase is a preset phase Target data receiving device.
  14. 14. The data receiving apparatus for acoustic communication according to claim 13 , further comprising a program execution unit for executing an application program corresponding to the data.
  15. The time domain selector is
    After extracting the synchronization data to perform the synchronization from the audio signal including the data, to claim 13, characterized in that to determine the insertion position of the synchronization data to select a time region including the data The data receiving apparatus for acoustic communication described.
  16. The synchronized data is
    [ 16] The data reception of the acoustic communication object according to claim 15 , wherein the data reception is positioned according to a start frame of the time domain including the data or according to a group of the start frames grouped into at least two or more. apparatus.
  17. The time domain selector is
    14. The data receiving apparatus for acoustic communication according to claim 13 , wherein guidance information relating to the time domain including the data is separately provided to determine the time domain including the data.
  18. The time domain selector is
    Claims, characterized in that to receive the provision of the guide information via different communication channels with either the communication channel receiving provision of the guide information via the communication channel that received the offer of an audio signal including the data 17. A data receiving device for acoustic communication according to 17 .
  19. A frequency axis conversion step for converting a time axis signal to an audio signal into a frequency axis signal;
    Set a set section of the preset frequency range based on the frequency axis signal, and in accordance with the band selection criteria including whether or not the power magnitude component reaches a predetermined level, the target of acoustic communication in the set section A frequency band selection step of selecting a frequency band for inputting the data of;
    When a frequency band for inputting the data is selected, a frequency changing step for changing the target frequency corresponding to the frequency band for inputting the data according to the format of the data; and after the changing A time axis inverse transform step for inversely transforming the frequency axis signal of the above into a time axis signal after the transformation to form an audio signal including the data.
  20. The data transmission method of claim 19 , further comprising a transmission output step for transmitting an audio signal including the data in an audible frequency band.
  21. When a frequency band for inputting the data is not selected, a section for inputting the data for a time axis signal input when the audio signal elapses at a preset time interval is set. The method of claim 19 , further comprising a time domain selection step of selecting.
  22. A synchronization stage for receiving an audio signal containing data and performing synchronization through matched filtering;
    A time domain selection step for selecting a time domain including the data from the time domain for the synchronized audio signal;
    A frequency axis conversion step for converting a time axis signal for the time domain including the data into a frequency axis signal; and selecting a frequency band for extracting the data from the frequency axis signal, and then setting a data extraction already set data extraction step to extract the data according to processing; only contains,
    The data extraction stage
    An acoustic communication characterized by determining phases for a number of target frequencies forming the frequency axis signal and selecting the corresponding frequency band as a frequency band for extracting the data if the phase is a preset phase Target data reception method.
  23. The method for receiving data of an acoustic communication object according to claim 22 , further comprising a program execution step for executing an application program corresponding to the data.
JP2011522894A 2008-08-14 2009-07-08 Data transmitting apparatus, data receiving apparatus, data transmitting method, and data receiving method Active JP5582508B2 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
KR1020080080188A KR101034693B1 (en) 2008-08-14 2008-08-14 System and method for transferring data on audio frequency baseband
KR1020080080185A KR101040888B1 (en) 2008-08-14 2008-08-14 Apparatus and method for transferring data of sound communication target
KR10-2008-0080185 2008-08-14
KR10-2008-0080188 2008-08-14
PCT/KR2009/003725 WO2010018929A2 (en) 2008-08-14 2009-07-08 System and method for data reception and transmission in audible frequency band

Publications (2)

Publication Number Publication Date
JP2011530939A JP2011530939A (en) 2011-12-22
JP5582508B2 true JP5582508B2 (en) 2014-09-03

Family

ID=41669428

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2011522894A Active JP5582508B2 (en) 2008-08-14 2009-07-08 Data transmitting apparatus, data receiving apparatus, data transmitting method, and data receiving method

Country Status (5)

Country Link
US (1) US9002487B2 (en)
EP (1) EP2337021B1 (en)
JP (1) JP5582508B2 (en)
CN (1) CN102124514B (en)
WO (1) WO2010018929A2 (en)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012049659A2 (en) * 2010-10-14 2012-04-19 Centro De Investigación Y De Estudios Avanzados Del Instituto Politécnico Nacional High payload data-hiding method in audio signals based on a modified ofdm approach
GB2496908B (en) 2011-11-28 2017-04-26 Ubiquisys Ltd Power management in a cellular system
EP2624234A1 (en) 2012-02-02 2013-08-07 Tata Consultancy Services Limited A system, a method and an apparatus for vehicular communication
US9332458B2 (en) 2012-03-25 2016-05-03 Cisco Technology, Inc. System and method for optimizing performance of a communication network
CN102752058B (en) * 2012-06-16 2013-10-16 天地融科技股份有限公司 Audio data transmission system, audio data transmission device and electronic sign tool
IL222709A (en) 2012-10-25 2016-02-29 Intucell Ltd Method and apparatus for using inter cell interference coordination mechanism in cellular systems
US9167444B2 (en) 2012-12-04 2015-10-20 Cisco Technology, Inc. Method for managing heterogeneous cellular networks
GB2518584B (en) 2013-07-09 2019-12-25 Cisco Tech Inc Power setting
JP6574551B2 (en) 2014-03-31 2019-09-11 培雄 唐沢 Arbitrary signal transmission method using sound
US9655102B2 (en) 2014-06-20 2017-05-16 Cisco Technology, Inc. Interference control in a cellular communications network
CN105450312B (en) * 2014-08-07 2018-12-28 福建天晴数码有限公司 Acoustic communication sending method and device
US9918314B2 (en) 2015-04-14 2018-03-13 Cisco Technology, Inc. System and method for providing uplink inter cell interference coordination in a network environment
US9860852B2 (en) 2015-07-25 2018-01-02 Cisco Technology, Inc. System and method to facilitate small cell uplink power control in a network environment
US9648569B2 (en) 2015-07-25 2017-05-09 Cisco Technology, Inc. System and method to facilitate small cell uplink power control in a network environment
US9820296B2 (en) 2015-10-20 2017-11-14 Cisco Technology, Inc. System and method for frequency and time domain downlink inter-cell interference coordination
US9826408B2 (en) 2015-12-07 2017-11-21 Cisco Technology, Inc. System and method to provide uplink interference coordination in a network environment
US10143002B2 (en) 2016-01-12 2018-11-27 Cisco Technology, Inc. System and method to facilitate centralized radio resource management in a split radio access network environment
US9813970B2 (en) 2016-01-20 2017-11-07 Cisco Technology, Inc. System and method to provide small cell power control and load balancing for high mobility user equipment in a network environment
US10091697B1 (en) 2016-02-08 2018-10-02 Cisco Technology, Inc. Mitigation of uplink interference within heterogeneous wireless communications networks
WO2017142112A1 (en) * 2016-02-19 2017-08-24 주식회사 트리니티랩 Audible frequency band audio signal reception method for low power
CN105913625A (en) * 2016-06-02 2016-08-31 广州极飞电子科技有限公司 Data transmission module pairing method and system

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5450490A (en) * 1994-03-31 1995-09-12 The Arbitron Company Apparatus and methods for including codes in audio signals and decoding
US7715446B2 (en) * 1996-04-25 2010-05-11 Digimarc Corporation Wireless methods and devices employing plural-bit data derived from audio information
JP3751419B2 (en) * 1997-06-16 2006-03-01 松下電器産業株式会社 Matched filter and synchronization method
JP3853541B2 (en) 1998-07-30 2006-12-06 富士写真フイルム株式会社 Data distribution method
JP3365331B2 (en) 1999-02-01 2003-01-08 ヤマハ株式会社 Vector quantization apparatus and vector quantization method
US7272718B1 (en) 1999-10-29 2007-09-18 Sony Corporation Device, method and storage medium for superimposing first and second watermarking information on an audio signal based on psychological auditory sense analysis
JP2001148670A (en) * 1999-11-19 2001-05-29 Nippon Telegr & Teleph Corp <Ntt> Method and device for transmitting acoustic signal
KR20020031654A (en) 2000-10-23 2002-05-03 황준성 Method and apparatus for embedding watermarks using fast fourier transformed data
EP1493154B1 (en) * 2002-03-28 2008-04-23 Philips Electronics N.V. Time domain watermarking of multimedia signals
WO2005002200A2 (en) * 2003-06-13 2005-01-06 Nielsen Media Research, Inc. Methods and apparatus for embedding watermarks
EP1645058A4 (en) * 2003-06-19 2008-04-09 Univ Rochester Data hiding via phase manipulation of audio signals
KR20050002545A (en) 2003-06-30 2005-01-07 주식회사 케이티 Digital audio watermarking system and method
EP1542227A1 (en) * 2003-12-11 2005-06-15 Deutsche Thomson-Brandt Gmbh Method and apparatus for transmitting watermark data bits using a spread spectrum, and for regaining watermark data bits embedded in a spread spectrum
DE102004021404B4 (en) * 2004-04-30 2007-05-10 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Watermark embedding
KR100613873B1 (en) 2004-07-13 2006-08-17 학교법인 울산공업학원 Audio watermarking apparatus using specific frequency coefficients
JP4896455B2 (en) * 2005-07-11 2012-03-14 株式会社エヌ・ティ・ティ・ドコモ Data embedding device, data embedding method, data extracting device, and data extracting method
JP4398416B2 (en) * 2005-10-07 2010-01-13 株式会社エヌ・ティ・ティ・ドコモ Modulation device, modulation method, demodulation device, and demodulation method
KR20070067501A (en) * 2005-12-23 2007-06-28 (주)본웨이브 Method for mixing and detecting analog watermarking of audio
JP4989293B2 (en) 2006-04-27 2012-08-01 パナソニック株式会社 Content distribution system
KR20080029446A (en) * 2006-09-29 2008-04-03 (주)이스트랩 System for providing information using audio watermarking and method thereof

Also Published As

Publication number Publication date
WO2010018929A2 (en) 2010-02-18
WO2010018929A3 (en) 2010-04-29
EP2337021A4 (en) 2016-11-02
US20110134971A1 (en) 2011-06-09
CN102124514B (en) 2012-11-28
JP2011530939A (en) 2011-12-22
EP2337021B1 (en) 2018-08-22
US9002487B2 (en) 2015-04-07
EP2337021A2 (en) 2011-06-22
CN102124514A (en) 2011-07-13

Similar Documents

Publication Publication Date Title
US10531198B2 (en) Apparatus and method for decomposing an input signal using a downmixer
US9967661B1 (en) Multichannel acoustic echo cancellation
US9747920B2 (en) Adaptive beamforming to create reference channels
US9414158B2 (en) Single-channel, binaural and multi-channel dereverberation
CA2854086C (en) System and method for narrow bandwidth digital signal processing
US20180262861A1 (en) Audio signal processing method and device
ES2452920T3 (en) Digital watermark signal provider and procedure for providing a digital watermark signal
JP2016126335A (en) Sound zone facility having sound suppression for every zone
CN101218850B (en) System and method for eliminating feedback and noise in a hearing device
US8126161B2 (en) Acoustic echo canceller system
US10692508B2 (en) Method for generating filter for audio signal and parameterizing device therefor
US8498860B2 (en) Modulation device, modulation method, demodulation device, and demodulation method
US20160381457A1 (en) Signal processing system and signal processing method
EP1205045B1 (en) Acoustic communication system
JP5096325B2 (en) Method and system for determining the distance between speakers
KR100800725B1 (en) Automatic volume controlling method for mobile telephony audio player and therefor apparatus
EP3040875A1 (en) Method and system for utilizing spread spectrum techniques for in car applications
KR20150123902A (en) Content based noise suppression
EP1924989B1 (en) Blind watermarking of audio signals by using phase modifications
KR101984115B1 (en) Apparatus and method for multichannel direct-ambient decomposition for audio signal processing
JP5134876B2 (en) Voice communication apparatus, voice communication method, and program
KR101442450B1 (en) Method and system for noise reduction, smart control method and device, and communication device
KR101445075B1 (en) Method and apparatus for controlling sound field through array speaker
US8090111B2 (en) Signal separator, method for determining output signals on the basis of microphone signals, and computer program
CN105659630A (en) Method and apparatus for processing multimedia signals

Legal Events

Date Code Title Description
A711 Notification of change in applicant

Free format text: JAPANESE INTERMEDIATE CODE: A711

Effective date: 20120510

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A821

Effective date: 20120510

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20120611

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20130816

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20130903

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20131202

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20140617

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20140708

R150 Certificate of patent or registration of utility model

Ref document number: 5582508

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250