WO2013115317A1 - 音波通信システム及び受信装置 - Google Patents
音波通信システム及び受信装置 Download PDFInfo
- Publication number
- WO2013115317A1 WO2013115317A1 PCT/JP2013/052214 JP2013052214W WO2013115317A1 WO 2013115317 A1 WO2013115317 A1 WO 2013115317A1 JP 2013052214 W JP2013052214 W JP 2013052214W WO 2013115317 A1 WO2013115317 A1 WO 2013115317A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- unit
- information
- signal
- sound
- broadcast
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B11/00—Transmission systems employing sonic, ultrasonic or infrasonic waves
Definitions
- the present invention relates to a sound wave communication system that transmits and receives data by modulating a signal in a frequency band that can be received by a microphone based on transmission data, and a reception device suitable for use in the sound wave communication system.
- the receiving device When the delayed wave is input to the microphone, the receiving device cannot correctly restore the sound wave (that is, transmission data) transmitted from the transmitting device from the received signal. For this reason, when performing sound wave communication, the speaker on the transmission device side and the microphone on the reception device side are placed close to each other so that reflected waves are not input to the microphone on the reception device side.
- the receiving apparatus removes unnecessary signal components such as reflected waves from the received signal (for example, Patent Documents). 1).
- a pseudo noise code is assigned to the transmission data, and on the receiving device side, an adaptive filter corresponding to the pseudo noise code is used.
- the received signal is separated into a data area and a pseudo noise area.
- the receiver side obtains the multipath delay characteristic value of the pseudo-noise domain signal (pseudo-noise code) separated from the received signal, and removes unnecessary signal components from the data domain signal based on this multipath delay characteristic value. To do.
- the communicable distance by the sonic communication can be increased.
- the frequency of sound waves used for communication is extremely low compared to radio wave communication, so the amount of data that can be transmitted per unit time is reduced, but unnecessary signal components such as delayed waves are removed from the received signal. If the pseudo-noise code is used for this purpose, it is considered that the amount of data that can be transmitted per unit time is further reduced and the desired communication speed cannot be realized.
- the frequency modulation unit on the transmission device side, the frequency modulation unit generates a transmission signal by frequency-modulating a signal in a frequency band receivable by the microphone based on transmission data.
- the sound wave generator receives the generated transmission signal and generates a sound wave.
- the sound wave output from the sound wave generator of the transmitting device is received by the microphone.
- the unnecessary signal removal unit performs signal processing on the reception signal from the microphone to remove the unnecessary signal component from the reception signal
- the FM detection unit receives the reception signal from which the unnecessary signal component is removed by the unnecessary signal removal unit.
- the transmission data is restored by FM detection.
- the first filter unit extracts a signal component corresponding to the transmission signal generated by the frequency modulation unit from the reception signal input from the microphone.
- the frequency conversion unit frequency-converts the received signal that has passed through the first filter unit into a predetermined intermediate frequency band
- the second filter unit converts the frequency conversion unit from the frequency-converted signal by the frequency conversion unit.
- the signal component corresponding to the transmission signal generated in is extracted.
- the received signal that has passed through the first filter unit is also input to the envelope detection unit and subjected to envelope detection.
- the 3rd filter part extracts the unnecessary signal component whose frequency is lower than the received signal which passed the 2nd filter part from the signal by which the envelope detection was carried out, and a removal part passes a 2nd filter part
- the unnecessary signal that has passed through the third filter unit is removed from the received signal.
- a sound wave that is frequency-modulated according to transmission data is transmitted from the transmission device to the reception device. Since the amplitude characteristic of the frequency-modulated sound wave is constant, the reception signal obtained on the receiving device side has a stable amplitude characteristic unless an unnecessary signal component such as a delayed wave is included.
- the received signal that has passed through the first filter unit is subjected to envelope detection, so that the fluctuation component of the amplitude of the received signal becomes an unnecessary signal component caused by the change of the delay wave or its transmission path.
- the unnecessary signal component is removed from the received signal that has been frequency-converted to the intermediate frequency band, thereby generating a transmission signal transmitted from the transmission device (in other words, a signal before being affected by the delay wave). It is.
- the transmission data from the transmission device can be accurately restored in the reception device.
- the unnecessary signal component can be removed from the received signal on the receiving device side in this way, even if the communication distance between the transmitting device and the receiving device becomes long, data communication by sound wave communication is improved. It can be carried out.
- a pseudo noise code is transmitted from the transmission device, and the delay characteristic value of the multipath using the pseudo noise code on the reception device side. There is no need to ask.
- the amount of data that can be transmitted per unit time does not decrease, and sonic wave communication can be executed at a desired communication speed.
- the receiving device in the second aspect of the present invention is a receiving device for sonic communication, and, like the receiving device in the sonic communication system in the first aspect, a microphone, an unnecessary signal removing unit, and an FM detecting unit.
- the unnecessary signal removal unit includes a first filter unit, a frequency conversion unit, a second filter unit, an envelope detection unit, a third filter unit, and a removal unit.
- the sound wave communication system in the first aspect can be constructed, and the same effects as described above can be obtained.
- the receiving device can be incorporated into various devices incorporating a microphone.
- a receiving device is incorporated into an information processing device with a built-in computer such as a portable information processing terminal equipped with a microphone, functions as an unnecessary signal removal unit and an FM detection unit can be performed by software processing by the computer. Can be realized.
- an information processing apparatus including a computer is provided with an oscillator that generates an operation clock of the computer, and sound waves generated from a sound wave generator such as a speaker divide the operation clock output from the oscillator. Can be generated.
- the transmission apparatus can also be incorporated into various apparatuses including the information processing apparatus.
- the modulation unit is configured by a frequency dividing circuit that divides the output from the oscillator that generates the operation clock of the computer.
- the envelope detection unit generates an unnecessary signal component by envelope detection of the reception signal that has passed through the first filter unit, so that the reception signal that passes through the first filter unit is an unnecessary signal. It may be a signal sufficiently containing components.
- the second filter unit extracts a reception signal for restoring transmission data by the FM detection unit from the frequency-converted reception signal, signal components unnecessary for the FM detection are removed as much as possible. There is a need.
- the first filter unit and the second filter unit are configured by a bandpass filter having a predetermined pass frequency band, and the selectivity of the first filter unit is determined by the selectivity of the second filter unit. Should be lower.
- a portable device suitable for utilizing such sonic communication, and an access information providing system, information providing device suitable for providing access information to the network device to the portable terminal device using sonic communication The portable terminal device will be described.
- a speaker for outputting normal sound for example, voice, music, notification sound, etc.
- a microphone that functions as a transmitter and inputs normal sound can function as a receiver for wireless communication.
- the sound wave communication has an advantage that data can be transmitted and received using a configuration for outputting normal sound and a configuration for inputting normal sound. Therefore, by configuring the portable device as follows, it is possible to take advantage of such sonic communication and utilize sonic communication.
- a sound input unit capable of inputting a sound wave signal included in a sound reproduced by a receiving device that receives and reproduces broadcast information;
- a control unit that executes reproduction-related processing related to the content reproduced by the receiving device based on information represented by the sound wave signal input by the sound input unit;
- a portable device comprising:
- portable device A1 configured as described above, by inputting a sound wave signal included in the sound reproduced by the receiving device, it is possible to execute processing related to the content reproduced by the receiving device.
- portable device A2 In portable device A1, It further includes an operation unit that receives an operation by the user, The control unit executes a process based on an operation received by the operation unit as a process related to the reproduction content as the reproduction-related process.
- portable device A2 configured as described above, it is possible to execute processing related to the reproduction content, which is based on an operation by the user.
- the control unit causes the presentation unit to present information related to the reproduction content as the reproduction-related processing.
- Access information providing system includes a mobile terminal device that communicates with a network device via a wireless communication network, and access information necessary for accessing the network device with respect to the mobile terminal device. It is comprised with the information provision apparatus which provides.
- mobile terminal devices such as mobile phones, smart phones, and tablet terminals can access network devices on a wide area network (WAN) or a local network (LAN) via a wireless communication network such as a wireless telephone line or a wireless LAN.
- WAN wide area network
- LAN local network
- predetermined access information such as the IP address of the network device on the network and the URL of the Web server provided by the network device is input. There is a need.
- the input operation is extremely troublesome for a user who is unfamiliar with the operation of the mobile terminal device. May not be entered.
- a) and b) are known as portable terminal devices capable of easily inputting such access information.
- a desired network device on the network by using a camera for imaging to read a two-dimensional code representing access information for a network device to be connected and decoding the access information from the read two-dimensional code (See, for example, JP-A-2003-67275).
- the mobile terminal device described in the above a) and b) is connected using a two-dimensional code imaging camera provided in the mobile terminal device or a short-range communication device using radio waves or infrared light. Access information for the target network device is acquired.
- a portable terminal device including a wireless communication unit for communicating with network devices on the network via a wireless communication network;
- An information providing device for providing the mobile terminal device with access information necessary to access the network device;
- An access information providing system comprising: The information providing apparatus includes: A speaker for transmitting sound waves; A transmitter that converts the access information into an audio signal that can be transmitted from the speaker, and outputs the sound signal to the speaker, thereby transmitting the access information from the speaker as a sound wave; With The portable terminal device A microphone capable of receiving sound waves transmitted from the speaker; A restoration unit that receives a sound wave transmitted from the speaker via the microphone and restores the access information from the received signal; Based on the access information restored by the restoration unit, a communication control unit that accesses the network device via the wireless communication unit and communicates with the network device;
- An access information providing system characterized by comprising:
- the access information providing system B1 includes a mobile terminal device including a wireless communication unit for performing communication with a network device on a network via a wireless communication network, and a network device for the mobile terminal device. And an information providing device for providing access information necessary for accessing the device.
- the information providing apparatus includes a sound wave transmitting speaker and a transmitting unit, and the transmitting unit converts access information to the network device into an audio signal that can be transmitted from the speaker and outputs the sound signal to the speaker.
- the access information is transmitted as sound waves from the speaker.
- the mobile terminal device includes a microphone that can receive a sound wave transmitted from the speaker of the information providing device.
- the restoration unit restores the access information to the network device from the received signal, and the communication control unit is restored by the restoration unit.
- the network device is accessed via the wireless communication unit, and communication is performed with the network device.
- the information providing apparatus uses the microphone that is normally provided for calling or voice input in a portable terminal device such as a mobile phone, a smart phone, and a tablet terminal. Access information is transmitted by sound waves.
- access information to a network device can be obtained for a mobile terminal device that does not have a function for imaging / decoding a two-dimensional code or a short-range communication function using wireless or infrared. Can be provided.
- a mobile terminal device is usually provided with a microphone for calling or voice input, and a signal processing circuit that processes a voice signal input from the microphone and converts it into voice data.
- the mobile terminal device On the mobile terminal device side, it becomes possible to restore the access information using these units, and in order to recognize the access information transmitted by sound waves from the information providing device, the mobile terminal device has a microphone for access information recognition. In addition, it is not necessary to provide a separate signal processing circuit, and it is possible to suppress an increase in cost of the mobile terminal device.
- the information providing apparatus includes: Built in a receiver that selects and demodulates a broadcast signal of a predetermined broadcast channel from received signals input from the outside, An access information acquisition unit that acquires an address on the network of the network device from the broadcast data obtained by selecting and demodulating the broadcast signal, and outputs the address to the transmission unit as the access information,
- An access information providing system characterized by comprising:
- the information providing apparatus is installed in a network device connected to a local area network (LAN) in a facility such as a store, and a network set in advance for a mobile terminal device that has moved to the vicinity of the network device. You may comprise so that the access information to an apparatus may be transmitted with sound waves.
- LAN local area network
- the access information acquisition unit is a network device that provides information related to the broadcast contents from the broadcast data obtained by selecting and demodulating the broadcast signal in the receiving device. An address is acquired and the address is output as access information to the transmitter.
- the information providing apparatus includes: An encryption information generation unit that generates encryption information including its own identification information and key information for authentication; Output of encrypted information generated by the encrypted information generating unit to the transmitting unit, so that the access information including the encrypted information is transmitted from the transmitting unit via the speaker as sound waves.
- a key information transmission unit that encrypts the key information and transmits it to the network device;
- the restoration unit restores the encrypted information and the access information from the received signal,
- the communication control unit accesses the network device via the wireless communication unit based on the access information restored by the restoration unit, the network device transmits the encrypted information restored by the restoration unit.
- To The network device is: When the encrypted information is obtained from the portable terminal device, the identification information and the key information are restored from the encrypted information, and the key information is transmitted to the information providing device via the network based on the restored identification information.
- a key information transmission request part for requesting transmission of In accordance with a transmission request by the key information transmission request unit, the key information transmitted encrypted and transmitted from the information providing device is acquired and decrypted, and the decrypted key information is acquired and restored from the portable terminal device
- a key information determination unit that determines whether or not the key information matches, When the key information determination unit determines that the key information matches, it is determined that the mobile terminal device and the information providing device are normal, and the mobile terminal device and the information providing device An access information providing system characterized by permitting communication by.
- the information providing apparatus includes the encrypted information generation unit, the encrypted information output unit, and the key information transmission unit.
- the encryption information generation unit generates encryption information including identification information of the information providing apparatus itself and key information for authentication.
- the encryption information output unit outputs the encrypted information generated by the encryption information generation unit to the transmission unit, thereby transmitting the access information including the encryption information from the transmission unit via the speaker. .
- the key information transmission unit encrypts the key information in accordance with a transmission request from the network device and transmits it to the network device.
- the restoration unit restores the encrypted information and the access information from the received signal from the speaker, and the communication control unit passes the wireless communication unit based on the access information restored by the restoration unit.
- the encrypted information restored by the restoration unit is transmitted to the network device.
- the key information transmission request unit restores the identification information and the key information from the encrypted information, and based on the restored identification information, the network information is transmitted via the network. Requesting the information providing apparatus to transmit key information.
- the key information transmission request unit the key information is encrypted and transmitted, so on the network device side, the key information determination unit acquires the key information, Decryption is performed, and it is determined whether or not the decrypted key information matches the key information acquired from the mobile terminal device and restored.
- the key information determination unit determines that the key information acquired and restored from the mobile terminal device matches the key information acquired and decrypted from the information providing device, the network device It is determined that the device and the information providing device are normal, and communication between these devices is permitted.
- the network device functions as an authentication server for authenticating that the information providing device and the mobile terminal device are normal, and the reliability of communication between the devices can be improved.
- Information providing device C1 Information provision that provides access information necessary to access the network device to a portable terminal device having a wireless communication unit for communicating with the network device on the network via the wireless communication network A device, A speaker for transmitting sound waves; A transmitter that converts the access information into an audio signal that can be transmitted from the speaker, and outputs the sound signal to the speaker, thereby transmitting the access information from the speaker as a sound wave;
- An information providing apparatus comprising:
- the information providing apparatus C1 includes the sound wave transmitting speaker and the transmitting unit, and the transmitting unit converts the access information into a sound signal that can be transmitted from the speaker and outputs the sound signal to the speaker.
- the access information is transmitted as sound waves from the speaker.
- the information providing apparatus is built in a receiving apparatus that selects and demodulates a broadcast signal of a predetermined broadcast channel from reception signals input from the outside.
- An access information acquisition unit that acquires an address on the network of the network device from the broadcast data obtained by selecting and demodulating the broadcast signal, and outputs the address to the transmission unit as the access information,
- An information providing apparatus comprising:
- the information providing device C2 is built in a receiving device that selects and demodulates a broadcast signal of a predetermined broadcast channel from reception signals input from the outside. Then, the information providing device C2 obtains an address on the network of the network device from the broadcast data obtained by selecting / demodulating the broadcast signal, and outputs the address to the transmission unit as access information. An information acquisition unit is provided.
- the access information providing system A2 described above can be constructed by using the information providing apparatus C2.
- Information providing device C3 In the information providing device C1 or C2, An encrypted information generating unit that generates encrypted information including identification information of the information providing apparatus and key information for authentication; Output of encrypted information generated by the encrypted information generating unit to the transmitting unit, so that the access information including the encrypted information is transmitted from the transmitting unit via the speaker as sound waves.
- a key information transmission unit that encrypts the key information and transmits it to the network device;
- An information providing apparatus comprising:
- the information providing device C3 generates the encrypted information including the identification information of the information providing device itself and the key information for authentication, and the encrypted information generating unit generates the encrypted information.
- the access information including the encrypted information is transmitted as a sound wave from the transmission unit via the speaker, and the key information is transmitted according to the transmission request from the network device.
- a key information transmission unit that encrypts and transmits to the network device.
- a communication control unit that accesses the network device via the wireless communication unit and communicates with the network device;
- a portable terminal device comprising:
- the mobile terminal device D1 includes a wireless communication unit for communicating with network devices on the network via a wireless communication network, a microphone capable of receiving sound waves transmitted from the speaker of the information providing device, , Is provided.
- the restoration unit receives the sound wave transmitted from the speaker via the microphone, restores the access information provided from the information providing device from the received signal, and the communication control unit Based on the restored access information, a network device is accessed via the wireless communication unit, and communication is performed with the network device.
- the access information providing system B1 or B2 described above can be constructed by using the portable terminal device D1.
- the restoration unit restores the encrypted information and access information provided from the information providing device from the received signal,
- the communication control unit accesses the network device via the wireless communication unit based on the access information restored by the restoration unit, the network device transmits the encrypted information restored by the restoration unit.
- a mobile terminal device that transmits to the mobile phone.
- the restoration unit restores the encrypted information and the access information provided from the information providing device from the sound wave reception signal obtained via the microphone, and the communication control unit includes the restoration unit.
- the communication control unit includes the restoration unit.
- the access information providing system (B3) described above can be constructed by using the portable terminal device D2.
- FIG. 35 is a block diagram illustrating a configuration example of a reception state determination unit used to determine a communication state based on a sound wave reception signal from the sound wave transmission unit of FIG. 34. It is explanatory drawing showing the example of arrangement
- SYMBOLS 1 ... Broadcasting device, 1A ... Generation unit, 1B ... Transmission unit, 2 ... Reception device, 2A ... Reception unit, 2B ... Reproduction unit, 2C ... Detection unit, 3 ... Portable device, 3A ... Sound input unit, 3B ... Control unit 3C ... Display unit, 3D ... Operation unit, 3E ... Communication unit, 3F ... Sound output unit, 10 ... Transmission device, 12 ... Addition value setting unit, 14 ... Numerically controlled oscillation unit, 16 ... D / A converter, 18 ... LPF, 20 ... amplifier circuit, 22 ... speaker, 30 ... receiver, 32 ... microphone, 34 ... amplifier circuit, 36 ... LPF, 38 ...
- Cell phone line communication 734 Wireless LAN communication unit, 735, 735a to 735e ... Microphone, 736 ... Speaker, 737 ... Input unit, 738 ... Display unit, 739 ... Camera, 740 ... Control unit, 741 ... Audio data input unit, 742 ... Amplifier circuit 743 ... LPF, 744 ... A / D converter, 746 ... data processing unit for calls, 750, 790a to 790e ... receiver for sonic communication, 766 ... Internet, 767 ... payment terminal, 768 ... authentication server, 769 ... mobile Telephone line network, 770 ... TV receiver, 772 ... broadcast station, 774 ... Web server, 777, 778 ... divider circuit, 779 ... mixing circuit, 780 ... reception state determination unit.
- the sound wave communication system includes a transmission device 10 with a built-in speaker 22 and a reception device 30 with a built-in microphone 32.
- the transmission device 10 includes a numerical control oscillation unit 14 and an addition value setting unit 12.
- the numerically controlled oscillating unit 14 generates a carrier wave (sine wave) in a frequency band capable of sound wave communication via the speaker 22 and the microphone 32.
- the addition value setting unit 12 sets the addition value in the numerically controlled oscillator 14 according to transmission data, thereby frequency-modulating (FM) the output from the numerically controlled oscillator 14.
- FM frequency-modulating
- the addition value setting unit 12 and the numerical control oscillation unit 14 are realized by software processing by a computer.
- the numerical control oscillation unit 14 repeatedly adds the addition value set by the addition value setting unit 12 at a constant period, and reads the amplitude value of the sine wave from the sine wave table using the addition result, thereby adding the added value.
- This is a well-known device that generates a sine wave having a period (in other words, a frequency) corresponding to the addition value set by the setting unit 12.
- the addition value of the numerically controlled oscillator 14 is set in the transmission data by setting the addition value setting unit 12 according to each bit value (“0” or “1”) of the transmission data. In response to this, a transmission signal (frequency modulated signal) whose frequency changes is generated.
- the frequency of the transmission signal is 17.9 kHz, and the transmission data has the value “1”. ”,
- the transmission signal is generated so that the frequency of the transmission signal is 18.1 kHz.
- the transmission signal (data) generated by the numerical control oscillator 14 is converted into an analog signal by the D / A converter 16 and then passed through a low-pass filter (hereinafter referred to as LPF) 18. Are output to the amplifier circuit 20.
- LPF low-pass filter
- the amplifying circuit 20 amplifies the analog signal input via the LPF to a predetermined level, and outputs it from the speaker 22 as a sound wave.
- the LPF 18 removes unnecessary high-frequency components from the transmission signal output from the D / A converter 16 (anti-alias LPF).
- the cutoff frequency is set to 20 kHz, for example. .
- the receiving device 30 receives the sound wave output from the speaker 22 of the transmitting device 10 by the microphone 32.
- the received signal is amplified to a predetermined level by the amplifier circuit 34, and unnecessary high frequency components are removed by the LPF 36 configured similarly to the LPF 18, and then input to the A / D converter 38. Is done.
- the sampling rate of the A / D converter 38 is set to “44100 / second”, for example.
- the reception signal A / D converted by the A / D converter 38 is subjected to FM detection by the FM detection unit 60 after the unnecessary signal is removed by the unnecessary signal removal unit 40.
- the signal detected by the FM detection unit 60 is shaped into a binary signal by the waveform shaping unit 68 and output as received data.
- the unnecessary signal removal unit 40, the FM detection unit 60, and the waveform shaping unit 68 are realized by software processing by a computer.
- the FM detection unit 60 includes a delay unit 62, a multiplication unit 64, and an LPF 66, and is configured as a quadrature detection digital signal processing unit.
- the delay unit 62 delays the phase of the reception signal by ⁇ / 2 (90 °), and the multiplication unit 64 multiplies the reception signal delayed by the delay unit 62 and the reception signal from the unnecessary signal removal unit 40.
- the LPF 66 removes unnecessary high-frequency components from the multiplication result obtained by the multiplication unit 64.
- the FM detection unit 60 by performing quadrature detection of a received signal by digital signal processing by a microcomputer, the frequency modulation wave component of the received signal can be converted to baseband, and as a result, transmission data Can be restored.
- the unnecessary signal removal unit 40 includes a band-pass filter (hereinafter referred to as BPF) 42 that is a digital filter, an oscillation unit 44, a multiplication unit 46, a BPF 48 that is a digital filter, and amplitude detection.
- BPF band-pass filter
- Unit 50 LPF 52 which is a digital filter
- division unit 56 division unit
- the BPF 42 selects only a signal having a predetermined bandwidth (18 kHz ⁇ 2 kHz in this embodiment) required for restoring the transmission data in the FM detector 60 from the reception signal input from the A / D converter 38. For the purpose of passing (in other words, extracting).
- the received signal that has passed through the BPF 42 is input to the multiplier 46 and the amplitude detector 50.
- the multiplying unit 46 multiplies the received signal input via the BPF 42 by the local signal generated at the constant frequency (13.1 kHz in the present embodiment) generated by the oscillating unit 44, thereby receiving the received signal ( (Frequency: 16 kHz to 20 kHz) is converted to a predetermined intermediate frequency (2.9 kHz to 6.9 kHz).
- the oscillating unit 44 generates a local oscillation signal having a constant frequency by dividing the operation clock of the microcomputer.
- the BPF 48 selectively passes the reception signal frequency-converted to the intermediate frequency (2.9 kHz to 6.9 kHz) out of the output from the multiplication unit 46, and the pass bandwidth is 2. It is set to 9 kHz to 6.9 kHz.
- the received signal that has passed through the BPF 48 is input to the divider 56.
- the amplitude detection unit 50 extracts an unnecessary signal component superimposed on the reception signal by performing envelope detection on the reception signal input from the BPF 42.
- the transmission device 10 changes the oscillation frequency of the numerically controlled oscillator 14 according to the value of transmission data (“0” or “1”), thereby transmitting a frequency-modulated sinusoidal transmission. Since the signal is generated, the transmission wave (sound wave) output from the speaker 22 of the transmission device 10 is as shown in the middle part of FIG.
- this transmission wave is constant, during the sound wave communication, not only the transmission wave from the transmission device 10 but also the reflected wave reflected by the surrounding object is delayed on the microphone 32 of the reception device 30. Input as a wave.
- the reception signal input via the microphone 32 is a signal obtained by synthesizing the transmission wave and the delay wave from the transmission device 10, and the amplitude of the signal varies depending on the delay wave and the change of the transmission path.
- the amplitude detection unit 50 performs envelope detection on the reception signal.
- the detection signal subjected to the envelope detection by the amplitude detection unit 50 is input to the LPF 52 that selectively passes the unnecessary signal component, and the unnecessary signal component that has passed the LPF 52 is input to the division unit 56.
- the cut-off frequency of the LPF 52 is set to 1 kHz to 1.1 kHz, for example. This is set in consideration of the transmission rate of data from the transmission device 10 to the reception device 30 being 2.2 kbps, and the cutoff frequency of the LPF 52 can be appropriately set according to the communication rate. Good.
- the division unit 56 divides the reception signal input via the BPF 48 by the unnecessary signal component input via the LPF 52, thereby removing the unnecessary signal component from the reception signal and removing the unnecessary signal component.
- the received signal is output to the FM detector 60.
- processing time of the received signal by the multiplier 46 and the BPF 48 and the processing time of the received signal by the amplitude detector 50 and the LPF 52 are set to be the same time. This is to synchronize the received signal input to the division unit 56 and the unnecessary signal component.
- the selectivity of the BPF 42 is set lower than the selectivity of the BPF 48 by making the number of taps of the BPF 42 smaller than that of the BPF 48.
- the transmission apparatus 10 generates a transmission signal by frequency-modulating a carrier wave in an audio frequency band that can be received by a microphone with transmission data. By outputting the transmission signal to the speaker 22, a frequency-modulated sound wave is transmitted.
- the microphone 32 is used to receive a sound wave from the transmitting device 10, and the received signal is subjected to envelope detection to extract an unnecessary signal component, and the extracted unnecessary signal component is received as a received signal. Remove from.
- the transmission signal from the transmission device 10 is restored as reception data by performing FM detection on the reception signal after removal of unnecessary signal components.
- the transmission data from the transmission device 10 can be accurately restored on the reception device 30 side without transmitting the pseudo noise code from the transmission device 10.
- a so-called acoustic coupler and a speaker on the transmitting device side It is necessary to bring the microphone on the receiver side close.
- the sound wave communication system of the present embodiment when the transmitter 10 and the receiver 30 are in close contact, the sound wave output from the speaker 22 is directly input to the microphone 32. Even if the transmitting device 10 and the receiving device 30 are arranged with an interval of about 70 cm, data communication can be performed without any problem.
- the addition value setting unit 12 and the numerically controlled oscillation unit 14 provided in the transmission device 10 correspond to an example of the frequency modulation unit of the present invention, and are similarly provided in the transmission device 10.
- the circuit 20 and the speaker 22 correspond to an example of a sound wave generator of the present invention.
- the unnecessary signal removing unit 40 provided in the receiving device 30 corresponds to an example of the unnecessary signal removing unit of the present invention
- the FM detecting unit 60 similarly provided in the receiving device 30 is an FM detecting unit of the present invention. It corresponds to an example.
- the BPF 42 corresponds to an example of the first filter unit of the present invention
- the oscillation unit 44 and the multiplication unit 46 correspond to an example of the frequency conversion unit of the present invention
- the BPF 48 The amplitude detection unit 50 corresponds to an example of the envelope detection unit of the present invention
- the LPF 52 corresponds to an example of the third filter unit of the present invention
- the division unit 56 corresponds to an example of the second filter unit of the present invention.
- the removal unit of the present invention corresponds to an example of the removal unit of the present invention.
- the addition value setting unit 12 and the numerically controlled oscillation unit 14 of the transmission device 10 are used for software processing by a computer.
- each of these units may be realized by a digital circuit that performs digital signal processing or an analog circuit that performs analog signal processing.
- each of these units is realized by software processing by a computer as in the above embodiment, as shown in FIG. 4, as a function of a computer system including a microphone and a speaker, sound wave communication is performed.
- a transmission device or a reception device can be realized.
- the sonic communication system of the present invention is configured in the portable information processing device. It is possible to incorporate functions as a transmitting device and a receiving device.
- the portable information processing terminal 70 usually performs wireless communication via an input unit 72 including a touch panel and various key switches, a display unit 74 including a liquid crystal display panel and the like, and an antenna 76.
- the wireless communication part 78 to perform and the control part 80 containing a computer (CPU) are provided.
- the portable information processing terminal 70 is also provided with a microphone 82 and a speaker 84 for a user to input and output voice for a call and the like, and an oscillator 86 that generates an operation clock of the control unit 80. Is also provided.
- the microphone 82 is connected to the control unit 80 via an amplifier circuit 83 that amplifies an audio signal input from the microphone 82 and an A / D converter 85.
- the speaker 84 is a D / A converter 87 that D / A converts the output (audio signal) from the control unit 80 and an amplifier circuit that amplifies the audio signal D / A converted by the D / A converter 87. It is connected to the control unit 80 via 88.
- this type of portable information processing terminal 70 is caused to function as the transmission device 10 described above, the above-described addition value setting is stored in a storage medium (such as a data rewritable nonvolatile memory) in the control unit 80.
- a storage medium such as a data rewritable nonvolatile memory
- a program for executing transmission signal generation processing as the unit 12 and the numerical control oscillation unit 14 may be written, and the program may be executed by the control unit 80 (specifically, CPU) as necessary.
- the unnecessary signal removing unit 40, the FM detecting unit 60, and the waveform shaping unit 68 described above are stored in the storage medium in the control unit 80.
- a program for executing the reception signal processing may be written, and the CPU may execute the program as necessary.
- the functions as the transmitting device 10 and the receiving device 30 are incorporated in the portable information processing terminal 70 as described above, desired data can be transmitted and received between the portable information processing terminals 70 by sonic communication. Usability of the portable information processing terminal 70 can be improved.
- a transmission device 10 may be provided in the vicinity of a display shelf of products, and a URL of a home page where detailed description of the products is made may be periodically transmitted.
- the customer can obtain the URL from the transmission device 10 and browse the home page using the portable information processing terminal 70 having the function as the reception device 30, and the radio wave communication according to the present invention.
- Applications of the system can be expanded.
- the transmission apparatus 10 can be configured by a simple transmitter 90 shown in FIG.
- the simple transmitter 90 takes in a control unit 92 including a one-chip microcomputer, an oscillator 94 that generates an operation clock for the control unit 92, and an operation clock output from the oscillator 94 to the control unit 92.
- a frequency dividing circuit 96 that generates an oscillation signal having a desired frequency by rotating and a speaker 98 that receives an output from the frequency dividing circuit 96 and generates a sound wave are configured.
- control unit 92 switches the frequency dividing ratio of the frequency dividing circuit 96 according to the transmission data in accordance with the control program stored in the built-in memory (ROM), so that the data value of the transmission data is changed from the frequency dividing circuit 96.
- a frequency modulation signal whose frequency is switched in response is output.
- this simple transmitter 90 can be comprised with very few components, and since it can achieve size reduction and cost reduction, it can utilize for various information transmission.
- the signal generated by the frequency dividing circuit 96 is a rectangular wave, so that the transmission wave from the speaker 98 is also a rectangular wave as described in the lower part of FIG. Even if the sound wave by the rectangular wave is transmitted, the reception side can restore the transmission data normally.
- a transmission function equivalent to the simple transmitter 90 (that is, a transmission function using a frequency dividing circuit) is incorporated into various sensors incorporating a microcomputer, such as an electronic thermometer and a barcode reader. If detection data such as a barcode is transmitted by sound waves, various types of detection data can be managed using the portable information processing terminal 70 having a function as the receiving device 30.
- FIG. 6 is a block diagram illustrating a conceptual configuration of the broadcast system according to the embodiment.
- This broadcasting system includes a broadcasting device 1, a receiving device 2, and a portable device 3.
- the broadcast device 1 is a device that generates and transmits (broadcasts) broadcast information.
- the broadcast information is information representing video and sound of a television broadcast.
- the broadcast information is information representing a radio broadcast sound.
- the broadcasting device 1 is used in broadcasting stations such as television broadcasting and radio broadcasting.
- the broadcasting device 1 includes a generation unit 1A and a transmission unit 1B.
- the generation unit 1A generates broadcast information.
- the transmission unit 1B transmits (broadcasts) the broadcast information generated by the generation unit 1A.
- the transmitted broadcast information can be received by one or more (usually many) receiving devices 2.
- the receiving device 2 is a device that receives and reproduces broadcast information.
- the receiving device 2 is a television broadcast receiving device, and in another example, is a radio broadcast receiving device.
- the receiving device 2 has at least a function of reproducing sound represented by broadcast information.
- the receiving device 2 includes a receiving unit 2A and a reproducing unit 2B.
- the receiving unit 2A receives broadcast information transmitted (broadcast) by the broadcasting device 1 via a broadcast network, the Internet, or the like.
- the reproduction unit 2B reproduces sound represented by the broadcast information received by the reception unit 2A.
- the reproduced sound can be input by one or more devices having a function of inputting sound.
- the portable device 3 is a device that can be carried by the user.
- the mobile device 3 is a communication device (for example, a mobile phone or a tablet terminal) capable of communication via a telephone line network or the Internet.
- the portable device 3 has at least a function of inputting sound.
- the portable device 3 includes a sound input unit 3A, a control unit 3B, a display unit 3C, an operation unit 3D, a communication unit 3E, and a sound output unit 3F.
- the sound input unit 3A inputs a sound wave signal in a specific frequency band included in the sound reproduced by the receiving device 2. In one example, the sound input unit 3A inputs sound wave signals by diverting a sound input microphone.
- the control unit 3B includes a memory for storing a program, a processor for executing the program, and the like, and executes processing based on information represented by the sound wave signal input by the sound input unit 3A.
- the display unit 3C displays a digital image (a broad image and includes characters) on the display screen.
- the operation unit 3D receives an operation by the user.
- the communication unit 3E performs communication via a telephone line network or the Internet.
- the sound output unit 3F outputs sound.
- the sound wave signal is a signal that can be output from a speaker and is carried by sound waves in a frequency band that can be input by a microphone.
- data can be transmitted and received using a speaker and a microphone.
- the sonic communication system of the first embodiment described with reference to FIGS. 1 to 5 can be used.
- the broadcasting system of FIG. 6 can be configured by utilizing at least a part of the configuration of the sound wave communication system described in the first embodiment. Configurations can also be used.
- Teleshopping here means that a merchandise seller introduces a merchandise to a user as a viewer who watches a program using a television broadcast receiving device, and receives a purchase intention from the user. It is a service to buy and sell.
- a user In teleshopping, a user needs to communicate the intention of purchase to a merchandise seller by using means other than a television broadcast receiving device (for example, a telephone or the Internet).
- a television broadcast receiving device for example, a telephone or the Internet.
- an operation for example, a search operation or a URL input operation
- an Internet-enabled electronic device for example, a PC or a mobile phone. I must.
- the broadcast device 1 is a device that generates and transmits (broadcasts) information representing video and sound of a television broadcast as broadcast information in a television broadcast station.
- the generation unit 1A includes a video information output unit 111, a display information output unit 112, a sound information output unit 113, a transmission information output unit 114, and a video information composition.
- a unit 115, a sound information synthesis unit 116, and a broadcast information generation unit 117 are provided.
- the video information output unit 111 outputs original video information.
- the original video information is information representing an original video before superimposing a video represented by display information to be described later, and is, for example, a video shot by a camera, a video edited after shooting, or the like.
- the display information output unit 112 outputs display information to be displayed superimposed on the original video.
- display information includes a product number (product identification information) 410, a product name 420, a product price (price, shipping cost, etc.) 430, a product seller's telephone number 440, and a product seller.
- Internet address for example, web page URL, site name, etc.
- 450 represents information (video).
- the sound information output unit 113 outputs original sound information.
- Original sound information is information that represents an original sound before adding transmission information, which will be described later, such as sound recorded by a microphone (sound, music, etc.) or sound edited after recording. is there.
- the transmission information output unit 114 outputs transmission information to be reproduced together with the original sound.
- the transmission information is information representing a sound wave signal.
- the video information synthesis unit 115 inputs the original video information output from the video information output unit 111 and the display information output from the display information output unit 112.
- the video information synthesis unit 115 generates video information in which the video represented by the display information is superimposed on the original video represented by the original video information (that is, the original video information and the display information are synthesized). And output to the broadcast information generation unit 117.
- the sound information synthesis unit 116 inputs the original sound information output from the sound information output unit 113 and the transmission information output from the transmission information output unit 114. Then, the sound information synthesis unit 116 generates sound information in which the sound represented by the transmission information is added to the original sound represented by the original sound information (that is, the original sound information and the transmission information are synthesized). And output to the broadcast information generation unit 117.
- the broadcast information generation unit 117 inputs the video information output from the video information synthesis unit 115 and the sound information output from the sound information synthesis unit 116, generates broadcast information including these, and transmits the transmission unit 1B. Output to.
- the transmission unit 1B transmits (broadcasts) the broadcast information generated by the generation unit 1A.
- the receiving device 2 receives broadcast information of a television broadcast transmitted (broadcasted) by the broadcasting device 1 via a broadcast network, the Internet, etc., and receives video and sound represented by the broadcast information.
- the reproduction unit 2B includes a channel selection unit 211, a broadcast information separation unit 212, a video reproduction unit 213, and a sound reproduction unit 214.
- the reception unit 2A receives broadcast information transmitted (broadcast) by the broadcast device 1 via a broadcast network, the Internet, or the like, and outputs it to the reproduction unit 2B.
- the receiving unit 2A receives broadcast information of a plurality of channels.
- the channel selection unit (tuner) 211 selects the broadcast information of the currently selected channel from the broadcast information of a plurality of channels included in the broadcast information output from the reception unit 2A, and selects the selected broadcast information. Output to the broadcast information separation unit 212.
- the broadcast information separation unit 212 receives the broadcast information output from the channel selection unit 211, separates the video information and the sound information included in the broadcast information, outputs the video information to the video reproduction unit 213, and outputs the sound information.
- the sound is output to the sound reproduction unit 214.
- the video playback unit 213 includes a display screen 215 for displaying video. Then, the video reproduction unit 213 inputs the video information output from the broadcast information separation unit 212 and displays the video represented by the video information on the display screen 215.
- the sound reproduction unit 214 includes a speaker 216 for outputting sound.
- the sound reproduction unit 214 receives the sound information output from the broadcast information separation unit 212, and outputs the sound represented by the sound information from the speaker 216.
- the mobile device 3 is a mobile phone (including a so-called smartphone) that can be carried by the user and can communicate via a telephone line network or the Internet.
- the sound input unit 3A includes a microphone 311 for inputting sound.
- the microphone 311 can input not only sounds such as voice and music reproduced by the receiving device 2 but also sound wave signals of a specific frequency band included in the sound reproduced by the receiving device 2.
- the sound input unit 3A outputs the input sound wave signal to the control unit 3B.
- the control unit 3B includes a memory 312 that stores a program, and a processor 313 that executes the program.
- the control unit 3B executes processing based on information represented by the sound wave signal input by the sound input unit 3A.
- the display unit 3 ⁇ / b> C includes a display screen 314 that displays various types of information (for example, characters and images) for the user to visually recognize. Then, the display unit 3C displays information represented by the sound wave signal on the display screen 314 in accordance with a command from the control unit 3B.
- the operation unit 3D includes a touch panel 315 that receives an operation by a user.
- the touch panel 315 has a transparent panel shape and is provided so as to overlap the display screen 314. Then, the operation unit 3D receives a user operation on information represented by the sound wave signal displayed on the display screen 314, and outputs information representing the operation content to the control unit 3B.
- the communication unit 3E includes a telephone communication unit 316 for performing communication via a telephone line network, an Internet communication unit 317 for performing communication via the Internet, and a short-range communication unit 318 for performing short-range wireless communication. And comprising.
- the communication unit 3E performs a process of making a call to a designated telephone number, a process of transmitting information to a predetermined Internet address, and a process of receiving information in accordance with a command from the control unit 3B.
- short-range wireless communication for example, short-range wireless communication according to the Bluetooth (registered trademark) standard, short-range wireless communication according to the Wi-Fi (registered trademark) standard, or the like may be used.
- the sound output unit 3F includes a speaker 319 for outputting sound and a jack 320 for connecting headphones or the like, and according to a command from the control unit 3B, sounds (for example, voice or music) are output from the speaker 319 or Output from the jack 320.
- the television cooperation process may be constantly executed, for example, in a state where a specific application is activated in the mobile device 3. Further, the television cooperation process may be started when a specific operation is performed, for example, and then ended when a predetermined end condition is satisfied (for example, after a predetermined time elapses).
- the television cooperation process may be always executed in a state where the mobile device 3 is powered on, for example.
- the processor 313 determines whether or not a sound wave signal is input by the sound input unit 3A.
- the process proceeds to S12, and after the information represented by the sound wave signal is displayed on the display unit 3C (display screen 314), the process proceeds to S13.
- the processor 313 determines in S11 that no sound wave signal is input, it skips S12 and shifts the processing to S13. In S13, the processor 313 determines whether or not the information represented by the sound wave signal is displayed on the display screen 314 and a communication request operation based on the information has been performed.
- the processor 313 determines that the communication request operation has been performed, the processor 313 shifts the process to S14, causes the communication unit 3E to execute the requested communication, and then shifts the process to S11.
- FIG. 11 is a conceptual diagram of the broadcasting system of the first configuration example.
- the receiving device 2 receives teleshopping broadcast information broadcast by a television broadcast station (broadcasting device 1), displays a video represented by the received broadcast information on the display screen 215, and represents the received broadcast information. Sound is output from the speaker 216.
- the video displayed on the display screen 215 includes, as information about the product being introduced, a product number (product identification information) 410, a product name 420, a product price (such as the price of the product itself and the postage) 430, a product seller Product information such as a telephone number 440 and an Internet address (for example, URL or site name) 450 of the product seller are superimposed on the original video as display information.
- the sound output from the speaker 216 includes a sound wave signal representing the product information displayed on the display screen 215.
- the portable device 3 inputs the sound output from the speaker 216 from the microphone 311 and displays information (product information displayed on the display screen 215) represented by the sound wave signal included in the sound on the display screen 314.
- the portable device 3 When the operation for selecting the telephone number 440 is performed on the touch panel 315, the portable device 3 performs a process of making a call to the telephone number. In addition, when an operation for selecting the Internet address 450 is performed on the touch panel 315, the portable device 3 performs a process of accessing the Internet address.
- the portable device 3 may perform, for example, a process of acquiring web page data as a process of accessing an Internet address.
- a configuration example when the present invention is applied to radio shopping will be described as a second configuration example.
- Radio shopping here means that a merchandise seller introduces a product to a user as a listener (listener) who listens to a program using a radio broadcast receiver, and receives an intention to purchase from the user. It is a service for buying and selling goods.
- a user as a listener sells merchandise to purchase using means other than a radio broadcast receiving device (for example, a telephone or the Internet) in the same manner as the user as a teleshopping viewer described above. It is necessary to tell the person.
- a radio broadcast receiving device for example, a telephone or the Internet
- the broadcast device 1 is a device that generates and transmits (broadcasts) information representing radio broadcast sound as broadcast information in a radio broadcast station.
- An example of radio broadcasting is digital broadcasting.
- the generation unit 1A includes a sound information output unit 121, a transmission information output unit 122, and a broadcast information generation unit 123.
- the sound information output unit 121 outputs original sound information.
- the original sound information is information representing the original sound before the transmission information is added, and is, for example, a sound recorded by a microphone (sound, music, etc.) or a sound edited after recording.
- the transmission information output unit 122 outputs transmission information to be reproduced together with the original sound.
- the transmission information is information representing a sound wave signal.
- the broadcast information generation unit 123 receives the original sound information output from the sound information output unit 121 and the transmission information output from the transmission information output unit 122.
- the broadcast information generation unit 123 generates sound information in which the sound represented by the transmission information is added to the original sound represented by the original sound information (that is, the original sound information and the transmission information are synthesized). Then, broadcast information including the generated sound information is generated and output to the transmission unit 1B.
- the transmission unit 1B transmits (broadcasts) the broadcast information generated by the generation unit 1A.
- the receiving device 2 receives radio broadcast information transmitted (broadcast) by the broadcast device 1 via a broadcast network or the Internet, and reproduces sound represented by the broadcast information. (Radio broadcast receiving device), for example, mounted in an automobile.
- the playback unit 2B includes a channel selection unit 221 and a sound playback unit 222.
- the reception unit 2A receives broadcast information transmitted (broadcast) by the broadcast device 1 via a broadcast network, the Internet, or the like, and outputs it to the reproduction unit 2B.
- the channel selection unit (tuner) 221 selects the broadcast information of the currently selected channel from the broadcast information of a plurality of channels included in the broadcast information output from the reception unit 2A, and selects the selected broadcast information.
- the sound is output to the sound reproduction unit 222.
- the sound reproduction unit 222 includes a speaker 223 for outputting sound.
- the sound reproduction unit 222 receives the broadcast information output from the channel selection unit 221 and outputs the sound represented by the broadcast information from the speaker 223.
- the mobile device 3 is a mobile phone (including a so-called smartphone) that can be carried by the user and can communicate via a telephone line network or the Internet. Since the hardware configuration of the portable device 3 is the same as that of the first configuration example (FIG. 9) described above, the description thereof is omitted.
- the radio link processing may be executed constantly in a state where a specific application is activated in the mobile device 3, for example. Further, the radio cooperation process may be started when a specific operation is performed, for example, and then ended when a predetermined end condition is satisfied (for example, after a predetermined time has elapsed). Moreover, you may make it perform a radio
- the processor 313 determines whether or not a sound wave signal is input from the sound input unit 3A. If the processor 313 determines that a sound wave signal has been input, the processor 313 moves the process to S22 and displays information represented by the sound wave signal on the display unit 3C (display screen 314).
- the processor 313 causes the communication unit 3E to execute processing for acquiring moving image data representing a moving image corresponding to information represented by the sound wave signal from a server on the Internet.
- the processor 313 executes synchronous reproduction processing for reproducing the moving image represented by the acquired moving image data in synchronization with the radio broadcast. Thereafter, the processor 313 shifts the processing to S25.
- the moving image reproduction process can be realized as follows, for example. (1) When the moving image data itself is data that is reproduced in synchronization with the radio broadcast When the moving image data itself is data that is reproduced in synchronization with the radio broadcast, it is necessary to perform special processing in the portable device 3 There is no. For example, it is a case where moving image data is streamed and reproduced in accordance with a radio broadcast.
- the mobile device 3 When the moving image data is data independent of the radio broadcast, the mobile device 3 needs to synchronize with the radio broadcast. In this case, based on information obtained from the radio broadcast, it may be determined which time point in the moving image the current broadcast content corresponds to, and the moving image may be reproduced from that point.
- the receiving device 2 outputs information that allows the portable device 3 to specify the timing based on the sound or sound wave signal heard by the user, and the portable device 3 specifies and reproduces the corresponding time point in the video based on the timing. May be.
- the receiving device 2 outputs start information to the mobile device 3 at a timing corresponding to the start point of the moving image, and the mobile device 3 measures the time from the start information, whereby the time in the moving image. You may make it synchronize with.
- the processor 313 determines in S21 that no sound wave signal is input, it skips S22 to S24 and moves the process to S25.
- the processor 313 determines whether or not the information represented by the sound wave signal is displayed on the display screen 314 and a communication request operation based on the information has been performed.
- the process proceeds to S26, the communication unit 3E performs the requested communication, and then the process proceeds to S27.
- the processor 313 determines whether information represented by the sound wave signal is displayed on the display screen 314 and whether a product storage operation based on the information has been performed.
- the product storage operation is an operation for the user to store the product currently introduced in the radio shopping in the portable device 3. If the processor 313 determines that the product storage operation has been performed, the process proceeds to S28, performs the process for storing the product, and then proceeds to S21.
- the processor 313 determines that the communication request operation has not been performed, the processor 313 skips S28 and shifts the processing to S21.
- the product notification process executed by the processor 313 when the product is stored in S28 described above will be described with reference to the flowchart of FIG.
- the product notification process may be constantly executed in a state where a specific application is activated in the mobile device 3, for example.
- the product notification process may be started when a specific operation is performed, for example, and then ended when a predetermined end condition is satisfied (for example, after a predetermined time elapses).
- the merchandise notification process may be executed constantly, for example, while the mobile device 3 is powered on.
- the processor 313 determines whether or not a sound wave signal related to the stored product has been input from the television broadcast receiving apparatus. If it is determined that the sound wave signal has been input, the processor 313 executes the notification process in S32.
- the sound wave signal related to the stored product is included in the CM of the product, for example.
- the notification process is a process for notifying the user that a CM currently broadcast on a television broadcast receiving apparatus is a product that has been introduced in radio shopping in the past. Information may be displayed on the screen 314, sound may be output from the speaker 319, and notification may be made with a vibration function.
- FIG. 16 is a conceptual diagram of the broadcasting system of the second configuration example.
- the receiving device 2 receives radio shopping broadcast information broadcast by a radio broadcast station (broadcast device 1), and outputs a sound represented by the received broadcast information from the speaker 223.
- the sound output from the speaker 223 includes a sound wave signal representing product information related to a product introduced in radio shopping.
- the portable device 3 inputs the sound output from the speaker 223 from the microphone 311, and displays information (product information related to products introduced in radio shopping) 410 to 450 represented by a sound wave signal included in the sound on the display screen 314. To display.
- the product information 410 to 450 illustrated in FIG. 16 is the same as the product information 410 to 450 of the first configuration example (FIG. 11) described above.
- the mobile device 3 acquires moving image data representing a moving image related to the product (specifically, a moving image for viewing according to the radio broadcast) from a server on the Internet, and synchronizes the moving image with the radio broadcast. Synchronous reproduction processing for reproducing the moving image 460 represented by the data is executed. Therefore, the user can view the moving image (video) 460 in addition to the sound by the radio broadcast.
- the portable device 3 When the operation for selecting the telephone number 440 is performed on the touch panel 315, the portable device 3 performs a process of making a call to the telephone number. In addition, when an operation for selecting the Internet address 450 is performed on the touch panel 315, the portable device 3 performs a process of accessing the Internet address.
- the portable device 3 performs processing for storing information on the product. Thereafter, when the mobile device 3 receives a sound wave signal related to the product by broadcasting the commercial CM or the like on the television broadcast receiving device, the mobile device 3 notifies the user by performing a notification process.
- a user as a viewer needs to purchase a betting ticket by means other than a television broadcast receiving device (for example, a window, a telephone vote, an internet vote, etc.). Therefore, in the third configuration example, necessary information is transmitted from the receiving device for viewing the horse racing relay to the portable device carried by the user using the technology of sonic communication.
- a television broadcast receiving device for example, a window, a telephone vote, an internet vote, etc.
- the hardware configuration of the broadcasting system of the third configuration example is the same as that of the first configuration example (FIGS. 7 to 9) described above, and thus the description thereof is omitted.
- the basic flow of the process which the portable apparatus 3 performs is the same as that of the television cooperation process (FIG. 10) mentioned above, description is abbreviate
- FIG. 17 is a conceptual diagram of the broadcasting system of the third configuration example.
- the receiving device 2 receives the broadcast information of the horse racing relay broadcast by the broadcasting station (broadcasting device 1) of the television broadcast, displays a video represented by the received broadcast information on the display screen 215, and represents the received broadcast information. Sound is output from the speaker 216.
- the video displayed on the display screen 215 includes race identification information (in this example, the racetrack name and race number) 510, the racehorse number (horse number) 520 as the subject, as information regarding the race being relayed.
- Race information such as racehorse name 530, horse weight and increase / decrease 540 from the previous race, jockey name 550, saddle amount 560, etc. are superimposed on the original video as display information.
- the sound output from the speaker 216 includes a sound wave signal representing the race information displayed on the display screen 215 and the betting ticket information related to the racehorse that is the subject.
- the portable device 3 inputs the sound output from the speaker 216 from the microphone 311, and the information represented by the sound wave signal included in the sound (the race information 510 to 560 displayed on the display screen 215 and the subject).
- the betting ticket information 570 to 580) related to the running horse is displayed on the display screen 314.
- the portable device 3 acquires information on the race (for example, a race table and odds) from a server on the Internet.
- the portable apparatus 3 will acquire the betting ticket information which the horse number entangles from the server on the internet. Moreover, if operation which selects the racehorse name 530 is performed with the touch panel 315, the portable apparatus 3 will acquire the information regarding the racehorse (for example, pedigree, past results, etc.) from the server on the Internet.
- the racehorse for example, pedigree, past results, etc.
- the portable device 3 transmits information relating to horse weight (for example, past horse weight, horse weight of other racehorses, etc.) to a server on the Internet. Get from.
- the portable device 3 acquires information on the jockey (for example, past results) from a server on the Internet.
- the portable device 3 acquires information on the saddle amount (for example, past saddle amount and other racehorse etc.) from a server on the Internet.
- the portable device 3 performs processing for purchasing the betting ticket represented by the touched betting ticket information via the Internet.
- the present invention is not limited to this, and various purchases are possible.
- a horse or a combination spoken by a commentator or the like may be selected with one touch.
- horse racing is taken as an example here, the present invention may be applied to other events that can be voted by the user (for example, sports such as bicycle racing, boat racing, and soccer).
- the video of a desired program can be viewed by simultaneously displaying the video of two different programs.
- the sounds of two different programs are output at the same time, the content becomes difficult to hear.
- the sound of at least one program is transmitted using a sound wave signal.
- the hardware configuration of the broadcasting system of the fourth configuration example is basically the same as that of the first configuration example (FIGS. 7 to 9) described above, but the configuration of the receiving device 2 is slightly different, so this point will be described. To do.
- the receiving device 2 receives broadcast information of a television broadcast transmitted (broadcasted) by the broadcasting device 1 via a broadcast network or the Internet, and reproduces video and sound represented by the broadcast information.
- This is a device (television broadcast receiving device).
- the receiving device 2 of the fourth configuration example has a function of simultaneously displaying videos of two different programs.
- the playback unit 2B includes a first channel selection unit 241, a second channel selection unit 242, a first broadcast information separation unit 243, and second broadcast information.
- a separation unit 244, a video reproduction unit 245, and a sound reproduction unit 246 are provided.
- the reception unit 2A receives broadcast information transmitted (broadcast) by the broadcast device 1 via a broadcast network, the Internet, or the like, and outputs it to the reproduction unit 2B.
- the first channel selection unit 241 and the second channel selection unit 242 are the same as the channel selection unit 211 of the first configuration example.
- the first channel selection unit 241 outputs the selected broadcast information to the first broadcast information separation unit 243.
- the second channel selection unit 242 outputs the selected broadcast information to the second broadcast information separation unit 244.
- the first broadcast information separation unit 243 and the second broadcast information separation unit 244 are the same as the broadcast information separation unit 212 of the first configuration example, and output video information to the video playback unit 245, respectively.
- the sound information is output to the sound reproduction unit 246.
- the video playback unit 245 includes a display screen 247 for displaying video. Then, the video reproduction unit 245 receives the video information output from the first broadcast information separation unit 243 and the second broadcast information separation unit 244 and displays the video represented by the video information on the display screen 247.
- the video represented by the video information from the first broadcast information separation unit 243 is displayed on the display screen 247. That is, the video represented by the video information from the second broadcast information separation unit 244 is not displayed.
- the video represented by the video information from the first broadcast information separation unit 243 and the video represented by the video information from the second broadcast information separation unit 244 are simultaneously displayed. It is displayed on the screen 247.
- two videos may be arranged side by side, and one video may be displayed inside the other video.
- the sound reproduction unit 246 includes a speaker 248 for outputting sound. Then, the sound reproduction unit 246 receives the sound information output from the first broadcast information separation unit 243 and the second broadcast information separation unit 244 and outputs the sound represented by the sound information from the speaker 248.
- the sound represented by the sound information from the first broadcast information separation unit 243 is output from the speaker 248. That is, the sound represented by the sound information from the second broadcast information separation unit 244 is not output.
- the sound reproduction unit 246 is set to the two-screen display, the sound that is set to be output from the speaker 248 (except the sound wave signal) and the sound wave signal included in the other sound Are output from the speaker 248.
- the sound wave signal is information representing the original sound of the program.
- the sound reproduction unit 246 selects the original sound A1 of the program A and the program among the sound of the program A (original sound A1 + sound wave signal A2) and the sound of the program B (original sound B1 + sound wave signal B2).
- a B sound wave signal B2 is output.
- the original sound B1 of program B and the sound wave signal A2 of program A are output.
- the sound reproduction process may be always executed in a state where a specific application is activated in the mobile device 3, for example.
- the sound reproduction process may be started when a specific operation is performed, for example, and then ended when a predetermined end condition is satisfied (for example, after a predetermined time elapses). Further, the sound reproduction process may be executed constantly while the mobile device 3 is powered on, for example.
- the processor 313 determines whether or not a sound wave signal is input from the sound input unit 3A. If the processor 313 determines that the sound wave signal has been input, the processor 313 moves the process to S42 and outputs the sound represented by the sound wave signal from the speaker 319.
- the sound is output from the jack 320 without being output from the speaker 319.
- the sound of one program is output from the speaker 248 of the receiving device 2
- the sound of the other program is output from the speaker 319 or the jack 320 (headphone) of the portable device 3.
- the sound wave signal of one program is output, but the sound wave signals representing the sound of a plurality of (two in this example) programs displayed on the display screen 247 are output from the speaker 248.
- the portable device 3 may be selected.
- a selection screen may be displayed on the portable device 3 to allow the user to select a person who wants to hear the sound.
- the sound is not limited to a plurality of programs, and for example, main sound and sub sound may be selected.
- the hardware configuration of the broadcasting system of the fifth configuration example is basically the same as that of the fourth configuration example (FIGS. 18 and 8) described above, but the configuration of the receiving device 2 is slightly different, so this point will be described. To do.
- the receiving device 2 of the fifth configuration example includes a detection unit 2C in addition to the configuration described above (FIG. 18).
- the detection unit 2 ⁇ / b> C includes a camera 251, a short-range communication unit 252, and a control unit 253.
- the camera 251 captures a user as a viewer and grasps information such as the number, position, sex, and age of the user, and is the front of the receiving device 2 (the side on which the display screen 247 is provided). For example, above the display screen 247).
- the near field communication unit 252 performs near field communication with the mobile device 3 carried by the user and acquires user information from the mobile device 3.
- short-range wireless communication for example, short-range wireless communication according to the Bluetooth (registered trademark) standard, short-range wireless communication according to the Wi-Fi (registered trademark) standard, or the like may be used.
- the control unit 253 includes a memory 254 that stores a program, and a processor 255 that executes the program.
- the control unit 253 executes processing for changing a sound wave signal output from the sound reproduction unit 246 according to user information from the camera 251 and the short-range communication unit 252.
- the viewer discrimination process executed by the processor 255 in accordance with the program stored in the memory 254 in the control unit 253 of the detection unit 2C of the receiving device 2 will be described with reference to the flowchart of FIG. Note that the viewer determination process may be executed at all times while the power of the receiving device 2 is on, for example.
- the processor 255 uses the camera 251 and the short-range communication unit 252 to detect information about the user as a viewer.
- the camera 251 detects information such as the number of users, position, sex, and age.
- the short-range communication unit 252 acquires information from which the user can be identified, information on a place of residence, information such as a birthday, information on a privilege held by the user, and the like from the portable device 3.
- the processor 255 selects a sound wave signal corresponding to the user information from a plurality of types of sound wave signals included in the broadcast information, and causes the sound reproduction unit 246 to reproduce the sound wave signal. That is, in the fifth configuration example, a plurality of types of sound wave signals are transmitted from the broadcasting device 1 on the assumption that the receiving device 2 selects them.
- a sound wave signal can be selected and provided as follows. Provide different information to a plurality of users according to the user's position.
- the speaker 248 having directivity is used.
- the sound output direction of the speaker 248 is divided into a plurality of directions.
- a user A located on the left side with respect to the receiving device 2 a user B located on the front side with respect to the receiving device 2, and a user C located on the right side with respect to the receiving device 2 are different. Sound can be output.
- a coupon for example, a coupon
- a specific user such as a birthday user or a user who has a privilege.
- -Information according to the user's age, gender, size, residence, etc. for example, information on content according to age or gender, information on clothes according to age, gender, size, information according to residence, etc.
- Images with different appearances for example, 3D images
- Information according to the user can be provided by selecting and providing the sound wave signal in this way.
- the portable device 3 receives a sound input unit 3A capable of inputting a sound wave signal included in sound reproduced by the receiving device 2 that receives and reproduces broadcast information, and information represented by the sound wave signal input by the sound input unit 3A. And a control unit 3B that executes processing related to the content reproduced by the receiving device 2 (reproduction related processing).
- the portable device 3 can execute processing related to the reproduction content (broadcast content) by the reception device 2 by inputting a sound wave signal included in the sound reproduced by the reception device 2. .
- the portable device 3 includes an operation unit 3D that receives an operation by the user, and the control unit 3B executes a process related to the reproduction content and a process based on the operation received by the operation unit 3D as the reproduction related process.
- the portable device 3 is a process related to the reproduction content, and can execute a process based on an operation by the user.
- the portable device 3 is designated to purchase a product in a state in which information (for example, information on teleshopping, radio shopping, etc.) that introduces the product and recruits a purchaser is broadcast in the receiving device 2 is broadcast.
- information for example, information on teleshopping, radio shopping, etc.
- communication can be performed by an extremely simple operation (for example, a one-touch operation or a simple utterance operation by voice).
- the portable device 3 can be used to display related information (for example, a race table or a running table) by a very simple operation in a state where information (for example, information on horse racing relay) that can be voted by the user is broadcast on the receiving device 2. Odds etc.) and voting (for example, purchase of a betting ticket) can be performed.
- related information for example, a race table or a running table
- the mobile device 3 can check (search) information related to the CM by a very simple operation in a state where the CM is broadcast on the receiving device 2.
- the portable device 3 includes a unit (presentation unit) that presents information to the user, and the control unit 3B causes the presentation unit to present information related to the playback content as playback-related processing.
- the portable device 3 includes a display unit 3 ⁇ / b> C that displays an image so that the user can visually recognize the presentation unit.
- the user of the portable device 3 can grasp the information related to the reproduction content by viewing the image displayed by the portable device 3.
- the portable device 3 displays product information and contact information (for example, a telephone number and an Internet address) in a state where information on contents for introducing a product and recruiting a purchaser is broadcast on the receiving device 2. Can do.
- the portable device 3 can display related information (for example, a start table, odds, etc.) in a state where information of contents that can be voted for by the user is broadcast in the receiving device 2, for example.
- related information for example, a start table, odds, etc.
- the mobile device 3 may display information (for example, a search page, a product website, etc.) for examining (searching) information related to the CM while the CM is broadcast on the receiving device 2. it can.
- information for example, a search page, a product website, etc.
- the mobile device 3 can display subtitles and lyrics related to a program broadcast on the receiving device 2.
- the portable device 3 can display a moving image as well as a still image. For this reason, even if the receiving device 2 cannot reproduce a moving image, such as a radio broadcast receiving device, the mobile device 3 can check the moving image related to the broadcast content.
- the mobile device 3 can display emergency information, CMs, and the like to be notified by the receiving device 2. If information to be displayed on the receiving device 2 is displayed on the portable device 3, the original video can be prevented from being damaged by irrelevant information.
- the portable device 3 includes a sound output unit 3F that outputs a sound so that the user can hear it as a presentation unit.
- the user of the portable device 3 can grasp the information related to the reproduction content by listening to the sound output by the portable device 3.
- the portable device 3 can reproduce the sound of a program that is not output from the receiving device 2 in a state where two programs are simultaneously displayed on the receiving device 2.
- the portable device 3 can reproduce a sound that is not output from the receiving device 2 in a state where a program having main audio and sub audio is displayed on the receiving device 2. Further, for example, the mobile device 3 can notify the emergency information and the like to be notified by the receiving device 2 by sound.
- the portable device 3 includes a communication unit 3E, and the control unit 3B causes the communication unit 3E to execute communication processing related to the playback content as playback related processing. For this reason, the portable device 3 can acquire information that cannot be obtained only by the sound wave signal, or can notify the external device (including the server) of the information.
- the mobile device 3 acquires product information (for example, specifications, images, etc.) from an external device in a state in which the receiver 2 introduces the product and information on the content for recruiting the purchaser is broadcast.
- product information for example, specifications, images, etc.
- the communication processing for purchasing can be performed.
- the portable device 3 acquires related information (for example, a run table, odds, etc.) or information for voting (for example, purchase) in a state in which the information that can be voted by the user is broadcast on the receiving device 2. Information on the betting ticket to be sent).
- related information for example, a run table, odds, etc.
- information for voting for example, purchase
- the mobile device 3 can acquire information related to the CM or transmit information indicating that the CM is being browsed.
- the mobile device 3 can acquire information on a person or an article appearing in a program or CM broadcast on the receiving device 2.
- the portable device 3 stores information (for example, product identification information) acquired from the sound wave signal, and then receives a sound wave signal representing information related to the stored information from the reception device 2. The process of informing is performed.
- the portable device 3 can notify the user when a product introduced by radio shopping is broadcast on a television broadcast receiver thereafter.
- the portable device 3 can instruct the recording device to search for the product introduced in the program or the like of the content that introduces the product and recruits the purchaser from the recorded data of the television broadcast.
- the portable device 3 may be a device other than the communication device in a system that does not require a communication function. For example, if the system simply displays information represented by a sound wave signal transmitted from the receiving device 2 (for example, information for CM) or outputs it as sound, a device other than the communication device (for example, the receiving device 2).
- the portable device 3 may be a remote controller or the like that can be remotely operated.
- the broadcast device 1 transmits broadcast information representing sound including sound wave signals. For this reason, the broadcasting device 1 can provide information used by the mobile device 3 in addition to information that the user can grasp with the five senses (by hearing or vision) from the receiving device 2.
- the broadcasting device 1 transmits information on contents for introducing a product and recruiting purchasers as broadcast information (for example, information on teleshopping, radio shopping, etc.), and purchases the product using the portable device 3 as a sound wave signal.
- broadcast information for example, information on teleshopping, radio shopping, etc.
- purchases the product using the portable device 3 as a sound wave signal for example, information on teleshopping, radio shopping, etc.
- a signal representing information for simplifying the procedure is transmitted.
- the broadcasting device 1 transmits a signal representing communication destination information of communication for purchasing a product as a sound wave signal.
- the broadcast device 1 transmits information about the content for which voting is requested (for example, information on horse racing relay) as broadcast information, and a signal representing information for simplifying a voting procedure using the portable device 3 as a sound wave signal. Send.
- the broadcasting device 1 transmits a signal representing options narrowed down according to the broadcast contents from options that can be voted, as a sound wave signal.
- the user of the portable device 3 can vote based on the options narrowed down according to the broadcast content. Therefore, compared with the case where voting is performed based on all the options regardless of the broadcast content, it is possible to reduce the complexity of the operation, and it is possible to perform an intuitive operation.
- the broadcast device 1 transmits a signal representing product identification information as a sound wave signal. For this reason, the user of the portable device 3 can specify the product without taking notes of the broadcast contents. Accordingly, it is possible to make it difficult to specify that a product cannot be specified when information about the product is obtained from another information source or when the product is purchased.
- Broadcast apparatus 1 transmits a signal representing the sound being broadcast as a sound wave signal.
- a plurality of users listen to different types of sounds (for example, different program sounds, main sound and sub sound of the same program, etc.) separately from the common receiving device 2. be able to.
- the broadcasting apparatus 1 may transmit a signal representing information for simplifying a procedure for searching for information related to the product being broadcast using the portable apparatus 3 as a sound wave signal.
- a signal representing information for simplifying a procedure for searching for information related to the product being broadcast using the portable apparatus 3 as a sound wave signal.
- the URL of the commercial product may be transmitted to the mobile device 3 so that the product website can be accessed with a simple operation (for example, a single touch operation).
- the broadcast device 1 may transmit a signal representing emergency information as a sound wave signal.
- the emergency information is, for example, information such as disaster information (for example, earthquake early warning and various alarms), temporary news, and the like. Such information can reduce the value of the original broadcast, such as being provided by being superimposed on the original video, or being provided by interrupting the original broadcast. On the other hand, if it transmits with a sound wave signal, it can prevent (or it is hard to damage) an original image
- Broadcast apparatus 1 may transmit a signal representing supplementary information (supplemental information) regarding the broadcast content as a sound wave signal.
- supplemental information includes, for example, subtitles such as movies and operas, song lyrics, person detailed information (for example, results of athletes), article detailed information (for example, clothing size and manufacturer), and the like.
- the broadcast device 1 may transmit a signal representing information to be written down regarding the broadcast content as a sound wave signal. For example, it may be information that may require taking notes, such as information on stores, articles, and email addresses introduced in the program. By transmitting such information as a sound wave signal, it is possible to make it less likely that the information needs to be quickly memoized.
- Broadcast apparatus 1 may transmit a signal representing information to be provided to the user as a sound wave signal.
- information such as an application form that can be printed and used.
- information such as an application form can be received and printed.
- the receiving device 2 detects a sound unit signal to be output from a plurality of types of sound wave signals included in the broadcast information based on the detection unit 2C that detects information about the user and the information about the user detected by the detection unit 2C. And a sound reproduction unit 246 for selecting and outputting. For this reason, the sound wave signal according to the user as a listener, a viewer, etc. can be output.
- the receiving device 2 includes a camera for photographing the user as the detection unit 2C. For this reason, for example, it is possible to grasp information such as the number of users, listening (viewing) position, sex, age, and the like, and a sound wave signal corresponding to the grasped information can be output.
- the receiving device 2 includes, as the detection unit 2C, a communication unit for communicating with the mobile device 3 carried by the user. For this reason, for example, it becomes possible to grasp information that can identify a user, information on a place of residence, information on a birthday, information on a privilege that the user has, etc., and sound waves corresponding to the information thus grasped A signal can be output.
- the detection unit 2C detects the position of the user as information about the user, and the sound reproduction unit 246 selects and outputs different sound wave signals according to the position of the user. For example, sound wave signals representing different sounds depending on the position are output.
- a sound wave signal representing a different 3D image is output depending on the position.
- the information to be provided can be individually compared with the case where the common information is provided. It can be made suitable for the user.
- the detection unit 2C may include a plurality of cameras 251 (for example, two at a distance in the horizontal direction) to detect the position of the user more accurately. In this way, it is possible to detect the user's position (existing direction and distance) more accurately than when the user's position is detected by one camera 251.
- the detection unit 2C may detect the position of the user by means other than the camera (for example, an ultrasonic wave or a laser). If it does in this way, a user's position can be detected comparatively correctly using an existing position detection device.
- the detection unit 2C detects the presence or absence of a specific user as information about the user, and the sound reproduction unit 246 outputs a sound wave signal representing special information for the specific user. For this reason, compared with the case where uniform information is provided to a plurality of users, it is possible to provide various services (for example, provision of birthday benefits, provision of member-only benefits, etc.).
- the transmission data from the transmitter 8 can be accurately restored on the receiver 9 side without transmitting the pseudo noise code from the transmitter 8. Further, it is not necessary to transmit a pseudo noise code from the transmitting device or to obtain a multipath delay characteristic value based on the pseudo noise code on the receiving device side so that an unnecessary signal component can be generated on the receiving device side. Therefore, high-accuracy sound wave communication can be executed at high speed.
- a notification sound output from the apparatus may be output including a sound wave signal. That is, many electrically operated devices (for example, electric appliances that operate with commercial power supplies such as refrigerators, rice cookers, microwave ovens, air conditioners, and electronic devices that operate with batteries such as desk clocks) are piezoelectric buzzers. Etc. are provided.
- this type of device outputs a notification sound in order to inform the user of the operating status and the occurrence of an error.
- the notification sound including a sound wave signal, it is possible to notify the mobile device 3 of the operation status and the occurrence of an error.
- FIG. 24 is a block diagram showing a configuration of a notification system as an example having such a device (electric device).
- This notification system includes an electric device 6 and a portable device 3.
- the electric device 6 includes an operation unit 6A, a control unit 6B, a display unit 6C, and a sound output unit 6D.
- the operation unit 6A includes an operation button 610 that receives an operation by the user, and an operation signal receiving unit 620 that receives an operation signal from a remote controller that the user uses for remote operation.
- the control unit 6B includes a memory 630 that stores a program and a processor 640 that executes the program.
- the display unit 6C includes a display screen 650 that displays various types of information (for example, characters and images) that are made visible to the user.
- the display screen 650 may be a simple one (for example, displaying only characters, displaying only a predetermined image, or performing only blinking or lighting of a lamp). Further, the electric device 6 may not include the display unit 6C itself.
- the sound output unit 6D includes a speaker 660 for outputting sound (for example, notification sound or voice message). A piezoelectric buzzer may be used as the sound output unit 6D.
- the mobile device 3 is a mobile phone that can be carried by the user and can communicate via a telephone network or the Internet, as in the above embodiment. Since the hardware configuration of the portable device 3 is the same as that of the first configuration example (FIG. 9) described above, the description thereof is omitted.
- control unit 6B When the control unit 6B detects that an abnormality has occurred in the electrical device 6, the control unit 6B causes the display unit 6C to display an error code corresponding to the abnormality that has occurred, and generates a notification sound (for example, a buzzer sound) indicating the error as a sound output unit Output to 6D.
- the notification sound output from the sound output unit 6D includes a sound wave signal.
- This sound wave signal represents information indicating detailed information (causes and countermeasures) regarding the abnormality that has occurred, and information indicating contact information for a repairer (for example, a support section of a manufacturer).
- the user can receive a sound wave signal by bringing the portable device 3 close to the electric device 6 in such a state.
- the mobile device 3 When the mobile device 3 receives the sound wave signal, the mobile device 3 displays information represented by the sound wave signal on the display screen 314, and accesses a website indicating related information or calls a repairer in accordance with a user's selection operation. To do.
- the portable device 3 may notify the occurrence of an abnormality by automatically sending an e-mail to the repair shop at the stage of receiving the sound wave signal.
- an access information providing system suitable for providing access information to a network device to a mobile terminal device using sonic communication will be described as a third embodiment.
- the communication system of the present embodiment is configured around a local area network (LAN) 705 connected to the Internet via a router 703 and a termination device 704.
- LAN local area network
- Various network devices including a printer 706, a wireless LAN access point 708, and a data processing device 710 are connected to the LAN 705.
- the data processing device 710 processes data transmitted from a network device connected to the LAN 705 or a mobile terminal device (hereinafter simply referred to as a mobile terminal) 730 connected via an access point 708, and a predetermined storage medium ( A hard disk, a silicon disk, a memory card, etc.) or printing using a printer 706.
- the data processing device 710 is configured by a computer having an MPU 712, a ROM 713, and a RAM 714 as the center.
- the data processing device 710 includes an input unit 715 including a keyboard and a mouse, a display unit 716 including an LCD, a storage medium (HDD (hard disk) in the figure) 717 for storing various data, and a LAN 705.
- a wired LAN communication unit 718 for communicating with other network devices, a sound wave transmission unit 720, and the like.
- the sound wave transmission unit 720 is for transmitting sound waves of predetermined data using sound waves (or ultrasonic waves) that can be received by a microphone for calling or voice input provided in the mobile terminal 730.
- the configuration is the same as that of the transmission apparatus 10 of the first embodiment shown in FIG.
- the mobile terminal 730 is, for example, a telephone terminal (mobile phone or smart phone) capable of calling and data communication via a mobile phone line (not shown), and is configured as shown in FIG. .
- the mobile terminal 730 communicates with an antenna 731 and a mobile phone line communication unit 732 for performing communication via a mobile phone line, and with an antenna 733 and a wireless LAN communication unit 734 for performing communication via a wireless LAN.
- a microphone 735 and a speaker 736 are examples of the mobile terminal 730.
- the mobile phone line communication unit 732, the wireless LAN communication unit 734, the microphone 735, and the speaker 736 are connected to a control unit 740 including a microcomputer. Further, the portable terminal 730 is provided with an input unit 737 including various touch keys, a display unit 738 including an LCD and the like, and an imaging camera 739. These units are also connected to the control unit 740.
- the control unit 740 uses the operation mode of the portable terminal 730 from the normal standby mode, the call mode, or the communication units 732 and 734 according to an instruction from the user input via the input unit 737.
- the mode is switched to the communication mode, and various control processes for standby, call, and communication are executed for each of these operation modes.
- the microphone 735 is used not only for voice input during a call, but also for receiving a communication sound wave (or ultrasonic wave) transmitted from the above-described data processing device 710 or the like.
- the control unit 740 is provided with an audio data input unit 741 shown in FIG.
- the voice data input unit 741 converts the voice signal from the microphone 735 into voice data for a call or reception data for sound wave communication according to the operation mode of the portable terminal 730, and takes it into the control unit 740. Is.
- the audio data input unit 741 passes through the amplifier circuit 742 that amplifies the audio signal from the microphone 735, the LPF 743 that removes unnecessary harmonic components from the audio signal amplified by the amplifier circuit 742, and the LPF 743.
- An A / D converter 744 is provided for converting the audio signal thus obtained into audio data.
- the voice data input unit 741 includes a call data processing unit 746 for converting voice data input from the A / D converter 744 into voice data for a call (specifically, for sending), and an A / D.
- a sound wave communication receiving unit 750 is also provided that restores sound wave reception data from the sound data input from the converter 744.
- the call data processing unit 746 operates when the operation mode of the portable terminal 730 is the call mode, and the sound wave communication receiving unit 750 receives a sound wave reception command from the user via the input unit 737. It works when
- the receiving part 750 for sound wave communication is provided with the unnecessary signal removal part, FM detection part, and waveform shaping part similarly to the receiver 30 of 1st Embodiment shown in FIG. For this reason, in the sonic wave communication receiving unit 750, the unnecessary signal component included in the received signal (audio data) is removed by the unnecessary signal removing unit, and the transmission data from the sonic wave transmitting unit 720 is restored by the FM detection unit. It will be.
- the data processing device 710 connected to the LAN 705 is configured to transmit arbitrary data by sound wave transmission from the speaker 728, and data is transmitted to the portable terminal 730.
- a sound wave communication receiving unit 750 that can receive sound waves transmitted from the processing device 710 and demodulate data is provided.
- desired data is transmitted from the data processing device 710 to the portable terminal 730 by sound waves, and the portable terminal 730 side receives the sound waves from the data processing device. Data transmitted by sound waves can be acquired.
- the MPU 712 executes a program stored in the ROM 713 or the HDD 717, thereby starting the TCP / IP server and transmitting the IP address of the TCP / IP server as a sound wave. To do.
- the portable terminal 730 that has acquired the IP address can log in to the TCP / IP server using the wireless LAN.
- a data acquisition process and a data output process executed by the MPU 712 of the data processing device 710 and the control unit 740 of the portable terminal 730 for this purpose will be described with reference to the flowchart shown in FIG.
- the data acquisition process illustrated in FIG. 29 is performed by the MPU 712 when a data input command is input from the administrator of the data processing apparatus 710 or the user of the portable terminal 730 via the input unit 737 in the data processing apparatus 710. It is a process executed in
- S110 (S represents a step)
- data indicating the IP address of the TCP / IP server is output to the sound wave transmitting unit 720, so that the sound wave transmitting unit 720 outputs the IP address. Is transmitted by sound wave.
- the TCP / IP server is activated with the IP address transmitted as a sound wave in S110, and in the subsequent S130, it is determined whether or not a connection request to the TCP / IP server has been transmitted via the LAN 705. Thus, it waits for a connection request to be transmitted.
- connection response is transmitted via.
- subsequent S150 data communication is performed with the mobile terminal 730 via the LAN 705.
- the received data acquired from the mobile terminal 730 by the data communication is processed in the subsequent S160. Then, the data acquisition process ends.
- the received data is stored in the HDD 717 or an external storage medium. If the received data is to be printed out, the received data is transferred to the printer 706 to receive the received data. Print an image corresponding to the data.
- the data output process shown in FIG. 29 is performed when the portable terminal 730 receives a sound wave reception command via the input unit 737 and the sound wave communication receiving unit 750 is operating. This is a process executed by the CPU of the microcomputer constituting the control unit 740.
- a reception process for fetching reception data from the sound wave communication receiving unit 750 of the audio data input unit 741 is executed.
- the process proceeds to S230, and the wireless LAN communication with the access point 708 makes a connection request to the TCP / IP server of the IP address received by sonic communication. Send.
- connection request is transmitted, it is determined in S240 whether or not there is a connection response from the TCP / IP server, and a connection response from the TCP / IP server is waited. If determined, the process proceeds to S250.
- the data processing device 710 connected to the LAN 705 activates a TCP / IP server for receiving data for storage or printing from the mobile terminal 730,
- the portable terminal 730 is notified of the IP address of the TCP / IP server by sonic communication.
- the data processing device 710 functions as the above-described information providing device, and the above-described access information providing system is constructed by the data processing device 710 and the portable terminal 730. .
- the microphone normally provided in the mobile terminal device can be used. There is no need to use short-range communication by code, wireless or infrared.
- access information to a network device (TCP / IP in this configuration example) is transmitted to a mobile terminal device that does not have a two-dimensional code reading function or these short-range communication functions.
- Server IP address (TCP / IP in this configuration example)
- the mobile terminal device is usually provided with a microphone for calling or voice input, and a signal processing circuit that processes a voice signal input from the microphone and converts it into voice data.
- the IP address transmitted as a sound wave can be restored using these.
- the portable terminal 730 receives the signal with the microphone 735 and the A / D converter
- a sound wave communication receiving unit 750 may be provided for restoring received data from the audio data A / D converted at 744.
- this sound wave communication receiving unit 750 can be easily realized by software processing by a digital processing circuit or a microcomputer, it is possible to suppress an increase in cost of the portable terminal 730.
- data transmission from the portable terminal 730 to the data processing device 710 is performed by data communication using a wireless LAN, not by sonic communication.
- data communication using a wireless LAN not by sonic communication.
- image data captured by the camera 739, etc. A large amount of data can be transmitted in a short time without degrading the quality.
- the sound wave transmission unit provided in the data processing device 710 as the information providing device corresponds to an example of the transmission unit described above, and the sound wave communication reception unit 750 provided in the mobile terminal 730 is provided.
- the control unit 740 (particularly the microcomputer constituting the control unit 740) corresponds to an example of the above-described communication control unit.
- the communication system of this configuration example is installed in an authentication server 768 connected to the Internet 766, a store or a business office that conducts commercial transactions, and the Internet 766 via an Internet service provider (ISP) 765. And a payment terminal 767 connected to.
- ISP Internet service provider
- the payment terminal 767 transmits the authentication data for authenticating the authentication server 768 to the mobile terminal 730 using sound waves, and the mobile terminal 730 acquires the authentication data acquired from the payment terminal 767.
- the authentication server 768 authenticates the mobile terminal 730 and the payment terminal 767 and executes predetermined payment processing with the payment terminal 767. Have been to.
- the payment terminal 767 is configured by a computer capable of transmitting arbitrary data by sonic communication (transmission), similarly to the data processing device 710 of the first configuration example.
- the configuration is the same as that of one configuration example.
- the processing is executed according to the procedure shown in FIG.
- the computer constituting the payment terminal 767 executes the authentication data generation process and the authentication key transmission process shown in FIG.
- the authentication data generation process is a process that is repeatedly executed in the payment terminal 767.
- an authentication key necessary for receiving authentication of payment by the authentication server 768 is generated.
- the generated authentication key and the terminal ID which is the identification information of the payment terminal 767 are combined and encrypted, and in S330, the encrypted data is used as authentication data as the payment terminal 767.
- the sound wave is transmitted from a sound wave transmitting unit (configured in the same manner as the transmitting device 10 in FIG. 1).
- access information (such as a global IP address) necessary for the mobile terminal 730 to access the authentication server 768 on the Internet 766 is also transmitted.
- the authentication key transmission process is a process repeatedly executed in the payment terminal 767 as in the authentication data generation process.
- S340 it is determined whether or not there is an authentication key inquiry from the authentication server 768, thereby waiting for an authentication key inquiry. If there is an authentication key inquiry from the authentication server 768, The process proceeds to S350.
- the authentication key generated in S310 is read and encrypted, and the encrypted authentication key is transmitted to the authentication server 768 via the Internet 766. Then, the process proceeds to S360, and in accordance with a command from the authentication server 768, data for settlement is transmitted / received via the Internet 766 to / from the portable terminal 730 authenticated by the authentication server 768, When a predetermined settlement process is executed and the settlement process is completed, the process proceeds to S340.
- this authentication data transfer process first, in S410, a reception process for fetching received data from the sonic wave communication receiving unit 750 is executed, and in S420, the authentication data transmitted from the settlement terminal 767 in the S410 reception process. And whether the access information has been received (in other words, restored).
- the process proceeds to S430, and the authentication data is transmitted to the authentication server 768 on the Internet 766 via the mobile phone network 769.
- the authentication data is transmitted using access information acquired from the payment terminal 767.
- the process proceeds to S440, and the payment data is transmitted / received to / from the payment terminal 767 via the Internet 766 in accordance with a command from the authentication server 768.
- the settlement process is executed and the settlement process is completed, the process proceeds to S410.
- the authentication key is encrypted and transmitted to the authentication server 768 by the above-described processing of S350, and in subsequent S540, whether or not the authentication key transmitted from the settlement terminal 767 has been received. By waiting for the authentication key to be received.
- the authentication key is decrypted in S550, and in S560, the decrypted authentication key matches the authentication key from the mobile terminal 730 decrypted in S520. Judge whether or not.
- the payment terminal 767 uses the sonic communication to authenticate the authentication data necessary for the authentication server 768 and the access information necessary to access the authentication server 768. Send.
- a user who wishes to make a payment such as payment of a product using the payment terminal 767 arranges the user's own mobile terminal 730 in the vicinity of the payment terminal 767 and receives the authentication data and the access information. If a settlement command is input via 737, authentication by the authentication server 768 and settlement processing by the settlement terminal 767 and the portable terminal 730 are automatically performed.
- the mobile terminal 730 can perform normal payment processing with the payment terminal 767 without storing access information to the authentication server 768 and the payment terminal 767. As a result, it becomes possible to easily and safely execute a payment process when paying for a product using the mobile terminal 730.
- receipt information describing the product and price is transmitted from the payment terminal 767 to the mobile terminal 730 by sonic communication.
- the user of the mobile terminal 730 may confirm the contents of the payment and save it in a memory or the like.
- the administrator of the payment terminal 767 transmits the payment information necessary for authentication with the authentication server 768, such as credit card information, from the portable terminal 730 to the payment terminal 767 by sonic communication.
- the payment information may be confirmed and stored in a memory or the like.
- the payment terminal 767 corresponds to an example of the above-described information providing apparatus
- the authentication server 768 corresponds to an example of the above-described network device
- the authentication key is an example of the above-described key information. It corresponds to.
- the authentication data generation process functions as the above-described encrypted information generation unit and the encrypted information output unit
- the authentication key transmission process functions as the above-described key information transmission unit. Function.
- the processes from S510 to S530 function as the key information transmission request unit described above, and the processes from S540 to S560 function as the key information determination unit described above.
- the communication system of this configuration example includes a television receiver 770 having a reception antenna 771 that receives a transmission radio wave from a transmission tower 773 of a broadcasting station 772, and a wireless LAN 709 or a cellular phone network 769.
- Mobile terminal 730 connectable to the Internet 766.
- the television receiving device 770 accesses the URL of the Web server 774 on the Internet 766 related to the television broadcast being received to the mobile terminal 730 by sound wave communication similar to each configuration example described above. Notify as information.
- the user of the portable terminal 730 views the television broadcast on the television receiver 770 and transmits desired information corresponding to the broadcast content on the Internet 766 via the portable terminal 730. It can be easily obtained from the Web server 774.
- the television receiver 770 acquires URL information included in broadcast data selected and demodulated by the television tuner in a general display device with a built-in television tuner, and transmits the URL information by sound waves. It is configured by providing a signal processing unit for transmitting sound waves for generating the sound data.
- the signal processing unit for sound wave transmission provided in the television receiver 770 is realized by causing the microcomputer provided in the television receiver 770 to execute the URL information transmission processing shown in FIG.
- URL information included in the currently selected broadcast signal is extracted from the broadcast data received and demodulated by the TV tuner.
- the process proceeds to S610. If the viewer requests information, the process proceeds to S630, and voice data corresponding to the URL information extracted in S610 is generated.
- the audio data is set to an ultrasonic band higher than the audible frequency band so that the frequency band of the audio data of the television broadcast does not overlap.
- the audio data generated in S630 is mixed with the audio data of the television broadcast so that the sound wave is transmitted from the speaker provided in the television receiver 770.
- the sound wave transmission in S640 is repeatedly executed until it is determined in S650 that the predetermined sound wave transmission period has elapsed, and when the sound wave transmission period elapses, the process proceeds to S610 again.
- the portable terminal 730 is configured in the same manner as in the first configuration example, but the sonic wave communication receiving unit 750 receives ultrasonic transmission data corresponding to the transmission frequency of the URL information transmitted from the television receiver 770.
- the frequency band of sound waves to be received and demodulated is set so that it can be demodulated.
- the microcomputer configuring the control unit 740 executes the Web server access process shown in FIG. 33, and responds to the URL information based on the URL information transmitted from the television receiver 770 as a sound wave. Automatically connected to the Web server 774 on the Internet 766.
- the process proceeds to S730, and a connection request is transmitted to the Web server 774 on the Internet 766 corresponding to the URL information via the wireless LAN 709 or the cellular phone network 769.
- the Web server 774 is accessed, and communication processing with the Web server 774 is performed in S740.
- the communication processing in S740 is executed according to a command input from the user of the portable terminal 730 via the input unit 737.
- the television receiver 770 transmits the URL information included in the television broadcast signal as a sound wave, and the mobile terminal 730 that acquires the URL information follows the URL information.
- a Web server 774 on the Internet 766 is automatically accessed.
- the mobile terminal 730 is set to an operation mode capable of receiving sound waves, and URL information is received from the TV receiver 770. If sound waves are transmitted, desired information can be easily obtained using the portable terminal 730.
- the broadcast signal from the broadcast station 772 needs to include URL information.
- the URL information is included by including arbitrary URL information in the broadcast signal. It is possible to prompt access to a specific Web server corresponding to the above.
- the broadcast station 772 by including URL information in the broadcast signal, not only the service for viewers can be improved, but also the service for sponsors who are broadcast providers can be improved.
- the access information providing system including the television receiver 770 that receives the television broadcast signal transmitted from the broadcast station 772 via the transmission tower 773 and the mobile terminal 730 has been described.
- the receiving device that transmits the URL information as a sound wave may be a receiving device that receives a radio broadcast or a satellite broadcast, or a receiving device that receives a broadcast performed by a CATV or the like via a cable. Also good.
- the URL information transmission process executed in the television receiver 770 functions as the above-described access information acquisition unit.
- the sound wave transmission unit 720 uses the numerically controlled oscillation unit 722 to generate a sound wave signal whose frequency changes according to transmission data.
- a sound wave signal may be generated using a frequency dividing circuit 777 like a sound wave transmitting unit 720a shown in FIG.
- the sound wave transmission unit 720a shown in FIG. 34 takes in the operation clock from the oscillator 719 that generates the operation clock of the MPU 712 in the computer system provided with the sound wave transmission unit 720a, as in the case shown in FIG. Is divided by a frequency dividing circuit 777, and the frequency dividing ratio of the frequency dividing circuit 777 is switched in two steps according to the value (0 or 1) of transmission data output from the MPU 712.
- the frequency of the output signal from the frequency dividing circuit 777 changes in two steps, f0 or f1, corresponding to the transmission data, and a sound wave signal similar to the above configuration example can be generated.
- the frequency dividing circuit 778 generates a reference signal having a frequency fx different from the frequencies f0 and f1 of the modulation signal, and the mixing circuit 779 generates the reference signal f1 and the modulation signal. Are mixed and output to the speaker 736.
- the modulation signal affects the influence of the reflected wave and the surrounding noise depending on whether the level difference between the modulation signal and the reference signal is within the allowable range. It is possible to determine whether or not it is received (in other words, whether or not there is an abnormality in the modulation signal).
- the frequency dividing circuits 777 and 778 divide the operation clock from the oscillator 719 to generate the modulation signal whose frequency is set to f0 or f1 and the reference signal whose frequency is fx.
- the level difference between the modulation signal and the reference signal is substantially constant.
- the reception level of each signal is compared, and if the level difference is substantially constant, the reception signal is normal. In this case, it can be determined that the received signal is abnormal.
- the sound wave transmitting unit 720a shown in FIG. 34 is provided on the device side that transmits access information by sound wave
- the mobile terminal 730 is provided with the reception state determining unit 780 shown in FIG. It is preferable to determine whether or not there is an abnormality in the received signal, and prohibit the restoration operation of the access information in the sonic wave communication receiving unit 750.
- the reception signal of the sound wave input from the microphone 735 is amplified by the amplification circuit 781, and the modulated reception signal having the frequencies f0 and f1 is selected from the amplified reception signal.
- the BPF 782 to be passed through and the BPF 783 through which the reference signal having the frequency fx is selectively passed are respectively extracted to extract the modulation signal and the reference signal.
- the differential amplifier 784 By inputting the extracted modulation signal and reference signal to the differential amplifier 784, the differential amplifier 784 generates a signal corresponding to the level difference between these signals.
- the comparison unit 785 compares the generated level difference signal with a threshold value to determine whether or not the level difference between the modulation signal and the reference signal is within an allowable range.
- the comparison unit 785 permits the operation of the sonic wave communication receiving unit 750, and the level difference between the modulation signal and the reference signal is within the allowable range. If not, a reception control signal for prohibiting the operation of the sonic wave communication receiving unit 750 is output.
- the mobile terminal 730 is provided with the reception state determination unit 780 shown in FIG. 35, the restoration accuracy when restoring the access information on the mobile terminal 730 side can be improved.
- the frequency modulation method (FSK) in which binary data is transmitted using two sound waves having different frequencies is used for transmitting the access information.
- the frequency band that can be used for transmission can be expanded and the wave number can be increased.
- the reception accuracy on the portable terminal 730 side can be further improved.
- one microphone 735 that can be used to receive sound waves is usually provided, but in one microphone 735, depending on the orientation of the mobile terminal 730 (and thus the microphone 735). It is considered that the sound wave from the sound wave transmitting speaker 728 cannot be satisfactorily received by the microphone 735.
- a plurality of microphones (5 in the figure, 735a to 735e) are distributed and arranged in the mobile terminal 730 so that sound waves incident from different directions can be received. May be.
- each microphone 735a to 735e is provided.
- the control unit 740 selects the received data with the least error in the CRC check or the like from the received data obtained from the respective sonic wave communication receiving units 790a to 790e. Good.
- a / D converter 792 includes an amplifying circuit 791, an A / D converter 792, and a DSP (digital signal processor) 793 that processes audio data and restores received data. Has been.
- DSP digital signal processor
- the first to third embodiments have been described as embodiments of the present invention.
- the above embodiments are merely examples of embodiments to which the present invention is applied.
- the present invention can be realized in various forms such as a system, an apparatus, a method, a program, and a recording medium on which the program is recorded (an optical disc such as a CD-ROM or a DVD, a magnetic disc, or a semiconductor memory).
- an optical disc such as a CD-ROM or a DVD, a magnetic disc, or a semiconductor memory.
- Each component of the above embodiment may be realized by hardware, may be realized by software, or may be realized by a combination thereof.
- Each illustrated component is conceptual, and the specific form is not limited to the above configuration.
- the functions of one component may be distributed to a plurality of components, or the functions of a plurality of components may be integrated into one component.
- at least a part of the configuration of the above embodiment may be replaced with a known configuration having the same function.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
- Mobile Radio Communication Systems (AREA)
- Telephonic Communication Services (AREA)
Abstract
Description
このため、音波通信を行う場合、反射波が受信装置側のマイクロフォンに入力されることのないよう、送信装置側のスピーカと受信装置側のマイクロフォンとを近接させていた。
このため、音波通信では、送信装置と受信装置との間の通信可能距離を長くすることが望まれていた。
そして、不要信号除去部が、マイクロフォンからの受信信号を信号処理することで、受信信号から不要信号成分を除去し、FM検波部が、不要信号除去部にて不要信号成分が除去された受信信号をFM検波することで、送信データを復元する。
そして、第3フィルタ部が、その包絡線検波された信号の中から、第2フィルタ部を通過した受信信号よりも周波数が低い不要信号成分を抽出し、除去部が、第2フィルタ部を通過した受信信号から第3フィルタ部を通過した不要信号を除去する。
周波数変調された音波の振幅特性は一定であることから、受信装置側で得られる受信信号は、遅延波等の不要信号成分が含まれなければ安定した振幅特性となる。
また、このように、受信装置側では、受信信号から不要信号成分を除去することができるので、送信装置と受信装置との間の通信距離が長くなっても、音波通信によるデータ通信を良好に行うことができる。
なお、受信装置において、不要信号除去部を構成する第1フィルタ部、周波数変換部、第2フィルタ部、包絡線検波部、第3フィルタ部及び除去部としての機能や、FM検波部としての機能は、アナログ回路にて実現できる。また、デジタル回路若しくはコンピュータによる演算処理にて実現することもできる。
例えば、マイクロフォンを備えた携帯型情報処理端末等、コンピュータを内蔵した情報処理装置に、受信装置を組み込むようにすれば、コンピュータによるソフトウェア処理にて、不要信号除去部、FM検波部としての機能を実現することができる。
なお、送信装置を、スピーカ等の音波発生部を備えた情報処理装置に組み込む場合、変調部は、コンピュータの動作クロックを生成する発振器からの出力を分周する分周回路にて構成し、送信データを音波送信する際には、コンピュータの演算処理により、送信データに応じて分周回路の分周比を切り換えるようにするとよい。
なお、受信装置において、包絡線検波部は、第1フィルタ部を通過した受信信号を包絡線検波することによって不要信号成分を生成することから、第1フィルタ部を通過する受信信号は、不要信号成分を充分含む信号であってもよい。
(本発明を適用するのに好適な装置例)
次に、こうした音波通信を活用するのに好適な携帯装置、及び、音波通信を利用して携帯端末装置にネットワーク機器へのアクセス情報を提供するのに好適なアクセス情報提供システム、情報提供装置、及び携帯端末装置について説明する。
(1)携帯装置
上述した特許文献1に記載の音波通信技術や本発明による音波通信では、通常の音(例えば、音声、音楽、報知音等)を出力するためのスピーカを、無線通信用の送信機として機能させ、通常の音を入力するためのマイクロフォンを、無線通信用の受信機として機能させることができる。
そこで、携帯装置を以下のように構成することにより、こうした音波通信の利点を生かし、音波通信を活用することができる。
[携帯装置A1]
放送情報を受信して再生する受信装置により再生される音に含まれる音波信号を入力可能な音入力ユニットと、
前記音入力ユニットにより入力された前記音波信号の表す情報に基づいて、前記受信装置による再生内容に関連する再生関連処理を実行する制御ユニットと、
を備えることを特徴とする携帯装置。
[携帯装置A2]
携帯装置A1において、
ユーザによる操作を受け付ける操作ユニットを更に備え、
前記制御ユニットは、前記再生関連処理として、前記再生内容に関連する処理であって前記操作ユニットにより受け付けられた操作に基づく処理を実行する
ことを特徴とする携帯装置。
[携帯装置A3]
携帯装置A1又はA2において、
ユーザに情報を提示する提示ユニットを更に備え、
前記制御ユニットは、前記再生関連処理として、前記再生内容に関連する情報を前記提示ユニットに提示させることを特徴とする携帯装置。
(2)アクセス情報提供システム
このアクセス情報提供システムは、無線通信網を介してネットワーク機器との間で通信を行う携帯端末装置と、携帯端末装置に対しネットワーク機器にアクセスするのに必要なアクセス情報を提供する情報提供装置とにより構成される。
a)撮像用のカメラを利用して、接続対象となるネットワーク機器に対するアクセス情報を表す2次元コードを読み取り、その読み取った2次元コードからアクセス情報を復号することで、ネットワーク上の所望のネットワーク機器にアクセスできるように構成されたもの(例えば、特開2003-67275号公報参照)。
[アクセス情報提供システムB1]
無線通信網を介して、ネットワーク上のネットワーク機器との間で通信を行うための無線通信部を備えた携帯端末装置と、
前記携帯端末装置に対し、前記ネットワーク機器にアクセスするのに必要なアクセス情報を提供する情報提供装置と、
を備えたアクセス情報提供システムであって、
前記情報提供装置は、
音波送信用のスピーカと、
前記アクセス情報を、前記スピーカから送信可能な音声信号に変換して、前記スピーカに出力することにより、前記アクセス情報を前記スピーカから音波送信させる送信部と、
を備え、
前記携帯端末装置は、
前記スピーカから送信された音波を受信可能なマイクロフォンと、
前記マイクロフォンを介して、前記スピーカから送信された音波を受信し、該受信信号から前記アクセス情報を復元する復元部と、
前記復元部にて復元されたアクセス情報に基づき、前記無線通信部を介して前記ネットワーク機器にアクセスし、該ネットワーク機器との間で通信を行う通信制御部と、
を備えたことを特徴とするアクセス情報提供システム。
そして、このマイクロフォンを介して、スピーカから送信された音波が受信されると、復元部が、その受信信号から、ネットワーク機器へのアクセス情報を復元し、通信制御部が、復元部にて復元されたアクセス情報に基づき、無線通信部を介してネットワーク機器にアクセスし、このネットワーク機器との間で通信を行う。
[アクセス情報提供システムB2]
アクセス情報提供システムB1において、
前記情報提供装置は、
外部から入力される受信信号の中から所定放送チャンネルの放送信号を選局・復調する受信装置に内蔵され、
前記放送信号を選局・復調することにより得られる放送データの中から、前記ネットワーク機器の前記ネットワーク上のアドレスを取得し、該アドレスを前記アクセス情報として前記送信部に出力するアクセス情報取得部、
を備えたことを特徴とするアクセス情報提供システム。
そこで、アクセス情報提供システムB2においては、アクセス情報取得部が、受信装置にて放送信号を選局・復調することにより得られる放送データの中から、放送内容に関連した情報を提供するネットワーク機器のアドレスを取得し、そのアドレスをアクセス情報として送信部に出力する。
[アクセス情報提供システムB3]
アクセス情報提供システムB1又はB2において、
前記情報提供装置は、
自身の識別情報と認証用の鍵情報とを含む暗号化情報を生成する暗号化情報生成部と、
前記暗号化情報生成部にて生成された暗号化情報を前記送信部に出力することで、該暗号化情報を含むアクセス情報を、前記送信部から前記スピーカを介して音波送信させる暗号化情報出力部と、
前記ネットワーク機器からの送信要求に従い、前記鍵情報を暗号化して前記ネットワーク機器に送信する鍵情報送信部と、
を備え、
前記携帯端末装置において、
前記復元部は、前記受信信号から前記暗号化情報及び前記アクセス情報を復元し、
前記通信制御部は、前記復元部にて復元されたアクセス情報に基づき、前記無線通信部を介して前記ネットワーク機器にアクセスする際、前記復元部にて復元された前記暗号化情報を前記ネットワーク機器に送信し、
前記ネットワーク機器は、
前記携帯端末装置から前記暗号化情報を取得すると、該暗号化情報から前記識別情報及び前記鍵情報を復元し、該復元した識別情報に基づき、前記ネットワークを介して前記情報提供装置に前記鍵情報の送信要求を行う鍵情報送信要求部と、
該鍵情報送信要求部による送信要求に従い前記情報提供装置から暗号化して送信されてくる鍵情報を取得し、復号化すると共に、該復号化した鍵情報が、前記携帯端末装置から取得し復元した鍵情報と一致しているか否かを判定する鍵情報判定部と、
を備え、該鍵情報判定部にて鍵情報が一致していると判断されると、前記携帯端末装置及び前記情報提供装置が正常であると判断して、前記携帯端末装置と前記情報提供装置とによる通信を許可することを特徴とするアクセス情報提供システム。
ここで、暗号化情報生成部は、情報提供装置自身の識別情報と認証用の鍵情報とを含む暗号化情報を生成する。
また、携帯端末装置においては、復元部が、スピーカからの受信信号から暗号化情報及びアクセス情報を復元し、通信制御部が、復元部にて復元されたアクセス情報に基づき、無線通信部を介してネットワーク機器にアクセスする際には、復元部にて復元された暗号化情報を前記ネットワーク機器に送信する。
[情報提供装置C1]
無線通信網を介して、ネットワーク上のネットワーク機器との間で通信を行うための無線通信部を備えた携帯端末装置に対し、前記ネットワーク機器にアクセスするのに必要なアクセス情報を提供する情報提供装置であって、
音波送信用のスピーカと、
前記アクセス情報を、前記スピーカから送信可能な音声信号に変換して、前記スピーカに出力することにより、前記アクセス情報を前記スピーカから音波送信させる送信部と、
を備えたことを特徴とする情報提供装置。
[情報提供装置C2]
情報提供装置C1において、
当該情報提供装置は、外部から入力される受信信号の中から所定放送チャンネルの放送信号を選局・復調する受信装置に内蔵されており、
前記放送信号を選局・復調することにより得られる放送データの中から、前記ネットワーク機器の前記ネットワーク上のアドレスを取得し、該アドレスを前記アクセス情報として前記送信部に出力するアクセス情報取得部、
を備えたことを特徴とする情報提供装置。
そして、情報提供装置C2には、放送信号を選局・復調することにより得られる放送データの中から、ネットワーク機器のネットワーク上のアドレスを取得し、そのアドレスをアクセス情報として送信部に出力するアクセス情報取得部が設けられている。
[情報提供装置C3]
情報提供装置C1又はC2において、
当該情報提供装置の識別情報と認証用の鍵情報とを含む暗号化情報を生成する暗号化情報生成部と、
前記暗号化情報生成部にて生成された暗号化情報を前記送信部に出力することで、該暗号化情報を含むアクセス情報を、前記送信部から前記スピーカを介して音波送信させる暗号化情報出力部と、
前記ネットワーク機器からの送信要求に従い、前記鍵情報を暗号化して前記ネットワーク機器に送信する鍵情報送信部と、
を備えたことを特徴とする情報提供装置。
[携帯端末装置D1]
無線通信網を介して、ネットワーク上のネットワーク機器との間で通信を行うための無線通信部と、
情報提供装置のスピーカから送信された音波を受信可能なマイクロフォンと、
前記マイクロフォンを介して、前記スピーカから送信された音波を受信し、該受信信号から、前記情報提供装置から提供されたアクセス情報を復元する復元部と、
前記復元部にて復元されたアクセス情報に基づき、前記無線通信部を介して前記ネットワーク機器にアクセスし、該ネットワーク機器との間で通信を行う通信制御部と、
を備えたことを特徴とする携帯端末装置。
[携帯端末装置D2]
携帯端末装置D1において、
前記復元部は、前記受信信号から、前記情報提供装置から提供された暗号化情報及びアクセス情報を復元し、
前記通信制御部は、前記復元部にて復元されたアクセス情報に基づき、前記無線通信部を介して前記ネットワーク機器にアクセスする際、前記復元部にて復元された前記暗号化情報を前記ネットワーク機器に送信することを特徴とする携帯端末装置。
(第1実施形態)
図1に示すように、本実施形態の音波通信システムは、スピーカ22を内蔵した送信装置10と、マイクロフォン32を内蔵した受信装置30とから構成される。
数値制御発振部14は、スピーカ22とマイクロフォン32とを介して音波通信可能な周波数帯の搬送波(正弦波)を発生する。
ここで、加算値設定部12及び数値制御発振部14は、コンピュータによるソフトウェア処理にて実現されるものである。
なお、LPF18は、D/A変換器16から出力される送信信号から不要な高周波成分を除去するもの(アンチエイリアLPF)であり、本実施形態では、カットオフ周波数が例えば20kHzに設定されている。
そして、その受信された受信信号は、増幅回路34にて所定レベルまで増幅され、LPF18と同様に構成されたLPF36にて、不要な高周波成分が除去された後、A/D変換器38に入力される。
次に、A/D変換器38にてA/D変換された受信信号は、不要信号除去部40にて不要信号が除去された後、FM検波部60にてFM検波される。
ここで、不要信号除去部40、FM検波部60、及び波形整形部68は、コンピュータによるソフトウェア処理にて実現されるものである。
なお、遅延部62は、受信信号の位相をπ/2(90°)遅延させ、乗算部64は、遅延部62にて遅延された受信信号と不要信号除去部40からの受信信号とを乗算し、LPF66は、乗算部64による乗算結果から不要な高周波成分を除去する。
乗算部46は、BPF42を介して入力される受信信号と、発振部44にて生成される一定周波数(本実施形態では、13.1kHz)の局発信号とを乗算することで、受信信号(周波数:16kHz~20kHz)を、所定の中間周波数(2.9kHz~6.9kHz)に周波数変換するものである。
次に、BPF48は、乗算部46からの出力の内、中間周波数(2.9kHz~6.9kHz)に周波数変換された受信信号を選択的に通過させるものであり、通過帯域幅が、2.9kHz~6.9kHzに設定されている。
一方、振幅検波部50は、BPF42から入力される受信信号を包絡線検波することで、受信信号に重畳された不要信号成分を抽出するものである。
そして、振幅検波部50により包絡線検波された検波信号は、不要信号成分を選択的に通過させるLPF52に入力され、LPF52を通過した不要信号成分は、除算部56に入力される。
このため、本実施形態の音波通信システムによれば、送信装置10から疑似雑音符号を送信することなく、受信装置30側で、送信装置10からの送信データを正確に復元できることになる。
ここで、本実施形態においては、送信装置10に設けられた加算値設定部12及び数値制御発振部14が、本発明の周波数変調部の一例に相当し、同じく送信装置10に設けられた増幅回路20及びスピーカ22が、本発明の音波発生部の一例に相当する。なお、音波発生部としては、例えば、圧電ブザー等、音波の発生源となるブザーを利用するようにしてもよい。
例えば、上記実施形態では、送信装置10の加算値設定部12及び数値制御発振部14、受信装置30の不要信号除去部40、FM検波部60、及び波形整形部68は、コンピュータによるソフトウェア処理にて実現されるものとして説明したが、これら各部は、デジタル信号処理を行うデジタル回路、或いは、アナログ信号処理を行うアナログ回路にて実現してもよい。
また、スピーカ84は、制御部80からの出力(音声信号)をD/A変換するD/A変換器87及びD/A変換器87にてD/A変換された音声信号を増幅する増幅回路88を介して、制御部80に接続されている。
このようにすれば、客が、受信装置30としての機能を有する携帯型情報処理端末70を利用して、送信装置10からURLを取得し、ホームページを閲覧できるようになり、本発明の電波通信システムの用途を拡大することができる。
つまり、この簡易送信機90は、ワンチップのマイクロコンピュータを含む制御部92と、制御部92の動作クロックを生成する発振器94と、発振器94から制御部92に出力される動作クロックを取り込み、分周することで、所望周波数の発振信号を生成する分周回路96と、分周回路96からの出力を受けて音波を発生するスピーカ98とから構成されている。
そして、この簡易送信機90は、極めて少ない構成部品にて構成でき、小型化及び低コスト化を図ることができることから、各種情報送信に利用することができる。
(第2実施形態)
次に、音波通信を活用するのに好適な携帯装置及びその周辺システムについて、第2実施形態として説明する。
図6は、実施形態の放送システムの概念的な構成を示すブロック図である。この放送システムは、放送装置1と、受信装置2と、携帯装置3と、を備える。
次に、音波信号について説明する。
音波信号は、スピーカから出力可能であって、マイクロフォンで入力可能な周波数帯の音波によって搬送される信号である。
この音波通信は、図1~図5にて説明した第1実施形態の音波通信システムを利用できる。但し、図6の放送システムは、第1実施形態で説明した音波通信システムの構成の少なくとも一部を利用して構成することが可能であるが、特許文献1に記載のような他の公知の構成を利用することもできる。
次に、具体的な構成例について説明する。
[3-1.第1構成例]
まず、第1構成例として、テレショッピングに本発明を適用した場合の構成例について説明する。ここでいうテレショッピングとは、商品販売者が、テレビジョン放送の受信装置を用いて番組を視聴する視聴者としてのユーザに対して商品を紹介し、ユーザから購入の意思を受けることで、商品の売買を行うサービスのことである。
また、インターネットを利用する場合には、インターネット可能な電子機器(例えばPCや携帯電話機等)で商品販売者のウェブページを閲覧するための操作(例えば検索操作やURLの入力操作等)を行わなければならない。
このような問題を解消するために、第1構成例では、商品販売者がユーザに対して商品を紹介するための受信装置から、ユーザが携帯する携帯装置へ、必要な情報が音波通信の技術を利用して送信される。
第1構成例において、放送装置1は、テレビジョン放送の放送局において、テレビジョン放送の映像や音を表す情報を放送情報として生成し、送信(放送)する装置である。
映像情報合成ユニット115は、映像情報出力ユニット111から出力されたオリジナルの映像情報と、表示用情報出力ユニット112から出力された表示用情報と、を入力する。
そして、音情報合成ユニット116は、オリジナルの音情報の表すオリジナルの音に、送信用情報の表す音を付加した音情報を生成し(つまり、オリジナルの音情報と送信用情報とを合成し)、放送情報生成ユニット117へ出力する。
また、第1構成例において、受信装置2は、放送装置1により送信(放送)されたテレビジョン放送の放送情報を、放送網やインターネットなどを介して受信し、放送情報の表す映像及び音を再生する装置(テレビジョン放送受信装置)である。
また、テレビジョン連携処理は、例えば、特定の操作がされた場合に開始され、その後に所定の終了条件が成立した時点で(例えば一定時間経過後に)終了されるようにしてもよい。
S11で、プロセッサ313は、音入力ユニット3Aにより音波信号が入力されたか否かを判定する。プロセッサ313は、音波信号が入力されたと判定した場合には、処理をS12へ移行させ、音波信号の表す情報を表示ユニット3C(表示画面314)に表示させた後、処理をS13へ移行させる。
S13で、プロセッサ313は、音波信号の表す情報が表示画面314に表示されており、かつ、その情報に基づく通信要求操作が行われたか否かを判定する。
図11は、第1構成例の放送システムの概念図である。
携帯装置3は、スピーカ216から出力された音をマイクロフォン311から入力し、その音に含まれる音波信号の表す情報(表示画面215に表示されている商品情報)を、表示画面314に表示する。
また、携帯装置3は、インターネットアドレス450を選択する操作がタッチパネル315で行われると、そのインターネットアドレスにアクセスする処理を行う。
[3-2.第2構成例]
次に、第2構成例として、ラジオショッピングに本発明を適用した場合の構成例について説明する。
音情報出力ユニット121は、オリジナルの音情報を出力する。オリジナルの音情報とは、送信用情報を付加する前のオリジナルの音を表す情報であり、例えば、マイクロフォンで録音された音(音声や音楽等)や、録音後に編集された音などである。
放送情報生成ユニット123は、音情報出力ユニット121から出力されたオリジナルの音情報と、送信用情報出力ユニット122から出力された送信用情報と、を入力する。
また、第2構成例において、受信装置2は、放送装置1により送信(放送)されたラジオ放送の放送情報を、放送網やインターネットなどを介して受信し、放送情報の表す音を再生する装置(ラジオ放送受信装置)であり、例えば自動車に搭載されている。
(1)動画データ自体がラジオ放送に同期して再生されるデータである場合
動画データ自体がラジオ放送に同期して再生されるデータである場合には、携帯装置3で特別な処理を行う必要がない。例えば、動画データが、ラジオ放送に合わせてストリーミング再生されるような場合である。
動画データがラジオ放送とは独立したデータである場合、携帯装置3でラジオ放送と同期させる必要がある。この場合には、ラジオ放送から得られる情報に基づき、現時点の放送内容が、動画におけるどの時点に対応するかを判断し、その時点から動画を再生すればよい。
S25で、プロセッサ313は、音波信号の表す情報が表示画面314に表示されており、かつ、その情報に基づく通信要求操作が行われたか否かを判定する。
S27で、プロセッサ313は、音波信号の表す情報が表示画面314に表示されており、かつ、その情報に基づく商品記憶操作が行われたか否かを判定する。
プロセッサ313は、商品記憶操作が行われたと判定した場合には、処理をS28へ移行させ、商品を記憶する処理を行った後、処理をS21へ移行させる。
次に、前述したS28で商品が記憶された状態においてプロセッサ313が実行する商品通知処理について、図15のフローチャートを用いて説明する。
次に、第3構成例として、テレビジョン放送による競馬中継に本発明を適用した場合の構成例について説明する。
そこで、第3構成例では、競馬中継を視聴するための受信装置から、ユーザが携帯する携帯装置へ、必要な情報が音波通信の技術を利用して送信される。
また、携帯装置3は、競走馬名530を選択する操作がタッチパネル315で行われると、その競走馬に関する情報(例えば血統や過去の成績等)を、インターネット上のサーバから取得する。
例えば、解説者等が発言した馬や組合せをワンタッチで選択できるようにしてもよい。また、ここでは競馬を例に挙げたが、ユーザが投票可能な他のイベント(例えば、競輪、競艇、サッカー等のスポーツ等)に適用してもよい。
次に、第4構成例として、異なる複数(以下の例では2つ)の番組を同時に表示する機能を備えるテレビジョン放送の受信装置2に本発明を適用した場合の構成例について説明する。
しかしながら、異なる2つの番組の音を同時に出力すると、内容が聞き取りにくくなってしまう。
第4構成例の放送システムのハードウェア構成は、基本的には前述した第1構成例(図7~図9)と同様であるが、受信装置2の構成が若干異なるため、この点について説明する。
具体的には、図18に示すように、再生ユニット2Bは、第1の選局ユニット241と、第2の選局ユニット242と、第1の放送情報分離ユニット243と、第2の放送情報分離ユニット244と、映像再生ユニット245と、音再生ユニット246と、を備える。なお、前述したように、受信ユニット2Aは、放送装置1により送信(放送)された放送情報を、放送網やインターネットなどを介して受信し、再生ユニット2Bへ出力する。
第1の選局ユニット241は、選局した放送情報を、第1の放送情報分離ユニット243へ出力する。また、第2の選局ユニット242は、選局した放送情報を、第2の放送情報分離ユニット244へ出力する。
そして、音再生ユニット246は、第1の放送情報分離ユニット243及び第2の放送情報分離ユニット244から出力された音情報を入力し、音情報の表す音をスピーカ248から出力する。
このため、一方の番組の音は受信装置2のスピーカ248ら出力され、他方の番組の音は携帯装置3のスピーカ319又はジャック320(ヘッドフォン)から出力される。
次に、第5構成例として、ユーザに関する情報を検出する機能を備えるテレビジョン放送の受信装置2に本発明を適用した場合の構成例について説明する。
カメラ251は、視聴者としてのユーザを撮影し、その人数、位置、性別、年齢等の情報を把握するためのものであり、受信装置2の正面(表示画面247が設けられている側であり、例えば表示画面247の上方)に設けられている。
・複数のユーザに対して、ユーザの位置に応じて異なる情報を提供する。この場合、スピーカ248は、指向性を有するものが用いられる。例えば、図23に示すように、スピーカ248による音の出力方向を複数方向に区分する。この例では、受信装置2に対して左寄りに位置するユーザAと、受信装置2に対して正面に位置するユーザBと、受信装置2に対して右寄りに位置するユーザCと、に対して異なる音を出力することができる。
・ユーザの年齢、性別、サイズ、居住地などに応じた情報(例えば、年齢や性別に応じた内容の情報、年齢、性別、サイズに応じた衣服の情報、居住地に応じた情報等)を提供する。
このように音波信号を選択して提供することで、ユーザに応じた情報を提供することができる。
[4.効果]
携帯装置3は、放送情報を受信して再生する受信装置2により再生される音に含まれる音波信号を入力可能な音入力ユニット3Aと、音入力ユニット3Aにより入力された音波信号の表す情報に基づいて、受信装置2による再生内容に関連する処理(再生関連処理)を実行する制御ユニット3Bと、を備える。
例えば、携帯装置3は、受信装置2において商品を紹介して購入者を募る内容の情報(例えばテレショッピングやラジオショッピング等の情報)が放送されている状態において、商品を購入するために指定の連絡先へ通信を行う場合に、極めて簡易的な操作(例えば、ワンタッチ操作や、音声による単純な発声操作等)により通信を行うことができる。
携帯装置3は、ユーザに情報を提示するユニット(提示ユニット)を備え、制御ユニット3Bは、再生関連処理として、再生内容に関連する情報を提示ユニットに提示させる。
携帯装置3は、提示ユニットとして、ユーザが視認可能に画像を表示する表示ユニット3Cを備える。
例えば、携帯装置3は、受信装置2において商品を紹介して購入者を募る内容の情報が放送されている状態において、商品の情報や連絡先(例えば電話番号やインターネットアドレス等)を表示することができる。
また例えば、携帯装置3は、静止画に限らず、動画を表示することができる。このため、ラジオ放送受信装置のように、動画を再生できない受信装置2であっても、放送内容に関連する動画を携帯装置3で確認することができる。
受信装置2で表示されるべき情報を携帯装置3で表示させるようにすれば、本来の映像が関係のない情報で損なわれないようにすることができる。
携帯装置3は、提示ユニットとして、ユーザが聴取可能に音を出力する音出力ユニット3Fを備える。
例えば、携帯装置3は、受信装置2において2つの番組が同時に表示されている状態において、受信装置2から出力されていない番組の音を再生することができる。
また例えば、携帯装置3は、受信装置2で通知されるべき緊急情報等を音で通知することができる。
このため、携帯装置3は、音波信号だけでは得られない情報を取得したり、外部装置(サーバを含む)へ情報を通知したりすることができる。
携帯装置3は、音波信号から取得した情報(例えば商品の識別情報等)を記憶し、その後に、記憶されている情報に関連する情報を表す音波信号を受信装置2から受信した場合に、ユーザに報知する処理を行う。
例えば、携帯装置3は、ラジオショッピングで紹介されていた商品が、その後にテレビジョン放送受信装置で放送された場合に、ユーザに通知することができる。
例えば、受信装置2から送信された音波信号の表す情報(例えばCM用の情報等)を単に画像として表示したり音で出力したりするシステムであれば、通信装置以外の装置(例えば受信装置2を遠隔操作可能なリモートコントローラ等)を携帯装置3としてもよい。
このため、放送装置1は、受信装置2からユーザが五感で(聴覚や視覚で)把握できる情報に加え、携帯装置3を用いて利用される情報を提供することができる。
放送装置1は、音波信号として、商品を購入するための通信の通信先情報を表す信号を送信する。
放送装置1は、放送情報として、投票を募る内容の情報(例えば競馬中継の情報等)を送信し、音波信号として、携帯装置3を用いて投票する手順を簡易化するための情報を表す信号を送信する。
放送装置1は、音波信号として、投票可能な選択肢の中から、放送内容に応じて絞り込まれた選択肢を表す信号を送信する。
このため、携帯装置3のユーザは、放送内容をメモ等することなく、商品を特定することができる。したがって、他の情報源から当該商品の情報を取得したり、当該商品を購入したりする場合に、商品を特定することができないということを生じにくくすることができる。
このような情報は、本来の映像に重畳して提供されたり、本来の放送を中断して提供されたりするなど、本来の放送の価値を低下させ得る。これに対し、音波信号で送信すれば、本来の映像が損なわれないように(又は損なわれにくく)することができる。
放送装置1は、音波信号として、放送内容に関し書き留めておくべき情報を表す信号を送信してもよい。例えば、番組で紹介された店、物品、メールアドレスの情報など、メモをとる必要が生じ得る情報である。このような情報を音波信号として送信することで、情報を急いでメモする必要を生じにくくすることができる。
また、受信装置側で不要信号成分を生成できるようにするために、送信装置から疑似雑音符号を送信したり、受信装置側で疑似雑音符号に基づき多重通路遅延特性値を求めたりする必要がないので、高精度な音波通信を高速に実行することができる。
以上、第2実施形態の各種構成例について説明したが、第2実施形態は、更に種々の形態を採り得ることは言うまでもない。
例えば、装置から出力される報知音に音波信号を含めて出力するようにしてもよい。すなわち、電気的に作動する装置(例えば、冷蔵庫、炊飯器、電子レンジ、エアコンディショナー等、商用電源で作動する電化製品や、卓上時計等、電池で作動する電子機器など)の多くは、圧電ブザーなどの報知手段を備えている。
(第3実施形態)
次に、音波通信を利用して携帯端末装置にネットワーク機器へのアクセス情報を提供するのに好適なアクセス情報提供システムについて、第3実施形態として説明する。
[第1構成例]
図25に示すように、本実施形態の通信システムは、ルータ703及び終端装置704を介してインターネットに接続されたローカルエリアネットワーク(LAN)705を中心に構成されている。
データ処理装置710は、LAN705に接続されたネットワーク機器やアクセスポイント708を介して接続される携帯端末装置(以下、単に携帯端末という)730から送信されてきたデータを処理し、所定の記憶媒体(ハードディスク、シリコンディスク、メモリカード等)へ保存したり、プリンタ706を利用して印刷したりするためのものである。
そして、データ処理装置710には、キーボードやマウス等を含む入力部715、LCD等を含む表示部716、各種データを記憶するための記憶媒体(図では、HDD(ハードディスク))717、LAN705を介して他のネットワーク機器と通信を行うための有線LAN通信部718、及び、音波送信部720、等が備えられている。
また、携帯端末730には、各種タッチキーを含む入力部737、LCD等を含む表示部738、及び、撮像用のカメラ739が設けられており、これら各部も制御部740に接続されている。
このため、音波通信用受信部750では、受信信号(音声データ)に含まれる不要信号成分が不要信号除去部で除去され、FM検波部にて、音波送信部720からの送信データが復元されることになる。
以下、このためにデータ処理装置710のMPU712及び携帯端末730の制御部740にてそれぞれ実行される、データ取得処理及びデータ出力処理について、図29に示すフローチャートに沿って説明する。
また続くS220では、S210の受信処理にて、データ処理装置710から音波送信されたIPアドレスが受信(換言すれば復元)されたか否かを判断し、IPアドレスが受信されていなければ、再度S210に移行することにより、IPアドレスが受信されるのを待つ。
[第2構成例]
図30に示すように、本構成例の通信システムは、インターネット766に接続された認証サーバ768と、商取引を行う店舗や事業所等に設置され、インターネットサービスプロバイダ(ISP)765を介してインターネット766に接続された決済端末767とを備える。
認証データ生成処理は、決済端末767において、繰り返し実行される処理である。
そして、続くS320では、その生成した認証キーと、決済端末767自身の識別情報である端末IDとを合成して、暗号化し、S330にて、その暗号化したデータを認証データとして、決済端末767に内蔵された音波送信部(図1の送信装置10と同様に構成されたもの)から音波送信させる。
そして、この認証キー送信処理では、S340にて、認証サーバ768から認証キーの問い合わせがあったか否かを判断することにより、認証キーの問い合わせを待ち、認証サーバ768から認証キーの問い合わせがあると、S350に移行する。
そして、その後は、S360に移行して、認証サーバ768からの指令に従い、認証サーバ768にて認証された携帯端末730との間で、インターネット766経由で、決済用のデータを送受信することで、所定の決済処理を実行し、決済処理が完了すると、S340に移行する。
一方、携帯端末730を構成するコンピュータ(上述した制御部740を構成するマイクロコンピュータ)は、入力部737から決済指令が入力されることにより、図31に示す認証データ転送処理を実行する。
次に、認証サーバ768を構成するコンピュータは、図31に示す認証処理を繰り返し実行する。
[第3構成例]
図32に示すように、本構成例の通信システムは、放送局772の送信塔773からの送信電波を受信する受信アンテナ771を有するテレビ受信装置770と、無線LAN709若しくは携帯電話回線網769を介してインターネット766に接続可能な携帯端末730とを備える。
そして、続くS640では、S630で生成された音声データを、テレビ放送の音声データと混合することで、テレビ受信装置770に設けられたスピーカから音波送信させる。
以上説明したように、本構成例の通信システムにおいては、テレビ受信装置770が、テレビ放送信号に含まれるURL情報を音波送信し、そのURL情報を取得した携帯端末730が、そのURL情報に従い、インターネット766上のWebサーバ774に自動でアクセスするようにされている。
[変形例1]
第3実施形態において、上記各構成例では、音波送信部720は、数値制御発振部722を用いて、送信データに対応して周波数が変化する音波信号を生成するものとして説明したが、図34に示す音波送信部720aのように、分周回路777を用いて音波信号を生成するようにしてもよい。
[変形例2]
一方、アクセス情報を音波送信する装置側に図34に示す音波送信部720aを設けた場合、携帯端末730には、図35に示す受信状態判定部780を設けて、音波の受信信号が正常であるか否かを判断し、受信信号に異常があるときには、音波通信用受信部750でのアクセス情報の復元動作を禁止するようにするとよい。
[変形例3]
また、上記構成例では、アクセス情報の送信に、周波数の異なる2つの音波を使って2値データを送信する周波数変調方式(FSK)を採用しているが、送信に用いる音波の周波数を超音波帯にすれば、送信に利用可能な周波数帯域を広げ、波数を増加することができる。
[変形例4]
一方、携帯電話やスマートホンにおいて、音波の受信に利用可能なマイクロフォン735は、通常、1個設けられているが、1個のマイクロフォン735では、携帯端末730(延いてはマイクロフォン735)の向きによって、音波送信用のスピーカ728からの音波をマイクロフォン735にて良好に受信できないことが考えられる。
本発明は、システム、装置、方法、プログラム、プログラムを記録した記録媒体(CD-ROMやDVD等の光ディスク、磁気ディスク、半導体製メモリ等)、などの種々の形態で実現することができる。上記実施形態の各構成要素は、ハードウェアで実現されていてもよく、ソフトウェアで実現されていてもよく、これらの組み合わせて実現されていてもよい。また、図示した各構成要素は概念的なものであり、具体的形態は上記の構成に限定されない。例えば、1つの構成要素が有する機能を複数の構成要素に分散させたり、複数の構成要素が有する機能を1つの構成要素に統合したりしてもよい。また、上記実施形態の構成の少なくとも一部は、同様の機能を有する公知の構成に置き換えてもよい。
Claims (3)
- マイクロフォンにて受信可能な周波数帯の信号を、送信データに基づき周波数変調することで送信信号を生成する周波数変調部、及び、該周波数変調部にて生成された送信信号を受けて音波を発生する音波発生部、を備えた送信装置と、
前記送信装置の音波発生部から出力された音波を受信するマイクロフォン、該マイクロフォンからの受信信号を信号処理することで不要信号成分を除去する不要信号除去部、及び、該不要信号除去部にて不要信号成分が除去された受信信号をFM検波することで前記送信データを復元するFM検波部、を備えた受信装置と、
を備え、
前記受信装置に設けられる前記不要信号除去部は、
前記マイクロフォンから入力される受信信号の中から、前記周波数変調部にて生成される送信信号に対応した信号成分を抽出する第1フィルタ部と、
前記第1フィルタ部を通過した受信信号を、所定の中間周波数帯に周波数変換する周波数変換部と、
前記周波数変換部にて周波数変換された信号の中から、前記周波数変調部にて生成される送信信号に対応した信号成分を抽出する第2フィルタ部と、
前記第1フィルタ部を通過した受信信号を包絡線検波する包絡線検波部と、
該包絡線検波部にて包絡線検波された信号の中から、前記第2フィルタ部を通過した受信信号よりも周波数が低い不要信号成分を抽出する第3フィルタ部と、
前記第2フィルタ部を通過した受信信号から前記第3フィルタ部を通過した不要信号成分を除去する除去部と、
を備える、音波通信システム。 - マイクロフォンであって、該マイクロフォンにて受信可能な周波数帯の信号を送信データに基づき周波数変調して生成される送信信号を受信するマイクロフォンと、
該マイクロフォンからの受信信号を信号処理することで不要信号成分を除去する不要信号除去部と、
該不要信号除去部にて不要信号成分が除去された受信信号をFM検波することで前記送信データを復元するFM検波部と、
を備え、
前記不要信号除去部は、
前記マイクロフォンから入力される受信信号の中から、前記周波数変調部にて生成される送信信号に対応した信号成分を抽出する第1フィルタ部と、
前記第1フィルタ部を通過した受信信号を、所定の中間周波数帯に周波数変換する周波数変換部と、
前記周波数変換部にて周波数変換された信号の中から、前記周波数変調部にて生成される送信信号に対応した信号成分を抽出する第2フィルタ部と、
前記第1フィルタ部を通過した受信信号を包絡線検波する包絡線検波部と、
該包絡線検波部にて包絡線検波された信号の中から、前記第2フィルタ部を通過した受信信号よりも周波数が低い不要信号成分を抽出する第3フィルタ部と、
前記第2フィルタ部を通過した受信信号から前記第3フィルタ部を通過した不要信号成分を除去する除去部と、
を備える、受信装置。 - 前記第1フィルタ部及び前記第2フィルタ部は、所定の通過周波数帯域を有するバンドパスフィルタにて構成されており、
前記第1フィルタ部の選択度は、前記第2フィルタ部の選択度よりも低い、請求項2に記載の受信装置。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/376,110 US9331792B2 (en) | 2012-01-31 | 2013-01-31 | Acoustic wave communication system and receiver |
JP2013556495A JP5856187B2 (ja) | 2012-01-31 | 2013-01-31 | 音波通信システム及び受信装置 |
Applications Claiming Priority (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2012018543 | 2012-01-31 | ||
JP2012-018543 | 2012-01-31 | ||
JP2012152524 | 2012-07-06 | ||
JP2012-152524 | 2012-07-06 | ||
JP2012-178430 | 2012-08-10 | ||
JP2012178430 | 2012-08-10 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2013115317A1 true WO2013115317A1 (ja) | 2013-08-08 |
Family
ID=48905348
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2013/052214 WO2013115317A1 (ja) | 2012-01-31 | 2013-01-31 | 音波通信システム及び受信装置 |
Country Status (3)
Country | Link |
---|---|
US (1) | US9331792B2 (ja) |
JP (1) | JP5856187B2 (ja) |
WO (1) | WO2013115317A1 (ja) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140369169A1 (en) * | 2012-01-31 | 2014-12-18 | System Design Corp. | Acoustic wave communication system and receiver |
JP2015156608A (ja) * | 2014-02-21 | 2015-08-27 | 日本電気株式会社 | 端末、通話システム、通話方法 |
JP2016046583A (ja) * | 2014-08-20 | 2016-04-04 | ヤマハ株式会社 | 放音装置およびヘッドホン |
JP2016207043A (ja) * | 2015-04-24 | 2016-12-08 | Line株式会社 | 端末装置、決済サーバ、決済システム、決済方法、及びプログラム |
JP2017063330A (ja) * | 2015-09-25 | 2017-03-30 | 株式会社フィールドシステム | 情報提供システム |
JP2020113837A (ja) * | 2019-01-09 | 2020-07-27 | 三菱電機株式会社 | リモートコントローラ、携帯端末、機器設定方法および機器設定システム |
JP2022508282A (ja) * | 2019-06-04 | 2022-01-19 | ミューズライブ インコーポレイテッド | 超音波を利用した認証情報伝送装置 |
JP7466294B2 (ja) | 2019-11-14 | 2024-04-12 | 三菱電機株式会社 | 通信システム及び通信方法 |
EP3591903B1 (en) * | 2013-09-16 | 2024-08-21 | LG Electronics Inc. | Home appliance |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9311640B2 (en) | 2014-02-11 | 2016-04-12 | Digimarc Corporation | Methods and arrangements for smartphone payments and transactions |
US9830588B2 (en) * | 2013-02-26 | 2017-11-28 | Digimarc Corporation | Methods and arrangements for smartphone payments |
US9100395B2 (en) * | 2013-09-24 | 2015-08-04 | International Business Machines Corporation | Method and system for using a vibration signature as an authentication key |
US9450682B2 (en) | 2013-10-07 | 2016-09-20 | International Business Machines Corporation | Method and system using vibration signatures for pairing master and slave computing devices |
US10262120B1 (en) * | 2014-11-17 | 2019-04-16 | Squirrels LLC | Providing display outputs responsive to record data |
KR102360930B1 (ko) * | 2014-12-02 | 2022-02-08 | 에스케이플래닛 주식회사 | 데이터 송신 단말, 데이터 송수신 시스템 및 데이터 송신 방법 |
US9654229B2 (en) * | 2015-02-10 | 2017-05-16 | Turtle Beach Corporation | Parametric transducer microphone system |
US9939517B2 (en) | 2015-04-05 | 2018-04-10 | Nicholaus J. Bauer | Determining a location of a transmitter device |
US10663555B2 (en) * | 2015-11-02 | 2020-05-26 | Ricoh Company, Ltd. | Communication device, communication method, and computer-readable recording medium |
PL414829A1 (pl) * | 2015-11-17 | 2017-05-22 | Audiolink Technologies Spółka Z Ograniczoną Odpowiedzialnością | Sposób równoległego budowania przekazu informacji różnymi kanałami i układ do równoległego przesyłania informacji różnymi kanałami |
FR3050897B1 (fr) * | 2016-04-27 | 2020-07-17 | Raoul Parienti | Appareil et systeme d'assistance a l'audition |
KR20180070962A (ko) * | 2016-12-19 | 2018-06-27 | 삼성전자주식회사 | 전자 결제 방법 및 이를 지원하는 전자 장치 |
JP6897415B2 (ja) | 2017-08-16 | 2021-06-30 | トヨタ自動車株式会社 | 車両用制御システム |
DE102017221738A1 (de) * | 2017-12-03 | 2019-06-06 | Audi Ag | Verfahren zum Einstellen einer Leistungselektronik |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09224005A (ja) * | 1995-07-19 | 1997-08-26 | Esuwan Corp | 音波通信装置及びその方法 |
JP2002368633A (ja) * | 2001-06-06 | 2002-12-20 | Mitsubishi Electric Corp | Fm雑音除去装置及びfm受信機 |
JP2006339913A (ja) * | 2005-05-31 | 2006-12-14 | Sharp Corp | 赤外線リモコン受信機 |
WO2007069445A1 (ja) * | 2005-12-14 | 2007-06-21 | Pioneer Corporation | マルチパスノイズ検出装置及びマルチパスノイズ除去装置 |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH02162999A (ja) * | 1988-12-16 | 1990-06-22 | Sony Corp | 超音波通信装置 |
JP4538173B2 (ja) | 2001-08-27 | 2010-09-08 | 株式会社日立製作所 | アクセス先入力プログラムおよびアクセス先入力装置 |
JP2004139525A (ja) | 2002-10-21 | 2004-05-13 | Nec Corp | 個人情報提供システム、個人情報提供方法 |
JP4263123B2 (ja) | 2004-03-23 | 2009-05-13 | 三洋電機株式会社 | 信号処理回路 |
JP5856187B2 (ja) * | 2012-01-31 | 2016-02-09 | エイディシーテクノロジー株式会社 | 音波通信システム及び受信装置 |
-
2013
- 2013-01-31 JP JP2013556495A patent/JP5856187B2/ja not_active Expired - Fee Related
- 2013-01-31 US US14/376,110 patent/US9331792B2/en not_active Expired - Fee Related
- 2013-01-31 WO PCT/JP2013/052214 patent/WO2013115317A1/ja active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09224005A (ja) * | 1995-07-19 | 1997-08-26 | Esuwan Corp | 音波通信装置及びその方法 |
JP2002368633A (ja) * | 2001-06-06 | 2002-12-20 | Mitsubishi Electric Corp | Fm雑音除去装置及びfm受信機 |
JP2006339913A (ja) * | 2005-05-31 | 2006-12-14 | Sharp Corp | 赤外線リモコン受信機 |
WO2007069445A1 (ja) * | 2005-12-14 | 2007-06-21 | Pioneer Corporation | マルチパスノイズ検出装置及びマルチパスノイズ除去装置 |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140369169A1 (en) * | 2012-01-31 | 2014-12-18 | System Design Corp. | Acoustic wave communication system and receiver |
US9331792B2 (en) * | 2012-01-31 | 2016-05-03 | Adc Technology Inc. | Acoustic wave communication system and receiver |
EP3591903B1 (en) * | 2013-09-16 | 2024-08-21 | LG Electronics Inc. | Home appliance |
JP2015156608A (ja) * | 2014-02-21 | 2015-08-27 | 日本電気株式会社 | 端末、通話システム、通話方法 |
JP2016046583A (ja) * | 2014-08-20 | 2016-04-04 | ヤマハ株式会社 | 放音装置およびヘッドホン |
JP2016207043A (ja) * | 2015-04-24 | 2016-12-08 | Line株式会社 | 端末装置、決済サーバ、決済システム、決済方法、及びプログラム |
JP2017063330A (ja) * | 2015-09-25 | 2017-03-30 | 株式会社フィールドシステム | 情報提供システム |
JP2020113837A (ja) * | 2019-01-09 | 2020-07-27 | 三菱電機株式会社 | リモートコントローラ、携帯端末、機器設定方法および機器設定システム |
JP7195158B2 (ja) | 2019-01-09 | 2022-12-23 | 三菱電機株式会社 | リモートコントローラ、機器設定方法および機器設定システム |
JP2022508282A (ja) * | 2019-06-04 | 2022-01-19 | ミューズライブ インコーポレイテッド | 超音波を利用した認証情報伝送装置 |
JP7009674B1 (ja) | 2019-06-04 | 2022-01-25 | ミューズライブ インコーポレイテッド | 超音波を利用した認証情報伝送装置 |
JP7466294B2 (ja) | 2019-11-14 | 2024-04-12 | 三菱電機株式会社 | 通信システム及び通信方法 |
Also Published As
Publication number | Publication date |
---|---|
US9331792B2 (en) | 2016-05-03 |
US20140369169A1 (en) | 2014-12-18 |
JPWO2013115317A1 (ja) | 2015-05-11 |
JP5856187B2 (ja) | 2016-02-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5856187B2 (ja) | 音波通信システム及び受信装置 | |
US9721465B2 (en) | Information-providing system, portable terminal device, server, and program | |
JP3822224B1 (ja) | 情報提供システム | |
CN103828382B (zh) | 视频显示装置、终端装置及其方法 | |
US9232347B2 (en) | Apparatus and method for playing music | |
JPH10163988A (ja) | 送受信装置および送受信方法、受信装置および受信方法、並びに送信装置および送信方法 | |
JP2008079139A (ja) | インタラクティブ装置およびインタラクティブ装置の制御方法 | |
JP3834579B1 (ja) | 情報提供システム | |
JP2004532541A (ja) | 無線による音楽およびデータの送受信機システム | |
WO2007086464A1 (ja) | 携帯通信機器およびその制御方法 | |
JP2012531628A (ja) | モバイルメディアデバイスのユーザーインターフェース | |
JP2012155706A (ja) | 情報提供システム、携帯端末装置、識別情報解決サーバおよびプログラム | |
JP2014187490A (ja) | 放送受信装置及び端末装置 | |
JP2011170282A (ja) | 再生装置および再生方法 | |
EP3920473B1 (en) | Device cooperation method, apparatus and system | |
CN108370458A (zh) | 显示装置、信息终端和信息处理方法 | |
JP2007060496A (ja) | 番組コンテンツ再生装置 | |
KR101214515B1 (ko) | 방송콘텐츠의 부가정보 제공 시스템 및 그 방법 | |
TW202203656A (zh) | 利用不可聽信號的線上購物方法、裝置、系統及計算機程序 | |
JP2008152707A (ja) | アドレス情報制御装置及びアドレス情報制御方法 | |
US9985735B1 (en) | Broadcast near field communication to mobile device | |
US20080187292A1 (en) | Device for and Method of Providing Operating Data and/or Data Associated with Playback Data to a Remote Device | |
JP4045554B2 (ja) | 送受信装置および送受信方法、並びに受信装置および受信方法 | |
KR102524066B1 (ko) | 웹기반으로 디바이스를 식별하는 방법 및 장치 | |
JP2003114999A (ja) | 特典情報提供システム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13743286 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2013556495 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14376110 Country of ref document: US |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 13743286 Country of ref document: EP Kind code of ref document: A1 |