JP2006203643A - Digital data processing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a digital data processing device capable of utilizing digital data multiplexed onto voice immediately and certainly. <P>SOLUTION: A microphone 101 at a calling telephone device 100 converts voice of a calling party into an electrical signal, and a digital data multiplexer 102 multiplexes digital data input from a digital data input 103 onto the electrical signal representing the voice. The digital data multiplexed electrical signal representing the voice is routed to a called party telephone device 200 via a signal transmitter 105. A signal receiver 201 at the called party telephone device 200 receives the electrical signal from the calling telephone device, and a digital data demultiplexer 202 demultiplexes the multiplexed digital data from the electrical signal. The electrical signal representing the voice is sent to a speaker 203, and a called party hears the voice converted by the speaker. A digital data processor 204 receives the demultiplexed digital data from the digital data demultiplexer 202, and performs a desired processing. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a voice processing technique using voice as a barcode.

  Bar codes consisting of one-dimensional or two-dimensional images are in practical use. By using the bar code, digital data can be acquired immediately and reliably.

  Of course, when information is propagated by voice, it is difficult to obtain the information immediately and reliably. For example, when voice is flowing from the handset (speaker) when using a telephone, even if there is important information there, it cannot be used unless it is noted. The same applies to the case where important information is transmitted by voice while watching a television or radio program.

  In addition, information propagated by voice cannot be revealed as information unless a person or a voice recognition device is used. When such information is input to a mobile phone or personal computer, a person or special recognition is required. It is necessary to perform input processing using an apparatus, and handling is complicated.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide an audio processing technique that enables information to be acquired immediately and reliably using audio.

  According to this invention, in order to achieve the above-mentioned object, the configuration as described in the claims is adopted. Here, prior to describing the invention in detail, supplementary explanations of the claims will be given.

  That is, according to one aspect of the present invention, in order to achieve the above-described object, the digital data processing device: digital data for extracting digital data multiplexed on the sound from an electrical signal representing the waveform of the sound Extraction means; and application execution means for processing the extracted digital data are provided.

  In this configuration, the digital data multiplexed on the voice can be used immediately and reliably.

  In this configuration, conversion means for converting sound into an electrical signal may be provided, and the digital data extraction means may extract digital data multiplexed on the sound from the electrical signal. In this case, digital data is extracted from the foreign sound.

  Also, receiving means for receiving an electrical signal representing a sound waveform is provided, and the digital data extracting means is for extracting digital data multiplexed on the sound from the electrical signal received by the receiving means. Anyway. In this case, digital data is extracted from the external electric signal.

  The sound is preferably a sound obtained by multiplexing the digital data on a basic pattern sound in an audible area having a predetermined pattern, but is not limited thereto. The user can discriminate that the digital data is carried by the basic pattern sound or the difference between the basic pattern sounds and what kind of digital data is carried.

  The digital data is started to be multiplexed delayed from the start time of the basic pattern sound, and the digital data extracting means determines the start time of the basic pattern sound and starts extracting the digital data. May be.

  The present invention can also be realized as a telephone, a television receiver, a radio receiver, a remote control device, or the like.

  The present invention can be realized not only as an apparatus or a system but also as a method. Of course, a part of the invention can be configured as software. Of course, software products used for causing a computer to execute such software are also included in the technical scope of the present invention.

  These and other aspects of the invention are set forth in the appended claims and will be described in detail below with reference to examples.

  According to the present invention, digital data multiplexed on sound can be used immediately and reliably.

  Examples of the present invention will be described below.

  First, a first embodiment in which the digital data processing technique of the present invention is applied to a telephone will be described. In the following, the target digital data is also referred to as a sound barcode.

  FIG. 1 shows the telephone of this embodiment and its use environment. In this figure, an example is shown in which a call is made from a calling telephone 100 to a called telephone 200 via a telephone line 150. In the figure, switching offices and the like are omitted. The calling side telephone 100 shows only the calling side functional parts, the called side telephone 200 shows only the called side functional parts, and the corresponding functional parts are not shown. is there. The calling side telephone 100 includes a microphone 101, a digital data multiplexing unit 102, a digital data input unit 103, a digital data storage unit 104, a signal transmission unit 105, a display unit 106, and the like as functional parts related to the call. Yes. The called telephone 200 has a signal receiving unit 201, a digital data demultiplexing unit 202, a speaker 203, a digital data processing unit 204, a digital data storage unit 205, a display unit 206, etc. as functional parts related to the incoming call. Yes. The display unit 106 used in connection with an outgoing call and the display unit 206 used in connection with an incoming call are usually the same, but not limited thereto.

  The microphone 101 of the calling telephone 100 converts the caller's voice into an electrical signal, and the digital data multiplexing unit 102 converts the voice signal into an electrical signal (baseband signal, subband signal, digital signal, etc.) digitally. The digital data input from the data input unit 103 is multiplexed. As the multiplexing method, an example will be described later, but various methods such as FFT (Fast Fourier Transform), DCT (Discrete Cosine Transform), spread spectrum method, and the like can be adopted. Digital data itself may be frequency-converted to an appropriate frequency. The electric signal representing the voice in which the digital data is multiplexed is sent to the called telephone 200 via the signal transmission unit 105.

  The signal receiving unit 201 of the called telephone 200 receives an electric signal representing the voice from the calling telephone, and the digital data demultiplexing unit 202 demultiplexes the digital data multiplexed on the electric signal. The demultiplexing method corresponds to multiplexing. The electric signal representing the voice is sent to the speaker 203, and the called party listens to the voice converted by the speaker. The digital data processing unit 204 receives the demultiplexed digital data from the digital data demultiplexing unit 202 and executes a desired process. For example, a call is made to a destination indicated by digital data, web browsing is performed, an e-mail is transmitted to a designated destination, and details of the digital data are displayed. The processing of the digital data processing unit 204 is realized by, for example, an application program or an embedded program.

  FIG. 2 shows an example of the calling side telephone 100 and the called side telephone 200. In FIG. 2, the telephone 10 includes a display unit 11 (corresponding to the display units 106 and 206), a key operation unit 12, a digital data input button 13, a digital data recording button 14, and the like. The key operation unit 12, the digital data input button 13, the digital data recording button 14, and the like may be displayed on the display unit 11 and input via the display unit 11. The key operation unit 12 is used to input a telephone number or alphabet, and to control various mode settings, state transitions, and the like, and operation contents and the like are displayed on the display unit 11. The telephone 10 has a web browsing function 15 and a mail browsing / sending function 16.

  2 is a mobile communication mobile phone, the present invention is not limited to this and may be a fixed phone or the like.

  FIG. 3 shows a display example of the display unit 11 (106) when digital data is input using the digital data input unit 103 of the calling telephone 100 of FIG. As shown in FIG. 3, the screen moves to a multiplexed data creation screen, and a telephone number, an e-mail address, a web URL, and the like are input using the key operation unit 12 and the like. By operating the “Register” button 11a, the input content can be registered as digital data to be multiplexed. A plurality of digital data can be processed once using a delimiter code. Thereafter, when the digital data input button 13 is pressed during a call, the digital data can be multiplexed with the call voice.

  FIG. 4 shows an example of a reception screen of digital data in the call voice received by the called telephone 200 in FIG. When the operator (calling user) presses the digital data recording button 14, the digital data in the call voice is demultiplexed and displayed on the display unit 11 (206) as “receiving”. Pressing the digital data recording button 14 again cancels the recording. A record release button may be provided separately. Without providing the digital data recording button 14, the demultiplexing process and the recording of the separated data may always be performed during a call. The demultiplexed digital data is stored in the digital data storage unit 205, and the recorded content can be browsed. An example of this browsing display is shown in FIG. In the example of FIG. 5, the transmission source (telephone number, name (converted from the telephone number using the address book)), reception time, contents, etc. are displayed for the recorded digital data. However, the present invention is not limited to this. When one of the recorded digital data entries is selected (inverted display) and then the “connect button” 11b is selected and operated, the call software, mail software, and browsing software are activated, and call, mail communication, and browsing are performed. It is possible to make a request, etc. Also, the “detail button” 11c can be selected and displayed to display all of its contents.

  Next, the digital data multiplexing / demultiplexing technique of this embodiment will be described. Of course, various other methods may be employed.

  In this example, digital information is superimposed on the audio frequency band as will be described in detail later. The mechanism is the application of conventional modem technology.

  In this example, the following two types can be implemented.

(1) Audible type is basically short (several seconds).
Humans can hear and understand.
Mainly audible range (60-15000Hz).
Withstand audio compression.
Good touch.
Resistant to noise.

(2) Non-audible (stealth) type: short (several seconds) or long (several minutes).
Uses a non-audible range that cannot be heard by humans.
Resistant to noise.
Multiple contents can be stored.

  The basic multiplexing method is as follows.

(1) Bit representation is performed using frequency, energy (volume), and time. (Described later)
(2) Create an audible type in the audible range. The mechanism to understand by listening to "This sound is a sound barcode" is as follows.
(A) A waveform having a basic structure (basic waveform) is defined in advance. That shows the characteristics of the sound barcode (a kind of sound logo). It is a sound that can be understood immediately as a sound bar code.
(B) Separately from this, a waveform in which a bit string to be expressed is embedded is created, and the waveform is completed by superimposing it on the basic waveform.
(C) It is assumed that the bit string to be expressed has undergone processing such as compression, error correction, and header addition to the original bit string.
(D) When superposing on the basic waveform, a digital watermark technique may be used. In that case, the original sound changes to some extent. However, the range is good for the ears.
(3) Since the stealth type uses a non-audible range, it does not consider harshness. In addition, error tolerance is enhanced in consideration of transporting large amounts of data.

  FIG. 6 shows a hierarchical model for multiplexing digital data and an example thereof. In FIG. 6, the payload layer is for storing digital data. The protocol header layer is for storing a protocol for processing digital data, version information, and the like. The control header layer is for storing control information for performing multi-channel partition control and encryption. The error control layer is for storing information on error correction using fine decoding. The encoding / transmission technology layer is for storing control information when performing synthesis / separation with the base waveform and FFT. The base waveform is the sound that characterizes the sound barcode.

  A bit string (digital data, sound bar code) is converted into sound bar code sound using such a protocol stack.

  The bit string / analog audio conversion method in the encoding / transmission technology layer is as follows.

  Basically, the frequency band is divided and a bit is assigned to each energy intensity (sound pressure) for expression. Expand it on the time axis. In addition, you may express with the variation | change_quantity for every time.

  When digital data is multiplexed and output as audio, digital information (bit string) is synthesized as the above waveform group by FFT, and audio is generated upon synthesis with the base waveform. You may perform the calculation combined with the base waveform in the state of the bit string.

  When digital data is demultiplexed by inputting voice, conversely to the above, (analog) voice acquired from a microphone or the like is converted into a bit string by FFT. The base waveform may be removed or may be left to error correction without being performed.

  FIG. 7 shows a configuration example of the digital data demultiplexing unit 202. In FIG. 7, the digital data demultiplexing unit 202 includes an analog / digital conversion unit 2021, a waveform conversion unit 2022, an error correction unit 2023, an encryption processing unit 2024, a channel information processing unit 2025, a protocol data processing unit 2026, and the like. Has been. The analog / digital conversion unit 2021 digitizes the analog input sound. The waveform converting unit 2022 performs separation from the base waveform and FFT. The error correction unit 2023 performs error correction using a cyclic code or the like. If the encryption processing unit 2024 is encrypted, the encryption processing unit 2024 performs the decryption. The key to be used is held inside the receiver. The channel information processing unit 2025 acquires channel information to be used and filters information outside the channel. The protocol data processing unit 2026 acquires protocol identification information, version information, and the like for processing data. The finally acquired digital data is processed by application software (digital data processing unit 204).

  FIG. 8 shows a configuration example of the digital data multiplexing unit 102. In FIG. 8, the digital data multiplexing unit 102 includes a protocol data adding unit 1021, a channel information adding unit 1022, an encryption processing unit 1023, an error encoding unit 1024, a waveform converting unit 1025, and the like. The protocol data giving unit 1021 gives protocol identification information and version information, and the channel information giving unit 1022 gives a channel number to be used. The encryption processing unit 1023 performs encryption when necessary. The error encoding unit 1024 performs redundancy for error correction using a cyclic code or the like. The waveform conversion unit 1025 performs synthesis with the base waveform and FFT. The finally obtained sound barcode file (stream) is distributed via a communication line or a broadcast line. In this example, the signal is transmitted to the called telephone 200 by the signal transmission unit 105.

  As described above, according to this embodiment, the digital data multiplexed into the voice can be used immediately and reliably.

  It is preferable that the digital data start to be multiplexed with a delay from the start time of the bass sound (basic pattern sound). By doing so, the user can surely know the fact of the multiplexing of the digital data, and the digital data can be reliably acquired even if the instruction (button operation) of the demultiplexing process is subsequently performed. Alternatively, the base sound may be automatically determined and the demultiplexing process may be activated.

  Next, a second embodiment in which the present invention is applied to broadcasting technology will be described.

  FIG. 2 shows a configuration of the second embodiment. In this figure, portions corresponding to those in FIG. In this example, digital data is multiplexed by the television broadcast station 300 and the digital data is demultiplexed by the television receiver 400. The portion related to the video signal in television broadcasting is omitted. The audio part is also shown in a simplified manner. Also, the audio part signal multiplexed by the digital data multiplexing unit 102 in the television broadcast station 300 is combined with the video part signal into a television signal and recorded directly or after being recorded, the television receiver 400. Delivered to the side. The television receiver 400 displays the demultiplexed digital data on the screen (display unit 206). If the television receiver 400 is intelligent and can process information, digital data can be processed by an application program. Of course, the television receiver 400 may be a personal computer having the function of a television receiver, or a set-top box such as CATV.

  Further, in addition to multiplexing the digital data in the audio part or independently, the digital data may be multiplexed in the video part and used or displayed in an application program or the like. Alternatively, the closed caption data may be multiplexed with the audio part or the video part and sent as digital data. In this case, it is preferable that the audio part is multiplexed in a non-audible band.

  Further, the present invention may be applied to radio broadcasting instead of television broadcasting.

  Next, a third embodiment in which the present invention is applied to a remote controller device will be described.

  FIG. 10 shows a remote controller device 500 according to the third embodiment and a use environment thereof. In this figure, the remote controller device 500 includes a microphone 501, a digital data demultiplexing unit 502, a digital data processing unit 503, and a digital data storage unit. 504, a display unit 505, a remote control main circuit unit 506, a control signal transmission unit 507, and the like. The digital data demultiplexing unit 502, digital data processing unit 503, digital data storage unit 504, and display unit 505 are the same as the digital data demultiplexing unit 202, digital data processing unit 204, digital data storage unit 205, and display unit 206 of FIG. Each corresponds. In this example, for example, sound from the speaker 601 of the television receiver 600 is converted into an electric signal by the microphone 501, and the multiplexed digital data is separated and used by the digital data demultiplexing unit 502. The remote control main circuit unit 506 realizes a main operation for remote control, and the control signal transmission unit 507 transmits a control signal to the control signal reception unit 602 of the television receiver 600 by, for example, infrared rays. The control unit 603 of the television receiver 600 performs various controls such as channel switching and on / off control based on the control signal received by the control signal receiving unit 602. The digital data processing unit 503 executes an application program.

  Also in this example, for example, an application program is executed by the remote controller device 500 and digital data is appropriately used.

  The remote controller device 500 may be for controlling an electric device 700 other than the television receiver 600, or may be a general-purpose remote controller device (which can control a plurality of electric devices including a television receiver). good. For example, in the case of a remote controller device that controls a microwave oven or the like, digital data of recipe information may be obtained by demultiplexing from audio information from the television receiver 600 and automatically set in the microwave oven.

  In addition, a portable telephone such as mobile communication may be provided with a remote controller function to similarly demultiplex digital data. In this way, it is possible to make a call using digital data multiplexed in the audio part and video part of a television broadcast or radio broadcast, browse the web, or send an e-mail.

  Next, a fourth embodiment in which the present invention is applied to a general-purpose information processing device will be described.

  FIG. 11 shows an information processing apparatus 800 of this embodiment (for example, a portable information device such as a personal computer or a PDA, an intelligent telephone, etc.). In FIG. 11, portions corresponding to those in FIG. did. In this embodiment, the digital data multiplexed in the foreign sound is demultiplexed by the digital data demultiplexing unit 502 and used by the digital data processing unit 503 (application program execution unit). A sound source in which digital data is multiplexed is not limited to a television receiver, a radio receiver, a telephone, or the like, and may be any sound source that has been electroacoustic converted by a speaker. Note that an electrical signal before being input to a speaker or the like may be extracted from a predetermined terminal and used.

  Although the embodiments have been described above, according to these embodiments and their alternatives, particularly in the case of an audible type, like an image barcode, “a certain symbol can be seen at a glance and“ read ”for it can be read by humans. By instructing the machine, an audio version of “a mechanism that can extract and process individual information encoded in symbols” can be realized.

  In addition, since digital information is compressed and converted into sound and delivered, it can also be used in the area of near-field communication, and can be used for data communication (for example, Bluetooth (trademark)) using weak radio waves for short distance. Is also optimal. For example, a recipe downloaded with a mobile phone can be set in a microwave by voice.

  As accessibility technology, the function of adding subtitles and URLs to sound is utilized, and even for people with hearing impairments during disaster prevention broadcasting etc., the content of the broadcast is displayed on the screen by capturing the sound barcode through the microphone of the mobile phone. You can make it.

  Also, as a media multiplexing technology, like the visible radio, the title, artist, and purchase URL of the music currently playing in FM broadcasts are embedded at the beginning of the music with a sound bar code, which is identified by the radio, and the LCD screen You can display or set the download site if you have a network connection environment.

  Furthermore, it is not possible to use a format that “a person can be identified” but, for example, a format that uses a frequency outside the audible range, and that “a person does not know” (non-audible type) is also possible.

  Specifically, real-time audio subtitles can be realized. Using the sound in the high frequency region, the contents of the voice information are converted into text and streamed in real time. The sound is picked up by the microphone of the mobile phone and decoded, and the subtitles are displayed on the screen. English is also possible.

  In addition, a “sound flyer” (which realizes a flyer by voice) can be configured. In other words, at the same time that the advertising phrases are repeated on the street, a digital flyer can be distributed and displayed on each mobile phone using high frequency.

  You can also transfer files. That is, it can be used as an alternative to infrared communication as a file transfer means (one-way communication) between a personal computer and a mobile phone, between a mobile phone and a mobile phone, or the like.

  When the technique of the above-described embodiment is compared with a bar code, unlike a bar code printed on a paper medium, a plurality of users can use it simultaneously. For example, all users can receive timetables at the station announcement.

  In addition, when the technology of the above-described embodiment is compared with a FAX / modem or the like, the data stored in the sound bar code is given channel information, and even if a plurality of sound bar codes are sounded at the same time, the channel information There is an advantage that identification is possible without confusion.

  Furthermore, it is different in that it always operates when compared with a fax / modem or the like. The receiver constantly monitors the external sound with the microphone, and if the sound includes a sound bar code, the data is automatically acquired. (It is also possible to turn off the function and operate only when specified by the user)

  Furthermore, when compared with a fax / modem or the like, information transmission for only a specific user is possible by means of a distribution channel or keyword matching.

  In addition, the amount of information is highly variable when compared with a barcode. In a short amount of time, a small amount (several tens of bytes) of information can be given using sounds that are harsh to humans, or tens of thousands of bytes of data can be transferred in minutes using non-audible sound. It is.

It is a figure explaining the structure of Example 1 of this invention. 3 is a diagram illustrating an example of a telephone according to Embodiment 1. FIG. It is a figure explaining the multiplexed data input operation | movement of Example 1. FIG. It is a figure explaining the demultiplexing operation | movement of the multiplexed data of Example 1. FIG. FIG. 3 is a diagram illustrating an example of use of demultiplexed digital data according to the first exemplary embodiment. 3 is a diagram illustrating a multiplexing hierarchical model according to Embodiment 1. FIG. FIG. 3 is a diagram illustrating a configuration example of a digital data demultiplexing unit 202 according to the first embodiment. 3 is a diagram illustrating a configuration example of a digital data multiplexing unit 102 according to the first embodiment. FIG. It is a figure explaining the structure of Example 2 of this invention. It is a figure explaining the structure of Example 3 of this invention. It is a figure explaining the structure of Example 4 of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Telephone 11 Display part 12 Key operation part 13 Digital data input button 14 Digital data recording button 15 Web browsing function 16 Mail browsing / transmission function 100 Calling side telephone 101 Microphone 102 Digital data multiplexing part 103 Digital data input part 104 Digital data Storage unit 105 Signal transmission unit 106 Display unit 150 Telephone line 200 Called telephone 201 Signal reception unit 202 Digital data demultiplexing unit 203 Speaker 204 Digital data processing unit 205 Digital data storage unit 206 Display unit 300 Television broadcast station 400 Television Receiver 500 Remote controller device 501 Microphone 502 Digital data demultiplexing unit 503 Digital data processing unit 504 Digital data storage unit 505 Display unit 506 Remote control Main circuit unit 507 control signal transmission unit 600 television receiver 601 speaker 602 control signal reception unit 603 control unit 700 electric device 800 information processing apparatus 1021 protocol data addition unit 1022 channel information addition unit 1023 encryption processing unit 1024 error encoding unit 1025 Waveform conversion unit 2021 Analog / digital conversion unit 2022 Waveform conversion unit 2023 Error correction unit 2024 Encryption processing unit 2025 Channel information processing unit 2026 Protocol data processing unit

Claims (10)

Digital data extraction means for extracting digital data multiplexed in the sound from an electrical signal representing the waveform of the sound;
A digital data processing apparatus comprising: an application execution unit that processes the extracted digital data.   2. The digital data processing apparatus according to claim 1, further comprising conversion means for converting sound into an electrical signal, wherein the digital data extraction means extracts digital data multiplexed with the sound from the electrical signal.   A receiving means for receiving an electrical signal representing a sound waveform, wherein the digital data extracting means extracts digital data multiplexed on the sound from the electrical signal received by the receiving means. 1. A digital data processing apparatus according to 1.   4. The digital data processing device according to claim 1, wherein the sound is obtained by multiplexing the digital data on a basic pattern sound in an audible area having a predetermined pattern.   The digital data is started to be multiplexed delayed from the start time of the basic pattern sound, and the digital data extraction means determines the start time of the basic pattern sound and starts extracting the digital data. 4. The digital data processing device according to 4. A multiplexing means for multiplexing digital data on an electrical signal representing sound;
A digital data multiplexing apparatus comprising distribution means for distributing multiplexed electrical signals. Digital data extraction means for extracting digital data multiplexed on the sound from an electrical signal representing a sound waveform sent via a telephone line;
A telephone having application execution means for processing the extracted digital data.   8. The telephone set according to claim 7, wherein the application execution means communicates with a destination designated by the extracted digital data. Digital data extraction means for extracting digital data multiplexed on the sound from an electrical signal representing a sound waveform sent via a telephone line;
A broadcast signal reproduction apparatus comprising: an application execution unit that processes the extracted digital data. Digital data extraction means for extracting digital data multiplexed on the sound from an electrical signal representing a sound waveform sent via a telephone line;
An application execution means for processing the extracted digital data.