WO2017131266A1

WO2017131266A1 - System for providing information using audible range audio signal

Info

Publication number: WO2017131266A1
Application number: PCT/KR2016/001040
Authority: WO
Inventors: 길현배; 정지환; 김재영
Original assignee: 주식회사 트리니티랩
Priority date: 2016-01-29
Filing date: 2016-01-29
Publication date: 2017-08-03

Abstract

Disclosed in the present invention is a system for providing information using an audible range audio signal. The apparatus comprises: an encoding device for receiving a content file and categorizing an audio signal and a video signal, analyzing the components of the audio signal which has been categorized to generate a tailored key signal, and encoding same into the audio signal that has been categorized in an audible range; a broadcasting device for receiving the audio signal that has been encoded and streaming same; a receiving device for receiving the encoded audio signal which has been transmitted, converting same into an analog signal, and outputting same; a mobile device for receiving the encoded audio signal which has been converted, detecting the key signal through an embedded detection algorithm, and outputting same; and a server for receiving, through a wireless communication network, the key signal that has been detected, extracting matching information from previously saved information, and transmitting same to the mobile device.

Description

Information providing system using audible band audio signal

The present invention relates to an information providing system using an audio signal. More particularly, the present invention relates to a system and method for generating a customized key signal for an audio signal classified in a content file, detecting a key signal by receiving an audio signal encoded and transmitted in an audible band, The present invention relates to an information providing system using an audible band audio signal capable of extracting information matched with a detected key signal from information stored in a server and transmitting the extracted information to a mobile device.

As we move into the mobile age, we are trying various efforts to connect offline content with online content.

The result is a beacon or NFC that has upgraded Bluetooth technology and Bluetooth technology a bit.

Bluetooth and a beacon based on this Bluetooth communication, the Bluetooth wireless system is a technology that uses 2400 ~ 2483.5 MHz frequency band of Industrial Scientific and Medical (ISM).

In order to prevent interference with other systems using frequencies other than the ISM frequency band, a total of 79 channels are used, ranging from 240 MHz to 2480 MHz except for the range from 2 MHz after 2400 MHz to 3.5 MHz before 2483.5 MHz.

The ISM frequency band is a frequency band allocated for industrial, scientific, and medical purposes, and is a technology commonly used in personal wireless devices that emit low-power radio waves without the need for permission to use radio waves.

On the other hand, in the case of Bluetooth or beacon, the limit of the distance to acquire the information and the Bluetooth function must be turned ON in order for the mobile devices to acquire the corresponding information.

Although Bluetooth itself is a low-power communication, mobile devices equipped with an application processor (AP) that is limited in battery power and low in power compared to conventional communication methods, As a communication method, the transmission distance of information is very limited at a short distance.

There is a communication method using a very high frequency or an extremely low frequency for communication using audio.

The biggest drawback of this approach is that it can be very disturbing to the ear of companion animals living with humans and humans, and cumulative exposure to such audio signals has a negative effect on the physical or psychological effects of humans or animals.

It is an object of the present invention to provide an information providing system using an audible band audio signal that can be applied to a communication infrastructure capable of being applied without any additional hardware to an existing broadcasting infrastructure to transmit information to a long distance with low power.

In addition, although an audible band suitable for a human auditory sense is used for transmitting information using an audio signal, an analog signal that can not be easily acquired by a human auditory sense is communicated as a carrier of information, so that human and companion animals are physically and psychologically And to provide an information providing system using an audible band audio signal capable of preventing a negative influence.

According to another aspect of the present invention, there is provided an information providing system using an audible band audio signal, the system comprising: a receiving unit receiving a content file and classifying the received audio and video signal into an audio signal and a video signal; An encoding device for encoding the encoded audio signal in the band; A broadcasting apparatus for receiving the encoded audio signal and streaming the encoded audio signal; A receiving unit for receiving the transmitted encoded audio signal, converting the received audio signal into an analog signal, and outputting the converted analog signal; A mobile device that receives the converted encoded audio signal and detects and outputs a key signal through a built-in detection algorithm; And a server for receiving the detected key signal through the wireless communication network and extracting matched information from the stored information, and transmitting the extracted information to the mobile device.

According to another aspect of the present invention, there is provided an apparatus for providing information using an audible band audio signal, comprising: an extractor for classifying the content file into an audio signal and a video signal; An encoder for setting an interval in which the classified audio signal can be inserted in a time domain or a frequency domain, generating the customized key signal according to the set interval, and inserting the customized key signal into an audio signal classified in an audible band; And a combiner for recombining and outputting the encoded audio signal and the classified video signal.

In order to achieve the above object, the mobile device of the information providing system using an audible band audio signal according to the present invention is adapted to convert the converted encoded audio signal into a digital signal by a non-reversible compression method.

In order to achieve the above object, the mobile device of the information providing system using an audible band audio signal according to the present invention approximates a location where the mobile device is provided with a communication service by using an embedded acceleration sensor and an A / D converter .

In order to attain the above object, the mobile device of the information providing system using an audible band audio signal according to the present invention measures a distance from the receiving device, and calculates a moving distance and a moving time obtained by the acceleration sensor based on the measured distance The location of the mobile device is calculated according to the information about the location of the mobile device.

In order to achieve the above object, the matching information of the information providing system using the audible band audio signal of the present invention is at least one of text, video, audio, and URL information.

In order to attain the above object, the server of the information providing system using the audible band audio signal of the present invention is connected to the online shopping mall to provide the matched information.

In order to achieve the above object, the customized key signal of the information providing system using the audible band audio signal of the present invention includes data that can provide a visual advertisement effect.

In order to achieve the above object, the customized key signal of the information providing system using the audible band audio signal of the present invention includes data that can convert sound to text for a hearing impaired person or a foreigner.

In order to achieve the above object, the customized key signal of the information providing system using the audible band audio signal according to the present invention is characterized in that a detection probability of the detection algorithm is increased by inserting a plurality of identical key signals.

In order to achieve the above object, the detection algorithm of an information providing system using an audible band audio signal according to the present invention is characterized in that information of the detected key signal among the inserted same key signals is deleted and backed up in the storage unit in the mobile device .

The details of other embodiments are included in the detailed description and the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and / or features of the present invention and the manner of achieving them will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. It should be understood, however, that the invention is not limited to the disclosed embodiments, but may be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. And is provided to fully explain the scope of the present invention to those skilled in the art.

According to the present invention, it is possible to prevent a limit of a distance from which information can be acquired in a conventional Bluetooth or beacon scheme, a power leakage and a leakage of a storage unit, and overcome the limitation of always being turned on to acquire information .

In addition, the cumulative exposure of the audio signal generated in the communication system using the very high frequency or the very low frequency can prevent the negative effect on the body and the psychology of the human body and the animal.

1 is a configuration diagram of an information providing system using an audible band audio signal according to the present invention.

2 is a flowchart showing the operation of the information providing system shown in Fig.

3 is a flowchart showing the detailed operation of step S100 in operation of the information providing system shown in FIG.

4 is a waveform diagram showing an audio signal before and after being encoded in the encoding apparatus in the information providing system shown in FIG.

Hereinafter, an information providing system using an audible band audio signal according to the present invention will be described with reference to the accompanying drawings.

The terms and words used in the present specification and claims should not be construed as limited to ordinary or dictionary terms and the inventor can properly define the concept of the term to describe its invention in the best way Should be construed in accordance with the principles and meanings and concepts consistent with the technical idea of the present invention.

In the specification, when a component is referred to as being "comprising" or "including" an element, it is to be understood that this may include other elements, . Also, the terms "absence", "unit", "unit", "module", "device" and the like described in the specification mean units for processing at least one function or operation, Lt; / RTI >

1 is a block diagram of an information providing system using an audible band audio signal according to the present invention. The encoding apparatus 100, the broadcasting apparatus 200, the receiving apparatus 300, the mobile apparatus 400, the server 500, And a GPS (600).

The encoding apparatus 100 includes an extractor 110, an encoder 120, a combiner 130, an A / D converter 140 and a storage unit 150. The receiving apparatus 300 includes a D / A converter 310 The mobile device 400 includes a microphone 420 as an A / D converter 410, a storage unit 430, a detection algorithm 440, and an acceleration sensor 450.

FIG. 4 is a waveform diagram showing an audio signal before and after being encoded in the encoding apparatus 100 in the information providing system shown in FIG. 1, in which an original audio signal a, an audio signal b inserted with a key signal after encoding, And a signal pattern (c) into which a key signal is inserted.

The structure and function of each component of the information providing system using the audible band audio signal according to the present invention will be described with reference to FIGS. 1 to 4. FIG.

The encoding apparatus 100 receives the content file and classifies it into an audio signal and a video signal in the extractor 110 (S110).

The component of the classified audio signal is analyzed to set a signal insertable period in the time domain (or frequency domain) (S120).

Also, a customized key signal corresponding to the set time domain (or frequency domain) is generated (S130), and the generated key signal is encapsulated in the original audio signal and then output (S140).

Meanwhile, the combiner 130 receives the encoded audio signal and the classified video signal, combines them, and outputs the combined audio signal and the classified video signal (S150).

The broadcasting apparatus 200 receives the encoded audio signal and the combined video signal from the combiner 130, and transmits the encoded audio signal and the video signal in a streaming transmission mode (S200).

A receiving apparatus 300 having a built-in speaker as the D / A converter 310 receives the encoded audio signal and the video signal, which are digital data transmitted from the broadcasting apparatus 200, and converts the analog audio signal into an analog signal.

The mobile device 400 receives an encoded audio signal and a video signal, which are analog signals transmitted from the receiving device 300, and receives an audio signal including a key signal, which is a kind of A / D converter 410, Conversion.

The decoder 420 receives the converted digital audio signal and detects a key signal through a built-in detection algorithm 440 or a software development kit (S400).

The server 500 receives a key signal detected from the mobile device 400 through a wireless communication network such as a WI-FI, 3G, 4G, or 5G and receives text data , Video, audio, and URL, and outputs the extracted information (S500).

The mobile device 400 receives information such as text, video, audio, and URL extracted from the server 500 and outputs the information to the user.

The detailed operation of the information providing system using the audible band audio signal according to the present invention will be described with reference to FIGS. 1 to 4. FIG.

In recent years, various types of digital contents have been circulated. In the environment where audio signals are output through various types of D / A converters, a key signal embedded in an audio signal outputted through a corresponding converter is detected, And provides customized information to the mobile device 400.

The present invention enables a content delivery service through an audio signal, which was possible only through the existing non-audible band (very high frequency, very low frequency), in the audible band through a technique including a key signal in the audible band (20 Hz - 20 kHz).

A detection algorithm 440 installed in the mobile device 400 or a key inserted already in the audio signal through a program is used as a key signal that is additional information included in audio outputted through an apparatus for outputting an audio signal in a general living environment, And provides additional services according to the information of the detected key signal.

At this time, the mobile device 400 may additionally communicate with the server 500.

That is, the mobile device 400 generates a key signal in the frequency domain of the audio signal not exceeding the audible band (20 Hz-20 kHz), receives the inserted key signal through the A / D converter 410, (440) or a program.

And then transmits contents or information (text, video, audio, URL, etc.) corresponding to the key signal to the corresponding mobile device 400 through communication with the server 500. [

Also, when the audio signal including the key signal is transmitted through the D / A converter 310 installed in the indoor / outdoor environment, for example, a speaker, the output is high or low, The mobile device 400 detects a key signal embedded in the audio signal through the detection algorithm 440 stored in the storage device 440. [

At this time, regardless of whether the user is using the mobile device 400, the mobile device 400 can deliver the content or information matched with the information of the key signal to the owner of the mobile device 400.

In communication via an audio signal, the mobile device 400 must be connected to at least one of a mobile communication network such as a WI-FI or a GPS 600 to acquire contents or information.

That is, if the key signal in the audio signal is detected and additional information or content is provided, the location information of the corresponding consumer can be obtained through the GPS function 600.

Additionally, when the reception of the key signal is performed through the mobile device 400, the position of the mobile device 400 can be roughly grasped in the room where the GPS 600 is not operated.

That is, the location of the corresponding mobile device 400 is calculated approximately using the acceleration sensor 450 and the A / D converter 410 built in the mobile device 400.

Generally, when the mobile device 400 receives the audio signal of the speaker, which is a kind of the D / A converter 310, the energy intensity of the D / A converter 310 varies according to the distance from the speaker.

The present invention is based on the fact that after the mobile device 400 firstly measures the distance from the speaker through the band, the information about the movement obtained by the acceleration sensor 450 in the mobile device 400, And calculates the current position of the mobile device 400 receiving the communication service according to the movement time.

In this case, the mobile device 400 must have information on the position of the speaker in advance.

If the corresponding audio signal is received by the various mobile devices 400 at the same location, only the mobile device 400 including the detection algorithm 440 that can detect the key signal in the corresponding audio signal can receive information I reach an additional service called content delivery.

The presence or absence of a key signal embedded in the audio can not be grasped by the mobile device 400 that does not include the detection algorithm 440 in advance or by the human auditory sense alone.

A key signal embedded in an audio band audio signal can also serve to transmit a message in addition to contents or information transmission.

That is, the mobile device 400 inserts a key signal to transmit a key signal through the D / A converter 310, and another mobile device 400 including the detection algorithm 440 detects the corresponding key signal, You can receive a message directly in the key signal.

This enables short distance communication between mobile devices 400 sharing a space in a specific space at the same time, for example, among mobile devices 400 carried by people traveling on the same time zone in the same time zone.

It is possible to transmit contents and information without limitation to the capacity through the server 500 matched with the key signal having the small bit and the corresponding key signal, and the connection with the online shopping mall is also possible immediately.

The communication method of the present invention has a wider application range than conventional communication services because the communication service can be performed without turning on the Bluetooth function of the mobile device 400 like the conventional beacon or Bluetooth wireless communication method.

In terms of power consumption, communication services that exceed the distance limit of conventional beacons and Bluetooth wireless communication systems are possible.

When a key signal is inserted into a broadcast such as a TV or a radio, consumers who have already installed the key signal detection algorithm 440 in the mobile device 400 among the users who consume the content regardless of the distance may receive additional information, Information about the clothes of the drama performer, photographs of the radio cast, and brief profile information.

The communication service entity may communicate in a one-to-one format, and information or contents can be transmitted in a one-to-many format or in a plurality of many-to-many communication methods.

It is possible to transmit data that can provide a visual advertisement effect to the data only made of audio in connection with the mobile device 400. [

It is possible to sequentially acquire various key signals simultaneously in one place and to provide information and contents to the mobile device 400. [

Even if additional A / D converters or amplifiers are added between the D / A converter 310 and the mobile device 400, information or content can be directly acquired through the audio signal output through the D / A converter 310, There is no problem in receiving the audio signal having the key signal to provide information or contents.

The key signal is inserted into the audible band in the original audio signal, and the generated key signal is combined according to the frequency characteristics of the original audio signal, for example, the presence or absence of noise.

The mobile device 400 including the detection algorithm 440 detects an audio signal output to the outside through the D / A converter 310 detects a key signal from the audio signal and transmits the detected key signal to the server 500 through communication with the server 500 Deliver the right content, information, or message.

The communication method of the present invention utilizes the existing digital and analog broadcasting apparatus infrastructure as it is, and the owner of the mobile device 400 consuming contents or information also performs an operation such as additional search or maintenance of the turn-on state of the mobile device 400 The information or the content can be received by the mobile device 400 only by detecting the key signal.

The customized key signal of the present invention may provide additional information tailored to the deaf or foreigner, such as persistent text information, or may convert sounds to text.

That is, it is possible to provide images of indoors broadcasting, public broadcasting or commercial broadcasting to foreigners, or to provide customized texts themselves.

D converter 410 of the mobile device 400 receiving the audio signal including the quality or the key signal of the D / A converter 310 that outputs the audio signal including the key signal, And the like.

It is possible to transmit and receive data through an audio signal irrespective of differences in operating system or hardware quality of the mobile device 400.

The mobile device 400 receiving the data must include at least one A / D converter 410 and a detection algorithm 440 or a software development kit (SDK) .

In addition, it includes an algorithm structure for determining whether a key signal is inserted in the audio signals of the audible band to be received.

The key signal includes one or more various types and a plurality of numbers in the audio signal.

A plurality of identical keys are inserted in order to increase the reception probability of the key signal, thereby increasing the detection probability of the corresponding key signal.

When the mobile device 400 detects one of the same key signals and communicates with the server 500, information on the corresponding key signal is deleted and backed up in the storage unit 430, So that it is possible to reduce power consumption by preventing the same information or a plurality of contents from being delivered.

In broadcasting through an audio signal, the form of the key signal has one or more forms, and its role includes various forms such as a form for providing contents, a form for standby of the A / D converter 410 do.

On the other hand, if the circuit noise is serious enough that the audio signal transmitted through the D / A converter 310 can be heard by the human ear, the transmission of information or the contents may be limited.

It is possible to include a direct or indirect link of a URL in a form of receiving information or contents by detecting a key signal embedded in an audio signal.

The provider of the content or information, for example, the broadcasting apparatus 200, which inserts the key signal into the audio and transmits the broadcasting, must process the audio or video signal through the additional operation of encoding the key signal insertion.

Such processed audio or video signals have a very low degree of deterioration, that is, degradation of sound quality or image quality. In the case of audio signals, only loss to the extent that human auditory ability can not feel deterioration results.

The audio signal including the key signal is provided to the mobile device 400 by digitizing it with a non-reversible compression method in order to prevent security or erasure of data from the outside.

Here, the irreversible compression method refers to a lossy compression method, and is also referred to as an MPEG compression method in the form of a compression of an MP3 file that is often used when a sound source file is discussed.

This compression method is a compression method that reduces the size of a file by applying a loss to the original data.

The human ear is insensitive to low-band sounds and is most sensitive to mid-band sounds.

For high-band sounds that exceed the middle band, they are more sensitive than low-band, but they are less sensitive than middle-band.

The irreversible compression method uses the above characteristics of the human ear to set the dB per frequency in advance and selects only the audible band sound that is heard by the human ear so that only the sound above the threshold dB is converted into data, .

As described above, the present invention applies a communication technology that can be applied to an existing broadcasting infrastructure without adding any additional hardware to transmit information to a long distance with low power, An information providing system using an audible band audio signal that can prevent physical and psychological adverse effects on humans and companion animals by communicating an analog signal that is difficult to acquire by human auditory sense as a vehicle of information, .

Accordingly, the present invention can overcome the limitation of the distance that can be obtained in the conventional Bluetooth or the beacon method, the power leakage and the leakage of the storage unit, have.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but many variations and modifications may be made without departing from the spirit and scope of the invention. Be clear to the technician. Accordingly, the true scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of the same should be construed as being included in the scope of the present invention.

Claims

An encoding apparatus for receiving a content file and classifying the encoded audio signal into a video signal and an audio signal to generate a customized key signal by analyzing a component of the classified audio signal to encode the classified audio signal in an audible band;

A broadcasting apparatus for receiving the encoded audio signal and streaming the encoded audio signal;

A receiving unit for receiving the transmitted encoded audio signal, converting the received audio signal into an analog signal, and outputting the converted analog signal;

A mobile device that receives the converted encoded audio signal and detects and outputs the key signal through a built-in detection algorithm; And

A server for receiving the detected key signal through a wireless communication network and extracting matched information from the stored information and transmitting the extracted information to the mobile device;

And a control unit

Information providing system using audible band audio signal.
The method according to claim 1,

The encoding device

An extractor for classifying the content file into an audio signal and a video signal;

An encoder for setting an interval in which the classified audio signal can be inserted in a time domain or a frequency domain, generating the customized key signal according to the set interval, and inserting the customized key signal into an audio signal classified in an audible band; And

A combiner for recombining and outputting the encoded audio signal and the classified video signal;

And a control unit

Information providing system using audible band audio signal.
The method according to claim 1,

The mobile device

And converting the converted encoded audio signal into a digital signal by a non-reversible compression method,

Information providing system using audible band audio signal.
The method according to claim 1,

The mobile device

Wherein the position estimating unit estimates the position of the mobile device to which the communication service is provided by using the built-in acceleration sensor and the A / D converter.

Information providing system using audible band audio signal.
5. The method of claim 4,

The mobile device

And the position of the mobile device is calculated based on the information on the movement distance and the movement time obtained by the acceleration sensor based on the measured distance,

Information providing system using audible band audio signal.
The method according to claim 1,

The matched information is

Text, video, audio, and URL information.

Information providing system using audible band audio signal.
The method according to claim 6,

The server

An online shopping mall, and provides the matching information.

Information providing system using audible band audio signal.
The method according to claim 1,

The customized key signal

Wherein the data includes data that can provide a visual advertising effect. &Lt; RTI ID = 0.0 >

Information providing system using audible band audio signal.
The method according to claim 1,

The customized key signal

Characterized in that it comprises data capable of converting the sound into text for the deaf or foreigner,

Information providing system using audible band audio signal.
The method according to claim 1,

The customized key signal

Characterized in that a detection probability of the detection algorithm is increased by inserting a plurality of identical key signals.

Information providing system using audible band audio signal.
11. The method of claim 10,

The detection algorithm

And the information about the detected key signal among the inserted same key signals is deleted and backed up in the storage unit in the mobile device.

Information providing system using audible band audio signal.