KR20110139077A

KR20110139077A - System and method for intelligent location finding using short range communication module, microphones and speaker embedded in the appliance for personal environment service

Info

Publication number: KR20110139077A
Application number: KR1020100092172A
Authority: KR
Inventors: 오종택
Original assignee: 오종택
Priority date: 2010-06-20
Filing date: 2010-09-18
Publication date: 2011-12-28

Abstract

PURPOSE: An intelligent global positioning system and a method thereof are provided to easily recognize a relative position between living appliances and a user using an acoustic signal for measuring a location and a distance. CONSTITUTION: An acoustic signal generation command is transmitted to a measurement target instrument(31) through a local area network communications device under the controller(12) of a relative position measurement instrument(11). An acoustic signal is generated in the measurement target instrument through a speaker(34) according to a command. A plurality of microphones(13,16) is built in the relative position measurement instrument and receives the acoustic signal. A relative position with the measurement target instrument is acknowledged by calculating and measuring receiving delay.

Description

System and method for intelligent location finding using short range communication module, microphones and speaker embedded in the appliance for Personal Environment Service }

The present invention uses a short-range communication module embedded in a mobile phone, a multi-microphone and a short-range communication module and speakers built into other living devices in the vicinity of the present invention to optimally control various living devices around a user in a personal environment service. The mobile phone carried by the user is for recognizing the relative position of the living device, and more specifically, a low-cost radio wave or electric signal method or an optical signal method or a near field communication module of an acoustic signal method and two or more microphones. Built-in and built-in short-range communication module and speaker of the same way to other living devices in the vicinity, and when the location measurement signal is sent to the near-field communication method from the mobile phone, the surrounding life received by the same method of near-field communication method The device generates sound signals from the built-in speaker, which is The mobile phone, which has received the microphone, calculates the time difference between the time when the position measurement signal is transmitted and the time when the sound signal is received, and the time difference between the two or more respective microphones. It is about.

[Document 1] is a paper published by the present inventor in a world-renowned journal on the concept of personal environment service. Personal environment service saves personal preference profile information in the mobile phone in advance, and the mobile phone communicates with nearby living devices through WPAN or WLAN communication and automatically controls the devices according to personal preferences. Because of the short-range wireless communication, the mobile phone performs control by direct communication with nearby devices, so that when the user and the device are mutually recognized, they can provide a higher level of service.

[Document 2] is a paper published in 2006. It installs several ultrasonic signal sources in a space and embeds RF transmitting / receiving modules in ultrasonic signal sources for generating ultrasonic signals simultaneously from these signal sources. When the circles transmit the ultrasonic signals sequentially through the RF communication, the device receives the RF communication signal and the ultrasonic signal, calculates the time difference between the RF communication signal and the received ultrasonic signal for each ultrasonic signal source, and calculates the relative position of the device. It is a way to measure.

Also, in order to give the best sound effect to the listener in the advanced home theater system, when the listener claps in front of the system, the stereo microphone installed in the system recognizes the sound and calculates the time difference of each clap received by the microphone. Some use technology to control the phase of the sound produced by the speakers.

[1] JONGTAEK OH AND ZYGMUNT J. HAAS, "PERSONAL ENVIRONMENT SERVICE BASED ON THE INTEGRATION OF MOBILE COMMUNICATIONS AND WIRELESS PERSONAL AREA NETWORKS," IEEE Communications Magazine, Vol. 48, No. 6, pp. 66-72, June 2010. [2] Moon Young-sung et al., "A Study on the Ultrasonic Positioning System for Ubiquitous Computing A Study on Extension of Recognition Area, "Journal of Korean Institute of Communication Sciences, Vol.31 No.7B, pp.595-601.

The above-cited documents are related to the present invention by obtaining the location information of the user using an acoustic signal, but the following points are different.

In [Document 1], a UWB-type short-range wireless communication module is embedded in a mobile phone and various living devices to utilize communication and relative position measurement functions. Therefore, it is difficult to be practical because all mobile phones and devices must use UWB. there is a problem.

In the method of [Document 2], since there must be several ultrasonic signal sources fixed in the same space in order to measure the relative position between devices, there is a problem that a large cost of installing a plurality of ultrasonic signal sources in every space is required. have. That is, while the present invention recognizes a relative position by directly transmitting and receiving a signal between devices, the method of Document 2 measures a relative position in a space by transmitting and receiving a signal with a plurality of signal sources installed in all spaces in advance. Because it is a method, it is difficult to apply practically because the method is fundamentally different and a lot of unnecessary costs are required in a personal environment service requiring only relative positions between devices.

According to the method of the advanced home theater system, the distance from the system cannot be estimated based on the position of the listener, and only the difference between the distance between the listener and each microphone can be calculated. The reason is that in a home theater system, the position of the listener is irrelevant, but the distance difference between the listener and each speaker is important. In other words, the difference in distance or the propagation time difference of the acoustic signal is calculated and based on this, the phase (ie, time) of the acoustic signal generated from each speaker is adjusted to give the optimal stereo sound effect to the listener. Therefore, this method also differs from the method of the present invention and its technology and object.

As described above, the location recognition method of the device using the existing sound signal cannot be used for personal environment service or the system construction cost is very expensive, so it is not practical.

The present invention has been proposed to solve the above problems, the location using a short-range communication module, a multi-microphone, a speaker built in the device for personal environment service for optimal control of various living devices around the user Recognition, low-cost radio wave or electric signal or optical signal or near-field communication module and two or more microphones are built in the cell phone, and other living devices around the same method of near field communication Built-in module and microphone, when the mobile phone sends the position measurement signal to the near field communication method, the nearby living devices receiving the same type of near field communication method generate the sound signal through the built-in speaker, The mobile phone received by the microphone and the time when the location measurement signal is sent It is an object to which recognizes the relative position of the destination device to calculate the time difference between the time of receiving a direction signal and a difference of two or more received individual micro-acoustic signal.

For example, when a mobile phone attempts to recognize a relative position of a nearby living device, the mobile phone transmits a data signal of a predetermined format to the living device through a Bluetooth method. In this case, the data signal includes information of a mobile phone, information of a living device, and a command to generate an audio signal from the living device. The living device receiving this data signal through the built-in Bluetooth module generates a very short sound signal in time immediately or after a designated time after confirming that the mobile phone has commanded to generate the sound signal. If the frequency of this signal avoids the audible frequency, it is inaudible to humans. The living device receives the sound signals from the two microphones built into the phone. The mobile phone estimates the distance between the mobile phone and the living device by calculating the delay time from the time of transmitting the sound signal generation command to receiving the sound signal. At this time, since the propagation time of the Bluetooth signal corresponds to the speed of light, the propagation time delay from the mobile phone to the living device is ignored, and the propagation delay time of the acoustic signal from the living device to the mobile phone is based on the propagation speed of about 340 m / sec. Calculate It also ignores the time from the receipt of the sound signal generation command to the living device until the sound signal is actually generated. However, if a time is required until the generation of the acoustic signal after receiving the command from the living device, the protocol promises to generate the acoustic signal after a predetermined time after receiving the command in advance. In general, when measuring the relative position, the distance is calculated by measuring the propagation delay time between the transceivers, but in this case, the speed of the radio waves is so fast that the measuring equipment must be very precise and operate at high speed, thus increasing the cost and increasing the problem. there was. However, when the acoustic signal is used for the position measurement or the distance measurement, the propagation speed of the sound is slowed down, so the time required for the measurement is relatively easy and inexpensive. An example is an ultrasonic sensor used for vehicle rear detection. In the case of personal environment service, since the mobile phone recognizes and controls living devices around the user, the distance to be measured is relatively short, so that the short distance of propagation of the acoustic signal is not a problem. On the other hand, two or more microphones are built apart from each other in the mobile phone, so that the time when the acoustic signal generated by the living device is received by each microphone depends on the location angle of the living device and the mobile phone. Therefore, by calculating the difference between the reception time difference of the signal received by each mobile phone microphone and the distance between the mobile phone and the living device measured earlier, it is possible to estimate the relative position of the mobile phone and the living device.

The above example has described a method of measuring a relative position with a living device in a mobile phone, and vice versa, a method of measuring a relative position with a mobile phone or another living device in a living device is also the same. When there are several living devices in the vicinity, the mobile phone first recognizes the nearby living devices in a short-range communication method, and then measures relative positions by the above procedure one by one using the recognized living device information. If a cell phone or a living device uses the same short-range communication method, speaker, and microphone, it can relatively estimate its position while listening to the measurement process between other devices.

Other objects and advantages of the present invention can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. Also, it will be readily appreciated that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

In the system of the present invention for achieving the above object, in the intelligent location recognition system using a short-range communication module, a multi-microphone, a speaker built in the device for personal environment service, the short-range communication device and a plurality of microphones under the control of the controller Relative position measurement that transmits a sound signal generation command to a measurement target device through a short range communication device and receives a sound signal generated by the measurement target device according to this command by measuring the relative position with the measurement target device. device; And a measurement target device that receives a sound signal generation command from the relative position measuring device to a short range communication device and generates a sound signal to a built-in speaker accordingly.

On the other hand, the method of the present invention, in the intelligent location recognition method using a short-range communication module, a multi-microphone, a speaker built in the device for personal environment service, under the control of the control unit of the relative position measuring device through a short range communication device Transmitting a sound signal generation command to the device; Generating a sound signal through the speaker by the measurement target device according to the command; And recognizing a relative position with the measurement target device by receiving the sound signals generated by the measurement target device as a plurality of microphones built in the relative position measurement device, measuring and calculating their respective reception delay times. Characterized in that.

As described above, the present invention is essential to provide an optimization service according to a location in a personal environment service such as a living device such as an air conditioner may recognize a location of a user having a mobile phone and set an optimized temperature for the location of the user. It has the effect of providing technology. In particular, the technology of the present invention will be an economical technology that can recognize the relative position inexpensively and easily until communication and positioning technology such as UWB becomes common.

In addition, indoor researches such as estimating the location by the signal strength of the wireless LAN due to the reception of the GPS signal is active, but due to the inconsistency in the characteristics of the wireless signal, its position error is very large, making it difficult to apply. In this situation, the proposed technique can be a good alternative.

1 is a conceptual diagram of a relative position measurement technology according to the present invention.
Figure 2 is an example of an intelligent location recognition system block diagram using a short-range communication module and multiple microphones, speakers built into the device for personal environmental services in accordance with the spirit of the present invention.

1 is a conceptual diagram of a relative position measurement technology according to the present invention, in which a time (seconds) between a mobile phone and an air conditioner is multiplied by the time (seconds) between the command of the mobile phone and the sound signal generated from the air conditioner's speaker. In other words, distance = time delay X is the speed of sound, and the distance difference between the two microphones and the air conditioner is obtained by multiplying the time difference of the sound signals received by the two microphones based on the mobile phone. If the distance difference is r and the distance between two microphones is d, the relative position angle is almost

to be.

FIG. 2 is an example of a block diagram of an intelligent location recognition system using a short range communication module, a multiple microphone, and a speaker built in a device for personal environment service according to the spirit of the present invention. The detailed structure of the present invention is described. The relative position measuring device 11 includes a control unit 12, an RF transmission / reception unit 14, a data processing unit 15, microphones 13, 16, and the like, and the measurement target device 31 includes a control unit 32, The RF transmitter / receiver 33, the speaker 34, and the like are incorporated.

First, the relative position measuring device 11 transmits a sound signal generation command to the measurement target device 31 through the RF transmitter / receiver 14 under the control of the controller 12. Before that, the relative position measuring device 11 and the measurement target device 31 have already recognized each other and have secured the ID of the counterpart. This is a common procedure in communication. Therefore, when the control unit 12 generates the command data frame, the ID of the measurement target device 31 that will generate the sound signal must be included in the frame and its ID must be included as necessary. It may also include attribute information and relative location information with other peripheral devices. In addition, it may include whether the measurement target device 31 that receives the command data frame should immediately generate an audio signal or after a predetermined time. Alternatively, the relative position measuring device 11 may include only the relative position information of the measurement target device 31. In this case, the measuring device does not need to recognize the relative position measuring device in reverse.

Under the control of the control unit 32, the measurement target device 31 receiving the command data frame through the RF transmitter / receiver 33 transmits a short sound signal immediately or after a predetermined time depending on the contents of the command data frame. Occurs through. For advanced signal processing, long signals such as chirp signals or PN code signals may be generated. This also depends on the content of the received command data frame.

Under the control of the control unit 12, the relative position measuring device 11 analyzes an acoustic signal generated by the measurement target device 31 received by the two microphones 13 and 16 through the data processing unit 15 to measure the measurement target device ( 31) Recognize the relative position with After the control unit 12 transmits the command data frame to the measurement target device 31, the control unit 12 may control to receive an audio signal through the microphones 13 and 16, and the input signal may be processed by the data processing unit 15. Wait for it. In particular, when the relative position measuring device 11 sends a command to the measurement target device 31 to generate an acoustic signal of a long signal, the data processing unit 15 should use a correlation function processing technique. The longer the distance between the microphone 1 (13) and the microphone 2 (16), the more accurately the relative position angle can be measured. If three microphones are distributed by 120 degrees and embedded in the relative position measuring device, the three-dimensional relative position angle can be measured. .

The relative position measuring device may transmit a command to wait for the reception of the sound signal generation command to the measurement target device in advance so that the measurement target device receives the sound signal generation command transmitted by the relative position measuring device and immediately generates the sound signal. have.

The method of the present invention as described above may be implemented as a program and stored in a computer-readable recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.). Since this process can be easily implemented by those skilled in the art will not be described in more detail.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawings.

Claims

An intelligent location recognition system using a short-range communication module, multiple microphones, and a speaker built in a device for personal environment service, and a short-range communication device and a plurality of microphones are built-in under the control of a control unit, and sound is measured through a short-range communication device. A relative position measuring device configured to transmit a signal generation command and receive a sound signal generated by the measurement target device according to the command to the plurality of microphones to measure a relative position with the measurement target device; And
Measurement target device that receives a sound signal generation command from the relative position measuring device to the local area communication device and generates a sound signal to the built-in speaker accordingly
Intelligent location recognition system using a short-range communication module and multiple microphones, speakers built into the device for personal environmental services, including.

The method of claim 1,
The relative position measuring device
When transmitting the sound signal generation command, the personal environment service, characterized in that further performing the function of transmitting, including the ID of the self or measurement target device, the type of sound signal generated, or the relative position information of the measurement target device. Intelligent location recognition system using local area communication module, multiple microphones and speakers.

The method of claim 1,
The measurement target device,
Intelligent location recognition system using short-range communication module, multi-microphone and speaker built in the device for personal environment service, characterized in that it performs more functions by selecting from short sound signal or long signal such as chirp signal or PN code. .

The method of claim 1,
The relative position measuring device,
Distribute and mount three or more microphones so that the relative position measurer performs a function of recognizing the relative position in three dimensions. Intelligent location using a short-range communication module, multiple microphones, and speakers built into the device for personal environment services. Recognition system.

The method of claim 1,
The relative position measuring device,
The apparatus for the personal environment service, characterized in that for performing the function of waiting for the reception of the sound signal generation command to the measurement target device in advance, so that the measurement target device receives the sound signal generation command and immediately generate the sound signal. Intelligent location recognition system using local area communication module, multiple microphones and speakers.

In the intelligent location recognition method using a short-range communication module, multiple microphones, and a speaker built in a device for personal environment service, an acoustic signal generation command is transmitted to a measurement target device through a short-range communication device under the control of a control unit of a relative position measuring device. Making;
Generating a sound signal through the speaker by the measurement target device according to the command; And
Receiving a plurality of microphones built into the relative position measuring apparatus by receiving the acoustic signal generated by the measurement target device to measure and calculate the respective reception delay time to recognize the relative position with the measurement target device
Intelligent location recognition method using a local area communication module and multiple microphones, speakers built into the device for personal environment services, including.