KR101965313B1 - System for Providing Noise Map Based on Big Data Using Sound Collection Device Looked Like Earphone - Google Patents

Abstract

[0001] The present invention relates to a system for providing real-time, large-scale data based on sound data using earphone-type sound collecting apparatus, and more particularly to a sound data collecting apparatus for earphone- A smartphone capable of receiving the sound information collected by the earphone type sound collecting device and transmitting the sound information by using wireless communication using GPS, receiving and storing sound information and position information transmitted from the smartphone, A server for generating a noise map by analyzing through a deep learning algorithm and a noise map display device for visualizing and displaying a noise map generated by the server, And a map providing system.

Description

Field of the Invention [0001] The present invention relates to a system and method for providing a real-

More particularly, the present invention relates to a system for providing real-time, large-data-based map data using earphone-type sound collecting apparatuses, and more particularly to a system and method for connecting earphone-type sound collecting apparatuses, A smartphone capable of receiving the sound information collected by the sound collection device of the form, receiving current position information by using GPS, and transmitting the sound information and the position information by using wireless communication, sound information transmitted from the smartphone, And a noise map display device (40) for visualizing the noise map generated by the server and a server for generating a noise map by analyzing the location information by a built-in deep running algorithm. Big data-based real-time noise source using earphone-type sound collector It relates to the delivery system.

The present invention relates to a system for providing a big data-based real-time noise map using an earphone-type sound collector.

A noise map is a map that visually presents the numerical value and distribution of the noise using the theoretical proof equation or the empirical equation obtained from the experimental result and the GIS.

Recently, we have been making noise maps to check the noise damage in local governments such as Gwangju, Ulsan, Daegu, and Busan and prepare customized noise measures.

Korean Patent No. 10-1190882 discloses a cloud computing apparatus and method for visualizing high-speed noise maps.

In addition, a method and apparatus for drawing a noise map is also presented in the United States registered patent method and device for drawing a noise map (method and apparatus for drawing noise map information).

However, in the case of the two prior arts, a computing device for producing a noise map is required, and the computer device can not provide any other functions besides noise mapping, and can not measure moving sound in real time.

Korea Patent No. 10-119082 US Patent No. 09728204 Korean Patent Publication No. 10-2010-0076631

SUMMARY OF THE INVENTION It is an object of the present invention to solve the above problems of the prior art.

An object of the present invention is to provide a real-time noisy map based on big data based on collected information by using an earphone-type sound collection device.

More specifically, the external sound information is collected using an earphone-type sound collecting device and transmitted to a smartphone, the current position information is received using a GPS in the smartphone, and the sound information is transmitted to the server in response to the current position information And the server provides a noise map updated in real time using the received external sound and position information.

The technical objects to be achieved by the present invention are not limited to the above-mentioned problems, and other technical subjects not mentioned can be clearly understood by those skilled in the art from the following description. There will be.

To achieve these and other advantages and in accordance with the purpose of the present invention, as embodied and broadly described herein, there is provided a system for providing real-time, large-data-based map data using earphone-type sound collecting apparatuses, A smartphone capable of receiving sound information collected by the earphone-type sound collecting device, receiving current position information using GPS, and transmitting the sound information and the position information using wireless communication; And a noise map display device for visualizing and displaying a noise map generated by the server by analyzing the sound information and the position information by analyzing the sound information and the position information through a built-in deep running algorithm, .

The earphone-type sound collecting device may include a microphone for collecting external sound, a sound transmitting unit for receiving or transmitting sound data transmitted from a smartphone by connecting to the smartphone by wire or wireless, And a speaker for outputting.

The smartphone includes: a GPS receiver for receiving current position information using at least one of GPS and satellite; receiving sound information collected and transmitted from the earphone-type sound collector; A control unit for transmitting the sound information to the communication unit in accordance with the positional information to the server, and a notification unit for notifying the user of the danger according to the sound information received by the communication unit.

The server includes a data collection unit for receiving the sound information and the position information sent from the smartphone, a database for storing the sound information and the position information received by the data collection unit, the sound information stored in the database, And a noise map generating unit for applying a deep running based on the position information to provide a noise map.

Wherein the noise map generation unit of the server receives the position information and the sound information stored in the database of the server and classifies the data having the same position information, The method comprising the steps of: specifying a type of noise and quantifying the magnitude of the noise; storing the designated noise type and the magnitude of the noise in the corresponding position information; transmitting the data stored in the position information and the position information to a geographic information system (GIS) To generate a visualized noise map.

The noise map display device may include a PC, a TV, a set-top box, a smart phone, or a portable terminal that can be connected to the server through wireless communication.

As described above, the present invention has an effect of collecting external sounds using earphone-type sound collecting apparatuses and providing real-time noises based on big data based on collected information.

More specifically, an external sound is collected using an earphone-type sound collecting device and transmitted to a smartphone, and a smartphone transmits external sound information to a server in correspondence with current position information. In the server, There is an effect of providing a noise map updated in real time using information.

It is to be understood that the technical advantages of the present invention are not limited to the technical effects mentioned above and that other technical effects not mentioned can be clearly understood by those skilled in the art from the description of the claims There will be.

FIG. 1 is a block diagram of a system for providing a real-time noisy map based on a big data using an earphone-type sound collector according to an embodiment of the present invention.
FIG. 2 is a block diagram of a system for providing a real-time noisy map based on a big data using an earphone-type sound collector according to an embodiment of the present invention.
3 is a flowchart illustrating an operation of the noise map generation unit according to an embodiment of the present invention.
4 is a view illustrating a wireless earphone-type sound collecting apparatus according to an embodiment of the present invention.
5 is a view showing a sound collecting apparatus of a wire earphone type according to an embodiment of the present invention.
6 is a diagram illustrating a deep learning model for noise classification in a server according to an exemplary embodiment of the present invention.
7 is a diagram illustrating a large data-based noise map according to an embodiment of the present invention.
8 is a view showing a general Convolution Neural Network structure.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. For the sake of convenience, the size, line thickness, and the like of the components shown in the drawings referenced in the description of the present invention may be exaggerated somewhat. The terms used in the description of the present invention are defined in consideration of the functions of the present invention, and thus may be changed depending on the user, the intention of the operator, customs, and the like. Therefore, the definition of this term should be based on the contents of this specification as a whole.

BRIEF DESCRIPTION OF THE DRAWINGS The present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which preferred embodiments of the invention are shown. It is not. In the following description of the embodiments of the present invention, the same components are denoted by the same reference numerals and symbols, and further description thereof will be omitted.

Prior to the detailed description of each constituent step of the present invention, terms and words used in this specification and claims should not be construed as limited to ordinary or dictionary meanings, It should be construed as meaning and concept consistent with the technical idea of the present invention based on the principle that the concept of the term can be properly defined. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are only the most preferred embodiments of the present invention and do not represent all the technical ideas of the present invention. Therefore, It is to be understood that equivalents and modifications are possible.

When an element is referred to as "including" an element throughout the specification, it is to be understood that the element may include other elements as well, without departing from the spirit or scope of the present invention. Also, the terms "part," " module, "and the like described in the specification mean units for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software .

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between .

FIG. 1 is a block diagram of a system for providing a real-time noisy sound map based on a big data using an earphone-type sound collector according to an embodiment of the present invention. Big data-based real-time noise map is a block diagram of the system.

Referring to FIG. 1 and FIG. 2, a system for providing real-time noisy map data based on earphones using a earphone-type sound collector according to an embodiment of the present invention includes an earphone-type sound collector 10, a smartphone 20, A server 30, and a noise map display device 40.

The earphone-type sound collecting device 10 may be a microphone for collecting external sounds, a sound receiver for receiving sound information transmitted from a smartphone by connecting to a smartphone by wired or wireless (for example, Bluetooth) And a speaker for outputting sound information received from the smartphone.

The earphone-type sound collecting device 10 collects external sounds using a built-in microphone and transmits sound information to the smartphone 20 through wireless or wired lines. The smartphone 20 can receive the current location information via GPS or satellite and transmit the delivery sound information to the server 30 or to the server 30 in correspondence with the current location information. The server 30 applies the sound information transmitted from the smartphone to the built-in deep-running algorithm of the sound processor to determine the type of sound and to quantify the size of the sound so that the sound type corresponding to the position information and the quantized sound size And provides a map in which the noise information is accumulated and updated in real time. The noise map display device 40 is a device that can be connected to the server 30 through wireless communication, and is a portable terminal having a set-top box, a smart phone or a display that can be connected to a PC, a TV, and a display device.

2, the smartphone 20 receives sound information collected and transmitted from the earphone-type sound collecting apparatus 10 and transmits the sound information to the server 30 using wireless communication A communication unit 21 for receiving information transmitted from the server, a GPS receiving unit 22 for receiving current position information using at least one of GPS and satellite, sound information received at the communication unit, and current position information And a notification unit 24 informing the user of the danger according to the signal received by the communication unit.

The notification unit 24 recognizes a dangerous situation when the size of the sound information collected by the earphone-type sound collecting apparatus 10 and transmitted through the communication unit 21 exceeds a certain size for a predetermined time or more, Or a warning sound is output to the speaker of the earphone-type sound collecting apparatus 10 to inform the user of the danger. As a result, it is possible to inform a user who is insensitive to the surroundings than when the earphone is not worn.

The server 30 includes a data collection unit 31 for receiving sound information and position information sent from the smartphone 20, a database 32 for storing sound information and position information received by the data collection unit 31, And a noise map generator 33 for applying noise based on the sound information and position information stored in the database 32 to provide a noise map.

3 is a flowchart illustrating an operation of the noise map generating unit according to an embodiment of the present invention.

3, the noise map generating unit 33 of the server 30 according to the embodiment of the present invention includes:

(S1), and classifies the data having the same positional information (S2). Then, the controller classifies the noise type of the held information of the classified data using the artificial intelligence And the size of the sound is quantified (S3).

The data of the designated sound type and the sound size are stored in the corresponding position information (S4), and the noise data is visualized by applying the data stored in the position information and the position information to the geographic information system (GIS) And provides a map (S5). The above process is performed every time new information is transmitted from the smartphone 20, thereby providing a real time updated noise map.

Geographic information system (Geographic information system) is an information system for converting geographical information necessary for human life into computer data and using it efficiently. An information system is a system for generating information necessary for decision making. It is a system that collects, observes, and measures information, stores it in a computer, stores it, manages it, analyzes the stored information and reflects it in decision making. In the present invention, sound information corresponds to this.

GIS is a system that integrates and manages spatial data and attribute data for objects with geographical locations and sound information according to an embodiment of the present invention to provide various forms of maps, Information can be provided.

The earphone is a compact device that converts electrical signals that can be put into or put on the ear into sound signals. It is attached to the ear canal, which is the most common type of earphone mounting type and the ear canal that connects to the ear canal. And a canal type.

In one embodiment of the present invention, the earphone-type sound collecting device is an open-type earphone, but in another embodiment, the earphone-type sound collecting device may be a kernal type.

FIG. 4 is a view illustrating a wireless earphone-type sound collector according to an embodiment of the present invention, and FIG. 5 is a view illustrating a wired earphone-type sound collector according to an embodiment of the present invention.

4 and 5, an earphone-type sound collecting apparatus according to an embodiment of the present invention includes a unit for outputting sound and a microphone for receiving an external sound, and includes a controller for data transmission.

And a wireless communication unit for communicating with the battery and the smartphone wirelessly (for example, Bluetooth, WiFi, etc.) at the bottom of the unit in case of wireless.

4 and 5, the earphone-type sound collecting device may include a unit for outputting sound and a microphone for receiving sound, but may have a separate microphone. In another embodiment Other configurations are possible.

In addition, the earphone-type sound collecting device collects sound to provide noise map data. In addition, the earphone-type sound collecting device can perform the function of the earphone and output to the speaker according to the degree of noise collected from the external microphone You can adjust the volume level.

For example, when you are on a call or listening to music, you can adjust the volume output to the speaker according to the external noise so that you can listen to the conversation and music smoothly. If you hear a loud sound such as a horn, Or by using a smartphone or earphone. For example, it notifies the earpiece speaker of the danger by emitting a warning sound or a specific ringing tone or vibrating the smartphone.

6 is a diagram illustrating a deep learning model for noise classification in a server according to an exemplary embodiment of the present invention.

Referring to FIG. 6, a deep learning model for noise classification in a server according to an embodiment of the present invention uses a Convolutional Neural Network.

FIG. 8 is a diagram illustrating a general Convolution Neural Network structure. A Convolutional Neural Network is a model that simulates a human brain function. Basically, a convolutional operation is used to extract the characteristics of a sound And various nonlinear functions such as pooling or non-linear activation functions to add nonlinear characteristics are used together. The larger the model, the greater the accuracy of object recognition, but it takes a long time. We applied a deep learning model using a convolution neural network to a server rather than a smartphone or device. This prevents the smartphone or device from being slowed down by the algorithm applied to the deep learning model and obtains accurate analysis results.

In the deep learning according to an embodiment of the present invention, a noise class such as a plane noise, a horn, a noise of a human voice, and a music sound is arbitrarily determined, a corresponding model is created by inputting corresponding data, The basic model is adjusted through classification and classifies the kind of noise.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, will be. Accordingly, the true scope of the present invention should be determined only by the appended claims.

10: Character information display device for the hearing impaired
20: Smartphones
21:
22: GPS receiver
23:
24: Notification section
30: Server
31: Data collection unit
32: Database
33: Noise map generator
40: Noise map display device

Claims (6)

A large data-based real-time noise map providing system using an earphone-type sound collector,
Earphone-shaped sound collector;
The earphone-type sound collecting device is connected to the earphone-type sound collecting device through a wired or wireless connection, receives sound information collected by the earphone-type sound collecting device, receives current position information using GPS, A smart phone capable of transmitting the location information;
A server for receiving and storing sound information and position information transmitted from the smartphone, analyzing the sound information by a built-in deep learning algorithm, and generating a noise map; And
A noise map display device (40) for visualizing and displaying a noise map generated by the server; Wherein the real-time noisy map data is generated by using the earphone-type sound collection device.
The method according to claim 1,
The earphone-type sound collecting device may include a microphone for collecting external sound, a sound transmitting unit for receiving or transmitting sound data transmitted from a smartphone by connecting to the smartphone by wire or wireless, And a speaker for outputting the sound data of the earphone. The method according to claim 1,
The smartphone includes: a GPS receiver for receiving current position information using at least one of GPS and satellite; receiving sound information collected and transmitted from the earphone-type sound collector; And a notification unit for informing the user of the risk according to the sound information received by the communication unit. The information processing apparatus according to claim 1, wherein the communication unit comprises: A Big Data - based Real - Time Noise Map Providing System Using a Sound Collector. The method according to claim 1,
The server includes a data collection unit for receiving the sound information and the position information sent from the smartphone, a database for storing the sound information and the position information received by the data collection unit, the sound information stored in the database, And a noise map generating unit for applying a deep running based on the position information to provide a noise map.
5. The method of claim 4,
The server generates a noise map.
Receiving the position information and the sound information stored in the database of the server and classifying the data having the same position information;
Designating a kind of noise of the sound information of the classified data using the artificial intelligence and quantifying the size of the sound;
Storing the designated sound type and sound size data in corresponding position information;
Applying the data stored in the location information and the location information to a geographic information system (GIS) to generate a visualized noise map; Wherein the real-time noisy map data is generated by using the earphone-type sound collection device.
The method according to claim 1,
The noise map display device includes a PC, a TV set, a set-top box, a smart phone, or a portable terminal that can be connected to the server through wireless communication. system.

Images