KR100756455B1 - Mobile device with sensing danger function and method for sensing unpxected danger sound on the mobile device - Google Patents

Abstract

The present invention is implemented in a mobile terminal having an MP3, a mobile phone, a PMP, a PSP, and other audio playback functions, and when a user listens to the audio through the mobile terminal, the user's surrounding sound is picked up and analyzed to present a risk to the user. Alerts or adjusts the audio playback feature to allow the user to determine the surrounding hazards. To this end, the present invention includes a microphone for collecting an external sound, a control unit for calculating the frequency change amount of the collected sound and calculating the speed of access to the sound based on this, and the control unit blocks the audio playback function when the access speed is increased. do.

Doppler, Decibel, Mobile Terminal, Microphone

Description

{Mobile device with sensing danger function and method for sensing unpxected danger sound on the mobile device}

1 is a view for conceptually explaining the present invention,

2 is a conceptual diagram of an example in which a mobile terminal having a risk detection function according to the present invention includes a processor and an audio processor;

3 is a conceptual diagram of an example in which a mobile terminal having a risk detection function according to the present invention includes a digital signal processor (DSP);

4 is a block diagram according to an embodiment of the present invention;

5 is a conceptual block diagram according to another embodiment of the present invention;

6 is a flow chart according to an embodiment of the present invention;

7 is a diagram illustrating an example of sampling sound in an analog-digital converter;

8 is a diagram illustrating an example of a cumulative distribution function for FIG. 7, and

FIG. 9 is a conceptual diagram illustrating a method of detecting a frequency component of sound sampled by an analog-digital converter and accumulating the frequency component to determine an approach speed.

* Description of the symbols for the main parts of the drawings *

110: microphone 120: codec

121: preamplifier 122: analog-to-digital converter

123: digital-to-analog converter 130: control unit

131: approach speed calculation unit 132: decibel calculation unit

140: flash memory 150: amplifier

The present invention relates to a mobile terminal having a risk detection function and a risk detection method. In particular, a user can use mp3, ogg, wav, WMF (MP3 file supported by Microsoft's Media Player) and ATRAC3plus (SONY MP3 compatible) as a mobile terminal. When listening to the playback sound of an audio file such as a compression technology), it detects the change in the speed of approaching the surrounding sound and based on this, judges the presence of an object moving toward the user and blocks the playback sound or warns the user. The present invention relates to a mobile terminal having a sensing function and a risk sensing method.

Conventional mobile phones, MP3, PDA (Personal Digital Assistance), PMP (Portable Media Player), mobile phones, and mobile terminals such as PSP (Play Station Portable) are mp3, ogg, wav, WMF (MP3 files supported by Microsoft's Media Player). ) And ATRAC3plus (SONY's MP3 compatible compression technology) and many other formats for playing audio files. The mobile terminal is provided with an earphone-jack (earphone-jack) for outputting the reproduced audio file, the user can listen to the audio by connecting the earphone or headphones to the earphone-jack. On the other hand, when a user listens to audio through earphones or headphones, the user often does not hear external sounds well. The user who is listening to the music may not be aware of various vehicles coming toward him, and it is often difficult to recognize the sound of a phone call or another person. If the object coming toward the user listening to the audio is a vehicle, the user is at risk of an accident. Accordingly, the present applicant is to propose a mobile terminal capable of detecting a danger coming to the user when the user listens to the audio to the mobile terminal having the audio playback function.

As described above, an object of the present invention is to receive audio when a user listens to audio through a mobile terminal, and when it is determined that there is an object moving toward the user based on a change in speed of access to the received sound, audio The purpose of the user's safety is to stop playback or provide a warning sound to the user.

According to the present invention, in the mobile terminal having an audio reproduction function, a control unit for calculating a microphone for collecting external sound, the frequency change amount of the collected sound, and calculates the access speed to the sound based on the same. The control unit is achieved by a mobile terminal having a risk detection function to block the audio playback function when the access speed is increased.

The controller may block the audio reproduction function when the volume of the collected sound exceeds a preset reference volume.

The reference volume may have any one of 70 Hz to 120 Hz.

Preferably, the controller measures an approach speed for a sound exceeding the reference volume.

The controller may pause the audio playback function when the access speed to the collected sound increases.

The controller may pause the audio reproduction function when the volume of the sound of which the access speed increases is less than the reference volume.

The controller may activate the paused audio playback function after a preset time.

Preferably, the apparatus further includes a memory for storing an audio file, and a codec for decoding the audio file, wherein the pre-amplification part may be provided in the codec to amplify the sound collected by the microphone.

The codec preferably includes a digital-to-analog converter for digital-to-analog converting the decoded audio file, and an analog-to-digital converter for analog-to-digital conversion of sound picked up by the microphone.

The memory has an alarm sound pattern in the form of a file, and the control unit applies the alarm sound pattern to the codec to reproduce the sound when the speed of access to the sound increases.

According to the present invention, in the mobile terminal capable of storing and playing audio files, a microphone for picking up external sounds, and a reference volume for decoding the audio file, the volume of the sound picked up by the microphone is provided. And a digital signal processor (DSP) measuring an access speed to the sound when the access speed is exceeded, wherein the DSP includes a risk detection function for stopping decoding of the audio file when the measured access speed is increased. Achieved by the mobile terminal.

The DSP preferably includes an audio processor for decoding the audio file, and a processor for measuring the magnitude of the collected sound volume and the access speed.

The memory device may further include a memory capable of storing the audio file and including at least one of a decoding program for the audio file, the access speed measurement program, and an alarm pattern in the form of a file.

The DSP provides the audio pattern to the audio processor when the measured approach speed is increased.

The DSP may include an analog-to-digital converter configured to analog-to-digital convert the sound collected by the microphone, and a digital-to-analog converter configured to digitally-analog convert the audio file decoded by the audio processor.

Preferably, the apparatus further includes an amplifier for amplifying the audio signal output from the analog-digital converter.

The DSP may block driving of the amplifying unit when the collected volume exceeds the reference volume.

Preferably, the DSP pauses the audio reproduction function when the access speed to the collected sound increases.

Preferably, the DSP pauses the audio reproduction function when the volume of the sound of which the access speed increases is less than the reference volume.

Preferably, the DSP activates the paused audio reproduction function after a preset time.

The reference volume may have any one of 70 Hz to 120 Hz.

The above object is to use a mobile terminal having an audio playback function, according to the present invention, collecting external sound through a microphone, calculating a speed of approach of the collected sound using a Doppler effect, and the When the calculated approach speed continues to increase with time, it is achieved by blocking the audio playback function of the mobile terminal.

delete

delete

delete

delete

delete

Preferably, the method further comprises the step of blocking the audio reproduction function when the volume of the collected sound exceeds a preset reference volume.

The speed of the sound is preferably calculated for sounds exceeding the reference volume.

When the speed of the sound is less than the reference volume, the audio reproduction function may be temporarily stopped.

Preferably, the method further includes reproducing an alarm sound through the audio reproducing function when the access speed to the sound is increased.

The above object can be performed in a mobile terminal having a processor and a memory according to the present invention, calculating an access speed for the external sound based on digital data of the external sound collected through a microphone, and When the calculated access speed increases with time, it is achieved by a storage medium including command code for performing the step of turning off the audio playback function of the mobile terminal.

Preferably, the method further comprises the step of blocking the audio reproduction function when the volume of the collected sound exceeds a preset reference volume.

Preferably, the method further comprises the step of pausing the audio playback function when the volume of the collected sound exceeds a preset reference volume.

Preferably, the method further includes reproducing an alarm sound through the audio reproducing function when the access speed to the sound is increased.

The speed of the sound is preferably calculated for sounds exceeding the reference volume.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 shows a diagram for conceptually explaining the present invention.

The present invention obtains and acquires ambient sounds of a mobile terminal through a microphone (MIC) provided in a mobile terminal such as MP3, PDA (Personal Digital Assistance), PMP (Portable Media Player), cellular phone, and PSP (Play Station Portable). By calculating the decibels of the sound and the approaching speed, it determines whether there is an object facing the user and warns the user or turns off or temporarily stops the audio function when the user listens to the audio. Allows the user to detect dangerous situations. Accordingly, the mobile terminal according to the present invention requires the function of calculating the decibel value of the sound obtained through the microphone, and the function of calculating the approach speed through the frequency change amount of the sound. To this end, the present invention,

1) a method of inserting a separate logic for calculating a decibel value for a sound obtained through a microphone and calculating a speed of approach into a mobile terminal,

2) a method of calculating the decibel value and the access speed by using a memory provided in the mobile terminal and a processor, and

3) How to integrate the decibel value calculation function and the access speed calculation function into the DSP (DSP: Digital Signal Processor) chip installed in the mobile terminal

To implement a mobile terminal having a risk detection function through.

2 is a conceptual diagram illustrating an example in which a mobile terminal having a risk detection function according to the present invention includes a processor 30 and an audio processor 20.

This embodiment includes a processor 30 for controlling a mobile terminal, and shows a conceptual diagram of a case including a separate audio processor 20 for audio reproduction. As shown, there is a processor 30 for controlling the mobile terminal, and as an additional function in the mobile terminal controlled by the processor 30, when the audio playback function is included, the mobile terminal is shown in the figure. In the same manner, two processors 20 and 30 are provided. The audio processor 20 plays a digital audio file that can be stored in a mobile terminal, and when the audio file is an MPEG format file, a codec for decompressing the audio file and a digital-analog conversion for the decompressed audio file. A digital-to-analog converter, an amplifier to amplify the digital-to-analog converted audio signal, and a pre-amplifire to preamplify the output signal of the microphone 10. At this time, the audio processor 20 obtains the decibel value for the sound by analog-to-digital conversion of the sound input through the microphone 10, and when the decibel value exceeds the reference value, the audio processor 20 blocks the audio signal provided to the earphone and allows the user to Make sure you can hear outside sounds. The reference value may be selected from a decibel value corresponding to a telephone ring sound or a car horn sound around the user. For reference, the noise level for the sound generated around the life is shown in Table 1 below.

  Noise source db Passenger car horn (within 2m) 100 Noise on railroad and textile mills 90 Noise on roadsides and trains 80 Telephone rings and typing noise 70 Normal conversation 60 Showers and office noise 50 Refrigerator noise 40 Wall clock noise 30

Referring to Table 1, when the audio processor 20 detects a sound of about 70 Hz to 100 Hz, it is preferable to block the audio signal output to the earphone. Of course, for noise above 100 Hz, the audio signal must of course be cut off. It may be determined that a vehicle or a dangerous object approaches the user that the user is exposed to the noise of 70 Hz to 100 Hz (or 100 Hz or more) during a normal life. Accordingly, the reference value is preferably set to 70 Hz or more.

3 is a conceptual diagram illustrating an example in which a mobile terminal having a risk detection function according to the present invention includes a digital signal processor (DSP). In mobile terminal such as MP3, audio playback function is the core function. Instead of using a separate processor to control MP3, it is necessary to implement MP3 control and audio playback function using DSP with ARM processor. many. In this case, the size of the MP3 is reduced due to the reduction of components constituting the MP3, and at the same time, excellent characteristics are observed in power consumption and heat generation. When the mobile terminal uses a processor-integrated DSP, an amplifier (AMP) is arranged around the DSP to amplify the decompressed and digital-to-analog audio signal from the DSP, and the user's ambient sound is set to a reference value (for example, 70 Hz). If is exceeded, control the amplifier AMP (ctrl) to decrease the volume or turn off the function of the amplifier AMP so that the user can hear surrounding sounds, or at the input of the amplifier AMP. You can insert a beep to warn you of danger. In addition, the DSP can recognize the approaching speed of the object approaching the user by analyzing the sound collected through the microphone (MIC) using the Doppler effect formula.

The following formula represents the Doppler effect.

vd)/(v

vs)f '= f * (v

vd) / (v

vs)

f ': Doppler effect frequency

f: original frequency

v: wave velocity (speed of sound waves)

vd: observer's movement (speed)

vs: Wave's movement (speed)

v is a constant value at a predetermined temperature. In this case, the velocity of the observer, vd, may be nearly zero, or may have a fixed value within a predetermined time as long as the change in velocity is not large. Thus, f 'and f can be found and then vs can be derived from the above formula. In the present specification, vs is referred to as the approach speed because vs is the velocity of an object or wave source that can be derived through measurement of the Doppler effect.

When the frequency of the ambient sound gradually increases, i.e., when the approaching speed is increased by using the Doppler effect, it is determined that a dangerous object (for example, a vehicle) approaches the user, thereby reducing or blocking the output sound of the amplifier (AMP) or a warning sound. You can output At this time, the measurement of the approach speed is preferably applied when the decibel value corresponding to the reference value. If the approach speed is high but the noise level of the sound is less than 40 Hz, it may not be desirable to block or reduce the output sound of the amplifier AMP for such a case, because the vehicle may be passing by a long distance.

Figure 4 shows a block diagram according to an embodiment of the present invention.

The illustrated embodiment shows a block diagram of an audio reproducing apparatus embedded in a mobile terminal such as an MP3, a personal digital assistant (PDA), a mobile phone, a portable media player (PMP), and a play station portable (PSP), and peripheral circuits. .

The illustrated audio reproduction apparatus includes a microphone 110, a codec 120, a controller 130, a flash memory 140, and an amplifier 150.

The microphone 110 picks up the ambient sound of the mobile terminal and provides it to the preamplifier 121. The preamplifier 150 amplifies an electric signal corresponding to the sound collected by the microphone 110 and provides it to the analog-digital converter 122. Since the electric signal output from the microphone 110 is typically only a few tens of mv, it may be determined as “no signal” when the signal is provided to the analog-digital converter 122 as it is.

The controller 130 calculates the approach speed for the sound collected through the microphone 110, and when it is determined that a dangerous object approaches the user, the controller 130 controls the codec 120 or the amplifier 150 to control the earphone (or headphone or speaker). Blocks (or reduces) the audio signal provided by. To this end, the controller 130 includes an approach speed calculator 131 that calculates the approach speed from the signal provided by the analog-to-digital converter (ADC) 122 and determines the increase and decrease of the approach speed. It includes a decibel calculation unit 132 for determining the. The controller 130 may notify the user of a danger according to each call below.

4) As a result of the determination of the approach speed calculator 131, when the frequency of the sound toward the user gradually increases, the codec 120 or the digital-to-analog converter (DAC) 123 provided in the codec 120 is controlled. To cut off the audio signal provided to the amplifier 150.

5) As a result of the determination of the approach speed calculating unit 131, when the frequency of the sound toward the user gradually increases, the codec 120 or the digital-to-analog converter (DAC) 123 provided in the codec 120 is turned. Turn off.

6) As a result of the determination of the approach speed calculator 131, when the frequency of the sound toward the user gradually increases, the volume of the amplifier 150 is adjusted or the amplifier 150 is turned off.

7) When the decibel value for sound exceeds the reference value (for example, 70 Hz), the codec 120, the digital-to-analog converter (DAC) 123, and the amplifier 150 are measured. By controlling any one of the audio output from the amplifier 150 or cut off the volume of the audio.

8) As a result of the determination of the approach speed calculating unit 131, when the frequency of the sound toward the user gradually increases, after the function of the amplifier 150 or the digital-analog converter 123 is paused, Second) to activate it so that the user can determine the surroundings.

Here, the approach speed calculator 131 may calculate the approach speed by the following method. After the sound collected through the microphone 110 is sampled by the analog-to-digital converter (ADC) 122, the amplitude or frequency component of the sampled signal is accumulated to determine the increase or decrease of the approach speed. can do. First, a method of determining an increase or decrease of an approach speed by accumulating an amplifier value will be described with reference to FIGS. 7 to 8.

7 illustrates an example of sampling sound in the analog-to-digital converter (ADC) 122. Fig. 7A shows low frequencies and Fig. 7B shows high frequencies. When (a) and (b) are sampled and accumulated at the same sampling frequency, the cumulative distribution function as shown in FIG. 8 can be obtained. At this time, the cumulative distribution function as shown in FIG. 8 accumulates a larger value for (b) than in FIG. When the external object approaches the user at high speed, that is, when the waveform of the external sound is transferred from (a) to (b), the final value of the cumulative distribution function (for example, A _total ) is increased. Here, the controller 130 may set a reference value (for example, A _th ) for the cumulative distribution function value, and determine whether the object approaches the user by comparing the final value with the reference value. For example, when the final value (eg, A _total ) exceeds the reference value (eg, A _th ), the digital-to-analog converter (DAC) 123 is controlled to cut off the audio signal provided to the amplifier AMP 150 or Can be reduced. The method of controlling the amplifier (AMP) 150 or the digital-to-analog converter (DAC) 123 by the control unit applies the above-mentioned 4) to 8).

Next, a method of determining the increase or decrease of the approach speed by accumulating frequency components will be described with reference to FIG. 9.

FIG. 9 conceptually illustrates a method of detecting a frequency component of sound sampled by an analog-to-digital converter (ADC) 122 and accumulating the frequency component to determine an approach speed.

As shown, the approach speed calculator 131 calculates the frequency of the sound sampled by the analog-to-digital converter (ADC) 122 and accumulates each of the calculated frequency values. The cumulative value increases slowly when the frequency change is small, but increases rapidly in the opposite case. Using this, the approach speed calculator 131 calculates a cumulative value for frequency per unit section (eg, section “T1”), and compares the calculated value with a reference value Th. As a result of the comparison, when the cumulative value exceeds the reference value, the digital-to-analog converter (DAC) 123 or the amplifier (AMP) 150 is controlled to cut off or reduce the audio signal provided to the user.

On the other hand, in the present embodiment, when the loudness of the sound collected by the microphone 110 exceeds a reference value (for example, 70 Hz) or the access speed increases, the amplifier 150, the codec 120, and the digital-analog converter ( 123 is controlled to reduce or block the output sound of the amplifier 150, but in addition, the amplifier 150 may provide a warning sound to the earphone (or speaker or headphone) of the user. For this purpose, an audio file for the alert sound is provided in the flash memory 140. In the case of 4) to 8) described above, the audio file stored in the flash memory 140 is provided to the digital-analog converter 123 to the user. It can provide a warning sound.

In addition, the present embodiment may divide the reference value into at least two reference values, and pause, block, and play a warning sound according to the divided reference values. For example, the controller 130 sets 70 kHz as the first reference value and 73 kHz as the second reference value, and then pauses playback when the volume of the collected sound is 70 kHz to 73 kHz and exceeds 73 kHz. In this case, any one of the amplifier 150, the codec 120, and the digital-analog converter 123 may be controlled to block the reproduction sound.

5 is a block diagram according to another embodiment of the present invention.

The illustrated embodiment is an audio playback device built around a DSP (Digital Signal Processor) in a mobile terminal such as MP3, PDA (Personal Digital Assistance), PMP (Portable Media Player), and PSP (Play Station Portable), and peripheral circuits. Represents a block diagram for.

The illustrated audio playback device includes a microphone 210, an analog-to-digital converter (ADC) 220, a DSP 230, an interface unit (I / F) 240, a USB controller 250, and a flash memory (FLASH). ) 260, a RAM 270, a digital-to-analog converter (DAC) 280, and an amplifier 290. The microphone 210 is provided for the user to record the sound of himself or the surroundings. In addition, the microphone 210 collects the surrounding sound when the user listens to the audio file stored in the flash memory (FLASH) 260 even if the user does not activate the function, the analog-to-digital converter (ADC) 220 To provide. The analog-to-digital converter (ADC) 220 converts the sound collected by the microphone 210 into a digital signal and provides it to the DSP 230. The DSP 230 includes an audio processor 231 for audio processing and a processor 232 for controlling a mobile terminal, and includes an access speed and a decibel value in a sound provided by an analog-to-digital converter (ADC) 220. Detect the risk coming to the user. In summary,

9) As a result of the determination of the processor 232, when the frequency of the sound toward the user gradually increases, the audio signal applied to the digital-to-analog converter (DAC) 280 is blocked, reduced, and suspended.

10) As a result of the determination of the processor 232, if the frequency of the sound toward the user gradually increases (control) the amplifier 290 (ctl), reducing the amplification gain of the amplifier 290 or turn the amplifier 290- Off or suspend operation of amplifier 290.

11) When the calculated decibel value exceeds the reference value (for example, 70 Hz), the audio signal applied to the digital-to-analog converter (DAC) 280 is cut off, reduced, and suspended.

12) When the frequency of the sound toward the user gradually increases but the decibel value is lower than the reference value (for example, 70 Hz), the audio signal applied to the digital-to-analog converter 280 is temporarily suspended or the amplifier 290 is driven. Pause.

In 11), the processor 232 may divide the reference value into at least two reference values and suspend, block, and play a warning sound according to the divided reference values. For example, the processor 232 sets 70 Hz as the first reference value and 73 Hz as the second reference value, and then pauses playback when the volume of the collected sound is 70 Hz to 73 Hz and exceeds 73 Hz. In this case, any one of the amplifier 290 and the digital-analog converter 280 may be controlled to block the reproduction sound.

The processor 232 may calculate the approach speed by the following method. After the sound collected through the microphone 210 is sampled by the analog-to-digital converter (ADC) 220, the amplitude or frequency component of the sampled signal is accumulated to determine the increase or decrease of the approach speed. can do. First, the method of determining the increase or decrease of the approach speed by accumulating the amplitude value is similar to that described above with reference to FIGS. 7 to 8, but in this embodiment, the processor 232 plays a role instead of the access speed calculator 131. The difference is to substitute for. Similarly, the processor 232 may calculate the approach speed by using the frequency component of the sound collected by the microphone 210 in a similar manner as described above with reference to FIG. 9, which is also described above with reference to FIG. 9 to avoid overlapping descriptions. Follow the instructions in this section.

The RAM 270 provides temporary storage space required for decompression of the audio file when the DSP 230 plays an audio file (eg, an MP3 file) stored in the flash memory (FLASH) 260. In addition, the memory 270 provides a storage space for temporary control data required when the processor 232 controls the mobile terminal. Interface unit (I / F) 240 provides an interface for connecting to an external storage medium (eg, compact flash memory, CD-ROM, SPI-ROM, and other peripherals.) Interface unit (I / F) 240 ) May include various interface logics according to peripheral devices supported by the mobile terminal, for example, a mobile terminal (eg, an MP3 player) including an audio reproducing apparatus and a peripheral circuit shown in the drawing may be connected to an external CD-ROM. If designed to be possible, the interface unit (I / F) 240 may contain AT-Attachment (ATA) interface logic for data communication with the CD-ROM, and the flash file (FLASH) 260 may contain an audio file. , A beep pattern in the form of a file, and a program file, etc. The flash memory (FLASH) 260 stores data and programs corresponding to the following arcs.

13) Audio files in formats such as MP3, ogg, wav, WMF (MP3 File supported by Microsoft's Media Player) and ATRAC3plus (SONY's MP3 compatible compression technology).

14) Beep pattern in the form of a digital file.

15) A terminal control program for controlling a mobile terminal.

16) A control program for implementing the above functions 9) to 12).

Here, the control program described in 11) means a control program including a function of calculating the speed of access to the sound collected by the microphone 210 and a decibel value calculation function of the sound collected by the microphone 210. The control program is loaded and driven by the RAM 270 and interpreted by the processor 232 or the audio processor 231 provided in the DSP 230 to convert the digital-to-analog converter (DAC) 280 or the amplifier 290. Control to implement the functions corresponding to the above 9) to 12). In addition, the control program may further include a function for each of the following calls.

17) A function of calculating the approach speed when the decibel value for the sound collected through the microphone 210 exceeds a reference value (for example, 70 Hz).

18) A function of obtaining the average value of the sound collected through the microphone 210, and determines the increase or decrease of the ambient sound based on the average value to alert the user.

Here, the average value described in 18) is a decibel average value calculated by using the user's ambient sound for 1 second, 10 seconds, 1 minute, 10 minutes, and 1 hour as the unit time, and the DSP 230 calculates the next unit from the calculated time point. If a sound exceeding the mean value is detected by time, a warning sound is provided to the user, the output of the amplifier 290 is blocked, or the volume of the amplifier 290 is changed.

6 shows a flowchart according to an embodiment of the present invention.

First, the mobile terminal equipped with the microphone 210 collects sounds around the mobile terminal through the microphone 210 (S301). The collected sound is preamplified and then analog-to-digital converted, and the DSP 230 determines an increase or decrease in an access speed for the converted sound (S302). At this time, the determination of the access speed may be performed by any one of the audio processor 231 and the processor 232 built in the DSP 230. When the calculated approach speed increases, it may be determined that the dangerous object approaches the user of the mobile terminal, and in the opposite case, the dangerous object may be determined to be far from the user. Next, when the access speed increases, the DSP 230 blocks the audio signal output to the digital-analog converter 280 or controls the amplifier 290 to block or reduce the audio signal provided to the user. It allows the user to recognize the surrounding situation (S303). In this case, the DSP 230 may provide a warning sound pattern provided in the flash memory 260 to the digital-analog converter 280 to send a warning sound to the user. On the contrary, when the access speed decreases, the DSP 230 determines whether the decibel value for the sound collected through the microphone 210 exceeds a reference value (for example, 70 Hz) (S304). As a result of the determination, when the sound collected through the microphone 210 exceeds the reference value, the user can recognize the surrounding situation by blocking the audio signal provided to the user or lowering the volume (S303). Although the present embodiment has been described with respect to a mobile terminal having a built-in DSP 230, the same applies to other mobile terminals having a general-purpose processor (for example, an ARM series processor) and a memory (for example, a flash memory and a RAM) instead of the DSP 230. Make it applicable.

10 shows a flowchart of another embodiment of the present invention.

First, when sound is collected through the microphone 110 (S401), the controller 130 calculates an average value of the collected sound (S402). The average value may be selected from a time period of 0.1 seconds to several tens of minutes, but is preferably calculated in decibels every one minute. Next, the controller 130 sets the first and second levels based on the calculated average value. The first level and the second level are set about two on the basis of the average value, and have a decibel value higher than the average value. For example, assuming that the average value of the sound collected through the microphone 110 is 60 Hz, the first level may be set to 60 Hz and the second level may be set to 63 Hz. Next, after the average value is calculated, the controller 130 compares the sound collected through the microphone 110 with the average value (S403). As a result of the comparison, when the external sound exceeds the second level, the controller controls the digital-analog converter 123 or the amplifier 150 to block audio reproduction (S504). As a result of the comparison, when the external sound exceeds the first level without exceeding the second level (S405), the controller controls the digital-to-analog converter 123 or the amplifier 150 to pause audio reproduction. . The suspended time is preferably 1 second or more.

Accordingly, when the sound collected through the microphone 110 does not significantly exceed the average level, the user may listen to the audio reproduction sound without manipulating the mobile terminal. Next, when the external sound is less than the first level, the controller 130 determines whether the approach speed of the external sound calculated by the approach speed calculating unit increases (S407). As a result of the determination, when the approaching speed increases, a warning sound is provided to the user or the audio playback function is paused so that the user can observe the surroundings. In the opposite case, the flow returns to step S402.

Although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the present invention is not limited to the specific embodiments of the present invention without departing from the spirit of the present invention as claimed in the claims. Anyone of ordinary skill in the art can make various modifications, as well as such changes are within the scope of the claims.

As described above, the present invention is embedded in a mobile terminal having an MP3, a mobile phone, a PMP, a PSP, and other audio playback functions, and when a user listens to audio through the built-in audio terminal, the sound of the user's surroundings is collected, And analysis to warn the user of the danger or adjust the audio playback function so that the user can determine the surrounding hazards.

Claims (46)

In a mobile terminal having an audio playback function, A microphone that picks up external sound; And a controller configured to calculate an amount of change in frequency of the collected sound and calculate an approach speed of the sound based on the calculated change. The control unit is a mobile terminal having a risk detection function, characterized in that for blocking the audio playback function, when the access speed is increased. The method of claim 1, The control unit, When the volume of the collected sound exceeds a predetermined reference volume, the mobile terminal having a risk detection function, characterized in that for blocking the audio playback function. The method of claim 2, The reference volume is, Mobile terminal having a risk detection function, characterized in that any one of 70 to 120㏈ value. The method of claim 3, The control unit, A mobile terminal having a risk detection function, characterized in that for measuring the approach speed for the sound exceeding the reference volume. The method of claim 4, wherein The control unit, The mobile terminal having a risk detection function, characterized in that to pause the audio playback function when the volume of the sound of increasing the access speed is less than the predetermined reference volume. The method of claim 1, The control unit, The mobile terminal having a risk detection function, characterized in that to pause the audio playback function when the access speed to the collected sound increases. The method according to claim 5 or 6, The control unit, After a preset time, the mobile terminal having a risk detection function, characterized in that for activating the pause audio playback function. The method of claim 1, A memory for storing audio files; And And a codec for decoding the audio file. The codec, a pre-amplifier for amplifying the sound collected by the microphone; mobile terminal having a risk detection function, characterized in that provided. The method of claim 8, The codec is, A digital-analog converter configured to digital-analog convert the decoded audio file; And And an analog-to-digital converter for analog-to-digital conversion of sound picked up by the microphone. The method of claim 8, The memory has an alarm tone pattern in the form of a file, The control unit, When the access speed to the sound is increased, the mobile terminal device having a risk detection function, characterized in that for reproducing by applying the alarm sound pattern to the codec. In a mobile terminal capable of storing and playing audio files, A microphone that picks up external sound; And And a digital signal processor (DSP) for decoding the audio file and measuring an access speed to the sound when the volume of the sound collected by the microphone exceeds a predetermined reference volume. And the DSP stops decoding the audio file when the measured access speed is increased. The method of claim 11, The DSP, An audio processor for decoding the audio file; And And a processor for measuring the magnitude of the collected sound volume and the approaching speed. The method of claim 12, And a memory capable of storing the audio file, the memory including at least one of a decoding program for the audio file, the access speed measurement program, and an alarm tone pattern in the form of a file. Mobile terminal. The method of claim 13, The DSP, And the alarm sound pattern is provided to the audio processor when the measured approach speed is increased. The method of claim 12, The DSP, An analog-to-digital converter configured to analog-to-digital convert the sound collected by the microphone; And And a digital-analog converter configured to digital-analog convert the audio file decoded by the audio processor. The method of claim 15, And amplifying unit for amplifying the audio signal output from the analog-digital converting unit. The method of claim 16, The DSP, When the volume of the collected volume exceeds the reference volume, the mobile terminal having a risk detection function characterized in that the driving of the amplifier block. The method of claim 11, The DSP, The mobile terminal having a risk detection function, characterized in that to pause the audio playback function when the access speed to the collected sound increases. The method of claim 11, The DSP, The mobile terminal having a risk detection function, characterized in that to pause the audio playback function when the volume of the sound of increasing the access speed is less than the reference volume. The method of claim 18 or 19, The DSP, After a preset time, the mobile terminal having a risk detection function, characterized in that for activating the pause audio playback function. The method of claim 11, The reference volume is, A mobile terminal having a risk detection function, characterized in that any value of 70 Hz to 120 Hz. delete delete delete delete delete delete delete Using a mobile terminal having an audio playback function, Collecting external sound through a microphone; Calculating an approach speed of the collected sound using a Doppler effect; And Blocking the audio reproduction function of the mobile terminal when the calculated approach speed is continuously increased with time; and detecting the risk of using the mobile terminal. The method of claim 29, And blocking the audio reproduction function when the volume of the collected sound exceeds a preset reference volume. The method of claim 29, The speed of the sound is The risk detection method using a mobile terminal, characterized in that calculated for the sound exceeding the reference volume. The method of claim 30, If the speed of the sound is less than the reference volume, Risk detection method using a mobile terminal, characterized in that to temporarily stop the audio playback function. The method of claim 30, Setting a first level of turning on and off the audio reproduction function based on the reference volume; And Setting a second level of suspending the audio playback function based on the reference volume; And the first level and the second level are volume values greater than the reference volume. The method of claim 33, wherein The second level is a risk detection method using a mobile terminal, characterized in that the volume value greater than the first level. The method of claim 29, And reproducing an alarm sound through the audio reproducing function when the speed of access to the sound is increased. Can be performed in a mobile terminal having a processor and a memory, Calculating an access speed to the external sound based on the digital data of the external sound collected through the microphone; And And when the calculated access speed increases with time, turning off an audio playback function of the mobile terminal. The method of claim 36, And blocking the audio playback function when the volume of the collected sound exceeds a predetermined reference volume. The method of claim 36, And pausing the audio playback function when the volume of the collected sound exceeds a preset reference volume. The method of claim 36, And reproducing an alarm sound through the audio reproducing function when the speed of access to the sound is increased. The method of claim 36, The speed of the sound is Storage medium, characterized in that calculated for the sound exceeding a predetermined reference volume. The method of claim 36, Calculating the approach speed, Sampling the sound for each sampling period divided into at least one and converting the sound into a digital signal, and calculating the cumulative value for the digital signal in each of the sections to determine the increase and decrease of the cumulative values; And And determining that the access speed is increased when the cumulative values are increased. The method of claim 36, Calculating the approach speed, Sampling the sound for each sampling section partitioned into at least one or more to detect a frequency component for the sound and calculate a cumulative distribution function for the sound; And And determining the increase or decrease of the approaching speed according to the increase and decrease of the cumulative distribution function. In a mobile terminal having an audio playback function, A microphone that picks up external sound; And And a controller configured to sample the sound for each sampling section partitioned into at least one and convert the sound into a digital signal, and calculate a cumulative value for the digital signal in each section to determine the increase and decrease of the cumulative values. The control unit, And a mobile terminal having a risk detection function to block the audio playback function when the calculated cumulative values increase with time. The method of claim 43, The control unit, And when the cumulative values increase with time, reducing the audio reproduction sound output by the audio reproduction function. The method of claim 43, Further comprising a memory having a sound pattern in the form of a file, And when the cumulative values increase as time passes, the controller plays the alarm sound through the audio reproducing function. In a mobile terminal having an audio playback function, A microphone that picks up external sound; And And a controller configured to detect the frequency component of the sound and calculate a cumulative distribution function for the sound by sampling the sound at each sampling interval divided into at least one or more. The control unit, And a cumulative distribution count calculated for each sampling period when the cumulative distribution number exceeds a preset reference value, the audio reproduction function being blocked.

Images